Auxiliary focusing method and device of shooting equipment, holder and focus following device

Abstract

The invention discloses an auxiliary focusing method and device of shooting equipment, a holder and a focus following device. The method comprises the following steps: acquiring an image of a current scene and depth information of a shooting object in the image; based on the image and the depth information, constructing a stereoscopic view containing the shooting object, the stereoscopic view being displayed on the interactive interface, the stereoscopic view being provided with an identifier to reflect a focal plane of a focus position of the shooting device, the identifier moving in the stereoscopic view along with the focus following operation to assist a user in determining the focus position; wherein the stereoscopic view presents the shooting object in a three-dimensional mode. According to the method, the current focus position of the shooting equipment can be visually displayed, and sufficient convenience and reliability are provided for focusing of the shooting equipment.

Description

Auxiliary focusing method, device, pan / tilt head and follow focus device for shooting equipment

[0001] manual Technical Field

[0002] The present application generally relates to the field of auxiliary control technology, and more specifically to an auxiliary focusing method, device, pan-tilt head and focus follower device for a shooting device. Background Art

[0003] Current movie cameras are equipped with pan-tilt cameras, integrating stabilization systems, radar laser focus tracking systems, and wireless image transmission control systems. The depth scope, based on the radar laser focus tracking system, provides a two-dimensional view to assist the camera in focusing. Because the two-dimensional view provided by the depth scope does not provide a three-dimensional and comprehensive display of the subject's depth and point cloud information, it is difficult for the focus puller to match the scope's graphic in the two-dimensional view with the actual subject during the focus tracking process. This is especially true when the subject is static, where the graphic becomes difficult to discern and may even obscure the subject's depth and point cloud information, ultimately leading to misjudgment by the focus puller.

[0004] Summary of the Invention

[0005] Based on the above problems, according to one aspect of the present application, an auxiliary focusing method for a shooting device is provided, the method comprising: obtaining an image of a current scene and depth information of a shooting object in the image; constructing a stereoscopic view containing the shooting object based on the image and the depth information, the stereoscopic view being displayed on an interactive interface, and a marker being provided on the stereoscopic view to reflect a focal plane of a focus position of the shooting device, the marker moving in the stereoscopic view along with a focus operation to assist a user in determining the focus position; wherein the stereoscopic view presents the shooting object in a three-dimensional manner.

[0006] According to another aspect of the present application, an assisted focusing method for a shooting device is provided, the method comprising: acquiring an image and depth data of a current scene; superimposing the depth data on the image to form and display a plan view interactive interface, wherein the plan view interactive interface is marked with a depth identifier reflecting the depth data, and the depth identifier changes with a focus operation to assist a user in determining a focal position of the shooting device.

[0007] According to another aspect of the present application, an auxiliary focusing device for a shooting device is provided, the device including a memory and a processor, the memory storing a computer program executed by the processor, and the computer program, when executed by the processor, causing the processor to perform the following operations: acquiring an image of a current scene and depth information of a shooting object in the image; constructing a stereoscopic view containing the shooting object based on the image and the depth information, the stereoscopic view being displayed on an interactive interface, the stereoscopic view being provided with an identifier to reflect a focal plane of a focus position of the shooting device, the identifier moving in the stereoscopic view along with a focus operation to assist a user in determining the focus position; wherein the stereoscopic view presents the shooting object in three dimensions.

[0008] According to another aspect of the present application, an auxiliary focusing device for a shooting device is provided, the device including a memory and a processor, the memory storing a computer program executed by the processor, and the computer program, when executed by the processor, causing the processor to perform the following operations: acquiring an image and depth data of a current scene; superimposing the depth data on the image to form and display a plan view interaction interface, wherein the plan view interaction interface is marked with a depth identifier reflecting the depth data, and the depth identifier changes with a focus operation to assist a user in determining a focus position of the shooting device.

[0009] According to another aspect of the present application, a gimbal is provided, comprising a supporting base and an auxiliary focusing device for the above-mentioned shooting equipment, wherein the shooting equipment is detachably supported on the supporting base.

[0010] According to another aspect of the present application, a follow focus device is provided, which includes a follow focus motor and the auxiliary focus device of the above-mentioned shooting equipment, wherein the follow focus motor engages with the zoom ring of the lens of the shooting equipment and drives the zoom ring to rotate.

[0011] According to another aspect of the present application, a storage medium is provided, on which a computer program executed by a processor is stored. When the computer program is executed by the processor, the processor executes the auxiliary focusing method of the above-mentioned shooting device.

[0012] The auxiliary focusing method and device of the shooting device of the present application obtain the image of the current scene and the depth information of the shooting object in the image, construct and display a stereoscopic view containing the shooting object on the interactive interface based on the image and depth information, the stereoscopic view presents the shooting object in a three-dimensional manner, and is provided with an identifier to reflect the focal plane of the focus position of the shooting device. The identifier moves in the stereoscopic view with the focus tracking operation. When the shooting device focuses on a certain shooting object, the identifier in the stereoscopic view has a clear intersection relationship with the stereoscopic shooting object, intuitively displays the current focus position of the shooting device, and provides sufficient convenience and reliability for the focusing of the shooting device. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] FIG1 shows a schematic flow chart of an auxiliary focusing method for a photographing device according to an embodiment of the present application.

[0014] FIG. 2 shows an example of a stereoscopic viewing image presented in a focusing assistance method of a photographing device according to an embodiment of the present application.

[0015] FIG. 3 shows another example diagram of a stereoscopic viewing image presented in the auxiliary focusing method of a photographing device according to an embodiment of the present application.

[0016] FIG. 4 shows another example diagram of a stereoscopic viewing image presented in the auxiliary focusing method of the photographing device according to an embodiment of the present application.

[0017] FIG. 5 shows another example diagram of a stereoscopic viewing image presented in the auxiliary focusing method of the photographing device according to an embodiment of the present application.

[0018] FIG. 6 shows another example diagram of a stereoscopic viewing image presented in the auxiliary focusing method of the photographing device according to an embodiment of the present application.

[0019] FIG. 7 shows another example diagram of a stereoscopic viewing image presented in the auxiliary focusing method of the photographing device according to an embodiment of the present application.

[0020] FIG. 8 shows another example diagram of a stereoscopic viewing image presented in the auxiliary focusing method of the photographing device according to an embodiment of the present application.

[0021] FIG9 is a flowchart illustrating an exemplary method for assisting focusing of a photographing device according to an embodiment of the present application.

[0022] FIG10 shows a schematic structural block diagram of an auxiliary focusing device of a photographing device according to an embodiment of the present application.

[0023] FIG11 shows a schematic flow chart of an auxiliary focusing method for a photographing device according to another embodiment of the present application.

[0024] FIG. 12 is a schematic diagram illustrating an exemplary embodiment of superimposing depth data on an image in a focusing assistance method for a photographing device according to an embodiment of the present application.

[0025] FIG13 shows a schematic structural block diagram of an auxiliary focusing device of a photographing device according to another embodiment of the present application.

[0026] FIG14 shows a schematic structural block diagram of a gimbal according to an embodiment of the present application. DETAILED DESCRIPTION

[0027] In order to make the purpose, technical solutions and advantages of the present application more apparent, the following is a detailed description of example embodiments of the present application with reference to the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all the embodiments of the present application, and it should be understood that the present application is not limited to the example embodiments described herein. Based on the embodiments of the present application described in this application, all other embodiments obtained by those skilled in the art without creative work should fall within the scope of protection of this application.

[0028] In the following description, a large number of specific details are provided to provide a more thorough understanding of the present application. However, it will be apparent to those skilled in the art that the present application can be implemented without one or more of these details. In other examples, some technical features well known in the art are not described in order to avoid confusion with the present application.

[0029] It should be understood that the present application can be implemented in different forms and should not be interpreted as being limited to the embodiments set forth herein. On the contrary, providing these embodiments will make the disclosure thorough and complete and will fully convey the scope of the present application to those skilled in the art.

[0030] The purpose of the terms used herein is only to describe specific embodiments and is not intended to limit the present application. When used herein, the singular forms "a", "an", and "the" are intended to include the plural forms, unless the context clearly indicates otherwise. It should also be understood that the terms "comprising" and / or "including", when used in this specification, determine the presence of the features, integers, steps, operations, elements and / or parts, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, parts and / or groups. When used herein, the term "and / or" includes any and all combinations of the relevant listed items.

[0031] In order to thoroughly understand the present application, detailed steps and detailed structures will be provided in the following description to illustrate the technical solution proposed by the present application. The preferred embodiments of the present application are described in detail below. However, in addition to these detailed descriptions, the present application may also have other implementation methods.

[0032] FIG1 shows a schematic flow chart of an auxiliary focusing method 100 for a photographing device according to an embodiment of the present application. As shown in FIG1 , the auxiliary focusing method 100 for a photographing device may include the following steps:

[0033] In step S110 , an image of the current scene and depth information of the object in the image are obtained.

[0034] In step S120, a stereoscopic view including the photographed object is constructed based on the image and depth information. The stereoscopic view is displayed on an interactive interface. An identifier is provided on the stereoscopic view to reflect a focal plane of a focal position of the photographing device. The identifier moves in the stereoscopic view along with the focus operation to assist the user in determining the focal position. The stereoscopic view presents the photographed object in three dimensions.

[0035] Specifically, the logo may be a graphic and / or text, etc.

[0036] In an embodiment of the present application, an image of the current scene and depth information of the subject in the image are obtained, and a stereoscopic view containing the subject is constructed based on the image and depth information and displayed on an interactive interface. The stereoscopic view presents the subject in three dimensions, so the subject is three-dimensional in the stereoscopic view. In addition, an indicator is provided on the stereoscopic view to reflect the focal plane of the focus position of the shooting device. The indicator moves in the stereoscopic view with the focus operation to assist the user in determining the focus position. Therefore, when the shooting device focuses on a certain subject, the indicator in the stereoscopic view has an obvious intersection relationship with the stereoscopic subject, which very intuitively reflects the current focus position of the shooting device, and provides sufficient convenience and reliability for the focusing of the shooting device.

[0037] In an embodiment of the present application, the stereoscopic view displays at least one of the following characteristics of the photographic object in the image: shape, color, or motion state. In this embodiment, the photographic object displayed in the stereoscopic view is not only three-dimensional, but can also clearly display at least one of its shape, color, and motion state (dynamic or static), so that different photographic objects can be more clearly distinguished from each other. In this way, for two photographic objects that are relatively close to each other, as long as their shapes, colors, or motion states are different, the position of the focal plane can also be clearly displayed, and the position of the focal plane will not be difficult to observe due to the close proximity of the two photographic objects, thereby further improving the focus reliability of the photographic device.

[0038] In an embodiment of the present application, the step S120 of constructing a stereoscopic view containing a photographed object based on an image and depth information may include: constructing an initial stereoscopic view based on the depth information; superimposing the pixel color information and / or pixel transparency information of the image on the initial stereoscopic view to obtain a stereoscopic view displayed on the interactive interface. This embodiment provides an example method for constructing a stereoscopic view containing a photographed object, wherein the depth information can be used to construct an initial stereoscopic view, in which the depth of the photographed object can be presented. At this time, the photographed object presented is a colorless point cloud; then, the pixel color information and / or pixel transparency information of the image is superimposed on the initial stereoscopic view, so that the photographed object in the stereoscopic view becomes a point cloud with color and shape, and has a vivid three-dimensional form. Based on such a three-dimensional form, the object intersected by the focal plane can be clearly presented, thereby providing sufficient convenience and reliability for the focusing of the shooting device.

[0039] In an embodiment of the present application, the stereoscopic view is also marked with a scale indicating the direction of movement of the cubic frame surrounding the stereoscopic view and / or the focal plane. In this embodiment, the stereoscopic view is also marked with a stereoscopic frame surrounding the stereoscopic view, which is equivalent to indicating the distance distribution of the subject in the stereoscopic view, making the depth range of the subject in the stereoscopic view clear at a glance, and the movement of the focal plane in the stereoscopic frame is also more intuitive. In addition, the stereoscopic view can be marked with a scale indicating the direction of movement of the focal plane, that is, indicating the distance required to move to the target focus, so that the moving direction and distance of the focal plane can be accurately controlled, further improving the focusing accuracy of the shooting device. Overall, in this embodiment, the stereoscopic view indicates the distance distribution of the subject, the direction to the target focus, and the distance required to move to the target focus, which can present the focus situation in a three-dimensional, intuitive, and visual way, and can play a good auxiliary focusing role regardless of whether the subject is static or dynamic.

[0040] In one embodiment of the present application, the stereoscopic view may include a focal plane, and when the focal plane cuts any photographic object in the stereoscopic view, the focal position is located on the cut photographic object.

[0041] Figure 2 illustrates an example of a stereoscopic view presented in an assisted focus method for a camera device according to an embodiment of the present application. As shown in Figure 2 , the right side region R1 of the display interface represents the current real-time image. As shown in the image on the right, the camera is currently focused on the black mouse box. Other objects, such as the apple box and office chair, are relatively blurry, with the mouse box being the clearest. Accordingly, the stereoscopic frame within the left black region R2 of the display interface represents the stereoscopic view SV. At the bottom of the stereoscopic view SV is an image frame P without depth information (associated with the current real-time image in the right side region R1). The image within the stereoscopic view SV is a "figurative" point cloud with depth information (capable of displaying the color, shape, motion, etc. of the captured object). The transparent plane within the stereoscopic view SV represents the focal plane FP. Currently, the focal plane FP cuts across the point cloud of the mouse box, indicating that the camera is currently focused on the black mouse box, consistent with the focused object displayed in the right side region R1.

[0042] FIG3 illustrates another example of a stereoscopic view presented in an assisted focusing method for a camera device according to an embodiment of the present application. As shown in FIG3 , the right side region R1 of the display interface represents the current real-time image. As shown in the right image, the camera is currently focused on the apple crate. Other objects, such as the mouse box and office chair, are relatively blurry, with the apple crate being the clearest. Accordingly, the stereoscopic frame within the left black region R2 of the display interface represents the stereoscopic view SV. At the bottom of the stereoscopic view SV is an image frame P without depth information (associated with the current real-time image within the right side region R1). The image within the stereoscopic view SV is a "figurative" point cloud with depth information (capable of displaying the color, shape, motion, etc. of the photographic object). The transparent plane within the stereoscopic view SV represents the focal plane FP. Currently, the focal plane FP cuts across the point cloud of the apple crate, indicating that the camera is currently focused on the apple crate, consistent with the focus object displayed within the right side region R1.

[0043] Figure 4 shows another example of a stereoscopic view presented in an assisted focus method for a camera according to an embodiment of the present application. As shown in Figure 4 , the right area R1 of the display interface displays the current real-time image. As shown in the right image, the camera is currently focused on the bouquet on the office chair. Other objects, such as the mouse box and apple crate, are relatively blurry, with the bouquet on the office chair being the clearest. Accordingly, the stereoscopic frame in the left black area R2 of the display interface represents the stereoscopic view SV. At the bottom of the stereoscopic view SV is an image frame P without depth information (associated with the current real-time image in the right area R1). The image in the stereoscopic view SV is a "figurative" point cloud with depth information (capable of displaying the color, shape, motion, etc. of the captured object). The transparent plane in the stereoscopic view SV represents the focal plane FP. Currently, the focal plane FP cuts across the point cloud of the bouquet, indicating that the camera is currently focused on the bouquet, consistent with the focus object displayed in the right area R1.

[0044] Figure 5 illustrates another example of a stereoscopic view presented in an assisted focus method for a camera device according to an embodiment of the present application. As shown in Figure 5 , the right area R1 of the display interface displays the current real-time image. As shown in the image on the right, the camera is currently focused on the mouse box. Other objects, such as the apple box and office chair, are relatively blurry, with the mouse box being the clearest. Accordingly, the stereoscopic frame in the black area R2 on the left side of the display interface represents the stereoscopic view SV. At the top of the stereoscopic view SV is an image frame P without depth information (associated with the current real-time image in the right area R1). The image in the stereoscopic view SV is a "figurative" point cloud with depth information (capable of revealing the color, shape, and motion of the captured object). The transparent plane in the stereoscopic view SV represents the focal plane FP. Currently, the focal plane FP cuts through the point cloud of the mouse box, indicating that the camera is currently focused on the mouse box, consistent with the focused object displayed in the right area R1. Figure 5 shows the same focused object as shown in Figure 2 , except for the different perspective of the stereoscopic view. This is because, in an embodiment of the present application, the stereoscopic view is rotatable so that the user can view the photographed object in the stereoscopic view from at least two angles, which provides more convenience, helps to improve the accuracy of focusing, and improves the user experience.

[0045] In the examples shown above in conjunction with Figures 2 through 5 , each stereoscopic view includes a focal plane. The subject cut by the focal plane represents the focal position of the camera. This intuitive display method is very helpful for accurate focusing. In another embodiment of the present application, a first marker and a second marker may be provided on the stereoscopic view, respectively reflecting the front focal plane and the rear focal plane. When the depth of field region between the first marker and the second marker contains any subject in the stereoscopic view, the focal position is located on the subject within the depth of field region. This is described below in conjunction with Figure 6 .

[0046] Figure 6 illustrates another example of a stereoscopic view presented in an assisted focus method for a camera according to an embodiment of the present invention. As shown in Figure 6, the right side region R1 of the display interface represents the current real-time image. As shown in the image on the right, the camera is currently focused on the mouse box, while other objects, such as the office chair and apple crate, are relatively blurry. The mouse box is the sharpest. Accordingly, the stereoscopic frame within the black left side region R2 of the display interface represents the stereoscopic view SV. At the bottom of the stereoscopic view SV is an image frame P (associated with the current real-time image in the right side region R1), which lacks depth information. The image within the stereoscopic view SV is a "figurative" point cloud with depth information (capable of displaying the color, shape, motion, etc. of the captured object). The two transparent planes within the stereoscopic view SV are focal planes FP1 and FP2, representing the front and back focal planes, respectively. The point cloud of the mouse box falls within the depth of field region between focal planes FP1 and FP2, indicating that the camera is currently focused on the mouse box, consistent with the focused object displayed in the right side region R1.

[0047] In the examples shown in conjunction with Figures 2 to 6 above, the stereoscopic views are all presented in a projection view mode. In the projection view mode, the size of the subject in the stereoscopic view changes as the angle of observation of the stereoscopic view changes, that is, farther subjects appear smaller, and closer subjects appear larger. In other embodiments of the present application, the stereoscopic view may further include other view modes, and in different view modes, the subject in the stereoscopic view is presented differently. For example, in one embodiment, the stereoscopic view includes a proportional view mode. In the proportional view mode, the size of the subject in the stereoscopic view does not change as the angle of observation of the stereoscopic view changes, but instead reflects the true size of the subject, as shown in Figure 7.

[0048] Figure 7 shows another example of a stereoscopic view presented using the auxiliary focus method of a camera device according to an embodiment of the present application. As shown in Figure 7, the objects in the stereoscopic view, such as a mouse box, an apple box, and a bouquet, remain the same size regardless of how the stereoscopic view is rotated or at what viewing angle. The size relationships of the different objects in the stereoscopic view reflect the size relationships of different objects in the real world.

[0049] In yet another embodiment, the stereoscopic viewing image includes a two-dimensional viewing mode. In the two-dimensional viewing mode, the photographed object in the stereoscopic viewing image is presented in a two-dimensional manner, as shown in FIG8 .

[0050] Figure 8 shows another example of a stereoscopic view presented in the assisted focus method of a camera device according to an embodiment of the present application. As shown in Figure 8, when observing the stereoscopic view from a top-down perspective, the two focal planes in the stereoscopic view become two lines, L1 and L2. The mouse box, apple box, and bouquet of flowers only show two-dimensional information from a top-down perspective, but the bouquet of flowers can still be observed to be located between L1 and L2, meaning that the bouquet of flowers is located in the depth of field region between the two focal planes.

[0051] Based on the above description in combination with Figures 2 to 8, the stereoscopic view in this application includes one or more view modes. In different view modes, the photographed objects in the stereoscopic view are presented differently, which can meet different user needs and assist the focusing of the shooting device with different view modes.

[0052] In general, the auxiliary focus method 100 for a shooting device according to an embodiment of the present application can present real-time depth data or point cloud data in a three-dimensional space, then overlay the image pixel color and transparency information in the real-time video onto the point cloud of the three-dimensional view, and finally overlay a three-dimensional space interactive interface to facilitate user observation and real-time interaction, as shown in Figure 9. Ultimately, the depth or point cloud information is vividly and accurately presented in the three-dimensional view, allowing users to select multiple angles and observe the required information in a way that maximizes their strengths and minimizes their weaknesses. The presentation of auxiliary information in the three-dimensional space (such as the aforementioned interactive elements such as the cubic frame, focal plane, and ruler) and the interactive method allow users to operate the device more vividly and accurately.

[0053] The above exemplifies the auxiliary focusing method 100 of the shooting device according to the embodiment of the present application. Based on the above description, the auxiliary focusing method 100 of the shooting device according to the embodiment of the present application obtains the image of the current scene and the depth information of the shooting object in the image, constructs and displays a stereoscopic view containing the shooting object on the interactive interface based on the image and the depth information, and presents the shooting object in a three-dimensional manner. The stereoscopic view is provided with an identifier to reflect the focal plane of the focus position of the shooting device. The identifier moves in the stereoscopic view as the focus tracking operation is performed. When the shooting device focuses on a certain shooting object, the identifier in the stereoscopic view has a clear intersection relationship with the stereoscopic shooting object, intuitively displays the current focus position of the shooting device, and provides sufficient convenience and reliability for the focusing of the shooting device.

[0054] The following describes an auxiliary focus device for a photographing device according to an embodiment of the present application in conjunction with Figure 10. Figure 10 shows a schematic structural block diagram of an auxiliary focus device 1000 for a photographing device according to an embodiment of the present application. As shown in Figure 10, the auxiliary focus device 1000 for a photographing device includes a memory 1010 and a processor 1020. The memory 1010 stores a computer program executed by the processor 1020. When the computer program is executed by the processor 1020, the processor 1020 executes the auxiliary focus method 100 for a photographing device according to an embodiment of the present application as described above. The specific process and operation of the auxiliary focus method 100 for a photographing device according to an embodiment of the present application have been described in detail above. Those skilled in the art can understand the structure and operation of the auxiliary focus device 1000 for a photographing device in combination with the above. For the sake of brevity, the details will not be repeated here, and only some main operations will be described.

[0055] In an embodiment of the present application, when the computer program is executed by the processor 1020, the processor 1020 is caused to perform the following operations: obtaining an image of the current scene and depth information of the photographed object in the image; constructing a stereoscopic view containing the photographed object based on the image and the depth information, the stereoscopic view being displayed on an interactive interface, and an identifier being provided on the stereoscopic view to reflect a focal plane of the focus position of the photographing device, the identifier moving in the stereoscopic view as the focus is followed to assist the user in determining the focus position; wherein the stereoscopic view presents the photographed object in three dimensions.

[0056] In an embodiment of the present application, the stereoscopic viewing image displays at least one of the following items of the photographed object: shape, color, and motion state.

[0057] In an embodiment of the present application, the processor 1020 constructs a stereoscopic view including the photographed object based on the image and depth information, including: constructing an initial stereoscopic view based on the depth information; superimposing the pixel color information and / or pixel transparency information of the image on the initial stereoscopic view to obtain a stereoscopic view displayed on the interactive interface.

[0058] In an embodiment of the present application, a scale indicating the moving direction of the cubic frame and / or the focal plane surrounding the stereoscopic view is further marked on the stereoscopic view.

[0059] In an embodiment of the present application, when the focal plane cuts any photographic object in the stereoscopic view, the focus position is located on the cut photographic object.

[0060] In an embodiment of the present application, a first marker and a second marker are provided on the stereoscopic view, reflecting the front focal plane and the rear focal plane, respectively. When the depth of field area between the first marker and the second marker includes any photographic object in the stereoscopic view, the focus position is on the photographic object within the depth of field area.

[0061] In an embodiment of the present application, the stereoscopic view is rotatable so that the user can view the object in the stereoscopic view from at least two angles.

[0062] In the embodiment of the present application, the stereoscopic viewing image includes one or more viewing modes. In different viewing modes, the photographed object in the stereoscopic viewing image is presented in different ways.

[0063] In an embodiment of the present application, the stereoscopic viewing mode includes a projection viewing mode. In the projection viewing mode, the size of the photographed object in the stereoscopic viewing mode changes as the observed angle of the stereoscopic viewing mode changes.

[0064] In an embodiment of the present application, the stereoscopic viewing image includes a proportional viewing mode. In the proportional viewing mode, the size of the photographed object in the stereoscopic viewing image does not change with the change of the observed angle of the stereoscopic viewing image.

[0065] In an embodiment of the present application, the stereoscopic viewing image includes a two-dimensional viewing mode. In the two-dimensional viewing mode, the photographed object in the stereoscopic viewing image is presented in a two-dimensional manner.

[0066] Based on the above description, the auxiliary focusing device 1000 of the shooting device according to the embodiment of the present application obtains the image of the current scene and the depth information of the shooting object in the image, constructs and displays a stereoscopic view containing the shooting object on the interactive interface based on the image and the depth information, and presents the shooting object in three dimensions, and is provided with an identifier to reflect the focal plane of the focus position of the shooting device. The identifier moves in the stereoscopic view with the focus operation. When the shooting device focuses on a certain shooting object, the identifier in the stereoscopic view has an obvious intersection relationship with the stereoscopic shooting object, which intuitively displays the current focus position of the shooting device, and provides sufficient convenience and reliability for the focusing of the shooting device.

[0067] The following describes an auxiliary focus method for a photographing device according to another embodiment of the present application in conjunction with FIG11. FIG11 shows a schematic flow chart of an auxiliary focus method 1100 for a photographing device according to another embodiment of the present application. As shown in FIG11, the auxiliary focus method 1100 for a photographing device may include the following steps:

[0068] In step S1110 , the image and depth data of the current scene are acquired.

[0069] In step S1120, the depth data is superimposed on the image to form and display a plan view interactive interface. The plan view interactive interface is marked with a depth indicator reflecting the depth data. The depth indicator changes with the focus operation to assist the user in determining the focus position of the shooting device.

[0070] In an embodiment of the present application, the depth data of the current scene is superimposed on the image of the current scene to form and display a planar view interactive interface, wherein the depth data is converted into a depth identifier. As the focus position changes, the depth identifier also changes, thereby being able to intuitively display the focus position. The depth identifier is superimposed on the image, thereby intuitively displaying the focused object, providing sufficient convenience and reliability for the focusing of the shooting device.

[0071] In an embodiment of the present application, the depth identification may include any one of the following: isobaths, grid lines, and dot matrices; wherein the attribute information of the isobaths, grid lines, or dot matrices changes with the focus operation, so that the user can identify the focus position.

[0072] In an embodiment of the present application, the attribute information of the depth contours includes at least one of the following: line color, transparency, and line thickness; relative to the depth contours away from the focal position, the depth contours closer to the focal position have a lighter line color, a higher line transparency, and a thinner line. In this embodiment, the depth contours are superimposed on the image as depth markers. By identifying the line color, line transparency, and line thickness of the depth contours, the focal position can be identified. The depth contours are superimposed on the image, so that objects in the image can be clearly identified and focused. Here, relative to the depth contours away from the focal position, the depth contours closer to the focal position have a lighter line color, a higher line transparency, and a thinner line. This is merely exemplary. In other examples, relative to the depth contours away from the focal position, the depth contours closer to the focal position may also have a darker line color, a lower line transparency, a thicker line, or other possible combinations of line attributes.

[0073] In an embodiment of the present application, the attribute information of the grid lines includes at least one of the following: line color, transparency, line thickness, and grid density; relative to the grid lines far from the focus position, the line color of the grid near the focus position is lighter, the line transparency is higher, the lines are thinner, and the grid is sparser. In this embodiment, the grid lines are superimposed on the image as a depth marker. By identifying the line color, line transparency, line thickness, and grid density of the grid lines, the focus position can be identified. The grid lines are superimposed on the image, so that objects in the image can be clearly identified and focused. Here, relative to the grid lines far from the focus position, the line color of the grid near the focus position is lighter, the line transparency is higher, the lines are thinner, and the grid is sparser. This is only exemplary. In other examples, relative to the grid lines far from the focus position, the grid near the focus position may also have darker line color, lower line transparency, thicker lines, denser grid, or other possible combinations of line and grid attributes.

[0074] In an embodiment of the present application, the attribute information of the dot matrix includes at least one of the following: dot color, dot transparency, dot size, and dot density; the dots in the dot matrix near the focal position have lighter colors, higher transparency, smaller sizes, and are more sparsely populated compared to the dots in the dot matrix far from the focal position. In this embodiment, the dot matrix is ​​superimposed on the image as a depth marker. By identifying the color, transparency, size, and density of the dots in the dot matrix, the focal position can be identified. The dot matrix is ​​superimposed on the image, enabling objects in the image to be clearly identified and focused. Here, the dots in the dot matrix near the focal position have lighter colors, higher transparency, smaller sizes, and are more sparsely populated compared to the dots in the dot matrix far from the focal position. This is merely exemplary. In other examples, the dots in the dot matrix near the focal position may also have darker colors, lower transparency, larger sizes, and denser dots, or other possible attribute combinations, compared to the dots in the dot matrix far from the focal position.

[0075] In general, superimposing a depth marker on an image can identify the distance distribution of objects in the image and the area where the current depth of field is located. It can also identify the direction of movement to the target focus and the distance required to move to the target focus. Specifically, isobaths can well show the distance distribution of objects in the image, grid lines can more intuitively show the depth of the image, and dot matrices can also show the distribution of object distances and the area where the depth of field is located through color gradients or transparency. The direction of movement required to reach the target focus can be achieved by coloring the isobaths or grids. The distance required to move to the target focus can be judged by the target focus isobaths and the current focus isobaths, or by the color or transparency of the grid lines, or by the density and granularity of the dot matrix, etc., making it very easy to follow the focus.

[0076] FIG12 is an exemplary schematic diagram showing the superposition of depth data on an image in the auxiliary focus method of a shooting device according to an embodiment of the present application. As shown in FIG12 , the white grid lines in the image are depth identifiers generated based on the depth data (areas in the image where no grid lines are superimposed, such as the roof in the upper right corner, are areas where the depth data has not yet covered), which are superimposed on the image. As can be seen from FIG12 , the size, shape and other grid attributes of the grids at different positions are different, which can be used to judge the depth of different objects in the image. In addition, as the focused object changes, the depth identifier will change, thereby being able to judge the current focus position.

[0077] The above exemplifies the auxiliary focusing method 1100 for a photographing device according to an embodiment of the present application. Based on the above description, the auxiliary focusing method 1100 for a photographing device according to an embodiment of the present application superimposes the depth data of the current scene on the image of the current scene to form and display a planar view interactive interface, wherein the depth data is converted into a depth identifier. As the focus position changes, the depth identifier also changes, thereby intuitively displaying the focus position. The depth identifier is superimposed on the image, thereby intuitively displaying the focused object, providing sufficient convenience and reliability for focusing of the photographing device.

[0078] The following describes an auxiliary focus device for a photographing device according to another embodiment of the present application in conjunction with Figure 13. Figure 13 shows a schematic structural block diagram of an auxiliary focus device 1300 for a photographing device according to another embodiment of the present application. As shown in Figure 13, the auxiliary focus device 1300 for a photographing device includes a memory 1310 and a processor 1320. The memory 1310 stores a computer program executed by the processor 1320. When the computer program is executed by the processor 1320, the processor 1320 executes the auxiliary focus method 1100 for a photographing device according to an embodiment of the present application as described above. The specific process and operation of the auxiliary focus method 1100 for a photographing device according to an embodiment of the present application have been described in detail above. Those skilled in the art can understand the structure and operation of the auxiliary focus device 1300 for a photographing device in combination with the above. For the sake of brevity, the details will not be repeated here, and only some main operations will be described.

[0079] In an embodiment of the present application, when the computer program is executed by the processor 1320, the processor 1320 performs the following operations: obtaining an image and depth data of the current scene; superimposing the depth data on the image to form and display a plan view interactive interface, wherein the plan view interactive interface is marked with a depth identifier reflecting the depth data, and the depth identifier changes with the focus operation to assist the user in determining the focus position of the shooting device.

[0080] In an embodiment of the present application, the depth marker includes any one of the following: isobaths, grid lines, and dot matrices; the attribute information of the isobaths, grid lines, or dot matrices changes with the focus operation, so that the user can identify the focus position.

[0081] In an embodiment of the present application, the attribute information of the isobath includes at least one of the following: line color, transparency, and line thickness; compared with the isobaths far away from the focus position, the isobaths close to the focus position have lighter line color, higher line transparency, and thinner lines.

[0082] In an embodiment of the present application, the attribute information of the grid lines includes at least one of the following: line color, transparency, line thickness, and grid density; compared with the grid lines far away from the focus position, the line color of the grid close to the focus position is lighter, the line transparency is higher, the lines are thinner, and the grid is sparser.

[0083] In an embodiment of the present application, the attribute information of the dot matrix includes at least one of the following: the color of the dots, the transparency of the dots, the size of the dots, and the density of the dots; compared with the dot matrix far away from the focus position, the dots of the dot matrix close to the focus position have lighter colors, higher transparency, smaller sizes, and are sparser.

[0084] Based on the above description, the auxiliary focusing device 1300 of the shooting device according to the embodiment of the present application superimposes the depth data of the current scene on the image of the current scene to form and display a planar view interactive interface, wherein the depth data is converted into a depth identifier. As the focus position changes, the depth identifier also changes, thereby being able to intuitively display the focus position. The depth identifier is superimposed on the image, thereby intuitively displaying the focused object, providing sufficient convenience and reliability for the focusing of the shooting device.

[0085] According to another aspect of the present application, a gimbal is provided, which will be described below in conjunction with FIG14 . FIG14 shows a schematic structural block diagram of a gimbal 1400 according to an embodiment of the present application. As shown in FIG14 , the gimbal 1400 includes a supporting seat 1410 and an auxiliary focus device 1420 for a shooting device, wherein the shooting device is detachably supported on the supporting seat 1410. The auxiliary focus device 1420 for the shooting device may be the auxiliary focus device 1000 or 1300 for the shooting device according to the embodiment of the present application described above. The structure and operation of the auxiliary focus device 1000 or 1300 of the shooting device have been described in detail above. Those skilled in the art will understand the structure and operation of the auxiliary focus device 1420 of the shooting device in combination with the above description. For the sake of brevity, they will not be described here in detail.

[0086] According to another aspect of the present application, a follow focus device is provided, which may include a follow focus motor and the auxiliary focus device 1000 or 1300 for a photographic device according to the embodiments of the present application described above. The follow focus motor engages with the zoom ring of the lens of the photographic device and drives the zoom ring to rotate. The structure and operation of the auxiliary focus device 1000 or 1300 for the photographic device have been described in detail above. Those skilled in the art will understand the structure and operation of the auxiliary focus device for the photographic device in the follow focus device of the present application in combination with the above description. For the sake of brevity, these details will not be repeated here.

[0087] In other embodiments, the auxiliary focusing device 1000 or 1300 of the shooting device according to the embodiment of the present application can also be set in the shooting device, or set independently.

[0088] In addition, according to an embodiment of the present application, a storage medium is further provided, on which program instructions are stored, and when the program instructions are executed by a computer or a processor, the corresponding steps of the auxiliary focus method of the shooting device of the embodiment of the present application are executed. The storage medium may include, for example, a memory card of a smart phone, a storage component of a tablet computer, a hard disk of a personal computer, a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a portable compact disk read-only memory (CD-ROM), a USB memory, or any combination of the above storage media. The computer-readable storage medium may be any combination of one or more computer-readable storage media.

[0089] Based on the above description, the auxiliary focusing method and device of the shooting device according to the embodiment of the present application can intuitively display the current focus position of the shooting device, providing sufficient convenience and reliability for the focusing of the shooting device.

[0090] Although example embodiments have been described herein with reference to the accompanying drawings, it should be understood that the above example embodiments are merely illustrative and are not intended to limit the scope of the present application. Various changes and modifications may be made therein by those skilled in the art without departing from the scope and spirit of the present application. All such changes and modifications are intended to be included within the scope of the present application as required by the appended claims.

[0091] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians can use different methods to implement the described functions for specific applications, but such implementation should not be considered beyond the scope of this application.

[0092] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the units described is merely a logical function division. In actual implementation, other division methods may be used, such as combining or integrating multiple units or components into another device, or ignoring or not performing some features.

[0093] In the description provided herein, a large number of specific details are described. However, it is understood that the embodiments of the present application can be practiced without these specific details. In some instances, well-known methods, structures, and techniques are not shown in detail so as not to obscure the understanding of this description.

[0094] Similarly, it should be understood that in order to streamline the present application and aid in understanding one or more of the various inventive aspects, in the description of the exemplary embodiments of the present application, the various features of the present application are sometimes grouped together into a single embodiment, figure, or description thereof. However, this approach to the present application should not be interpreted as reflecting the intention that the application claimed for protection requires more features than those explicitly recited in the claims. More precisely, as reflected in the corresponding claims, the inventive point is that the corresponding technical problem can be solved with fewer features than all the features of a single disclosed embodiment. Therefore, the claims following the detailed description are hereby expressly incorporated into the detailed description, with the claims themselves serving as separate embodiments of the present application.

[0095] Those skilled in the art will understand that, except where mutually exclusive, all features disclosed in this specification (including the accompanying claims, abstract, and drawings) and all processes or units of any method or apparatus disclosed herein may be combined in any combination. Unless expressly stated otherwise, features disclosed in this specification (including the accompanying claims, abstract, and drawings) may be replaced by alternative features that provide the same, equivalent, or similar purpose.

[0096] Furthermore, those skilled in the art will appreciate that although some embodiments described herein include certain features included in other embodiments but not other features, combinations of features from different embodiments are intended to be within the scope of this application and to form different embodiments. For example, in the claims, any of the claimed embodiments may be used in any combination.

[0097] The various component embodiments of the present application can be implemented in hardware, or in a software module running on one or more processors, or in a combination thereof. Those skilled in the art will appreciate that a microprocessor or digital signal processor (DSP) can be used in practice to implement some or all of the functions of some modules according to the embodiments of the present application. The application can also be implemented as a device program (for example, a computer program and a computer program product) for performing a part or all of the methods described herein. Such a program implementing the present application can be stored on a computer-readable storage medium, or can have the form of one or more signals. Such a signal can be downloaded from an Internet website, or provided on a carrier signal, or provided in any other form.

[0098] It should be noted that the above embodiments illustrate rather than limit the present application, and that those skilled in the art may devise alternative embodiments without departing from the scope of the appended claims. In the claims, any reference symbols placed between brackets should not be construed as limiting the claims. The present application may be implemented by means of hardware comprising several different elements and by means of a suitably programmed computer. In a unit claim enumerating several means, several of these means may be embodied by the same item of hardware. The use of the words first, second, and third, etc. does not indicate any order. These words may be interpreted as names.

[0099] The above description is merely a specific embodiment or illustration of a specific embodiment of the present application, and the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in the present application should be included in the scope of protection of the present application. The scope of protection of the present application should be based on the scope of protection of the claims.

Claims

1. A focusing assist method for a photographing device, characterized in that: The method comprises: Acquire an image of a current scene and depth information of a photographed object in the image; constructing a stereoscopic view including the photographed object based on the image and the depth information, displaying the stereoscopic view on an interactive interface, and providing a marker on the stereoscopic view to reflect a focal plane of a focus position of the photographing device, wherein the marker moves in the stereoscopic view in response to a focus operation to assist a user in determining the focus position; The stereoscopic viewing image presents the photographed object in a three-dimensional manner.

2. The method according to claim 1, characterized in that The stereoscopic viewing image displays at least one of the following items of the photographed object in the image: shape, color, and motion state.

3. The method according to claim 1, characterized in that The constructing a stereoscopic view including the photographed object based on the image and the depth information includes: constructing an initial stereoscopic view based on the depth information; The pixel color information and / or pixel transparency information of the image is superimposed on the initial stereoscopic viewing image to obtain a stereoscopic viewing image displayed on the interactive interface.

4. The method according to claim 1, wherein The stereoscopic image is also marked with a scale indicating the moving direction of the cubic frame surrounding the stereoscopic image and / or the focal plane.

5. The method according to any one of claims 1 to 4, characterized in that When the focal plane cuts any photographic object in the stereoscopic view, the focus position is located on the cut photographic object.

6. The method according to any one of claims 1 to 4, characterized in that The stereoscopic view is provided with a first marker and a second marker, which respectively reflect the front focal plane and the back focal plane. When the depth of field area between the first marker and the second marker contains any photographic object in the stereoscopic view, the focus position is on the photographic object within the depth of field area.

7. The method according to any one of claims 1 to 4, characterized in that The stereoscopic view is rotatable so that a user can view the object in the stereoscopic view from at least two angles.

8. The method according to any one of claims 1 to 4, characterized in that The stereoscopic viewing image includes one or more viewing modes. In different viewing modes, the shooting object in the stereoscopic viewing image is presented in different ways.

9. The method according to claim 8, characterized in that The stereoscopic viewing image includes a projection viewing mode. In the projection viewing mode, the size of the photographed object in the stereoscopic viewing image changes as the observed angle of the stereoscopic viewing image changes.

10. The method according to claim 8, characterized in that The stereoscopic viewing image includes a proportional viewing mode. In the proportional viewing mode, the size of the photographed object in the stereoscopic viewing image does not change with the change of the observed angle of the stereoscopic viewing image.

11. The method according to claim 8, characterized in that The stereoscopic viewing image includes a two-dimensional viewing mode. In the two-dimensional viewing mode, the photographed object in the stereoscopic viewing image is presented in a two-dimensional manner.

12. A focusing assist method for a photographing device, characterized in that: The method comprises: Get the image and depth data of the current scene; The depth data is superimposed on the image to form and display a plan view interactive interface, wherein the plan view interactive interface is marked with a depth mark reflecting the depth data, and the depth mark changes with the focus operation to assist the user in determining the focus position of the shooting device.

13. The method according to claim 12, characterized in that The depth marker includes any one of the following: isobaths, grid lines, and dot matrix; The attribute information of the isobaths, the grid lines or the dot matrix changes with the focus operation, so that the user can identify the focus position.

14. The method according to claim 13, characterized in that The attribute information of the depth contour includes at least one of the following: line color, transparency, and line thickness; Compared with the isobaths far from the focal position, the isobaths close to the focal position have lighter colors, higher transparency, and are thinner.

15. The method according to claim 13, characterized in that The attribute information of the grid lines includes at least one of the following: line color, transparency, line thickness, and grid density; Compared with the grid lines far from the focus position, the grid lines close to the focus position are lighter in color, more transparent, thinner, and more sparse.

16. The method according to claim 15, characterized in that The attribute information of the dot matrix includes at least one of the following: the color of the dot, the transparency of the dot, the size of the dot, and the density of the dot; Compared with the dot matrix far from the focal position, the dots of the dot matrix close to the focal position have lighter colors, higher transparency, smaller sizes, and are more sparse.

17. An auxiliary focusing device for a photographing device, characterized in that: The apparatus includes a memory and a processor, wherein a computer program executed by the processor is stored in the memory, and when the computer program is executed by the processor, the processor performs the following operations: Acquire an image of a current scene and depth information of a photographed object in the image; constructing a stereoscopic view including the photographed object based on the image and the depth information, displaying the stereoscopic view on an interactive interface, and providing a marker on the stereoscopic view to reflect a focal plane of a focus position of the photographing device, wherein the marker moves in the stereoscopic view in response to a focus operation to assist a user in determining the focus position; The stereoscopic viewing image presents the photographed object in a three-dimensional manner.

18. The device according to claim 17, characterized in that The stereoscopic viewing image displays at least one of the following items of the photographed object in the image: shape, color, and motion state.

19. The device according to claim 17, characterized in that The processor constructs a stereoscopic view including the photographed object based on the image and the depth information, including: constructing an initial stereoscopic view based on the depth information; The pixel color information and / or pixel transparency information of the image is superimposed on the initial stereoscopic viewing image to obtain a stereoscopic viewing image displayed on the interactive interface.

20. The device according to claim 17, wherein The stereoscopic image is also marked with a scale indicating the moving direction of the cubic frame surrounding the stereoscopic image and / or the focal plane.

21. The device according to any one of claims 17 to 20, characterized in that When the focal plane cuts any photographic object in the stereoscopic view, the focus position is located on the cut photographic object.

22. The device according to any one of claims 17 to 20, characterized in that The stereoscopic view is provided with a first marker and a second marker, which respectively reflect the front focal plane and the back focal plane. When the depth of field area between the first marker and the second marker contains any photographic object in the stereoscopic view, the focus position is on the photographic object within the depth of field area.

23. The device according to any one of claims 17 to 20, characterized in that The stereoscopic view is rotatable so that a user can view the object in the stereoscopic view from at least two angles.

24. The method according to any one of claims 17 to 20, characterized in that The stereoscopic viewing image includes one or more viewing modes. In different viewing modes, the shooting object in the stereoscopic viewing image is presented in different ways.

25. The device according to any one of claims 24, characterized in that The stereoscopic viewing image includes a projection viewing mode. In the projection viewing mode, the size of the photographed object in the stereoscopic viewing image changes as the observed angle of the stereoscopic viewing image changes.

26. The device according to any one of claims 24, characterized in that The stereoscopic viewing image includes a proportional viewing mode. In the proportional viewing mode, the size of the photographed object in the stereoscopic viewing image does not change with the change of the observed angle of the stereoscopic viewing image.

27. The device according to any one of claims 24, characterized in that The stereoscopic viewing image includes a two-dimensional viewing mode. In the two-dimensional viewing mode, the photographed object in the stereoscopic viewing image is presented in a two-dimensional manner.

28. An auxiliary focusing device for a photographing device, characterized in that: The apparatus includes a memory and a processor, wherein a computer program executed by the processor is stored in the memory, and when the computer program is executed by the processor, the processor performs the following operations: Get the image and depth data of the current scene; The depth data is superimposed on the image to form and display a plan view interactive interface, wherein the plan view interactive interface is marked with a depth mark reflecting the depth data, and the depth mark changes with the focus operation to assist the user in determining the focus position of the shooting device.

29. The device according to claim 28, characterized in that The depth marker includes any one of the following: isobaths, grid lines, and dot matrix; The attribute information of the isobaths, the grid lines or the dot matrix changes with the focus operation, so that the user can identify the focus position.

30. The device according to claim 29, characterized in that The attribute information of the depth contour includes at least one of the following: line color, transparency, and line thickness; Compared with the isobaths far from the focal position, the isobaths close to the focal position have lighter colors, higher transparency, and are thinner.

31. The device according to claim 29, characterized in that The attribute information of the grid lines includes at least one of the following: line color, transparency, line thickness, and grid density; Compared with the grid lines far from the focus position, the grid lines close to the focus position are lighter in color, more transparent, thinner, and more sparse.

32. The device according to claim 29, characterized in that The attribute information of the dot matrix includes at least one of the following: the color of the dot, the transparency of the dot, the size of the dot, and the density of the dot; Compared with the dot matrix far from the focal position, the dots of the dot matrix close to the focal position have lighter colors, higher transparency, smaller sizes, and are more sparse.

33. A pan / tilt head, characterized in that: The pan / tilt head includes a supporting seat and the auxiliary focusing device of the shooting equipment according to any one of claims 17 to 32, wherein the shooting equipment is detachably supported on the supporting seat.

34. A follow focus device, characterized in that: The follow focus device includes a follow focus motor and the auxiliary focus device of the shooting equipment according to any one of claims 17 to 32, wherein the follow focus motor engages with the zoom ring of the lens of the shooting equipment and drives the zoom ring to rotate.

35. A storage medium, characterized in that The storage medium stores a computer program executed by a processor. When the computer program is executed by the processor, the processor executes the auxiliary focusing method for a photographing device according to any one of claims 1 to 16.

Images