Multi-camera focusing method, apparatus, device, and storage medium

Abstract

The present application relates to display device technical field, specifically to a kind of multi-camera focusing method, device, equipment and storage medium, the present application includes: when conference panel displays the first picture of first camera shooting, control second camera executes pre-focusing operation, obtains the pre-focusing information of focusing object, obtains target picture of second camera shooting;According to target picture, determine the real-time focusing information of focusing object;According to real-time focusing information and pre-focusing information, control second camera keeps focusing focusing object.By the present application, when first camera displays, control second camera pre-focusing operation is carried out to the focusing object collected jointly in advance, on the one hand, it does not affect the current display process of first camera, on the other hand, when receiving switching instruction, second camera can smoothly and quickly display clear picture.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of display devices, in particular to a multi-camera focusing method, device, equipment and storage medium. BACKGROUND

[0002] In a video conference of a conference tablet, it may be necessary to switch the same panoramic image to a picture of local conference personnel, at which time multiple cameras in the conference tablet need to work together.

[0003] In the prior art, after the panoramic display picture is switched from the first camera to the second camera for displaying the local conference personnel, the second camera starts focusing on the local conference personnel, but this prior method has a slow focusing process and a short-term blurred picture after switching, resulting in a display delay and unclear picture of the local conference personnel. SUMMARY

[0004] An object of an embodiment of the present application is to provide a multi-camera focusing method, device, equipment and storage medium to solve the technical problems of picture delay and unclear picture when multiple cameras switch conference pictures in a video conference.

[0005] In a first aspect, an embodiment of the present application provides a multi-camera focusing method applied to a conference tablet, wherein the conference tablet includes a first camera and a second camera, and the method includes:

[0006] When the conference tablet displays a first picture captured by the first camera, a pre-focusing operation of the second camera is controlled to obtain pre-focusing information of a focusing object, and the focusing object is a focusing object captured by the first camera and the second camera together.

[0007] In response to a camera switching command, a target picture captured by the second camera is obtained, and the camera switching command is used to instruct the conference tablet to switch from displaying the first picture captured by the first camera to displaying the target picture captured by the second camera.

[0008] Real-time focusing information of the focusing object is determined according to the target picture.

[0009] The second camera is controlled to keep focusing on the focusing object according to the real-time focusing information and the pre-focusing information.

[0010] With reference to the first aspect, in a possible implementation manner, when the conference panel displays the first picture captured by the first camera, the second camera is controlled to perform a pre-focusing operation to obtain pre-focusing information of the focusing object, including: obtaining a second picture captured by the second camera; determining a picture overlap area according to the first picture and the second picture; and determining the pre-focusing information of the focusing object according to the picture overlap area.

[0011] With reference to the first aspect, in a possible implementation manner, the conference panel further includes a motor configured to adjust a position of the second camera, and the determining the pre-focusing information of the focusing object according to the picture overlap area includes: determining whether the picture overlap area contains the focusing object; if yes, determining the pre-focusing information of the focusing object; and if no, controlling the motor to adjust the second camera to capture the second picture again.

[0012] With reference to the first aspect, in a possible implementation manner, the determining whether the picture overlap area contains the focusing object includes: extracting an object in the picture overlap area; determining whether the object meets a preset focusing condition; if yes, determining that the object is the focusing object; and if no, controlling the motor to adjust the second camera to capture the second picture again.

[0013] With reference to the first aspect, in a possible implementation manner, the pre-focusing information includes pre-object information, a pre-focusing position, and a pre-rotation position of the focusing object, and the determining the pre-focusing information of the focusing object includes: recording the pre-object information and the pre-focusing position of the focusing object, the pre-object information including identity information and pre-object size information of the focusing object; and determining the pre-rotation position of the motor when the second camera captures the second picture.

[0014] With reference to the first aspect, in a possible implementation manner, the real-time focusing information includes real-time object information, a real-time focusing position, and a real-time rotation position of the focusing object, and the determining the real-time focusing information of the focusing object according to the target picture includes: recording the real-time object information and the real-time focusing position of the focusing object at a current time, the real-time object information including identity information and real-time object size information of the focusing object; and determining the real-time rotation position of the motor at the current time.

[0015] With reference to the first aspect, in a possible implementation manner, the controlling the second camera to keep focusing on the focus object according to the real-time focusing information and the pre-focusing information comprises: calculating an object offset of the focus object according to the real-time focusing information and the pre-focusing information; determining whether the object offset is less than a preset offset threshold; if yes, controlling the second camera to keep focusing on the focus object according to the pre-focusing information; and if no, controlling the second camera to refocus on the focus object.

[0016] With reference to the first aspect, in a possible implementation manner, the object offset comprises a position offset and / or an object size offset, the real-time focusing information comprises real-time focusing position and real-time object size information, the pre-focusing information comprises pre-focusing position and pre-object size information, and the calculating the object offset of the focus object according to the real-time focusing information and the pre-focusing information comprises: calculating a difference between the real-time focusing position and the pre-focusing position to obtain the position offset, and / or calculating a difference between the real-time object size information and the pre-object size information to obtain the object size offset.

[0017] The second aspect, the embodiment of the present application provides a multi-camera focusing device, applied to a conference tablet, characterized in that the conference tablet comprises a first camera and a second camera, comprising:

[0018] a control unit configured to control the second camera to perform a pre-focusing operation when the conference tablet displays a first picture captured by the first camera, to obtain pre-focusing information of a focus object, the focus object being a focus object captured by the first camera and the second camera together;

[0019] an acquisition unit configured to acquire a target picture captured by the second camera in response to a camera switching command, the camera switching command being used to instruct the conference tablet to switch from displaying the first picture captured by the first camera to displaying the target picture captured by the second camera;

[0020] a determination unit configured to determine real-time focusing information of the focus object according to the target picture;

[0021] the control unit is further configured to control the second camera to keep focusing on the focus object according to the real-time focusing information and the pre-focusing information.

[0022] In the third aspect, a conference tablet comprises:

[0023] a housing;

[0024] a first camera disposed on the housing;

[0025] a second camera disposed on the housing, wherein a position of the second camera on the housing is different from a position of the first camera on the housing;

[0026] a motor connected to the first camera and the second camera, respectively;

[0027] a controller electrically connected to the first camera, the second camera and the motor, configured to control the motor to adjust the position of the second camera, wherein the controller comprises a memory and a processor, the memory is connected to the processor, the processor is configured to execute one or more computer programs stored in the memory, and the processor, when executing the one or more computer programs, causes the conference tablet to implement the method of the first aspect.

[0028] In a fourth aspect, a computer device is provided, comprising a memory and one or more processors, the memory is connected to the one or more processors, and the one or more processors are configured to execute one or more computer programs stored in the memory, and the one or more processors, when executing the one or more computer programs, cause the computer device to implement the method of the first aspect.

[0029] In a fifth aspect, a computer readable storage medium is provided, the computer readable storage medium stores a computer program, the computer program comprises program instructions, and the program instructions, when executed by a processor, cause the processor to execute the method of the first aspect.

[0030] In the scheme implemented by the multi-camera focusing method, device, equipment and storage medium, when the conference tablet displays the first picture taken by the first camera, the second camera is first controlled to perform a pre-focusing operation to obtain pre-focusing information of a focusing object, the focusing object is a focusing object collected by the first camera and the second camera, secondly, in response to a camera switching command, a target picture taken by the second camera is obtained, the camera switching command is used to instruct the conference tablet to switch from displaying the first picture taken by the first camera to displaying the target picture taken by the second camera, then, real-time focusing information of the focusing object is determined according to the target picture, and finally, the second camera is controlled to keep focusing on the focusing object according to the real-time focusing information and the pre-focusing information. Through the scheme, the second camera can be controlled to perform a focusing operation on the common focusing object in advance when the first camera is displayed, and then the target picture can be focused in the background without affecting the current display picture of the first camera, and when the target picture is switched to, the target picture is dynamically adjusted according to the real-time focusing and pre-focusing information of the target picture, so as to achieve smooth and clear display of the target picture. BRIEF DESCRIPTION OF DRAWINGS

[0031] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed to be used in the description of the embodiments of the present application will be briefly introduced as follows. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor on the basis of these drawings.

[0032] Figure 1A is a hardware architecture diagram of a conference tablet in an embodiment of the present application;

[0033] Figure 1B is a module diagram of a conference tablet in an embodiment of the present application;

[0034] Figure 1C is a scene diagram of a conference tablet in an embodiment of the present application;

[0035] Figure 2 is a flowchart of a multi-camera focusing method in an embodiment of the present application;

[0036] Figure 3 is a picture overlapping area diagram in an embodiment of the present application;

[0037] Figure 4 is a structural diagram of a multi-camera focusing device in an embodiment of the present application;

[0038] Figure 5 is a structural diagram of a computer device in an embodiment of the present application. DETAILED DESCRIPTION

[0039] In order to make the purpose, technical solutions and advantages of the present application more clear, the present application will be further described in detail below in combination with the drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and do not limit the present application. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative labor are within the scope of protection of the present application.

[0040] It should be noted that each feature in the embodiments of the present application can be combined with each other without conflict, and all within the scope of protection of the present application. In addition, although the functional modules are divided in the device schematic diagram, and the logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in a different order from the module division in the device or the order in the flowchart. Furthermore, the "first", "second", "third" and the like used in the present application do not limit the data and execution order, but only distinguish the same items or similar items with basically the same function and effect.

[0041] The technical solution of this application is applicable to various meeting scenarios, such as remote meetings.

[0042] The technical solution of this application can be specifically applied to a conference flat panel, which can be a multi-functional imaging device with display, broadcasting, recording, etc., specifically such as a television screen, monitor, and electronic whiteboard. For ease of understanding, the conference flat panel of this application will first be introduced.

[0043] See Figure 1A , Figure 1A This is a schematic diagram of the hardware structure of a conference tablet provided in an embodiment of this application, as shown below. Figure 1A As shown, the conference tablet 10 includes a display panel 101, a microphone array 102, a camera module 103, a controller 104, and a motor 105. The display panel 101 displays video stream images captured by the camera module 103. The microphone array 102 is used to locate sound source information in the scene and calculate the sound source orientation angle. The layout of the microphone array 102 can be a linear array, a planar array, or a stereo array. The camera module 103 includes at least one camera, mainly used to acquire scene images or video streams. It can be a fixed-focus camera, a zoom camera, or a combination of both. In this solution, the camera module 102 may include a first camera and a second camera, where the first camera is designated as the main camera and the second camera as the secondary camera. The controller 104 is electrically connected to the first camera, the second camera, and the motor 105, respectively, and is used to control the motor to adjust the position of the second camera. The controller 104 includes a memory and a processor. The memory and the processor are devices used to store and process signals from various sensors, such as processing audio information captured by the microphone array 102 or video information captured by the camera. The motor 106 is used to adjust the position of the camera module 103 in the conference tablet 10.

[0044] Among them, such as Figure 1B As shown, the conference tablet 10 includes four main functional modules: a camera image acquisition module, which mainly acquires raw video information through two or more cameras; a target position calculation module, which calculates the position and approximate distance of the target object based on the raw audio and video information; an electronic focusing module, which performs focusing operations on the camera based on the position of the target object; and a camera switching module, which switches between different cameras as needed.

[0045] like Figure 1C As shown, Figure 1C The image shown is displayed on the panel of the conference tablet. For example, in a video conference, the conference tablet controls the first camera to capture a panoramic view of the current conference room, such as... Figure 1CAs shown in the left part of FIG. 1, when receiving the switching instruction, the second camera is controlled to switch the screen, and the second camera shooting area is as shown in the middle part of FIG. 1. Figure 1C As shown in the middle part of FIG. 1, finally, the second camera collects the screen as shown in the right part of FIG. 1 on the conference panel. Figure 1C

[0046] The application will be described in detail below through specific embodiments.

[0047] Please refer to Figure 2 , Figure 2 A flowchart of a multi-camera focusing method provided by an embodiment of the application is shown in FIG. 1, which is applied to a conference panel, and the conference panel comprises a first camera and a second camera. The method comprises the following steps:

[0048] S10, when the conference panel displays a first screen shot by the first camera, the second camera is controlled to perform a pre-focusing operation to obtain pre-focusing information of a focusing object, and the focusing object is a focusing object collected by the first camera and the second camera.

[0049] The conference panel further comprises a motor, which can adjust the position of the second camera and the position of the first camera.

[0050] Specifically, the motor as a control device of the camera can be controlled by a user of the camera or an automatic system to adjust the direction, focal length, stability and other parameters of the camera to achieve different shooting requirements and functions. For example, the motor can rotate, tilt or translate the camera to change the angle and field of view of the shot; the motor can also adjust the position of the camera according to the posture of the camera to reduce shaking and blur, which is beneficial to shooting stable videos or clear photos; the motor is also used to automatically adjust the direction of the camera to track moving targets.

[0051] For example, in the present scheme, the conference panel displays a first screen shot by the first camera in the display panel, starts the second camera, determines a common collection area of the second camera and the first camera, obtains a focusing object in the common collection area, locks the focusing object by the second camera, and the controller in the conference panel uses the motor to control the second camera to change the focal length or lens position to ensure that the focusing object is always within the focal point range.

[0052] The shooting range of the first camera is greater than the shooting range of the second camera.

[0053] Optionally, the common collected focusing object is a plurality of focusing objects, and the second camera is controlled to perform a pre-focusing operation on the plurality of focusing objects in turn to obtain pre-focusing information of each focusing object in the plurality of focusing objects. ​

[0054] The pre-focusing operation refers to the operation of pre-focusing the focusing object captured by the first camera and the second camera in the background while the first camera displays the first picture.

[0055] The focusing information refers to various information and data used to help the camera module achieve correct focusing. These information helps to ensure that the target is clear and sharp. The focusing information can include, but is not limited to, focusing point position information, contrast information, depth information, automatic focusing algorithm output, tracking information, and rotation position. The focusing point position information refers to the focus point position in the image measured or calculated by the camera, usually expressed in pixel coordinates or focus distance. The focusing point position information is used to adjust the lens position or focal length to ensure accurate focus. The rotation position refers to the rotation position of the motor after focusing.

[0056] The pre-focusing information in the present scheme refers to various information and data used to achieve correct focusing. The pre-focusing information can include pre-focusing position and pre-rotation position, and can also include identity information of the focusing object. The identity information is used to distinguish each focusing object in multiple focusing objects, and the pre-focusing position and pre-rotation position corresponding to each focusing object are combined into sub-pre-focusing information.

[0057] Optionally, the focusing object can be multiple objects, i.e., each object in the multiple objects has its own sub-pre-focusing information, which forms the pre-focusing information.

[0058] As can be seen, when the conference panel displays the first picture taken by the first camera, the second camera is controlled to perform the pre-focusing operation. Since the pre-focusing operation is performed before the actual shooting of the second camera, the focusing time can be significantly reduced, which is beneficial for quickly switching the camera or capturing important moments without waiting for the camera to focus. The pre-focusing operation helps to reduce the problem of image blur or unclearness caused by incorrect focal length or inaccurate focusing of the camera, and further improves the automation and intelligence of the conference panel.

[0059] S20, in response to the camera switching command, obtaining a target picture taken by the second camera, the camera switching command being used to instruct the conference panel to switch from displaying the first picture taken by the first camera to displaying the target picture taken by the second camera.

[0060] For example, the switching process in step S20 can refer to the above Figure 1C .

[0061] The camera switching command is used to switch multiple cameras in the conference tablet. The camera switching command is issued to ensure that the images of the conference, live broadcast or recording can be switched and adjusted as needed, such as displaying different pictures taken by different cameras in the display panel of the conference tablet. The camera switching command is issued by various entities or devices, depending on the application scenario and system design. For example, the camera switching command can be manually issued in the display panel or controlled by voice instructions, such as the verbal command "Hey, Assistant", which is not limited here.

[0062] Optionally, in response to the camera switching command, the conference tablet switches from displaying the first picture taken by the first camera to displaying the target picture taken by the second camera. At this time, the first picture is not presented in the display panel of the conference tablet, and the display panel only presents the target picture taken by the second camera.

[0063] It can be seen that by responding to the switching command, the conference tablet is switched from displaying the picture of the first camera to the target picture of the second camera, which makes the picture switching more smooth. Further, by switching to the picture of the second camera, the audience can obtain information of different angles and perspectives, highlighting the richness of multiple cameras and providing more comprehensive information. It can be further concluded that the visual content of the conference can be flexibly controlled according to the operation of switching the camera, so as to dynamically adjust the display of the camera according to the progress or needs of the conference.

[0064] S30, determining real-time focusing information of the focusing object according to the target picture.

[0065] The real-time focusing information can be real-time object information, real-time focusing position and real-time rotation position at the current time. The real-time object information includes identity information and real-time object size information of the focusing object, and the identity information can distinguish each focusing object.

[0066] It can be seen that before step S40 is implemented, by obtaining the real-time focusing information in the target picture, instant feedback can be obtained during the shooting process, ensuring the focusing processing mode of the target image in the subsequent steps.

[0067] S40, controlling the second camera to keep focusing on the focusing object according to the real-time focusing information and the pre-focusing information.

[0068] The object offset can be calculated according to the focusing position in the real-time focusing information and the focusing position of the same focusing object in the pre-focusing information, and it is determined whether the object offset is less than a preset offset threshold. If the object offset is less than the preset offset threshold, the second camera is controlled to keep focusing on the focusing object according to the pre-focusing information. If the object offset is greater than the preset offset threshold, the second camera is controlled to refocus on the focusing object.

[0069] The object offset is usually expressed in pixels or other units, and is used to measure whether the focusing object deviates from the expected position. The object offset can be calculated according to the real-time focusing position and the pre-focusing position of the same focusing object. If the object offset is less than or equal to the preset offset threshold, it is considered that the focusing object is still within an acceptable range, and no large focusing adjustment is needed. If the object offset is greater than the preset threshold, it is considered that the focusing object has deviated from the ideal position, and a large focusing adjustment is needed.

[0070] The preset offset threshold can be 0-5mm, which can be set manually and is not limited herein.

[0071] Specifically, there are multiple focusing objects A, B and C. If the object offset of the real-time focusing position and the pre-focusing position of the focusing object A is greater than the preset object offset, it is determined that A has a large position change and has exceeded the position range in which the pre-focusing position can be focused clearly. Therefore, A is refocused in real time, and the pre-focusing information corresponding to A is deleted and replaced with the focusing information of the real-time focusing of A. If the object offset of the real-time focusing position and the pre-focusing position of B and C is less than the preset object offset, it is determined that B and C do not have a large position change. Therefore, B and C are directly focused using the pre-focusing information corresponding to B and C, and a fast focusing effect can be achieved.

[0072] It can be seen that by comparing the difference between the real-time focusing information and the pre-focusing information of the focusing object, it can be quickly determined which focusing objects in the target picture have deviated and have exceeded the pre-focusing record range. If the pre-focusing information is used for the focusing objects that have deviated, it may cause the picture to be blurred or distorted. In this case, the focusing objects that have deviated are refocused in real time, a clear picture can be obtained, and the focusing action is hidden to ensure the visual effect.

[0073] In an embodiment, when the conference panel displays the first picture captured by the first camera, the second camera is controlled to perform a pre-focusing operation to obtain pre-focusing information of a focusing object, including: acquiring a second picture captured by the second camera; determining a picture overlap region according to the first picture and the second picture; and determining the pre-focusing information of the focusing object according to the picture overlap region.

[0074] For example, reference can be made to Figure 3 For example, reference can be made toFigure 3 As shown, the first camera picture in the figure is the first picture of the present scheme, and the second camera picture is the second picture of the present scheme. As shown, the overlapping area is the second picture, and the focused object collected together can be obtained in the overlapping area.

[0075] The process of obtaining the second picture and determining the overlapping area is unknown to the user, i.e. it runs in the background of the conference tablet, and therefore does not affect the display effect of the currently displayed first picture.

[0076] As can be seen, by determining the picture overlapping area, the changes in the meeting can be quickly responded to, and the focus can be adjusted accordingly, which helps to adapt to different shooting needs, such as switching focal length or focusing on different focused objects.

[0077] In an embodiment, the conference tablet further comprises a motor for adjusting the position of the second camera. The pre-focusing information of the focused object determined according to the picture overlapping area comprises: determining whether the picture overlapping area contains a focused object; if it contains, determining the pre-focusing information of the focused object; if it does not contain, controlling the motor to adjust the second camera to re-shoot the second picture.

[0078] The motor is a mechanical device for changing the position or direction of the second camera, i.e. for adjusting the orientation or angle of the second camera, to ensure that it can be aligned with the shooting object or the specific area of the picture.

[0079] In the picture overlapping area, whether there is a focused object can be determined according to image recognition and detection algorithms.

[0080] As can be seen, by determining whether the picture overlapping area contains a focused object, and then controlling the motor to adjust the position of the second camera, the problem of misfocus can be avoided.

[0081] In an embodiment, the determination of whether the picture overlapping area contains a focused object comprises: extracting the object of the picture overlapping area; determining whether the object meets a preset focusing condition; if it meets, determining that the object is a focused object; if it does not meet, controlling the motor to adjust the second camera to re-shoot the second picture.

[0082] The object of the picture overlapping area can be extracted by conventional image recognition or image detection technology.

[0083] The preset focusing condition is used to evaluate the focus of the extracted object to determine whether it meets the preset focusing condition. The focusing condition can include the sharpness, distance, position or other visual properties of the object.

[0084] If the focusing condition is not met, it can mean that the object is blurred, moved out of the frame or is no longer the focus. In this case, measures will be taken to control the motor to adjust the position or angle of the second camera to re-shoot the second frame and re-find the focusing object.

[0085] As can be seen, by detecting the focusing condition of the object in the frame overlap area, timely adjustment can be made to correct the focusing error and ensure that the camera provides a clear image.

[0086] In an embodiment, the pre-focusing information includes pre-object information, a pre-focusing position and a pre-rotation position of the focusing object, and the determination of the pre-focusing information of the focusing object includes: recording the pre-object information and the pre-focusing position of the focusing object, the pre-object information including identity information and pre-object size information of the focusing object; determining the pre-rotation position of the motor when the second camera obtains the second frame.

[0087] The identity information includes the identification of the focusing object, such as the name or label of the object, so as to identify and track a specific object; the pre-object size information can describe the relative size of the object in the frame, which helps the conference tablet to better compare the features of the focusing object.

[0088] As can be seen, the identity information, size information and motor rotation position when the focusing is successful of each focusing object are saved during the pre-focusing process, so that the pre-focusing information can be quickly retrieved for focusing on the focusing object during subsequent switching, reducing the delay of frame switching and improving the smoothness of multi-camera switching.

[0089] In an embodiment, the real-time focusing information includes real-time object information, a real-time focusing position and a real-time rotation position of the focusing object, and the determination of the real-time focusing information of the focusing object according to the target frame includes: recording the real-time object information and the real-time focusing position of the focusing object at the current time, the real-time object information including identity information and real-time object size information of the focusing object; determining the real-time rotation position of the motor at the current time.

[0090] The identity information includes the identification of the focusing object, such as the name or label of the object, so as to identify and track a specific object; the real-time object size information can describe the relative size of the object in the frame, which helps the conference tablet to better compare the features of the focusing object.

[0091] As can be seen, through the real-time focusing information, adjustment can be made quickly when the scene or the focusing object changes, ensuring that the focus is not lost. Whether the focusing object is moving or changing, the focusing can be quickly adjusted to ensure that the frame remains clear and the display quality of the switched frame is guaranteed.

[0092] In an embodiment, the controlling the second camera to keep focusing on the focusing object according to the real-time focusing information and the pre-focusing information comprises: calculating an object offset of the focusing object according to the real-time focusing information and the pre-focusing information; determining whether the object offset is less than a preset offset threshold; if yes, controlling the second camera to keep focusing on the focusing object according to the pre-focusing information; if no, controlling the second camera to refocus on the focusing object.

[0093] The object offset refers to the difference between the actual focusing object position and the predetermined focusing position, which can be calculated by comparing the real-time focusing position and the pre-focusing position.

[0094] The preset offset threshold can be 0-5mm and can be set manually. The preset offset threshold is used to determine whether the object is close enough to the predetermined focusing position. If the object offset is less than the threshold, it means that the object is not far from the predetermined focusing position and can be considered to have been well focused. If the object offset is greater than the preset offset threshold, it means that the object has deviated from the predetermined focusing position, and the second camera will be controlled to refocus on the object. The control process can include adjusting the focal length, angle or position of the camera to bring the object back to the focus point.

[0095] As can be seen, by comparing the object offset with the offset threshold, it can be determined whether each focusing object should maintain the current focus or refocus to ensure that the focusing object remains clear at all times.

[0096] In an embodiment, the object offset includes a position offset and / or an object size offset, the real-time focusing information includes real-time focusing position and real-time object size information, the pre-focusing information includes pre-focusing position and pre-object size information, and the calculating the object offset of the focusing object according to the real-time focusing information and the pre-focusing information comprises: calculating the difference between the real-time focusing position and the pre-focusing position to obtain the position offset, and / or calculating the difference between the real-time object size information and the pre-object size information to obtain the object size offset.

[0097] The calculation of the object offset can use mathematical calculation or image processing technology. For example, a coordinate system can be used to represent the real-time focusing position and the pre-focusing position, and then the distance between them is calculated to obtain the position offset. For the object size offset, image processing technology can be used to measure the actual size of the object and compare it with the expected size.

[0098] For example, the difference between the real-time focusing position and the pre-focusing position can be calculated to obtain the position offset, which can be calculated by the following formula:

[0099] X coordinate offset = X coordinate of real-time focusing position - X coordinate of pre-focusing position

[0100] Y coordinate offset = Y coordinate of real-time focusing position - Y coordinate of pre-focusing position If the pre-focusing position is (120, 180) and the real-time focusing position is (100, 200), the following can be obtained:

[0101] X coordinate offset = 100 - 120 = -20

[0102] Y coordinate offset = 200 - 180 = 20

[0103] Therefore, the position offset is (-20, 20), which means that the current position deviates from the expected position by 20 units on the X axis (to the left) and by 20 units on the Y axis (upward).

[0104] As can be seen, by calculating the object offset, whether it is a position offset or an object size offset, more accurate focusing adjustment can be performed according to the offset result, so as to ensure that the focusing object remains clear at all times.

[0105] In the scheme implemented by the multi-camera focusing method, device, equipment and storage medium, when the conference panel displays the first picture captured by the first camera, the second camera is first controlled to perform a pre-focusing operation to obtain pre-focusing information of a focusing object, the focusing object being the focusing object captured by the first camera and the second camera. Secondly, in response to a camera switching command, a target picture captured by the second camera is obtained, the camera switching command being used to instruct the conference panel to switch from displaying the first picture captured by the first camera to displaying the target picture captured by the second camera. Then, real-time focusing information of the focusing object is determined according to the target picture. Finally, the second camera is controlled to keep focusing on the focusing object according to the real-time focusing information and the pre-focusing information. Through the scheme, the second camera can be controlled to perform a focusing operation on the common focusing object in advance when the first camera is displayed, so that the target picture can be focused in the background without affecting the current display picture of the first camera. When the target picture is switched to, the target picture can be dynamically adjusted according to the real-time focusing and pre-focusing information of the target picture, so that the target picture can be displayed smoothly and clearly.

[0106] The method of the present application is described above, and the device of the present application is described below.

[0107] Referring to Figure 4 , Figure 4 is a structural schematic diagram of a multi-camera focusing device provided by an embodiment of the present application. As shown in Figure 4As shown, the multi-camera focusing device is applied to a conference tablet, and the conference tablet comprises a first camera and a second camera, and comprises:

[0108] The control unit 401 is configured to control the second camera to perform a pre-focusing operation to obtain pre-focusing information of a focusing object when the conference tablet displays a first picture captured by the first camera, wherein the focusing object is a focusing object captured by the first camera and the second camera together.

[0109] The acquisition unit 402 is configured to acquire a target picture captured by the second camera in response to a camera switching command, wherein the camera switching command is used to instruct the conference tablet to switch from displaying the first picture captured by the first camera to displaying the target picture captured by the second camera.

[0110] The determination unit 403 is configured to determine real-time focusing information of the focusing object according to the target picture.

[0111] The control unit 401 is further configured to control the second camera to keep focusing on the focusing object according to the real-time focusing information and the pre-focusing information.

[0112] In an embodiment, in the process of controlling the second camera to perform a pre-focusing operation to obtain pre-focusing information of a focusing object when the conference tablet displays a first picture captured by the first camera, the control unit 401 is further configured to acquire a second picture captured by the second camera, determine a picture overlap area according to the first picture and the second picture, and determine the pre-focusing information of the focusing object according to the picture overlap area.

[0113] In an embodiment, the conference tablet further comprises a motor configured to adjust the position of the second camera, and in the process of determining the pre-focusing information of the focusing object according to the picture overlap area, the determination unit 403 is further configured to determine whether the picture overlap area contains the focusing object, and if yes, determine the pre-focusing information of the focusing object, and if not, control the motor to adjust the second camera to recapture the second picture.

[0114] In an embodiment, in the process of determining whether the picture overlap area contains the focusing object, the determination unit 403 is further configured to extract an object in the picture overlap area, determine whether the object meets a preset focusing condition, and if yes, determine that the object is the focusing object, and if not, control the motor to adjust the second camera to recapture the second picture.

[0115] In an embodiment, the pre-focusing information comprises pre-object information, a pre-focusing position and a pre-rotation position of the focusing object, and the determining unit 403 is further configured to: determine the pre-object information and the pre-focusing position of the focusing object, wherein the pre-object information comprises identity information and pre-object size information of the focusing object; and determine the pre-rotation position of the motor when the second camera obtains the second image.

[0116] In an embodiment, the real-time focusing information comprises real-time object information, a real-time focusing position and a real-time rotation position of the focusing object, and the determining unit 403 is further configured to: record the real-time object information and the real-time focusing position of the focusing object at a current time, wherein the real-time object information comprises identity information and real-time object size information of the focusing object; and determine the real-time rotation position of the motor at the current time.

[0117] In an embodiment, in the step of controlling the second camera to keep focusing on the focusing object according to the real-time focusing information and the pre-focusing information, the control unit 401 is further configured to: calculate an object offset of the focusing object according to the real-time focusing information and the pre-focusing information; determine whether the object offset is less than a preset offset threshold; if yes, control the second camera to keep focusing on the focusing object according to the pre-focusing information; and if no, control the second camera to refocus on the focusing object.

[0118] In an embodiment, the object offset comprises a position offset and / or an object size offset, the real-time focusing information comprises a real-time focusing position and real-time object size information, and the pre-focusing information comprises a pre-focusing position and pre-object size information, and in the step of calculating the object offset of the focusing object according to the real-time focusing information and the pre-focusing information, the control unit 401 is further configured to: calculate a difference between the real-time focusing position and the pre-focusing position to obtain the position offset, and / or calculate a difference between the real-time object size information and the pre-object size information to obtain the object size offset.

[0119] In the scheme implemented by the multi-camera focusing method, device, equipment and storage medium, when the conference panel displays the first picture captured by the first camera, the second camera is first controlled to perform a pre-focusing operation to obtain pre-focusing information of a focusing object, the focusing object being the focusing object captured by the first camera and the second camera; secondly, in response to a camera switching command, a target picture captured by the second camera is obtained, the camera switching command being used to instruct the conference panel to switch from displaying the first picture captured by the first camera to displaying the target picture captured by the second camera; then, real-time focusing information of the focusing object is determined according to the target picture; and finally, the second camera is controlled to keep focusing on the focusing object according to the real-time focusing information and the pre-focusing information. Through the scheme, the second camera can be controlled to perform a focusing operation on the focusing object captured by the first camera and the second camera in advance when the first camera is displaying, so that the target picture can be focused on in the background without affecting the current display picture of the first camera, and when the target picture is switched to, the target picture can be dynamically adjusted according to the real-time focusing and pre-focusing information of the target picture, so that the target picture can be displayed smoothly and clearly.

[0120] Referring to Figure 5 , Figure 5 is a structural schematic diagram of a computer device provided by an embodiment of the present application, and the computer device can be a display. As shown in Figure 5 , the computer device 50 includes a processor 501 and a memory 502. The memory 502 is connected to the processor 501, for example, through a bus.

[0121] The processor 501 is configured to support the computer device 50 to perform corresponding functions in the methods in the method embodiments. The processor 501 can be a central processing unit (CPU), a network processor (NP), a hardware chip or any combination thereof. The hardware chip can be an application specific integrated circuit (ASIC), a programmable logic device (PLD) or a combination thereof. The PLD can be a complex programmable logic device (CPLD), a field-programmable gate array (FPGA), a generic array logic (GAL) or any combination thereof.

[0122] Specifically, the processor 501 can include a sending card, a receiving card, and a driving chip.

[0123] The memory 502 is configured to store program codes and the like. The memory 502 can include a volatile memory (VM), such as a random access memory (RAM), and / or a non-volatile memory (NVM), such as a read-only memory (ROM), a flash memory, a hard disk drive (HDD), or a solid-state drive (SSD), and / or a combination thereof.

[0124] The processor 501 can invoke the program codes to perform the following operations:

[0125] When the conference panel displays a first picture captured by a first camera, a pre-focusing operation is controlled to be performed on a second camera to obtain pre-focusing information of a focusing object, the focusing object being a focusing object captured by both the first camera and the second camera;

[0126] In response to a camera switching command, a target picture captured by the second camera is obtained, the camera switching command being used to instruct the conference panel to switch from displaying the first picture captured by the first camera to displaying the target picture captured by the second camera;

[0127] Real-time focusing information of the focusing object is determined according to the target picture;

[0128] The second camera is controlled to keep focusing on the focusing object according to the real-time focusing information and the pre-focusing information.

[0129] The embodiments of the present application also provide a computer readable storage medium, which stores a computer program, the computer program including program instructions, the program instructions causing a computer to execute the method according to the foregoing embodiments when the computer executes the program instructions.

[0130] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by a computer program instructing related hardware. The program can be stored in a computer readable storage medium, and when the program is executed, the processes of the above-mentioned embodiment methods can be included. The storage medium can be a magnetic disc, an optical disc, a read-only memory (ROM), a random access memory (RAM), or the like.

[0131] The above disclosure is only the preferred embodiment of the present application, and of course cannot limit the scope of the right of the present application, so the equivalent changes made according to the claims of the present application still belong to the scope covered by the present application.

Claims

1. A multi-camera focusing method, applied to a conference tablet, characterized in that, The conference tablet includes a first camera and a second camera, and the method includes: When the conference tablet displays the first image captured by the first camera, it controls the second camera to perform a pre-focusing operation to obtain the pre-focusing information of the focus object, which is the focus object jointly acquired by the first camera and the second camera. In response to a camera switching command, the system acquires the target image captured by the second camera. The camera switching command instructs the conference tablet to switch from displaying the first image captured by the first camera to displaying the target image captured by the second camera. Determine the real-time focus information of the object to be focused based on the target image; The second camera is controlled to maintain focus on the target object based on the real-time focus information and the pre-focus information.

2. The method according to claim 1, characterized in that, When the conference tablet displays the first image captured by the first camera, it controls the second camera to perform a pre-focusing operation to obtain pre-focusing information of the object to be focused, including: Acquire the second image captured by the second camera; Determine the overlapping area of ​​the images based on the first and second images; The pre-focus information of the object to be focused is determined based on the overlapping area of ​​the image.

3. The method according to claim 2, characterized in that, The conference tablet also includes a motor, which is used to adjust the position of the second camera. The step of determining the pre-focus information of the focus object based on the overlapping area of ​​the image includes: Determine whether the overlapping area of ​​the image contains the object in focus; If included, the pre-focus information of the object to be focused is determined; If not included, control the motor to adjust the second camera and re-capture the second scene.

4. The method according to claim 3, characterized in that, The step of determining whether the overlapping area of ​​the image contains the focus object includes: Extract the objects in the overlapping area of ​​the image; Determine whether the object meets the preset focus conditions; If the conditions are met, then the object is determined to be the focus object; If the conditions are not met, the motor is controlled to adjust the second camera to re-capture the second scene.

5. The method according to claim 3, characterized in that, The pre-focus information includes pre-object information, pre-focus position, and pre-rotation position of the object to be focused. The pre-focus information for determining the object to be focused includes: Record the pre-object information and pre-focus position of the object to be focused, wherein the pre-object information includes the identity information and pre-object size information of the object to be focused; The pre-rotation position of the motor is determined when the second camera obtains the second image.

6. The method according to claim 3, characterized in that, The real-time focus information includes the real-time object information, real-time focus position, and real-time rotation position of the focus object. Determining the real-time focus information of the focus object based on the target image includes: Record the real-time object information and real-time focus position of the focused object at the current time. The real-time object information includes the identity information and real-time object size information of the focused object. Determine the real-time rotation position of the motor at the current time.

7. The method according to claim 1, characterized in that, The step of controlling the second camera to maintain focus on the focus object based on the real-time focus information and the pre-focus information includes: Based on the real-time focus information and the pre-focus information, calculate the object offset of the focus object; Determine whether the object offset is less than a preset offset threshold; If it is less than the target object, then the second camera is controlled to maintain focus on the target object according to the pre-focus information; If the value is greater than the target value, the second camera is controlled to refocus on the target object.

8. The method according to claim 7, characterized in that, The object offset includes position offset and / or object size offset; the real-time focus information includes real-time focus position and real-time object size information; the pre-focus information includes pre-focus position and pre-object size information; and calculating the object offset of the focused object based on the real-time focus information and the pre-focus information includes: Calculate the difference between the real-time focus position and the pre-focus position to obtain the position offset, and / or calculate the difference between the real-time object size information and the pre-object size information to obtain the object size offset.

9. A conference flat panel, characterized in that, include: case; The first camera is mounted on the housing. A second camera is mounted on the housing, wherein the position of the second camera on the housing is different from the position of the first camera on the housing; The motor is connected to the first camera and the second camera, respectively. A controller is electrically connected to the first camera, the second camera, and the motor, respectively, and is used to control the motor to adjust the position of the second camera. The controller includes a memory and a processor. The memory is connected to the processor, and the processor is used to execute one or more computer programs stored in the memory. When the processor executes the one or more computer programs, it causes the conference tablet to implement the method as described in any one of claims 1-8.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program, the computer program including program instructions that, when executed by a processor, cause the processor to perform the method as described in any one of claims 1-8.

Images