Image collection device, terminal, method and storage medium for videoconferencing

Abstract

The present application discloses an image collection device, terminal, method, and storage medium for video conferencing, which relates to the technical field of camera terminals. The device includes a wide-angle lens for capturing a first field of view, and multiple wide-angle lenses arranged symmetrically about the wide-angle lens, whose optical axes intersect at the same virtual optical center as the optical axis of the wide-angle lens, and whose absolute value of the difference between a second field of view obtained by combining the field of view areas and the first field of view area is less than a field of view threshold. The image collection device according to the embodiment of the present application combines a wide-angle lens and a telephoto lens to improve field of view coverage and can also blend the telephoto lens and wide-angle lens to enlarge the image without degradation of the screen. Based on the setting of the virtual optical center and field of view, image distortion due to differences in focus information of different lenses can be avoided, and the telephoto lens can be blended within most of the field of view area of ​​the wide-angle lens to perform enlarged close-ups.

Description

[Technical Field]

[0001] Related Applications This application claims priority to a Chinese patent application bearing application number 202311267503.0 and entitled "Image collection device, terminal, method and storage medium for videoconferencing," filed on September 27, 2023, the entire contents of which are incorporated herein by reference.

[0002] The present application relates to the technical field of camera terminals, and in particular to image collection devices, terminals, methods and storage media for video conferencing. [Background technology]

[0003] Current video conferencing requires two key requirements for image formation: it must provide as much panoramic coverage as possible while also providing clear close-ups of distant objects. With current video conferencing equipment, it's difficult to achieve both panoramic coverage and image resolution. Wide-angle cameras have a large field of view and can capture large scenes, but the number of pixels per unit area is reduced, resulting in a significant drop in image resolution when enlarging distant images. Telephoto lenses can capture sufficiently clear images, but their narrow field of view means they can't cover most of the scene.

[0004] In some related technologies, in order to improve the resolution of important areas in images of large scenes captured by wide-angle cameras, more and more device manufacturers are installing multiple lenses in electronic devices, and stitching together images collected by the multiple lenses using an image matching algorithm.However, when capturing images using traditional lenses, there is a phenomenon of image distortion, and the quality of images collected by multiple lenses to collect different shots is low, which makes the algorithm for image stitching more difficult and increases the requirements for the computing power of image collection devices. Summary of the Invention

[0005] The embodiments of the present application provide an image collection device, terminal, method and storage medium for video conferencing, to solve the drawback of the above-mentioned related art that image panoramic coverage and image resolution cannot be compatible, and the technical solutions are as follows:

[0006] In a first aspect, an embodiment of the present application provides an image capture device for video conferencing, the device comprising: a wide-angle lens used to capture a first field of view; The optical system is provided with a plurality of telephoto lenses that are arranged symmetrically about the wide-angle lens, whose optical axes intersect at the same virtual optical center as the optical axis of the wide-angle lens, and whose absolute value of the difference between the second field of view obtained by combining the field of view areas and the first field of view area is less than a field of view threshold.

[0007] In an alternative embodiment of the first aspect, the angle between the optical axis of the telephoto lens and the optical axis of the wide-angle lens is equal to or greater than half the angle of view of the telephoto lens.

[0008] In an alternative embodiment of the first aspect, the telephoto lens at the same distance from the wide-angle lens has the same field of view.

[0009] In an alternative embodiment of the first aspect, all telephoto lenses have the same field of view.

[0010] In one alternative embodiment of the first aspect, there is a third field of view superimposed on the field of view of each of the two telephoto lenses, and the width of the projection of the third field of view in the horizontal plane at a predetermined distance from the device is greater than or equal to a field of view width threshold.

[0011] In an alternative embodiment of the first aspect, the device further includes at least one annular rotation mechanism, a rotation axis of the annular rotation mechanism overlapping the optical axis of the wide-angle lens, the annular rotation mechanism having a plurality of rotation bases, each of which is equidistant from the axis of the wide-angle lens, each of which is provided with one telephoto lens, and the rotation mechanism drives the telephoto lens to rotate around the optical axis of the wide-angle lens via the rotation base.

[0012] In an alternative embodiment of the first aspect, the device further includes a rotating base, the telephoto lens is detachably mounted on the rotating base, a plane on which a rotation axis of the rotating base lies is perpendicular to a plane on which an optical axis of the wide-angle lens lies, and the rotating base is used to rotate the telephoto lens around the rotation axis of the rotating base and adjust the angle between the optical axis of the telephoto lens and the optical axis of the wide-angle lens.

[0013] In a second aspect, an embodiment of the present application further provides a terminal, the terminal comprising: a housing including a cavity in which the image capture device provided by any one of the first aspects above is mounted; Here, the object side ends of both the wide-angle lens and the telephoto lens are located outside the housing.

[0014] In a third aspect, embodiments of the present application further provide an image acquisition method, applied to the image acquisition device provided by any one of the first aspects above, the method comprising: determining a focus object in a first field of view and obtaining a distance between the focus object and the device; If the distance between the focused object and the device is less than a first distance threshold, magnifying the focused object via a wide-angle lens to generate a first focused image; When the distance between the focus object and the device is equal to or greater than a first distance threshold and less than a second distance threshold, first enlarge the focus object through a wide-angle lens until the magnification of the wide-angle lens reaches a first magnification, and then switch to a corresponding telephoto lens to further enlarge the focus object and generate a second focused image; When the distance between the object to be focused and the device is equal to or greater than a second distance threshold, the object to be focused is enlarged sequentially via a wide-angle lens and a telephoto lens until the magnification of the telephoto lens reaches a second magnification, and digital zoom is performed based on the focused image generated by the telephoto lens to generate a third focused image.

[0015] In a fourth aspect, the present application further provides a non-transitory computer-readable storage medium having stored thereon a computer program, which when executed by a processor, implements the method provided by the first aspect of the embodiments of the present application or any one of the implementations of the first aspect.

[0016] The beneficial effects of the technical solutions provided by some embodiments of the present application include at least: The image collection device for video conferencing provided by the embodiments of the present application includes: obtaining a first field of view through a wide-angle lens, thereby improving the field of view coverage rate of the video conferencing scene; arranging multiple telephoto lenses symmetrically relative to the wide-angle lens, and setting the optical axes of the multiple telephoto lenses and the optical axis of the wide-angle lens to intersect at the same virtual optical center, so that the multiple telephoto lenses and the wide-angle lenses form an overlapping area, allowing images to be easily synthesized; thereby fusing the telephoto lenses and the wide-angle lenses to enlarge the image without degradation on the screen, ensuring the quality of the collected images, and preventing image distortion caused by differences in focus information of different lenses; helping to reduce the difficulty of the image stitching synthesis algorithm, and eliminating the need for complex image algorithms; and further setting the absolute value of the difference between the first and second field of view obtained by synthesizing the field of view of the multiple telephoto lenses to be less than a field of view threshold, so that the union of the field of view obtained by fitting through the telephoto lenses covers most of the field of view of the wide-angle lens, allowing for magnified close-ups to be performed within most of the field of view of the wide-angle lens. [Brief explanation of the drawings]

[0017] In order to more clearly describe the technical solutions in the present application or related art, the following will briefly describe the accompanying drawings necessary for the embodiments or related technical description. Needless to say, the accompanying drawings in the following description are some embodiments of the present application, and those skilled in the art can further obtain other drawings based on these accompanying drawings without any creative work. [Figure 1] 1 is a schematic diagram of an application scenario of an image acquisition device according to an embodiment of the present application; [Figure 2] 1 is a schematic diagram illustrating the configuration of an image acquisition device according to an embodiment of the present application. [Figure 3] 1 is a schematic plan view of an image acquisition device provided by an embodiment of the present application; [Figure 4] 1 is a schematic diagram of the configuration of an image acquisition device provided by an embodiment of the present application; [Figure 5] 1 is a schematic diagram of the configuration of an image acquisition device provided by an embodiment of the present application; [Figure 6] 1 is a schematic plan view of a viewing area of ​​an image acquisition device provided by an embodiment of the present application; [Figure 7] 1 is a schematic plan view of a viewing area of ​​an image acquisition device provided by an embodiment of the present application; [Figure 8] 1 is a schematic plan view of a viewing area of ​​an image acquisition device provided by an embodiment of the present application; [Figure 9] 1 is a schematic diagram of the configuration of an image acquisition device provided by an embodiment of the present application; [Figure 10] 1 is a schematic diagram of the configuration of an image acquisition device provided by an embodiment of the present application; [Figure 11] 1 is a schematic diagram of the configuration of an image acquisition device provided by an embodiment of the present application; [Figure 12] FIG. 1 is a schematic diagram of the configuration of a terminal provided by an embodiment of the present application; [Figure 13] 1 is a flowchart of an image acquisition method provided by an embodiment of the present application. DETAILED DESCRIPTION OF THE INVENTION

[0018] In order to clarify the purpose, technical solution and advantages of the present application more clearly, the following will clearly and comprehensively describe the technical solution in the present application, combined with the drawings in the present application, and it should be understood that the described embodiments are only some of the embodiments in the present application, and not all of the embodiments. All other embodiments that can be obtained by those skilled in the art based on the embodiments in the present application without any creative work are all within the scope of protection of the present application.

[0019] The terms "comprises" and "comprises," and any variations thereof, in the specification and claims of this application and in the drawings above, are intended to cover a non-exclusive inclusion. For example, a process, method, system, product, or apparatus comprising a series of steps or modules is not limited to the listed steps or modules, but may also optionally include steps or modules not listed, or may also optionally include other steps or modules inherent to the process, method, product, or apparatus.

[0020] It should be noted that the terms "first / second" used in the present application are merely used to distinguish between similar objects and do not represent a particular order of objects, and it should be understood that "first / second" can be used to interchange a particular order or order where permitted. It should be understood that objects distinguished by "first / second" can be interchanged where appropriate, and therefore, the embodiments of the present application described herein can be implemented in an order different from that described or illustrated herein.

[0021] In related art, telephoto lenses have a long focal length and high resolution but a narrow field of view, while wide-angle lenses have a short focal length and low resolution but a wide field of view. Therefore, in some special scenes, using only a telephoto lens or a wide-angle lens cannot meet user needs. By integrating a wide-angle lens and a telephoto lens into the same image acquisition device, a wider imaging range can be obtained through the wide-angle lens. However, the wide-angle lens has different imaging magnifications in the central and peripheral fields, resulting in image distortion around the edges of the captured image. Furthermore, if the wide-angle lens, for example, has an excessively large aperture, stray light is likely to enter and cause interference, resulting in problems such as light spots and optical fog. Meanwhile, when a telephoto lens and a wide-angle lens are used simultaneously to capture images, there is an overlapping area between the multiple lenses, which can result in image information being overlaid in the overlapping area, potentially causing image information loss or image distortion. To prevent image distortion, the images must be captured sequentially at a predetermined interval, which increases the imaging time and makes it difficult to meet the real-time requirements of video conferencing.

[0022] Next, refer to FIG. 1, which is a schematic diagram of an application scenario of an image acquisition device provided according to an exemplary embodiment of the present application.

[0023] As shown in FIG. 1, the image collection device 100 provided in the embodiments of the present application is applied to a video conferencing scene, which includes but is not limited to places such as conference rooms, conference halls, classrooms, and rooms. By installing the image collection device 100 at a predetermined position in the video conferencing scene, the wide-angle lens in the image collection device 100 covers the main area of ​​the conference scene, and the field of view obtained by combining the field of view of multiple telephoto lenses is approximately the same as the field of view obtained by the wide-angle lens. That is, within the area covered by the wide-angle lens, a close-up of the object can be achieved through the telephoto lens, which not only can cover most of the field of view in the scene, but can also clearly close up the person in the scene.

[0024] Furthermore, the image collection device provided by the embodiments of the present application may be applied to a remote video conferencing system, which establishes a network connection between at least two terminals participating in a conference at different locations, allowing people in different locations to conduct a remote conference through the remote video conferencing system.

[0025] Next, as shown in FIG. 2, FIG. 2 is a structural schematic diagram showing an image acquisition device provided by an embodiment of the present application, the device 200 includes one wide-angle lens 210 and multiple telephoto lenses 220; Here, a wide-angle lens 210 is used to capture a first field of view, The multiple telephoto lenses 220 are arranged symmetrically about the center of the wide-angle lens 210, the optical axes S of the multiple telephoto lenses 220 intersect at the same virtual optical center O2 as the optical axis A of the wide-angle lens 210, and the absolute value of the difference between the second field of view obtained by combining the field of view areas of the multiple telephoto lenses 220 and the first field of view area is less than the field of view threshold.

[0026] Specifically, the wide-angle lens 210 and the telephoto lens 220 are both fixed focal length and fixed viewing angle lenses, and the parameters of the wide-angle lens 220 and the telephoto lens 210 are selected according to the video conferencing scene in which the device is used.

[0027] Specifically, the area captured by the wide-angle lens 220 is the first field of view, which is the thin solid line area shown in Figure 2. The size of the first field of view captured by the wide-angle lens 210 is positively correlated with the size of the field of view of the selected wide-angle lens, which is larger than the field of view of the telephoto lens. The resulting first field of view should cover most of the conference scene. Each telephoto lens 220 captures a corresponding telephoto field of view, which is shown by the thick solid line area in Figure 2. The field of view of multiple telephoto lenses is combined through fitting to obtain a second field of view, which can be understood as the union of the field of view of multiple telephoto lenses. The size of the second field of view is determined by the field of view of each telephoto lens and the position of the virtual optical center. The resulting second field of view should be approximately overlapped with the first field of view.

[0028] Taking two telephoto lenses as an example, and matching the planar configuration schematic diagram of the image acquisition device provided by the embodiment of the present application as shown in FIG. 3 , FIG. 3 shows the projection of the field of view on a horizontal plane, in which the telephoto lenses 320 and 330 are arranged symmetrically on either side of the wide-angle lens 310, the distances from the telephoto lenses 320 and 330 to the wide-angle lens 310 are equal, the optical axes of the telephoto lenses 320 and 330 intersect with the optical axis of the wide-angle lens 310 at a virtual optical center O3, the optical axes of the telephoto lenses 320 and 330 and the optical axis of the wide-angle lens 310 are shown by dashed and dotted lines in FIG. 3 , the field of view of the telephoto lenses 320 and 330 are shown by the thick solid line area in FIG. 3 , and the first field of view of the wide-angle lens 310 is shown by the dotted line area in FIG. 3 , respectively. The first field of view of the wide-angle lens is defined as M1, and the second field of view obtained by fitting the field of view of the telephoto lens is defined as M2. The difference between M1 and M2 is calculated, and the smaller the difference between M1 and M2, the closer the first field of view of the wide-angle lens and the second field of view obtained by fitting the telephoto lens are, so that the telephoto lens can magnify the object in most of the field of view of the wide-angle lens. Here, the field of view threshold can be set based on the size of the conference scene used and the parameters of the selected lens, and the embodiments of the present application are not limited thereto.

[0029] Optionally, an overlap ratio of a first field of view M1 of the wide-angle lens and a second field of view M2 obtained by fitting the field of view of the telephoto lens to the first field of view of the wide-angle lens can be calculated. The intersection of the first field of view M1 and the second field of view M2 is calculated and denoted as M1∩M2. The overlap ratio of the first field of view of the wide-angle lens to the first field of view of the wide-angle lens is (M1∩M2) / M2. The magnitude of the overlap ratio can determine the proportion of the first field of view of the wide-angle lens that the telephoto lens covers. If the overlap ratio is lower than a set overlap ratio threshold, it indicates that the field of view of the telephoto lens does not meet the requirements.

[0030] As can be understood, the field of view and focal length of the telephoto lens and the field of view and focal length of the wide-angle lens can be determined through optical simulation. Here, the field of view and focal length of the wide-angle lens and the telephoto lens are determined according to the spatial scale of the assumed video conference scene. When the spatial scale is large, a wide-angle lens with a larger field of view needs to be selected to cover the video conference scene. When the spatial scale is small, a wide-angle lens with a narrower field of view needs to be selected. Similarly, as the spatial scene scale becomes larger, a telephoto lens with a longer focal length needs to be selected to realize a close-up image of a distant object. As the focal length of the telephoto lens increases, the field of view of the telephoto lens becomes narrower. In order to match the field of view areas corresponding to the field of view of the telephoto lens and the wide-angle lens, the number of telephoto lenses can be appropriately increased.

[0031] In one embodiment, the plurality of telephoto lenses are arranged in a ring shape around the wide-angle lens and are arranged symmetrically about the center of the wide-angle lens.

[0032] For example, FIG. 4 is a schematic diagram of the configuration of an image collection device provided by an embodiment of the present application. For example, in the case where four telephoto lenses are arranged in a ring around a wide-angle lens, the device 400 includes a telephoto lens 420, a telephoto lens 430, a telephoto lens 440, a telephoto lens 450, and one wide-angle lens 410.

[0033] Specifically, the distance from telephoto lens 420 to axis O of wide-angle lens 410 is represented as AO, the distance from telephoto lens 430 to axis O of wide-angle lens 410 is represented as BO, the distance from telephoto lens 440 to axis O of the wide-angle lens is represented as CO, and the distance from telephoto lens 450 to axis O of wide-angle lens 410 is represented as DO, and the optical axis S2 of telephoto lens 420, the optical axis S3 of telephoto lens 430, the optical axis S4 of telephoto lens 440, and the optical axis S5 of telephoto lens 450 intersect at the same virtual optical center O4 as the optical axis A4 of wide-angle lens 410. The multiple telephoto lenses are arranged in a ring shape centered on the wide-angle lens and are arranged symmetrically about the wide-angle lens, so that distance AO is equal to distance CO, and distance BO is equal to distance DO. Here, distances AO and CO do not have to be equal to distances BO and DO, and the angles formed between the optical axes of telephoto lenses 420 and 440 and the optical axis of wide-angle lens 410 are equal, and the angles formed between the optical axes of telephoto lenses 430 and 450 and the optical axis of the wide-angle lens are equal.

[0034] Optionally, when distances AO, CO, BO, and DO are all equal, the angles formed between the optical axes of telephoto lenses 420, 430, 440, and 450 and the optical axis of the wide-angle lens are all the same, and in this case, the axes of telephoto lenses 420, 430, 440, and 450 are located on the same circumference with wide-angle lens 410 as the axis.

[0035] In one embodiment, the telephoto lenses and the wide-angle lenses are arranged in the same row or column and are arranged symmetrically about the center of the wide-angle lens.

[0036] For example, FIG. 5 is a structural diagram of an image collection device provided by an embodiment of the present application, in which four telephoto lenses and wide-angle lenses are installed in the same row, and the device 500 includes telephoto lens 520, telephoto lens 530, telephoto lens 540, telephoto lens 550 and one wide-angle lens 510.

[0037] Specifically, the distance from telephoto lens 520 to the axis O' of wide-angle lens 510 is represented as A'O', the distance from telephoto lens 530 to the axis O' of wide-angle lens 510 is represented as B'O', the distance from telephoto lens 530 to the axis O' of wide-angle lens 510 is represented as C'O', and the distance from telephoto lens 550 to the axis O' of wide-angle lens 510 is represented as D'O', and the optical axis S2' of telephoto lens 520, the optical axis S3' of telephoto lens 530, the optical axis S4' of telephoto lens 540, and the optical axis S5' of telephoto lens 550 intersect at the same virtual optical center O5 as the optical axis A5 of wide-angle lens 510. The multiple telephoto lenses and wide-angle lenses are installed in the same row and are arranged symmetrically about the wide-angle lens, so that the distance A'O is equal to the distance D'O' and the distance B'O' is equal to the distance C'O'. Here, distances A'O' and D'O' are both greater than distances B'O' and C'O', the angles formed between the optical axes of telephoto lenses 520 and 550 and the optical axis A5 of wide-angle lens 510 are equal, and the angles formed between the optical axes of telephoto lenses 530 and 550 and the optical axis A5 of the wide-angle lens are equal.

[0038] As can be understood, the multiple telephoto lenses in the image collection device provided by the embodiments of the present application may be arranged in a circular pattern as shown in FIG. 4 or in the same row as shown in FIG. 5, and the embodiments of the present application do not limit the arrangement of the telephoto lenses.

[0039] Optionally, it may be desirable to minimize the distance between the telephoto lens and the wide-angle lens, the specific value being determined by the external dimensions of the telephoto lens module and the wide-angle lens module, and the embodiments of the present application are not limited in this regard.

[0040] Preferably, the same field of view parameters may be set for each telephoto lens that is at the same distance from the wide-angle lens, and different field of view parameters may be set for each telephoto lens that is at a different distance from the wide-angle lens, and the embodiments of the present application are not limited thereto.

[0041] Preferably, the same lens parameters may be set for each telephoto lens that is at the same distance from the wide-angle lens, and different lens parameters may be set for each telephoto lens that is at a different distance from the wide-angle lens. Preferably, the same field of view parameters may be set for each telephoto lens, and similarly, the same lens parameters may be set for each wide-angle lens, and the embodiments of the present application are not limited thereto.

[0042] Optionally, the lens parameters include, but are not limited to, focal length, resolution, frame rate, etc., and the embodiments of the present application are not limited in this regard.

[0043] Optionally, the wide-angle lens and the telephoto lens can be mounted on a fixed bracket at a fixed angle, thereby fixing the relative positional relationship between the wide-angle lens and the telephoto lens.

[0044] In the embodiments of the present application, by obtaining a first field of view through a wide-angle lens, the field of view coverage rate in a video conference scene can be improved. By arranging multiple telephoto lenses symmetrically around the wide-angle lens and setting the optical axes of the multiple telephoto lenses to intersect at the same virtual optical center as the optical axis of the wide-angle lens, the telephoto lenses and the wide-angle lenses can be combined to enlarge the image without degradation to the screen, ensuring the quality of the collected image and preventing image distortion due to differences in the focus information of different lenses. There is no need to use complex image algorithms. Furthermore, by setting the absolute value of the difference between the second field of view obtained by combining the field of view of multiple telephoto lenses and the first field of view to be less than the field of view threshold, it can be ensured that the union of the field of view obtained by fitting through the telephoto lenses covers most of the field of view of the wide-angle lens, and therefore, zoom close-ups can be performed within most of the field of view of the wide-angle lens.

[0045] The inventor discovered that when there is an angle between the optical axis of the telephoto lens and the optical axis of the wide-angle lens, and the value of the field of view of the telephoto lens is smaller than a certain value, the boundary line of the projection of the field of view of the telephoto lens on the horizontal plane will intersect with the optical axis of the wide-angle lens, and thus the second field of view obtained by fitting through the telephoto lens is likely to produce a blind zone of view at the far side of the first field of view of the wide-angle lens. For example, as shown in FIG. 6, two telephoto lenses are arranged symmetrically on both sides of the wide-angle lens, and the field of view of the two telephoto lenses is the same, and the two The optical axes of the telephoto lens and the wide-angle lens intersect at a common virtual optical center O6, half of the field of view of the telephoto lens is Θ1, and the angle between the optical axis of the telephoto lens and the optical axis of the wide-angle lens is Θ2. From the geometric relationship, it can be easily determined that Θ1 is smaller than Θ2. As one end of the projection of the field of view of the two telephoto lenses in the horizontal plane intersects at point O6', the second field of view obtained by fitting will, after being extended to a certain distance, generate a blind zone of view M3, and it is not possible to magnify the object through the telephoto lens within the blind zone of view.

[0046] Based on this, an embodiment of the present application further provides an image collection device, in which a plurality of telephoto lenses are arranged symmetrically with respect to a wide-angle lens, the optical axes of the plurality of telephoto lenses intersect at the same virtual optical center as the optical axis of the wide-angle lenses, the angle formed by the optical axis of the telephoto lenses and the optical axis of the wide-angle lens is equal to or greater than half the field of view of the telephoto lenses, and the absolute value of the difference between the second field of view obtained by combining the field of view areas of the plurality of telephoto lenses and the first field of view is less than a field of view threshold.

[0047] For example, as shown in Figure 7, Figure 7 is a schematic plan view of the field of view of an image acquisition device, taking the case where two telephoto lenses with the same field of view are placed on either side of a wide-angle lens. When the angle Θ4 between the optical axis of the telephoto lens and the optical axis of the wide-angle lens is exactly equal to Θ3, which is half the field of view angle of the telephoto lens, one end of the projection of the field of view areas of the two telephoto lenses in the horizontal plane is parallel to each other and parallel to the projection of the optical axis of the wide-angle lens in the horizontal plane, and the boundary lines of the overlapping areas of the two telephoto lenses are both parallel to the projection of the optical axis of the wide-angle lens in the horizontal plane, which advantageously ensures that no blind zones of the field of view occur at a certain distance from the image acquisition device.

[0048] As can be understood, and easily seen from geometric analysis, if the angle between the optical axis of the telephoto lens and the optical axis of the wide-angle lens is reduced, one end of the projections in the horizontal plane of the field of view of the two telephoto lenses will intersect at point O6', as shown in Figure 6.

[0049] This allows the angle formed by the optical axis of the telephoto lens and the optical axis of the wide-angle lens to be set to half or more of the viewing angle of the telephoto lens, in other words, by setting the angle formed by the optical axis of the telephoto lens and the optical axis of the wide-angle lens to be half or more of the viewing angle of the telephoto lens, it is possible to avoid the occurrence of a blind zone in the field of view at a certain distance away from the image collecting device.

[0050] As can be understood, when the use scene of the image acquisition device is limited, for example, when it is only necessary to acquire images of the area between O6′ and the image acquisition device in FIG. 6, even if the angle between the optical axis of the telephoto lens and the optical axis of the wide-angle lens is made less than half of the field of view angle of the telephoto lens, no blind zone of field of view will occur in the scene.

[0051] Preferably, a third field of view area is present that is superimposed on the field of view areas of the two telephoto lenses, and the width of the projection of the third field of view area in the horizontal plane at a position away from the device by a predetermined distance is equal to or greater than a field of view width threshold; Optionally, the predetermined distance and the visual field width threshold are determined according to the video conference scene used, where the predetermined distance is determined by the parameters of the wide-angle lens, and the longer the focal length of the wide-angle lens, the larger the predetermined distance. Here, the visual field width threshold is determined according to the size of the object to be magnified. For example, if the object to be magnified is a speaker, the visual field width threshold should be set to the shoulder width of an adult. If the object to be magnified is a display product, the visual field width threshold may be set to the outer periphery of the display product. For example, for a position 2.5 m away from the image acquisition device, the visual field width threshold should not be less than 40 cm. The embodiments of the present application are not limited thereto.

[0052] For example, as shown in FIG. 6, the width of the projection in the horizontal plane of the third field of view at a predetermined distance from the device is PQ, and part of PQ is in the blind zone M3 of the field of view. In this case, when enlarging the object corresponding to PQ through one of the telephoto lenses, due to the parallax problem, neither of the two telephoto lenses can collect all the image information of PQ, resulting in a split image and making it impossible to fully enlarge the object.

[0053] For example, as shown in Figures 7 and 8, Figures 7 and 8 are schematic plan views of the field of view area of ​​the same image collection device provided by an embodiment of the present application, and Figure 8 shows that the object PQ is located at a predetermined distance from the device, and the width of PQ is exactly equal to the field of view width threshold of the two telephoto lenses, and in this case, the object PQ can be enlarged through any one of the telephoto lenses.

[0054] Furthermore, if the width of PQ is greater than the field width threshold of the two telephoto lenses, but one end of PQ is located within the field of view of one of the telephoto lenses and the other end is located entirely within the overlapping third field of view of the two telephoto lenses, PQ will occupy a larger proportion of the field of view of one of the telephoto lenses, and the object PQ can be magnified through the telephoto lens that occupies a larger proportion.

[0055] Therefore, in the embodiments of the present application, the angle between the optical axis of the telephoto lens and the optical axis of the wide-angle lens is set to more than half of the field of view of the telephoto lens, thereby avoiding the occurrence of blind zones in the field of view at long distances in the second field of view obtained by fitting through the telephoto lens, ensuring the existence of overlapping areas between the field of view areas of the telephoto lenses, avoiding the parallax problem caused by blind zones in the field of view, and allowing images within the depth of field to be completely fused and stitched in the overlapping areas. By setting the width of the overlapping areas at a predetermined distance from the device to be greater than or equal to the field of view width threshold, image distortion caused by the inability of a single telephoto lens to fully magnify an object can be avoided, ensuring image integrity and helping to improve imaging quality.

[0056] Next, as shown in Figures 9 and 10, an image collection device provided by another embodiment of the present application is shown, which further includes at least one annular rotation mechanism, the rotation axis of each annular rotation mechanism overlaps with the optical axis of the wide-angle lens, each annular rotation mechanism has a plurality of rotation bases, the distance between each rotation base and the axis of the wide-angle lens is equal, each rotation base is provided with one telephoto lens, and the rotation mechanism drives the telephoto lens to rotate around the optical axis of the wide-angle lens via the rotation base.

[0057] Optionally, the telephoto lens is removably mounted on a corresponding rotating base.

[0058] Specifically, as shown in FIG. 9, taking four telephoto lenses as an example, the image collection device shown in FIG. 9 includes a wide-angle lens 910 located in the center, a telephoto lens 920, a telephoto lens 930, a telephoto lens 940, and a telephoto lens 950, and the telephoto lenses 920, 930, 940, and 950 are arranged symmetrically around the wide-angle lens 910, and the four telephoto lenses are respectively attached to a rotation base 962, a rotation base 963, a rotation base 964, and a rotation base 965 of an annular rotation mechanism 960.

[0059] Optionally, the rotation base is fixedly mounted relative to the annular rotation mechanism so that the angle between the optical axis of telephoto lens 920, telephoto lens 930, telephoto lens 940, and telephoto lens 950 and the optical axis of wide-angle lens 910 remains constant.

[0060] Optionally, the ring-shaped rotation mechanism can be attached to the image acquisition device via a buckle, and the rotation can be realized through a gear transmission, bearings, or other methods.

[0061] 10 is a diagram illustrating another image acquisition device provided by an embodiment of the present application, the device 1000 including two annular rotation mechanisms, annular rotation mechanism 1060 to which telephoto lenses 1030 and 1050 are attached, and annular rotation mechanism 1070 to which telephoto lenses 1020 and 1040 are attached. Both annular rotation mechanisms 1060 and 1070 are perfect circles and rotate around the axis of wide-angle lens 1010. Here, the distance from the telephoto lens 1030 attached to the annular rotation mechanism 1060 to the wide-angle lens 1010 is equal to the distance from the telephoto lens 1050 to the wide-angle lens 1010, and similarly, the distance from the telephoto lens 1020 attached to the annular rotation mechanism 1070 to the wide-angle lens 1010 is equal to the distance from the telephoto lens 1040 to the wide-angle lens 1010, and the radius of the annular rotation mechanism 1060 is greater than the radius of the annular rotation mechanism 1070.

[0062] Optionally, the rotation can be clockwise or counterclockwise, and the examples of the present application are not limited in this regard.

[0063] As can be understood, several ring-shaped rotation mechanisms can be installed according to the needs in practical use, and the embodiments of the present application are not limited thereto.

[0064] In the embodiment of the present application, the telephoto lens is attached to a ring-shaped rotation mechanism, which allows the telephoto lens to be rotated relative to the wide-angle lens, thereby easily adjusting the orientation of the telephoto lens. After rotating the ring-shaped rotation mechanism, the projection of the telephoto lens's field of view in the horizontal plane will change accordingly, and the field of view of the telephoto lens can be adjusted based on this. By providing multiple ring-shaped rotation mechanisms, the image collection device provided by the embodiment of the present application can be used in a stepped conference room with steps, which avoids overlooking the vertical field of view when only considering the projection of the telephoto lens's field of view in the horizontal plane, and avoids the blind zone of the field of view that exists in the vertical direction, which helps to expand the application range of the image collection device.

[0065] Next, as shown in FIG. 11, FIG. 11 is a schematic structural diagram of an image collection device provided by yet another embodiment of the present application, the device further includes a rotation base, the telephoto lens is detachably mounted on the rotation base, the plane on which the rotation axis of the rotation base is located is perpendicular to the plane on which the optical axis of the wide-angle lens is located, and the rotation base is used to rotate the telephoto lens around the rotation axis of the rotation base and adjust the angle between the optical axis of the telephoto lens and the optical axis of the wide-angle lens.

[0066] For example, as shown in FIG. 11, taking two telephoto lenses as an example, the device 1100 includes a wide-angle lens 1110, a telephoto lens 1120, a telephoto lens 1130, and a rotation base 1140, and for clarity and simplicity of illustration, only one rotation mechanism 1140 is shown in FIG.

[0067] Optionally, a through hole may be provided on the end surface of the rotating base 1140 corresponding to the inner wall of the device 1100, so that the rotating base 1140 can be rotatably connected to the device through a pinning method, and the rotating base 1140 can rotate around the rotation axis R11 through a hinge, rotation axis, or other method.

[0068] As can be understood, the rotation axis R11 being perpendicular to the optical axis space of the wide-angle lens A11 may also be understood as the plane containing the rotation axis R11 of the rotation base 1140 being perpendicular to the plane containing the optical axis A11 of the wide-angle lens 1110.

[0069] Preferably, the telephoto lenses are arranged symmetrically around the optical axis of the wide-angle lens, and to ensure that the virtual optical centers of the telephoto lenses and the wide-angle lenses overlap with the optical axis of the wide-angle lenses, the telephoto lenses that are the same distance from the optical axis of the wide-angle lenses may be installed to rotate synchronously, and it may be understood that when each corresponding telephoto lens is driven and rotated via the rotation base, the rotation angle and rotation direction of the telephoto lenses are all the same.

[0070] In the embodiment of the present application, each telephoto lens is attached to a rotating base, thereby enabling adjustment of the angle between the optical axis of the telephoto lens and the optical axis of the wide-angle lens. When adjusting the position of the virtual optical center of the image collection device, the rotating base can be adjusted to easily adjust the angles between the optical axes of all telephoto lenses and the wide-angle lens, so that the virtual optical centers overlap.

[0071] Furthermore, the embodiment of the present application further provides a terminal based on the image processing device described in the above embodiment, and FIG. 12 is a schematic diagram of the configuration of the terminal provided by the embodiment of the present application.

[0072] Specifically, the terminal 1200 includes a housing 1210 and an image processing unit 1220 mounted within the housing.

[0073] Specifically, the housing 1210 has a cavity 1211 therein, which is used to accommodate the image processing device 1220. The image processing device can be embedded in the cavity 1211 or attached to the cavity 1211 by means of adhesive, a locking hole, or the like, and the dimensions of the cavity 1211 are determined by the dimensions of the lens module selected for the image processing device 1220.

[0074] As can be understood, the image processing device 1220 has at least two telephoto lenses and one wide-angle lens, the lenses are used to collect image information, the side facing the object is the object side end, after the image processing device 1220 is embedded in the cavity 1210, the object side end needs to be located outside the housing to collect image information, the opposite side to the object side end is the eye side end, which may be installed inside the housing 1210 of the terminal 1200.

[0075] As can be understood, the terminal may be an electronic device such as a television or a video conferencing device, and the embodiments of the present application are not limited in this regard.

[0076] Next, the image collection method provided by the embodiment of the present application will be described by taking the case where a terminal equipped with the above-mentioned device executes the image collection method as an example, as shown in Figure 13. Specifically, as shown in Figure 13, Figure 13 is a flowchart illustrating the image collection method provided by the embodiment of the present application, and the method includes the following steps:

[0077] In step S1301, a focus target in the first field of view is determined, and the distance between the focus target and the device is acquired.

[0078] Specifically, the wide-angle lens is the main lens, and the first field of view is obtained through the main lens; Optionally, the focus object can be determined by detecting speech or gestures of a person, or the focus object may be actively selected.

[0079] Optionally, the proportion of the outer dimensions of the focused object in the drawing can be detected, and the distance between the focused object and the device can be determined. For example, if the size of a face, or the proportion of the face in the drawing that is large, indicates that the corresponding object is close to the device. Here, the distance between the focused object and the device can be the straight-line distance or the vertical distance to the device, and the distance between the focused object and the device can be calculated by configuring a sensor and an algorithm.

[0080] Furthermore, after determining the focus object, a close-up of the focus object can be performed, and a focused image, i.e., a close-up image, can be generated. As we can see, the magnification of wide-angle lens and telephoto lens has its own limit, and the image quality will decrease after the magnification exceeds a certain value. Therefore, in order to obtain a clear focused image, we need to select the corresponding lens based on the distance between the focusing object and the device to perform close-up on the focusing object. Specifically, when the distance between the object to be focused and the device is less than a first distance threshold, The method includes step S1302 of magnifying the focus object through a wide-angle lens to generate a first focused image.

[0081] Here, the first distance threshold is determined by the parameters of the wide-angle lens, which is the corresponding distance when the wide-angle lens enlarges the image to its maximum magnification and the image resolution does not fall below the minimum requirement, and the lens resolution can be evaluated by the MTF (modulation transfer function).

[0082] When the distance between the object to be focused and the device or lens is below a first distance threshold, the image may be magnified via a wide-angle lens.

[0083] Specifically, when the distance between the object to be focused and the device is equal to or greater than the first distance threshold and less than the second distance threshold, The method includes step S1303 of first magnifying the focused object through a wide-angle lens until the magnification of the wide-angle lens reaches a first magnification, then switching to a corresponding telephoto lens to further magnify the focused object and generate a second focused image.

[0084] As can be seen, the second distance threshold is determined by the parameters of the telephoto lens, which are the corresponding distances at which the resolution of the image does not fall below a minimum requirement when the telephoto lens magnifies the image to its maximum magnification.

[0085] When the distance between the focused object and the device is equal to or greater than a first distance threshold and less than a second distance threshold, the drawing in the first field of view is first enlarged through the wide-angle lens, enlarged to the maximum magnification of the wide-angle lens, and then the image enlarged to the maximum magnification by the wide-angle lens is mapped to the corresponding telephoto lens, and the focused object is further enlarged through the telephoto lens.

[0086] Specifically, when the distance between the focusing target and the device is equal to or greater than the second distance threshold, The method includes step S1304 of magnifying the object to be focused through the wide-angle lens and the telephoto lens in that order until the magnification of the telephoto lens reaches a second magnification, and performing digital zoom based on the focused image generated by the telephoto lens to generate a third focused image.

[0087] Specifically, for a focus target whose distance is equal to or greater than the second distance threshold, steps S1302 and S1303 are referred to, and the image can be enlarged sequentially through the wide-angle lens and the telephoto lens, and after enlarging to the maximum magnification of the telephoto lens, digital zoom is performed.

[0088] As can be understood, for objects at a distance, it is difficult to further enlarge the image using a telephoto lens without losing resolution, so digital zoom must be introduced to generate a third focused image and complete the close-up of the object.

[0089] Optionally, the digital zoom method includes, but is not limited to, nearest neighbor interpolation algorithm, bilinear interpolation algorithm, etc., and the embodiments of the present application are not limited in this regard.

[0090] The embodiments of the present application determine the distance between the object to be focused and the device, and then select a corresponding lens or a lens and magnification algorithm to perform a close-up on the object to be focused, thereby making maximum use of hardware resources. The image is magnified sequentially through a wide-angle lens and a telephoto lens, and the position of the object to be focused is determined using the wide imaging range of the wide-angle lens. The lens to perform the close-up on the object to be focused is determined, and the combination of a wide-angle lens and a telephoto lens can be used to achieve a close-up on the object, and this is helpful in improving imaging quality without compromising image resolution.

[0091] An embodiment of the present application further provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of the method of any one of the preceding embodiments, wherein the computer-readable storage medium may include any type of disk, such as, but not limited to, a floppy disk, an optical disk, a DVD, a CD-ROM, a microdrive and a magneto-optical disk, a ROM, a RAM, an EPROM, an EEPROM, a DRAM, a VRAM, a flash memory device, a magnetic or optical card, a nanosystem (including a molecular memory IC), or any type of medium or device suitable for storing instructions and / or data.

[0092] Through the description of the above embodiments, it should be understood by those skilled in the art that each embodiment can be realized by a method using software and a required general-purpose hardware platform, and naturally, can also be realized by hardware. Based on such understanding, an essential part of the above technical solution or a part contributing to the related technology can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium such as a ROM / RAM, a magnetic disk, an optical disk, etc., and includes several instructions for causing a computer device (which may be a personal computer, a server, a network device, etc.) to execute the methods described in each embodiment or part of the embodiments.

[0093] Finally, we would like to explain as follows: The above examples are only for illustrating the technical solutions of the present application and are not limited thereto, and although the present application has been described in detail with reference to the above examples, it should be understood by those skilled in the art that the technical solutions described in the above examples can still be modified or some of the technical features thereof can be equivalently substituted, and such modifications or transformations do not deviate from the spirit and scope of the technical solutions of the examples of the present application.

Claims

1. 1. An image collection device for video conferencing, comprising: a wide-angle lens used to capture a first field of view; An image collection device for video conferencing comprising: a plurality of telephoto lenses arranged symmetrically about the wide-angle lens, whose optical axes intersect at the same virtual optical center as the optical axis of the wide-angle lens, and whose absolute value of the difference between a second field of view obtained by synthesizing the field of view areas and the first field of view area is less than a field of view threshold.

2. 2. The device of claim 1, wherein an angle between the optical axis of the telephoto lens and the optical axis of the wide-angle lens is equal to or greater than half the field of view of the telephoto lens.

3. The device of claim 1 , wherein the telephoto lenses at the same distance from the wide-angle lens have the same field of view.

4. The device of claim 1 , wherein all of the telephoto lenses have the same field of view.

5. 2. The device of claim 1, wherein a third field of view exists that is superimposed on the field of view of each of the two telephoto lenses, and the width of the projection of the third field of view in a horizontal plane at a predetermined distance from the device is equal to or greater than a field of view width threshold.

6. The device described in any one of claims 1 to 5, further including at least one annular rotation mechanism, the rotation axis of the annular rotation mechanism overlapping the optical axis of the wide-angle lens, the annular rotation mechanism having a plurality of rotation bases, each of which is equidistant from the axis of the wide-angle lens, each of which is provided with one of the telephoto lenses, and the rotation mechanism driving the telephoto lenses to rotate around the optical axis of the wide-angle lens via the rotation bases.

7. The device described in any one of claims 1 to 5, further comprising a rotating base, the telephoto lens being detachably mounted on the rotating base, a plane on which the rotation axis of the rotating base is located being perpendicular to a plane on which the optical axis of the wide-angle lens is located, and the rotating base is used to rotate the telephoto lens around the rotation axis of the rotating base and adjust the angle between the optical axis of the telephoto lens and the optical axis of the wide-angle lens.

8. A terminal, a housing including a cavity in which the image acquisition device according to any one of claims 1 to 7 is mounted; Here, the object ends of the wide-angle lens and the telephoto lens are both located outside the housing.

9. An image acquisition method based on an image acquisition device according to any one of claims 1 to 7, comprising: determining a focus object in the first field of view and obtaining a distance between the focus object and the device; If the distance between the focus object and the device is less than a first distance threshold, magnifying the focus object via the wide-angle lens to generate a first focused image; When the distance between the focus object and the device is equal to or greater than the first distance threshold and less than a second distance threshold, first enlarge the focus object through the wide-angle lens until the magnification of the wide-angle lens reaches a first magnification, and then switch to a corresponding telephoto lens to further enlarge the focus object and generate a second focused image; When the distance between the object to be focused and the device is equal to or greater than the second distance threshold, the object to be focused is enlarged sequentially via the wide-angle lens and the telephoto lens until the magnification of the telephoto lens reaches a second magnification, and digitally zooming based on the focused image generated by the telephoto lens to generate a third focused image.

10. 10. A non-transitory computer-readable storage medium having a computer program stored thereon, the computer program implementing the steps of the method of claim 9 when executed by a processor.

Images