Image capturing system, method, apparatus, processing device and medium

By splitting light into two paths using a beam splitter and transmitting them to a short-focus camera and a long-focus camera respectively, images are captured separately and then combined for processing. This solves the image distortion problem caused by adjusting the focal length within a small range with a zoom lens, achieving accurate and clear capture of the target object and improving the user experience.

CN115714922BActive Publication Date: 2025-11-04YIBIN XGIMI OPTOELECTRONIC CO LTD
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202110952929.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-08-19
Publication Date
2025-11-04
Estimated Expiration
2041-08-19

AI Technical Summary

Technical Problem

In existing technologies, zoom lenses cause image distortion by adjusting the focal length within a small range, making it impossible to accurately capture images of the target object and reducing the user experience.

Method used

A beam splitter is used to split the light into two paths, which are transmitted to a short-focus camera and a long-focus camera respectively. The first image and the second image are acquired respectively, and the two images are combined and processed by a processing device to obtain the target image.

Benefits of technology

It achieves accurate and clear acquisition of the area to be observed of the object being photographed, improving the user experience. It combines the advantages of telephoto and short-focus cameras, featuring a wide field of view and high resolution.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115714922B_ABST
    Figure CN115714922B_ABST
Patent Text Reader

Abstract

The application provides an image shooting system, method, device, processing equipment and medium, and relates to the technical field of image shooting. The image shooting system comprises a light splitting prism, a short-focus camera, a long-focus camera and a processing equipment. The processing equipment is connected with the short-focus camera and the long-focus camera. The light splitting prism is arranged in the light direction of a to-be-shot object and is used for transmitting light to the short-focus camera and the long-focus camera respectively. The processing equipment is used for acquiring a first image collected by the short-focus camera and a second image collected by the long-focus camera respectively, and combining the images of a to-be-observed region in the first image and the second image to obtain a target image. The long-focus camera and the short-focus camera are arranged simultaneously, the first image and the second image are collected by the long-focus camera and the short-focus camera respectively, the first image and the second image are combined to obtain the target image, the advantages of the images collected by the long-focus camera and the short-focus camera are combined, the to-be-observed region image of the to-be-shot object is accurately collected, and the user experience is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to the field of image capture technology, and more specifically, to an image capture system, method, apparatus, processing device, and medium. Background Technology

[0002] With the rapid development of science and technology, cameras have also become widespread, becoming one of the most commonly used electronic devices in people's daily lives. The acquisition and analysis of images captured by cameras has also become increasingly common.

[0003] In related technologies, using a zoom lens allows for adjusting the focal length within a small range, enabling the capture of images of target objects within a wide field of view. However, this can easily lead to image distortion, such as making a vertical wall appear curved. Additionally, the focal length can only be adjusted within a small range.

[0004] The aforementioned technologies cannot accurately capture images of the target object, thus reducing the user experience. Summary of the Invention

[0005] The purpose of this invention is to address the shortcomings of the prior art by providing an image capturing system, method, apparatus, processing device, and medium to solve the problem of inaccurate image capture of target objects, which reduces user experience.

[0006] To achieve the above objectives, the technical solutions adopted in the embodiments of the present invention are as follows:

[0007] In a first aspect, embodiments of the present invention provide an image capturing system, including: a beam splitter, a short-focus camera, a long-focus camera, and a processing device;

[0008] The processing devices are all connected to the short-focus camera and the long-focus camera.

[0009] The beam splitter is positioned in the direction of the light rays from the object to be photographed, and is used to transmit light rays to the short-focus camera and the long-focus camera respectively;

[0010] The processing device is used to acquire a first image captured by the short-focus camera and a second image captured by the long-focus camera; and to combine the images of the region to be observed in the first image and the second image to obtain a target image.

[0011] Optionally, the image capturing structure may also include: a sliding stage;

[0012] The telephoto camera is placed on the slide.

[0013] Optionally, the image capturing structure further includes: a driving device; the driving device is connected to the processing device and the slide table respectively;

[0014] The processing device is configured to determine the shooting position of the telephoto camera as the target position based on the position information of the object to be photographed in the first image, and send a control command to the driving device based on the target position. The control command is configured to instruct the driving device to adjust the position of the slide to control the telephoto camera to move to the target position.

[0015] Optionally, it may also include: a display device; the display device is connected to the processing device and is used to receive and display the target image.

[0016] Secondly, embodiments of the present invention also provide an image capturing method, applied to a processing device in any of the systems described in the first aspect, the method comprising:

[0017] The first image captured by the short-focus camera and the second image captured by the long-focus camera are acquired respectively;

[0018] The target image is obtained by combining the images of the region to be observed in the first image and the second image.

[0019] Optionally, acquiring the first image captured by the short-focus camera and the second image captured by the long-focus camera respectively includes:

[0020] Acquire the first image captured by the short-focus camera, and determine the location information of the observation area of ​​the object to be photographed in the first image;

[0021] Based on the position information of the observation area of ​​the object to be photographed in the first image, the shooting position of the telephoto camera is adjusted to the target position;

[0022] Acquire a second image taken by the telephoto camera at the target location, and determine the image of the area to be observed in the second image.

[0023] Optionally, the step of combining the images of the region to be observed in the first image and the second image to obtain the target image includes:

[0024] The target image is obtained by replacing the image of the region to be observed in the first image with the image of the region to be observed in the second image.

[0025] Optionally, determining the location information of the observation area of ​​the object to be photographed in the first image includes:

[0026] In response to the input selection operation for the region to be observed, the region to be observed in the first image is determined and the location information corresponding to the region to be observed is obtained.

[0027] Optionally, determining the location information of the observation area of ​​the object to be photographed in the first image includes:

[0028] In the first image, target features that are identical to the features of the object to be photographed are identified;

[0029] The region of a preset size containing the target feature is taken as the region to be observed, and the location information corresponding to the region to be observed is obtained.

[0030] Optionally, replacing the image of the region to be observed in the first image with the image of the region to be observed in the second image to obtain the target image includes:

[0031] Based on the first size of the image of the region to be observed in the second image, the size of the first image is transformed to obtain a first image of the second size;

[0032] The target image is obtained by replacing the image of the region to be observed in the first image of the second size with the image of the region to be observed in the second image.

[0033] Wherein, the image in the observation area of ​​the first image of the second size is of the first size.

[0034] Optionally, adjusting the shooting position of the telephoto camera to the target position based on the position information of the observation area of ​​the object to be photographed in the first image includes:

[0035] The target position is calculated and obtained based on the position information of the observation area of ​​the object to be photographed in the first image;

[0036] According to the target position, a control command is sent to the drive device, which instructs the drive device to adjust the position of the slide to control the telephoto camera to move to the target position.

[0037] Optionally, calculating the target location based on the location information of the observation area of ​​the object to be photographed in the first image includes:

[0038] Using a preset coordinate transformation relationship, the target position is calculated and obtained based on the position information of the observation area of ​​the object to be photographed in the first image;

[0039] The preset coordinate transformation relationship is the transformation relationship between the coordinate system corresponding to the telephoto camera and the coordinate system corresponding to the short-focus camera.

[0040] Thirdly, embodiments of the present invention also provide an image capturing device, applied to a processing device in any of the systems described in the first aspect, the device comprising:

[0041] The acquisition module is used to acquire the first image captured by the short-focus camera and the second image captured by the long-focus camera, respectively;

[0042] The combined processing module is used to combine the images of the observed regions in the first image and the second image to obtain the target image.

[0043] Optionally, the acquisition module is further configured to acquire a first image captured by the short-focus camera and determine the location information of the observation area of ​​the object to be photographed in the first image; adjust the shooting position of the telephoto camera to the target position according to the location information of the observation area of ​​the object to be photographed in the first image; acquire a second image captured by the telephoto camera at the target position and determine the image of the observation area in the second image.

[0044] Optionally, the combined processing module is further configured to replace the image of the region to be observed in the first image with the image of the region to be observed in the second image to obtain the target image.

[0045] Optionally, the acquisition module is further configured to respond to an input selection operation for the region to be observed, determine the region to be observed in the first image, and acquire the location information corresponding to the region to be observed.

[0046] Optionally, the acquisition module is further configured to determine, in the first image, a target feature that is identical to the feature of the object to be photographed; take the region of a preset size where the target feature is located as the region to be observed and acquire the location information corresponding to the region to be observed.

[0047] Optionally, the combined processing module is further configured to transform the size of the first image according to the first size of the image of the region to be observed in the second image to obtain a first image of a second size; replace the image of the region to be observed in the first image of the second size with the image of the region to be observed in the second image to obtain the target image; wherein, the image of the region to be observed in the first image of the second size is the first size.

[0048] Optionally, the acquisition module is further configured to calculate and acquire the target position based on the position information of the observation area of ​​the object to be photographed in the first image; and send a control command to the driving device based on the target position, wherein the control command is used to instruct the driving device to adjust the position of the slide to control the telephoto camera to move to the target position.

[0049] Optionally, the acquisition module is further configured to calculate and acquire the target position based on the position information of the observation area of ​​the object to be photographed in the first image using a preset coordinate transformation relationship; wherein, the preset coordinate transformation relationship is the transformation relationship between the coordinate system corresponding to the telephoto camera and the coordinate system corresponding to the short-focus camera.

[0050] Fourthly, embodiments of the present invention also provide a processing device, including: a memory and a processor, wherein the memory stores a computer program executable by the processor, and the processor executes the computer program to implement the image capturing method described in any of the first aspects above.

[0051] Fifthly, embodiments of the present invention also provide a storage medium storing a computer program, wherein when the computer program is read and executed, it implements the image capturing method described in any of the first aspects above.

[0052] The beneficial effects of this invention are as follows: This application provides an image capturing method, comprising: acquiring a first image captured by a short-focus camera and a second image captured by a long-focus camera; and combining the images of the area to be observed in the first and second images to obtain a target image. By simultaneously using a long-focus camera and a short-focus camera, acquiring the first and second images respectively, and combining the first and second images to obtain the target image, the advantages of both long-focus and short-focus camera images are combined, enabling accurate and clear acquisition of the image of the area to be observed of the object to be photographed, thus improving the user experience. Attached Figure Description

[0053] To more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings used in the embodiments will be briefly introduced below. It should be understood that the following drawings only show some embodiments of the present invention and should not be regarded as a limitation on the scope. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.

[0054] Figure 1 This is a schematic diagram of the structure of an image capturing system provided in an embodiment of the present invention;

[0055] Figure 2 This is a schematic diagram of the structure of an image capturing system provided in an embodiment of the present invention;

[0056] Figure 3 This is a schematic flowchart of an image capturing method provided in an embodiment of the present invention;

[0057] Figure 4 This is a schematic flowchart of an image capturing method provided in an embodiment of the present invention;

[0058] Figure 5 This is a schematic flowchart of an image capturing method provided in an embodiment of the present invention;

[0059] Figure 6 This is a schematic flowchart of an image capturing method provided in an embodiment of the present invention;

[0060] Figure 7 This is a schematic flowchart of an image capturing method provided in an embodiment of the present invention;

[0061] Figure 8 This is a schematic diagram of the structure of an image capturing device provided in an embodiment of the present invention;

[0062] Figure 9 This is a schematic diagram of a processing device provided in an embodiment of the present invention. Detailed Implementation

[0063] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are some embodiments of the present invention, but not all embodiments.

[0064] Therefore, the following detailed description of the embodiments of this application provided in the accompanying drawings is not intended to limit the scope of the claimed application, but merely to illustrate selected embodiments of the application. All other embodiments obtained by those skilled in the art based on the embodiments of this application without inventive effort are within the scope of protection of this application.

[0065] In the description of this application, it should be noted that if the terms "upper", "lower", etc. appear to indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings, or the orientation or positional relationship that the product of this application is usually placed in, it is only for the convenience of describing this application and simplifying the description, and does not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation, and therefore should not be construed as a limitation of this application.

[0066] Furthermore, the terms "first," "second," etc., used in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that embodiments of the invention described herein can be implemented in orders other than those illustrated or described herein. Additionally, the terms "comprising" and "having," and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0067] It should be noted that, where there is no conflict, the features in the embodiments of this application can be combined with each other.

[0068] Figure 1 This is a schematic diagram of the structure of an image capturing system provided in an embodiment of the present invention, as shown below. Figure 1 As shown, the image capturing system may include: a beam splitter 101, a short-focus camera 102, a long-focus camera 103, and a processing device 104.

[0069] The processing device 104 is connected to both the short-focus camera 102 and the long-focus camera 103. The connection between the processing device 104 and the short-focus camera 102 and the long-focus camera 103 can be a communication connection.

[0070] In addition, the beam splitter 101 is positioned in the direction of the light rays from the object to be photographed, and is used to transmit light rays to the short-focus camera 102 and the long-focus camera 103 respectively; the processing device 104 is used to acquire the first image captured by the short-focus camera 102 and the second image captured by the long-focus camera 103 respectively; and to combine the images of the area to be observed in the first image and the second image to obtain the target image.

[0071] In some embodiments, the beam splitter 101 is positioned in the direction of the light rays from the object to be photographed. The beam splitter 101 can split the light rays from the object to be photographed into two parts, which are transmitted to the short-focus camera 102 and the long-focus camera 103 respectively. Thus, the object to be photographed observed at the positions of the short-focus camera 102 and the long-focus camera 103 is the same. The short-focus camera 102 acquires a first image and sends the first image to the processing device 104, while the long-focus camera 103 acquires a second image and sends the second image to the processing device 104.

[0072] Correspondingly, the processing device 104 can receive the first image acquired by the short-focus camera 102 and the second image acquired by the long-focus camera 103; and perform combined processing on the images of the area to be observed in the first and second images to obtain the target image.

[0073] It should be noted that the short-focus camera 102 may include a short-focus lens and a first camera, while the long-focus camera 103 may include a long-focus lens and a second camera. The short-focus lens is mounted on the first camera, and the long-focus camera 103 is mounted on the second camera. The first image captured by the short-focus camera 102 has a large field of view but low resolution; the second image captured by the long-focus camera 103 has a small field of view but high resolution.

[0074] In summary, this invention provides an image capturing system comprising a beam splitter, a short-focus camera, a long-focus camera, and a processing device. The processing device is connected to both the short-focus and long-focus cameras. The beam splitter is positioned in the direction of light from the object to be photographed, transmitting light to both the short-focus and long-focus cameras respectively. The processing device acquires a first image from the short-focus camera and a second image from the long-focus camera, and combines the images of the observation area in the first and second images to obtain the target image. By simultaneously using both a long-focus and a short-focus camera, acquiring the first and second images respectively, and combining them to obtain the target image, the advantages of both cameras are combined, enabling accurate capture of the observation area of ​​the object to be photographed, thus improving the user experience.

[0075] Optional, Figure 2 This is a schematic diagram of the structure of an image capturing system provided in an embodiment of the present invention, as shown below. Figure 2 As shown, the image capturing structure also includes a slide 202.

[0076] The telephoto camera 103 is placed on the slide 202.

[0077] It should be noted that the telephoto camera 103 can be detachably mounted on the slide table 202, or it can be fixedly mounted on the slide table 202, or it can be mounted on the slide table 202 in other ways. This application embodiment does not impose specific limitations on this.

[0078] In addition, as the slide 202 moves, the shooting position of the telephoto camera 103 placed on the slide 202 also changes.

[0079] In some implementations, when controlling the movement of the slide 202, the operator can manually control the movement of the slide 202 according to the position information of the observation area of ​​the object to be photographed in the first image, so as to change the shooting position of the telephoto camera 103.

[0080] Optional, such as Figure 2 As shown, the image capturing structure also includes a driving device 201.

[0081] The drive device 201 is connected to the processing device 104 and the slide 202 respectively. The processing device 104 is used to determine the shooting position of the telephoto camera 103 as the target position based on the position information of the object to be photographed in the first image, and send a control command to the drive device 201 according to the target position. The control command is used to instruct the drive device 201 to adjust the position of the slide 202 to control the telephoto camera 103 to move to the target position.

[0082] In some embodiments, the processing device 104 sends a control command to the driving device 201 according to the target position, and the driving device 201 adjusts the position of the slide 202 according to the control command, so that the telephoto camera 103 mounted on the slide 202 moves to the target position.

[0083] Optionally, the driving device 201 can be a motor driver. Of course, the driving device 201 can also be other types of devices that can drive the slide table 202. This application embodiment does not impose specific limitations on this.

[0084] Optionally, it also includes: a display device; the display device is connected to the processing device 104 and is used to receive and display the target image.

[0085] The processing device 104 can send the target image to the display device, and the display device can receive and display the target image so that the user can observe the target image.

[0086] The following explanation uses the processing device in the aforementioned image capturing system as the execution subject to illustrate the image capturing method provided in this application embodiment. The processing device can be a terminal, a server, or other types of devices with processing capabilities; this application embodiment does not impose specific limitations on these. If the processing device is a terminal, it can be any of the following: desktop computer, laptop computer, tablet computer, smartphone, etc.

[0087] Figure 3 This is a flowchart illustrating an image capturing method provided in an embodiment of the present invention, as shown below. Figure 3 As shown, the method may include:

[0088] S301. Acquire the first image captured by the short-focus camera and the second image captured by the long-focus camera, respectively.

[0089] In some implementations, the short-focus camera can acquire a first image and send the first image to a processing device; the processing device can receive the first image and move the shooting position of the long-focus camera according to the first image; the long-focus camera can acquire a second image and send the second image to the processing device; the processing device can receive the second image.

[0090] It should be noted that the first image of the object being photographed taken by a short-focal-length camera has a large field of view, but the area to be observed in the first image is not clear; while the second image of the object being photographed taken by a long-focal-length camera has a small field of view, but the area to be observed in the second image is relatively clear.

[0091] S302. Combine the images of the region to be observed in the first image and the second image to obtain the target image.

[0092] The combination methods can include replacement or addition, etc., and this application embodiment does not impose specific limitations on this. For example, an image of the region to be observed in the second image can be added to the first image.

[0093] In some embodiments, the processing device can combine images of the region to be observed in the first image and the second image to obtain a target image. The target image may include an image of the region to be observed in the second image; that is, the target image may contain a clear image of the region to be observed.

[0094] In summary, this application provides an image capturing method, comprising: acquiring a first image captured by a short-focus camera and a second image captured by a long-focus camera; and combining the images of the area to be observed in the first and second images to obtain a target image. By simultaneously using both a long-focus camera and a short-focus camera, acquiring the first and second images respectively, and combining them to obtain the target image, the advantages of both long-focus and short-focus camera images are combined, enabling accurate and clear capture of the area to be observed of the object being photographed, thus improving the user experience.

[0095] Optional, Figure 4 This is a flowchart illustrating an image capturing method provided in an embodiment of the present invention, as shown below. Figure 4 As shown, the process of acquiring the first image captured by the short-focus camera and the second image captured by the long-focus camera in S301 above may include:

[0096] S401. Acquire the first image captured by the short-focus camera and determine the location information of the observation area of ​​the object to be photographed in the first image.

[0097] In this embodiment, after the processing device acquires the first image captured by the short-focus camera, the processing device can respond to the user's input of a selection operation for the area to be observed and determine the location information of the area to be observed of the object to be photographed in the first image; alternatively, it can determine the location information of the area to be observed of the object to be photographed in the first image based on the characteristics of the object to be photographed in the area to be photographed; this embodiment does not impose specific limitations on this.

[0098] S402. Based on the position information of the observation area of ​​the object to be photographed in the first image, adjust the shooting position of the telephoto camera to the target position.

[0099] The beam splitter divides the light rays from the object to be photographed into two parts, transmitting them separately to a short-focus camera and a long-focus camera, respectively. This ensures that the short-focus and long-focus cameras are positioned at the same location. Therefore, based on the location information of the observation area of ​​the object in the first image, the target location that the long-focus camera can capture in the second image can be determined.

[0100] S403. Acquire a second image taken by a telephoto camera at the target location, and determine the area to be observed in the second image.

[0101] In some implementations, the second image captured by the telephoto camera at the target location may include: a clear image of the area to be observed, and images of a portion of the area surrounding the area to be observed. After acquiring the second image captured by the telephoto camera at the target location, the processing device can determine the image of the area to be observed from the second image based on the features of the object to be photographed in the area to be photographed.

[0102] In other embodiments, the second image captured by the telephoto camera at the target location may only include an image of the area to be observed, and the processing device may directly use the second image as the image of the area to be observed.

[0103] Optionally, the target image is obtained by combining the images of the region to be observed in the first image and the second image, including:

[0104] The target image is obtained by replacing the image of the region to be observed in the first image with the image of the region to be observed in the second image.

[0105] In this embodiment of the application, the processing device can delete the image of the region to be observed in the first image to obtain the deleted first image; and fill the deleted first image with the image of the region to be observed in the second image to obtain the target image.

[0106] Optionally, the process of determining the location information of the observation area of ​​the object to be photographed in the first image in S401 above may include:

[0107] In response to the input selection operation for the region to be observed, the region to be observed in the first image is determined and the location information corresponding to the region to be observed is obtained.

[0108] In some implementations, the processing device can control the display of a first image, respond to an input screen adjustment operation for the area to be observed in the first image, display the area to be observed in the first image at the center of the screen, determine the area to be observed in the first image, and determine the position information corresponding to the center of the screen as the area to be observed.

[0109] Optional, Figure 5 This is a flowchart illustrating an image capturing method provided in an embodiment of the present invention, as shown below. Figure 5 As shown, the process of determining the location information of the observation area of ​​the object to be photographed in the first image in S401 above may include:

[0110] S501. In the first image, identify target features that are the same as the features of the object to be photographed.

[0111] The processing device can pre-store the features of the object to be photographed. Based on the pre-stored features, the processing device can match the features in the first image to determine the target features that are identical to the features of the object to be photographed.

[0112] S502. Take the area of ​​a preset size where the target feature is located as the observation area and obtain the location information corresponding to the observation area.

[0113] In this embodiment of the application, the processing device can determine a preset-size region where the target feature is located in the first image, wherein the preset-size region can be determined in advance based on the features of the object to be photographed; then the processing device takes the preset-size region where the target feature is located in the first image as the observation region and determines the position information of the observation region in the first image.

[0114] Optional, Figure 6 This is a flowchart illustrating an image capturing method provided in an embodiment of the present invention, as shown below. Figure 6 As shown, the process of replacing the image of the region to be observed in the first image with the image of the region to be observed in the second image to obtain the target image may include:

[0115] S601. Based on the first size of the region to be observed in the second image, the size of the first image is transformed to obtain the first image with the second size.

[0116] The first dimension can be larger than the second dimension.

[0117] In some embodiments, the processing device can enlarge the size of the first image according to the first size of the image of the region to be observed in the second image to obtain a first image of a second size, wherein the size of the image of the region to be observed in the second-sized first image is the first size.

[0118] For example, the first size of the region to be observed in the second image is 4*4; the size of the first image can also be 4*4, and the size of the region to be observed in the first image is 2*2. Then the second size of the first image obtained by transformation can be 8*8, and the size of the region to be observed in the first image with the second size is 4*4.

[0119] S602. Replace the image of the region to be observed in the first image of the second size with the image of the region to be observed in the second image to obtain the target image.

[0120] In this context, the image of the region to be observed in the first image of the second size is of the first size. The image of the region to be observed in the first image of the second size has the same size as the image of the region to be observed in the second image.

[0121] Optionally, the processing device can delete the image of the region to be observed in the first image of the second size to obtain the processed first image of the second size; then fill the image of the region to be observed in the second image into the processed first image of the second size to obtain the target image.

[0122] Optional, Figure 7 This is a flowchart illustrating an image capturing method provided in an embodiment of the present invention, as shown below. Figure 7 As shown, the process in S402 above, which adjusts the shooting position of the telephoto camera to the target position based on the position information of the observation area of ​​the object to be photographed in the first image, may include:

[0123] S701. Calculate and obtain the target position based on the position information of the observation area of ​​the object to be photographed in the first image.

[0124] It should be noted that since both telephoto and short-focus cameras capture light passing through a beam splitter prism positioned in the direction of the light from the object being photographed, the processing device can easily determine the target position by executing S701.

[0125] S702. Send control commands to the drive device according to the target position.

[0126] Among them, control commands can be used to instruct the drive device to adjust the position of the slide to control the telephoto camera to move to the target position.

[0127] In some implementations, the processing device can send a control command to the driving device according to the target position; the driving device can receive the control command and adjust the position of the slide according to the control command, and the telephoto camera set on the slide can also move to the target position and take a second image at the target position.

[0128] Optionally, the process of calculating and obtaining the target position in S701 above based on the position information of the observation area of ​​the object to be photographed in the first image may include: using a preset coordinate transformation relationship, calculating and obtaining the target position based on the position information of the observation area of ​​the object to be photographed in the first image.

[0129] The preset coordinate transformation relationship is the transformation relationship between the coordinate system corresponding to the telephoto camera and the coordinate system corresponding to the short focal length camera.

[0130] In some implementations, the preset coordinate transformation relationship can be a preset formula with preset parameters. The input of the preset formula can be the position coordinates of the observation area of ​​the object to be photographed in the first image, and the output coordinates can be the target position coordinates.

[0131] In addition, the coordinate system corresponding to the short-focal-length camera can be called the camera coordinate system, and the coordinate system corresponding to the long-focal-length camera fixed on the slide can be called the slide coordinate system. Since a beam splitter is used, the camera coordinate system and the slide coordinate system can be on the same plane.

[0132] In this embodiment, the camera coordinate system can be transformed to the sliding table coordinate system through scaling, translation, and rotation. A point P1(x1, y1) in any camera coordinate system can be transformed to the sliding table coordinate system P2(x2, y2) through a preset coordinate transformation relationship. This preset coordinate transformation relationship can be expressed as:

[0133] a1*x1+b1*y1+c1=x2

[0134] a²x₁ + b²y₁ + c² = y₂

[0135] Where a1, b1, c1, a2, b2, and c2 are preset parameters.

[0136] It should be noted that when solving for the preset parameters, you can take any point in the short-focus camera and record the coordinates P1. Manually adjust the slide so that the long-focus camera set on the slide can capture the above point and record the coordinates P2. Take several sets of such points, for example, you can take 3 sets of such points to solve for the preset parameters.

[0137] In addition, once the slide and telephoto camera are assembled, the preset coordinate transformation relationship is fixed and can be saved.

[0138] In summary, this application provides an image capturing method, comprising: acquiring a first image captured by a short-focus camera and a second image captured by a long-focus camera; and combining the images of the area to be observed in the first and second images to obtain a target image. By simultaneously using both a long-focus camera and a short-focus camera, acquiring the first and second images respectively, and combining them to obtain the target image, the advantages of both long-focus and short-focus camera images are combined, enabling accurate and clear capture of the area to be observed of the object being photographed, thus improving the user experience.

[0139] Furthermore, by splitting the optical path of the object to be photographed into two paths and transmitting them separately to a telephoto camera and a short-focus camera, respectively, and then fusing the data from the two cameras, the system achieves both a wide field of view and high resolution. Of course, multiple beam splitters can be used in conjunction with multiple cameras that offer more precise focal length divisions, resulting in a more natural transition in the fused image and higher magnification. The image capture method provided in this application also features low cost, while significantly improving magnification at a low cost.

[0140] The following describes the image capturing apparatus, processing device, and storage medium used to execute the image capturing method provided in this application. For the specific implementation process and technical effects, please refer to the relevant content of the above method, which will not be repeated below.

[0141] Figure 8 This is a schematic diagram of the structure of an image capturing device provided in an embodiment of the present invention, as shown below. Figure 8 As shown, this device can be applied to the processing equipment in an image capturing system, and the device includes:

[0142] The acquisition module 901 is used to acquire the first image captured by the short-focus camera and the second image captured by the long-focus camera, respectively.

[0143] The combination processing module 902 is used to combine the images of the observation area in the first image and the second image to obtain the target image.

[0144] Optionally, the acquisition module 901 is further configured to acquire a first image captured by the short-focus camera and determine the location information of the observation area of ​​the object to be photographed in the first image; adjust the shooting position of the telephoto camera to the target position according to the location information of the observation area of ​​the object to be photographed in the first image; acquire a second image captured by the telephoto camera at the target position and determine the image of the observation area in the second image.

[0145] Optionally, the combined processing module 902 is further configured to replace the image of the region to be observed in the first image with the image of the region to be observed in the second image to obtain the target image.

[0146] Optionally, the acquisition module 901 is further configured to respond to an input selection operation for the region to be observed, determine the region to be observed in the first image, and acquire the location information corresponding to the region to be observed.

[0147] Optionally, the acquisition module 901 is further configured to determine, in the first image, a target feature that is identical to the feature of the object to be photographed; take the area of ​​a preset size where the target feature is located as the observation area and acquire the location information corresponding to the observation area.

[0148] Optionally, the combined processing module 902 is further configured to transform the size of the first image according to the first size of the image of the region to be observed in the second image to obtain a first image of a second size; and replace the image of the region to be observed in the first image of the second size with the image of the region to be observed in the second image to obtain the target image; wherein the image of the region to be observed in the first image of the second size is the first size.

[0149] Optionally, the acquisition module 901 is further configured to calculate and acquire the target position based on the position information of the observation area of ​​the object to be photographed in the first image; and send a control command to the driving device based on the target position, wherein the control command is used to instruct the driving device to adjust the position of the slide to control the telephoto camera to move to the target position.

[0150] Optionally, the acquisition module 901 is further configured to calculate and acquire the target position based on the position information of the observation area of ​​the object to be photographed in the first image using a preset coordinate transformation relationship; wherein, the preset coordinate transformation relationship is the transformation relationship between the coordinate system corresponding to the telephoto camera and the coordinate system corresponding to the short-focus camera.

[0151] The above-described device is used to execute the method provided in the foregoing embodiments, and its implementation principle and technical effect are similar, so they will not be described again here.

[0152] These modules can be one or more integrated circuits configured to implement the above methods, such as one or more Application Specific Integrated Circuits (ASICs), one or more digital signal processors (DSPs), or one or more Field Programmable Gate Arrays (FPGAs). Alternatively, when a module is implemented using processing element scheduler code, the processing element can be a general-purpose processor, such as a Central Processing Unit (CPU) or other processor capable of calling program code. Furthermore, these modules can be integrated together as a system-on-a-chip (SOC).

[0153] Figure 9 This is a schematic diagram of the structure of a processing device provided in an embodiment of the present invention, as shown below. Figure 9 As shown, the processing device may include a processor 1001 and a memory 1002. The memory 1002 stores programs, and the processor 1001 calls the programs stored in the memory 1002 to execute the above-described method embodiments. The specific implementation and technical effects are similar and will not be repeated here.

[0154] Optionally, the present invention also provides a program product, such as a computer-readable storage medium, including a program that, when executed by a processor, is used to perform the above-described method embodiments.

[0155] In the several embodiments provided by this invention, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0156] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0157] Furthermore, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or in the form of hardware plus software functional units.

[0158] The integrated units implemented as software functional units described above can be stored in a computer-readable storage medium. These software functional units, stored in a storage medium, include several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) or processor to execute some steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0159] The above are merely preferred embodiments of the present invention and are not intended to limit the present invention. Various modifications and variations can be made to the present invention by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the scope of protection of the present invention.

Claims

1. An image capturing system, characterized in that, include: Beam splitter, short-focus camera, long-focus camera, processing equipment, slide table and drive equipment; The processing devices are all connected to the short-focus camera and the long-focus camera; the long-focus camera is placed on the slide table; the driving devices are connected to the processing devices and the slide table respectively. The beam splitter is positioned in the direction of the light rays from the object to be photographed, and is used to transmit light rays to the short-focus camera and the long-focus camera respectively; The processing device is used to acquire the first image captured by the short-focus camera and determine the location information of the observation area of ​​the object to be photographed in the first image. Based on the location information of the observation area of ​​the object to be photographed in the first image, the shooting position of the telephoto camera is determined as the target position, and a control command is sent to the driving device according to the target position. The control command is used to instruct the driving device to adjust the position of the slide to control the telephoto camera to move to the target position. Acquire a second image taken by the telephoto camera at the target location, and determine the image of the area to be observed in the second image; Based on the first size of the image of the region to be observed in the second image, the size of the first image is transformed to obtain a first image of the second size; The target image is obtained by replacing the image of the region to be observed in the first image of the second size with the image of the region to be observed in the second image. Wherein, the image in the observation area of ​​the first image of the second size is of the first size.

2. The system according to claim 1, characterized in that, Also includes: The display device is connected to the processing device and is used to receive and display the target image.

3. An image capturing method, characterized in that, The processing device applied to the system according to any one of claims 1-2, the method comprising: Acquire the first image captured by the short-focus camera, and determine the location information of the observation area of ​​the object to be photographed in the first image; The target position is calculated and obtained based on the position information of the observation area of ​​the object to be photographed in the first image; According to the target position, a control command is sent to the drive device, and the control command is used to instruct the drive device to adjust the position of the slide to control the telephoto camera to move to the target position; Acquire a second image taken by the telephoto camera at the target location, and determine the image of the area to be observed in the second image; Based on the first size of the image of the region to be observed in the second image, the size of the first image is transformed to obtain a first image of the second size; Based on the first size of the image of the region to be observed in the second image, the size of the first image is transformed to obtain a first image of the second size; The target image is obtained by replacing the image of the region to be observed in the first image of the second size with the image of the region to be observed in the second image. Wherein, the image in the observation area of ​​the first image of the second size is of the first size.

4. The method according to claim 3, characterized in that, The step of determining the location information of the observation area of ​​the object to be photographed in the first image includes: In response to the input selection operation for the region to be observed, the region to be observed in the first image is determined and the location information corresponding to the region to be observed is obtained.

5. The method according to claim 3, characterized in that, The step of determining the location information of the observation area of ​​the object to be photographed in the first image includes: In the first image, target features that are identical to the features of the object to be photographed are identified; The region of a preset size containing the target feature is taken as the region to be observed, and the location information corresponding to the region to be observed is obtained.

6. The method according to claim 3, characterized in that, The step of calculating and obtaining the target position based on the position information of the observation area of ​​the object to be photographed in the first image includes: Using a preset coordinate transformation relationship, the target position is calculated and obtained based on the position information of the observation area of ​​the object to be photographed in the first image; The preset coordinate transformation relationship is the transformation relationship between the coordinate system corresponding to the telephoto camera and the coordinate system corresponding to the short-focus camera.

7. An image capturing device, characterized in that, A processing device applied to the system according to any one of claims 1-2, the device comprising: The acquisition module is used to acquire the first image captured by the short-focus camera and the second image captured by the long-focus camera, respectively; The processing module is used to combine the images of the observed region in the first image and the second image to obtain the target image.

8. A processing apparatus, characterized in that, include: A memory and a processor, wherein the memory stores a computer program executable by the processor, and the processor executes the computer program to implement the image capturing method according to any one of claims 3-6.

9. A storage medium, characterized in that, The storage medium stores a computer program, which, when read and executed, implements the image capturing method according to any one of claims 3-6.

Citation Information

Patent Citations

  • Video structurization system and target search method thereof

    CN105893510A

  • Image fusion method and device

    CN111818304A

  • Dynamic monitoring camera device and dynamic monitoring method

    CN112565568A