A remote imaging transmission system and method for liquid lens
By working together with the wide-angle and telephoto subsystems, combined with a liquid lens and a remote control module, the system achieves full-area monitoring and precise monitoring of local magnified locations in urban road surveillance systems, solving the problems of complex equipment and heavy data processing pressure in traditional surveillance systems.
Patent Information
- Application Number
- CN202311667042.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-12-06
- Publication Date
- 2025-10-28
- Estimated Expiration
- 2043-12-06
AI Technical Summary
In existing urban road monitoring systems, the use of multiple cameras results in complex equipment, large data volume, and heavy data processing pressure. Furthermore, traditional monitoring systems are cumbersome in design and cannot achieve the synergistic effect of monitoring the entire area and accurately monitoring local locations.
It employs a wide-angle subsystem and a telephoto subsystem working together to achieve real-time imaging of the target area through a liquid lens. Combined with a remote control module and a target focusing module, it enables precise monitoring of the entire area and local magnification.
It achieves real-time imaging of any target under ultra-wide-angle conditions, completes full-area monitoring of the target area and precise monitoring of local locations, reduces the pressure of monitoring data processing, and avoids the cumbersome design of traditional monitoring systems.
Smart Images

Figure CN117640893B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of remote imaging technology, and in particular to a remote imaging transmission system and method using a liquid lens. Background Technology
[0002] Urban roads, as a fundamental component of urban construction, play a crucial role in urban security and crime prevention. Urban road traffic monitoring systems, as a vital means of traffic management, also serve a significant function. Currently, common road video surveillance systems typically employ multiple types of cameras (e.g., fixed-focus cameras: providing clear imaging of targets at a specific distance within the field of view, but with significant limitations, often used for capturing license plate information at intersections; mechanical zoom cameras: commonly used for capturing traffic violations at intersections, but bulky, slow zoom imaging speed, and prone to losing information about high-speed moving targets, often used in conjunction with fixed-focus cameras; panoramic spherical cameras: compensating for the small field of view of fixed cameras, but extremely slow speed and having blind spots; fisheye wide-angle cameras: large field of view, but with severe lens distortion and very low edge imaging quality) to compensate for functional deficiencies. While using multiple cameras simultaneously can collect complex road information, it also results in numerous monitoring devices at various locations, making the entire system overly complex. Furthermore, the large number of cameras and the resulting massive data volume lead to a relatively long data processing time. This approach is beneficial for compatibility and use with artificial intelligence technologies such as facial recognition and big data algorithms. Summary of the Invention
[0003] This invention provides a remote imaging transmission system and method for liquid lenses to solve the above-mentioned problems. Through the coordinated work of the wide-angle subsystem and the telephoto subsystem, it provides a field of view that ordinary wide-angle cameras cannot match, enabling real-time imaging of any target within the target area. It achieves accurate monitoring of the entire area as well as local magnification of the area, avoiding the overly cumbersome design of traditional monitoring systems and reducing the pressure of monitoring data processing.
[0004] This invention provides a remote imaging transmission system for a liquid lens, comprising:
[0005] The wide-angle imaging module is used to acquire real-time monitoring images of the target area based on the wide-angle subsystem.
[0006] The remote control module is used to send real-time monitoring images to a remote target display terminal for display based on a preset communication protocol, and to obtain target capture operation information of the display terminal on the real-time monitoring images in real time.
[0007] The target focusing module is used to control the telephoto subsystem to focus on the area to be focused on based on the target capture operation information, acquire local dynamic images, and send them to the display end.
[0008] Preferably, in a remote imaging transmission system for a liquid lens, the wide-angle imaging module includes:
[0009] The target setting unit is used to obtain the user's shooting requirement information, and based on the shooting requirement information and the actual situation of the shooting target, determine the effective shooting area corresponding to the real-time shooting target, and use the effective shooting area as the target area.
[0010] The parameter determination unit is used to acquire the region data corresponding to the target region and determine the first lens parameters corresponding to the wide-angle lens based on the region data.
[0011] The first control unit is used to generate a first control command based on the first lens parameters and send it to the wide-angle subsystem to adjust the shooting angle and focal length of the wide-angle lens. After the adjustment is completed, it acquires a real-time monitoring image of the target area based on the wide-angle lens.
[0012] Preferably, in a remote imaging transmission system for a liquid lens, the first control unit includes:
[0013] The confirmation subunit is used to adjust the shooting angle and focal length of the wide-angle lens based on the first lens parameters, acquire a test image, extract features from the test image, and obtain the scene features within the shooting area.
[0014] Based on the actual condition of the target, the edge features of the target area are determined, and the edge features are compared with the scene features to determine the position of the edge features of the target area in the test image.
[0015] When all edge objects are within the edge of the test image, the wide-angle lens adjustment is considered complete.
[0016] The fine-tuning subunit is used when all edge objects are in the test image, but there are edges where edge objects are not in the test image. It takes the edge objects that are not in the test image as the first target objects and obtains the error distance between the first target objects and the edge of the test image.
[0017] Based on the error distance and combined with the wide-angle lens parameter adjustment reference table, the shooting angle and focal length fine-tuning strategy corresponding to the wide-angle lens are determined, and the wide-angle lens parameters are fine-tuned according to the fine-tuning strategy.
[0018] The first adjustment subunit is used to determine the target feature corresponding to the image center on the test image when there are edge objects that are not in the test image;
[0019] Acquire a planar image of the target region, mark the image center on the planar image based on the target features, and simultaneously determine and mark the region center of the target region based on the planar image.
[0020] When the image center coincides with the region center, mark the first edge scene of the test image edge in the planar image, and obtain the first distance from the first edge scene to the region center and the second distance of the first edge scene to the planar image edge scene;
[0021] Based on the size of the test image and the first distance, a second image scale is obtained, and based on the second image scale and the second distance, the missing distance of the test image is obtained;
[0022] Based on the incomplete distance and combined with the wide-angle lens parameter adjustment reference table, the first adjustment strategy for the shooting angle and focal length corresponding to the wide-angle lens is determined, and the parameters of the wide-angle lens are readjusted according to the first adjustment strategy.
[0023] Preferably, in a remote imaging transmission system for a liquid lens, the first control unit further includes:
[0024] The second adjustment subunit is used to obtain the first center error between the region center and the test image center based on the marked planar image when the image center and the region center do not coincide, and at the same time obtain the second center error between the region center and the test image center.
[0025] Based on the first center error and the second center error, the first image scale corresponding to the current wide-angle lens shooting scene is obtained, the second edge scene of the test image is obtained, and the actual error distance between the second edge scene and the edge scene of the target area is determined by marking on the planar image.
[0026] Based on the second image scale, the expansion width of the corresponding viewpoint of the image is determined. Based on the expansion width and combined with the wide-angle lens parameter adjustment table, the first adjustment strategy for the shooting viewpoint and focal length corresponding to the wide-angle lens is determined.
[0027] After aligning the shooting center of the wide-angle lens with the center of the area, the parameters of the wide-angle lens are readjusted according to the second adjustment strategy.
[0028] Preferably, in a remote imaging transmission system for a liquid lens, the remote control module includes:
[0029] The image sending unit is used to acquire a preset communication protocol, determine the target terminal device, and send the real-time monitoring image to the display end of the target terminal device for display.
[0030] The operation capture unit is used to acquire operation information of real-time operations performed by the user on the display end, and determine the operation attributes corresponding to the real-time operation based on the operation information. When the operation is a target capture operation, a target capture command is generated and sent to the target focusing module.
[0031] Preferably, in a remote imaging transmission system for a liquid lens, the operation capture unit includes:
[0032] The capture subunit is used to capture the user's real-time operations on the video operation page on the display terminal, obtain the operation information corresponding to each real-time operation, and determine the operation attributes based on the operation information. The operation attributes include target capture operations and regular video operations.
[0033] The target determination unit is used to determine the click point corresponding to the target capture operation on the real-time monitoring screen when the user's real-time operation is a target capture operation, and to determine the target type of the clicked target at the click point. When the clicked target is an object, the object is taken as the capture target.
[0034] Otherwise, use the clicked point as the focus point;
[0035] The instruction acquisition unit is used to acquire the image coordinates of the target and generate a target capture instruction based on the image coordinates and the target type.
[0036] The command sending unit is used to send target acquisition commands to the target focusing module.
[0037] Preferably, in a remote imaging transmission system for a liquid lens, the target focusing module includes:
[0038] The information receiving unit is used to receive target acquisition instructions, parse the target acquisition instructions, and determine the user's acquisition target or focus point;
[0039] The local magnification unit is used to take the target or focus point as the focus center, control the shooting center of the liquid lens to coincide with the focus center, and change the voltage of the liquid lens according to the user's magnification ratio to complete the focusing of the liquid lens.
[0040] The image acquisition unit is used to acquire local dynamic images centered on the target or focal point through a liquid lens;
[0041] The image display unit is used to acquire a preset communication protocol corresponding to the real-time monitoring image of a local dynamic image, and based on the preset communication protocol, send the local dynamic image to a preset display area of the display end of the target terminal device for display.
[0042] Preferably, in a remote imaging transmission system for a liquid lens, the local magnification unit includes:
[0043] The object magnification subunit is used to adjust the focus of the liquid lens based on the user's real-time magnification ratio when the focus center is the target. When a clear object appears in the local dynamic image obtained by the liquid lens, the outline of the object is located. Based on the positioning result, the magnification angle of the liquid lens is adjusted to ensure that the object is entirely in the center of the local dynamic image until the local dynamic image can no longer meet the overall shooting image presentation requirements of the object.
[0044] The point image magnification subunit is used to magnify the focus area always with the focus point as the center when the focus center is the focus point;
[0045] The secondary focusing subunit is used to perform secondary magnification of local details based on the object or focus area corresponding to the user's secondary click point when the user performs a secondary magnification operation on a local dynamic image or when the local dynamic image cannot meet the requirements of the overall image presentation.
[0046] Preferably, in a remote imaging transmission system for a liquid lens, the local magnification unit further includes:
[0047] The operation monitoring subunit is used to monitor the user's operation click points, compare the current click point with the click position of the previous click point to obtain the click position difference, and when the click position difference is less than or equal to a preset value, it is determined that the current click point is the user's second zoom-in operation;
[0048] Otherwise, the current user operation will be sent to the operation capture unit for processing.
[0049] This invention provides a remote imaging transmission method for a liquid lens, comprising:
[0050] Step 1: Based on the wide-angle subsystem, acquire the real-time monitoring image corresponding to the target area;
[0051] Step 2: Based on the preset communication protocol, send the real-time monitoring screen to the remote target display terminal for display, and obtain the target capture operation information of the display terminal on the real-time monitoring screen in real time;
[0052] Step 3: Based on the target capture operation information, control the telephoto subsystem to focus on and capture the area to be focused, obtain local dynamic images, and send them to the display terminal.
[0053] Compared with the prior art, the present invention has at least the following beneficial effects:
[0054] This invention, based on a wide-angle subsystem, acquires real-time monitoring images of the target area, achieving full-area monitoring of the target area. Then, through a remote control module, based on a preset communication protocol, the real-time monitoring images are sent to a remote target display terminal for display. The module also acquires real-time target capture operation information from the display terminal, enabling remote transmission of the monitoring images. Based on this target capture operation information, the telephoto subsystem is controlled to focus on and capture images of the area to be focused, obtaining local dynamic images, which are then sent to the display terminal. According to the user's actual needs, details of the local area can be magnified based on the user's selection, achieving remote control of the liquid lens. This invention, through the collaborative work of the wide-angle and telephoto subsystems, achieves a tight integration of wide-angle and telephoto lenses, providing a field of view unmatched by ordinary wide-angle cameras. This makes real-time imaging of any target under ultra-wide-angle conditions possible, completing both full-area monitoring of the target area and precise monitoring of local magnification. This effectively avoids the overly cumbersome design of traditional monitoring systems and reduces the pressure on monitoring data processing.
[0055] Other features and advantages of the invention will be set forth in the description which follows, and will be apparent in part from the description, or may be learned by practicing the invention. The objects and other advantages of the invention may be realized and obtained by means of the structures particularly pointed out in the written description, claims, and drawings.
[0056] The technical solution of the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. Attached Figure Description
[0057] The accompanying drawings are provided to further illustrate the invention and form part of the specification. They are used in conjunction with embodiments of the invention to explain the invention and do not constitute a limitation thereof. In the drawings:
[0058] Figure 1 This is a schematic diagram of a remote imaging transmission system for a liquid lens according to an embodiment of the present invention;
[0059] Figure 2 This is a schematic diagram of a wide-angle imaging module of a remote imaging transmission system for a liquid lens according to an embodiment of the present invention;
[0060] Figure 3 This is a schematic diagram of a remote control module for a remote imaging transmission system of a liquid lens according to an embodiment of the present invention;
[0061] Figure 4 This is a schematic diagram of a target focusing module of a remote imaging transmission system for a liquid lens according to an embodiment of the present invention;
[0062] Figure 5 This is a step diagram of a remote imaging transmission method using a liquid lens according to an embodiment of the present invention. Detailed Implementation
[0063] The preferred embodiments of the present invention will be described below with reference to the accompanying drawings. It should be understood that the preferred embodiments described herein are for illustration and explanation only and are not intended to limit the present invention.
[0064] Example 1:
[0065] This invention provides a remote imaging transmission system for liquid lenses, such as... Figure 1 As shown, it includes:
[0066] The wide-angle imaging module is used to acquire real-time monitoring images of the target area based on the wide-angle subsystem.
[0067] The remote control module is used to send real-time monitoring images to a remote target display terminal for display based on a preset communication protocol, and to obtain target capture operation information of the display terminal on the real-time monitoring images in real time.
[0068] The target focusing module is used to control the telephoto subsystem to focus on the area to be focused on based on the target capture operation information, acquire local dynamic images, and send them to the display end.
[0069] In this embodiment, the wide-angle subsystem consists of a high-speed camera and a wide-angle lens. The telephoto subsystem consists of a high-speed camera, a telephoto lens, a liquid lens, and a two-position mirror.
[0070] In this embodiment, the target area refers to the area that the user sets as requiring wide-angle monitoring.
[0071] In this embodiment, target capture operation information refers to the target location or target object that the user needs to zoom in to view in detail.
[0072] In this embodiment, the local dynamic image refers to the magnified dynamic image captured by the liquid lens.
[0073] The beneficial effects of the above technical solution are as follows: Based on the wide-angle subsystem, this invention acquires real-time monitoring images of the target area, realizing full-area monitoring of the target area. Then, through the remote control module, based on a preset communication protocol, the real-time monitoring images are sent to a remote target display terminal for display. The display terminal also acquires target capture operation information for the real-time monitoring images in real time, enabling remote transmission of the monitoring images. Based on the target capture operation information, the telephoto subsystem is controlled to focus on and capture images of the area to be focused, obtaining local dynamic images, which are then sent to the display terminal. According to the user's actual needs, the details of the local area are magnified according to the user's selection, realizing remote control of the liquid lens. This invention, through the collaborative work of the wide-angle and telephoto subsystems, achieves a close integration of wide-angle and telephoto lenses, providing a field of view unmatched by ordinary wide-angle cameras. This makes real-time imaging of any target under ultra-wide-angle conditions possible, completing full-area monitoring of the target area and accurate monitoring of local magnification. This effectively avoids the overly cumbersome design of traditional monitoring systems and also reduces the pressure on monitoring data processing.
[0074] Example 2:
[0075] Based on Example 1, the wide-angle imaging module, such as Figure 2 As shown, it includes:
[0076] The target setting unit is used to obtain the user's shooting requirement information, and based on the shooting requirement information and the actual situation of the shooting target, determine the effective shooting area corresponding to the real-time shooting target, and use the effective shooting area as the target area.
[0077] The parameter determination unit is used to acquire the region data corresponding to the target region and determine the first lens parameters corresponding to the wide-angle lens based on the region data.
[0078] The first control unit is used to generate a first control command based on the first lens parameters and send it to the wide-angle subsystem to adjust the shooting angle and focal length of the wide-angle lens. After the adjustment is completed, it acquires a real-time monitoring image of the target area based on the wide-angle lens.
[0079] In this embodiment, the shooting requirement information refers to the user's requirements for the shooting content, such as the shooting range and shooting content.
[0080] In this embodiment, the shooting target refers to the object being photographed by the wide-angle lens, such as an intersection, a pedestrian crossing, or the entrance of a shopping mall. In reality, it refers to the range and shape of the shooting target.
[0081] In this embodiment, the effective area refers to the maximum effective range of the target captured by the wide-angle lens at the current location.
[0082] In this embodiment, the area data refers to the size data of the target area and the environmental data within the area.
[0083] In this embodiment, the first lens parameter refers to the lens parameter corresponding to when the wide-angle lens can capture a complete dynamic image of the target area.
[0084] In this embodiment, the first control command refers to the command to adjust the parameters sent by the wide-angle lens.
[0085] The beneficial effects of the above technical solution are as follows: Based on the user's shooting requirements and the actual condition of the target, this invention automatically locks the shooting area of the wide-angle lens, determines the effective shooting range of the wide-angle lens (i.e., the target area), and automatically adjusts the wide-angle lens parameters according to this effective range. This ensures that the wide-angle lens can monitor the entire target area during daily monitoring, requiring only...
[0086] Example 3:
[0087] Based on Embodiment 2, the first control unit includes:
[0088] The confirmation subunit is used to adjust the shooting angle and focal length of the wide-angle lens based on the first lens parameters, acquire a test image, extract features from the test image, and obtain the scene features within the shooting area.
[0089] Based on the actual scene setting of the target area, the edge scene features of the target area are determined, and the edge scene features are compared with the scene features to determine the position of the edge scene features in the test image.
[0090] When all edge objects are within the edge of the test image, the wide-angle lens adjustment is considered complete.
[0091] The fine-tuning subunit is used when all edge objects are in the test image, but there are edges where edge objects are not in the test image. It takes the edge objects that are not in the test image as the first target objects and obtains the error distance between the first target objects and the edge of the test image.
[0092] Based on the error distance and combined with the wide-angle lens parameter adjustment reference table, the shooting angle and focal length fine-tuning strategy corresponding to the wide-angle lens are determined, and the wide-angle lens parameters are fine-tuned according to the fine-tuning strategy.
[0093] The first adjustment subunit is used to determine the target feature corresponding to the image center on the test image when there are edge objects that are not in the test image;
[0094] Acquire a planar image of the target region, mark the image center on the planar image based on the target features, and simultaneously determine and mark the region center of the target region based on the planar image.
[0095] When the image center coincides with the region center, mark the first edge scene of the test image edge in the planar image, and obtain the first distance from the first edge scene to the region center and the second distance from the first edge scene to the edge scene of the planar image;
[0096] Based on the size of the test image and the first distance, a first image scale is obtained, and based on the second image scale and the second distance, the missing distance of the test image is obtained;
[0097] Based on the incomplete distance and combined with the wide-angle lens parameter adjustment reference table, the first adjustment strategy for the shooting angle and focal length corresponding to the wide-angle lens is determined, and the parameters of the wide-angle lens are readjusted according to the first adjustment strategy.
[0098] The second adjustment subunit is used to obtain the first center error between the region center and the test image center based on the marked planar image when the image center and the region center do not coincide, and at the same time obtain the second center error between the region center and the test image center.
[0099] Based on the first center error and the second center error, the second image scale corresponding to the current wide-angle lens shooting scene is obtained, the second edge scene of the test image is obtained, and the actual error distance between the second edge scene and the edge scene of the target area is determined by marking on the planar image.
[0100] Based on the second image scale, the expansion width of the corresponding viewpoint of the image is determined. Based on the expansion width and combined with the wide-angle lens parameter adjustment table, the first adjustment strategy for the shooting viewpoint and focal length corresponding to the wide-angle lens is determined.
[0101] After aligning the shooting center of the wide-angle lens with the center of the area, the parameters of the wide-angle lens are readjusted according to the second adjustment strategy.
[0102] In this embodiment, the test image refers to the image captured by the wide-angle lens after the user has adjusted the parameters of the wide-angle lens according to the first parameter.
[0103] In this embodiment, when the wide-angle lens adjustment is completed, the corresponding lens parameters will be set to the default parameters of the wide-angle lens. When the user does not adjust the wide-angle parameters, the wide-angle lens can always shoot based on these parameters. When the user zooms in to view the wide-angle image, the wide-angle lens parameters can be automatically adjusted according to the user's control. After the user finishes viewing, the parameters will automatically return to the default parameters, ensuring that the wide-angle lens can capture the target area from all directions during daily shooting, thus improving the reliability of real-time monitoring images.
[0104] In this embodiment, the shooting area refers to the range of the target area presented in the captured test image.
[0105] In this embodiment, scene features refer to the outline features and color features of each object within the shooting area.
[0106] In this embodiment, the actual set design refers to the distribution of fixed objects (e.g., trees, transformers, sculptures, etc.) within the target area.
[0107] In this embodiment, edge scene features refer to the outline features and color features of fixed objects on the edge of the target area.
[0108] In this embodiment, the first target scene refers to an edge scene that is within the test image but not at the edge of the test image, wherein the edge scene refers to a fixed object on the edge of the target area.
[0109] In this embodiment, the error distance refers to the distance between the first target object on the test image and the edge of the test image.
[0110] In this embodiment, the wide-angle lens parameter adjustment reference table is a table generated based on the correspondence between the image distance determined by the camera shooting experiment and the wide-angle lens parameter adjustment. This table is pre-stored in the storage unit.
[0111] In this embodiment, the fine-tuning strategy refers to adjusting the parameters of a wide-angle lens so that the edge objects of the target area are all within the test image.
[0112] In this embodiment, the target feature refers to the feature corresponding to the center of the test image. This feature includes the scene features of the fixed object corresponding to the center of the image and the distance features between the center of the image and the surrounding fixed objects.
[0113] In this embodiment, the region center refers to the center point of the target region.
[0114] In this embodiment, the first edge object refers to a fixed object on the edge of the test image when there is no edge object in the test image and the center of the test image is inconsistent with the regional center of the target area. The fixed object is marked on the planar image of the target area.
[0115] In this embodiment, the first distance refers to the distance from the first edge object to the center of the target area on the planar image; the second distance refers to the distance between the first edge object and the edge object on the planar image of its corresponding location.
[0116] In this embodiment, the first image scale refers to the ratio of half the width or length of the test image to the first distance;
[0117] In this embodiment, the missing distance refers to the distance that should be extended by the first image scale of the test image when there are edge objects not in the test image and the center of the test image is inconsistent with the regional center of the target area.
[0118] In this embodiment, the first adjustment strategy refers to the strategy of adjusting the wide-angle lens parameters when there are edge objects not in the test image and the center of the test image is inconsistent with the regional center of the target area.
[0119] In this embodiment, the first center error refers to the actual distance between the center of the region calculated based on the scale of the planar image and the center of the test image; the second center error refers to the image distance between the center of the region and the center of the test image based on the actual size of the test image.
[0120] In this embodiment, the second image scale refers to the ratio of the first center error to the second center error.
[0121] In this embodiment, the second edge object refers to a fixed object on the edge of the test image when there is an edge object that is not in the test image and the center of the test image is consistent with the regional center of the target area.
[0122] In this embodiment, the actual error distance refers to the length of the image field of view that should be extended according to the first image scale of the test image when there are edge objects not in the test image and the center of the test image is consistent with the regional center of the target area.
[0123] In this embodiment, the second adjustment strategy refers to the strategy of adjusting the wide-angle lens parameters when there are edge objects not in the test image and the center of the test image is consistent with the regional center of the target area.
[0124] The beneficial effects of the above technical solution are as follows: After adjusting the wide-angle lens according to the first lens parameters, the present invention detects the image captured by the wide-angle lens. Based on whether the edge objects in the test image are consistent with the edge objects in the target area, it determines whether the wide-angle lens needs to be readjusted. According to the position of the edge objects in the test image and the distribution of the test image and the center of the target area, the need for readjustment is classified and processed differently to obtain the corresponding image error distance of the test image (including error distance, incomplete distance, and actual error distance). Based on the image error distance and combined with the wide-angle lens parameter adjustment reference table, the corresponding readjustment strategy of the wide-angle lens (including fine-tuning strategy, first adjustment strategy, and second adjustment strategy) is determined. This achieves precise control of the shooting range and parameter adjustment of the wide-angle lens, ensuring that the target area is completely captured and realizing full-area monitoring.
[0125] Example 4:
[0126] Based on Example 1, the remote control module, such as Figure 3 As shown, it includes:
[0127] The image sending unit is used to acquire a preset communication protocol, determine the target terminal device, and send the real-time monitoring image to the display end of the target terminal device for display.
[0128] The operation capture unit is used to acquire operation information of real-time operations performed by the user on the display end, and determine the operation attributes corresponding to the real-time operation based on the operation information. When the operation is a target capture operation, a target capture command is generated and sent to the target focusing module.
[0129] In this embodiment, the target terminal device refers to the device that receives real-time monitoring images and local dynamic images.
[0130] In this embodiment, the operation information includes the user's operation goal and the operation instruction content.
[0131] In this embodiment, target capture operation refers to focusing and magnifying a point or object in the real-time monitoring screen.
[0132] The beneficial effects of the above technical solution are as follows: This invention achieves secure and accurate transmission of real-time dynamic images, as well as remote transmission of user operation commands. It enables coordinated coordination of full-area monitoring and local precise monitoring of the target area. Full-area monitoring of the target area and precise monitoring of local magnification can be completed simply by adjusting the parameters of the wide-angle lens in the wide-angle subsystem and the liquid lens in the telephoto subsystem. This effectively avoids the overly cumbersome design of traditional monitoring systems and also reduces the pressure of monitoring data processing.
[0133] Example 5:
[0134] Based on Example 4, the operation of the capture unit includes:
[0135] The capture subunit is used to capture the user's real-time operations on the video operation page on the display terminal, obtain the operation information corresponding to each real-time operation, and determine the operation attributes based on the operation information. The operation attributes include target capture operations and regular video operations.
[0136] The target determination unit is used to determine the click point corresponding to the target capture operation on the real-time monitoring screen when the user's real-time operation is a target capture operation, and to determine the target type of the clicked target at the click point. When the clicked target is an object, the object is taken as the capture target.
[0137] Otherwise, use the clicked point as the focus point;
[0138] The instruction acquisition unit is used to acquire the image coordinates of the target and generate a target capture instruction based on the image coordinates and the target type.
[0139] The command sending unit is used to send target acquisition commands to the target focusing module.
[0140] In this embodiment, routine video operations refer to all operations other than target capture operations.
[0141] The beneficial effects of the above technical solution are as follows: This invention realizes real-time monitoring of user operations on the real-time monitoring screen, and simplifies real-time operations into two types, effectively and quickly confirming target capture operations, improving the focus control response speed of target capture operations, and determining the type of the target after determining that the real-time operation is a target capture operation, which facilitates the selection of imaging strategies during local magnification and provides users with better local magnified images.
[0142] Example 6:
[0143] Based on Example 1, the target focusing module, such as Figure 4 As shown, it includes:
[0144] The information receiving unit is used to receive target acquisition instructions, parse the target acquisition instructions, and determine the user's acquisition target or focus point;
[0145] The local magnification unit is used to take the target or focus point as the focus center, control the shooting center of the liquid lens to coincide with the focus center, and change the voltage of the liquid lens according to the user's magnification ratio to complete the focusing of the liquid lens.
[0146] The image acquisition unit is used to acquire local dynamic images centered on the target or focal point through a liquid lens;
[0147] The image display unit is used to acquire a preset communication protocol corresponding to the real-time monitoring image of a local dynamic image, and based on the preset communication protocol, send the local dynamic image to a preset display area of the display end of the target terminal device for display.
[0148] The beneficial effects of the above technical solution are as follows: The present invention completes the control of the liquid lens, adjusts the parameters of the liquid lens in real time according to the target acquisition command, provides the user with the best local dynamic image centered on the target or focal point according to the user's magnification needs, and sends the local dynamic image according to the preset communication protocol corresponding to the real-time monitoring image, ensuring the accuracy of the local dynamic image transmission and ensuring the consistency between the local dynamic image and the real-time monitoring image.
[0149] Example 7:
[0150] Based on Example 6, the locally enlarged unit includes:
[0151] The object magnification subunit is used to adjust the focus of the liquid lens based on the user's real-time magnification ratio when the focus center is the target. When a clear object appears in the local dynamic image obtained by the liquid lens, the outline of the object is located. Based on the positioning result, the magnification angle of the liquid lens is adjusted to ensure that the object is entirely in the center of the local dynamic image until the local dynamic image can no longer meet the overall shooting image presentation requirements of the object.
[0152] The point image magnification subunit is used to magnify the focus area always with the focus point as the center when the focus center is the focus point;
[0153] The secondary focusing subunit is used to perform secondary magnification of local details based on the object or focus area corresponding to the user's secondary click point when the user performs a secondary magnification operation on a local dynamic image or when the local dynamic image cannot meet the requirements of the overall image presentation.
[0154] In this embodiment, the real-time zoom ratio refers to the effect that the user expects to achieve in a local dynamic scene by scrolling the mouse or setting the zoom level on the video operation page of the display terminal.
[0155] The beneficial effects of the above technical solution are as follows: This invention performs different magnification processing on different click targets, ensuring that the click target always remains in the center of the local dynamic picture in the early stage of local magnification, which is convenient for users to view and provides users with a good experience. At the same time, it also realizes secondary magnification of a certain part of the local dynamic picture through the secondary focusing sub-unit, providing users with more accurate details.
[0156] Example 8:
[0157] Based on Embodiment 7, the local magnification unit further includes:
[0158] The operation monitoring subunit is used to monitor the user's operation click points, compare the current click point with the click position of the previous click point to obtain the click position difference, and when the click position difference is less than or equal to a preset value, it is determined that the current click point is the user's second zoom-in operation;
[0159] Otherwise, the current user operation will be sent to the operation capture unit for processing.
[0160] In this embodiment, the difference in click position refers to the distance between the current click point and the click position of the previous click point.
[0161] In this embodiment, the secondary magnification operation refers to further focusing and magnifying the details of the captured target or focal point based on the first target capture operation, for example, magnifying the arm movements of the captured target.
[0162] The beneficial effects of the above technical solution are as follows: This invention monitors the user's operation click position and confirms whether the current click is a detail magnification of the target or focus point based on the comparison between the current click position and the previous click position. This achieves precise aggregation and magnification of the target or focus point details, providing users with more detailed local dynamic images, which helps users accurately grasp the real-time dynamics of each position within the target area.
[0163] Example 9:
[0164] This invention provides a remote imaging transmission method for liquid lenses, such as... Figure 5 As shown, it includes:
[0165] Step 1: Based on the wide-angle subsystem, acquire the real-time monitoring image corresponding to the target area;
[0166] Step 2: Based on the preset communication protocol, send the real-time monitoring screen to the remote target display terminal for display, and obtain the target capture operation information of the display terminal on the real-time monitoring screen in real time;
[0167] Step 3: Based on the target capture operation information, control the telephoto subsystem to focus on and capture the area to be focused, obtain local dynamic images, and send them to the display terminal.
[0168] The beneficial effects of the above technical solution are as follows: Based on the wide-angle subsystem, this invention acquires real-time monitoring images of the target area, realizing full-area monitoring of the target area. Then, through the remote control module, based on a preset communication protocol, the real-time monitoring images are sent to a remote target display terminal for display. The display terminal also acquires target capture operation information for the real-time monitoring images in real time, enabling remote transmission of the monitoring images. Based on the target capture operation information, the telephoto subsystem is controlled to focus on and capture images of the area to be focused, obtaining local dynamic images, which are then sent to the display terminal. According to the user's actual needs, the details of the local area are magnified according to the user's selection, realizing remote control of the liquid lens. This invention, through the collaborative work of the wide-angle and telephoto subsystems, achieves a close integration of wide-angle and telephoto lenses, providing a field of view unmatched by ordinary wide-angle cameras. This makes real-time imaging of any target under ultra-wide-angle conditions possible, completing full-area monitoring of the target area and accurate monitoring of local magnification. This effectively avoids the overly cumbersome design of traditional monitoring systems and also reduces the pressure on monitoring data processing.
[0169] Obviously, those skilled in the art can make various modifications and variations to this invention without departing from its spirit and scope. Therefore, if these modifications and variations fall within the scope of the claims of this invention and their equivalents, this invention also intends to include these modifications and variations.
Claims
1. A remote imaging transmission system for a liquid lens, characterized in that, include: The wide-angle imaging module is used to acquire real-time monitoring images of the target area based on the wide-angle subsystem. The remote control module is used to send real-time monitoring images to a remote target display terminal for display based on a preset communication protocol, and to obtain target capture operation information of the display terminal on the real-time monitoring images in real time. The target focusing module is used to control the telephoto subsystem to focus on the area to be focused based on the target capture operation information, acquire local dynamic images, and send them to the display end; The target focusing module includes: The local magnification unit is used to take the target or focus point as the focus center, control the shooting center of the liquid lens to coincide with the focus center, and change the voltage of the liquid lens according to the user's magnification ratio to complete the focusing of the liquid lens. The local magnification unit includes: The object magnification subunit is used to adjust the focus of the liquid lens based on the user's real-time magnification ratio when the focus center is the target. When a clear object appears in the local dynamic image obtained by the liquid lens, the outline of the object is located. Based on the positioning result, the magnification angle of the liquid lens is adjusted to ensure that the object is entirely in the center of the local dynamic image until the local dynamic image can no longer meet the overall shooting image presentation requirements of the object. The point image magnification subunit is used to magnify the focus area always with the focus point as the center when the focus center is the focus point; The secondary focusing subunit is used to perform secondary magnification of local details based on the object or focus area corresponding to the user's secondary click point when the user performs a secondary magnification operation on a local dynamic image or when the local dynamic image cannot meet the requirements of the overall image presentation.
2. The remote imaging transmission system for a liquid lens according to claim 1, characterized in that, Wide-angle imaging module, including: The target setting unit is used to obtain the user's shooting requirement information, and based on the shooting requirement information and the actual situation of the shooting target, determine the effective shooting area corresponding to the real-time shooting target, and use the effective shooting area as the target area. The parameter determination unit is used to acquire the region data corresponding to the target region and determine the first lens parameters corresponding to the wide-angle lens based on the region data. The first control unit is used to generate a first control command based on the first lens parameters and send it to the wide-angle subsystem to adjust the shooting angle and focal length of the wide-angle lens. After the adjustment is completed, it acquires a real-time monitoring image of the target area based on the wide-angle lens.
3. The remote imaging transmission system for a liquid lens according to claim 2, characterized in that, The first control unit includes: The confirmation subunit is used to adjust the shooting angle and focal length of the wide-angle lens based on the first lens parameters, acquire a test image, extract features from the test image, and obtain the scene features within the shooting area. Based on the actual condition of the target, determine the edge features of the target area, and compare the edge features with the scene features to determine the position of the edge features of the target area in the test image; When all edge objects are within the edge of the test image, the wide-angle lens adjustment is considered complete. The fine-tuning subunit is used when all edge objects are in the test image, but there are edges where edge objects are not in the test image. It takes the edge objects that are not in the test image as the first target objects and obtains the error distance between the first target objects and the edge of the test image. Based on the error distance and combined with the wide-angle lens parameter adjustment reference table, the shooting angle and focal length fine-tuning strategy corresponding to the wide-angle lens are determined, and the wide-angle lens parameters are fine-tuned according to the fine-tuning strategy. The first adjustment subunit is used to determine the target feature corresponding to the image center on the test image when there are edge objects that are not in the test image; Acquire a planar image of the target region, mark the image center on the planar image based on the target features, and simultaneously determine and mark the region center of the target region based on the planar image. When the image center coincides with the region center, mark the first edge scene of the test image edge in the planar image, and obtain the first distance from the first edge scene to the region center and the second distance of the first edge scene to the planar image edge scene; Based on the size of the test image and the first distance, a second image scale is obtained, and based on the second image scale and the second distance, the missing distance of the test image is obtained; Based on the incomplete distance and combined with the wide-angle lens parameter adjustment reference table, the first adjustment strategy for the shooting angle and focal length corresponding to the wide-angle lens is determined, and the parameters of the wide-angle lens are readjusted according to the first adjustment strategy.
4. The remote imaging transmission system for a liquid lens according to claim 3, characterized in that, The first control unit includes: The second adjustment subunit is used to obtain the first center error between the region center and the test image center based on the marked planar image when the image center and the region center do not coincide, and at the same time obtain the second center error between the region center and the test image center. Based on the first center error and the second center error, the first image scale corresponding to the current wide-angle lens shooting scene is obtained, the second edge scene of the test image is obtained, and the actual error distance between the second edge scene and the edge scene of the target area is determined by marking on the planar image. Based on the second image scale, the expansion width of the corresponding viewpoint of the image is determined. Based on the expansion width and combined with the wide-angle lens parameter adjustment table, the first adjustment strategy for the shooting viewpoint and focal length corresponding to the wide-angle lens is determined. After aligning the shooting center of the wide-angle lens with the center of the area, the parameters of the wide-angle lens are readjusted according to the second adjustment strategy.
5. The remote imaging transmission system for a liquid lens according to claim 1, characterized in that, The remote control module includes: The image sending unit is used to acquire a preset communication protocol, determine the target terminal device, and send the real-time monitoring image to the display end of the target terminal device for display. The operation capture unit is used to acquire operation information of real-time operations performed by the user on the display end, and determine the operation attributes corresponding to the real-time operation based on the operation information. When the operation is a target capture operation, a target capture command is generated and sent to the target focusing module.
6. The remote imaging transmission system for a liquid lens according to claim 5, characterized in that, Operation capture unit, including: The capture subunit is used to capture the user's real-time operations on the video operation page on the display terminal, obtain the operation information corresponding to each real-time operation, and determine the operation attributes based on the operation information. The operation attributes include target capture operations and regular video operations. The target determination unit is used to determine the click point corresponding to the target capture operation on the real-time monitoring screen when the user's real-time operation is a target capture operation, and to determine the target type of the clicked target at the click point. When the clicked target is an object, the object is taken as the capture target. Otherwise, use the clicked point as the focus point; The instruction acquisition unit is used to acquire the image coordinates of the clicked target and generate a target capture instruction based on the image coordinates and the target type. The command sending unit is used to send target acquisition commands to the target focusing module.
7. The remote imaging transmission system for a liquid lens according to claim 1, characterized in that, The target focusing module also includes: The information receiving unit is used to receive target acquisition instructions, parse the target acquisition instructions, and determine the user's acquisition target or focus point; The image acquisition unit is used to acquire local dynamic images centered on the target or focal point through a liquid lens; The image display unit is used to acquire a preset communication protocol corresponding to the real-time monitoring image of a local dynamic image, and based on the preset communication protocol, send the local dynamic image to a preset display area of the display end of the target terminal device for display.
8. The remote imaging transmission system for a liquid lens according to claim 1, characterized in that, The local magnification unit also includes: The operation monitoring subunit is used to monitor the user's operation click points, compare the current click point with the click position of the previous click point to obtain the click position difference, and when the click position difference is less than or equal to a preset value, it is determined that the current click point is the user's second zoom-in operation; Otherwise, the current user operation will be sent to the operation capture unit for processing.
9. A method for remote imaging transmission using a liquid lens, characterized in that, include: Step 1: Based on the wide-angle subsystem, acquire the real-time monitoring image corresponding to the target area; Step 2: Based on the preset communication protocol, send the real-time monitoring screen to the remote target display terminal for display, and obtain the target capture operation information of the display terminal on the real-time monitoring screen in real time; Step 3: Based on the target capture operation information, control the telephoto subsystem to focus on and capture the area to be focused, obtain local dynamic images, and send them to the display end; Step 3 includes: Using the target or focal point as the focus center, the shooting center of the liquid lens is aligned with the focus center. The voltage of the liquid lens is adjusted according to the user's magnification ratio to achieve focusing. Specifically, this includes: When the focus center is the target to be captured, the liquid lens is adjusted for focusing based on the user’s real-time magnification ratio. When a clear image appears in the local dynamic image obtained by the liquid lens, the outline of the image is located. Based on the positioning result, the magnification angle of the liquid lens is adjusted to ensure that the image is entirely in the center of the local dynamic image until the local dynamic image can no longer meet the overall shooting image presentation requirements of the image. When the focus center is the focal point, always zoom in on the focal area with the focal point as the center; When the user zooms in on a portion of the moving image, or when the portion of the moving image cannot satisfy the overall presentation of the captured image.
Citation Information
Patent Citations
Video monitoring system for multi-target tracking close-up shooting
CN102148965A
Wide-view long-focus monitoring system based on liquid lens zooming
CN116668636A