Focusing management system and method for camera array and electronic equipment
By providing a focus management system for camera array, the problems of high focus frequency and large manual workload of foundation wide-angle camera array are solved, and parallel focus management and visual control of a large number of telescopes are realized.
Patent Information
- Application Number
- CN202411723841.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-28
- Publication Date
- 2025-02-28
AI Technical Summary
The focus frequency of the foundation wide-angle camera array is high and the focus work is large. It takes a lot of manpower to focus on the telescope one by one by one.
A focus management system for a camera array is provided, including a focus module, a sending module, a receiving module and a display module. The user can perform focus operations on at least one camera in the camera array in parallel. The system sends a focus instruction to the observation control system to receive and display the execution results of the focus task.
Parallelized focus task management of a large number of telescopes is realized, manual workload is reduced, visual control of the focus process and visual display of results are improved.
Smart Images
Figure CN119545175A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of astronomical technology, and more specifically, to a focus management system, method and electronic device for a camera array. Background Art
[0002] With the development of astronomical technology, time-domain astronomy has entered the era of ultra-large field surveys. For example, a ground-based wide-angle camera array is an optical telescope array that contains 50 telescopes and can monitor about 5,000 square degrees of the starry sky at the same time. The movable distance of the effective focal plane of the camera lens of the ground-based wide-angle camera array is in the micron range, which is easily affected by temperature and causes changes in image quality. Therefore, when observing, the ground-based wide-angle camera array needs to perceive image quality changes in a timely manner and focus the camera lens.
[0003] In the process of realizing the concept of the present disclosure, the inventors found that there are at least the following problems in the related art: the focusing frequency of the telescope array is high, the focusing workload is large, and manually focusing the telescopes one by one requires a lot of manpower. Summary of the invention
[0004] In view of this, the present disclosure provides a focus management system, method, electronic device, storage medium and program product for a camera array.
[0005] One aspect of the present disclosure provides a focus management system for a camera array, wherein the focus management system is configured with a focus management interface, and the focus management interface is used for a user to perform a focus operation on at least one camera in the camera array in parallel, and the focus management system includes: a focus module, wherein the focus module is configured to generate a focus instruction in response to the user's focus operation, and the focus instruction is used to represent a focus task for a target camera in the camera array; a sending module, wherein the sending module is configured to send the focus instruction to an observation control system to trigger the observation control system to control the target camera to perform the focus task; a receiving module, wherein the receiving module is configured to receive execution information from the observation control system when the observation control system receives execution information about the target camera, and the execution information is for the focus task; and a display module, wherein the display module is configured to display the execution result of the focus task on the focus management interface according to the execution information.
[0006] Another aspect of the present disclosure provides a focus management method for a camera array, the focus management method is applied to the focus management system as described above, the focus management method comprising: generating a focus instruction in response to a user's focus operation, the focus instruction being used to characterize a focus task for a target camera in the camera array; sending the focus instruction to an observation control system to trigger the observation control system to control the target camera to perform the focus task; receiving execution information from the observation control system when the observation control system receives execution information about the target camera, the execution information being for the focus task; and displaying the execution result for the focus task on a focus management interface according to the execution information.
[0007] Another aspect of the present disclosure provides an electronic device, including: one or more processors; and a memory for storing one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors implement the method as described above.
[0008] Another aspect of the present disclosure provides a computer-readable storage medium storing computer-executable instructions, which are used to implement the above method when executed.
[0009] Another aspect of the present disclosure provides a computer program product, which includes computer executable instructions, and when the instructions are executed, are used to implement the method as described above.
[0010] The embodiment of the present disclosure provides an integrated focus management system for a camera array. Based on the focus management system, a user can perform a focus operation on at least one camera in the camera array in parallel, can view the execution results of the focus task in parallel, and can also view the focus history of at least one camera in the camera array in parallel. The focus management system provided by the embodiment of the present disclosure can support parallel focus task management, visual control of the focus process, visual display of the focus results and history, etc. for a large number of telescopes, and can effectively reduce the manual workload under high focusing requirements, thereby at least partially overcoming the technical problem in the related art that manually focusing the telescopes one by one requires a lot of manpower. BRIEF DESCRIPTION OF THE DRAWINGS
[0011] The above and other objects, features and advantages of the present disclosure will become more apparent through the following description of the embodiments of the present disclosure with reference to the accompanying drawings, in which:
[0012] Figure 1 A diagram schematically illustrates an application scenario of a focus management system, method, electronic device, storage medium, and program product for a camera array according to an embodiment of the present disclosure;
[0013] Figure 2 A block diagram of a focus management system according to an embodiment of the present disclosure is schematically shown;
[0014] Figure 3A The focus management interface according to an embodiment of the present disclosure is schematically shown;
[0015] Figure 3B The camera management interface according to an embodiment of the present disclosure is schematically shown;
[0016] Figure 3C The camera focus history interface according to an embodiment of the present disclosure is schematically shown;
[0017] Figure 4 The camera focus management process according to an embodiment of the present disclosure is schematically shown;
[0018] Figure 5 A flowchart of a focus management method according to an embodiment of the present disclosure is schematically shown;
[0019] Figure 6 A block diagram of an electronic device suitable for implementing the above-mentioned system and method according to an embodiment of the present disclosure is schematically shown. DETAILED DESCRIPTION
[0020] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. However, it should be understood that these descriptions are exemplary only and are not intended to limit the scope of the present disclosure. In the following detailed description, for ease of explanation, many specific details are set forth to provide a comprehensive understanding of the embodiments of the present disclosure. However, it is apparent that one or more embodiments may also be implemented without these specific details. In addition, in the following description, descriptions of known structures and technologies are omitted to avoid unnecessary confusion of the concepts of the present disclosure.
[0021] The terms used herein are only for describing specific embodiments and are not intended to limit the present disclosure. The terms "comprise", "include", etc. used herein indicate the existence of the features, steps, operations and / or components, but do not exclude the existence or addition of one or more other features, steps, operations or components.
[0022] All terms (including technical and scientific terms) used herein have the meanings commonly understood by those skilled in the art unless otherwise defined. It should be noted that the terms used herein should be interpreted as having a meaning consistent with the context of this specification and should not be interpreted in an idealized or overly rigid manner.
[0023] When using expressions such as "at least one of A, B, and C, etc.", they should generally be interpreted according to the meaning of the expression commonly understood by those skilled in the art (for example, "a system having at least one of A, B, and C" should include but is not limited to a system having A alone, B alone, C alone, A and B, A and C, B and C, and / or A, B, C, etc.).
[0024] In the embodiments of the present disclosure, the collection, updating, analysis, processing, use, transmission, provision, disclosure, storage, etc. of the data involved (for example, including but not limited to user personal information) are in compliance with the provisions of relevant laws and regulations, are used for legitimate purposes, and do not violate public order and good morals. In particular, necessary measures are taken for user personal information to prevent illegal access to user personal information data and maintain the security of user personal information and network security.
[0025] In the embodiments of the present disclosure, the user's authorization or consent is obtained before obtaining or collecting the user's personal information.
[0026] With the development of astronomical technology, time-domain astronomy has entered the era of ultra-large field surveys. For example, a ground-based wide-angle camera array is an optical telescope array that contains 50 telescopes and can monitor about 5,000 square degrees of the starry sky at the same time. The movable distance of the effective focal plane of the camera lens of the ground-based wide-angle camera array is in the micron range, which is easily affected by temperature and causes changes in image quality. Therefore, when observing, the ground-based wide-angle camera array needs to perceive image quality changes in a timely manner and focus the camera lens.
[0027] In the process of realizing the concept of the present disclosure, the inventors found that there are at least the following problems in the related art: the focusing frequency of the telescope array is high, the focusing workload is large, and manually focusing the telescopes one by one requires a lot of manpower.
[0028] In order to at least partially solve the technical problems existing in the related art, the present disclosure provides a focus management system, method, electronic device, storage medium and program product for a camera array. The focus management system is configured with a focus management interface, which is used for a user to perform a focus operation on at least one camera in the camera array in parallel. The focus management system includes: a focus module, which is configured to generate a focus instruction in response to the user's focus operation, and the focus instruction is used to characterize a focus task for a target camera in the camera array; a sending module, which is configured to send the focus instruction to an observation control system to trigger the observation control system to control the target camera to perform the focus task; a receiving module, which is configured to receive execution information from the observation control system when the observation control system receives execution information about the target camera, and the execution information is for the focus task; and a display module, which is configured to display the execution result of the focus task on the focus management interface according to the execution information.
[0029] According to one embodiment of the present disclosure, the ground-based wide-angle camera array (GWAC) is a ground-based observation device of the space-based multiband astronomical variable objects monitor (SVOM), and its main scientific goal is to detect the electromagnetic radiation counterparts of gamma-ray bursts, gravitational wave events, etc. Exemplarily, the ground-based wide-angle camera array may include multiple optical telescopes, each of which is equipped with a high-performance CCD (Charge-coupled Device) or CMOS (Complementary Metal Oxide Semiconductor) camera. Exemplarily, the camera array in the embodiment of the present disclosure may include the aforementioned ground-based wide-angle camera array, and the target camera in the camera array may be the aforementioned CCD camera or CMOS camera.
[0030] Figure 1 The application scenario diagram of the focus management system, method, electronic device, storage medium and program product for a camera array according to an embodiment of the present disclosure is schematically shown.
[0031] like Figure 1 As shown, the application scenario 100 according to this embodiment may include a first terminal device 101, a second terminal device 102, a third terminal device 103, a network 104, and a server 105. The network 104 is used to provide a medium for a communication link between the first terminal device 101, the second terminal device 102, the third terminal device 103, and the server 105. The network 104 may include various connection types, such as wired, wireless communication links, or optical fiber cables, etc.
[0032] The user can use the first terminal device 101, the second terminal device 102, and the third terminal device 103 to interact with the server 105 through the network 104 to receive or send messages, etc. Various communication client applications can be installed on the first terminal device 101, the second terminal device 102, and the third terminal device 103, such as shopping applications, web browser applications, search applications, instant messaging tools, email clients, social platform software, etc. (only for example).
[0033] The first terminal device 101, the second terminal device 102, and the third terminal device 103 may be various electronic devices having display screens and supporting web browsing, including but not limited to smart phones, tablet computers, laptop computers, desktop computers, and the like.
[0034] The server 105 may be a server that provides various services, such as a background management server (only as an example) that provides support for websites browsed by users using the first terminal device 101, the second terminal device 102, and the third terminal device 103. The background management server may analyze and process the received data such as user requests, and feed back the processing results (such as web pages, information, or data obtained or generated according to user requests) to the terminal device.
[0035] It should be noted that the focus management method for the camera array provided in the embodiment of the present disclosure can generally be executed by the server 105. Accordingly, the focus management system for the camera array provided in the embodiment of the present disclosure can generally be set in the server 105. The focus management method for the camera array provided in the embodiment of the present disclosure can also be executed by a server or server cluster that is different from the server 105 and can communicate with the first terminal device 101, the second terminal device 102, the third terminal device 103 and / or the server 105. Correspondingly, the focus management system for the camera array provided in the embodiment of the present disclosure can also be set in a server or server cluster that is different from the server 105 and can communicate with the first terminal device 101, the second terminal device 102, the third terminal device 103 and / or the server 105. Alternatively, the focus management method for the camera array provided in the embodiment of the present disclosure can also be executed by the first terminal device 101, the second terminal device 102 or the third terminal device 103, or by other terminal devices different from the first terminal device 101, the second terminal device 102 or the third terminal device 103. Correspondingly, the focus management system for the camera array provided in the embodiments of the present disclosure may also be arranged in the first terminal device 101, the second terminal device 102 or the third terminal device 103, or in other terminal devices different from the first terminal device 101, the second terminal device 102 or the third terminal device 103.
[0036] It should be understood that Figure 1 The number of terminal devices, networks and servers in the embodiment is only for illustration. Any number of terminal devices, networks and servers may be provided according to implementation requirements.
[0037] Figure 2 A block diagram of a focus management system according to an embodiment of the present disclosure is schematically shown.
[0038] like Figure 2 As shown, the focus management system 200 includes a focus module 210 , a sending module 220 , a receiving module 230 and a display module 240 .
[0039] The focus module 210 is configured to generate a focus instruction in response to a focus operation of a user, where the focus instruction is used to represent a focus task for a target camera in the camera array.
[0040] The sending module 220 is configured to send a focus instruction to the observation control system to trigger the observation control system to control the target camera to perform a focus task.
[0041] The receiving module 230 is configured to receive execution information from the observation control system when the observation control system receives execution information about the target camera, where the execution information is for the focus adjustment task.
[0042] The display module 240 is configured to display the execution result of the focus task on the focus management interface according to the execution information.
[0043] According to an embodiment of the present disclosure, a focus management system may be configured with a focus management interface, where the focus management interface is used for allowing a user to perform a focus operation on at least one camera in a camera array in parallel.
[0044] According to an embodiment of the present disclosure, a focus adjustment operation for a camera may include a focus adjustment action and a focus adjustment task.
[0045] Exemplarily, the focusing action can be understood as the smallest execution unit of camera focusing. A focusing action mainly includes three sub-actions: the camera focusing hardware mechanism moves a specified step length, the camera exposure sensor takes an image, and the image quality is evaluated. Among them, the camera forward or reverse walking specified step length in the camera focusing sub-action, and / or the exposure time in the camera exposure sensor shooting sub-action, such as 3 seconds or 10 seconds, can be set by setting the focusing parameters. In the image quality evaluation sub-action, algorithms such as the energy concentration of star images and the half-height full width can be used to calculate the image quality.
[0046] Exemplarily, a focus task consists of at least one focus action, and a focus task can be understood as a set of focus actions for a specific scientific or maintenance task. For example, a focus task may include: manually adjusting the image quality to the optimal level after the camera is out of focus; establishing a focus algorithm parameter calibration for the camera, collecting the relationship between the camera travel and the image quality parameters, etc. Affected by the ambient temperature, each camera may trigger one or more focus tasks within a preset period of time (e.g., an observation night).
[0047] Figure 3A A focus management interface according to an embodiment of the present disclosure is schematically shown.
[0048] like Figure 3A As shown, in the focus management interface, for example, the user can edit the focus parameters such as "focus direction", "focus stroke", "exposure time", "exposure times" in the parameter bar above the interface to set the focus operation on the target camera. For example, the user can switch the target camera by switching the camera ID in the parameter bar above the interface to perform the focus operation on at least one camera in the camera array in parallel. For example, the user can trigger the focus operation on the target camera by clicking / touching the "focus" function button in the upper right corner of the interface.
[0049] According to an embodiment of the present disclosure, in response to a user's focusing operation, the focusing module 210 may generate a focusing instruction, which is used to characterize a focusing task for a target camera in the camera array. The sending module 220 may send the focusing instruction to the observation control system, thereby triggering the observation control system to control the target camera to perform the focusing task. In the case where the observation control system receives execution information about the target camera, the receiving module 230 may receive execution information from the observation control system, which is for the focusing task. The display module 240 may display the execution result for the focusing task on the focusing management interface according to the execution information.
[0050] As an example, the execution result of the focus task can be displayed on the focus management interface in a visual manner such as images, charts, and dashboards. Visual display of the execution result helps users intuitively perceive and understand the focus process, as well as fault analysis and diagnosis.
[0051] According to an embodiment of the present disclosure, based on the focus management interface, the user can conveniently perform a focus operation on a target camera by setting focus parameters, and can perform a focus operation on at least one camera in a camera array in parallel by switching the target camera. In addition, based on the focus management interface, the user can also intuitively view the execution results of the focus task.
[0052] According to an embodiment of the present disclosure, the focus management system may also be configured with a camera management interface, and the camera management interface is used for the user to trigger the focus management interface of at least one camera in the camera array in parallel.
[0053] Figure 3B The camera management interface according to an embodiment of the present disclosure is schematically shown.
[0054] like Figure 3B As shown, in the camera management interface, for example, a user can trigger the focus management interface for the target camera by clicking / touching the "camera name" function button in the row where the target camera is located. For example, a user can open the focus management interfaces of multiple target cameras in parallel to perform a focus operation on at least one camera in the camera array in parallel. For another example, multiple users can open the focus management interfaces of multiple target cameras in parallel to perform a focus operation on at least one camera in the camera array in parallel.
[0055] For example, Figure 3B As shown, the camera management interface can also be used to: initiate a manual focus task, initiate a focus run task, continue / view the current focus task, view historical focus tasks, etc.
[0056] According to an embodiment of the present disclosure, the focus management system may also be configured with a camera focus history interface, where the camera focus history interface is used for allowing a user to view the focus history records of at least one camera in the camera array in parallel.
[0057] Figure 3C The camera focus history interface according to an embodiment of the present disclosure is schematically shown.
[0058] According to one embodiment of the present disclosure, focus tasks can be organized according to cameras, and the focus task history records of the target camera can be viewed in the camera focus history interface. For example, in the camera management interface, the user can click / touch the "View History" function button of the target camera row to trigger the camera focus history interface for the target camera. For example, the user can open the camera focus history interfaces of multiple target cameras in parallel to view the focus history records of at least one camera in the camera array in parallel. For another example, multiple users can open the camera focus history interfaces of multiple target cameras in parallel to view the focus history records of at least one camera in the camera array in parallel.
[0059] The embodiment of the present disclosure provides an integrated focus management system for a camera array. Based on the focus management system, a user can perform a focus operation on at least one camera in the camera array in parallel, can view the execution results of the focus task in parallel, and can also view the focus history of at least one camera in the camera array in parallel. The focus management system provided by the embodiment of the present disclosure can support parallel focus task management, visual control of the focus process, visual display of the focus results and history, etc. for a large number of telescopes, and can effectively reduce the manual workload under high focusing requirements, thereby at least partially overcoming the technical problem in the related art that manually focusing the telescopes one by one requires a lot of manpower.
[0060] According to the embodiments of the present disclosure, the inventors have also found that the relevant telescope focusing method lacks monitoring of the focusing process and results, making it difficult to timely know whether the camera is focused in a timely manner, whether the image quality meets the standards after the camera is focused, the focusing frequency of the camera, etc.
[0061] According to an embodiment of the present disclosure, the execution result includes at least one of the following: the current execution state of the focusing task, focusing process information, an observed image, the imaging quality of the target camera, and a curve representing the change in imaging quality.
[0062] According to one embodiment of the present disclosure, Figure 3A As shown, the current execution status of the focusing task, the focusing process information, the observed image, the imaging quality of the target camera, and the curve representing the change of the imaging quality can be displayed on the focusing management interface.
[0063] Exemplarily, the focusing process information may include the serial number, start time, travel amount and image quality parameters of all focusing actions of the current focusing task. The focusing process information may also include information of each node in the execution process of the focusing task. The current execution status of the focusing task may include queued, executing, interrupted, completed, etc. The curve representing the change in imaging quality may include a curve of the change in camera travel and imaging quality. Optionally, only the observation image of the latest focusing action may be displayed, or the observation images of all the completed focusing actions may be displayed in a carousel.
[0064] According to the embodiments of the present disclosure, based on the focus management interface, the user can more intuitively and quickly learn the detailed focus process and execution results, thereby being able to monitor the focus process and results, which is helpful for fault analysis and diagnosis.
[0065] According to an embodiment of the present disclosure, the camera focus management system may further include a storage module, which is configured with a database. Based on the focus task identifier, the focus operation, execution information, and execution result for the focus task may be associated and stored in the database.
[0066] As an example, Figure 3A As shown, in response to the user clicking / touching the "focus" function button, a focus task for the target camera can be automatically created, and the focus management system can decompose the focus task into at least one focus action according to the set focus parameters. The focus management system can store the focus task and at least one focus action under the focus task in a database in association with the focus task ID. Furthermore, the execution information and execution results for the focus task can be stored in the database in association with the focus task ID.
[0067] According to one embodiment of the present disclosure, the relevant table structure of the database may be as follows:
[0068] 1. Focus task (focus_task): task name, task type, camera name, start time, end time, number of focus actions, number of captured images, number of image quality parameters, date_str, task execution status.
[0069] a. Task execution status: The default value is 0, 1 indicates that the task has entered the focus queue of the business layer, 2 indicates that the task is in execution, 3 indicates that the task is interrupted, and 4 indicates that the task is completed.
[0070] 2. Focus action (focus_task_step):
[0071] a. Task related: task name, camera name, image ID, sequence number.
[0072] b. Focusing parameters: travel direction, exposure time, number of exposures, travel amount.
[0073] c. Record of processes and results: image quality parameters, observation time, start time (button click time), trigger time (business layer triggers focus task), focus execution time, camera shooting start time, camera shooting end time, processing time, upload time.
[0074] d. Status indicator:
[0075] i. Query status: The default is 0, which means not queried; 1 means queried.
[0076] 3. Camera focus status table (focus_task_camera): camera name, current focus task type, current task ID, whether cleared.
[0077] a. Each camera records one line.
[0078] b. Whether it is cleared: 0 means it is cleared, 1 means it is not cleared.
[0079] 4. Image table (fits_file_image): The image corresponding to each focusing action, including image ID, image name, image storage path, and image observation time.
[0080] According to an embodiment of the present disclosure, the execution information includes a current execution status, and the receiving module includes a first receiving submodule and a second receiving submodule, wherein the first receiving submodule is configured to receive the current execution information from the observation control system, and when the current execution status indicates that the focusing task is successfully executed: the second receiving submodule is configured to: receive focusing process information and an observed image from the observation control system, the focusing process information including stroke information; determine the imaging quality of the target camera based on the observed image; and determine a curve representing the change in imaging quality based on the stroke information and the imaging quality of the target camera.
[0081] According to an embodiment of the present disclosure, the execution information for the focus task may include the current execution state of the focus task. The receiving module may include a first receiving submodule and a second receiving submodule, and the first receiving submodule is configured to receive the current execution information from the observation control system.
[0082] According to an embodiment of the present disclosure, when the current execution state indicates that the focus task is successfully executed, the second receiving submodule is configured to: receive the focus process information and the observation image from the observation control system, the focus process information including the travel information; determine the imaging quality of the target camera according to the observation image; and determine the curve representing the change of the imaging quality according to the travel information and the imaging quality of the target camera. On this basis, the display module can display the current execution state of the focus task, the focus process information, the observation image, the imaging quality of the target camera, and the curve representing the change of the imaging quality on the focus management interface.
[0083] As an example, the imaging quality of the observed image may be calculated using algorithms such as energy concentration and full width at half maximum of star images.
[0084] According to another embodiment of the present disclosure, when the current execution status indicates that the focus task is not successfully executed, the display module may display the current execution status on the focus management interface so as to perform troubleshooting and processing in a timely manner.
[0085] According to the embodiments of the present disclosure, the inventors have also discovered, based on a large number of focus action history records, that the camera focus position may change with changes in temperature, hardware performance, and the like.
[0086] According to an embodiment of the present disclosure, the focus management system also includes: an evaluation module, which is used to evaluate the focus task according to the execution information and the execution result to obtain the evaluation result for the focus task; the display module is also used to: display the evaluation result in the focus management system.
[0087] According to an embodiment of the present disclosure, the evaluation module can evaluate the focus task according to the current execution state of the focus task, the focus process information, the observed image, the imaging quality of the target camera, and the curve representing the change of the imaging quality, and obtain the evaluation result for the focus task. Exemplarily, the evaluation result may include: whether the camera is focused in time, whether the image quality after the camera is focused is up to standard, and the statistical and analysis results of indicators such as the focusing frequency of the camera.
[0088] Exemplarily, the evaluation result may be displayed on a focus management interface, or the evaluation result may be displayed on an evaluation result interface configured in the focus management system.
[0089] According to the embodiments of the present disclosure, by evaluating the focusing task, the focusing management system can be guided to perform more efficient focusing, and abnormal points in the focusing process can also be discovered in time.
[0090] According to an embodiment of the present disclosure, the focus adjustment task may include manual focus adjustment and manual focus adjustment, specifically:
[0091] 1. Manual focus: Manually control the parameters of each focusing action of the focusing task until a specific focusing goal is achieved, such as optimizing the image quality.
[0092] 2. Manual focus: Manually set the total forward and reverse travel of the camera and the number of reverse movements N. For example, if the camera moves forward once and moves backward N times, the total travel of the N reverse movements is equal to the travel of one forward movement. Manual focus can be used to determine the camera travel boundary (such as the travel range information mentioned above), collect the relationship between the camera travel and image quality parameters (such as the curve representing the change in image quality mentioned above), and provide data support for the focus task.
[0093] According to an embodiment of the present disclosure, by performing a manual focus task on a target camera, the range information of the target camera and a curve representing the change in the imaging quality of the target camera can be determined to determine the focus information. The focus parameters for the manual focus task can be determined based on the relationship between the focus information and the preset parameters, and the focus parameters can adjust the target camera to a state with the best imaging quality.
[0094] As an example, Figure 3A As shown, the target travel amount corresponding to the best imaging quality of the target camera can be determined according to the curve representing the change of the imaging quality of the target camera. The focus information can be determined according to the travel range information of the target camera, the target travel amount and the current position of the target camera. The focus parameters for the manual focus task can be determined according to the relationship between the focus information and the preset parameters to adjust the target camera to the state with the best imaging quality.
[0095] For example, the focus shifting task may be performed periodically to update a curve representing changes in the imaging quality of the target camera to ensure the reliability and accuracy of the data.
[0096] According to the embodiments of the present disclosure, by performing a focus task based on the focus information, the camera can be adjusted to a state with the best imaging quality to ensure the imaging quality and observation effect of the camera. By performing a focus task, the camera's range information and a curve representing the change in the camera's imaging quality can be determined to provide reliable and accurate data support for the focus task.
[0097] According to an embodiment of the present disclosure, the focus management system is used to respond to the user's focusing operation and send a focusing instruction to the observation control system, where the focusing instruction is used to characterize a focusing task for a target camera in the camera array; the observation control system is used to respond to the focusing instruction and schedule the observation execution system according to the focusing instruction; and the observation execution system is used to execute the focusing task for the target camera.
[0098] According to the embodiments of the present disclosure, the observation execution system may be understood as the hardware execution layer of the camera array, and the observation control system may be understood as the control interface of the camera array.
[0099] According to the embodiments of the present disclosure, the observation control system and the observation execution system can be triggered based on the focus management system, so that a complete business process from initiating a focus operation to executing the focus operation and then displaying the execution result can be realized. The focus management system provided by the embodiments of the present disclosure can be combined with the observation control system and the observation execution system to support system-level requirements such as focus management, execution, tracking, visual monitoring, status and result analysis for a large number of telescopes.
[0100] According to an embodiment of the present disclosure, the focusing instruction includes a camera identifier, a focusing task identifier and focusing information, and the observation control system is configured to: in response to receiving a focusing instruction from the focusing management system, send the focusing instruction to the observation execution system, the observation execution system is used to execute the focusing task for the target camera; in response to receiving a current execution status from the observation execution system, when the current execution status indicates that the focusing task is successfully executed: obtain an initial image and focusing process information from the observation execution system; mark the initial image according to the focusing task identifier and the travel information in the focusing process information to obtain an observed image; and send the current execution status, the focusing process information and the observed image to the focusing management system.
[0101] According to an embodiment of the present disclosure, the focusing information may include the focusing parameters set by the user through the focusing management interface in the focusing management system, such as "focusing direction", "focusing stroke", "exposure time", "number of exposures", etc. The initial image can be understood as the image obtained by controlling the camera to take pictures, and the focusing process information may include the serial number, start time, stroke amount (such as the stroke information described above) and image quality parameters of all focusing actions of the current focusing task. The focusing process information may also include the information of each node in the execution process of the focusing task. The observed image can be understood as the initial image carrying the focusing task identification and stroke information.
[0102] According to an embodiment of the present disclosure, the focus task identifier and the travel information can be written into the file header information of the initial image to obtain the observed image. Thus, the observed image can be stored in the database according to the focus task identifier to facilitate the display and analysis of subsequent execution results.
[0103] According to an embodiment of the present disclosure, the observation execution system is configured to, in response to receiving a focusing instruction from the observation control system: determine the target camera according to the camera identifier; focus the target camera according to the focusing task identifier and focusing information to obtain the current execution state, focusing process information and the initial image; and send the current execution state, focusing process information and the initial image to the observation control system.
[0104] According to the embodiments of the present disclosure, the target camera can be focused according to the focusing task identifier and focusing information, the camera focusing hardware mechanism can be controlled to move a specified step length, the camera exposure sensor can be controlled to capture an image, and the current execution state, focusing process information and the initial image can be obtained.
[0105] Figure 4 The camera focus management process according to an embodiment of the present disclosure is schematically illustrated.
[0106] like Figure 4 As shown, in response to the user's focusing operation in the focusing management interface 401, the focusing management system 410S can create a focusing task 402, and send a focusing instruction 403 representing the focusing task 402 to the observation control system 420S. The focusing management system 410S can schedule the focusing task 402 and the focusing action according to the focusing instruction 403, and trigger the observation control system 420S to execute.
[0107] According to an embodiment of the present disclosure, the observation control system 420S may send the focus instruction 403 to the focus execution system 430S, triggering the observation execution system 430S to execute. The observation execution system 430S may execute the focus task 402 for the target camera according to the focus instruction 403, obtain the execution information and send the execution information 404 to the observation control system 420S. The execution information 404 includes the current execution state (not shown in the figure).
[0108] According to an embodiment of the present disclosure, when the current execution state indicates that the focusing task is successfully executed, the observation control system 420S can obtain the initial image 405 and the focusing process information 406 from the observation execution system 430S. The observation control system 420S can mark the initial image 405 according to the focusing task identifier in the focusing instruction 403 and the travel information in the focusing process information 406 to obtain the observation image 407. The observation control system 420S can send the current execution state, the focusing process information 406 and the observation image 407 to the focusing management system 410S.
[0109] According to an embodiment of the present disclosure, when the current execution state indicates that the focusing task is successfully executed, the focusing management system 410S may receive the focusing process information 406 and the observed image 407 from the observation control system 420S, and the focusing process information 406 includes the travel information (not shown in the figure). The focusing management system 410S may determine the imaging quality 408 of the target camera based on the observed image 407. The focusing management system 410S may determine the curve representing the change of the imaging quality based on the travel information and the imaging quality 408 of the target camera (not shown in the figure). On this basis, the focusing management system 410S may display the execution result 409 on the focusing management interface 401. Among them, the execution result 409 may include at least one of the following: the current execution state of the focusing task, the focusing process information 406, the observed image 407, the imaging quality 408 of the target camera, and the curve representing the change of the imaging quality.
[0110] According to the embodiments of the present invention, any one or more of the modules, submodules, units, and subunits, or at least part of the functions of any one of them can be implemented in one module. According to the embodiments of the present invention, any one or more of the modules, submodules, units, and subunits can be split into multiple modules for implementation. According to the embodiments of the present invention, any one or more of the modules, submodules, units, and subunits can be at least partially implemented as hardware circuits, such as field programmable gate arrays (FPGAs), programmable logic arrays (PLAs), systems on chips, systems on substrates, systems on packages, application specific integrated circuits (ASICs), or can be implemented by hardware or firmware in any other reasonable way of integrating or packaging circuits, or can be implemented in any one of the three implementation methods of software, hardware, and firmware, or in any appropriate combination of any of them. Alternatively, according to the embodiments of the present invention, one or more of the modules, submodules, units, and subunits can be at least partially implemented as computer program modules, and when the computer program modules are run, the corresponding functions can be performed.
[0111] For example, any multiple of the focusing module 210, the sending module 220, the receiving module 230 and the display module 240 can be combined in one module / unit / sub-unit for implementation, or any one of the modules / units / sub-units can be split into multiple modules / units / sub-units. Alternatively, at least part of the functions of one or more of these modules / units / sub-units can be combined with at least part of the functions of other modules / units / sub-units and implemented in one module / unit / sub-unit. According to an embodiment of the present disclosure, at least one of the focusing module 210, the sending module 220, the receiving module 230 and the display module 240 can be at least partially implemented as a hardware circuit, such as a field programmable gate array (FPGA), a programmable logic array (PLA), a system on a chip, a system on a substrate, a system on a package, an application specific integrated circuit (ASIC), or can be implemented by hardware or firmware such as any other reasonable way of integrating or packaging the circuit, or implemented in any one of the three implementation methods of software, hardware and firmware or in a suitable combination of any of them. Alternatively, at least one of the focusing module 210 , the sending module 220 , the receiving module 230 and the display module 240 may be at least partially implemented as a computer program module, and when the computer program module is executed, a corresponding function may be performed.
[0112] Figure 5 The flowchart of the focus management method according to the embodiment of the present disclosure is schematically shown.
[0113] According to an embodiment of the present disclosure, the focus management method for a camera array is applied to the focus management system as described above, such as Figure 5As shown, the focus management method 500 includes operations S510 to S540.
[0114] In operation S510 , in response to a focusing operation of a user, a focusing instruction is generated, where the focusing instruction is used to represent a focusing task for a target camera in a camera array.
[0115] In operation S520, a focus instruction is sent to the observation control system to trigger the observation control system to control the target camera to perform a focus task.
[0116] In operation S530, when the observation control system receives the execution information about the target camera, the execution information is received from the observation control system, where the execution information is for the focus adjustment task.
[0117] In operation S540, the execution result of the focus adjustment task is displayed on the focus adjustment management interface according to the execution information.
[0118] According to an embodiment of the present disclosure, the focus management method further includes: evaluating the focus task corresponding to the execution result according to the execution result to obtain an evaluation result for the focus task; and displaying the evaluation result in the focus management system.
[0119] It should be noted that the focus management method part in the embodiment of the present disclosure corresponds to the focus management system part in the embodiment of the present disclosure. The description of the focus management method part specifically refers to the focus management system part, which will not be repeated here.
[0120] Figure 6 A block diagram of an electronic device suitable for implementing the above-mentioned system and method according to an embodiment of the present disclosure is schematically shown. Figure 6 The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.
[0121] like Figure 6 As shown, the electronic device 600 according to an embodiment of the present disclosure includes a processor 601, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 602 or a program loaded from a storage part 608 to a random access memory (RAM) 603. The processor 601 may include, for example, a general-purpose microprocessor (such as a CPU), an instruction set processor and / or a related chipset and / or a special-purpose microprocessor (for example, an application-specific integrated circuit (ASIC)), etc. The processor 601 may also include an onboard memory for caching purposes. The processor 601 may include a single processing unit or multiple processing units for performing different actions of the method flow according to an embodiment of the present disclosure.
[0122] In RAM 603, various programs and data required for the operation of electronic device 600 are stored. Processor 601, ROM 602 and RAM 603 are connected to each other via bus 604. Processor 601 performs various operations of the method flow according to the embodiment of the present disclosure by executing the program in ROM 602 and / or RAM 603. It should be noted that the program can also be stored in one or more memories other than ROM 602 and RAM 603. Processor 601 can also perform various operations of the method flow according to the embodiment of the present disclosure by executing the program stored in the one or more memories.
[0123] According to an embodiment of the present disclosure, the electronic device 600 may further include an input / output (I / O) interface 605, which is also connected to the bus 604. The electronic device 600 may further include one or more of the following components connected to the input / output (I / O) interface 605: an input portion 606 including a keyboard, a mouse, etc.; an output portion 607 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage portion 608 including a hard disk, etc.; and a communication portion 609 including a network interface card such as a LAN card, a modem, etc. The communication portion 609 performs communication processing via a network such as the Internet. A drive 610 is also connected to the input / output (I / O) interface 605 as needed. A removable medium 611, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 610 as needed, so that a computer program read therefrom is installed into the storage portion 608 as needed.
[0124] According to an embodiment of the present disclosure, the method flow according to an embodiment of the present disclosure can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable storage medium, and the computer program contains a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 609, and / or installed from the removable medium 611. When the computer program is executed by the processor 601, the above-mentioned functions defined in the system of the embodiment of the present disclosure are executed. According to an embodiment of the present disclosure, the system, equipment, device, module, unit, etc. described above can be implemented by a computer program module.
[0125] The present disclosure also provides a computer-readable storage medium, which may be included in the device / apparatus / system described in the above embodiments; or may exist independently without being assembled into the device / apparatus / system. The above computer-readable storage medium carries one or more programs, and when the above one or more programs are executed, the method according to the embodiment of the present disclosure is implemented.
[0126] According to an embodiment of the present disclosure, the computer-readable storage medium may be a non-volatile computer-readable storage medium. For example, it may include, but is not limited to: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, apparatus, or device.
[0127] For example, according to an embodiment of the present disclosure, the computer-readable storage medium may include the ROM 602 and / or the RAM 603 described above and / or one or more memories other than the ROM 602 and the RAM 603 .
[0128] An embodiment of the present disclosure also includes a computer program product, which includes a computer program, and the computer program contains a program code for executing the method provided by the embodiment of the present disclosure. When the computer program product runs on an electronic device, the program code is used to enable the electronic device to implement the focus management method for a camera array provided by the embodiment of the present disclosure.
[0129] When the computer program is executed by the processor 601, the above functions defined in the system / device of the embodiment of the present disclosure are executed. According to the embodiment of the present disclosure, the system, device, module, unit, etc. described above can be implemented by a computer program module.
[0130] In one embodiment, the computer program may rely on tangible storage media such as optical storage devices, magnetic storage devices, etc. In another embodiment, the computer program may also be transmitted and distributed in the form of signals on a network medium, and downloaded and installed through the communication part 609, and / or installed from a removable medium 611. The program code contained in the computer program may be transmitted using any appropriate network medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.
[0131] According to an embodiment of the present disclosure, the program code for executing the computer program provided by the embodiment of the present disclosure can be written in any combination of one or more programming languages. Specifically, these computing programs can be implemented using high-level process and / or object-oriented programming languages, and / or assembly / machine languages. Programming languages include, but are not limited to, Java, C++, python, "C" language or similar programming languages. The program code can be executed entirely on the user computing device, partially on the user device, partially on the remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device can be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computing device (for example, using an Internet service provider to connect through the Internet).
[0132] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram may represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of the code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box may also occur in an order different from that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flowchart, and the combination of boxes in the block diagram or flowchart, can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions. It can be understood by those skilled in the art that the features recorded in the various embodiments of the present disclosure can be combined and / or combined in a variety of ways, even if such a combination or combination is not explicitly recorded in the present disclosure. In particular, without departing from the spirit and teaching of the present disclosure, the features described in the various embodiments of the present disclosure may be combined and / or combined in a variety of ways. All of these combinations and / or combinations fall within the scope of the present disclosure.
[0133] The embodiments of the present disclosure are described above. However, these embodiments are only for illustrative purposes and are not intended to limit the scope of the present disclosure. Although the embodiments are described above, this does not mean that the measures in the various embodiments cannot be used in combination to advantage. Without departing from the scope of the present disclosure, those skilled in the art may make a variety of substitutions and modifications, which should all fall within the scope of the present disclosure.
Claims
1. A focus management system for a camera array, the focus management system being configured with a focus management interface, the focus management interface being used for allowing a user to perform a focus operation on at least one camera in the camera array in parallel, the focus management system comprising: A focusing module, wherein the focusing module is configured to generate a focusing instruction in response to a focusing operation of a user, wherein the focusing instruction is used to represent a focusing task for a target camera in the camera array; A sending module, wherein the sending module is configured to send the focusing instruction to an observation control system to trigger the observation control system to control the target camera to perform the focusing task; a receiving module, wherein the receiving module is configured to receive the execution information from the observation control system when the observation control system receives the execution information about the target camera, wherein the execution information is for the focusing task; as well as A display module is configured to display the execution result of the focus task on the focus management interface according to the execution information.
2. The system according to claim 1, wherein: The execution result includes at least one of the following: the current execution state of the focusing task, focusing process information, an observed image, the imaging quality of the target camera, and a curve representing a change in the imaging quality.
3. The system according to claim 2, wherein: The execution information includes the current execution state, and the receiving module includes a first receiving submodule and a second receiving submodule, wherein the first receiving submodule is configured to receive the current execution information from the observation control system, and when the current execution state indicates that the focusing task is successfully executed: The second receiving submodule is configured as follows: receiving the focusing process information and the observed image from the observation control system, wherein the focusing process information includes travel information; Determining the imaging quality of the target camera according to the observed image; A curve representing a change in the imaging quality is determined according to the travel information and the imaging quality of the target camera.
4. The system according to claim 1, wherein: The focus management system further includes: an evaluation module, configured to evaluate the focus task according to the execution information and the execution result, and obtain an evaluation result for the focus task; The display module is also used to: display the evaluation result on the focus management system.
5. The system according to any one of claims 1 to 4, wherein: The focus management system is used to send a focus instruction to the observation control system in response to a focus operation of a user, wherein the focus instruction is used to represent a focus task for a target camera in the camera array; The observation control system is used to respond to the focusing instruction and schedule the observation execution system according to the focusing instruction; The observation execution system is used to execute the focusing task for the target camera.
6. The system according to claim 5, wherein: The focusing instruction includes a camera identifier, a focusing task identifier and focusing information, and the observation control system is configured as follows: In response to receiving the focus instruction from the focus management system, sending the focus instruction to the observation execution system, the observation execution system is used to perform a focus task for the target camera; In response to receiving the current execution status from the observation execution system, when the current execution status indicates that the focusing task is successfully executed: Acquiring an initial image and the focusing process information from the observation execution system; Marking the initial image according to the focusing task identifier and the travel information in the focusing process information to obtain the observed image; as well as The current execution state, the focusing process information and the observed image are sent to the focusing management system.
7. The system according to claim 6, wherein: The observation execution system is configured to, in response to receiving the focusing instruction from the observation control system: Determine the target camera according to the camera identifier; Focusing the target camera according to the focusing task identifier and the focusing information, to obtain the current execution state, the focusing process information and the initial image; as well as The current execution state, the focusing process information and the initial image are sent to the observation control system.
8. A focus management method for a camera array, the focus management method being applied to the focus management system according to any one of claims 1 to 7, the method comprising: In response to a focusing operation of a user, generating a focusing instruction, wherein the focusing instruction is used to represent a focusing task for a target camera in the camera array; Sending the focusing instruction to an observation control system to trigger the observation control system to control the target camera to perform the focusing task; In a case where the observation control system receives execution information about the target camera, receiving the execution information from the observation control system, wherein the execution information is for the focus adjustment task; as well as According to the execution information, the execution result of the focus adjustment task is displayed on the focus adjustment management interface.
9. The focus management method according to claim 8, further comprising: According to the execution result, evaluating the focus adjustment task corresponding to the execution result to obtain an evaluation result for the focus adjustment task; The evaluation result is displayed on the focus management system.
10. An electronic device, comprising: one or more processors; a memory for storing one or more computer programs, It is characterized in that the one or more processors execute the one or more computer programs to implement the steps of the method according to any one of claims 8 to 9.