Data processing method and device for real-time standardized transient source alarm data

Abstract

The present invention provides a data processing method and device for real-time standardized transient source alarm data, which can be applied to the field of astronomical information technology. The method includes: using a large language model to extract features from the acquired transient source alarm data to obtain standardized features, wherein the standardized features include name features and coordinate features of celestial bodies in the transient source alarm data, and the name features and coordinate features have a unified data format; based on the name features and coordinate features, multiple associated transient source alarm data are determined from multiple transient source alarm data, wherein the multiple associated transient source alarm data are associated with the same celestial body; the associated transient source alarm data are sent to a telescope; the telescope is controlled to perform follow-up observations on the associated transient source alarm data to obtain observation results, and the observation results are used to assist in the study of celestial bodies.

Description

Technical Field

[0001] The present invention relates to the field of astronomical information technology, and more specifically to a data processing method, device, equipment, medium and program product for real-time standardized transient source alarm data. Background Art

[0002] Transient cosmic phenomena are unpredictable, short-lived and most violent phenomena in the universe, also known as transient sources. The time scale required for observing transient sources is generally relatively short. For example, the observation of the electromagnetic counterpart of gravitational waves hopes to obtain early light changes and spectral data within 10 minutes. Therefore, in order to conduct detailed research on transient cosmic phenomena, the speed of subsequent observations is crucial.

[0003] In the related art, the acquired transient source alarm data is often stored in a database so that users can search based on information such as names, and then manually dock the telescope to perform follow-up observation tasks based on the searched information. It can be seen that in the prior art, it is impossible to integrate the transient source alarm data acquired from multiple sources, nor can it be directly docked with the telescope, resulting in a long follow-up observation process, which makes it difficult to increase the speed of follow-up observation, and it is difficult to capture transient cosmic phenomena in a short period of time, which affects the time domain astronomical research of scientific researchers. Summary of the invention

[0004] In view of the above problems, the present invention provides a data processing method, device, equipment, medium and program product for real-time standardized transient source alarm data.

[0005] According to a first aspect of the present invention, there is provided a data processing method for real-time standardized transient source alarm data, comprising: using a large language model to perform feature extraction on the acquired transient source alarm data to obtain standardized features, wherein the standardized features include name features and coordinate features of celestial bodies in the transient source alarm data, and the name features and the coordinate features have a unified data format; based on the name features and the coordinate features, determining a plurality of associated transient source alarm data from a plurality of transient source alarm data, wherein the plurality of associated transient source alarm data are associated with the same celestial body; sending the associated transient source alarm data to a telescope; and controlling the telescope to perform follow-up observations on the associated transient source alarm data to obtain observation results, and the observation results are used to assist in the study of celestial bodies.

[0006] According to an embodiment of the present invention, a large language model is used to perform feature extraction on the acquired transient source alarm data to obtain standardized features, including: using a large language model to perform feature extraction on the transient source alarm data to obtain initial name features and initial coordinate features; performing accuracy evaluation on the initial name features and initial coordinate features based on historical features to obtain evaluation results; when the evaluation results indicate that both the initial name features and the initial coordinate features meet preset feature accuracy conditions, based on regular expressions, format conversion is performed on the initial name features and the initial coordinate features, respectively, to obtain name features and coordinate features.

[0007] According to an embodiment of the present invention, a large language model is used to extract features from the acquired transient source alarm data to obtain standardized features, and also includes: when an evaluation result indicates that at least one of the initial name features and the initial coordinate features does not meet a preset feature accuracy condition, a self-assessment mechanism is used to extract new features from the transient source alarm data to obtain updated initial name features and initial coordinate features.

[0008] According to an embodiment of the present invention, sending the associated transient source alarm data to a telescope includes: determining a target telescope among a plurality of telescopes according to a preset screening condition; determining a message transmission protocol associated with the target telescope; and transmitting the associated transient source alarm data to the target telescope based on the message transmission protocol.

[0009] According to an embodiment of the present invention, determining a target telescope in telescopes according to preset screening conditions includes: determining a target range associated with the associated transient source alarm data according to coordinate information of the associated transient source alarm data; and determining the target telescope from a plurality of telescopes within the target range according to an observation state of the telescope within the target range, wherein the observation state of the telescope represents whether the telescope is performing a subsequent observation task.

[0010] According to an embodiment of the present invention, the method further comprises: visualizing the standardized features, the associated transient source alarm data and the observation results.

[0011] According to an embodiment of the present invention, the above method also includes: obtaining public transient source alarm data; using a message queue to obtain specified transient source alarm data, the specified transient source alarm data is collected by a specified device; determining the public transient source alarm data and the specified transient source alarm data as transient source alarm data, and storing them in a database.

[0012] The second aspect of the present invention provides a data processing device for real-time standardized transient source alarm data, including: an extraction module, used to use a large language model to extract features from the acquired transient source alarm data to obtain standardized features, wherein the standardized features include name features and coordinate features of the celestial body in the transient source alarm data, and the name features and coordinate features have a unified data format; a determination module, used to determine multiple associated transient source alarm data from multiple transient source alarm data based on the name features and coordinate features, wherein the multiple associated transient source alarm data are associated with the same celestial body; a sending module, used to send the associated transient source alarm data to a telescope; and an observation module, used to control the telescope to perform follow-up observations on the associated transient source alarm data to obtain observation results, and the observation results are used to assist in the study of celestial bodies.

[0013] A third aspect of the present invention provides an electronic device, comprising: one or more processors; a memory for storing one or more computer programs, wherein the one or more processors execute the one or more computer programs to implement the steps of the above method.

[0014] The fourth aspect of the present invention further provides a computer-readable storage medium on which a computer program or instruction is stored, and the steps of the above method are implemented when the above computer program or instruction is executed by a processor.

[0015] The fifth aspect of the present invention also provides a computer program product, including a computer program or instructions, which implement the steps of the above method when executed by a processor.

[0016] According to an embodiment of the present invention, a large language model is used to extract features from the acquired transient source alarm data to obtain name features and coordinate features of celestial bodies in the transient source alarm data; multiple associated transient source alarm data are determined from multiple transient source alarm data based on the name features and coordinate features; and a telescope is controlled to perform follow-up observations on the associated transient source alarm data to obtain observation results. By using a large language model to extract features from the acquired transient source alarm data, the problem of different formats of data from multiple sources is avoided, and the standardization of a large amount of unstructured and highly professional transient source alarm data is achieved, thereby improving the system response speed. At the same time, since the telescope can directly receive and perform follow-up observations on the associated transient source alarm data, the tedious work of manually collating the transient source alarm data and then assigning the telescope is avoided, thereby improving the speed of follow-up observations. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] The above contents and other objects, features and advantages of the present invention will become more apparent through the following description of the embodiments of the present invention with reference to the accompanying drawings, in which:

[0018] Figure 1An application scenario diagram showing a data processing method, apparatus, device, medium and program product for real-time standardized transient source alarm data according to an embodiment of the present invention;

[0019] Figure 2 A flow chart showing a data processing method for real-time standardized transient source alarm data according to an embodiment of the present invention;

[0020] Figure 3 A visualization interface according to an embodiment of the present invention is shown;

[0021] Figure 4 A schematic diagram showing a data processing method for real-time standardized transient source alarm data according to an embodiment of the present invention;

[0022] Figure 5 It shows a structural block diagram of a data processing device for real-time standardized transient source alarm data according to an embodiment of the present invention;

[0023] Figure 6 A block diagram of an electronic device suitable for implementing a data processing method for real-time normalized transient source alarm data according to an embodiment of the present invention is shown. DETAILED DESCRIPTION

[0024] Below, embodiments of the present invention will be described with reference to the accompanying drawings. However, it should be understood that these descriptions are exemplary only and are not intended to limit the scope of the present invention. In the following detailed description, for ease of explanation, many specific details are set forth to provide a comprehensive understanding of embodiments of the present invention. However, it is apparent that one or more embodiments may also be implemented without these specific details. In addition, in the following description, descriptions of known structures and technologies are omitted to avoid unnecessary confusion of concepts of the present invention.

[0025] The terms used herein are only for describing specific embodiments and are not intended to limit the present invention. The terms "comprise", "include", etc. used herein indicate the existence of the features, steps, operations and / or components, but do not exclude the existence or addition of one or more other features, steps, operations or components.

[0026] All terms (including technical and scientific terms) used herein have the meanings commonly understood by those skilled in the art unless otherwise defined. It should be noted that the terms used herein should be interpreted as having a meaning consistent with the context of this specification and should not be interpreted in an idealized or overly rigid manner.

[0027] When using expressions such as "at least one of A, B, and C, etc.", they should generally be interpreted according to the meaning of the expression commonly understood by those skilled in the art (for example, "a system having at least one of A, B, and C" should include but is not limited to a system having A alone, B alone, C alone, A and B, A and C, B and C, and / or A, B, C, etc.).

[0028] In the related technology, the transient source alert data is annotated by using star catalog association, and filtered and classified for user subscription; it can also be to design an automated alert classification and summary framework to provide users with transient source alert data; it can also be to parse and extract information such as celestial body names, coordinates, keywords, and transient cosmic phenomenon observation dates from the title and body text of each report of the astronomer's telegram. It also supports cross-reference of astronomical databases by celestial body name search, allowing users to search for docked telescopes by celestial body aliases.

[0029] It can be seen that the existing technology is unable to integrate the transient source alarm data obtained from multiple sources, nor can it be directly connected to the telescope, resulting in a too long follow-up observation process, which in turn makes it difficult to increase the speed of follow-up observations and capture transient cosmic phenomena in a short period of time, affecting scientific researchers' time domain astronomical research.

[0030] An embodiment of the present invention provides a data processing method for real-time standardized transient source alarm data, comprising: using a large language model to extract features from the acquired transient source alarm data to obtain standardized features, wherein the standardized features include name features and coordinate features of celestial bodies in the transient source alarm data, and the name features and coordinate features have a unified data format; based on the name features and coordinate features, determining multiple associated transient source alarm data from multiple transient source alarm data, wherein the multiple associated transient source alarm data are associated with the same celestial body; sending the associated transient source alarm data to a telescope; controlling the telescope to perform follow-up observations on the associated transient source alarm data to obtain observation results, and the observation results are used to assist in the study of celestial bodies.

[0031] Figure 1 An application scenario diagram of a data processing method, apparatus, device, medium, and program product for real-time standardized transient source alarm data according to an embodiment of the present invention is shown.

[0032] like Figure 1 As shown, the application scenario 100 according to this embodiment may include a server 101, a terminal device 102, a telescope 103, and a network 104. The network 104 is used to provide a medium for a communication link between the server 101, the terminal device 102, and the telescope 103. The network 104 may include various connection types, such as wired, wireless communication links, or optical fiber cables, etc.

[0033] The user can use the terminal device 102 to interact with the server 105 through the network 104 to receive or send messages, etc. Various communication client applications can be installed on the terminal device 102, such as shopping applications, web browser applications, search applications, instant messaging tools, email clients, social platform software, etc. (only as examples).

[0034] The terminal device 102 may be any electronic device having a display screen and supporting web browsing, including but not limited to a smart phone, a tablet computer, a laptop computer, a desktop computer, and the like.

[0035] The server 101 may be a server that provides various services, such as a background management server that provides support for websites browsed by users using the terminal device 102 (only as an example). The background management server may analyze and process the received user request data, and feed back the processing results (such as temporary source alarm data, etc.) to the terminal device 102 and the telescope 103.

[0036] The telescope 103 is used to perform follow-up observation on the received transient source alarm data, and feed back the observation result to the terminal device 102 through the network 104 .

[0037] It should be noted that the data processing method of real-time standardized transient source alarm data provided by the embodiment of the present invention can generally be executed by the server 101. Accordingly, the data processing device of real-time standardized transient source alarm data provided by the embodiment of the present invention can generally be arranged in the server 101. The data processing method of real-time standardized transient source alarm data provided by the embodiment of the present invention can also be executed by a server or server cluster that is different from the server 101 and can communicate with the terminal device 102 and / or the server 101. Accordingly, the data processing device of real-time standardized transient source alarm data provided by the embodiment of the present invention can also be arranged in a server or server cluster that is different from the server 101 and can communicate with the terminal device 102 and / or the server 101.

[0038] It should be understood that Figure 1 The number of terminal devices, networks and servers in the embodiment is only . According to the implementation requirements, there can be any number of terminal devices, networks and servers.

[0039] The following will be based on Figure 1 The described scenario is described in detail with respect to the data processing method of real-time standardized transient source alarm data of an embodiment of the invention.

[0040] Figure 2 A flow chart of a data processing method for real-time standardized transient source alarm data according to an embodiment of the present invention is shown.

[0041] like Figure 2 As shown, the data processing method of real-time standardized transient source alarm data of this embodiment includes operations S210 to S240.

[0042] In operation S210, a large language model is used to extract features from the acquired transient source alarm data to obtain standardized features, wherein the standardized features include name features and coordinate features of celestial bodies in the transient source alarm data, and the name features and coordinate features have a unified data format.

[0043] According to an embodiment of the present invention, the transient source alarm data may be image data of the unpredictable, short-lived and most violent phenomena occurring in the universe, that is, transient cosmic phenomenon alarm data, involving celestial data such as black hole tidal disruption events (TidalDisruption Event TDE), gravitational waves (Gravitational Wave GW) electromagnetic counterparts, and high-redshift gamma-ray bursts (Gamma Ray Burst GRB).

[0044] In operation S220, a plurality of associated transient source alarm data are determined from the plurality of transient source alarm data based on the name feature and the coordinate feature, wherein the plurality of associated transient source alarm data are associated with the same celestial body.

[0045] According to an embodiment of the present invention, multiple transient source alarm data with consistent name features and coordinate features are used as associated transient source alarm data, that is, the multiple transient source alarm data from different data sources are data associated with the same celestial body.

[0046] According to an embodiment of the present invention, the extracted name features and coordinate features are used to associate multiple source alarms of the same transient source alarm data, effectively integrating the transient source alarm data scattered in various platforms; the integrated associated transient source alarm data can provide effective assistance for the authentication and classification of transient source alarm data, improve the data processing efficiency of the system, and allow scientific researchers to quickly determine the type of transient source alarm data for more in-depth research.

[0047] In operation S230, the associated transient source alarm data is sent to the telescope.

[0048] According to the embodiments of the present invention, an integrated observation link is constructed to realize an automated associated transient source alarm data forwarding pipeline, which greatly improves the speed of subsequent observations and eliminates the tedious work of manually collating alarm information and then assigning telescopes.

[0049] In operation S240, the telescope is controlled to perform follow-up observation on the associated transient source alarm data to obtain observation results, which are used to assist in the study of celestial bodies.

[0050] According to an embodiment of the present invention, follow-up observation in astronomy refers to subsequent observation activities of associated transient source alarm data using a telescope, which is usually carried out after the initial discovery or triggering event (associated transient source alarm data) to obtain more detailed data and information.

[0051] According to an embodiment of the present invention, a large language model is used to extract features from the acquired transient source alarm data to obtain name features and coordinate features of celestial bodies in the transient source alarm data; multiple associated transient source alarm data are determined from multiple transient source alarm data based on the name features and coordinate features; and a telescope is controlled to perform follow-up observations on the associated transient source alarm data to obtain observation results. By using a large language model to extract features from the acquired transient source alarm data, the problem of different formats of data from multiple sources is avoided, and the standardization of a large amount of unstructured and highly professional transient source alarm data is achieved, thereby improving the system response speed. At the same time, since the telescope can directly receive and perform follow-up observations on the associated transient source alarm data, the tedious work of manually collating the transient source alarm data and then assigning the telescope is avoided, thereby improving the speed of follow-up observations.

[0052] According to an embodiment of the present invention, a large language model is used to perform feature extraction on the acquired transient source alarm data to obtain standardized features, including: using a large language model to perform feature extraction on the transient source alarm data to obtain initial name features and initial coordinate features; performing accuracy evaluation on the initial name features and initial coordinate features based on historical features to obtain evaluation results; when the evaluation results indicate that both the initial name features and the initial coordinate features meet preset feature accuracy conditions, based on regular expressions, format conversion is performed on the initial name features and the initial coordinate features, respectively, to obtain name features and coordinate features.

[0053] According to an embodiment of the present invention, a large language model constructs a prompt strategy with multiple roles and rounds of extractors and reviewers, wherein the extractor is used to perform feature extraction on the transient source alarm data to obtain initial name features and initial coordinate features, and the reviewer is used to perform accuracy evaluation on the initial name features and initial coordinate features.

[0054] According to an embodiment of the present invention, the reviewer may evaluate the accuracy of the initial name feature and the initial coordinate feature by comparing the initial name feature and the initial coordinate feature using the historical feature, for example, determining the similarity between the historical coordinate feature corresponding to the historical name feature consistent with the initial name feature and the initial coordinate feature, and using the comparison result with multiple groups of historical features as the evaluation result.

[0055] According to an embodiment of the present invention, the preset feature accuracy condition may be a similarity threshold between the historical feature and the initial name feature, the initial coordinate feature, etc. If the evaluation result indicates that both the initial name feature and the initial coordinate feature satisfy the preset feature accuracy condition, a regular expression is used to unify the data formats of the initial name feature and the initial coordinate feature to obtain the name feature and the coordinate feature.

[0056] According to an embodiment of the present invention, a large language model is used to perform feature extraction on the acquired transient source alarm data to obtain standardized features, and also includes: when an evaluation result indicates that at least one of the initial name feature and the initial coordinate feature does not meet a preset feature accuracy condition, a self-assessment mechanism is used to perform new feature extraction on the transient source alarm data to obtain updated initial name features and initial coordinate features.

[0057] According to an embodiment of the present invention, the self-assessment mechanism can allow extractors and reviewers to conduct multiple rounds of extraction and evaluation, and fine-tune the parameters of the large language model based on each evaluation result, so that the initial name features and initial coordinate features extracted by the fine-tuned large language model can be close to the historical features.

[0058] According to an embodiment of the present invention, 200 pieces of temporary source alarm data from ATel (Astronomer's Telegram Atel) and GCNCircular (General Coordinates Network GCN) are selected, and the precision, recall and F1 scores of the extracted name features and coordinate features are calculated. As shown in Table 1, the results show that the extraction precision has reached more than 95%, among which 5% instability will be avoided by the above-mentioned fine-tuning of the large language model.

[0059]

[0060] According to the embodiments of the present invention, multi-role and multi-round structured extraction is performed by extractors and reviewers of a large language model, and regular expressions are used for final format specification, which effectively solves the problem of hallucinations in large models and enables the system to run stably and be implemented effectively.

[0061] According to an embodiment of the present invention, sending the associated transient source alarm data to a telescope includes: determining a target telescope among a plurality of telescopes according to a preset screening condition; determining a message transmission protocol associated with the target telescope; and transmitting the associated transient source alarm data to the target telescope based on the message transmission protocol.

[0062] According to an embodiment of the present invention, the target telescope is used to perform a follow-up observation task.

[0063] According to an embodiment of the present invention, the message transmission protocol may be a lightweight transmission protocol, such as the MQTT protocol (Message Queuing Telemetry Transport, message queue telemetry transmission protocol).

[0064] According to an embodiment of the present invention, based on a message transmission protocol, an interface specification is determined to determine a message character string format in a process of transmitting data associated with a transient source alarm.

[0065] According to an embodiment of the present invention, an interface standard specification is formulated so that the transmission link is not limited to certain telescopes. Newly added telescope equipment can quickly and conveniently access the integrated observation link, and the formulated interface specification allows data to be transmitted in a specified message string format, which is convenient for improving the response speed of the system, allowing the telescope to quickly receive associated transient source alarm data, facilitating subsequent research by scientific researchers.

[0066] According to an embodiment of the present invention, determining a target telescope in telescopes according to preset screening conditions includes: determining a target range associated with the associated transient source alarm data according to coordinate information of the associated transient source alarm data; and determining the target telescope from a plurality of telescopes within the target range according to an observation state of the telescope within the target range, wherein the observation state of the telescope represents whether the telescope is performing a subsequent observation task.

[0067] According to an embodiment of the present invention, a target range within which the associated transient source alarm data can be observed is determined based on coordinate information of the associated transient source alarm data, thereby preventing a telescope within the target range from failing to observe the associated transient source alarm data.

[0068] According to an embodiment of the present invention, a telescope that is performing a subsequent observation task among multiple telescopes within the target range is used as the target telescope, that is, a telescope that can work normally is selected to avoid the selected telescope being unable to perform the subsequent observation task.

[0069] According to an embodiment of the present invention, the method further comprises: visualizing the standardized features, the associated transient source alarm data and the observation results.

[0070] According to an embodiment of the present invention, in order to facilitate the use of scientific researchers, a visualization interface is designed, which includes functions such as temporary source alarm data display, associated temporary source alarm data display, alarm forwarding, observation result display, and telescope availability monitoring, so that scientific researchers can see the alarm forwarding and observation results at the first time.

[0071] According to an embodiment of the present invention, the transient source alarm data display interface can display the transient source alarm data and the standardized features corresponding to the transient source alarm data, specifically the time information of acquiring each transient source alarm data, and the coordinate features and name features corresponding to the transient source alarm data.

[0072] According to an embodiment of the present invention, the associated transient source alarm data interface can display image data of a celestial body corresponding to the associated transient source alarm data, and a plurality of transient source alarm data included in the associated transient source alarm data.

[0073] According to an embodiment of the present invention, the observation result display interface may display the availability status information of the telescope and the observation results of subsequent observations corresponding to each telescope.

[0074] Figure 3 A visualization interface according to an embodiment of the present invention is shown.

[0075] According to an embodiment of the present invention, Figure 3 As shown, the observation result display interface can display the identification, longitude, latitude and other information of the telescope, so that the user can confirm the status of the telescope in real time.

[0076] According to an embodiment of the present invention, the above method also includes: obtaining public transient source alarm data; using a message queue to obtain specified transient source alarm data, the specified transient source alarm data is collected by a specified device; determining the public transient source alarm data and the specified transient source alarm data as transient source alarm data, and storing them in a database.

[0077] According to an embodiment of the present invention, public transient source alert data can be obtained through various platforms such as Astronomer's Telegram Atel, machine-readable and human-readable gamma-ray datasets (GCN Notice, GCN Circular) published in the General Coordinates Network (GCN), and the Transient Name Server (TNS).

[0078] According to an embodiment of the present invention, the designated transient source alarm data may be non-invented transient source alarm data collected by a designated telescope.

[0079] Figure 4 A schematic diagram showing a data processing method for real-time standardized transient source alarm data according to an embodiment of the present invention is shown.

[0080] According to an embodiment of the present invention, the data processing method of real-time standardized transient source alarm data of the embodiment of the present invention is as follows: Figure 4 As shown, in operation S401, the public transient source alarm data and the designated transient source alarm data are obtained respectively. In operation S402, the transient source alarm data is determined. In operation S403, the initial name feature and the initial coordinate feature of the transient source alarm data are extracted. In operation S404, the initial name feature and the initial coordinate feature are evaluated for accuracy. In operation S405, it is determined whether the evaluation result meets the preset feature accuracy condition. If not, operation S403 is re-executed based on the self-assessment mechanism; if it is satisfied, operation S406 is executed to obtain the name feature and the coordinate feature in a unified format based on the regular expression. In operation S407, the associated transient source alarm data is determined. In operation S408, the associated transient source alarm data is sent to the telescope based on the message transmission protocol. In operation S409, the telescope is controlled to perform follow-up observation on the associated transient source alarm data, and the observation result is obtained in operation S412. In operation S411, the above observation results and the data such as the telescope status confirmed during the observation process are stored in the time domain astronomy database. In operation S410, the standardized features determined in operation S403, the associated transient source alarm data determined in operation S407, the observation results stored in the time domain astronomy database in operation S411, and the telescope status confirmed during the observation process are visualized.

[0081] Based on the above-mentioned data processing method for real-time standardized transient source alarm data, the present invention also provides a data processing device for real-time standardized transient source alarm data. Figure 5 The device is described in detail.

[0082] Figure 5 The structure block diagram of the data processing device for real-time normalization of transient source alarm data according to an embodiment of the present invention is shown.

[0083] like Figure 5 As shown, the data processing device 500 for real-time standardized transient source alarm data of this embodiment includes an extraction module 510 , a determination module 520 , a sending module 530 and an observation module 540 .

[0084] The extraction module 510 is used to extract features from the acquired transient source alarm data using a large language model to obtain standardized features, wherein the standardized features include name features and coordinate features of celestial bodies in the transient source alarm data, and the name features and coordinate features have a unified data format. In one embodiment, the extraction module 510 can be used to perform the operation S210 described above, which will not be repeated here.

[0085] The determination module 520 is used to determine a plurality of associated transient source alarm data from the plurality of transient source alarm data based on the name feature and the coordinate feature, wherein the plurality of associated transient source alarm data are associated with the same celestial body. In one embodiment, the determination module 520 can be used to perform the operation S220 described above, which will not be described in detail herein.

[0086] The sending module 530 is used to send the associated transient source alarm data to the telescope. In one embodiment, the sending module 530 can be used to perform the operation S230 described above, which will not be described in detail here.

[0087] The observation module 540 is used to control the telescope to perform follow-up observation on the associated transient source alarm data to obtain observation results, which are used to assist in the study of celestial bodies. In one embodiment, the observation module 540 can be used to perform the operation S240 described above, which will not be repeated here.

[0088] According to an embodiment of the present invention, a large language model is used to extract features from the acquired transient source alarm data to obtain name features and coordinate features of celestial bodies in the transient source alarm data; multiple associated transient source alarm data are determined from multiple transient source alarm data based on the name features and coordinate features; and a telescope is controlled to perform follow-up observations on the associated transient source alarm data to obtain observation results. By using a large language model to extract features from the acquired transient source alarm data, the problem of different formats of data from multiple sources is avoided, and the standardization of a large amount of unstructured and highly professional transient source alarm data is achieved, thereby improving the system response speed. At the same time, since the telescope can directly receive and perform follow-up observations on the associated transient source alarm data, the tedious work of manually collating the transient source alarm data and then assigning the telescope is avoided, thereby improving the speed of follow-up observations.

[0089] According to an embodiment of the present invention, any multiple modules among the extraction module 510, the determination module 520, the sending module 530 and the observation module 540 can be combined into one module for implementation, or any one of the modules can be split into multiple modules. Alternatively, at least part of the functions of one or more of these modules can be combined with at least part of the functions of other modules and implemented in one module. According to an embodiment of the present invention, at least one of the extraction module 510, the determination module 520, the sending module 530 and the observation module 540 can be at least partially implemented as a hardware circuit, such as a field programmable gate array (FPGA), a programmable logic array (PLA), a system on a chip, a system on a substrate, a system on a package, an application specific integrated circuit (ASIC), or can be implemented by hardware or firmware such as any other reasonable way of integrating or packaging the circuit, or implemented in any one of the three implementation methods of software, hardware and firmware or in any appropriate combination of any of them. Alternatively, at least one of the extraction module 510, the determination module 520, the sending module 530 and the observation module 540 can be at least partially implemented as a computer program module, and when the computer program module is run, the corresponding function can be executed.

[0090] According to an embodiment of the present invention, the extraction module 510 includes an extraction submodule, an evaluation submodule and a conversion submodule.

[0091] The extraction submodule is used to extract features from the transient source alarm data using a large language model to obtain initial name features and initial coordinate features.

[0092] The evaluation submodule is used to evaluate the accuracy of the initial name feature and the initial coordinate feature based on the historical features to obtain the evaluation results.

[0093] The conversion submodule is used to convert the format of the initial name feature and the initial coordinate feature based on a regular expression to obtain the name feature and the coordinate feature respectively when the evaluation results indicate that the initial name feature and the initial coordinate feature meet the preset feature accuracy conditions.

[0094] According to an embodiment of the present invention, the extraction module 510 further includes a fine-tuning submodule.

[0095] The fine-tuning submodule is used to use a self-evaluation mechanism to extract new features from the transient source alarm data to obtain updated initial name features and initial coordinate features when the evaluation results indicate that at least one of the initial name features and the initial coordinate features does not meet the preset feature accuracy conditions.

[0096] According to an embodiment of the present invention, the sending module 530 includes a first determining submodule, a second determining submodule and a transmission submodule.

[0097] The first determination submodule is used to determine a target telescope among a plurality of telescopes according to a preset screening condition.

[0098] The second determination submodule is used to determine a message transmission protocol associated with the target telescope.

[0099] The transmission submodule is used to transmit the associated transient source alarm data to the target telescope based on the message transmission protocol.

[0100] According to an embodiment of the present invention, the first determining submodule includes a first determining unit and a second determining unit.

[0101] The first determining unit is used to determine a target range associated with the associated transient source alarm data according to coordinate information of the associated transient source alarm data.

[0102] The second determination unit is used to determine a target telescope from a plurality of telescopes within the target range according to the observation state of the telescope within the target range, wherein the observation state of the telescope represents whether the telescope is performing a subsequent observation task.

[0103] According to an embodiment of the present invention, the data processing device 500 for normalizing transient source alarm data in real time further includes a visualization module.

[0104] A visualization module is used to visualize the standardized features, associated transient source alarm data and observation results.

[0105] According to an embodiment of the present invention, the data processing device 500 for real-time normalization of transient source alarm data further includes a first acquisition module, a second acquisition module and a storage module.

[0106] The first acquisition module is used to acquire public transient source alarm data.

[0107] The second acquisition module is used to acquire the specified temporary source alarm data by using the message queue.

[0108] The storage module is used to determine the public transient source alarm data and the designated transient source alarm data as transient source alarm data, and store them into the database.

[0109] Figure 6 A block diagram of an electronic device suitable for implementing a data processing method for real-time normalized transient source alarm data according to an embodiment of the present invention is shown.

[0110] like Figure 6As shown, the electronic device 600 according to an embodiment of the present invention includes a processor 601, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 602 or a program loaded from a storage part 608 to a random access memory (RAM) 603. The processor 601 may include, for example, a general-purpose microprocessor (e.g., a CPU), an instruction set processor and / or a related chipset and / or a special-purpose microprocessor (e.g., an application-specific integrated circuit (ASIC)), etc. The processor 601 may also include an onboard memory for caching purposes. The processor 601 may include a single processing unit or multiple processing units for performing different actions of the method flow according to an embodiment of the present invention.

[0111] In RAM 603, various programs and data required for the operation of electronic device 600 are stored. Processor 601, ROM 602 and RAM 603 are connected to each other via bus 604. Processor 601 performs various operations of the method flow according to the embodiment of the present invention by executing the program in ROM 602 and / or RAM 603. It should be noted that the program can also be stored in one or more memories other than ROM 602 and RAM 603. Processor 601 can also perform various operations of the method flow according to the embodiment of the present invention by executing the program stored in the one or more memories.

[0112] According to an embodiment of the present invention, the electronic device 600 may further include an input / output (I / O) interface 605, which is also connected to the bus 604. The electronic device 600 may further include one or more of the following components connected to the input / output (I / O) interface 605: an input portion 606 including a keyboard, a mouse, etc.; an output portion 607 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage portion 608 including a hard disk, etc.; and a communication portion 609 including a network interface card such as a LAN card, a modem, etc. The communication portion 609 performs communication processing via a network such as the Internet. A drive 610 is also connected to the input / output (I / O) interface 605 as needed. A removable medium 611, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 610 as needed, so that a computer program read therefrom is installed into the storage portion 608 as needed.

[0113] The present invention also provides a computer-readable storage medium, which may be included in the device / apparatus / system described in the above embodiment; or may exist independently without being assembled into the device / apparatus / system. The above computer-readable storage medium carries one or more programs, and when the above one or more programs are executed, the method according to the embodiment of the present invention is implemented.

[0114] According to an embodiment of the present invention, the computer-readable storage medium may be a non-volatile computer-readable storage medium, for example, it may include but is not limited to: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present invention, the computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, an apparatus or a device. For example, according to an embodiment of the present invention, the computer-readable storage medium may include the ROM 602 and / or RAM 603 described above and / or one or more memories other than ROM 602 and RAM 603.

[0115] The embodiment of the present invention also includes a computer program product, which includes a computer program, and the computer program contains program code for executing the method shown in the flowchart. When the computer program product is run in a computer system, the program code is used to enable the computer system to implement the data processing method for real-time standardized transient source alarm data provided by the embodiment of the present invention.

[0116] The computer program executes the above functions defined in the system / device of the embodiment of the present invention when it is executed by the processor 601. According to the embodiment of the present invention, the system, device, module, unit, etc. described above can be implemented by a computer program module.

[0117] In one embodiment, the computer program may rely on tangible storage media such as optical storage devices, magnetic storage devices, etc. In another embodiment, the computer program may also be transmitted and distributed in the form of signals on a network medium, and downloaded and installed through the communication part 609, and / or installed from a removable medium 611. The program code contained in the computer program may be transmitted using any appropriate network medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

[0118] In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 609, and / or installed from the removable medium 611. When the computer program is executed by the processor 601, the above functions defined in the system of the embodiment of the present invention are performed. According to the embodiment of the present invention, the system, device, means, module, unit, etc. described above can be implemented by a computer program module.

[0119] According to an embodiment of the present invention, the program code for executing the computer program provided by the embodiment of the present invention can be written in any combination of one or more programming languages. Specifically, these computing programs can be implemented using high-level process and / or object-oriented programming languages, and / or assembly / machine languages. Programming languages ​​include, but are not limited to, Java, C++, python, "C" language or similar programming languages. The program code can be executed entirely on the user computing device, partially on the user device, partially on the remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device can be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computing device (e.g., using an Internet service provider to connect through the Internet).

[0120] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present invention. In this regard, each box in the flow chart or block diagram can represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of a code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flow chart, and the combination of the boxes in the block diagram or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0121] It will be appreciated by those skilled in the art that the features described in the various embodiments of the present invention may be combined and / or combined in various ways, even if such combinations or combinations are not explicitly described in the present invention. In particular, without departing from the spirit and teachings of the present invention, the features described in the various embodiments of the present invention may be combined and / or combined in various ways. All of these combinations and / or combinations fall within the scope of the present invention.

[0122] The embodiments of the present invention are described above. However, these embodiments are only for the purpose of illustration, and are not intended to limit the scope of the present invention. Although each embodiment is described above, it does not mean that the measures in each embodiment cannot be used in combination advantageously. Without departing from the scope of the present invention, those skilled in the art may make various substitutions and modifications, which should all fall within the scope of the present invention.

Claims

1. A data processing method for real-time standardized transient source alarm data, characterized in that: The method comprises: The large language model is used to extract features from the transient source alarm data to obtain initial name features and initial coordinate features; Based on the historical features, the accuracy of the initial name feature and the initial coordinate feature is evaluated to obtain an evaluation result; When the evaluation result indicates that both the initial name feature and the initial coordinate feature meet the preset feature accuracy condition, based on a regular expression, format conversion is performed on the initial name feature and the initial coordinate feature to obtain a name feature and a coordinate feature, wherein the name feature and the coordinate feature have a unified data format; Determining a plurality of associated transient source alarm data from the plurality of transient source alarm data based on the name feature and the coordinate feature, wherein the plurality of associated transient source alarm data are associated with the same celestial body; sending the associated transient source alarm data to a telescope; The telescope is controlled to perform follow-up observation on the associated transient source alarm data to obtain observation results, and the observation results are used to assist in the study of the celestial body.

2. The method according to claim 1, characterized in that The method further comprises: When the evaluation result indicates that at least one of the initial name feature and the initial coordinate feature does not meet the preset feature accuracy condition, a self-assessment mechanism is used to perform new feature extraction on the transient source alarm data to obtain updated initial name features and initial coordinate features.

3. The method according to claim 1, characterized in that: The step of sending the associated transient source alarm data to the telescope comprises: Determining a target telescope from among the plurality of telescopes according to a preset screening condition; determining a message transmission protocol associated with the target telescope; Based on the message transmission protocol, the associated transient source alarm data is transmitted to the target telescope.

4. The method according to claim 3, characterized in that The step of determining a target telescope among the telescopes according to a preset screening condition comprises: determining a target range associated with the associated transient source alarm data according to the coordinate information of the associated transient source alarm data; The target telescope is determined from the plurality of telescopes within the target range according to the observation state of the telescope within the target range, wherein the observation state of the telescope represents whether the telescope is performing a subsequent observation task.

5. The method according to claim 1, characterized in that The method further comprises: The name feature, the coordinate feature, the associated transient source alarm data, and the observation result are visualized.

6. The method according to claim 1, characterized in that The method further comprises: Get public transient source alarm data; Acquire designated transient source alarm data by using a message queue, wherein the designated transient source alarm data is collected by a designated device; The common transient source alarm data and the designated transient source alarm data are determined as the transient source alarm data, and stored in a database.

7. A data processing device for real-time standardized transient source alarm data, characterized in that: The device comprises: An extraction module, used for extracting features from the acquired transient source alarm data using a large language model to obtain standardized features, wherein the standardized features include name features and coordinate features of celestial bodies in the transient source alarm data, and the name features and coordinate features have a unified data format; A determination module, configured to determine a plurality of associated transient source alarm data from the plurality of transient source alarm data based on the name feature and the coordinate feature, wherein the plurality of associated transient source alarm data are associated with the same celestial body; a sending module, configured to send the associated transient source alarm data to a telescope; and An observation module, used for controlling the telescope to perform follow-up observation on the associated transient source alarm data to obtain observation results, wherein the observation results are used to assist in the study of the celestial body; Wherein, the extraction module comprises: An extraction submodule, used for extracting features from the transient source alarm data using the large language model to obtain initial name features and initial coordinate features; An evaluation submodule, used for performing accuracy evaluation on the initial name feature and the initial coordinate feature based on the historical feature to obtain an evaluation result; The conversion submodule is used to convert the format of the initial name feature and the initial coordinate feature based on a regular expression to obtain the name feature and the coordinate feature when the evaluation result indicates that the initial name feature and the initial coordinate feature both meet the preset feature accuracy conditions.

8. An electronic device comprising: one or more processors; a memory for storing one or more computer programs, It is characterized in that the one or more processors execute the one or more computer programs to implement the steps of the method according to any one of claims 1 to 6.

9. A computer-readable storage medium having a computer program or instruction stored thereon, characterized in that: When the computer program or instruction is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

Images