A space science experiment data online collaborative analysis method and system

Abstract

The application provides a kind of space science experimental data online collaborative analysis method and system, it is related to scientific experimental data processing and analysis technical field.The method comprises: in response to the project creation request sent by the first device, create space science data online research project;In response to the analysis request of space science data online research project sent by the second device, according to the running environment information scheduling environment mirror and computing resources, create running environment;In response to the online analysis operation sent by the second device, based on the plurality of functional components configured by running environment, determine target sub-result, in response to the result update request sent by the second device, the target sub-result identification information is carried in result update request, according to the identification information of target sub-result, update target result.The application can quickly and accurately complete the online processing and analysis of complex scientific tasks in the scene of multi-person collaborative processing, efficiently utilize space science experimental data, effectively improve data processing and analysis efficiency.

Description

Technical Field

[0001] This invention relates to the field of scientific experimental data processing and analysis technology, and in particular to an online collaborative analysis method and system for space science experimental data. Background Technology

[0002] The space laboratory includes scientific research facilities such as scientific experiment cabinets and extravehicular exposure experimental platforms, capable of supporting on-orbit rolling implementation of numerous research fields, including space life sciences and biotechnology, microgravity fundamental physics, space materials science, and space astronomy. Space science experimental data is characterized by its large volume, real-time batch generation, multi-field scope, diverse types, multiple formats, and wide range of sources, exhibiting characteristics of broad reach, openness, collaboration, and sharing.

[0003] In scientific research, data processing and analysis are crucial. With the rapid development of data science, the processing and analysis of scientific data has become increasingly complex. Traditional scientific data processing methods typically require users to build local computing environments, which is not only time-consuming and labor-intensive but also limited by local computing resources. Furthermore, complex scientific research projects often require collaboration among multiple researchers; traditional collaboration methods are inefficient and fail to meet the needs of modern scientific research. Existing online data processing platforms have not yet effectively solved problems such as how to efficiently allocate computing resources, manage project versions, and support complex collaborative task planning during multi-user collaborative work.

[0004] Therefore, there is an urgent need for an online collaborative analysis method and system for space science experimental data, which can conveniently complete the online processing and analysis of complex scientific tasks, efficiently utilize space science experimental data, and promote the output of scientific and applied results. Summary of the Invention

[0005] This invention provides a method and system for online collaborative analysis of space science experimental data, which can quickly and accurately complete the online processing and analysis of complex scientific tasks in multi-person collaborative processing scenarios, efficiently utilize space science experimental data, and effectively improve data processing and analysis efficiency.

[0006] To achieve the above objectives, the embodiments of the present invention adopt the following technical solutions:

[0007] In a first aspect, a method for online collaborative analysis of space science experimental data is provided, applied to an online collaborative analysis system. The online collaborative analysis system communicates with a first device and multiple second devices. The method includes: in response to a project creation request sent by the first device, creating an online research project for space science data, the online research project for space science data is used to determine a target result, the target result of the online research project for space science data includes multiple sub-results, each sub-result is configured with different identification information; the project creation request carries operating environment information; in response to an analysis request for the online research project for space science data sent by the second devices, scheduling environment mirrors and computing resources according to the operating environment information to create an operating environment, the operating environment being configured with multiple functional components; in response to an online analysis operation sent by the second devices, determining a target sub-result based on the multiple functional components configured in the operating environment, the target sub-result being one of the multiple sub-results; in response to a result update request sent by the second devices, the result update request carrying the identification information of the target sub-result, updating the target result according to the identification information of the target sub-result.

[0008] In one possible implementation of the first aspect, the project creation request also carries permission information for each of the multiple second devices; in response to the analysis request for the online research project of space science data sent by the second device, creating an operating environment based on the operating environment information includes: in response to the analysis request for the online research project of space science data sent by the second device, determining whether the second device has online analysis permission for the online research project of space science data based on the permission information; and if the second device has online analysis permission for the online research project of space science data, creating an operating environment based on the operating environment information.

[0009] In one possible implementation of the first aspect, the method further includes: responding to a request from the second device to read the results of an online research project on space science data, determining whether the second device has permission to read the results of the online research project on space science data based on permission information; and if the second device has permission to read the results of the online research project on space science data, sending the target results corresponding to the online research project on space science data to the second device.

[0010] In one possible implementation of the first aspect, the online collaborative analysis system is further configured with multiple space science experiment data sources, including local datasets, databases, object storage, and NAS space; in response to an online analysis operation sent by a second device, the system determines a target sub-result based on multiple functional components configured in the operating environment, including: in response to an online analysis operation sent by the second device, acquiring space science experiment data from the space science experiment data sources; and determining the target sub-result based on the space science experiment data according to the multiple functional components configured in the operating environment.

[0011] In one possible implementation of the first aspect, the project creation request also carries resource configuration information, and the method further includes: determining the computing resources corresponding to the operating environment based on the resource configuration information; determining the computing resource occupancy rate corresponding to the second device when determining the target sub-result in response to the operation of multiple functional components configured by the second device on the operating environment; applying to the resource pool to expand computing nodes when the computing resource occupancy rate is greater than or equal to a first threshold, the resource pool including multiple computing nodes, the type of the computing nodes matching the hardware architecture of the operating environment; and releasing idle computing nodes to the resource pool when the computing resource occupancy rate is less than a second threshold and continues for a preset duration.

[0012] In one possible implementation of the first aspect, the method further includes: responding to an instruction from the second device for a custom runtime environment, the instruction carrying information about custom functional components, incrementally installing custom functional components on the runtime environment to generate a custom runtime environment; and responding to an online analysis operation sent by the second device, determining a target sub-result based on multiple functional components configured in the custom runtime environment.

[0013] In one possible implementation of the first aspect, the result update request further carries a version number of the target sub-result. Updating the target result based on the identification information of the target sub-result includes: if no data is stored at the storage location corresponding to the identification information of the target sub-result, storing the target sub-result and its version number at the storage location corresponding to the identification information of the target sub-result; if data is stored at the storage location corresponding to the identification information of the target sub-result, determining the version number of the stored data; and if the version number of the stored data is less than the version number of the target sub-result, storing the target sub-result and its version number at the storage location corresponding to the identification information of the target sub-result.

[0014] In one possible implementation of the first aspect, the method further includes: upon receiving result update requests from at least two second devices for the same sub-result, sending update conflict information to the first device, the update conflict information carrying identification information and sub-result of each of the at least two second devices; responding to a conflict resolution instruction sent by the first device, the conflict resolution instruction carrying identification information of a third device, the third device being one of the at least two second devices; and updating the target result according to the sub-result corresponding to the third device.

[0015] The beneficial effects of this invention are as follows: The method provided by this invention creates an online research project of space science data for determining target results. In response to analysis requests from multiple second devices for the online research project of space science data, it creates an operating environment based on operating environment information. The operating environment is configured with multiple functional components. In response to online analysis operations sent by multiple second devices, it determines different sub-results based on the multiple functional components configured in the operating environment. In response to result update requests sent by each second device, it updates the target result based on the identification information of the sub-results of each second device. The method provided by this invention can quickly and accurately complete the online processing and analysis of complex scientific tasks in multi-person collaborative processing scenarios, efficiently utilize space science experimental data, and effectively improve data processing and analysis efficiency.

[0016] In other words, the technical solution provided by this invention enables online analysis and collaborative processing of large-scale, multi-domain, and multi-type space science experimental data, thereby supporting the research needs of complex space science experimental tasks. On the one hand, it improves the efficiency of space science experimental data processing and strengthens research collaboration capabilities. Through online collaborative analysis methods, researchers can quickly and accurately decompose complex research tasks, enabling multiple teams to collaborate online, significantly shortening the data processing cycle and improving research efficiency. This invention supports multiple users collaborating on the same research project, achieving fine-grained permission management and project version control, allowing research teams to efficiently solve problems and share results. On the other hand, this invention optimizes computing resource allocation and reduces research costs. The online collaborative analysis system automatically schedules computing resources according to user needs, constructing an online research environment, effectively solving the problem of limited computing resources in traditional data processing methods, and improving the utilization and reusability of computing resources. This invention avoids the cumbersome process of building an analysis environment locally in traditional research, allowing researchers to focus on data processing and analysis.

[0017] Secondly, the present invention provides an online collaborative analysis system that communicates with a first device and multiple second devices. The online collaborative analysis system includes: a project creation module, used to create an online research project on space science data in response to a project creation request sent by the first device. The online research project on space science data is used to determine a target result, and the target result of the online research project on space science data includes multiple sub-results, each of which is configured with different identification information; the project creation request carries runtime environment information; a mirror creation module, used to create a runtime environment by scheduling an environment mirror and computing resources according to the runtime environment information in response to an analysis request sent by the second devices, and the runtime environment is configured with multiple functional components; a result iteration module, used to determine a target sub-result based on the multiple functional components configured in the runtime environment in response to an online analysis operation sent by the second devices, and the target sub-result is one of the multiple sub-results; and a result update module, used to update the target result according to the identification information of the target sub-result in response to a result update request sent by the second devices.

[0018] Thirdly, an electronic device is provided, the electronic device including a memory and one or more processors; the memory is coupled to the processors; wherein the memory stores computer program code, the computer program code including computer instructions, which, when executed by the processor, cause the electronic device to perform the method as described in any implementation of the first aspect.

[0019] Fourthly, a computer-readable storage medium is provided, including computer instructions that, when executed on an electronic device, cause the electronic device to perform a method as described in any implementation of the first aspect.

[0020] Fifthly, a computer program product is provided that, when run on a computer, causes the computer to perform the method in any implementation of the first aspect.

[0021] Understandably, the beneficial effects that the online collaborative analysis system for space science experimental data of the second aspect, the electronic equipment of the third aspect, the computer-readable storage medium of the fourth aspect, and the computer program product of the fifth aspect can achieve can be referred to the beneficial effects of the first aspect and any of its possible design methods, and will not be repeated here. Attached Figure Description

[0022] Figure 1 A schematic diagram illustrating an application scenario provided by an embodiment of the present invention;

[0023] Figure 2 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present invention;

[0024] Figure 3 A flowchart of an online collaborative analysis method for space science experimental data provided in an embodiment of the present invention;

[0025] Figure 4a This is a schematic diagram of the interactive programming interface for Notebooks, as shown in an embodiment of the present invention.

[0026] Figure 4b This is a schematic diagram of a graphical drag-and-drop programming interface according to an embodiment of the present invention;

[0027] Figure 4c This is a schematic diagram of a Web IDE programming interface shown in an embodiment of the present invention;

[0028] Figure 5 This is a schematic diagram illustrating the task breakdown of an online collaborative analysis method for space science experimental data, as shown in an embodiment of the present invention.

[0029] Figure 6 This is a schematic diagram of the interface for selecting project runtime resources according to an embodiment of the present invention;

[0030] Figure 7a This is a schematic diagram of an interface for planning space science experimental data missions, as shown in an embodiment of the present invention.

[0031] Figure 7b This is a schematic diagram of the interface of a space science experiment data analysis project dashboard, as shown in an embodiment of the present invention.

[0032] Figure 7c This is a schematic diagram of the interface for details of a space science experiment data analysis task, as shown in an embodiment of the present invention.

[0033] Figure 8 This is a schematic diagram of a collaborative analysis code merging processing interface shown in an embodiment of the present invention;

[0034] Figure 9 This is a flowchart illustrating a multi-user collaborative analysis scenario according to an embodiment of the present invention;

[0035] Figure 10 This is a schematic diagram of the structure of an online collaborative analysis system provided in an embodiment of the present invention. Detailed Implementation

[0036] The technical solutions of the embodiments of the present invention will be described below with reference to the accompanying drawings. In the description of the present invention, unless otherwise stated, " / " indicates that the objects before and after are in an "or" relationship. For example, A / B can represent A or B. The "or" in the present invention is merely a description of the relationship between the related objects, indicating that three relationships can exist. For example, A or B can represent: A alone, A and B simultaneously, and B alone. A and B can be singular or plural. Furthermore, in the description of the present invention, unless otherwise stated, "multiple" refers to two or more. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items.

[0037] Furthermore, to facilitate a clear description of the technical solutions of the embodiments of the present invention, the terms "first" and "second" are used in the embodiments of the present invention to distinguish identical or similar items with essentially the same function and effect. Those skilled in the art will understand that the terms "first" and "second" do not limit the quantity or execution order, and that the terms "first" and "second" are not necessarily different.

[0038] In this embodiment of the invention, the terms "exemplary" or "for example" are used to indicate that something is an example, illustration, or description. Any embodiment or design described as "exemplary" or "for example" in this embodiment of the invention should not be construed as superior or more advantageous than other embodiments or designs. Specifically, the use of terms such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner for ease of understanding.

[0039] The space laboratory includes scientific research facilities such as scientific experiment cabinets and extravehicular exposure experimental platforms, capable of supporting on-orbit rolling implementation of numerous research fields, including space life sciences and biotechnology, microgravity fundamental physics, space materials science, and space astronomy. Space science experimental data is characterized by its large volume, real-time batch generation, multi-field scope, diverse types, multiple formats, and wide range of sources, exhibiting characteristics of broad reach, openness, collaboration, and sharing.

[0040] In scientific research, data processing and analysis are crucial. With the rapid development of data science, the processing and analysis of scientific data has become increasingly complex. Traditional scientific data processing methods typically require users to build local computing environments, which is not only time-consuming and labor-intensive but also limited by local computing resources. Furthermore, complex scientific research projects often require collaboration among multiple researchers; traditional collaboration methods are inefficient and fail to meet the needs of modern scientific research. Existing online data processing platforms have not yet effectively solved problems such as how to efficiently allocate computing resources, manage project versions, and support complex collaborative task planning during multi-user collaborative work.

[0041] Therefore, there is an urgent need for an online collaborative analysis method and system for space science experimental data, which can conveniently complete the online processing and analysis of complex scientific tasks, efficiently utilize space science experimental data, and promote the output of scientific and applied results.

[0042] In view of this, embodiments of the present invention provide an online collaborative analysis method for space science experimental data, applied to an online collaborative analysis system. The online collaborative analysis system communicates with a first device and multiple second devices. The method includes: responding to a project creation request sent by the first device, creating an online research project for space science data. The online research project for space science data is used to determine a target result. The target result of the online research project for space science data includes multiple sub-results, each of which is configured with different identification information. The project creation request carries operating environment information. Responding to an analysis request for the online research project for space science data sent by the second devices, scheduling an environment mirror and computing resources according to the operating environment information to create an operating environment. The operating environment is configured with multiple functional components. Responding to an online analysis operation sent by the second devices, determining a target sub-result based on the multiple functional components configured in the operating environment. The target sub-result is one of the multiple sub-results. Responding to a result update request sent by the second devices, the result update request carries the identification information of the target sub-result, and updating the target result according to the identification information of the target sub-result.

[0043] The beneficial effects of this invention are as follows: The method provided by this invention creates an online research project of space science data for determining target results. In response to analysis requests from multiple second devices for the online research project of space science data, it creates an operating environment based on operating environment information. The operating environment is configured with multiple functional components. In response to online analysis operations sent by multiple second devices, it determines different sub-results based on the multiple functional components configured in the operating environment. In response to result update requests sent by each second device, it updates the target result based on the identification information of the sub-results of each second device. The method provided by this invention can quickly and accurately complete the online processing and analysis of complex scientific tasks in multi-person collaborative processing scenarios, efficiently utilize space science experimental data, and effectively improve data processing and analysis efficiency.

[0044] In other words, the technical solution provided by this invention enables online analysis and collaborative processing of large-scale, multi-domain, and multi-type space science experimental data, thereby supporting the research needs of complex space science experimental tasks. On the one hand, it improves the efficiency of space science experimental data processing and strengthens research collaboration capabilities. Through online collaborative analysis methods, researchers can quickly and accurately decompose complex research tasks, enabling multiple teams to collaborate online, significantly shortening the data processing cycle and improving research efficiency. This invention supports multiple users collaborating on the same research project, achieving fine-grained permission management and project version control, allowing research teams to efficiently solve problems and share results. On the other hand, this invention optimizes computing resource allocation and reduces research costs. The online collaborative analysis system automatically schedules computing resources according to user needs, constructing an online research environment, effectively solving the problem of limited computing resources in traditional data processing methods, and improving the utilization and reusability of computing resources. This invention avoids the cumbersome process of building an analysis environment locally in traditional research, allowing researchers to focus on data processing and analysis.

[0045] See Figure 1 , Figure 1 This is a schematic diagram illustrating an application scenario provided by an embodiment of the present invention. It includes an online collaborative analysis system 100, a first device 11, and multiple second devices 12. The online collaborative analysis system 100 communicates with both the first device 11 and the multiple second devices 12. The user operating the first device 11 is the manager of the online space science data research project, and the users operating the second devices 12 are collaborators in the online space science data research project.

[0046] In some embodiments, the online collaborative analysis method for space science experimental data provided in this invention can be executed by an online collaborative analysis system 100 for space science experimental data (hereinafter referred to as the online collaborative analysis system 100).

[0047] As an example, the online collaborative analysis system 100 can be any electronic device 200 with data processing capabilities, such as a general-purpose computer, personal computer, laptop computer, switch, or tablet computer. The specific implementation method of the online collaborative analysis system 100 is not limited here.

[0048] Figure 2 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present invention is shown. The electronic device 200 includes a processor 210, a memory 220, and a communication interface 230.

[0049] Processor 210 may include one or more processing cores. Processor 210 connects to various parts within electronic device 200 using various interfaces and lines, and performs various functions and processes data of electronic device 200 by running or executing instructions, programs, code sets, or instruction sets stored in memory 220, and by calling data stored in memory 220. Optionally, processor 210 may be implemented using at least one of the following hardware forms: Central Processing Unit (CPU), Graphics Processing Unit (GPU), Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), and Programmable Logic Array (PLA).

[0050] The memory 220 may include random access memory (RAI) or read-only memory (ROI). Optionally, the memory 220 may include non-transitory computer-readable storage ledger. The memory 220 may be used to store instructions, programs, code, code sets, or instruction sets. The memory 220 may include a stored program area. The stored program area may store instructions for implementing an operating system, instructions for implementing at least one function (such as project management functions, collaboration management functions, and sharing and publishing functions), and instructions for implementing the various method embodiments described above.

[0051] The communication interface 230 is used to communicate with other devices, equipment, or communication networks, such as data storage devices, image processing devices, or Ethernet, wireless access networks (RAN), wireless local area networks (WLAN), etc.

[0052] In terms of physical implementation, the aforementioned devices (such as processor 210, memory 220, and communication interface 230) can each be devices within the same device (such as a laptop computer). Alternatively, at least two of these devices can be located within the same device, i.e., as different devices within the same device, similar to the deployment of devices or components in a distributed system.

[0053] It is understood that the structure illustrated in this embodiment does not constitute a specific limitation on the electronic device 200. In other embodiments of the present invention, the electronic device 200 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0054] The following description, in conjunction with the accompanying drawings, illustrates an online collaborative analysis method for space science experimental data provided by an embodiment of the present invention.

[0055] Figure 3 This is a flowchart illustrating an online collaborative analysis method for space science experimental data provided in an embodiment of the present invention. Optionally, this method can be... Figure 1 The online collaborative analysis system 100 shown is executed by, that is, by Figure 2 The illustrated electronic device 200 performs this operation. The method may include the following steps:

[0056] S1. In response to the project creation request sent by the first device, create an online research project for space science data. The online research project for space science data is used to determine the target results.

[0057] Specifically, for complex research projects requiring multiple participants, teams can use project management tools to better conduct data science research. Before the first device sends a project creation request to the online collaborative analysis system, the user of the first device can create a new task plan, dividing the space science data research project into multiple tasks, each including multiple sub-tasks. The user of the first device can then distribute the sub-tasks, and each sub-task can be further specified as an online research project (space science data online research project) to be carried out, enabling the collaborative team to jointly complete complex research projects.

[0058] like Figure 5 As shown, the space science data research project A includes research task A1, research task A2, and research task A3. Research task A2 includes research sub-task A. 21 Research Subtask A 22 and research subtask A 23 Each research subtask corresponds to an online research project (Space Science Data Online Research Project). That is, Research Subtask A... 21 Corresponding online research project A 21 Research subtask A 22 Corresponding online research project A 22 Research subtask A 23 Corresponding online research project A 23 .

[0059] For example, the online research project on space science data in S1 above corresponds to research sub-task A. 21 Research Subtask A 22 and research subtask A 23 one of the.

[0060] It should be noted that a space science data research project may include multiple tasks, each task may include multiple sub-tasks, and each sub-task may include an even greater number of sub-tasks. The above division of the levels of space science data research projects is only an illustrative example. The embodiments of the present invention do not impose any particular limitation on the specific number of task levels included in a space science data research project.

[0061] Specifically, the Space Science Data Online Research Project (hereinafter referred to as the Project) is a user's space science data analysis content management unit. Each Project brings together the code, data, required operating environment, and output results of the analysis process. Users can use this function to manage and share various information needed for research and analysis as well as the output results of research and analysis in an integrated manner, which facilitates communication and cooperation.

[0062] The target outcome of the online space science data research project includes multiple sub-outcomes, each configured with different identification information; and the project creation request carries the operating environment information.

[0063] For example, a project creation request may also include basic project information, including: Project Name (to name the project); Project Description (a brief description of the project); Tags (users can add tags to projects during creation to categorize them for easier filtering later; only one tag can be added to a project, and tags support multi-level structures); and Data Source (users can attach the data they will use when creating the project).

[0064] In one possible implementation, the identification information for each sub-result includes ID information and attribute information of the space science experiment, wherein the attribute information includes experiment ID, sub-result type, device number, and timestamp.

[0065] When sub-result A is obtained based on data A, the sub-result types correspond to different standard process stages of space science experimental data analysis, such as preprocessing, data correction, algorithm model training, and result verification. The equipment number is associated with the on-orbit experimental cabinet that generated data A, and the timestamp is used to characterize the time when data A was generated.

[0066] In this way, the method provided by the present invention can solve the traceability problem of parallel data acquisition by multiple devices and cross-validation of data in multiple stages during space science experiments. For example, when sub-result A is abnormal, the source of data A can be quickly located through the identification information, so as to realize the rapid and accurate identification of abnormal data and improve processing efficiency.

[0067] In some embodiments, users can upload existing ".ipynb" format files locally for subsequent code work.

[0068] Once a project is created, the user of the first device can send a request to the online collaborative analysis system to view the project they created in the workbench. After entering the project details page, the user can view the project content, run the project, modify the project attributes, share the project, or choose to delete the project.

[0069] In one example, the project details page includes project content and project data.

[0070] The project content encompasses the user's modeling process, allowing them to view the specific code. It supports three modes: Notebook interactive programming, graphical drag-and-drop programming, and Web IDE. See also... Figure 4a , Figure 4a The interactive programming interface of the Notebook shown consists of multiple "programming units" (cells). A cell is the smallest unit of content writing in the Notebook, and each cell can run independently, with a one-to-one correspondence between input and output. Reusable code snippets can be saved for later analysis with a single click. See also... Figure 4b , Figure 4b The graphical drag-and-drop programming interface shown allows for zero-code modeling using encapsulated components of common machine learning algorithms. Each component has fixed instructions, acting as a processor to handle data processing and application at each stage, including basic structures such as input data, parameters, and output results. Users can create projects by dragging and dropping components on a canvas, or flexibly customize components to implement the entire process from data reading to result output. Common modeling workflows can be saved as fixed workflows for quick reuse later. Graphical programming projects can be converted into Notebook programming projects, with one component corresponding to one code cell, and the cell order corresponding to the component execution order. See also... Figure 4c , Figure 4c The Web IDE shown provides code-level programming tools in the form of a web-based integrated development environment, supporting online development in programming languages ​​such as Python, Java, C, C++, Fortran, and R.

[0071] The project data will display a list of data attached to the project. Clicking on an item will show an overview of the data and related files. It supports previewing file types such as ".txt", ".csv", ".jpg", ".png", ".mp4", ".mkv", and ".json", helping users gain a preliminary understanding of the data before analysis.

[0072] It should be understood that the above implementation of the project details page is only an illustrative example, and the embodiments of the present invention do not impose any special restrictions on the specific implementation of the project.

[0073] S2. In response to the analysis request of the online research project on space science data sent by the second device, schedule the environment image and computing resources according to the operating environment information to create the operating environment.

[0074] The runtime environment is configured with multiple functional components and is a cloud-based runtime environment.

[0075] Specifically, the runtime environment is configured with multiple functional components, providing software environment support for project operation. The online collaborative analysis system is configured with various data analysis and machine learning toolkits based on the pre-set runtime environment. These runtime environments all share the same operating system and the same versions of functional components.

[0076] In one possible implementation, the method provided by the embodiments of the present invention further includes:

[0077] In response to the instruction for a custom runtime environment input by the second device, which carries information about custom functional components, the custom functional components are incrementally installed on the runtime environment to generate a custom runtime environment; in response to the online analysis operation sent by the second device, the target sub-result is determined based on the multiple functional components configured in the custom runtime environment.

[0078] This can also be understood as users of the second device maintaining their own runtime environment through custom images, and new images can be built based on the existing runtime environment, eliminating the need for duplicate installations of some packages. Users can create images by adding toolkits; currently, it supports installing Python 3, Python 2, R, Julia 1.0, and Julia 1.5.

[0079] In some embodiments, the project creation request also carries resource configuration information.

[0080] The resource configuration information includes computing resources that provide the hardware environment support for project operation. Users of the second device can view the computing resources they can use, such as different specifications like an 8-core CPU with 32GB of memory, a 16-core CPU with 64GB of memory, etc., as well as whether it includes a GPU, and information such as the computing instances currently running under the resources, offline tasks, and the duration of a single use.

[0081] In one possible implementation, if existing computing resources are insufficient to meet data analysis needs, the user of the second device can apply to the user of the first device for more resource usage rights through an online collaborative analysis system. The user selects the required computing resources and corresponding duration, fills in the reason for the application, and submits the application form. In response to the resource expansion confirmation operation of the first device, the online collaborative analysis system expands the corresponding computing nodes for the second device to meet the data analysis needs.

[0082] For example, such as Figure 6 As shown, after the user selects the environment image and computing resources, the request is sent to the online collaborative analysis system. The online collaborative analysis system maintains a resource pool consisting of multiple nodes (which may include CPU nodes and GPU nodes), schedules nodes that meet the configuration from the resource pool to provide computing services to the user, and automatically runs the runtime environment selected by the user.

[0083] Optionally, the method provided in this embodiment of the invention further includes:

[0084] The computing resources corresponding to the operating environment are determined based on the resource configuration information; when the target sub-result is determined in response to the operation of multiple functional components configured by the second device on the operating environment, the computing resource utilization rate corresponding to the second device is determined; if the computing resource utilization rate is greater than or equal to a first threshold, an application is made to the resource pool to expand the computing nodes, the resource pool including multiple computing nodes, the type of the computing nodes matching the hardware architecture of the operating environment; if the computing resource utilization rate is less than a second threshold and continues for a preset duration, idle computing nodes are released to the resource pool.

[0085] This invention can also be understood as follows: The method provided by this invention supports dynamic switching of computing resources and environment images during project operation, instantly meeting project operation requirements. During project operation, users can view information such as current available time, CPU usage, memory usage, and disk usage in the monitoring panel. When memory usage or disk usage (storage resource utilization) exceeds 80% (the first threshold), the online collaborative analysis system will trigger an alert to prevent memory overflow and other situations that could lead to project failure. Users can also view the historical usage of the project, including historical usage of CPU, memory, disk I / O, and network I / O. Users can precisely pinpoint resource changes at specific moments to gain a more detailed and comprehensive understanding of the instance's operating status, providing a basis for selecting more suitable computing specifications.

[0086] To ensure effective resource allocation and utilization, the duration of each project run is limited to X hours. After X hours, the resources will automatically disconnect, with X set by the user of the first device. This limitation is to prevent users from consuming computing resources due to forgetting to close the runtime interface. When 10 minutes remain in the single run, the online collaborative analysis system will notify the user of the second device that there is insufficient time remaining. If the user of the second device is performing a time-consuming task, they can manually extend the available single run duration.

[0087] When the user of the second device closes their research project, the online collaborative analysis system automatically releases computing resources, allowing these resources to serve other users and business needs, thus improving computing resource utilization and reusability. The online collaborative analysis system supports two operating modes: fixed resource pool and dynamic resource pool. When multiple users are using the system and the resource request volume exceeds the existing resources in the cluster: In fixed mode, the online collaborative analysis system provides an automatic queuing mechanism to reduce task waiting time and maximize resource utilization under a fixed resource supply, efficiently supporting data analysis and processing for various users. In dynamic mode, the online collaborative analysis system sets thresholds 1 and 2. If the total resources occupied by the currently running project / the total resource pool size > threshold 1, an automatic expansion mechanism is triggered, adding computing nodes to the resource pool. If the total resources occupied by the currently running project / the total resource pool size < threshold 2, an automatic shrinkage mechanism is triggered, removing computing nodes from the resource pool.

[0088] In one possible implementation, the project creation request also carries permission information for each of the multiple second devices, S2 mentioned above, including:

[0089] In response to the analysis request for the online research project of space science data sent by the second device, determine whether the second device has online analysis permission for the online research project of space science data based on the permission information;

[0090] If the second device has online analysis permissions for space science data online research projects, an operating environment is created based on the operating environment information.

[0091] In one example, the first device displays as follows: Figure 7a The task planning interface shown above allows you to access specific tasks and see features such as... Figure 7b The project dashboard shown above displays all planned tasks and their statuses. New tasks can be created with a name and deadline, and will appear on the project dashboard upon completion. Figure 7c As shown, on the task details page, users can edit task details, communicate in the discussion area, share attachments as supplementary information, and finally upload and summarize the task results.

[0092] Users on the first device can invite members to jointly maintain task planning by adding collaborators. Users on the first device can add collaborators individually (that is, configure corresponding permissions for different second devices, such as task modification permissions and task viewing permissions), or add them in batches by group. If the members of the selected group (users on different second devices) change (members leave or are added), the scope of users on the first device will be updated synchronously.

[0093] The following example illustrates the permission information of the first and second devices in this embodiment of the invention. The permissions for task planning are divided into two types: Collaborator (user of the second device): Can access the content in the task planning, create tasks, edit tasks, and access the knowledge base. Administrator (user of the first device): In addition to having "collaborator" permissions, also has the ability to adjust member permissions and add / edit task deliveries.

[0094] If a member (on any second device) has left the project group, the creator (on the first device) can remove them directly. If the member (on any second device) joined the collaborator list via group synchronization, the creator can remove the user (on any second device) from the synchronized group, thus removing the user.

[0095] S3. In response to the online analysis operation sent by the second device, determine the target sub-result based on multiple functional components configured in the operating environment. The target sub-result is one of multiple sub-results.

[0096] In some embodiments, the online collaborative analysis system is also configured with multiple space science experiment data sources, including local datasets, databases, object storage, and NAS space; S3 above includes: in response to an online analysis operation sent by the second device, acquiring space science experiment data from the space science experiment data sources; and determining target sub-results based on multiple functional components configured in the operating environment and the space science experiment data.

[0097] The following example illustrates the process by which a user determines a target sub-result through a second device in an embodiment of the invention.

[0098] Specifically, research tasks are carried out through online research projects. The platform provides code-level collaboration features, allowing multiple second devices to be added to a project, enabling multiple users on multiple second devices to collaboratively solve data science problems and obtain the desired results.

[0099] Specifically, the second device can create a new project (sub-project) in the online collaborative analysis system with the same content as the selected version of the forked project (Online Research Project of Space Science Data). This creates a copy of the Online Research Project of Space Science Data, allowing users to edit and modify the target results or any sub-results within those results. All attachment files (generated results) from the parent project (Online Research Project of Space Science Data) are automatically imported, and users can view the attachment content (e.g., any sub-result included in the target results) through the corresponding directory in the file tree when running the project.

[0100] It's important to note that project versioning is fundamental for systematic project management, sharing, and collaboration. It facilitates sharing and collaboration: When a project hasn't generated any versions, only the creator can view its content. Generating versions makes the project content previewable, allowing for sharing and public release. It records progress: During data analysis, multiple versions can be generated to save content from different stages. Multiple versions of the same project can be generated, and content can be compared and replaced between versions. Users' solutions and actual progress at each stage can be preserved through versioning. At this point, organizational users with viewing permissions for the project can see the corresponding version's content.

[0101] In some embodiments, the method provided by the present invention further includes:

[0102] In response to a request from the second device to read the results of an online research project on space science data, determine whether the second device has permission to read the results of an online research project on space science data based on the permission information.

[0103] If the second device has permission to read the results of the online space science data research project, send the target results corresponding to the online space science data research project to the second device.

[0104] Based on online projects and version control, multi-user project collaboration can be carried out.

[0105] Specifically, the first device can share a project with multiple members within the organization by adding multiple second devices, allowing them to share project content and collaborate on code. Each user on a second device has the following three types of permissions:

[0106] View Only: Only allows browsing of project content; content cannot be copied or reproduced via online forking (generating a copy) or downloading. Forkable: Allows viewing and forking of the project. Collaborative: Allows viewing and forking of the project, and also allows submitting merge requests for content collaboration.

[0107] Optionally, project collaboration is limited to members within the organization. If you need to share project content with members outside the organization, you can use the project sharing feature. Select the project version you want to share to generate a sharing link, which can be password-protected. After sharing the link, external users can view the project content.

[0108] S4. In response to the result update request sent by the second device, the result update request carries the identification information of the target sub-result, and the target result is updated according to the identification information of the target sub-result.

[0109] It should be noted that the online collaborative analysis system can also respond to analysis requests from the first device for online space science data research projects, creating an operating environment based on the operating environment information. The online collaborative analysis system can also respond to online analysis operations sent by the first device, determining target sub-results based on multiple functional components configured in the operating environment. Furthermore, the online collaborative analysis system can respond to result update requests sent by the first device, updating the target result based on the identifier information of the target sub-results. In other words, the first device can also perform all the functions of the second device mentioned above. The distinction between the first and second devices is merely for illustrative purposes; that is, the user of the first device is the manager of the online space science data research project, and the user of the second device is a collaborator in the online space science data research project.

[0110] Specifically, the target results are the interim outcomes of the current online space science data research project, including processed data files, trained model files, and other file types. These target results will be published for future viewing and reproduction by users of the first or second equipment.

[0111] The target results can be integrated and managed using knowledge bases and algorithm libraries.

[0112] The knowledge base uses a tree structure to organize various types of content, helping users gather and organize personal and organizational resources. It enables the organization and sharing of projects, data, and other content within the knowledge base. Each research task has its own knowledge base, supporting the uploading of various formats of research materials, including projects, data, files, videos, and external links, to assist team research. Administrators can sort, add, and delete content, and categorize it using folders. Members can view and download knowledge base content, run project code, and create projects using data.

[0113] Using the algorithm library, users can manage the algorithm models produced in their research work, enabling the organization, sharing, and reuse of these models. Users can edit, delete, and authorize algorithms. Model files support parsing and visualization of their structure, and support frameworks including ONNX (.onnx, .pb, .pbtxt), Keras (.h5, .keras), CoreML (.mlmodel), MXNet (.model), Caffe (.caffemodel, .prototxt), PyTorch (.pth), Torch (.t7), CNTK (.model, .cntk), Darknet (.cfg), scikit-learn (.pkl), TensorFlow Lite (.tflite), TensorFlow.js (.pb), and TensorFlow (.pb, .meta, .pbtxt).

[0114] In one possible implementation, the result update request also carries a version number of the target sub-result, and updates the target result based on the identification information of the target sub-result, including:

[0115] If no data is stored at the storage location corresponding to the identifier information of the target sub-result, store the target sub-result and its version number at the storage location corresponding to the identifier information of the target sub-result; if data is already stored at the storage location corresponding to the identifier information of the target sub-result, determine the version number of the stored data; if the version number of the stored data is less than the version number of the target sub-result, store the target sub-result and its version number at the storage location corresponding to the identifier information of the target sub-result.

[0116] In some embodiments, the method provided by the present invention further includes:

[0117] If at least two second devices are received to update the result of the same sub-result, update conflict information is sent to the first device, which carries the identification information of each of the at least two second devices and the sub-result; in response to the conflict resolution instruction sent by the first device, the conflict resolution instruction carries the identification information of a third device, which is one of the at least two second devices; the target result is updated according to the sub-result corresponding to the third device.

[0118] In some embodiments, the method provided by the present invention further includes:

[0119] Upon receiving result update requests from at least two second devices for different sub-results, an update request message is sent to the first device, the update request message carrying the identification information of each of the at least two second devices and the different sub-results; in response to the result update instruction sent by the first device, the target result is updated according to the sub-results corresponding to the two second devices respectively.

[0120] Specifically, users can run sub-projects on the second device to perform code editing, committing, and merging operations. Users can handle merge requests in the parent project via the first device, such as... Figure 8 As shown.

[0121] Specifically, submitting a merge request: After a sub-project is updated, the update can be sent to the parent project via "Submit Merge". A merge request can be actively withdrawn. Collaborators can see the processing result of the request. Collaborators will receive a notification when the merge request is approved or rejected. Processing merge requests: The parent project creator can process merge requests and compare the modified content. The differences between the sub-project and the parent project are visually displayed (modified parts are highlighted), allowing users to view each modification individually. Modifications can be accepted or rejected individually or in batches. After completion, the new version of the sub-project will be merged into the parent project, and all collaborators in the project can then access the relevant modifications by checking for updates. Checking updates: When the parent project generates a new version, the platform will trigger a "Source Project Update Reminder" for all collaborators, allowing them to pull the latest content. Upon acceptance, the current workspace content of the sub-project will be replaced with the latest version content of the parent project, and a new version record will be generated to record this modification. In the version list tab, users can compare different versions of the project and visually view the differences between them. Version comparison allows users to see the differences between each version and the current workspace. For each modification, users can replace the content edited in the current runtime with the content from the selected version, thus achieving code-level rollback. Users can also completely replace the content edited in the current runtime with the content from a specific historical version.

[0122] The following example illustrates the application scenario of the method provided in this embodiment of the invention. In one example, taking a collaborative development scenario involving a small team of two people, the workflow of project leader A (first device) and member B (second device) is as follows: Figure 9 As shown.

[0123] S41. The first device creates a project, debugs it online, generates a version, and records the project's associations.

[0124] S42. In response to the operation input by project leader A, the first device shares the project with other members within the organization (the second device), sharing project content and collaborating on code. During sharing, the project's mirror and data can also be shared. After obtaining project permissions, the second device can see the collaborative project (P) in its workspace, generate a project copy (sub-project) (P') via fork, and support running the code using the same analytics environment.

[0125] Optionally, the first device can share the project via a project link. Copy the project URL link and send it to collaborators. It also supports adding collaborators in batches via group synchronization, enabling bulk content distribution. If group members change (members leave or are added), the collaborator scope will be updated accordingly. If a member has left the project group, the creator can remove them directly.

[0126] Optionally, to fully reproduce the project on a second device, you need to use the data, computing power, and images that the project depends on. If you do not yet have the relevant permissions, you can apply for them at the time of forking.

[0127] S43. The second device runs the project and enters the programming interface to modify the content (P'). After completing the code writing, a version of the current content is generated. At the same time, the first device (or another second device) can continue to edit the project (P), and their work is not affected.

[0128] S44. After the second device generates a version, it can submit a merge request, that is, request to merge the latest version of project P' into the source project P. The first device, in project P, processes the merge request (accepting or rejecting modifications), supporting batch acceptance / rejection. The platform will highlight content differences to help the first device compare and integrate updated content.

[0129] Optionally, the second device can pull the latest content of project P by checking for updates (S45) before submitting the merge, and then submit it after incorporating the latest adjustments.

[0130] S45. After the first device completes the content review, the platform will automatically generate a version for this operation and send a project update reminder to the second device. Before the second device modifies the content (P') again, it will first fetch the latest content to avoid subsequent merge conflicts.

[0131] In one possible implementation, the method provided by the embodiments of the present invention further includes: generating a traceability chain corresponding to each identifier based on the identifier information of each sub-result after updating.

[0132] For example, when the second device updates the "Space Radiation Dose Sub-Result SRD-5", the system automatically generates a traceability chain based on the device number and calibration parameters associated with the identification information. The traceability chain is as follows: [Original Data (Sensor 02, 2024-05-10 12:00) → Calibration Processing (Toolkit 6.0) → Sub-Result SRD-005 (Version V2) → Target Result (Space Radiation Dose Measurement Module Data Update)];

[0133] The method provided in this invention can perform one-click backtracking through the traceability chain. If abnormal results are found later, the traceability chain can quickly locate whether the abnormality is due to abnormal original data or incorrect calibration parameters, which can effectively improve processing efficiency and achieve rapid and accurate backtracking of abnormal data.

[0134] As described in S1-S4 above, the method provided by this embodiment of the invention creates an online research project for space science data to determine the target result. In response to analysis requests from multiple second devices for the online research project, it creates a runtime environment configured with multiple functional components based on runtime environment information. In response to online analysis operations from multiple second devices, it determines different sub-results based on the multiple functional components configured in the runtime environment. In response to result update requests from each second device, it updates the target result based on the identifier information of each second device's sub-result. The method provided by this invention can quickly and accurately complete the online processing and analysis of complex scientific tasks in multi-person collaborative processing scenarios, efficiently utilize space science experimental data, and effectively improve data processing and analysis efficiency.

[0135] In other words, the technical solution provided by this invention enables online analysis and collaborative processing of large-scale, multi-domain, and multi-type space science experimental data, thereby supporting the research needs of complex space science experimental tasks. On the one hand, it improves the efficiency of space science experimental data processing and strengthens research collaboration capabilities. Through online collaborative analysis methods, researchers can quickly and accurately decompose complex research tasks, enabling multiple teams to collaborate online, significantly shortening the data processing cycle and improving research efficiency. This invention supports multiple users collaborating on the same research project, achieving fine-grained permission management and project version control, allowing research teams to efficiently solve problems and share results. On the other hand, this invention optimizes computing resource allocation and reduces research costs. The online collaborative analysis system automatically schedules computing resources according to user needs, constructing an online research environment, effectively solving the problem of limited computing resources in traditional data processing methods, and improving the utilization and reusability of computing resources. This invention avoids the cumbersome process of building an analysis environment locally in traditional research, allowing researchers to focus on data processing and analysis.

[0136] To facilitate understanding of this solution, an example is provided below to illustrate the method provided by this invention. The purpose of this method is to enable research teams to more easily collaboratively process and analyze complex space science data (such as space life science data, space materials science data, etc.). The entire solution is like an "online collaborative laboratory" specifically designed for scientists, providing a complete toolchain from project creation to final result sharing. First, project creation begins. The user (administrator) operating the first device sends a request to the online collaborative analysis system to create a dedicated online research project, much like establishing a virtual laboratory. This "laboratory" not only includes a standard project name and description but also allows users to categorize and manage projects using tags (e.g., labeled "Space Life Science Experimental Data Analysis"). The online collaborative analysis system offers three programming methods: interactive programming similar to Jupyter Notebook (suitable for data exploration), graphical drag-and-drop programming (suitable for visual workflow design), and a web-based code editor (suitable for professional programmers). Projects can directly connect to various data sources, including local experimental data, research databases, and even cloud storage.

[0137] Then, the online collaborative analysis system can manage project resources. Users operating the second device (collaborators) can choose standardized "packages" (images) pre-installed with commonly used tools (such as Python / R), or they can customize the environment. They can add toolkits through a simple interface, configure them finely using command-line scripts, or even install software directly in the code and save it as a new image for later use. Regarding hardware resources, the online collaborative analysis system automatically allocates CPU / GPU computing nodes and releases resources immediately after use. When multiple users simultaneously cause resource shortages, the online collaborative analysis system has two coping strategies: automatic queuing and dynamic addition or removal of online collaborative analysis system nodes (automatic scaling up and down of computing nodes). Users operating the first device (administrators) can break down large projects into a tree-like task structure (task → subtask) and track progress on a shared Kanban board. When adding users operating the second device (collaborators), it supports batch addition of the entire research group and allows fine-grained control over the permissions of each user operating the second device (such as read-only or editable). A version control feature similar to GitHub was specifically designed: users operating the second device (collaborators) can "fork" project copies and modify them independently. They can then synchronize these changes back to the main project via a "merge request." The online collaborative analysis system automatically marks code differences and helps resolve conflicts. Any version can be reviewed and compared at any time, even down to the replacement of a single line of code. Finally, the target results (processed data, trained AI models, analysis reports, etc.) obtained by multiple users operating the second device (collaborators) are stored in the "knowledge repository" of the online collaborative analysis system. Algorithm models are managed separately as a reusable "toolbox," which can be directly accessed by other teams later. The online collaborative analysis system also has a dedicated multi-format database, which can store not only regular documents but also manage video materials and external reference links, forming a complete project knowledge graph.

[0138] The foregoing mainly describes the solutions of the embodiments of the present invention from a methodological perspective. It is understood that, in order to achieve the above-mentioned functions, the online collaborative analysis system 100 includes at least one of the hardware structures and software modules corresponding to the execution of each function. Those skilled in the art should readily recognize that, in conjunction with the units and algorithm steps of the various examples described in the embodiments disclosed herein, the embodiments of the present invention can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed in hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the embodiments of the present invention.

[0139] In this embodiment of the invention, the online collaborative analysis system 100 can be divided into functional units according to the above method example. For example, the online collaborative analysis system 100 can be divided into functional units corresponding to various functions, or two or more functions can be integrated into one processing unit. The integrated unit can be implemented in hardware or as a software functional unit. It should be noted that the unit division in this embodiment is illustrative and only represents one logical functional division; other division methods may be used in actual implementation.

[0140] For example, Figure 10 A schematic diagram of the hardware structure of an online collaborative analysis system provided by an embodiment of the present invention is shown. The online collaborative analysis system 100 includes: a project creation module 110, used to create an online research project on space science data in response to a project creation request sent by a first device. The online research project on space science data is used to determine a target result, and the target result of the online research project on space science data includes multiple sub-results, each of which is configured with different identification information; the project creation request carries runtime environment information; a mirror creation module 120, used to create a runtime environment by scheduling an environment mirror and computing resources according to the runtime environment information in response to an analysis request for the online research project on space science data sent by a second device, and the runtime environment is configured with multiple functional components; a result iteration module 130, used to determine a target sub-result based on the multiple functional components configured in the runtime environment in response to an online analysis operation sent by the second device, and the target sub-result is one of the multiple sub-results; and a result update module 140, used to update the target result according to the identification information of the target sub-result in response to a result update request sent by the second device.

[0141] In some embodiments, the online collaborative analysis system 100 further includes a task management module 150, which is used to perform management operations on space science data research topics in response to task management instructions sent by the first device. The management operations include adding or deleting space science data research tasks or sub-tasks, and the management operations also include creating, modifying or deleting online research projects included in space science data research tasks or sub-tasks.

[0142] In other embodiments, the online collaborative analysis system 100 further includes an outcome management module 160, which is used to respond to an outcome management instruction sent by a first device. The outcome management instruction includes editing the final target result generated by the online research project and sending the target result to any second device. It also includes running the code or program corresponding to the target result to realize the function corresponding to the target result.

[0143] It should be understood that specific descriptions of the above-mentioned optional methods can be found in the foregoing method embodiments, and will not be repeated here. Furthermore, explanations of any of the online collaborative analysis systems 100 provided above, as well as descriptions of their beneficial effects, can be found in the corresponding method embodiments described above, and will not be repeated here.

[0144] This invention also provides a computer-readable storage medium storing at least one computer instruction, which is loaded and executed by a processor to implement the methods of the various embodiments described above. Explanations of the relevant content and descriptions of the beneficial effects of any of the computer-readable storage media provided above can be found in the corresponding embodiments described above, and will not be repeated here.

[0145] This invention also provides a chip. This chip integrates a control circuit for implementing the functions of the online collaborative analysis system 100 described above, and one or more ports. Optionally, the functions supported by this chip are as described above, and will not be repeated here.

[0146] Those skilled in the art will understand that the program for implementing all or part of the steps of the above embodiments, which can be executed by a program instructing related hardware, can be stored in a computer-readable storage medium. The storage medium mentioned above can be a read-only memory, a random access memory, etc. The processing unit or processor mentioned above can be a central processing unit, a general-purpose processor, an application-specific integrated circuit (ASIC), a microprocessor (DSP), a field-programmable gate array (FPGA), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof.

[0147] This invention also provides a computer program product containing instructions that, when executed on a computer, cause the computer to perform any of the methods described in the above embodiments. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the flow or function according to the embodiments of this invention is generated. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, computer instructions may be transmitted from one website, computer, online collaborative analytics system, or data center to another via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium may be any available medium accessible to a computer or a data storage device such as an online collaborative analytics system or data center that integrates one or more available media. The available medium may be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., SSD), etc.

[0148] It should be noted that the devices for storing computer instructions or computer programs provided in the embodiments of the present invention, such as, but not limited to, the aforementioned memory, computer-readable storage medium, and communication chip, are all non-transitory. Those skilled in the art should recognize that the functions described in the embodiments of the present invention in one or more of the above examples can be implemented using hardware, software, firmware, or any combination thereof. When implemented using software, these functions can be stored in a computer-readable storage medium or transmitted as one or more instructions or code on a computer-readable storage medium. Computer-readable storage media include computer storage media and communication media, wherein communication media include any medium that facilitates the transmission of computer programs from one place to another. Storage media can be any available medium accessible to general-purpose or special-purpose computers.

[0149] Although embodiments of the present invention have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present invention. Those skilled in the art can make changes, modifications, substitutions and variations to the above embodiments within the scope of the present invention.

Claims

1. A method for online collaborative analysis of space science experimental data, characterized in that, The method, applied to an online collaborative analysis system that communicates with a first device and multiple second devices, includes: In response to a project creation request sent by the first device, an online research project for space science data is created. The online research project for space science data is used to determine the target result. The target result of the online research project for space science data includes multiple sub-results, each of which is configured with different identification information. The project creation request carries operating environment information. In response to the analysis request of the online research project of space science data sent by the second device, the environment mirror and computing resources are scheduled according to the operating environment information to create an operating environment, which is configured with multiple functional components; In response to the online analysis operation sent by the second device, a target sub-result is determined based on multiple functional components configured in the operating environment, wherein the target sub-result is one of the multiple sub-results; In response to a result update request sent by the second device, wherein the result update request carries the identification information of the target sub-result, the target result is updated according to the identification information of the target sub-result; The project creation request also carries permission information for each of the plurality of second devices; The step of responding to the analysis request of the online space science data research project sent by the second device, and creating an operating environment based on the operating environment information, includes: In response to the analysis request of the online research project of space science data sent by the second device, it is determined whether the second device has online analysis permission for the online research project of space science data based on the permission information; If the second device has online analysis permissions for the online research project of space science data, an operating environment is created based on the operating environment information; The project creation request also carries resource configuration information, and the method further includes: The computing resources corresponding to the operating environment are determined based on the resource configuration information. When the target sub-result is determined in response to the operation of multiple functional components configured by the second device on the operating environment, the computing resource utilization rate corresponding to the second device is determined; If the computing resource utilization rate is greater than or equal to a first threshold, an application is made to the resource pool to expand the computing nodes. The resource pool includes multiple computing nodes, and the type of the computing nodes matches the hardware architecture of the operating environment. If the computing resource utilization rate is less than the second threshold and continues for a preset duration, the idle computing nodes are released to the resource pool. The method further includes: If at least two second devices are received to update the result of the same sub-result, update conflict information is sent to the first device, wherein the update conflict information carries the identification information and sub-result of each of the at least two second devices; In response to a conflict resolution instruction sent by the first device, the conflict resolution instruction carries identification information of a third device, which is one of the at least two second devices; The target result is updated based on the sub-result corresponding to the third device.

2. The method according to claim 1, characterized in that, The method further includes: In response to the result reading request of the online space science data research project sent by the second device, determine whether the second device has the permission to read the result of the online space science data research project according to the permission information; If the second device has permission to read the results of the online space science data research project, the target results corresponding to the online space science data research project are sent to the second device.

3. The method according to claim 2, characterized in that, The online collaborative analysis system is also equipped with a variety of space science experiment data sources, including local datasets, databases, object storage, and NAS space. In response to the online analysis operation sent by the second device, based on multiple functional components configured in the operating environment, the target sub-result is determined, including: In response to the online analysis operation sent by the second device, space science experiment data is obtained from the space science experiment data source; Based on the multiple functional components configured in the operating environment, the target sub-results are determined according to the space science experiment data.

4. The method according to claim 1, characterized in that, The method further includes: In response to a custom runtime environment instruction input by a second device, the instruction carrying custom functional component information, the custom functional components are incrementally installed on the runtime environment to generate a custom runtime environment; In response to the online analysis operation sent by the second device, the target sub-result is determined based on multiple functional components configured in the custom operating environment.

5. The method according to claim 4, characterized in that, The result update request also carries the version number of the target sub-result, and updating the target result according to the identification information of the target sub-result includes: If no data is stored in the storage location corresponding to the identifier information of the target sub-result, the target sub-result and its version number are stored in the storage location corresponding to the identifier information of the target sub-result. If data has already been stored in the storage location corresponding to the identification information of the target sub-result, determine the version number of the stored data; If the version number of the stored data is less than the version number of the target sub-result, the target sub-result and its version number are stored in the storage location corresponding to the identifier information of the target sub-result.

6. An online collaborative analysis system for space science experimental data, characterized in that, The system communicates with a first device and multiple second devices respectively, and the system includes: The project creation module is used to create an online research project for space science data in response to a project creation request sent by the first device. The online research project for space science data is used to determine the target result. The target result of the online research project for space science data includes multiple sub-results, each of which is configured with different identification information. The project creation request carries operating environment information. The image creation module is used to respond to the analysis request of the online research project of space science data sent by the second device, schedule the environment image and computing resources according to the operating environment information, and create an operating environment, wherein the operating environment is configured with multiple functional components; The result iteration module is used to respond to the online analysis operation sent by the second device, and determine the target sub-result based on multiple functional components configured in the operating environment, wherein the target sub-result is one of the multiple sub-results; The result update module is used to respond to a result update request sent by the second device, wherein the result update request carries the identification information of the target sub-result, and updates the target result according to the identification information of the target sub-result; The project creation request also carries permission information for each of the plurality of second devices; the image creation module is specifically used for: In response to the analysis request of the online research project of space science data sent by the second device, it is determined whether the second device has online analysis permission for the online research project of space science data based on the permission information; If the second device has online analysis permissions for the online research project of space science data, an operating environment is created based on the operating environment information; The project creation request also carries resource configuration information, and the image creation module is further used for: The computing resources corresponding to the operating environment are determined based on the resource configuration information. When the target sub-result is determined in response to the operation of multiple functional components configured by the second device on the operating environment, the computing resource utilization rate corresponding to the second device is determined; If the computing resource utilization rate is greater than or equal to a first threshold, an application is made to the resource pool to expand the computing nodes. The resource pool includes multiple computing nodes, and the type of the computing nodes matches the hardware architecture of the operating environment. If the computing resource utilization rate is less than the second threshold and continues for a preset duration, the idle computing nodes are released to the resource pool. The result update module is also used for: If at least two second devices are received to update the result of the same sub-result, update conflict information is sent to the first device, wherein the update conflict information carries the identification information and sub-result of each of the at least two second devices; In response to a conflict resolution instruction sent by the first device, the conflict resolution instruction carries identification information of a third device, which is one of the at least two second devices; The target result is updated based on the sub-result corresponding to the third device.

7. An electronic device, characterized in that, include: processor; Memory used to store the processor's executable instructions; The processor is configured to execute the instructions to implement the online collaborative analysis method for space science experimental data as described in any one of claims 1-5.

Images