A data processing method and device for simulation data management

Abstract

The present invention discloses a data processing method and device for simulation data management, which includes: acquiring simulation data information; performing data integration processing on the simulation data information to obtain target simulation processing information; and performing distributed processing on the simulation data information and the target simulation processing information to obtain target simulation management data information.

Description

Technical Field

[0001] The present invention relates to the field of simulation technology, and in particular to a data processing method and device for simulation data management. Background Art

[0002] In the simulation field, with the increasing frequency of simulation activities, the amount of simulation data has exploded. Data management faces numerous challenges, such as data fragmentation, irregular management, incomplete collaborative work records, and fragmented simulation software. These issues lead to low data query efficiency, low reuse rates, and a high risk of data loss, seriously impacting the efficiency and quality of simulation work. Therefore, a data processing method and device for simulation data management are provided to address existing challenges in simulation data management and improve the efficiency and accuracy of simulation data utilization. Summary of the Invention

[0003] The technical problem to be solved by the present invention is to provide a data processing method and device for simulation data management, which is conducive to solving the problems existing in existing simulation data management and improving the utilization efficiency and accuracy of simulation data.

[0004] In order to solve the above technical problems, a first aspect of an embodiment of the present invention discloses a data processing method for simulation data management, the method comprising:

[0005] Get simulation data information;

[0006] Performing data integration processing on the simulation data information to obtain target simulation processing information;

[0007] The simulation data information and the target simulation processing information are distributedly processed to obtain target simulation management data information.

[0008] A second aspect of an embodiment of the present invention discloses a data processing device for simulation data management, the device comprising:

[0009] Acquisition module, used to obtain simulation data information;

[0010] A first processing module is used to perform data integration processing on the simulation data information to obtain target simulation processing information;

[0011] The second processing module is used to perform distributed processing on the simulation data information and the target simulation processing information to obtain target simulation management data information.

[0012] A third aspect of the present invention discloses another data processing device for simulation data management, the device comprising:

[0013] a memory storing executable program code;

[0014] a processor coupled to the memory;

[0015] The processor calls the executable program code stored in the memory to execute part or all of the steps in the data processing method for simulation data management disclosed in the first aspect of the embodiment of the present invention.

[0016] The fourth aspect of the present invention discloses a computer-readable storage medium, which stores computer instructions. When the computer instructions are called, they are used to execute some or all of the steps in the data processing method for simulation data management disclosed in the first aspect of an embodiment of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0018] Figure 1 is a schematic diagram of a scenario of a data processing system for simulation data management provided by an embodiment of the present invention;

[0019] Figure 2 This is a flow chart of a data processing method for simulation data management disclosed in an embodiment of the present invention;

[0020] Figure 3 It is a structural diagram of a data processing device for simulation data management disclosed in an embodiment of the present invention;

[0021] Figure 4 It is a structural diagram of another data processing device for simulation data management disclosed in an embodiment of the present invention. DETAILED DESCRIPTION

[0022] In order to enable those skilled in the art to better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making any creative efforts shall fall within the scope of protection of the present invention.

[0023] The terms "first," "second," and so on, in the description and claims of the present invention and the accompanying drawings are used to distinguish between different objects, not to describe a specific order. Furthermore, the terms "including," "having," and any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, apparatus, product, or device comprising a series of steps or elements is not limited to the listed steps or elements but may optionally include steps or elements not listed, or may optionally include other steps or elements inherent to the process, method, product, or device.

[0024] References herein to "embodiments" mean that a particular feature, structure, or characteristic described in connection with the embodiments may be included in at least one embodiment of the present invention. The appearance of this phrase in various places in the specification does not necessarily refer to the same embodiment, nor does it constitute a separate or alternative embodiment that is mutually exclusive of other embodiments. It is understood, both explicitly and implicitly, by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0025] In this application, the word "exemplary" is used to mean "serving as an example, illustration, or illustration." Any embodiment described in this application as "exemplary" is not necessarily to be construed as preferred or advantageous over other embodiments. The following description is given to enable any person skilled in the art to implement and use the present application. In the following description, details are listed for the purpose of explanation. It should be understood that one of ordinary skill in the art can recognize that the present application can be implemented without using these specific details. In other instances, well-known structures and processes are not elaborated in detail to avoid obscuring the description of the present application with unnecessary details. Therefore, the present application is not intended to be limited to the embodiments shown, but is consistent with the widest scope consistent with the principles and features disclosed in this application.

[0026] It should be noted that since the method of the embodiment of the present application is executed in a computer device, the processing objects of each computer device exist in the form of data or information. For example, time is actually time information. It can be understood that if size, quantity, position, etc. are mentioned in subsequent embodiments, the corresponding data exist for the computer device to process. The details will not be repeated here.

[0027] It should be noted that the artificial intelligence related technologies that may be involved in this application are briefly described. Artificial Intelligence (AI) is the theory, method, technology and application system that uses digital computers or machines controlled by digital computers to simulate, extend and expand human intelligence, perceive the environment, acquire knowledge and use knowledge to obtain the best results. In other words, artificial intelligence is a comprehensive technology in computer science that attempts to understand the essence of intelligence and produce a new type of intelligent machine that can respond in a similar way to human intelligence. Artificial intelligence is to study the design principles and implementation methods of various intelligent machines, so that machines have the functions of perception, reasoning and decision-making.

[0028] Artificial intelligence (AI) technology is a comprehensive discipline encompassing a wide range of fields, encompassing both hardware and software technologies. Foundational AI technologies generally include sensors, specialized AI chips, cloud computing, distributed storage, big data processing, operating / interaction systems, and mechatronics. AI software technologies primarily encompass computer vision, speech processing, natural language processing, and machine learning / deep learning.

[0029] Computer vision (CV) is the science of making machines "see." Specifically, it refers to machine vision, where cameras and computers replace the human eye in identifying and measuring objects, performing further image processing to create images more suitable for human observation or transmission to instruments. As a scientific discipline, computer vision studies related theories and technologies, attempting to build artificial intelligence systems capable of extracting information from images or multidimensional data. Computer vision technologies typically include image processing, image recognition, image semantic understanding, image retrieval, optical character recognition (OCR), video processing, video semantic understanding, video content / behavior recognition, three-dimensional object reconstruction, 3D technology, virtual reality, augmented reality, simultaneous localization and mapping, and common biometric recognition technologies such as facial recognition and fingerprint recognition.

[0030] Unimodal information is data consisting of only one type, such as text, images, audio, video, or electromagnetic signals. Multimodal information is data that includes at least two types of unimodal information. Furthermore, multimodal information is suitable for complex tasks that require integrating multiple information sources, such as sentiment analysis, robot interaction, and autonomous driving. By integrating information from multiple modalities, higher performance and accuracy can often be achieved on the task.

[0031] A large model refers to an artificial neural network model with a very large number of parameters. In the field of artificial intelligence, a large model generally refers to a model with hundreds of millions to trillions of parameters. Models usually need to be trained on large-scale data sets and require a large amount of computing resources to be optimized and adjusted. Large models are generally used to solve complex tasks such as natural language processing, computer vision, and speech recognition. Generative AI is an AI that can create new content and ideas, including conversations, stories, images, videos, and music. In the embodiment of the present application, the large model can be ChatGPT, BERT, XLNet, Zhipu model, Claude, Moonshot AI model, ChatGLM model, Tongwen Qianyi model, MiniMax model, Spark model, Llama model, 360GPT model, Qwen model, Baichuan model, Skylark model, vivoLM model, Wenxin Yiyan and other large-scale language models, which are not limited in the embodiment of the present application.

[0032] The embodiments of the present application provide a data processing method, apparatus, computer device, and computer-readable storage medium for simulation data management, which are described in detail below.

[0033] See also Figure 1 , Figure 1 This is a schematic diagram of a data processing system for simulation data management provided by an embodiment of the present application. The data processing system for simulation data management may include a computer device 100, in which a data processing device for simulation data management is integrated, such as Figure 1 Computer equipment in.

[0034] In the embodiment of the present application, the computer device 100 is mainly used to obtain simulation data information;

[0035] Performing data integration processing on the simulation data information to obtain target simulation processing information;

[0036] The simulation data information and the target simulation processing information are distributedly processed to obtain target simulation management data information.

[0037] It can solve the problems existing in existing simulation data management and improve the utilization efficiency and accuracy of simulation data.

[0038] In the embodiments of the present application, the computer device 100 may be an independent server, or a server network or server cluster composed of servers. For example, the computer device 100 described in the embodiments of the present application includes, but is not limited to, a computer, a network host, a single network server, a set of multiple network servers, or a cloud server composed of multiple servers. A cloud server is composed of a large number of computers or network servers based on cloud computing.

[0039] It is understood that the computer device 100 used in the embodiments of the present application can be a device that includes both receiving and transmitting hardware, that is, a device that has receiving and transmitting hardware capable of performing two-way communication over a two-way communication link. Such a device may include: a cellular or other communication device that has a single-line display, a multi-line display, or a cellular or other communication device without a multi-line display. The specific computer device 100 can be a desktop terminal or a mobile terminal. The computer device 100 can also be a mobile phone, a tablet computer, a laptop computer, etc.

[0040] Those skilled in the art will understand that Figure 1 The application environment shown in the figure is only one application scenario of the present application solution and does not constitute a limitation on the application scenario of the present application solution. Other application environments may also include Figure 1 More or fewer computer devices as shown in Figure 1 Only one computer device is shown in the figure. It can be understood that the data processing system for simulation data management can also include one or more other services, which are not specifically limited here.

[0041] In addition, if Figure 1 As shown, the data processing system for simulation data management may further include a memory 200 for storing data, such as image data, position information, and the like.

[0042] It should be noted that Figure 1 The scenario diagram of the data processing system for simulation data management shown is merely an example. The data processing system and scenario for simulation data management described in the embodiment of the present application are intended to more clearly illustrate the technical solution of the embodiment of the present application, and do not constitute a limitation on the technical solution provided in the embodiment of the present application. A person skilled in the art will appreciate that, with the evolution of the data processing system for simulation data management and the emergence of new business scenarios, the technical solution provided in the embodiment of the present application is equally applicable to similar technical problems.

[0043] The present invention discloses a data processing method and device for simulation data management, which are beneficial for solving the problems existing in existing simulation data management and improving the utilization efficiency and accuracy of simulation data. Detailed descriptions are given below.

[0044] Example 1

[0045] See also Figure 2 , Figure 2 This is a flow chart of a data processing method for simulation data management disclosed in an embodiment of the present invention. Figure 2 The data processing method for simulation data management described is applied to a management system, such as a local server or cloud server for management, etc., which is not limited in the embodiment of the present invention. Figure 2 As shown, the data processing method for simulation data management may include the following operations:

[0046] 101. Obtain simulation data information.

[0047] 102. Perform data integration processing on the simulation data information to obtain target simulation processing information.

[0048] 103. Distribute the simulation data information and the target simulation processing information to obtain the target simulation management data information.

[0049] It should be noted that the above-mentioned acquisition of simulation data information is based on the frequency of data generation and business needs, and the choice of real-time or batch collection method is selected. For simulation tasks that require a fast response, real-time collection is used; for tasks with large data volumes and less real-time requirements, batch collection is used. This embodiment of the present invention does not limit this.

[0050] It should be noted that the above-mentioned target simulation management data information includes simulation data index information and simulation data storage data information, which is not limited in the embodiment of the present invention.

[0051] It should be noted that the above-mentioned simulation data index information represents the situation where the above-mentioned simulation data information is stored in the simulation storage node, that is, the storage index, so as to facilitate the indexing of the target simulation processing information corresponding to the simulation data information, thereby improving the read and write performance and availability of the simulation data information index, and the embodiments of the present invention do not limit this.

[0052] It should be noted that the above-mentioned simulation data storage data information represents the simulation storage nodes corresponding to the target simulation processing information corresponding to the simulation data information, so as to guide the storage of data in each simulation storage node, which is not limited in the embodiment of the present invention.

[0053] It can be seen that implementing the data processing method for simulation data management described in the embodiment of the present invention is conducive to solving the problems existing in the existing simulation data management and improving the utilization efficiency and accuracy of simulation data.

[0054] In an optional embodiment, performing data integration processing on the simulation data information to obtain target simulation processing information includes:

[0055] Performing data format conversion processing on the simulation data information to obtain first simulation processing information; the first simulation processing information includes a plurality of first simulation result value information distributed according to sampling time sequence; each sampling time sequence corresponds to a relative sequence value;

[0056] The first simulation processing information is standardized to obtain target simulation processing information.

[0057] It should be noted that the above-mentioned data format conversion processing of the simulation data information is to convert the format of the collected data to eliminate the data differences between different software, such as converting files of different formats (such as CSV, XML, JSON, etc.) into a common format, such as CSV or JSON, which is not limited in the embodiments of the present invention.

[0058] It should be noted that the relative sequence number value represents a data processing method that starts from the first collected simulation data with 1 as the initial sequence number value and increases the sequence number value in sequence, which is not limited in the embodiment of the present invention.

[0059] It should be noted that the above-mentioned sampling sequence represents the sampling time, which may be represented in seconds, and the embodiment of the present invention does not limit this.

[0060] It can be seen that implementing the data processing method for simulation data management described in the embodiment of the present invention is conducive to solving the problems existing in the existing simulation data management and improving the utilization efficiency and accuracy of simulation data.

[0061] In another optional embodiment, performing standardization processing on the first simulation processing information to obtain target simulation processing information includes:

[0062] Performing data cleaning on the first simulation processing information to obtain first standardized processing information; the first standardized processing information includes a plurality of first standardized value information;

[0063] Performing planned processing on the first standardized processing information to obtain second standardized processing information; the second standardized processing information includes a plurality of second standardized value information;

[0064] Mapping and conversion processing is performed on the second normalized processing information to obtain target simulation processing information.

[0065] It should be noted that the above-mentioned standardization of the first simulation processing information is to remove noise, duplicate data, erroneous data, etc. in the data and convert it into a standard format to ensure the quality and indexing efficiency of the simulation data, which is not limited in the embodiment of the present invention.

[0066] It can be seen that implementing the data processing method for simulation data management described in the embodiment of the present invention is conducive to solving the problems existing in the existing simulation data management and improving the utilization efficiency and accuracy of simulation data.

[0067] In yet another optional embodiment, performing data cleaning on the first simulation processing information to obtain first standardized processing information includes:

[0068] Marking first simulation result value information corresponding to the first simulation result value information in the first simulation processing information, where the first simulation result value is a missing value, to obtain first simulation marking information;

[0069] Marking first simulation result value information corresponding to first simulation result value information in the first simulation processing information, where the first simulation result value is greater than the first cleaning threshold, to obtain second simulation marking information;

[0070] Using the Z-score to identify and mark abnormal information in the first simulation processing information to obtain third simulation marking information;

[0071] Performing a union process on the first simulation tag information, the second simulation tag information, and the third simulation tag information to obtain target simulation tag information; the target simulation tag information includes a plurality of tag simulation result value information; each tag simulation result value information corresponds to a piece of first simulation result value information;

[0072] Selecting a piece of marked simulation result value information from the target simulation mark information in sequence according to the relative sequence number value as the simulation result value information to be processed;

[0073] The simulation result value information to be processed is processed using a simulation update calculation formula to obtain updated simulation result value information corresponding to the simulation result value information to be processed;

[0074] The simulation update calculation formula is:

[0075]

[0076] In the formula, GX represents the updated simulation result value corresponding to the updated simulation result value information; SX represents the relative sequence number value corresponding to the updated simulation result value information; Z1 and SX1 respectively represent the first simulation result value and the relative sequence number value corresponding to the first simulation result value information corresponding to a non-marked simulation result value information closest to the updated simulation result value information before the updated simulation result value information; Z2 and SX2 respectively represent the first simulation result value and the relative sequence number value corresponding to the first simulation result value information corresponding to a non-marked simulation result value information closest to the updated simulation result value information after the updated simulation result value information;

[0077] All updated simulation result value information is used to perform replacement and update processing on the first simulation result value information in the first simulation processing information to obtain first standardized processing information.

[0078] It should be noted that the marks in this application can be marked with marking symbols, such as * or #, etc., which is not limited in the embodiments of the present invention.

[0079] It should be noted that the above-mentioned marking of the first simulation result value information corresponding to the first simulation result value information in the first simulation processing information as a missing value is to mark the first simulation result value information in the first simulation result value information as a missing value, so as to timely complete the simulation data in the missing state and improve the management efficiency and accuracy of the simulation data. The embodiment of the present invention does not limit this.

[0080] Marking the first simulation result value information corresponding to the first simulation result value information in the first simulation processing information, which is greater than the first cleaning threshold, is to use the first cleaning threshold to filter the simulation data to filter out obvious simulation anomalies, thereby improving the efficiency and accuracy of identifying abnormal simulation data, which is not limited in the embodiments of the present invention. Furthermore, the above-mentioned first cleaning threshold can be set by the user, or it can be determined by the large model based on the historical cleaning threshold, which is not limited in the embodiments of the present invention. Furthermore, the first cleaning threshold can be set between 1 and 100, which is not limited in the embodiments of the present invention.

[0081] It should be noted that the above-mentioned use of Z-score to identify and mark abnormal information in the first simulation processing information is by calculating the mean square error in the first simulation processing information, so as to utilize the relationship between the data itself to identify abnormal values, so as to further determine the abnormal problem data in the simulation data, and the embodiments of the present invention do not limit this.

[0082] It should be noted that the above-mentioned union processing of the first simulation mark information, the second simulation mark information and the third simulation mark information is to union and fuse the simulation data identified by multiple methods, so as to efficiently and accurately identify the abnormal data of the simulation data, improve the recognition reliability of abnormal simulation, and further improve the management efficiency and accuracy of the simulation data, which is not limited in the embodiments of the present invention.

[0083] It should be noted that the non-marked simulation result value information closest to the updated simulation result value information represents the first simulation result value information corresponding to the non-marked simulation result value information that is closest to the updated simulation result value information, which is not limited in this embodiment of the present invention.

[0084] It should be noted that the above-mentioned replacement and update processing of the first simulation result value information in the first simulation processing information using all updated simulation result value information is to replace the abnormal first simulation result value, thereby improving the management efficiency and accuracy of the simulation data, and the embodiment of the present invention is not limited thereto.

[0085] It can be seen that implementing the data processing method for simulation data management described in the embodiment of the present invention is conducive to solving the problems existing in the existing simulation data management and improving the utilization efficiency and accuracy of simulation data.

[0086] In yet another optional embodiment, performing mapping conversion processing on the second standardized processing information to obtain target simulation processing information includes:

[0087] Performing vectorization conversion processing on simulation basic information in the simulation data information to obtain target basic vector information;

[0088] The target basic vector information and the second normalized processing information are associated with each other to obtain target simulation processing information.

[0089] It should be noted that the above-mentioned basic simulation information includes information such as the version information of the simulation software and the simulation time, which is not limited in the embodiment of the present invention. Furthermore, the above-mentioned vectorization conversion processing of the basic simulation information in the simulation data information can be implemented by a BERT model or a large model, which is not limited in the embodiment of the present invention.

[0090] It should be noted that the above-mentioned associating process of the target basis vector information and the second normalized information is to express the information in the form of (target basis vector information, second normalized information), which is not limited in the embodiment of the present invention.

[0091] It can be seen that implementing the data processing method for simulation data management described in the embodiment of the present invention is conducive to solving the problems existing in the existing simulation data management and improving the utilization efficiency and accuracy of simulation data.

[0092] In an optional embodiment, performing planned processing on the first standardized information to obtain second standardized information includes:

[0093] Performing data type conversion on the first standardized processed information to obtain standard data processed information;

[0094] Performing unit type conversion on the standard data processing information to obtain standard unit processing information; the standard unit processing information includes a plurality of target unit processing value information;

[0095] The standard unit processing information is converted and processed using a simulation specification formula to obtain second standardized processing information;

[0096] Among them, the simulation specification formula is:

[0097]

[0098] Wherein, BZ1 represents the second standardized value information; MBZ represents the target unit processing value information; ZDZ and ZXZ represent the target unit processing value information with the largest value and the target unit processing value information with the smallest value in the standard unit processing information, respectively.

[0099] It should be noted that the data type conversion process performed on the first standardized processing information is to convert the simulation data into a unified storage format, such as a decimal format, which is not limited in the embodiment of the present invention.

[0100] It should be noted that the above-mentioned unit type conversion of the standard data processing information to obtain the standard unit processing information is to convert the data into a unified unit format and unit standard, such as unifying the length unit into meters and the time unit into seconds, which is not limited in the embodiments of the present invention.

[0101] It should be noted that the numerical value of the above-mentioned target unit processing value information is the target unit processing value, which is expressed in decimal form. Furthermore, the target unit processing value information also includes a relative serial number value, but it does not require a simulation standard formula for processing, and the embodiment of the present invention does not limit it.

[0102] It can be seen that implementing the data processing method for simulation data management described in the embodiment of the present invention is conducive to solving the problems existing in the existing simulation data management and improving the utilization efficiency and accuracy of simulation data.

[0103] In another optional embodiment, the simulation data information and the target simulation processing information are distributedly processed to obtain target simulation management data information, including:

[0104] Determine target node information based on simulation basic information and simulation storage node information in the simulation data information;

[0105] Based on the target node information, target simulation processing information is processed to obtain target simulation management data information.

[0106] It should be noted that the above-mentioned simulation storage node information includes several simulation storage nodes, each simulation storage node corresponds to a node vector, and the node vector represents the different types of simulation data that can be stored, which is not limited in the embodiment of the present invention. Furthermore, the above-mentioned simulation storage node corresponds to the amount of available storage data of the node, which is not limited in the embodiment of the present invention. Furthermore, the amount of available storage data of the node represents the amount of data that can be stored in the remaining hardware storage resources of the current simulation storage node, which is not limited in the embodiment of the present invention.

[0107] It should be noted that the above target node information includes several target storage nodes, which is not limited in the embodiment of the present invention.

[0108] In this optional embodiment, as an optional implementation manner, the above-mentioned determination of the target node information based on the simulation basic information and the simulation storage node information in the simulation data information includes:

[0109] Utilizing a node screening calculation formula, the target basic vector information corresponding to the simulation basic information in the simulation data information and the node vector corresponding to the simulation storage node in the simulation storage node information are calculated and processed to obtain node vector calculation value information; the node vector calculation value information includes a plurality of node vector calculation values;

[0110] The node screening calculation formula is:

[0111]

[0112] Where JSZ represents the calculated value of the node vector; XL1 represents the target basic vector information; L2 represents the node vector;

[0113] The node vector calculated value in the node vector calculated value information, whose node vector calculated value is greater than the first node threshold, is used as a first candidate calculated value;

[0114] The first candidate calculated value corresponding to the first candidate calculated value has a node available storage data amount greater than the second node threshold as the second candidate calculated value;

[0115] Determine whether the number of the second alternative calculated values ​​is greater than or equal to YZ, and obtain the node number judgment result

[0116] When the result of the node quantity determination is no, determining the simulation storage node corresponding to the second candidate calculated value as the target storage node;

[0117] When the result of the node number judgment is yes, YZ second candidate calculation values ​​are randomly selected from the second candidate calculation values ​​as the target calculation values;

[0118] The simulation storage node corresponding to the target calculation value is determined as the target storage node.

[0119] It should be noted that the above-mentioned second node threshold is determined based on the version information of the simulation software corresponding to the simulation basic information, so that the threshold can be adjusted according to the simulation software version to adapt to the change in simulation data volume caused by version changes. The embodiment of the present invention does not limit this.

[0120] It should be noted that the first node threshold can be set by the user or obtained by analyzing historical data using a large model, which is not limited in the embodiment of the present invention. Furthermore, the first node threshold is a value between 0.5 and 1, which is not limited in the embodiment of the present invention.

[0121] It should be noted that the above YZ is a positive integer between 3 and 8, which is not limited in the embodiment of the present invention.

[0122] It should be noted that the above-mentioned selection of simulation storage nodes as target storage nodes by comparing the number of second alternative calculation values ​​with YZ ensures the distributed distribution of storage nodes without having too many distributed nodes, which causes the simulation data to be stored too dispersedly. The embodiment of the present invention does not limit this.

[0123] In this optional embodiment, as an optional implementation manner, the target simulation processing information is subjected to information generation processing based on the target node information to obtain target simulation management data information, including:

[0124] The second normalized processing information in the target simulation processing information is equally divided into YZ parts to obtain segmented simulation processing; the segmented simulation processing includes YZ target segmented normalized processing information;

[0125] Establishing a correlation and correspondence between target segmentation normalization processing information in the segmentation simulation processing information and target storage nodes in the target node information to obtain simulation data storage data information;

[0126] The target segmentation normalization processing information in the simulation data storage data information is used to generate information in a standard indexing manner according to the associated correspondence between the target storage node and the target basic vector information to obtain simulation data index information.

[0127] It should be noted that the above-mentioned establishment of the associated correspondence between the target segmentation standardization processing information in the segmentation simulation processing information and the target storage node in the target node information is to establish a one-to-one association between the target segmentation standardization processing information and the target storage node, that is, (target storage node, target segmentation standardization processing information), so that the target segmentation standardization processing information is stored in the target storage node, and the embodiments of the present invention are not limited to this.

[0128] It should be noted that the above standard indexing method is target basic vector information-(target storage node, target segmentation normalization processing information)-...-(target storage node, target segmentation normalization processing information), which is not limited in the embodiment of the present invention.

[0129] It can be seen that implementing the data processing method for simulation data management described in the embodiment of the present invention is conducive to solving the problems existing in the existing simulation data management and improving the utilization efficiency and accuracy of simulation data.

[0130] Example 2

[0131] See also Figure 3 , Figure 3 This is a schematic diagram of the structure of a data processing device for simulation data management disclosed in an embodiment of the present invention. Figure 3 The described device can be applied to a management system, such as a local server or a cloud server for management, etc., and the embodiment of the present invention does not limit this. Figure 3 As shown, the device may include:

[0132] Acquisition module 201, used to acquire simulation data information;

[0133] The first processing module 202 is used to perform data integration processing on the simulation data information to obtain target simulation processing information;

[0134] The second processing module 203 is used to perform distributed processing on the simulation data information and the target simulation processing information to obtain target simulation management data information.

[0135] It can be seen that implementation Figure 3 The described data processing device for simulation data management is beneficial to solving problems existing in existing simulation data management and improving the utilization efficiency and accuracy of simulation data.

[0136] In another optional embodiment, Figure 3 As shown, the simulation data information is integrated and processed to obtain target simulation processing information, including:

[0137] Performing data format conversion processing on the simulation data information to obtain first simulation processing information; the first simulation processing information includes a plurality of first simulation result value information distributed according to sampling time sequence; each sampling time sequence corresponds to a relative sequence value;

[0138] The first simulation processing information is standardized to obtain target simulation processing information.

[0139] It can be seen that implementation Figure 3 The data processing device for simulation data management described herein is beneficial for solving problems existing in existing simulation data management and improving the utilization efficiency and accuracy of simulation data.

[0140] In another optional embodiment, Figure 3 As shown, the first simulation processing information is standardized to obtain target simulation processing information, including:

[0141] Performing data cleaning on the first simulation processing information to obtain first standardized processing information; the first standardized processing information includes a plurality of first standardized value information;

[0142] Performing planned processing on the first standardized processing information to obtain second standardized processing information; the second standardized processing information includes a plurality of second standardized value information;

[0143] Mapping and conversion processing is performed on the second normalized processing information to obtain target simulation processing information.

[0144] It can be seen that implementation Figure 3 The data processing device for simulation data management described herein is beneficial for solving problems existing in existing simulation data management and improving the utilization efficiency and accuracy of simulation data.

[0145] In another optional embodiment, Figure 3 As shown, data cleaning is performed on the first simulation processing information to obtain first standardized processing information, including:

[0146] Marking first simulation result value information corresponding to the first simulation result value information in the first simulation processing information, where the first simulation result value is a missing value, to obtain first simulation marking information;

[0147] Marking first simulation result value information corresponding to first simulation result value information in the first simulation processing information, where the first simulation result value is greater than the first cleaning threshold, to obtain second simulation marking information;

[0148] Using the Z-score to identify and mark abnormal information in the first simulation processing information to obtain third simulation marking information;

[0149] Performing a union process on the first simulation tag information, the second simulation tag information, and the third simulation tag information to obtain target simulation tag information; the target simulation tag information includes a plurality of tag simulation result value information; each tag simulation result value information corresponds to a piece of first simulation result value information;

[0150] Selecting a piece of marked simulation result value information from the target simulation mark information in sequence according to the relative sequence number value as the simulation result value information to be processed;

[0151] The simulation result value information to be processed is processed using a simulation update calculation formula to obtain updated simulation result value information corresponding to the simulation result value information to be processed;

[0152] The simulation update calculation formula is:

[0153]

[0154] In the formula, GX represents the updated simulation result value corresponding to the updated simulation result value information; SX represents the relative sequence number value corresponding to the updated simulation result value information; Z1 and SX1 respectively represent the first simulation result value and the relative sequence number value corresponding to the first simulation result value information corresponding to a non-marked simulation result value information closest to the updated simulation result value information before the updated simulation result value information; Z2 and SX2 respectively represent the first simulation result value and the relative sequence number value corresponding to the first simulation result value information corresponding to a non-marked simulation result value information closest to the updated simulation result value information after the updated simulation result value information;

[0155] All updated simulation result value information is used to perform replacement and update processing on the first simulation result value information in the first simulation processing information to obtain first standardized processing information.

[0156] It can be seen that implementation Figure 3 The data processing device for simulation data management described herein is beneficial for solving problems existing in existing simulation data management and improving the utilization efficiency and accuracy of simulation data.

[0157] In another optional embodiment, Figure 3 As shown, the second standardized processing information is mapped and converted to obtain target simulation processing information, including:

[0158] Performing vectorization conversion processing on simulation basic information in the simulation data information to obtain target basic vector information;

[0159] The target basic vector information and the second normalized processing information are associated with each other to obtain target simulation processing information.

[0160] It can be seen that implementation Figure 3 The data processing device for simulation data management described herein is beneficial for solving problems existing in existing simulation data management and improving the utilization efficiency and accuracy of simulation data.

[0161] In another optional embodiment, Figure 3 As shown, the first standardized processing information is subjected to planned processing to obtain the second standardized processing information, including:

[0162] Performing data type conversion on the first standardized processed information to obtain standard data processed information;

[0163] Performing unit type conversion on the standard data processing information to obtain standard unit processing information; the standard unit processing information includes a plurality of target unit processing value information;

[0164] The standard unit processing information is converted and processed using a simulation specification formula to obtain second standardized processing information;

[0165] Among them, the simulation specification formula is:

[0166]

[0167] Wherein, BZ1 represents the second standardized value information; MBZ represents the target unit processing value information; ZDZ and ZXZ represent the target unit processing value information with the largest value and the target unit processing value information with the smallest value in the standard unit processing information, respectively.

[0168] It can be seen that implementation Figure 3 The data processing device for simulation data management described herein is beneficial for solving problems existing in existing simulation data management and improving the utilization efficiency and accuracy of simulation data.

[0169] In another optional embodiment, Figure 3 As shown, the simulation data information and the target simulation processing information are distributedly processed to obtain the target simulation management data information, including:

[0170] Determine target node information based on simulation basic information and simulation storage node information in the simulation data information;

[0171] Based on the target node information, target simulation processing information is processed to obtain target simulation management data information.

[0172] It can be seen that implementation Figure 3 The data processing device for simulation data management described herein is beneficial for solving problems existing in existing simulation data management and improving the utilization efficiency and accuracy of simulation data.

[0173] Example 3

[0174] See also Figure 4 , Figure 4 This is a structural diagram of another data processing device for simulation data management disclosed in an embodiment of the present invention. Figure 4 The described device can be applied to a management system, such as a local server or a cloud server for management, etc., and the embodiment of the present invention does not limit this. Figure 4 As shown, the device may include:

[0175] A memory 301 storing executable program code;

[0176] a processor 302 coupled to the memory 301;

[0177] The processor 302 calls the executable program code stored in the memory 301 to execute the steps of the data processing method for simulation data management described in the first embodiment.

[0178] Example 4

[0179] An embodiment of the present invention discloses a computer-readable storage medium storing a computer program for electronic data exchange, wherein the computer program enables a computer to execute the steps of the data processing method for simulation data management described in the first embodiment.

[0180] Example 5

[0181] An embodiment of the present invention discloses a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to enable a computer to execute the steps of the data processing method for simulation data management described in the first embodiment.

[0182] The device embodiments described above are merely illustrative. Modules described as separate components may or may not be physically separate, and components shown as modules may or may not be physical modules, i.e., they may be located in one place or distributed across multiple network modules. Some or all of the modules may be selected based on actual needs to achieve the objectives of the present embodiment. Persons of ordinary skill in the art will be able to understand and implement the present invention without inventive effort.

[0183] Through the detailed description of the above embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus the necessary general hardware platform, or of course, by means of hardware. Based on this understanding, the above technical solution, in essence, or the portion that contributes to the prior art, can be embodied in the form of a software product, which can be stored in a computer-readable storage medium, including a read-only memory (ROM), a random access memory (RAM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), a one-time programmable read-only memory (OTPROM), an electronically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disc storage, magnetic disk storage, magnetic tape storage, or any other computer-readable medium capable of carrying or storing data.

[0184] Finally, it should be noted that the data processing method and device for simulation data management disclosed in the embodiments of the present invention are only preferred embodiments of the present invention, and are only used to illustrate the technical solutions of the present invention, rather than to limit them. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that the technical solutions described in the aforementioned embodiments can still be modified, or some of the technical features therein can be replaced by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present invention.

Claims

1. A data processing method for simulation data management, characterized in that: The method comprises: Get simulation data information; Performing data integration processing on the simulation data information to obtain target simulation processing information; Performing distributed processing on the simulation data information and the target simulation processing information to obtain target simulation management data information; The distributed processing of the simulation data information and the target simulation processing information to obtain target simulation management data information includes: Determining target node information based on simulation basic information and simulation storage node information in the simulation data information; Based on the target node information, performing information generation processing on the target simulation processing information to obtain target simulation management data information; The target node information is determined based on the simulation basic information and the simulation storage node information in the simulation data information, including: Utilizing a node screening calculation formula, the target basic vector information corresponding to the simulation basic information in the simulation data information and the node vector corresponding to the simulation storage node in the simulation storage node information are calculated and processed to obtain node vector calculation value information; the node vector calculation value information includes a plurality of node vector calculation values; The node screening calculation formula is: Where JSZ represents the calculated value of the node vector; XL1 represents the target basic vector information; L2 represents the node vector; The node vector calculated value in the node vector calculated value information, whose node vector calculated value is greater than the first node threshold, is used as a first candidate calculated value; The first candidate calculated value corresponding to the first candidate calculated value has a node available storage data amount greater than the second node threshold as the second candidate calculated value; Determine whether the number of the second alternative calculated values ​​is greater than or equal to YZ, and obtain the node number judgment result When the result of the node quantity determination is no, determining the simulation storage node corresponding to the second candidate calculated value as the target storage node; When the result of the node number judgment is yes, YZ second candidate calculation values ​​are randomly selected from the second candidate calculation values ​​as the target calculation values; The simulation storage node corresponding to the target calculation value is determined as the target storage node.

2. The data processing method for simulation data management according to claim 1, characterized in that: The performing data integration processing on the simulation data information to obtain target simulation processing information includes: Performing data format conversion processing on the simulation data information to obtain first simulation processing information; the first simulation processing information includes a plurality of first simulation result value information distributed according to sampling time sequences; each of the sampling time sequences corresponds to a relative sequence number value; The first simulation processing information is standardized to obtain target simulation processing information.

3. The data processing method for simulation data management according to claim 2, characterized in that: The step of performing standardization processing on the first simulation processing information to obtain target simulation processing information includes: Performing data cleaning on the first simulation processing information to obtain first standardized processing information; the first standardized processing information includes a plurality of first standardized value information; Performing a planned processing on the first standardized information to obtain second standardized information; the second standardized information includes a plurality of second standardized value information; Mapping and conversion processing is performed on the second standardized processing information to obtain target simulation processing information.

4. The data processing method for simulation data management according to claim 3, characterized in that: The performing data cleaning on the first simulation processing information to obtain first standardized processing information includes: Marking the first simulation result value information in the first simulation processing information, where the first simulation result value corresponding to the first simulation result value information is a missing value, to obtain first simulation marking information; Marking the first simulation result value information in the first simulation processing information, where the first simulation result value corresponding to the first simulation result value information is greater than a first cleaning threshold, to obtain second simulation marking information; Using the Z-score to identify and mark abnormal information in the first simulation processing information to obtain third simulation marking information; Performing a union process on the first simulation tag information, the second simulation tag information, and the third simulation tag information to obtain target simulation tag information; the target simulation tag information includes a plurality of tag simulation result value information; each tag simulation result value information corresponds to one piece of the first simulation result value information; Selecting one of the marked simulation result value information as the simulation result value information to be processed from the target simulation mark information in sequence according to the relative sequence number value; Processing the to-be-processed simulation result value information using a simulation update calculation formula to obtain updated simulation result value information corresponding to the to-be-processed simulation result value information; The simulation update calculation formula is: In the formula, GZ represents the updated simulation result value corresponding to the updated simulation result value information; SX represents the relative sequence number value corresponding to the updated simulation result value information; Z1 and SX1 respectively represent the first simulation result value and relative sequence number value corresponding to the first simulation result value information corresponding to a non-marked simulation result value information that is closest to the updated simulation result value information and whose relative sequence number value is before the updated simulation result value information; Z2 and SX2 respectively represent the first simulation result value and relative sequence number value corresponding to the first simulation result value information corresponding to a non-marked simulation result value information that is closest to the updated simulation result value information and whose relative sequence number value is after the updated simulation result value information; The first simulation result value information in the first simulation processing information is replaced and updated using all the updated simulation result value information to obtain first standardized processing information.

5. The data processing method for simulation data management according to claim 3, characterized in that: The performing mapping conversion processing on the second standardized processing information to obtain target simulation processing information includes: Performing vectorization conversion processing on the simulation basic information in the simulation data information to obtain target basic vector information; The target basic vector information and the second normalized processing information are associated with each other to obtain target simulation processing information.

6. The data processing method for simulation data management according to claim 3, characterized in that: The performing planned processing on the first standardized processing information to obtain second standardized processing information includes: Performing data type conversion on the first standardized processed information to obtain standard data processed information; Performing unit type conversion on the standard data processing information to obtain standard unit processing information; the standard unit processing information includes a plurality of target unit processing value information; Converting the standard unit processing information using a simulation specification formula to obtain second standardized processing information; Wherein, the simulation specification formula is: In the formula, BZ1 represents the second standardized value information; MBZ represents the target unit processing value information; ZDZ and ZXZ represent the target unit processing value information with the largest value and the target unit processing value information with the smallest value in the standard unit processing information, respectively.

7. A data processing device for simulation data management, characterized in that: The device comprises: Acquisition module, used to obtain simulation data information; A first processing module is used to perform data integration processing on the simulation data information to obtain target simulation processing information; A second processing module is used to perform distributed processing on the simulation data information and the target simulation processing information to obtain target simulation management data information; The distributed processing of the simulation data information and the target simulation processing information to obtain target simulation management data information includes: Determining target node information based on simulation basic information and simulation storage node information in the simulation data information; Based on the target node information, performing information generation processing on the target simulation processing information to obtain target simulation management data information; The target node information is determined based on the simulation basic information and the simulation storage node information in the simulation data information, including: Utilizing a node screening calculation formula, the target basic vector information corresponding to the simulation basic information in the simulation data information and the node vector corresponding to the simulation storage node in the simulation storage node information are calculated and processed to obtain node vector calculation value information; the node vector calculation value information includes a plurality of node vector calculation values; The node screening calculation formula is: Where JSZ represents the calculated value of the node vector; XL1 represents the target basic vector information; L2 represents the node vector; The node vector calculated value in the node vector calculated value information, whose node vector calculated value is greater than the first node threshold, is used as a first candidate calculated value; The first candidate calculated value corresponding to the first candidate calculated value has a node available storage data amount greater than the second node threshold as the second candidate calculated value; Determine whether the number of the second alternative calculated values ​​is greater than or equal to YZ, and obtain the node number judgment result When the result of the node quantity determination is no, determining the simulation storage node corresponding to the second candidate calculated value as the target storage node; When the result of the node number judgment is yes, YZ second candidate calculation values ​​are randomly selected from the second candidate calculation values ​​as the target calculation values; The simulation storage node corresponding to the target calculation value is determined as the target storage node.

8. A data processing device for simulation data management, characterized in that: The device comprises: a memory storing executable program code; a processor coupled to the memory; The processor calls the executable program code stored in the memory to execute the data processing method for simulation data management according to any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that The computer-readable storage medium stores computer instructions, and when the computer instructions are called, they are used to execute the data processing method for simulation data management according to any one of claims 1 to 6.

Images