Data asset sharing method and system based on square and circular cloud

By encoding and expressing characters in the fields connected to the data source, a standardized list of data structures is established, and dynamically allocating resource paths in business scenarios, the problems of insufficient field expression levels and static resource path allocation in the existing technology are solved, and efficient and accurate data asset sharing is achieved.

CN120086220AActive Publication Date: 2025-06-03FANGYUANBIAOZHIRENZHENG GRP CO LTD

Patent Information

Application Number
CN202510560109.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-04-30
Publication Date
2025-06-03
Estimated Expiration
2045-04-30

AI Technical Summary

Technical Problem

In the existing data asset sharing technology, the access field character set is not finely encoded and structurally expressed, resulting in insufficient field expression levels and affecting the efficiency of structure fusion; lack of numerical judgment criteria for structural similarity, and it is prone to error mapping or missing field jump recognition; the resource path filtering process is not included in the business attribute dimension, the path configuration tends to be static allocation, and the lack of dynamic scheduling response mechanism, resulting in path conflicts and the risk of lag or interruption of data request distribution.

Method used

By obtaining the data structure information of the data source to be accessed, performing field name character set encoding mapping, and combining it with field data type values ​​to establish a standardized list of data structures; based on this list, counting the number of unique matches and the number of repeated jumps of field labels, calculating the scoring of field remapping candidate field pairs, and establishing a data field shared remapping list; obtaining resource request information, recording business scenarios, extracting free path numbers, aggregating them into a shared path group according to business scenarios, handling priority conflicts, and generating data source diversion path mapping results; finally, combining the data field sharing remapping list with the data source diversion path mapping table, data path docking is performed, and data asset sharing operations are performed.

Benefits of technology

It improves the clarity of field semantic expression and enhances the recognition and accuracy of structural adaptation among fields; through the dynamic scheduling mechanism, resource path allocation is optimized, path conflict risk is reduced, and data sharing is guaranteed; a shared channel structure that coordinates field granularity and path granularity is established, which improves the organizational orderliness and operational accuracy of data transmission channels.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120086220A_ABST
    Figure CN120086220A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of data asset sharing, in particular to a data asset sharing method and system based on square and circular clouds, and the method comprises the following steps: obtaining data structure information and establishing a standardized list, counting field matching and jumping conditions to construct a remapping list, extracting an idle path aggregation path group to generate a candidate list, and judging priority conflicts to generate a shunting mapping result, and performing sharing operation on the combined fields and the paths in a butt joint manner. According to the invention, through combination of field name coding and type expression, the unified field identification capability is enhanced, coding difference and type vector difference are adopted to synthesize a score and screen a remapping field pair, the field matching precision is improved, and a path state, service attribution and priority elements are fused to construct a path group; the alternative number and the distribution identifier are configured under the path conflict, and the field and the path number are combined and butted, so that the granularity collaborative sharing is realized, the correspondence between the data channel structure and the access control is enhanced, and the stability of data sharing under multiple environments is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of data asset sharing, and in particular, to a data asset sharing method and system based on Fangyuan Cloud. Background Art

[0002] The technical field of data asset sharing includes technical solutions for collaborative utilization and unified allocation of distributed data resources in a multi-organization and multi-system environment. The core content is to achieve secure, efficient, and compliant circulation and use of data among different management entities, covering links such as data standardization processing, permission control, data desensitization, and transmission mechanism design. The aim is to break data islands and, by establishing a unified data identification system, metadata management mechanism, and exchange interface protocol, achieve discoverability, accessibility, understandability, and reusability of data across systems and platforms. It involves the design of a data management system, data security control strategies, and the formulation of data interaction processes, and is a key enabling technology for promoting digital transformation and data element circulation.

[0003] Among them, the data asset sharing method based on Fangyuan Cloud refers to a technical solution that relies on the Fangyuan Cloud platform to achieve cross-domain sharing of multi-source heterogeneous data assets, covering matters such as data access, standard mapping, sharing strategy execution, and access control management, and is completed by constructing a data resource directory system, setting sharing levels, formulating access rules, and configuring an authentication mechanism. By establishing a data model for resource description, structured collation of the accessed data sources is achieved, and an access request verification mechanism is used in conjunction with an authorization system for access permission management. At the same time, data cross-platform sharing is completed in combination with the data exchange scheduling process.

[0004] In the existing data asset sharing process, there is no fine-grained encoding and structural expression modeling for the accessed field character sets, and the field expression level is insufficient, resulting in unclear semantic distinction between fields in cross-domain structure docking, affecting the structure fusion efficiency; the field matching process relies on label consistency rather than quantitative analysis, lacking a numerical judgment standard for structural similarity, and prone to incorrect mapping or missing recognition of field jumps; the resource path screening process does not incorporate the business attribute dimension, the path configuration tends to be static allocation, lacking a dynamic scheduling response mechanism, and the resource usage is limited by the current availability status; in the case of path conflicts, there is no construction of alternative paths and diversion mechanisms, prone to single-point path blockage, causing risks of distribution lag or interruption of high-frequency data requests; there is no construction of a bound channel structure between paths and fields, and the path allocation lacks control support for the field sharing range, easily causing problems such as data desensitization failure or permission mismatch. For example, in a multi-business cross-deployment scenario, if the path allocation lacks business recognition capabilities and conflict replacement strategies, it is extremely easy to cause priority imbalance, reducing the stability of the sharing link and the coordination degree of system resources. Summary of the Invention

[0005] The object of the present invention is to solve the drawbacks existing in the prior art, and to propose a method for sharing data assets based on Fangyuan Cloud.

[0006] To achieve the above object, the present invention adopts the following technical solution: A method for sharing data assets based on Fangyuan Cloud, comprising the following steps: S1: Obtain the data structure information of the data source to be accessed on the Fangyuan Cloud platform, encode and map the character set of the field names, and combine them with the field data type values to establish a data structure standardization list; S2: According to the data structure standardization list, count the number of unique matches of the field labels corresponding to the data source and the number of repeated jump fields, compare the sharing threshold and the jump tolerance value, extract the candidate field pairs for remapping and perform weighted synthesis scoring to establish a data field sharing remapping list; S3: Obtain the data source resource request information in the sharing stage, record the business scenario, extract the idle path numbers, aggregate them into shareable path groups according to the belonging business scenario, and obtain a candidate list for sharing path allocation; S4: Based on the candidate list for sharing path allocation, retrieve the usage priority corresponding to the occupied path numbers, compare the priorities of the data sources to be accessed, and if there are priority conflicts, allocate alternative path numbers to generate a data source diversion path mapping result; S5: According to the data field sharing remapping list and the data source diversion path mapping table, combine the field remapping field pairs and the path numbers to perform data path docking and execute the data asset sharing operation.

[0007] As a further solution of the present invention, the data structure standardization list includes field name mapping rules, field type expression models, and a standardized field identifier set. The data field sharing remapping list includes field remapping pairs, structure adaptation scores, and unique identifiers of shared fields. The candidate list for sharing path allocation includes a set of path numbers, business scenario path groups, and available status identifiers. The data source diversion path mapping result includes alternative path numbers, diversion identifiers, and a priority comparison table. The data asset sharing operation includes a path number field docking set, a mapped field data stream, and a shared operation execution label.

[0008] As a further solution of the present invention, the specific steps for obtaining the data structure standardization list are as follows: S111: Obtain the first-layer field label information exposed by the data source to be accessed on the Fangyuan Cloud platform, detect the data type values corresponding to the field labels, call the field label character set and field type mapping rules, perform item-by-item encoding conversion on the character set in the field labels, and splice and integrate them with the field type information to generate a field structure encoding combination result; S112: According to the encoding combination result of the field structure, screen the field items in which the character set encoding repetition rate in the field exceeds the standard encoding repetition threshold, count the number of duplicate combinations existing in the corresponding field type, and obtain the distribution range interval values of the field character set under different types, and generate field encoding distribution interval data; S113: Based on the field encoding distribution interval data, judge the type consistency degree of each field after encoding mapping, and call the type mapping quantity corresponding to the field label character set and the field structure encoding length, and use the formula: ; Calculate the cross-type field structure encoding consistency difference value , judge whether field reconstruction is required, and establish a data structure standardization list, where represents the th type mapping quantity of the field, represents the th character set encoding repetition rate of the field, represents the th character set length of the field, represents the th encoding combination length of the field, represents the total number of type mapping fields, represents the total number of encoding length fields.

[0009] As a further solution of the present invention, the specific steps for obtaining the data field sharing remapping list are as follows: S211: Based on the field label information recorded in the data structure standardization list, count the matching relationship between the field labels in all the currently connected data sources in the Fangyuan Cloud platform and the standard field labels, call the field label set and the data source field label set for item-by-item comparison, obtain the number of unique labels corresponding to the standard field labels in each data source one by one, and accumulate and count the frequency of repeated occurrences of the labels to obtain the unique matching quantity and repeated jump quantity of the field labels; S212: According to the unique matching quantity and repeated jump quantity of the field labels, respectively perform interval judgment with the sharing threshold and the jump tolerance value, extract the data source fields that meet the sharing threshold, and correspondingly generate a set of field pairs that can be replaced and accessed. Call the field label character set encoding set and the field type vector set, and calculate the character set encoding difference quantity and the field type expression vector difference value between the field pairs respectively, using the formula: ; Calculate the combined score of the character set difference and type expression offset of the field pair , screen the minimum score among all the field pairs, and obtain the field structure adaptation result, where represents the The encoding value of the candidate character set for a field indicating the encoding value of the standard character set for the th field indicating the expression vector value of the candidate type for the th field indicating the expression vector value of the standard type for the th field indicating the number of encoding difference items indicating the dimension number of type expression; S213: Based on the field structure adaptation result, select the field pairs with the minimum score according to the score value, identify them as the high-adaptation field combinations, form field pair entries by combining the original field labels and standard field labels to which they belong, and combine and summarize them to form a field mapping record set, and establish a data field sharing remapping list.

[0010] As a further solution of the present invention, the step of obtaining the candidate list of shared path allocation is specifically as follows: S311: Obtain the data source resource request information entering the sharing stage, extract the corresponding data source number and field mapping record, collect the business scenario identification items in the associated data source resource request entries, and perform label mapping on the data source resource request information according to the business scenario identification to obtain the business scenario identification mapping result; S312: According to the business scenario identification mapping result, call the path number set, path status set and current path occupancy set in the shared path status library, extract the path number list with the current path status being allocable and the occupancy flag being empty, detect the resource priority threshold associated with each path number, aggregate each path number according to the business scenario respectively, and obtain the group of shareable path numbers; S313: Based on the group of shareable path numbers, combine the business scenario identification to which they belong, integrate all the shareable path numbers under each type of business scenario into one type of shared path, and establish a candidate list of shared path allocation.

[0011] As a further solution of the present invention, the step of obtaining the data source diversion path mapping result is specifically as follows: S411: Based on all the path numbers in the candidate list of shared path allocation, retrieve the path number items in the path status field that are currently in the occupied state, collect the usage priority values registered in the resource usage records associated with the path numbers, compare the resource priority values in the data source resource request to be accessed, and count the set of all conflicting path numbers to obtain the group of priority-conflicting path numbers; S412: According to the group of priority-conflicting path numbers, screen the shareable path numbers that are not occupied in the same business scenario, and perform number pairing attempts based on the judgment conditions that the path status is idle and the business scenario identification to which they belong is the same. Use the formula: ; Calculate the difference score value between the resource usage deviation degree and the priority reconstruction adaptation value for each pair of path numbers , select the path number with the smallest score value as the alternative path number, and perform annotation recording to generate the alternative path mapping score result, where represents the resource request intensity of the th conflict path, represents the resource idle level of the th alternative path, represents the load cycle value of the th alternative path, represents the priority difference of the th conflict path, represents the cumulative occupation duration of the th path, represents the remaining available cycle number of the th path, is the number of conflict paths, is the number of path priority difference items; S413: According to the alternative path mapping score result, select the path number with the smallest score value corresponding to each conflict path as the alternative path number, perform corresponding binding with the original conflict path number, and establish a shunt identification record item to establish the data source shunt path mapping result.

[0012] As a further solution of the present invention, the specific execution steps of the data asset sharing operation are as follows: S511: According to the field mapping field pairs recorded in the data field sharing remapping list, obtain the corresponding relationship between the standard field and the original field in each pair of fields, and combine the set of path numbers already allocated in the data source shunt path mapping result. Perform joint matching of the field mapping field pairs and the path numbers according to the data source number, and merge and combine the field mapping field pairs and the path numbers to obtain a field path combination comparison table; S512: According to the field path combination comparison table, extract the field character set encoding and field type vector in all field pairs, call the resource type label, business scenario identifier and path transmission capacity associated with the path number, and compare the field structure information and the path resource structure characteristics item by item to confirm the structural matching and resource accessibility between the two, and obtain the field path combination record with successful structural matching; S513: Based on the field path combination record with successful structural matching, extract the field path combination record that meets the path access conditions as the formal connectable field data path mapping relationship, establish a data path docking relationship according to the field mapping order and the path number, and execute the data asset sharing operation.

[0013] A data asset sharing system based on Fangyuan Cloud, comprising: The data structure standardization module obtains field label and type information, extracts the character set and encodes and maps the combination to uniformly express the structure, and generates a data structure standardization list; Based on the data structure standardization list, the field mapping and screening module counts the unique matching number and jump number of fields, determines whether the sharing threshold and jump tolerance value are met, extracts candidate field pairs, calculates the difference number of character set encodings and the difference value of type expression vectors, performs weight scoring, screens the field pairs with the optimal scores to establish an adaptation relationship, and generates a data field sharing and remapping list; The resource request analysis module obtains resource request information and scenario identifiers, combines the path status and occupancy to screen for idle paths, and builds a shareable path group according to the business scenario to obtain a candidate list for shared path allocation; Based on the candidate list for shared path allocation, the path priority conflict resolution module compares the data source priority and the occupied path priority. If there is a conflict, it allocates an alternative path in the same scenario and generates a data source diversion path mapping result; The data sharing execution module combines the data field sharing and remapping list and the data source diversion path mapping table, performs data path docking, and executes the data asset sharing operation.

[0014] Compared with the prior art, the advantages and positive effects of the present invention are as follows: In the present invention, by encoding the character set of the accessed field name and combining the field data type to construct a structural expression, the clarity of the field semantic expression is improved, the structural information has consistency and comparability, and the ambiguity and misjudgment caused by heterogeneous fields are effectively avoided; a remapped field pair is constructed based on the field matching accuracy index, and a quantitative evaluation is carried out in combination with the encoding difference and the type expression vector difference to realize the screening and optimization of the mapping result, and the discrimination and accuracy of the structural adaptation between fields are enhanced; in the process of screening the shared path, multiple dimensions such as the path idle state, business scenario attribution, and priority threshold are integrated to carry out path group aggregation, breaking the single resource allocation logic, constructing a path candidate mechanism with scenario orientation, and expanding the elastic boundary of resource scheduling; alternative numbers and diversion identifiers are configured for the priority conflict paths to strengthen the continuity and fault tolerance of path allocation, and ensure the smooth sharing in a high-density request environment; in the path docking stage, the field remapping pair and the path number are combined and bound to establish a shared channel structure that coordinates at the field granularity and path granularity, improves the organizational orderliness and operation accuracy of the data transmission channel, and expands the intelligent scheduling depth and policy elastic range of data sharing in a complex environment. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 It is the main step flow chart of the present invention; Figure 2Flowchart for obtaining the standardized list of the data structure of the present invention; Figure 3 Flowchart for obtaining the remapping list of shared data fields of the present invention; Figure 4 Flowchart for obtaining the candidate list of shared path allocation of the present invention; Figure 5 Flowchart for obtaining the mapping result of the data source diversion path of the present invention; Figure 6 Flowchart for executing the data asset sharing operation of the present invention. Detailed implementation manners

[0016] In order to make the objectives, technical solutions and advantages of the present invention clearer and more understandable, the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0017] In the description of the present invention, it should be understood that the orientation or positional relationship indicated by the terms "length", "width", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", etc. is based on the orientation or positional relationship shown in the accompanying drawings, and is only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and thus should not be construed as a limitation to the present invention. In addition, in the description of the present invention, the meaning of "a plurality of" is two or more unless otherwise specifically defined.

[0018] Please refer to Figure 1 , a data asset sharing method based on Fangyuan Cloud, comprising the following steps: S1: Obtain the first-layer field labels and corresponding data type information of the data structure of the data source to be accessed on the Fangyuan Cloud platform, extract the field name character set and field data type, combine the encoded mapping of the field name character set with the field data type value, unify the data structure expression, and establish a standardized list of the data structure; S2: According to the records of each field label in the standardized list of the data structure, count the unique matching quantity and the number of repeated jump fields of the corresponding field labels of the data sources already accessed in the current Fangyuan Cloud environment, respectively make interval judgments with the sharing threshold and the jump tolerance value. When the unique matching quantity meets the sharing threshold, extract the remapping candidate field pairs, synthesize and score the weight of the difference in the character set encoding quantity and the difference in the type expression vector of the remapping candidate field pairs, and screen the field pairs with the optimal score as the structure adaptation result to establish a remapping list of shared data fields; S3: Obtain the data source resource request information entering the sharing stage, record the business scenario identifier to which it belongs, combine the path status, current occupancy, and resource priority threshold in the shared path status library, extract the path numbers with the resource usage status being idle, aggregate them into shareable path groups according to the business scenario to which they belong, and obtain the shared path allocation candidate list; S4: Based on all path records in the shared path allocation candidate list, retrieve the usage priorities corresponding to all path numbers in the occupied state, compare the priority of the data source to be connected with the priorities in the current occupancy status record. If there is a priority conflict for the current path, allocate an alternative path number in the same business scenario for the current requested path and establish a diversion identifier to generate the data source diversion path mapping result; S5: According to the mapped relationship fields that have been completed in the data field sharing remapping list and the path allocation numbers in the data source diversion path mapping table, combine the field remapping field pairs and path numbers for data path docking, and perform the data asset sharing operation.

[0019] The data structure standardization list includes field name mapping rules, field type expression models, and standardized field identifier sets. The data field sharing remapping list includes field remapping pairs, structure adaptation scores, and shared field unique identifiers. The shared path allocation candidate list includes a path number set, business scenario path groups, and available status identifiers. The data source diversion path mapping result includes alternative path numbers, diversion identifiers, and priority comparison tables. The data asset sharing operation includes path number field docking sets, mapped field data streams, and shared operation execution tags.

[0020] Please refer to Figure 2 , and the steps of S1 are as follows: S111: Obtain the first-layer field label information exposed by the data source to be connected in the Fangyuan Cloud Platform, detect the data type values corresponding to the field labels, call the field label character set and field type mapping rules, perform item-by-item encoding conversion on the character set in the field labels, and splice and integrate them with the field type information to generate the field structure encoding combination result; Obtain the first-level field label information exposed by the data source to be connected in the Fangyuan Cloud Platform, that is, extract the field names and data types from the structured data. For example, in a certain water quality monitoring, fields such as "dissolved oxygen", "temperature", "pH value", etc. and their corresponding types are "floating point number", "integer", "floating point number". It is necessary to detect each field label item by item to confirm whether it conforms to the character set rule. For example, the character set is restricted to be composed of English letters and underscores. During the detection, it is found that the field "dissolved_oxygen" is legal, and "pH value" is illegal. After disassembling it into "pH_zhi" and then mapping it, the mapping operation of the character set can refer to the ASCII coding table. Each character is mapped to a two-digit code, such as "_" is mapped to "5F", and "p" is mapped to "70". Further combine the fields to form a complete character coding string, and then generate a combined coding value according to its data type. For example, "pH_zhi" is "70485F7A6869", and the data type is float, and the type value setting code is "02", and finally combined into "70485F7A686902". The above operations are carried out in units of fields. After generating the combined coding for all fields, it is necessary to splice the field label coding and the data type coding to facilitate subsequent judgment of the duplication rate and coding rules. The coding of the field name "Temperature" is "54656D7065726174757265", the data type is float, and the coding is "02", combined into "54656D706572617475726502". This structure is used to construct a metadata index table in the actual business scenario, such as judging the coding consistency of sensor fields in different regions in the urban pipe network real-time monitoring system. After completing the structure splicing, write all the encodings into the total field structure table and establish a mapping index to assist in subsequent identification of field duplication situations and mapping relationships, such as the combined result of the field structure coding.

[0021] S112: According to the combined result of the field structure coding, screen the field items in the field whose character set coding duplication rate exceeds the standard coding duplication threshold, count the number of duplicate combinations existing in the corresponding field types, and obtain the distribution range interval values of the field character sets under different types, and generate field coding distribution interval data; Based on the combined result of field structure encoding, it is necessary to screen out the fields with a character set encoding repetition rate exceeding the threshold from the combined encoding values. First, set the encoding repetition threshold to 60%. That is, if the proportion of repeated characters in the character encoding of any field exceeds 60% of the total length, it is considered that there is redundancy or naming conflict. Count the number of such fields and mark them. For example, the encoding of field A is "616161626364", and the proportion of the repeated character "61" is 50%, which does not exceed the threshold and is not marked; the encoding of field B is "707070707273", and the proportion of the character "70" is 66.7%, which is marked as a repeated field. Further, count the distribution of various data types in the repeated fields. For example, 10 items are marked in integer fields and 8 items are marked in floating-point fields. Then, count the character set encoding length range corresponding to each field type. For example, the average length of integer fields is 8 bytes, and the average length of floating-point fields is 10 bytes. Construct the encoding length distribution interval of fields under different data types, and classify and judge the landing points of each field within the type range to determine whether it is in the abnormal range. The specific threshold is determined by the sample mean and standard deviation. If the encoding length of a certain field falls outside the mean ± 2 times the standard deviation, it is recorded as abnormal. Use the data of a monitoring platform with a sample size of 100 to construct the standard, as shown in the following table.

[0022] Table 1 Sample Table of Field Encoding Structure: ; As shown in Table 1, the proportion of repeated characters in the field "Chloride" is 0.67, exceeding the set threshold of 0.6, so it is included in the set of fields with abnormal encoding. After screening and counting all fields, combined with the distribution, draw an interval judgment graph, and further obtain the field encoding distribution interval data under each type.

[0023] S113: Based on the field encoding distribution interval data, judge the type consistency degree of each field after encoding mapping, and call the type mapping quantity corresponding to the field label character set and the field structure encoding length. Use the formula: ; Calculate the cross-type field structure encoding consistency difference value , judge whether field reconstruction is required, and establish a data structure standardization list. Among them, represents the type mapping quantity of the th field, represents the character set encoding repetition rate of the th field, represents the character set length of the th field, represents the encoding combination length of the th field, represents the total number of type mapping fields, Indicates the total number of encoding length fields; Based on the above field encoding distribution interval values, judge the consistency of the type mapping between fields. If a field has corresponding values in multiple types but the encoding differences are significant, it indicates that there are differences in the naming specifications of the field. It is necessary to compare the character set lengths and mapping quantities of the field under different types, and then calculate the structural consistency based on this.

[0024] : The number of type mappings of the field, indicating the number of different data types corresponding to the field in the system. For example, the field "temperature" is mapped to int, float, and double in 3 tables respectively, so ; : The encoding repetition rate of the field, such as 0.64; : The character set length of the field, such as "dissolved oxygen" is 8; : The encoding combination length of the field, such as 12; , ; Substitute the sample data: ; ; ; The result shows that the structural encoding consistency difference value is 43.1, indicating that there are significant differences between the current fields. The system can judge whether it meets the access standard structure based on this. If it is regarded as standard consistent (the setting basis of the standard value 20 is the average structure deviation tolerance generated by the analysis of field encoding in multiple types of structured data systems. In its calculation process, the conventional fluctuation ranges of the field mapping quantity, field encoding length, and encoding repetition rate are comprehensively considered, and the median deviation amount is used for truncation setting. The specific setting is as follows: in each type of data source structure, the average encoding length of the field is set to 10 bytes, the average character repetition rate is 0.5, and the number of type mappings usually does not exceed 4. The three together constitute a floating interval with a difference value fluctuating between 18 and 22. Therefore, the standard consistency judgment threshold is set to 20. This threshold will show an upward trend when the field mapping scale expands and the field character complexity increases, and tends to decrease in an environment with high field standardization concentration, so as to ensure the discrimination accuracy during field encoding quantization and at the same time limit the access of unreasonable field structures), otherwise field reconstruction is required, and finally a data structure standardization list is obtained.

[0025] The operation logic of this formula is designed based on the comprehensive measurement method of structural coding differences in different dimensions. First, two sets of parameter collections are introduced in the numerator part. One set is the product term of the number of field type mappings and the coding repetition rate, which represents the number of redundant structural mappings of each field in multiple data types. Taking the square root of the coding repetition rate is to moderately amplify the weight of highly repetitive fields while controlling the non-linear impact of extremely high repetition values on the overall calculation. The other set is the product of the field character set length and the coding combination length, which reflects the complexity of the field coding itself in the character dimension and the structure dimension. These two sets represent structural extensibility and redundancy characteristics respectively. Therefore, through the difference between these two sets of values, the structural inconsistency degree between the mapping quantity and the coding complexity of the field is reflected. In the final calculation, the denominator is normalized, representing the combined count of the number of field samples, ensuring the comparability of structural differences under different sample scales. Taking the absolute value in the overall structure is to avoid interference caused by the difference direction to the result interpretation, so that the structural deviation intensity across fields is stably expressed.

[0026] Please refer to Figure 3 , and the steps of S2 are as follows: S211: Based on the matching relationships between the field labels in all the connected data sources in the current Fangyuan Cloud Platform and the standard field labels recorded in the data structure standardization list, call the field label set and the data source field label set for item-by-item comparison, obtain the number of unique labels corresponding one-to-one to the standard field labels in each data source, and accumulate the occurrence frequency of label repetitions to obtain the number of unique matches and the number of repeated jumps of the field labels; Based on the field label content recorded in the data structure standardization list, obtain the standard field name, character set encoding value, and field type in the list as matching benchmarks. Extract the field label set in the connected data source item by item, and call the character set encoding values of each field label for comparison operations. Use the same character set encoding value for one-to-one matching. If the character sets are exactly the same and the field types are the same, it is regarded as the only matching field, record its position index in the current data source, and at the same time call the occurrence frequency of each field label in different data sources, and accumulate the number of times the same label appears repeatedly in multiple sources as the jump number. The following example is used to illustrate: The standard field label is "customer_id", the character set encoding is "CU123", and the field type is "integer". There is a field "cust_id" in data source A, its encoding is "CU123", and the type is "integer", so it is the only matching field, and record the field index position as A1. Repeated jump fields such as the field "region_code" exist in data sources B, C, and D, with encodings of "RC001", "RC002", and "RC003" respectively. The field types are the same but the encodings are different, and the cumulative jump number is 2; then calculate the number of unique matches and the number of jump fields. Suppose there are a total of 30 standard fields, and 50 data source field labels are extracted on the current platform, of which the number of matching fields is 18 and the jump field count is 9. According to the set sharing threshold of 50% of the standard field number, that is, 15, and the jump tolerance value of 10, it is judged that the number of unique matches 18 > 15 and the jump number 9 < 10, which meets the field remapping judgment condition, and obtains the number of unique matches and the number of repeated jumps of the field label.

[0027] S212: According to the number of unique matches and the number of repeated jumps of the field label, make interval judgments with the sharing threshold and the jump tolerance value respectively, extract the data source fields that meet the sharing threshold, and correspondingly generate a set of field pairs that can be replaced and connected. Call the character set encoding set of the field label and the field type vector set, and calculate the number of character set encoding differences and the field type expression vector differences between the field pairs respectively. Use the formula: ; Calculate the composite score of the character set difference and type expression offset of the field pair , screen the minimum score among all field pairs to obtain the field structure adaptation result. Among them, represents the th candidate character set encoding value of the field, represents the th standard character set encoding value of the field, represents the th candidate type expression vector value of the field, represents the th standard type expression vector value of the field. Indicates the number of coding difference items, indicating the number of type expression dimensions; According to the unique matching quantity and repeated jump quantity of field tags, after satisfying field sharing and jump tolerance, all remappable field pairs are extracted from the matching field set, and the corresponding character set encoding values and type expression vector values of the field pairs are called. Assume that field pair D1 is the standard field "order_amount" and the data source field "ord_amt", and the character set encodings are "OA456" and "OA467" respectively. Then, the ASCII code differences between the corresponding positions of each character form a character set difference value array {0, 0, 0, 1, 1, 0}. After taking the absolute value and summing, the difference quantity is 2. Assume that the type expression vector is {1, 0, 0, 1} for the standard field and {1, 1, 0, 0} for the data source field. The vector difference is {0, -1, 0, 1}, and the sum of squares is 2. After taking the square root, the result is approximately 1.414. The same operation is performed for each candidate field pair, and calculations are carried out using the formula.

[0028] Assume that the character set encoding difference value array in the current field pair is {2, 1, 0, 1, 0, 0}, then , the average difference is , the type expression vector dimension is 4, and the sum of squared differences is 2, then the vector distance is , then: ; After collecting the scores of all field pairs, select the field pair with the minimum score as the structure adaptation field group, and then obtain the field structure adaptation result.

[0029] Table 2 lists the coding differences and type vector values of the example field pairs: Table 2 Field Pair Adaptation Parameter Table: ; As shown in Table 2, the score of the field pair "order_amount - ord_amt" is 1.374, which is better than other field pairs and is selected as the adapted field.

[0030] The operation logic of this formula is based on two core dimensions: the difference in field character set encoding and the deviation degree of the field type expression vector. The former calculates the sum of the absolute values of the encoding differences at each character position and takes the average value to reflect the proximity of field labels at the character level, which is applicable to detecting whether there is structural convergence in field naming among different data sources. The latter obtains the Euclidean distance by taking the square root of the sum of the squares of the vector differences, which is used to characterize the similarity of fields in semantic or type expression, thereby reflecting their compatibility at the functional dimension. The two parts measure the matching quality from the structural and semantic perspectives respectively, and use an additive structure to weight and fuse them to form a comprehensive adaptation score. The use of absolute value and average value operations in the character set part is to weaken the fluctuation impact of field length on the score, while the use of square root after square difference in the vector part is to conform to the standard geometric representation of distance measurement in the vector space. The entire formula structure realizes dimension unification through a simple linear combination method, enabling the differences at the character encoding level and the semantic level to be comprehensively expressed under the same dimension, and further providing a clearer and more complete adaptation evaluation basis in the field remapping evaluation.

[0031] S213: Based on the field structure adaptation results, select the field pairs with the minimum scores by sorting according to the score values, identify them as high-adaptation field combinations, and form field pair entries by combining their original field labels and standard field labels. Combine and summarize them to form a field mapping record set, and establish a data field sharing remapping list; According to the field structure adaptation results, sort all candidate field pair results in ascending order and select the field group with the lowest score as the high-adaptation field combination. Form paired records from the corresponding data source field labels and standard field labels, and aggregate information such as field labels, matching sources, and score values into a set of mapping entries. Classify and label them according to the field group dimension in the list structure to generate a structured list, and form a data field sharing remapping list. For example, the standard field "customer_email" and the data source field "cust_mail" form a field pair, the matching source is data source C, and the adaptation score is 1.092. The combination result is written into the shared remapping list table, and the list entry format is as follows: ["customer_email", "cust_mail", "source: C", "score: 1.092"]. Store all field pair combination records as shared remapping content for subsequent structural access and call, and finally establish a shared and recognizable remapping path and output it to a list file in JSON or CSV format for docking and unified recognition.

[0032] Please refer to Figure 4 , and the steps of S3 are as follows: S311: Obtain the data source resource request information entering the sharing phase, extract the corresponding data source number and field mapping records, collect the business scenario identification items in the associated data source resource request entries, and perform labeled mapping on the data source resource request information according to the business scenario identification to obtain the business scenario identification mapping result; To obtain the data source resource request information entering the sharing phase, it is necessary to first clarify the data source number and field mapping records included in the field structure adaptation result. For the data source number, it can be directly extracted through the source system unique identification field attached in the resource request record. For example, in the resource request record table, the field "source_id" is "DS202404", indicating that it comes from the system with the data source number DS202404. After extracting this number, the "source_id" field in the field mapping record table can be called for joint matching to obtain the detailed field mapping corresponding to this data source, and further extract the field names, field standard labels, and field adaptation levels involved to form a set of field adaptation details; To collect the business scenario identification items in the associated data source resource request entries, it is necessary to locate the "business_tag" field in the data source resource request record. Based on the data recorded in this field, such as "BIZ-CUST", it is determined that it belongs to the business scenario of customer information classification. If there are multiple business scenarios, each record needs to be independently marked and then classified; During the process of performing labeled mapping on the data source resource request information according to the business scenario identification, it is necessary to perform an aggregation mapping operation on the data source number and the business scenario identification. For example, in a resource request record, source_id is DS202404 and business_tag is BIZ-CUST, and an aggregation key "DS202404_BIZ-CUST" can be constructed. By constructing this aggregation identifier, the request records of all data sources can be classified to achieve resource request grouping at the business scenario level.

[0033] In actual operation, if the resource request records are collected as shown in the following table: Table 3 Resource Request Record Table: ; As shown in Table 3, they respectively represent three business scenarios of customer, finance, and operation. When constructing the mapping, they are respectively identified as "DS202404_BIZ-CUST", "DS202405_BIZ-FIN", and "DS202406_BIZ-OPS". In this way, the business channels involved in the subsequent resource path allocation can be classified, and finally the business scenario identification mapping result can be obtained.

[0034] S312: According to the mapping result of the business scenario identifier, call the path number set, path status set, and current path occupancy set in the shared path status library, extract the list of path numbers with the current path status being assignable and the occupancy flag being empty, detect the resource priority threshold associated with each path number, aggregate each path number by business scenario, and obtain the group of shareable path numbers; According to the mapping result of the business scenario identifier, it is necessary to call the path number set, path status set, and current path occupancy set from the shared path status library. The path number set is read through the field "path_id", such as "PATH_01". The value of the field "status" in the status set is "assignable" or "occupied", and the "occupy_flag" in the current occupancy set is a boolean value indicating whether it is occupied; in the process of extracting the list of path numbers with the current path status being assignable and the occupancy flag being empty, two screening conditions need to be met simultaneously, that is, the value of the status field is "assignable" and the value of the occupy_flag field is False. For example, if a path number is PATH_07, status is "assignable", and occupy_flag is False, then this path can enter the next judgment; when detecting the resource priority threshold associated with each path number, it is necessary to extract the priority field "priority_threshold". For example, the priority threshold corresponding to a path PATH_07 is 75, and this value represents that the allocation priority requirement needs to be higher than 75 to enter the sharing process; make a difference judgment and quantity calculation between the resource priority threshold and indicators such as the current request intensity, idle duration, cumulative occupancy times, and total request volume. Among them, the current request intensity is determined by the resource request frequency of each business scenario. For example, if the number of resource requests for the business scenario BIZ-CUST in the recent 5 days is 20 times, then its request intensity value can be set to 20. The idle duration is the time interval since the last allocation, in hours. If PATH_07 was last used 48 hours ago, then the idle duration is 48 hours. The cumulative occupancy times are read through the field "use_count", such as 32 times, and the total request volume field "req_total" is the cumulative value of recent request data, such as 65 times. Perform difference or relative quantization processing according to such indicators and uniformly use a standardized method for subsequent grouping and screening; in the process of aggregating each path number by business scenario, use the business scenario as the index field to aggregate all path number sets that meet the above conditions. For example, if the set of assignable path numbers under the business scenario "BIZ-CUST" is [PATH_03, PATH_07, PATH_09], then this set is the path candidate number for this scenario, and finally obtain the group of shareable path numbers.

[0035] S313: Based on the shareable path number group, combined with the business scenario identifier of the business to which it belongs, integrate all the shareable path numbers under each type of business scenario into one type of shared path access, and establish a shared path allocation candidate list; When reading the shareable path number group, it is necessary to clarify the aggregated path number array under each business scenario, and perform horizontal integration processing in combination with the business scenario identifier field. For example, for the "BIZ-CUST" scenario, its corresponding path number set is [PATH_03, PATH_07, PATH_09], then this array can be regarded as the available path pool for this scenario in the subsequent process; in the process of integrating all the shareable path numbers under each type of business scenario into one type of shared path access, it is necessary to perform normalization identification processing on the path number array and construct an access identifier field. For example, use "SHR-BIZ-CUST" to identify the shared path set PATH_03, PATH_07, PATH_09, and similarly "SHR-BIZ-FIN" is used to identify PATH_04, PATH_08, etc.; when generating the path number record table that can be used for shared allocation under each type of business scenario, it is necessary to construct a structured output table or record file, and the fields need to include business scenario identifier, shared path number, path status identifier and other fields. In the process of data structure sorting, if there are no allocable paths in a certain scenario, the shared path access under the business scenario identifier of this item is empty, so as to avoid cross-scenario resource mixing; finally, integrate all scenario identifiers and their shareable path number combinations to establish a shared path allocation candidate list.

[0036] Please refer to Figure 5 , the steps of S4 are as follows: S411: Based on all the path numbers in the shared path allocation candidate list, retrieve the path number items that are currently in the occupied state in the path status field, collect the usage priority values registered in the resource usage records associated with the path numbers, and compare the resource priority values in the resource request of the data source to be accessed, and count all the conflicting path number sets to obtain a priority conflict path number group; When obtaining all path numbers in the shared path allocation candidate list and retrieving the path number items that are currently in the occupied state, it is first necessary to extract all path records from the shared path list, perform a retrieval operation on the status field of each path, and identify the path entries marked as "occupied". For example, if the statuses of path numbers P01, P03, and P07 are all "occupied", then these three numbers are extracted for subsequent analysis. Next, for each occupied path number, query its resource usage record field and extract its usage priority through the priority record value in the field. For example, the priority of P01 is 3, P03 is 2, and P07 is 5. Here, the priority value is numeric, and the larger the value, the higher the priority. These priority values are used as reference indicators for the occupied state of existing resources. Subsequently, extract the priority information corresponding to the data source to be accessed currently. Assume that a data source access number is DS001 and its resource priority is 4. At this time, it is necessary to compare the priority of DS001 with the priorities of the above path numbers item by item. For example, the comparison result with the priority of P01 (3) is a conflict (because 4 > 3), and the comparison result with P07 is non-conflict (because 4 < 5). Thus, it is judged that DS001 has a priority conflict with P01 and P03, but there is no conflict with P07. Output the conflict path numbers P01 and P03 as the priority conflict path set to obtain the priority conflict path number group. In this process, the judgment basis for priority conflict can set the priority conflict determination reference value to 1, that is, when the difference between the priority value of the accessed data source and the priority value of the occupied path is greater than or equal to 1, it is determined as a conflict. This set threshold comes from the unified priority suppression standard of the system. Table 4 lists the status and priority of some paths for reference.

[0037] Table 4 Path Status and Priority Table: ; As shown in Table 4, by comparing the current priority of the path with the priority value of the data source, it is possible to effectively identify the priority conflict path numbers. In actual implementation, such item-by-item comparison needs to be performed for each access judgment. The "priority" field in the execution process is generally obtained from the system initialization resource weight configuration, and the conventional setting range is between 1 and 10. The higher the value, the stronger the priority. This priority field does not directly calculate using weight parameters, but is based on a predefined static hierarchy system of the system scheduling strategy and is dynamically associated and marked through resource occupancy information.

[0038] S412: According to the priority conflict path number group, screen the unoccupied shareable path numbers in the same business scenario, and perform number pairing attempts with the judgment conditions that the path status is idle and the business scenario identification belongs to the same. Use the formula: ; Calculate the difference score value between the resource usage deviation degree and the priority reconstruction adaptation value for each pair of path numbers , select the path number with the smallest scoring value as the alternative path number, and mark and record it to generate the alternative path mapping scoring result, where represents the resource request intensity of the th conflict path, represents the resource idle level of the th alternative path, represents the load cycle value of the th alternative path, represents the priority difference of the th conflict path, represents the cumulative occupation duration of the th path, represents the remaining available cycle number of the th path, is the number of conflict paths, is the number of path priority difference items; When screening the unoccupied path numbers in the same business scenario for diversion and alternative allocation according to the priority conflict path number group, first, according to the path numbers P01, P03 obtained in the previous paragraph and their business scenario identification information, for example, both belong to the business scenario "BIZ_A", retrieve all path numbers with the path status of "idle" and the business identifier of "BIZ_A" in the shared path allocation candidate list, such as path numbers P05, P08. Then, judge whether these candidate paths meet the alternative conditions. Here, it is necessary to perform arithmetic comparisons on parameters such as resource usage intensity, idle level, and load cycle. Let the resource request intensity of P01 be 65, the idle level of P05 be 80, and the load cycle be 4, that is: , , ; , , ; , , ; , , ; Substitute into the formula for calculation as follows: The first part: ; ; ; The second part: ; ; ; Substitute as a whole to get: ; The final score value is 24.2912. Similarly, perform the same calculation process for other paths such as P08, and select the path with the smallest score value as the alternative path. The smaller this value is, the weaker the overall deviation and priority contradiction are, and it is more appropriate as the alternative number configuration. The benefit of the formula is that by introducing a dynamic ratio structure between the resource request intensity and the resource idle level, and at the same time superimposing the path load cycle adjustment factor and the priority difference quantitative accumulation, the adaptation and difference control of the conflict path to the service equivalent idle path are realized. Finally, the alternative path mapping score result is obtained.

[0039] The operation logic of the formula is to uniformly measure and quantitatively evaluate the resource request characteristics and path availability characteristics, so as to realize the differential scoring of the adaptability of the alternative path. The formula structure is divided into two parts. First, the left summation term is used to measure the relative deviation between the resource request intensity of the conflict path and the idle level of the candidate path. The deviation is attenuated by the square root value of the path load cycle to introduce an adjustment coefficient in the time dimension and avoid the extreme influence of short-term path fluctuations on the judgment. And the right summation term represents the comprehensive adjustable evaluation of the alternative path under the priority difference and its cumulative occupied duration and the remaining available cycle . The absolute value operation processes the priority direction to avoid the cancellation of positive and negative errors. At the same time, the addition is used to integrate the priority adaptation error and the path stability index. Finally, by taking the absolute value of the difference between the scores in the two directions, the overall stability deviation of the alternative path adaptation is obtained. This logic integrates multi-dimensional indicators through addition, realizes the constraint control of the cycle factor through division, and realizes the non-linear scaling of the volatility factor through square root extraction, so as to establish a multi-factor fusion adaptation mechanism that takes into account resource load differences, priority contradiction degrees and path availability trends.

[0040] S413: According to the alternative path mapping score result, select the path number with the smallest score value corresponding to each conflict path as the alternative path number, bind it to the original conflict path number, and establish a shunt identification record item to establish the data source shunt path mapping result; After obtaining the alternative path mapping score value, select the path number with the smallest score and bind it to the original conflicting path number for configuration, form a mapping pair and register the shunt identifier. This operation needs to traverse all conflicting paths and correspond to their optimal alternative paths in terms of scores. In the example, the score of P01 is 24.2912, and the corresponding alternative path is P05. If the path with the smallest score for P03 is P08, then establish the alternative binding relationships of P01→P05 and P03→P08 respectively. At the same time, write the shunt status identifier field to P05 and P08, and the identifier status bit is "1", which is used to distinguish the directly allocated path and the shunt path in subsequent scheduling. Finally, generate a set of mapping entries according to the data source number. For example, DS001 contains two binding relationships of P01→P05 and P03→P08, and integrate them to form the mapping result of the data source shunt path. In this process, there is no need to repeatedly judge the resource status and priority, and only call the sorting of the scoring results and execute the binding operation. This result shows that the shunt path forms the optimal docking through quantitative scoring in both resource status determination and alternative path matching, and can effectively realize the structural mapping reconstruction between the data source and the path resources.

[0041] Please refer to Figure 6 , step S5 is as follows: S511: According to the field mapping field pairs recorded in the data field sharing remapping list, obtain the corresponding relationship between the standard field and the original field in each pair of fields. Combine the set of path numbers already allocated in the data source shunt path mapping result, and perform a joint matching of the field mapping field pairs and the path numbers according to the data source number, and merge and combine the field mapping field pairs and the path numbers to obtain a field-path combination comparison table; According to the path numbers in the data source shunt path mapping result corresponding to the field mapping field pairs recorded in the data field sharing remapping list, it is necessary to combine the field pairs and path numbers and establish a field-path combination comparison table. First, extract each pair of field names in the field pairs, and identify their source fields and target fields. Identify the path number corresponding to the field in the field hierarchy structure. By querying the path number set, establish the association relationship between the field and the path. For example, if the original field name is "Customer Number" and the target field is "Customer ID", and the source data source is A1 and the assigned path number is P13, then a mapping item of "Customer Number - Customer ID - P13" is formed. Then, summarize multiple mapping items into a field-path combination set. During this process, it is also necessary to further analyze the table structure to which each field belongs and the transmission type label of the path number. If the table to which the field belongs is the "Customer Information Table" and the path transmission type is the "High-Speed Sharing Path", then the path label needs to be added to the combination information to complete the pairing identification of the field and the path transmission attribute. The actual processing example is that if the A1 data source contains a field group [User ID, Transaction Amount, Transaction Time] mapped to the target fields [UID, Amount, Timestamp], and their path numbers are P101, P102, and P103, then three groups of field-path records are combined, such as "User ID - UID - P101", "Transaction Amount - Amount - P102", and "Transaction Time - Timestamp - P103". To further refine the corresponding relationship between the path number and the field in this combination table, it is necessary to call the shared path allocation record, and compare each source field in the field mapping table item by item in the path allocation record to verify whether there is a direct association with the path number. Determine whether the combination is successfully established through boolean matching. The judgment criterion is that the source field name exists in the corresponding data source field list in the path allocation record and has a one-to-one mapping relationship with the target field. Under the condition that this condition is established, write the three items of the source field, target field, and path number into the field-path combination table, as shown in Table 5.

[0042] Table 5 Field-Path Combination Record Table: ; As shown in Table 5, the field-path combination record table clearly lists the one-to-one correspondence between the field mapping and the path number, reflecting the basic information structure of the field channel connection. The path number needs to come from the actual available path numbers, and the field pairs are extracted according to the data field sharing remapping list. Only some field-path combination entries are listed in this table. All combined data needs to be dynamically generated in the system and then batch recorded and stored in the database. The field-path combination comparison table is used as the basic input for subsequent field structure verification and shared docking, with high stability and adjustable structure.

[0043] S512: According to the field path combination comparison table, extract the field character set encoding and field type vector in all field pairs, call the resource type label, business scenario identifier, and path transmission capacity associated with the path number, compare the field structure information and the path resource structure characteristics item by item, confirm the structural matching and resource accessibility between the two, and obtain the field path combination records with successful structural matching; According to the corresponding items of the field paths listed in the field path combination comparison table, to verify their adaptation between the structure and resources, it is necessary to call the character set encoding and field type vector in the field pair item by item, parse the character set encoding length and encoding rule of each pair of fields at the field level, obtain their respective character types (such as ASCII, UTF-8, etc.), and at the same time count the dimension and unit definition of the field type vector. For example, the field "Customer ID" uses UTF-8 encoding, the character set length is 10, the field type is "string", and the corresponding type vector dimension is 1. While the field "Amount" is of floating-point type, the vector dimension is 2. The corresponding structure type needs to match the resource label and path capacity value defined by the path number. The path number information is provided by the shared path allocation record. The field docking path number is P101, the label is "Financial Numerical Channel", and the capacity is 100 Mbps. The structural adaptation needs to meet two conditions. One is that the field type should be consistent with the path label. For example, a numerical field is docked to a financial channel. The other is that the path capacity should not be less than the field data rate requirement. For example, the size of a single record of the field "Transaction Amount" is 8 bytes, and 1000 records are processed per second. The required bandwidth is 8×1000 = 8000 bytes, that is, 64 kbps, which is much less than the path capacity and can be determined to be a match. The field "Transaction Time" uses the timestamp encoding format, with a size of 6 bytes and the same rate, so the required bandwidth is 6×1000 = 6000 bytes, that is, 48 kbps, which also meets the path transmission capacity. Then, the field character set encoding value and the path number bandwidth capacity value are compared side by side. If the difference is within the allowable range (set as the maximum transmission difference threshold of 10%), it is determined to be a match. The encoding length of the field "UID" is 8, the capacity of path P101 is 150 Mbps, and the field data transmission rate is 64 kbps, with a ratio of 0.0426%, which is much lower than 10%, so it can be determined that the structural adaptation is successful. Furthermore, register the field path records with successful adaptation in the combined information. This process needs to traverse all combined items and judge the compatibility between the field and the path structure item by item. If any inconsistency is found, mark it as "not dockable" in the record table, and then perform abnormal path reconstruction. The final structural path adaptation value is returned to the system as the field docking determination result.

[0044] S513: Based on the field path combination records with successful structural matching, extract the field path combination records that meet the path access conditions as the formal connectable field data path mapping relationship, establish a data path docking relationship with the path number according to the field mapping order, and perform the data asset sharing operation; After obtaining the records of the structural matching successful field path combinations, extract all the field path combination records marked as "structural adaptation successful", bind and combine the corresponding field pairs with the path numbers, and establish a formal field data path mapping relationship table. This table should include three items: field source, field target, and bound path number, and be sorted in the order of the business tables where the fields are located to ensure the maintainability of field consistency when exporting data and docking with business modules. The binding order uses the field serial numbers of the original fields in the source system table. For example, the field "User ID" has a field number of 1 in the user table, the corresponding target field is "UID", its path number is P101, and the sorting is the first record. The field "Transaction Amount" has a field number of 2, the path is P102, and the sorting is the second record. Build the field path docking table structure accordingly. Subsequently, generate a data asset sharing value, which is a numerical data recording the number of successfully docked field path mappings, and is statistically calculated by the number of successfully docked fields. In this example, the number of successfully docked fields is 3, so the data asset sharing value is 3. This value is used as the measurement basis for the shared resource allocation comparison module in the subsequent system. If this value is lower than the allowable lower limit of resource allocation (such as set to 2), the system will automatically abort the shared path allocation process and re-evaluate the field matching scheme. Otherwise, it can be considered that the data path configuration of the current data source is effective. Finally, enter the data sharing stage to execute the data asset sharing operation.

[0045] A data asset sharing system based on Fangyuan Cloud, including: The data structure standardization module obtains field label and type information, extracts the character set and encodes and maps the combination to unify the structural expression, and generates a data structure standardization list; The field mapping and screening module, based on the data structure standardization list, counts the number of unique field matches and the number of jump variables, judges whether the sharing threshold and jump tolerance value are met, extracts candidate field pairs, calculates the difference in character set encoding and the difference in type expression vectors, performs weight scoring, screens the field pairs with the optimal score to establish an adaptation relationship, and generates a data field sharing and re-mapping list; The resource request analysis module obtains resource request information and scenario identifiers, screens for idle paths in combination with path status and occupancy, and builds a shareable path group according to the business scenario to obtain a candidate list for shared path allocation; The path priority conflict resolution module, according to the candidate list for shared path allocation, compares the data source priority and the occupied path priority. If there is a conflict, it allocates an alternative path in the same scenario and generates a data source diversion path mapping result; The data sharing execution module combines the data field sharing and re-mapping list with the data source diversion path mapping table, performs data path docking, and executes the data asset sharing operation.

[0046] The above are only the preferred embodiments of the present invention, and are not intended to limit the present invention in other forms. Any person skilled in the art may use the technical content disclosed above to make changes or modifications into equivalent embodiments with equivalent changes and apply them to other fields. However, as long as it does not depart from the technical solution content of the present invention, any simple modification, equivalent change and modification made to the above embodiments based on the technical essence of the present invention still fall within the protection scope of the technical solution of the present invention.

Claims

1. A data asset sharing method based on Fangyuan Cloud, characterized in that: The following steps are involved: S1: Obtain the data structure information of the data source to be connected on the Fangyuan Cloud Platform, encode and map the field name character set and combine it with the field data type value to establish a standardized list of data structures; S2: According to the standardized list of data structures, the number of unique matches of field labels corresponding to statistical data sources and the number of repeated jump fields are counted, the sharing threshold and the jump tolerance value are compared, the remapping candidate field pairs are extracted and weighted synthesis scores are performed, and a data field sharing remapping list is established; S3: Obtain resource request information of the data source in the sharing phase, record the business scenario, extract the idle path number, aggregate them into a shareable path group according to the business scenario, and obtain a candidate list of shared path allocation; S4: based on the shared path allocation candidate list, retrieve the usage priority corresponding to the path number in the occupied state, compare the priority of the data source to be connected, and if there is a priority conflict, allocate an alternative path number to generate a data source diversion path mapping result; S5: According to the data field sharing remapping list and the data source diversion path mapping table, the combined field remapping field pairs are connected to the path numbers for data path docking, and the data asset sharing operation is performed.

2. The data asset sharing method based on Fangyuan Cloud according to claim 1 is characterized in that: The data structure standardization list includes field name mapping rules, field type expression model, and standardized field identifier set; the data field shared remapping list includes field remapping pairs, structure adaptation scores, and shared field unique identifiers; the shared path allocation candidate list includes a path number set, a business scenario path group, and an available status identifier; the data source diversion path mapping result includes an alternative path number, a diversion identifier, and a priority comparison table; the data asset sharing operation includes a path number field docking set, a mapping field data flow, and a shared operation execution tag.

3. The data asset sharing method based on Fangyuan Cloud according to claim 1 is characterized in that: The steps for obtaining the standardized list of data structures are specifically as follows: S111: Obtain the first-level field label information exposed by the data source to be connected in the Fangyuan Cloud Platform, detect the data type value corresponding to the field label, call the field label character set and field type mapping rules, perform encoding conversion on the character set in the field label item by item, and integrate it with the field type information to generate a field structure encoding combination result; S112: According to the field structure code combination result, filter the field items whose character set code repetition rate exceeds the standard code repetition threshold in the field, count the number of repetition combinations existing in the corresponding field type, and obtain the distribution range interval value of the field character set under different types to generate field code distribution interval data; S113: Based on the field code distribution interval data, determine the type consistency of each field after code mapping, and call the type mapping quantity and field structure code length corresponding to the field label character set, using the formula: ; Calculate the cross-type field structure encoding consistency difference value , determine whether field reconstruction is needed and establish a standardized list of data structures, where: Indicates The number of type mappings for fields, Indicates The character set encoding repetition rate of the fields, Indicates The character set length of the field, Indicates The length of the encoded combination of fields, Indicates the total number of type mapping fields. Indicates the total number of coded length fields.

4. The data asset sharing method based on Fangyuan Cloud according to claim 1 is characterized in that: The steps for obtaining the data field sharing remapping list are specifically as follows: S211: Based on the field label information recorded in the data structure standardization list, the matching relationship between the field labels in all the connected data sources in the current Fangyuan cloud platform and the standard field labels is counted, and the field label set is called to compare with the data source field label set item by item to obtain the number of unique labels in each data source that correspond to the standard field labels one by one, and the frequency of repeated occurrence of the labels is accumulated and counted to obtain the number of unique matches and repeated jumps of the field labels; S212: Based on the number of unique matches and repeated jumps of the field tags, interval judgment is performed with the shared threshold and the jump tolerance value, and the data source fields that meet the shared threshold are extracted. A set of field pairs that can be replaced and accessed is generated accordingly. The field tag character set encoding set and the field type vector set are called to calculate the number of character set encoding differences and the field type expression vector difference between the field pairs, respectively, using the formula: ; Calculate the composite score of field pair character set difference and type expression offset , filter the minimum score among all field pairs and obtain the field structure adaptation results, where: Indicates Field candidate character set encoding values, Indicates Field standard character set encoding value, Indicates Field candidate types express vector values, Indicates Fields of standard type express vector values, represents the number of encoding difference items, The type indicates the number of dimensions of expression; S213: Based on the field structure adaptation result, select the minimum score field pair according to the score value sorting, mark it as a high-fit field combination, and combine the original field label and the standard field label to form a field pair entry, combine and summarize to form a field mapping record set, and establish a data field shared remapping list.

5. The data asset sharing method based on Fangyuan Cloud according to claim 1 is characterized in that: The steps of obtaining the shared path allocation candidate list are specifically as follows: S311: Acquire the data source resource request information entering the sharing phase, extract the corresponding data source number and field mapping record, collect the business scenario identification item in the associated data source resource request item, annotate and map the data source resource request information according to the business scenario identification, and obtain the business scenario identification mapping result; S312: according to the business scenario identifier mapping result, calling the path number set, path state set and current path occupancy set in the shared path state library, extracting the path number list whose current path state is the allocatable state and the occupancy flag is empty, detecting the resource priority threshold associated with each path number, respectively aggregating each path number according to the business scenario, and obtaining a sharable path number group; S313: Based on the sharable path number group and in combination with the business scenario identifier, all sharable path numbers under each business scenario are integrated into a type of shared path path, and a shared path allocation candidate list is established.

6. The data asset sharing method based on Fangyuan Cloud according to claim 1 is characterized in that: The data source split path mapping result acquisition step is specifically as follows: S411: based on all the path numbers in the shared path allocation candidate list, searching for the path number items that are currently in the occupied state in the path status field, collecting the usage priority values ​​registered in the resource usage records associated with the path numbers, and comparing the resource priority values ​​in the resource request of the data source to be connected, counting all the conflicting path number sets, and obtaining the priority conflicting path number group; S412: According to the priority conflict path number group, select the unoccupied sharable path numbers in the same business scenario, and make a number pairing attempt based on the judgment conditions that the path status is idle and the business scenario identifier is consistent, using the formula: ; Calculate the difference score between the resource usage deviation degree and the priority reconstruction adaptation value for each pair of path numbers , select the path number with the smallest score value as the alternative path number, record it, and generate the alternative path mapping score result, where, Indicates The resource request intensity of the conflicting paths, Indicates The resource availability level of the alternative paths, Indicates Duty cycle values ​​for alternative paths, Indicates The priority difference of the conflicting paths, Indicates The cumulative occupancy time of each path, Indicates The number of remaining available cycles for each path, is the number of conflicting paths, is the number of path priority difference items; S413: According to the alternative path mapping scoring result, the path number with the smallest score value corresponding to each conflicting path is selected as the alternative path number, and is bound to the original conflicting path number, and a diversion identification record item is established to establish a data source diversion path mapping result.

7. The data asset sharing method based on Fangyuan Cloud according to claim 1 is characterized in that: The data asset sharing operation execution steps are specifically as follows: S511: According to the field mapping field pairs recorded in the data field sharing remapping list, the corresponding relationship between the standard field and the original field in each pair of fields is obtained, and the path number set allocated in the data source diversion path mapping result is combined with the field pair and the path number according to the data source number, and the field mapping field pair and the path number are merged and combined to obtain a field path combination comparison table; S512: extracting the field character set encoding and field type vector in all field pairs according to the field path combination comparison table, calling the resource type label, business scenario identifier and path transmission capacity associated with the path number, comparing the field structure information and the path resource structure characteristics item by item, confirming the structure matching and resource interoperability of the two, and obtaining the field path combination record with successful structure matching; S513: Based on the field path combination records that have successfully matched the structure, extract the field path combination records that meet the path access conditions as the formally connectable field data path mapping relationship, establish a data path docking relationship with the path number according to the field mapping order, and perform data asset sharing operations.

8. A data asset sharing system based on Fangyuan Cloud, characterized in that: The system is used to implement the data asset sharing method based on Fangyuan Cloud as described in any one of claims 1 to 7, including: The data structure standardization module obtains field labels and type information, extracts character sets and encodes mapping combinations to unify the structure expression, and generates a data structure standardization list; The field mapping screening module counts the number of unique matches and jumps of the field based on the data structure standardization list, determines whether the sharing threshold and jump tolerance value are met, extracts candidate field pairs, calculates the number of character set encoding differences and the type expression vector difference, performs weighted scoring, screens the field pairs with the best scores to establish an adaptation relationship, and generates a data field sharing remapping list; The resource request analysis module obtains resource request information and scenario identification, selects idle paths based on path status and occupancy, builds a shareable path group according to the business scenario, and obtains a candidate list for shared path allocation; The path priority conflict resolution module allocates a candidate list of shared paths, compares the data source priority with the occupied path priority, allocates an alternative path in the same scenario if there is a conflict, and generates a data source diversion path mapping result; The data sharing execution module combines the data field sharing remapping list with the data source diversion path mapping table to perform data path docking and execute data asset sharing operations.

Citation Information

Patent Citations

  • Method and device for processing resource sharing path, and method and device for resource sharing

    CN106533731A

  • Data sharing method and device based on data sharing center

    CN119690929A

  • Intelligent session method and server based on table data retrieval

    EP4339799A1

Cited By

  • Digital space full-flow encryption transmission system and method

    CN120342792A

  • Emergency resource data sharing method based on deep learning and storage medium

    CN120525428A

  • Dynamic routing method and device based on Nginx and Lua, equipment and storage medium

    CN120785814A

  • A dynamic routing method and device based on Nginx and Lua, equipment and storage medium

    CN120785814B

  • Digital rural construction business data analysis method and system

    CN121144382A