View Data Merging Method, System, Electronic Device, Medium and Program Product
By combining the view data of the external network and storage multiplexed intranet view library, the target intranet view data is generated, and the problem of wasted bandwidth and storage resources in cross-net transmission is solved, and more efficient data transmission and storage utilization is achieved.
Patent Information
- Application Number
- CN202310370029.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-04-07
- Publication Date
- 2025-07-11
- Estimated Expiration
- 2043-04-07
AI Technical Summary
During the cross-network transmission of view data, the external network view library needs to download image data from the third-party view library through the external network URL address and transmit it across the network to the internal network view library, resulting in network bandwidth occupation and computer hardware resource consumption. At the same time, the duplicate storage of image data exists in the internal network view library, resulting in waste of storage resources.
By receiving the first view data and the second view data, it comes from the external network view library and the storage multiplexed intranet view library respectively, and merges these data to generate the target intranet view data. The target view data includes the intranet URL address. The intranet view library can directly access the storage multiplexed intranet view library to obtain the original data, avoiding repeated storage and downloading.
It reduces the bandwidth pressure of cross-network transmission, reduces computer hardware resource consumption, saves storage resources, and improves data transmission efficiency.
Smart Images

Figure CN116566964B_ABST
Abstract
Description
Technical Field
[0001] The present disclosure belongs to the field of computer technology, and particularly relates to a view data merging method, system, electronic device, computer-readable storage medium, and computer program product. Background Art
[0002] View data refers to data with structured information and original information. Taking image data as an example, the structured information refers to key-value pairs describing the attributes of a face image, such as picture height, picture width, image content, etc., and the original information may include the URL (Uniform Resource Locator) address of the image data.
[0003] In the cross-network transmission of view data, the external network service system can transmit data streams from different sources to the external network view library, and then the external network view library transmits them to the internal network view library for storage, for the internal network service system to access. Among them, the video stream of the source monitoring platform, the capture stream of the capture camera, etc. are stored in the external network view library by the external network service system; for the view data from the external network third-party view library, the external network view library can access it by reading the URL address without storing the corresponding image data.
[0004] Since the URL address of the external network cannot be accessed in the internal network after cross-network transmission, when the external network view library performs cross-network transmission, it usually needs to download the corresponding image data from the third-party view library according to the URL address and transmit the image data across the network to the internal network view library. The internal network view library stores the image data and generates an internal network URL address for the internal network service system to access. The external network third-party view library can also store the image data in the internal network third-party view library through cross-network transmission for the internal network third-party service system to access.
[0005] It can be seen that in the above view data storage process, the external network view library needs to obtain the image data in the external network third-party view library through the external network URL address, transmit it across the network and store it in the internal network view library, and the internal network view library generates the internal network URL address of the image data. There is also image data transmitted across the network from the external network third-party view library stored in the internal network third-party view library, so that the image data with the same URL address in the internal network is stored repeatedly, resulting in waste of storage resources. Moreover, the external network view library needs to download the image data from the third-party view library according to the URL address and then transmit it across the network, occupying network bandwidth and consuming computer hardware resources, causing waste of network resources. Summary of the Invention
[0006] The purpose of the present disclosure is to provide a view data merging method, system, electronic device, computer-readable storage medium, and computer program product, which can save internal network storage resources and improve data transmission efficiency.
[0007] To solve the above technical problems, the present disclosure is implemented as follows:
[0008] In a first aspect, the present disclosure provides a method for merging view data. The method is applied to a view data merging component and may include: receiving first view data and second view data; the first view data and the second view data are transmitted in the URL format, and the data sources of the first view data and the second view data include a first external network view library or a storage and reuse internal network view library; the first external network view library is used to receive view data containing the external network URL address corresponding to the original data provided by the second external network view library, and transmit the external network URL address across the network to the target internal network view library through the view data; the storage and reuse internal network view library is used to store the view data containing the original data transmitted across the network by the second external network view library, and send the internal network URL address generated by storing the original data to the target internal network view library through the view data; the first view data and the second view data correspond to the same original data; in the case where the data sources of the first view data and the second view data are different, the first view data and the second view data are merged so that the target internal network view library obtains target view data, and the target view data includes an internal network URL address, and the internal network URL address is used to access the storage and reuse internal network view library to obtain the corresponding original data.
[0009] Optionally, in the case where the data sources of the first view data and the second view data are different, the first view data and the second view data are merged so that the target internal network view library obtains target view data, including: in the case where the data source of the first view data is the first external network view library and the data source of the second view data is the storage and reuse internal network view library, the external network structured information of the first view data is merged with the data source and the internal network URL address of the second view data so that the target internal network view library obtains target view data.
[0010] Optionally, receive first view data and second view data, including: receiving the first view data sent to the target intranet view library, the data source of the first view data being the first extranet view library, the first view data including extranet structured information and an extranet URL address; writing the first view data into the target intranet view library; on the basis of having received the first view data, receiving the second view data corresponding to the same original data, the data source of the second view data being the storage reuse intranet view library, the second view data including an intranet URL address; in the case where the data sources of the first view data and the second view data are different, merging the first view data and the second view data so that the target intranet view library obtains target view data, including: determining that the data sources are different, in the target intranet view library, using the data source and the intranet URL address of the second view data to update the data source and the extranet URL address of the first view data, obtaining the target view data, the target view data including extranet structured information, the data source of the second view data, and the intranet URL address.
[0011] Optionally, the view data merging component and the target intranet view library are deployed independently. Receive first view data and second view data, including: receiving the first view data sent to the target intranet view library, the data source of the first view data being the storage reuse intranet view library, the first view data including an intranet URL address; writing the first view data into the local memory of the view data merging component; on the basis of having received the first view data, receiving the second view data corresponding to the same original data, the data source of the second view data being the first extranet view library, the second view data including extranet structured information and an extranet URL address; in the case where the data sources of the first view data and the second view data are different, merging the first view data and the second view data so that the target intranet view library obtains target view data, including: determining that the data sources are different, in the local memory, using the data source and the intranet URL address of the first view data to update the data source and the extranet URL address of the second view data, obtaining the target view data, the target view data including extranet structured information, the data source of the first view data, and the intranet URL address; sending the target view data to the target intranet view library.
[0012] Optionally, the view data merging component and the target intranet view library are deployed independently. The view data merging component receives the first view data and the second view data sent to the target intranet view library, including: receiving the first view data sent to the target intranet view library, where the data source of the first view data is the first external network view library, and the first view data includes external network structured information and external network URL addresses; writing the first view data into the local memory of the view data merging component; on the basis of having received the first view data, receiving the second view data corresponding to the same original data, where the data source of the second view data is the storage reuse intranet view library, and the second view data includes intranet URL addresses; in the case where the data sources of the first view data and the second view data are different, merging the first view data and the second view data so that the target intranet view library obtains the target view data, including: determining that the data sources are different, and in the local memory, using the data source of the second view data and the intranet URL address to update the data source and the external network URL address of the first view data, to obtain the target view data, where the target view data includes external network structured information, the data source of the second view data, and the intranet URL address; sending the target view data to the target intranet view library.
[0013] In a second aspect, the present disclosure also provides a view data merging system, which is characterized in that the system may include a first external network view library and a second external network view library deployed on the external network, and a target intranet view library, a storage reuse intranet view library, and a view data merging component deployed on the intranet; the first external network view library is used for receiving the view data containing the external network URL address corresponding to the original data provided by the second external network view library, and for cross-network transmitting the external network URL address to the target intranet view library through the view data; the second external network view library is used for providing the view data containing the external network URL address corresponding to the original data to the first external network view library, and for cross-network transmitting the view data containing the original data to the storage reuse intranet view library; the storage reuse intranet view library is used for storing the view data containing the original data cross-network transmitted by the second external network view library, and for sending the intranet URL address generated by storing the original data to the target intranet view library through the view data; the view data merging component is used for receiving the view data, and for merging the first view data and the second view data when receiving the first view data and the second view data corresponding to the same original data and having different data sources, so that the target intranet view library obtains the target view data, where the target view data includes the intranet URL address, and the intranet URL address is used to access the storage reuse intranet view library to obtain the corresponding original data.
[0014] Optionally, the view data merging component is deployed on the target intranet view library.
[0015] Optionally, the view data merging component and the target intranet view library are deployed independently.
[0016] In a third aspect, the present disclosure provides an electronic device, which includes a processor, a memory, and a program or instruction stored on the memory and executable on the processor. When the program or instruction is executed by the processor, the steps of the view data merging method according to the first aspect are implemented.
[0017] In a fourth aspect, the present disclosure provides a computer-readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the view data merging method according to the first aspect are implemented.
[0018] In a fifth aspect, the present disclosure provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor, and the processor is configured to run a program or instruction to implement the steps of the view data merging method according to the first aspect.
[0019] In a sixth aspect, the present disclosure provides a computer program product, which, when running on an electronic device, causes the electronic device to execute the steps of implementing the view data merging method according to the first aspect.
[0020] The view data merging method provided by the present disclosure is applied to a view data merging component, which can receive first view data and second view data. Among them, the first view data and the second view data are transmitted in the URL format, and the data sources of the first view data and the second view data can include a first external network view library or a storage reuse internal network view library; the first external network view library is used to provide view data containing the external network URL address corresponding to the original data for the second external network view library, and transmit the external network URL address across the network to the target internal network view library through the view data; the storage reuse internal network view library is used to store the view data containing the original data transmitted across the network by the second external network view library, and send the internal network URL address generated by storing the original data to the target internal network view library through the view data; and the first view data and the second view data correspond to the same original data; then, in the case of different data sources, the first view data and the second view data can be merged so that the target internal network view library obtains target view data, and the target view data includes an internal network URL address. Then, the target internal network view library can access the storage reuse internal network view library through the internal network URL address to obtain the corresponding original data. In the present disclosure, the first external network view library does not need to download the original data from the second external network view library through the external network URL address and send the original data to the target internal network view library through the view data, but transmits the view data containing the external network URL address to the target internal network view library across the network in the URL format, which can reduce the bandwidth pressure of cross-network transmission, reduce the consumption of computer hardware resources, and the burden on network resources; moreover, the target internal network view library can, based on view data merging, obtain the internal network URL address of the original data provided by the storage reuse internal network view library when the same original data corresponds to different data sources, so as to access the storage reuse internal network view library to obtain it, without repeatedly storing the original data in the target internal network view library, and effectively saves storage resources. BRIEF DESCRIPTION OF THE DRAWINGS
[0021] Figure 1 It is a schematic diagram of the existing view data storage network architecture provided by an embodiment of the present disclosure;
[0022] Figure 2 It is one of the step flowcharts of the view data merging method provided by an embodiment of the present disclosure;
[0023] Figure 3 It is another step flowchart of the view data merging method provided by an embodiment of the present disclosure;
[0024] Figure 4 It is yet another step flowchart of the view data merging method provided by an embodiment of the present disclosure;
[0025] Figure 5 It is still another step flowchart of the view data merging method provided by an embodiment of the present disclosure;
[0026] Figure 6 The fifth step flowchart of the view data merging method provided by the embodiments of the present disclosure;
[0027] Figure 7a One of the schematic diagrams of the architecture of the view data merging system provided by the embodiments of the present disclosure;
[0028] Figure 7b Another schematic diagram of the architecture of the view data merging system provided by the embodiments of the present disclosure;
[0029] Figure 8 The structural block diagram of the view data storage device provided by the embodiments of the present disclosure;
[0030] Figure 9 The schematic diagram of the structure of an electronic device provided by the embodiments of the present disclosure;
[0031] Figure 10 The schematic diagram of the hardware of an electronic device provided by the embodiments of the present disclosure. Detailed implementation manners
[0032] Next, the technical solutions in the embodiments of the present disclosure will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present disclosure. Obviously, the described embodiments are part of the embodiments of the present disclosure, rather than all of the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present disclosure.
[0033] The terms "first", "second", etc. in the specification and claims of the present disclosure are used to distinguish similar objects, rather than to describe a specific order or sequence. It should be understood that such data may be interchanged under appropriate circumstances so that the embodiments of the present disclosure can be implemented in an order other than those illustrated or described herein, and the objects distinguished by "first", "second", etc. are generally of the same category, and the number of objects is not limited. For example, the first object may be one or more. In addition, "and / or" in the specification and claims means at least one of the connected objects, and the character " / " generally indicates an "or" relationship between the related objects before and after.
[0034] It should be noted that for the data obtained in the present disclosure, including raw data, view data and other related data, after clearly informing the user or the relevant data owner of information such as the content of data collection, data usage, processing method, etc., access, collection, storage and application to subsequent analysis and processing are carried out under the consent and authorization of the user or the relevant data owner, and the user or the relevant data owner can be provided with ways to access, correct, delete the data, as well as methods to revoke consent and authorization.
[0035] The following explanations are provided for some terms in this disclosure:
[0036] View data is data that describes the original data and usually includes the structured information and the original information of the original data. Among them, the original information can be the data itself, such as the BASE64 encoding or string of the original data; the original information can also be the storage path of the original data, such as the URL address of the original data; the structured information can be key-value pairs that describe the original data, such as the data length, image width, etc. Taking the original data stored in view library T as an example, the storage format is as follows:
[0037] {"ID":"00001","Width":100,"Height","Data":"BASE64 string"}
[0038] Among them, "Width" and "Height" are the structured information of the original data, and "Data": "BASE64 string" is the original information of the original data. The view data can also include "ID": "00001" as the unique identifier of the original data.
[0039] When the original data is stored in view library T, the URL address of the original data in the network where view library T is located can be obtained, so that the view library can provide the view data corresponding to the original data as follows:
[0040] {"ID":"00001","Width":100,"Height","Storage Path":"URL address","User-Identify":[T]}
[0041] Among them, "Storage Path": "URL address" means that the storage path of the original data is "URL address", which is obtained when the "BASE64 string" is stored in view library T; and, "User-Identify": [T] means that the data source is view library T, and each node passed by the view data during data transmission can add the corresponding node to "User-Identify" in the order of the path.
[0042] Figure 1 The following is a schematic diagram of the existing view data storage network architecture provided by the embodiments of this disclosure, as Figure 1As shown in the figure, divided by the network boundary X, the external network includes the external network business system M 101, the external network view library V 102, and the external network third-party view library T 103; the internal network includes the internal network view library V’ 104, the internal network third-party view library T’ 105, the internal network business system M’ 106, and the internal network third-party business system P 107. Among them, the external network third-party view library T 103 stores the "BASE64 string 1" of the original data 00001 and provides the view data of the original data to the external network business system M 101, as follows:
[0043] {"ID":"00001","Width":100,"Height","Storage Path":"URL address","User-Identify":[T]}
[0044] The external network business system M 101 can receive the above view data provided by the external network third-party view library T 103, as well as the video stream captured by other platforms or the captured images, and perform feature extraction, clustering and filing, etc. on the video stream, images, view data, etc. to obtain the external network structured information corresponding to the original data. When there is already structured information in the view data, after the calculation and processing of the external network business system, its external network structured information may change. Further, the external network business system M can send the corresponding view data to the external network view library V 102, as follows:
[0045] {"ID":"00001","Width":100,"Height","StoragePath":"URL address","User-Identify":[T,M]}
[0046] Among them, in the view data of the original data "00001" provided by the external network third-party view library T 103, the external network business system M 101 adds "M" at "User-Identify"; "Width":100 is the external network structured information determined by the external network business system M; this view data is transmitted in the URL format.
[0047] {"ID":"00002","Width":50,"Height":10,"Data":"BASE64 string 2","User-Identify":[M]}
[0048] Among them, the original data "00002" is the image captured by other platforms; "Width":50, "Height":10 are the external network structured information determined by the external network business system M; this view data is transmitted in the BASE64 format.
[0049] The external network view library V 102 can send the view data corresponding to the original data "00001" and "00002" to the internal network view library V' 104 through cross-network transmission. Since the internal network view library V' 104 cannot access the external network third-party view library T 103, the external network view library V 102 can first obtain the "URL address" from the view data of the original data "00001", and obtain the "BASE64 string" of the original data "00001" from the third-party view library T 103 according to the "URL address", and then transmit the view data of the original data "00001" to the internal network view library V' 104 in the BASE64 format, as follows:
[0050] {"ID":"00001","Width":100,"Height","Data":"BASE64 string","User-Identify":[T,M,V]}
[0051] Thus, the internal network view library V' 104 can obtain and store the original data "00001" and the original data "00002" from the view data, so as to obtain the "URL addresses" of the original data "00001" and the original data "00002" and push them to the internal network service system M' 106.
[0052] However, on this basis, the external network third-party view library T 103 will also transmit the locally stored original data "00002" to the internal network third-party view library T' 105 through cross-network transmission, so that the internal network third-party view T' 105 can store the original data "00002" and provide the "URL address" where the original data "00002" is stored in the internal network third-party view library T' 105 to the internal network third-party service system P 107.
[0053] It can be seen that in the existing solution, before cross-network transmission of the view data containing the "URL address", the external network view library V 102 needs to first obtain the corresponding original data based on the "URL address" and perform cross-network transmission on the original data, occupying network bandwidth and consuming computer hardware resources; moreover, in the internal network, the internal network view library V' 104 and the internal network third-party view library T' 105 store the original data "00002" repeatedly, wasting storage resources.
[0054] The embodiment of the present disclosure provides a view data merging method. In this method, the external network view library V 102 can perform cross-network transmission based on the view data containing the "URL address", reducing bandwidth occupancy and reducing the loss of computer hardware resources; and the internal network view library V' 104 can reuse the original data stored in the internal network third-party view library T' 105, thus avoiding the waste of storage resources caused by repeated storage.
[0055] The method for merging view data provided by the embodiments of the present disclosure will be described in detail below in conjunction with the accompanying drawings, through specific embodiments and their application scenarios.
[0056] Figure 2 One of the flowcharts of the method for merging view data provided by the embodiments of the present disclosure. This method can be applied to a view data merging component. As Figure 2 shown, this method may include the following steps 201 to step 202.
[0057] Step 201: Receive the first view data and the second view data; the first view data and the second view data are transmitted in the URL format, and the data sources of the first view data and the second view data include the first external network view library or the storage and reuse internal network view library; the first external network view library is used to receive the view data containing the external network URL address corresponding to the original data provided by the second external network view library, and transmit the external network URL address across the network to the target internal network view library through the view data; the storage and reuse internal network view library is used to store the view data containing the original data transmitted across the network by the second external network view library, and send the internal network URL address generated by storing the original data to the target internal network view library through the view data; the first view data and the second view data correspond to the same original data.
[0058] In the embodiments of the present disclosure, divided by the network boundary, it may include the external network and the internal network. Among them, the external network includes the first external network view library and the second external network view library, and the internal network includes the target internal network view library and the storage and reuse internal network view library. The first external network view library may be the view database corresponding to our business in the external network, the second external network view library may be the view database corresponding to the third-party business in the external network, the target internal network view library may be the view database corresponding to our business in the internal network, and the storage and reuse internal network view library may be the view database corresponding to the third-party business in the internal network. In the conventional solution, the second external network view library may provide the view data including the external network URL address to the first external network view library, and then the first external network view library may obtain the corresponding original data from the second external network view library according to the external network URL address, and transmit the original data across the network to the target internal network view library. The target internal network view library stores the original data to obtain the internal network URL address for the business needs of our business in the internal network to call. However, the second external network view library also transmits the view data containing the original data across the network to the storage and reuse internal network view library for the storage and reuse internal network view library to store the original data to obtain another internal network URL address for the business needs of the third-party business in the internal network to call. It can be seen that the same original data is repeatedly stored in the internal network in the conventional solution, which greatly wastes storage resources.
[0059] In the embodiments of the present disclosure, the second external network view library may also provide view data including the external network URL address corresponding to the original data to the first external network view library. At this time, the first external network view library may transmit the view data including the external network URL address corresponding to the original data across the network to the target internal network view library, without the need to download the original data from the second external network view library based on the external network URL address, nor to transmit the view data including the original data to the target internal network view library, which can reduce the data transmission pressure; the second external network view library may also transmit the view data including the original data across the network to the storage and reuse internal network view library. At this time, the storage and reuse internal network view library may store the original data to obtain an internal network URL address, and transmit the view data including the internal network URL address to the target internal network view library, so that the target internal network view library can call the original data from the storage and reuse internal network view library based on the internal network URL address, without the need to locally store the original data to obtain the internal network URL address, effectively saving storage resources. Among them, the data type of the original data may be selected according to actual business requirements, such as images, texts, etc.
[0060] In the embodiments of the present disclosure, the view data merging component may receive the first view data and the second view data corresponding to the same original data. The data sources of the first view data and the second view data may be the first external network view library or the storage and reuse internal network view library, that is, the first view data may be sent by the first external network view library or the storage and reuse internal network view library, and the second view data may be sent by the first external network view library or the storage and reuse internal network view library. According to different data sources, the information included in the view data may also be different, such as it may include the external network URL address, the internal network URL address, etc., or the original data is subjected to feature extraction, calculation processing, etc. by the external network business system during the transmission process, so that the corresponding view data may include external network structured information, etc.
[0061] It should be noted that when the second view library provides the view data including the external network URL address to the first view library, the view data may pass through other nodes, such as the external network business system, etc., so that the structure information of the view data changes based on business requirements; at the same time, the second view library directly transmits the view data including the original data to the storage and reuse internal network view library through cross-network transmission, and the view data does not pass through other nodes, which may result in differences in the structure information between the view data received by the first external network view library and the view data sent by the second external network view library. Therefore, the view data merging component may be used to merge the view data provided by the first external network view library and the view data provided by the storage and reuse internal network view library, so as to obtain the target view data that meets the actual business requirements.
[0062] Among them, the view data merging component can be a logic module, a microservice, a pluggable component, etc. It can receive the view data sent by the first external network view library or the storage-reused internal network view library to the target internal network view library, store, merge the view data, and write it into the target internal network view library for the target internal network view library to call based on business requirements. The view data merging component can be deployed in the target internal network view library or can be independently deployed relative to the target internal network view library on the basis of establishing a communication connection. Thus, before the view data sent by the first external network view library or the storage-reused internal network view library is written into the target internal network view library, the view data merging component can analyze, merge, process, and write the received video data. The embodiments of the present disclosure do not make specific limitations on this.
[0063] In the embodiments of the present disclosure, the first external network view library, the storage-reused internal network view library, the target internal network view library, etc. are only used to distinguish the functions implemented by different view libraries in the network architecture. Based on business requirements, corresponding data storage and processing technologies can be selected between view libraries, and there can be one or multiple view libraries that implement the same function. For example, in the internal network, there can be one storage-reused internal network view library that provides the internal network URL address corresponding to the original data for the target internal network view library, or there can be multiple storage-reused internal network view libraries that provide different internal network URL addresses corresponding to the original data for the target internal network view library. In the embodiments of the present disclosure, no specific limitations are imposed on the methods adopted by the view libraries in implementation and the number of view libraries.
[0064] Step 202: When the data sources of the first view data and the second view data are different, merge the first view data and the second view data so that the target internal network view library obtains the target view data, where the target view data includes an internal network URL address, and the internal network URL address is used to access the storage-reused internal network view library to obtain the corresponding original data.
[0065] In the embodiments of the present disclosure, when the data sources of the first view data and the second view data are different, it can be considered that one of them is sent by the first external network view library and the other is sent by the storage-reused internal network view library. Furthermore, the first view data and the second view data can be merged so that the obtained target view data includes the internal network URL address provided by the storage-reused internal network view library for the target internal network view library to access the corresponding storage-reused internal network view library to obtain the original data based on the internal network URL address. Among them, the data source can be determined based on "User-Identify" in the first view data and the second view data or can be determined according to other agreed rules, and can include the first external network view library or the storage-reused internal network view library, so that the target view data includes both the external network information of the original data that meets the business call requirements and the internal network URL address for calling.
[0066] Figure 3This is the second flowchart of the view data merging method provided by the embodiments of the present disclosure. This method can be applied to a view data merging component, such as Figure 3 As shown, this method may include the following steps 301 to 302.
[0067] Step 301: Receive first view data and second view data; the first view data and the second view data are transmitted in the URL format, and the data sources of the first view data and the second view data include a first external network view library or a storage and reuse internal network view library; the first external network view library is used to receive view data containing the external network URL address corresponding to the original data provided by the second external network view library, and transmit the external network URL address across the network to the target internal network view library through the view data; the storage and reuse internal network view library is used to store the view data containing the original data transmitted across the network by the second external network view library, and send the internal network URL address generated by storing the original data to the target internal network view library through the view data; the first view data and the second view data correspond to the same original data.
[0068] In the embodiments of the present disclosure, step 301 may refer to the relevant description of the foregoing step 101 for reference. To avoid repetition, it will not be elaborated here.
[0069] In the embodiments of the present disclosure, different original data may be marked with data identifiers. The data identifier is an ID that uniquely indicates the original data in the view data. Thus, the view data merging component can determine the first view data and the second view data corresponding to the same original data in the received view data through the data identifier. The way for the view data merging component to receive the view data may be to wait for the first external network view library and the storage and reuse internal network view library to send; or it may be to query the view data corresponding to the same original data from the other view library after receiving the view data sent by any one of the two view libraries, namely the first external network view library and the storage and reuse internal network view library. In the embodiments of the present disclosure, no specific limitation is made thereto.
[0070] In the embodiments of the present disclosure, when the original data is an image, it may include face image data, human body image data, locomotive image data, etc. According to the acquisition method, acquisition scenario, and service requirements, the types of view data may be different.
[0071] In addition, in the internal network, in addition to the target internal network view library, there may be multiple view libraries storing different original data. According to the actual service requirements of the internal network service system, storage and reuse view libraries storing the original data required for the service may be subscribed in multiple view libraries. On this basis, when the target internal network view library receives the view data sent by the storage and reuse view library, it may trigger a push to the internal network service system so that the internal network service system can obtain the relevant view data required for providing services.
[0072] It should be noted that the first view data, the second view data, etc. described in the embodiments of the present disclosure refer to view data transmitted in the URL format. That is, when the view data merging component receives view data transmitted in the URL format, it further determines whether it is necessary to store, merge, write to the target intranet view library, etc.; in addition, the view data merging component may also receive other view data containing raw data, and the other view data may correspond to the raw data collected by the monitoring and capture cameras docked with the external network service system. Since the raw data is not stored in the intranet, it can be directly stored locally by the target intranet view library to obtain the corresponding intranet URL address, and trigger the push of the other view data corresponding to the raw data to the service system, so that the service system can obtain the corresponding raw data from the target intranet view library.
[0073] Step 302: When the data source of the first view data is the first external network view library and the data source of the second view data is the storage-reused intranet view library, merge the external network structured information of the first view data with the data source and the intranet URL address of the second view data, so that the target intranet view library obtains the target view data.
[0074] In the embodiments of the present disclosure, in order to realize the storage reuse of the raw data, it is necessary to enable the target intranet view library to obtain the intranet URL address of the storage-reused intranet view library storing the raw data, so that the target intranet view library can access the storage-reused intranet view library based on the intranet URL address to obtain the raw data required by the service. Therefore, when the view data merging component continuously receives view data corresponding to the same raw data, in the case where the data sources of the two view data are different, the data source of the first view data can be the first external network view library, and the data source of the second view data can be the storage-reused intranet view library. At this time, the receiving order of the first view data and the second view data is not limited, and they are distinguished by different data sources.
[0075] Furthermore, the external network structured information can be obtained from the first view data provided by the first external network view library, and the intranet URL address of the raw data can be obtained from the second view data provided by the storage-reused intranet view library. The view data merging component can merge the foregoing external network structured information, intranet URL address, and the data source of the second view data, so that the target intranet view library obtains the target view data. In the embodiments of the present disclosure, the external network structured information of the raw data in terms of external network transmission, feature extraction, analysis and processing, etc. can be obtained from the view data provided by the first external network view library. On this basis, after merging the first view data and the second view data to obtain the target view data, the target intranet view library can access the storage-reused intranet view library using the intranet URL address in the target view data to obtain the raw data, without downloading and storing the raw data locally, realizing the storage reuse of the raw data.
[0076] In an alternative embodiment of the present disclosure, the view data merging component may also, according to the reception order of the view data corresponding to the same original data, consider the first received as the first view data and the later received as the second view data, without restricting its data source. Then, there may be different combinations of its data sources. For different situations, corresponding operation processes can be adopted.
[0077] Figure 4 This is the third step flowchart of the view data merging method provided by the embodiments of the present disclosure. This method can be applied to a view data merging component, such as Figure 4 As shown, this method may include the following steps 401 to 404.
[0078] Step 401: Receive the first view data sent to the target intranet view library. The data source of the first view data is the first extranet view library. The first view data includes extranet structured information and an extranet URL address.
[0079] In the embodiments of the present disclosure, the view data merging component may receive the view data sent to the target intranet view library. When determining that the view data corresponding to the same original data is received for the first time, this view data can be determined as the first view data. If the data source of the first view data is the first extranet view library, then the first view data contains the extranet structured information obtained by the extranet business system through feature extraction and calculation analysis of the original data corresponding to the first view data, and the extranet URL address where the original data is stored on the extranet.
[0080] Furthermore, the view data merging component may record the first view data to determine that the view data corresponding to the original data has been received once. The "ID" of the original data included in the first view data can be used as the key of the first view data for storage, and the value may include information such as the data source (User-Identify) and data storage path (Storage Path) of the first view data. In the embodiments of the present disclosure, the data source is the first extranet view library, and the data storage path is the extranet URL address.
[0081] Step 402: Write the first view data into the target intranet view library.
[0082] In the embodiments of the present disclosure, the view data merging component may write the first view data into the target intranet view library. At this time, the view data merging component can be deployed on the target intranet view library or can be independently deployed separately from the target intranet view library. For the same original data, this process is the first time to write view data into the target intranet view library.
[0083] Step 403: On the basis of having received the first view data, receive the second view data corresponding to the same original data. The data source of the second view data is the storage multiplexing intranet view library, and the second view data includes the intranet URL address.
[0084] In the embodiments of the present disclosure, the view data merging component can determine the second view data when receiving the view data for the second time for the same original data. The view data of the second view data can be the storage multiplexing intranet view library, and the intranet URL address of the original data in the storage multiplexing intranet view library is included in the second view data. Specifically, after receiving a view data subsequently, the view data merging component can obtain the "ID" of the view data, and determine that the view data is the second view data when the "ID" matches the key in the local memory. In the embodiments of the present disclosure, the data source of the second view data is the storage multiplexing intranet view library, and includes the intranet URL address stored by the original data in the storage multiplexing intranet view library.
[0085] Step 404: Determine that the data sources are different, and in the target intranet view library, use the data source and intranet URL address of the second view data to update the data source and external network URL address of the first view data, and obtain the target view data. The target view data includes external network structured information, the data source of the second view data, and the intranet URL address.
[0086] On the basis of Steps 401 to 403, it can be determined that the data sources of the first view data and the second view data are different. The view data merging component can update the data source and external network URL address of the first view data with the data source and intranet URL address of the second view data in the target intranet view library, and obtain the target view data including the external network URL address, external network structured information, and the data source being the storage multiplexing intranet view library. For the same original data, this process is to write the view data twice in the target intranet view library. When the target intranet view library subscribes to the storage multiplexing intranet view library based on business requirements, based on the data source of the target view data being the storage multiplexing intranet view library, the target intranet view library can trigger the push to the intranet business system based on the target view data.
[0087] Figure 5 This is the fourth step flowchart of the view data merging method provided by the embodiments of the present disclosure. This method can be applied to the view data merging component, and the view data merging component and the target intranet view library are independently deployed respectively. As Figure 5 shown, this method can include the following Steps 501 to 505.
[0088] Step 501: Receive the first view data sent to the target intranet view library. The data source of the first view data is the first extranet view library, and the first view data includes extranet structured information and an extranet URL address.
[0089] In the embodiments of the present disclosure, step 501 can be correspondingly referred to the relevant description of the foregoing step 401. To avoid repetition, it will not be elaborated herein.
[0090] Step 502: Write the first view data into the local memory of the view data merging component.
[0091] In the embodiments of the present disclosure, the first view data can also be written into the local memory of the view data merging component first to avoid the transmission pressure that may be caused by writing to the target intranet view library multiple times. At this time, the view data merging component and the target intranet view library are independently deployed. The local memory can be implemented by an in-built database. For example, a Redis database can be built in the view data merging component. Redis (Remote Dictionary Server) is a memory-based Key-Value database. Those skilled in the art can select other databases based on application requirements, operating conditions, etc. The embodiments of the present disclosure do not make specific limitations thereto.
[0092] Step 503: On the basis of having received the first view data, receive the second view data corresponding to the same original data. The data source of the second view data is the storage reuse intranet view library, and the second view data includes an intranet URL address.
[0093] In the embodiments of the present disclosure, step 503 can be correspondingly referred to the relevant description of the foregoing step 403. To avoid repetition, it will not be elaborated herein.
[0094] Step 504: Determine that the data sources are different, and in the local memory, use the data source and the intranet URL address of the second view data to update the data source and the extranet URL address of the first view data to obtain the target view data. The target view data includes extranet structured information, the data source of the second view data, and the intranet URL address.
[0095] Step 505: Send the target view data to the target intranet view library.
[0096] Based on steps 501 to 503, it can be determined that the data sources of the first view data and the second view data are different. The view data merging component can update the data source and the external network URL address of the first view data with the data source and the internal network URL address of the second view data in the local memory, and obtain the target view data after merging, which includes the external network URL address, the external network structured information, and the data source is the storage-reused internal network view library. Further, the target view data can be sent to the target internal network view library. For the same original data, only one write of the target view data is required to avoid the read-write and storage pressure on the target internal network view library caused by frequent writes. Since the data source of the target view data is the storage-reused internal network view library, when the target internal network view library subscribes to the storage-reused internal network view library based on business requirements, the target internal network view library can trigger the push of the target view data to the internal network business system.
[0097] Figure 6 This is the fifth step flowchart of the view data merging method provided by the embodiments of the present disclosure. This method can be applied to a view data merging component, and the view data merging component and the target internal network view library are independently deployed, as Figure 6 shown. This method can include the following steps 601 to 605.
[0098] Step 601: Receive the first view data sent to the target internal network view library. The data source of the first view data is the storage-reused internal network view library, and the first view data includes the internal network URL address.
[0099] In the embodiments of the present disclosure, when the view data merging component determines that the view data of the same original data is received for the first time, the view data can be determined as the first view data. If the data source of the first view data is the storage-reused internal network view library, the first view data includes the internal network URL address of the original data in the storage-reused internal network view library.
[0100] Step 602: Write the first view data into the local memory of the view data merging component.
[0101] In the embodiments of the present disclosure, since the data source of the first view data is the storage-reused internal network view library, when the target internal network view library subscribes to the storage-reused internal network view library based on business requirements, to avoid triggering the push of the first view data after writing the first view data into the target internal network view library, the first view data can be written into the local memory of the view data merging component and then wait for the subsequent reception of the second view data.
[0102] In an optional embodiment of the present disclosure, it is also possible that the view data merging component is deployed in the target intranet view library, and the first view data can be used to write into the target intranet view library, and the target view data can be obtained by the method of merging the second view data with different data sources. At this time, the content that is not pushed for the same original data before merging to obtain the target view data can be set in the rule that triggers the push.
[0103] Step 603: On the basis of having received the first view data, receive the second view data corresponding to the same original data. The data source of the second view data is the first extranet view library, and the second view data includes extranet structured information and an extranet URL address.
[0104] In the embodiment of the present disclosure, the view data merging component can determine the second view data when receiving the view data for the second time for the same original data. If the view data of the second view data is the first extranet view library, the second view data includes the extranet structured information obtained by the extranet business system through feature extraction and calculation analysis of the original data corresponding to the second view data, and the extranet URL address where the original data is stored on the extranet.
[0105] Step 604: Determine that the data sources are different, and in the local memory, update the data source and the extranet URL address of the second view data with the data source and the intranet URL address of the first view data to obtain the target view data. The target view data includes extranet structured information, the data source of the first view data, and the intranet URL address.
[0106] Step 605: Send the target view data to the target intranet view library.
[0107] On the basis of Steps 601 to 603, it can be determined that the data sources of the first view data and the second view data are different. The view data merging component can update the data source and the extranet URL address of the second view data with the data source and the intranet URL address of the first view data in the local memory to obtain the merged target view data that includes the extranet URL address, the extranet structured information, and the data source as the storage-reused intranet view library. Further, the target view data can be sent to the target intranet view library. Since the data source of the target view data is the storage-reused intranet view library, when the target intranet view library subscribes to the storage-reused intranet view library based on business requirements, the target intranet view library can trigger the push to the intranet business system based on the target view data.
[0108] In the embodiment of the present disclosure, there may also be a situation where the data sources of the first view data and the second view data corresponding to the original data are the same, as shown in the following Steps A1 to A2:
[0109] Step A1: When the data sources of the first view data and the second view data are both the first external network view library, no view data merging is performed, and continue to wait for receiving the view data corresponding to the original data.
[0110] In the embodiments of the present disclosure, when the data sources of the first view data and the second view data are both the first external network view library, it means that in the external network, there may be view data of a single first external network view library repeatedly sending the same original data, or there may be view data of two or more first external network view libraries having the same original data. In this case, it may be a failure, such as a network transmission failure, an abnormal view library storage, etc. The view data merging component can not process the first view data and the second view data, and continue to wait for receiving subsequent view data. Further, an alert can be sent for the abnormal situation, so as to troubleshoot the system and avoid possible failures affecting the processing and transmission efficiency of view data.
[0111] Step A2: When the data sources of the first view data and the second view data are both the storage multiplexing internal network view library, no data merging is performed; or, if it is determined that the original data is repeatedly stored in two or more storage multiplexing internal network view libraries, the access order of the target internal network view library can be defined for two or more storage multiplexing internal network view libraries, or an access object of the target internal network view library can be defined in two or more storage multiplexing internal network view libraries, and continue to wait for receiving the view data corresponding to the original data.
[0112] In the embodiments of the present disclosure, there may also be a situation where the data sources of the first view data and the second view data corresponding to the original data are both the storage - reused intranet view library, which means that in the intranet, there may be a single storage - reused intranet view library repeatedly sending view data of the same original data, or there may be view data of two or more storage - reused intranet view libraries with the same original data. In this case, it may be a fault, such as a network transmission fault, an abnormal view library storage, etc.; it may also be that there are two or more available storage - reused intranet view libraries. At this time, the view data merging component can either not process the first view data and the second view data and continue to wait for the reception of subsequent view data; or define one of the two or more available storage - reused intranet view libraries as the access object of the target intranet view library, or define the access order of the target intranet view library to different storage - reused intranet view libraries. On this basis, the view data merging component can not perform other operations and continue to wait for the reception of the view data corresponding to the original data. When receiving other view data corresponding to the original data and the data source is the first external - network view library, view data merging can be performed based on the access object, access order, etc., so that after the target intranet view library obtains the target view data, it can obtain the original data from the specified access object among multiple storage - reused intranet view libraries, or obtain the original data from the storage - reused intranet view library at the corresponding position based on the access order each time the original data is obtained.
[0113] In an alternative method embodiment of the present disclosure, the view data merging component can clear the merged first view data, second view data, etc. from the local memory, or can clear the view data that has waited for more than the waiting period and has not been merged from the local memory, so as to avoid reducing the occupancy of storage capacity by redundant data, improve data reading and writing efficiency, and thus improve the efficiency of view data analysis, merging, updating, and writing. In practical applications, each view data may include "ID", "User - Identify", "User - Identify", etc. Among them, according to the view data definition, "ID" occupies 48 bytes, "User - Identify" occupies 20 bytes, and "User - Identify" occupies 256 bytes. Then each view data may occupy 324 bytes. Taking the example of receiving 30 million view data per day and the waiting period being 7 days, in the case where no view data merging is completed within the waiting period, it occupies at most 63 GB of memory, with small storage requirements, and the view data to be processed can be placed in the local memory for easy reading and writing, effectively improving the view data processing efficiency.
[0114] The view data merging method provided by the embodiments of the present disclosure is applied to a view data merging component, which can receive first view data and second view data. Among them, the first view data and the second view data are transmitted in the URL format, and the data sources of the first view data and the second view data can include a first external network view library or a storage-reused internal network view library; the first external network view library is used to provide view data containing the external network URL address corresponding to the original data for the second external network view library, and to transmit the external network URL address across the network to the target internal network view library through the view data; the storage-reused internal network view library is used to store the view data containing the original data transmitted across the network by the second external network view library, and to send the internal network URL address generated by storing the original data to the target internal network view library through the view data; and the first view data and the second view data correspond to the same original data; then, in the case of different data sources, the first view data and the second view data can be merged so that the target internal network view library obtains target view data, and the target view data includes the internal network URL address, so that the target internal network view library can access the storage-reused internal network view library through the internal network URL address to obtain the corresponding original data. In the present disclosure, the first external network view library does not need to download the original data from the second external network view library through the external network URL address and send the original data to the target internal network view library through the view data, but transmits the view data containing the external network URL address to the target internal network view library across the network in the URL format, which can reduce the bandwidth pressure of cross-network transmission, reduce the consumption of computer hardware resources, and the burden on network resources; moreover, the target internal network view library can, based on view data merging, obtain the internal network URL address of the original data provided by the storage-reused internal network view library when the same original data corresponds to different data sources, so as to access the storage-reused internal network view library to obtain it, without repeatedly storing the original data in the target internal network view library, effectively saving storage resources.
[0115] Figure 7a One of the schematic diagrams of the architecture of the view data merging system provided by the embodiments of the present disclosure, as Figure 7a shown, divided by the network boundary X, the network architecture includes a first external network view library 701 and a second external network view library 702 deployed on the external network, and a storage-reused internal network view library 703, a target internal network view library 704, and a view data merging component 705 deployed on the internal network; among them, the storage-reused internal network view library 403 is composed of "view libraries A1, A2, A3, ···, An" subscribed by the target internal network view library 402.
[0116] The first external network view library 701 is used to receive the view data containing the external network URL address corresponding to the original data provided by the second external network view library 702, and to transmit the external network URL address across the network to the target internal network view library 704 through the view data.
[0117] The second external network view library 702 is used to provide view data containing the external network URL address corresponding to the original data to the first external network view library 701, and cross-network transmit view data containing the original data to the storage multiplexing internal network view library 703.
[0118] The storage multiplexing internal network view library 703 is used to store the view data containing the original data cross-network transmitted by the second external network view library 702, and send the internal network URL address generated by storing the original data to the target internal network view library 704 through the view data;
[0119] The view data merging component 705 is used to receive the view data sent to the target internal network view library 704, and when receiving the first view data and the second view data corresponding to the same original data and with different data sources, merge the first view data and the second view data, so that the target internal network view library 704 obtains the target view data, and the target view data includes the internal network URL address, and the internal network URL address is used to access the storage multiplexing internal network view library 703 to obtain the corresponding original data.
[0120] In the embodiments of the present disclosure, as Figure 7a shown, in the Figure 7a network architecture shown, the view data merging component 705 can receive the view data transmitted in the URL format by the first external network view library 701 and the storage multiplexing internal network view library 703 to the target internal network view library 704, and determine the first view data and the second view data corresponding to the same original data in the received view data; further, when the data sources in the first view data and the second view data are different, the view data merging component can merge the first view data and the second view data, obtain the external network structured information from the view data with the data source being the first external network view library 701, obtain the data source and the internal network URL address from the view data with the data source being the storage multiplexing internal network view library 703 and then merge them, so that the target internal network view library obtains the target view data containing the internal network URL address of the original data, and can access the storage multiplexing internal network view library based on the internal network URL address to obtain the corresponding original data, Figure 7a The view data merging system shown and the steps that can be used to execute the view data merging method shown in the foregoing Figures 2 to 4 are not described herein again to avoid repetition.
[0121] In an alternative embodiment of the present disclosure, the view data merging component 405 is configured on the target internal network view library 402.
[0122] In an embodiment of the present disclosure, when the view data merging component 705 is deployed on the target intranet view library 704, the view data merging component 705 may first receive the first view data, write the first view data into the target intranet view library, and when receiving the second view data of the same original data object, merge the first view data and the second view data in the target intranet view library 704, so that the target intranet view library 702 obtains the target view data; in this process, the target intranet view library 704 goes through two writes in one merge of the target view data.
[0123] In an alternative embodiment of the present disclosure, the view data merging component and the target intranet view library are independently deployed.
[0124] Figure 7b This is the second schematic diagram of the architecture of the view data merging system provided by the embodiments of the present disclosure. As Figure 7b shown, the view data merging component 705 and the target intranet view library 704 may be independently deployed. At this time, the view data merging component 705 may first receive the first view data, write the first view data into the local memory of the view data merging component, and when receiving the second view data of the same original data object, merge the first view data and the second view data in the local memory, and send the obtained target view data to the target intranet view library 704, so that the target intranet view library 704 obtains the target view data; in this process, the target intranet view library 704 goes through one write in one merge of the target view data.
[0125] It should be noted that in the overall architecture, Figure 7a , b only schematically shows the part of the network architecture improved by the present disclosure. In practical applications, for other parts of the network architecture required to implement image acquisition, parsing, storage, view data transmission, etc., reference may be made to the content and related descriptions shown in the foregoing Figure 1 as shown.
[0126] In an optional embodiment of the present disclosure, in addition to the second external network view library, the first external network view library may also obtain view data from other sources. The original information in the view data may be an original string, a base64 encoding of an original image, or other forms of encoding, such as a base64 encoding of an image frame in a surveillance video stream that is not stored in the second external network view library. At this time, the first external network view library may send the view data from other sources to the second external network view library, and then the second external network view library may store the view data from other sources to obtain the external network URL address corresponding to the original data in the view data. Further, the second external network view library may provide the view data corresponding to the original data to the first external network view library through the external network service system, including the external network URL address where the original data is stored in the second external network view library.
[0127] Furthermore, the first external network view library may also send the view data in the form of a URL to the target internal network view library, so that the target internal network view library does not need to store the original data anymore, and any source data can be obtained from the storage-reusable internal network view library, completely liberating the storage pressure of the target internal network view library and further effectively improving the data transmission efficiency. In this method, the first external network view library may also send the original data that needs to be transmitted across the network to the second external network view library, so that all view data can be sent to the target internal network view library in the form of a URL, further reducing bandwidth occupancy and computer hardware resource consumption; and based on the Figures 2 - 4 view data merging method shown above, the second external network view library may transmit the stored original data across the network to the storage-reusable internal network view library, so that the storage-reusable internal network view library can provide the fifth view data to the target internal network view library, including the internal network URL address where the original data is stored in the storage-reusable internal network view library, for the target internal network view library to obtain. Thus, the target content view library does not need to store the original data locally, releasing its storage resources and improving the data reading and writing efficiency.
[0128] Taking Figure 1 the network architecture shown as an example, the external network view library V 102 may serve as the first external network view library, the external network third-party view library T 103 may serve as the second external network view library, the internal network view library V’104 serves as the target internal network view library, and the internal network third-party view library T’105 serves as the storage-reusable internal network view library.
[0129] When the external network view library V 102 receives view data, if the view data is transmitted in the form of a URL, including the external network URL address of the original data, it means that the view data is provided by the external network third-party view library T 103, and the external network third-party view library T 103 stores the original data corresponding to the view data. At the same time, the external network third-party view library T 103 will also transmit the original data across the network to the internal network third-party view library T’105.
[0130] Further, the external network view library V 102 can send the view data to the internal network view library V' 104. The internal network view library V' 104 is configured with a view data merging component, which can, based on Figure 2 , 3 the view data merging method shown, enable the internal network view library V' 104 to obtain the original data from the internal network third-party view library T' 105.
[0131] Optionally, when the external network view library V 102 receives view data, if the view data is transmitted in Base64 format, it can send the view data to the external network third-party view library T 103, so that the external network third-party view library T 103 stores the Base64 string of the original data and provides the view data containing the URL address corresponding to the Base64 string to the external network view library V 102.
[0132] Figure 8 FIG. 800 is a schematic structural diagram of a view data storage component provided by an embodiment of the present disclosure. As Figure 8 shown, the component may include:
[0133] A view data receiving module 801, configured to receive first view data and second view data; the first view data and the second view data are transmitted in URL format, and the data sources of the first view data and the second view data include a first external network view library or a storage-reused internal network view library; the first external network view library is configured to receive view data containing the external network URL address corresponding to the original data provided by a second external network view library, and transmit the external network URL address across the network to a target internal network view library through view data; the storage-reused internal network view library is configured to store view data containing the original data transmitted across the network by the second external network view library, and transmit the internal network URL address generated by storing the original data to the target internal network view library through view data; the first view data and the second view data correspond to the same original data;
[0134] A view data merging module 802, configured to merge the first view data and the second view data when the data sources of the first view data and the second view data are different, so that the target internal network view library obtains target view data, and the target view data includes an internal network URL address, and the internal network URL address is used to access the storage-reused internal network view library to obtain the corresponding original data.
[0135] In an alternative device embodiment of the present disclosure, the view data merging module 802 is specifically configured to, when the data source of the first view data is the first external network view library and the data source of the second view data is the storage-reused internal network view library, merge the external network structured information of the first view data with the data source and the internal network URL address of the second view data, so that the target internal network view library obtains the target view data.
[0136] In an alternative device embodiment of the present disclosure, the view data receiving module 801 is specifically configured to receive the first view data sent to the target internal network view library. The data source of the first view data is the first external network view library, and the first view data includes external network structured information and an external network URL address; write the first view data into the target internal network view library; and on the basis of having received the first view data, receive the second view data corresponding to the same original data. The data source of the second view data is the storage-reused internal network view library, and the second view data includes an internal network URL address.
[0137] Then the view data merging module 802 is specifically configured to determine that the data sources are different, and in the target internal network view library, update the data source and the external network URL address of the first view data with the data source and the internal network URL address of the second view data to obtain the target view data. The target view data includes external network structured information, the data source of the second view data, and the internal network URL address.
[0138] In an alternative embodiment of the present disclosure, the view data merging component and the target internal network view library are separately and independently deployed. The view data receiving module 801 is specifically configured to receive the first view data sent to the target internal network view library. The data source of the first view data is the storage-reused internal network view library, and the first view data includes an internal network URL address. Write the first view data into the local memory of the view data merging component; and on the basis of having received the first view data, receive the second view data corresponding to the same original data. The data source of the second view data is the first external network view library, and the second view data includes external network structured information and an external network URL address.
[0139] Then the view data merging module 802 is specifically configured to determine that the data sources are different, and in the local memory, update the data source and the external network URL address of the second view data with the data source and the internal network URL address of the first view data to obtain the target view data. The target view data includes external network structured information, the data source of the first view data, and the internal network URL address, and send the target view data to the target internal network view library.
[0140] In an optional embodiment of the present disclosure, the view data receiving module 801 is specifically configured to receive first view data sent to the target intranet view library. The data source of the first view data is the first extranet view library, and the first view data includes extranet structured information and an extranet URL address; write the first view data into the local memory of the view data merging component; on the basis of having received the first view data, receive second view data corresponding to the same original data. The data source of the second view data is the storage multiplexing intranet view library, and the second view data includes an intranet URL address.
[0141] The view data merging module 802 is specifically configured to determine that the data sources are different, and update the data source and the extranet URL address of the first view data with the data source and the intranet URL address of the second view data in the local memory to obtain target view data. The target view data includes extranet structured information, the data source of the second view data, and the intranet URL address; send the target view data to the target intranet view library.
[0142] The view data merging component provided by the present disclosure can receive first view data and second view data. Among them, the first view data and the second view data are transmitted in the URL format, and the data sources of the first view data and the second view data can include a first external network view library or a storage-reused internal network view library. The first external network view library is used to provide view data containing the external network URL address corresponding to the original data for the second external network view library, and to transmit the external network URL address across the network to the target internal network view library through the view data. The storage-reused internal network view library is used to store the view data containing the original data transmitted across the network by the second external network view library, and to send the internal network URL address generated by storing the original data to the target internal network view library through the view data. And the first view data and the second view data correspond to the same original data. Then, in the case of different data sources, the first view data and the second view data can be merged so that the target internal network view library obtains target view data, and the target view data includes the internal network URL address. Then, the target internal network view library can access the storage-reused internal network view library through the internal network URL address to obtain the corresponding original data. In the present disclosure, the first external network view library does not need to download the original data from the second external network view library through the external network URL address and send the original data to the target internal network view library through the view data, but transmits the view data containing the external network URL address to the target internal network view library across the network in the URL format, which can reduce the bandwidth pressure of cross-network transmission, reduce the consumption of computer hardware resources, and the burden on network resources. Moreover, based on the view data merging, when the same original data corresponds to different data sources, the target internal network view library can obtain the internal network URL address of the original data provided by the storage-reused internal network view library, so as to access the storage-reused internal network view library to obtain it, without repeatedly storing the original data in the target internal network view library, which also effectively saves storage resources.
[0143] Figure 9 FIG. is a schematic structural diagram of an electronic device 900 provided by an embodiment of the present disclosure, as Figure 9 shown. The electronic device 900 may include a processor 901, a memory 902, a program or instruction stored on the memory 902 and executable on the processor 901. When the program or instruction is executed by the processor 901, it implements each process of the above-mentioned view data merging method embodiment and can achieve the same technical effect. To avoid repetition, it will not be elaborated here.
[0144] It should be noted that Figure 9 the shown electronic device 900 is only an example and should not bring any limitation to the functions and usage scopes of the embodiments of the present disclosure.
[0145] Figure 10 FIG. is a hardware schematic diagram of an electronic device 1000 provided by an embodiment of the present disclosure, as Figure 10As shown, the electronic device 1000 includes a Central Processing Unit (CPU) 1001, which can perform various appropriate actions and processes according to the program stored in the ROM (Read Only Memory) 1002 or the program loaded from the storage section 1008 into the RAM (Random Access Memory) 1003. In the RAM 1003, various programs and data required for system operation are also stored. The CPU 1001, ROM 1002, and RAM 1003 are connected to each other via a bus 1004. An I / O (Input / Output) interface 1005 is also connected to the bus 1004.
[0146] The following components are connected to the I / O interface 1005: an input section 1006 including a keyboard, a mouse, etc.; an output section 1007 including, for example, a CRT (Cathode Ray Tube), an LCD (Liquid Crystal Display), etc., and a speaker, etc.; a storage section 1008 including a hard disk, etc.; and a communication section 1009 including a network interface card such as a LAN (Local Area Network) card, a modem, etc. The communication section 1009 performs communication processing via a network such as the Internet. A drive 1010 is also connected to the I / O interface 1005 as needed. A removable medium 1011, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 1010 as needed so that a computer program read from it can be installed into the storage section 1008 as needed.
[0147] In particular, according to an embodiment of the present disclosure, the process described below with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes program code for performing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication section 1009, and / or installed from the removable medium 1011. When the computer program is executed by the Central Processing Unit (CPU 1001), various functions defined in the system of the present application are executed.
[0148] The embodiment of the present disclosure also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, each process of the above-described embodiment of the view data merging method is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be described in detail here.
[0149] Among them, the processor is the processor in the electronic device in the above embodiment. The readable storage medium includes computer-readable storage media such as ROM, RAM, magnetic disks, or optical discs, etc.
[0150] Another embodiment of the present disclosure provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor. The processor is used to run programs or instructions to implement each process of the above embodiment of the view data merging method, and can achieve the same technical effects. To avoid repetition, it will not be elaborated here.
[0151] It should be understood that the chip mentioned in the embodiments of the present disclosure may also be referred to as a system-on-chip, system chip, chip system, or system-on-chip, etc.
[0152] The embodiments of the present disclosure provide a computer program product containing instructions. When it runs on a computer, it causes the computer to execute the steps of the view data merging method as described above, and can achieve the same technical effects. To avoid repetition, it will not be elaborated here.
[0153] It should be noted that in this article, the term "including", "comprising", or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, article, or device including a series of elements not only includes those elements, but also includes other elements not explicitly listed, or further includes elements inherent to such process, method, article, or device. Without more limitations, an element defined by the statement "including a..." does not exclude the existence of another identical element in the process, method, article, or device including that element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present disclosure is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in a reverse order according to the functions involved. For example, the described methods may be performed in an order different from that described, and various steps may be added, omitted, or combined. Additionally, the features described with reference to certain examples may be combined in other examples.
[0154] Through the description of the above embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus a necessary general hardware platform. Of course, it can also be implemented by hardware, but in many cases, the former is a better implementation method. Based on such an understanding, the technical solution of the present disclosure, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disc) and includes several instructions to cause a terminal (which may be a mobile phone, computer, electronic device, air conditioner, or network device, etc.) to execute the methods of the various embodiments of the present disclosure.
[0155] The embodiments of the present disclosure have been described above in conjunction with the accompanying drawings. However, the present disclosure is not limited to the above specific embodiments. The above specific embodiments are merely illustrative rather than restrictive. Under the inspiration of the present disclosure, those of ordinary skill in the art can also make many forms without departing from the purpose of the present disclosure and the scope protected by the claims, and all of them fall within the protection scope of the present disclosure.
Claims
1. A method for merging view data, characterized in that, The method is applied to a view data merging component, and the method includes: Receiving first view data and second view data; the first view data and the second view data are transmitted in URL format, and the data sources of the first view data and the second view data include a first external network view library or a storage and reuse internal network view library; the first external network view library is used to receive view data containing the external network URL address corresponding to the original data provided by a second external network view library, and transmit the external network URL address across the network to a target internal network view library through the view data; the storage and reuse internal network view library is used to store the view data containing the original data transmitted across the network by the second external network view library, and send the internal network URL address generated by storing the original data to the target internal network view library through the view data; the first view data and the second view data correspond to the same original data. In the case where the data sources of the first view data and the second view data are different, merging the first view data and the second view data so that the target internal network view library obtains target view data, the target view data includes an internal network URL address, and the internal network URL address is used to access the storage and reuse internal network view library to obtain the corresponding original data.
2. The method according to claim 1, wherein The step of, in the case where the data sources of the first view data and the second view data are different, merging the first view data and the second view data so that the target internal network view library obtains target view data, includes: In the case where the data source of the first view data is the first external network view library and the data source of the second view data is the storage and reuse internal network view library, merging the external network structured information of the first view data with the data source and the internal network URL address of the second view data so that the target internal network view library obtains target view data.
3. The method according to claim 1, characterized in that, The step of receiving first view data and second view data includes: Receiving the first view data sent to the target internal network view library, the data source of the first view data is the first external network view library, and the first view data includes external network structured information and an external network URL address; Writing the first view data into the target internal network view library; On the basis of having received the first view data, receiving the second view data corresponding to the same original data, the data source of the second view data is the storage and reuse internal network view library, and the second view data includes an internal network URL address; The step of, in the case where the data sources of the first view data and the second view data are different, merging the first view data and the second view data so that the target internal network view library obtains target view data, includes: Determine that the data sources are different, and in the target intranet view library, use the data source and intranet URL address of the second view data to update the data source and external network URL address of the first view data, to obtain target view data, where the target view data includes the external network structured information, the data source of the second view data, and the intranet URL address.
4. The method according to claim 1, characterized in that, The view data merging component and the target intranet view library are deployed independently. The receiving of the first view data and the second view data includes: Receive the first view data sent to the target intranet view library. The data source of the first view data is the storage reuse intranet view library, and the first view data includes an intranet URL address. Write the first view data into the local memory of the view data merging component. On the basis of having received the first view data, receive the second view data corresponding to the same original data. The data source of the second view data is the first external network view library, and the second view data includes external network structured information and an external network URL address. In the case where the data sources of the first view data and the second view data are different, merge the first view data and the second view data, so that the target intranet view library obtains target view data, including: Determine that the data sources are different, and in the local memory, use the data source and intranet URL address of the first view data to update the data source and external network URL address of the second view data, to obtain target view data, where the target view data includes the external network structured information, the data source of the first view data, and the intranet URL address; Send the target view data to the target intranet view library.
5. The method according to claim 1, wherein The view data merging component and the target intranet view library are deployed independently. The receiving of the first view data and the second view data includes: Receive the first view data sent to the target intranet view library. The data source of the first view data is the first external network view library, and the first view data includes external network structured information and an external network URL address. Write the first view data into the local memory of the view data merging component. On the basis of having received the first view data, receive the second view data corresponding to the same original data. The data source of the second view data is the storage reuse intranet view library, and the second view data includes an intranet URL address. In the case where the data sources of the first view data and the second view data are different, merge the first view data and the second view data, so that the target intranet view library obtains target view data, including: Determine that the data sources are different. In the local memory, use the data source and the intranet URL address of the second view data to update the data source and the extranet URL address of the first view data, and obtain target view data. The target view data includes the extranet structured information, the data source of the second view data, and the intranet URL address; Send the target view data to the target intranet view library.
6. A view data storage system, characterized in that, The system includes a first extranet view library and a second extranet view library deployed on the extranet, and a target intranet view library, a storage reuse intranet view library, and a view data merging component deployed on the intranet; The first extranet view library is used to receive view data containing the extranet URL address corresponding to the original data provided by the second extranet view library, and transmit the extranet URL address to the target intranet view library across the network through the view data; The second extranet view library is used to provide view data containing the extranet URL address corresponding to the original data to the first extranet view library, and transmit view data containing the original data to the storage reuse intranet view library across the network; The storage reuse intranet view library is used to store the view data containing the original data transmitted by the second extranet view library across the network, and send the intranet URL address generated by storing the original data to the target intranet view library through the view data; The view data merging component is used to receive view data, and when receiving the first view data and the second view data corresponding to the same original data and with different data sources, merge the first view data and the second view data, so that the target intranet view library obtains target view data. The target view data includes an intranet URL address, and the intranet URL address is used to access the storage reuse intranet view library to obtain the corresponding original data.
7. The system according to claim 6, characterized in that, The view data merging component is deployed on the target intranet view library; or, The view data merging component and the target intranet view library are independently deployed respectively.
8. An electronic device, characterized in that, The electronic device includes: A processor; and A memory for storing executable instructions of the processor; Wherein, the processor is configured to execute the view data merging method according to any one of claims 1-5 by executing the executable instructions.
9. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the view data merging method according to any one of claims 1-5.
10. A computer program product, characterized in that, When the computer program product runs on an electronic device, it causes the electronic device to execute the view data merging method according to any one of claims 1-5.
Citation Information
Patent Citations
Web service application system for user network service facing electric power market transaction
CN201266950Y
ETL data transit method and system
US20130325788A1