Method, device, medium and electronic device for collecting on-chain digital content

Abstract

The application discloses a method and device for collecting digital content on a chain, a medium and an electronic device. The method comprises the following steps: acquiring basic block data from a target blockchain network to be processed; generating platform access addresses of a plurality of digital content transaction platforms based on the basic block data, wherein the digital content transaction platforms are used for transacting digital content generated in the target blockchain network; and reading target digital content in the target blockchain network from the digital content transaction platforms based on the platform access addresses through a simulated browser cluster and a limitation breakthrough plug-in. The application can realize collection of digital content in a blockchain network, ensure accuracy of the collected digital content, and reduce the collection cost of the digital content.

Description

Technical Field

[0001] This application relates to the field of computer technology, specifically to the field of blockchain, and in particular to a method, apparatus, medium, and electronic device for collecting on-chain digital content. Background Technology

[0002] Digital content generated by blockchain networks can be traded through digital content trading platforms. In other words, digital content generated by blockchain networks can be acquired through digital content trading platforms.

[0003] In related technologies, web page downloaders or script tools such as web crawlers are typically used to obtain the web page code of digital content trading platforms. Then, methods such as searching for keywords or parsing the web page code are used to collect digital content from these platforms. However, obtaining the access URL of a digital content trading platform is inherently difficult, and the security mechanisms implemented by these platforms further complicate the process. Furthermore, in some cases, a physical screen and a physical browser are required to collect digital content from these platforms, resulting in high costs. Summary of the Invention

[0004] This application provides a method, apparatus, medium, and electronic device for collecting on-chain digital content, which can collect digital content from a blockchain network, ensure the accuracy of the collected digital content, and reduce the cost of collecting digital content.

[0005] According to a first aspect of this application, a method for collecting on-chain digital content is provided, the method comprising:

[0006] Obtain basic block data from the target blockchain network to be processed;

[0007] Based on the aforementioned basic block data, platform access addresses for multiple digital content trading platforms are generated; wherein, the digital content trading platforms are used to trade digital content generated in the target blockchain network;

[0008] By simulating browser clusters and restriction-breaking plugins, the target digital content in the target blockchain network is read from the digital content trading platform based on the platform's access address.

[0009] According to a second aspect of this application, an on-chain digital content acquisition device is provided, the device comprising:

[0010] The basic block data acquisition module is used to acquire basic block data from the target blockchain network to be processed;

[0011] The platform access address determination module is used to generate platform access addresses for multiple digital content trading platforms based on the basic block data; wherein, the digital content trading platforms are used to trade digital content generated in the target blockchain network;

[0012] The target digital content reading module is used to read target digital content from the target blockchain network of the digital content trading platform based on the platform access address by simulating a browser cluster and a restriction bypass plugin.

[0013] According to a third aspect of the present invention, embodiments of this application provide a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the on-chain digital content acquisition method as described in embodiments of this application.

[0014] According to a fourth aspect of the present invention, an electronic device is provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, it implements the on-chain digital content acquisition method as described in the embodiments of the present application.

[0015] This application's technical solution generates multiple platform access addresses for digital content trading platforms based on basic block data obtained from the target blockchain network to be processed. By simulating browser clusters and using restriction-breaking plugins, it reads target digital content from the target blockchain network from the digital content trading platforms based on these platform access addresses, thus achieving the collection of digital content from the blockchain network. The digital content trading platforms are used to trade digital content generated in the target blockchain network. By accessing the digital content trading platforms and reading the target digital content from the target blockchain network, the accuracy of the collected digital content can be guaranteed. This application's use of simulated browser clusters and restriction-breaking plugins to access the digital content trading platforms reduces the cost of digital content collection.

[0016] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of this application, nor is it intended to limit the scope of this application. Other features of this application will become readily apparent from the following description. Attached Figure Description

[0017] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0018] Figure 1This is a flowchart of the on-chain digital content collection method provided in Implementation Example 1;

[0019] Figure 2 This is a flowchart of the on-chain digital content collection method provided in Embodiment 2;

[0020] Figure 3 This is a schematic diagram of the structure of the on-chain digital content acquisition device provided in Embodiment 3 of this application;

[0021] Figure 4 This is a schematic diagram of the structure of an electronic device provided in Embodiment 4 of this application. Detailed Implementation

[0022] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present application, and not all embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative effort should fall within the scope of protection of the present application.

[0023] It should be noted that the terms "first," "second," "target," and "candidate," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0024] Example 1

[0025] Figure 1 This is a flowchart of the on-chain digital content collection method provided in Embodiment 1. This embodiment is applicable to the collection of digital content in a blockchain network. The method can be executed by an on-chain digital content collection device, which is implemented in hardware and / or software and can be integrated into an electronic device running this system.

[0026] like Figure 1 As shown, the method includes:

[0027] S110. Obtain basic block data from the target blockchain network to be processed.

[0028] Optionally, the target blockchain network to be processed is determined based on the digital content collection request. The digital content collection request is used to request the collection of digital content generated by the target blockchain network to be processed. Optionally, the digital content collection request includes the blockchain identifier of the target blockchain network.

[0029] Digital content generated by the target blockchain network through smart contracts will be traded on digital content trading platforms. When the target blockchain network engages in digital content trading on these platforms, the trading platforms simultaneously acquire the digital content information via blockchain synchronization and display it on their websites. Accessing these trading platforms allows users to collect digital content generated by the target blockchain network.

[0030] The base block data is used to generate platform access addresses for multiple digital content trading platforms. The base block data can be extracted from existing block data in the target blockchain network. Existing block data refers to all block data generated within the target blockchain network. Optionally, existing block data can be obtained from blockchain nodes in the target blockchain network.

[0031] Optionally, the basic block data includes: transaction transfer data, smart contract data, and digital content identifiers (tokenId).

[0032] S120. Based on the basic block data, generate platform access addresses for multiple digital content trading platforms; wherein, the digital content trading platforms are used to trade digital content generated in the target blockchain network.

[0033] The platform access address points to a digital content trading platform, used for data access. This platform is used to trade digital content generated within the target blockchain network. Accessing the platform allows the collection of digital content generated by the target blockchain network. Optionally, the platform access address is a Uniform Resource Locator (URL).

[0034] S130. By simulating a browser cluster and a restriction-breaking plugin, the target digital content in the target blockchain network is read from the digital content trading platform based on the platform access address.

[0035] The simulated browser cluster is used to simulate the physical browser cluster. The physical browser cluster needs to run directly on real devices and, under the control of user operation or automated scripts, read target digital content from the target blockchain network of the digital content trading platform. The physical browser cluster includes a physical browser and a physical display screen. The physical browser refers to browser software on a real computer, and the target digital content accessed by the physical browser is displayed on the physical display screen. The physical display screen refers to a physical screen.

[0036] A simulated browser cluster does not need to run directly on a real device. By simulating the behavior and protocols of a physical browser, it simulates real user operations such as entering URLs, sending requests, and receiving responses, thereby achieving automated access to a digital content trading platform. Optionally, the simulated browser cluster includes: a simulated browser and a virtual display screen. The simulated browser can be used to simulate real user operations occurring in a physical browser to automate access to the digital content trading platform. The target digital content accessed by the simulated browser is displayed on the virtual display screen. The virtual display screen can simulate the display effect of a physical display screen.

[0037] Optionally, the simulated browser cluster is configured with a restriction-breaking plugin. This plugin assists the simulated browser cluster in bypassing page access restrictions of the digital content trading platform when reading target digital content. The specific type of restriction-breaking plugin is not limited here; it is determined based on actual business needs. For example, the restriction-breaking plugin could be a graphic CAPTCHA processing plugin, a browser fingerprint information processing plugin, etc. When the digital content trading platform requires a graphic CAPTCHA, the simulated browser cluster can bypass the image CAPTCHA restriction by loading the restriction-breaking plugin and continue data access.

[0038] Optionally, the simulated browser cluster requests a network proxy service to read target digital content from the target blockchain network on the digital content trading platform based on the platform access address. Optionally, the target digital content is used as feedback for the digital content acquisition request. Optionally, there are at least two platform access addresses and at least two target digital contents. That is, the target blockchain network can generate at least two target digital contents, which can be traded on different digital content trading platforms. The number of platform access addresses and the number of target digital contents are not limited here and are determined based on the actual situation. Optionally, the simulated browser cluster has a corresponding cluster management tool. The cluster management tool is used to manage the simulated browser cluster and to schedule data access tasks submitted to the simulated browser cluster.

[0039] Optionally, data acquisition tasks are generated based on the platform access address and submitted to a simulated browser cluster. The cluster management tool within the simulated browser cluster schedules these tasks. Optionally, the cluster management tool monitors the status of the simulated browser nodes in the cluster, obtaining status monitoring data. For example, the status of a simulated browser node can be busy, idle, healthy, or down. Based on the status monitoring data, the cluster management tool determines the task processing capacity of the simulated browser cluster. The cluster management tool then scales up or down the simulated browser cluster based on its task processing capacity and the number of submitted data acquisition tasks. The task processing capacity can be quantified by the number of tasks that the simulated browser cluster can handle.

[0040] Optionally, if the task processing capacity exceeds the number of task submissions, the simulated browser cluster should be scaled down; otherwise, the simulated browser cluster should be scaled up.

[0041] This application's technical solution generates multiple platform access addresses for digital content trading platforms based on basic block data obtained from the target blockchain network to be processed. By simulating browser clusters and using restriction-breaking plugins, it reads target digital content from the target blockchain network from the digital content trading platforms based on these platform access addresses, thus achieving the collection of digital content from the blockchain network. The digital content trading platforms are used to trade digital content generated in the target blockchain network. By accessing the digital content trading platforms and reading the target digital content from the target blockchain network, the accuracy of the collected digital content can be guaranteed. This application's use of simulated browser clusters and restriction-breaking plugins to access the digital content trading platforms reduces the cost of digital content collection.

[0042] In an optional embodiment, after reading the target digital content from the target blockchain network based on the platform access address, the method includes: determining the smart contract data associated with the target digital content based on the platform access address to which the target digital content belongs; obtaining target metadata from the target digital content based on the smart contract protocol in the smart contract data and determining the target data type to which the target metadata belongs; if the target data type is a data read address, then reading data based on the data read address and updating the target metadata according to the data read result until the target data type to which the target metadata belongs is a preset data type.

[0043] The target digital content is read from the digital content trading platform based on the platform access address of the digital content trading platform.

[0044] Given the target digital content, the digital content trading platform that has acquired the target digital content can be identified, and thus the platform access address of the digital content trading platform can be determined. The platform access address is determined based on the basic block data in the target blockchain network. Optionally, the basic block data includes: transaction transfer data, smart contract data, and digital content identifiers (tokenId).

[0045] Optionally, smart contract data includes a smart contract address and a smart contract protocol. For example, the smart contract protocol can be an ERC-721 protocol or an ERC-1155 protocol. The smart contract protocol supports metadata standards. Based on the smart contract protocol in the smart contract data, target metadata can be obtained from the target digital content. This target metadata describes data related to transactions on the blockchain, contract account status, network parameters, and other data. The target data type is the data type to which the target metadata belongs. Target metadata can be used to describe any type of data, including text, numbers, images, and data access addresses such as URLs. Accordingly, the target data type can be any type; for example, the target data type can be text, an image, or a data access address.

[0046] If the target data type is a data read address, it indicates that the target metadata includes nested numeric content. Data is read based on the data read address to obtain the data read result. The data read result is the resource file pointed to by the data read address.

[0047] Optionally, the data read result can be used as the new target metadata to update the target metadata. After the target metadata is updated, the target data type to which the target metadata belongs is determined again, and it is determined whether the target data type is a preset data type. Here, the preset data type refers to a data type other than the data read address. The preset data type is not limited here and is determined according to the actual situation. For example, the preset data type can be an image type or a text type. Determining whether the target data type to which the target metadata belongs is the data read address is actually to determine whether the target metadata includes nested numeric content. The target data type to which the target metadata belongs is a preset data type, indicating that the target metadata does not contain nested numeric content.

[0048] The above technical solution, after reading the target digital content from the digital content trading platform, determines whether the target metadata's data type is the data read address, and whether the target metadata includes nested digital content. If the target metadata includes nested digital content, data is read based on the data read address, and the target metadata is updated according to the data read results until the target metadata is a preset data type. This ensures the accuracy and completeness of the collected digital content.

[0049] In an optional embodiment, obtaining basic block data from the target blockchain network to be processed includes: deploying a target blockchain node in the target blockchain network and synchronizing existing block data in the target blockchain network through the target blockchain node; parsing the existing block data based on a pre-selected smart contract protocol to obtain data parsing results; and determining the basic block data of the target blockchain network based on the data parsing results.

[0050] It is known that each blockchain node in a blockchain network stores a complete copy of block data, which includes all transaction records and block information. When a new blockchain node joins the blockchain network, it needs to obtain the latest block data from other blockchain nodes and synchronize it. The process involves deploying a target blockchain node into the target blockchain network. The target blockchain node refers to the new blockchain node joining the target blockchain network. After joining the target blockchain network, the target blockchain node will synchronize the existing block data from the target blockchain network.

[0051] The pre-selected smart contract protocol is used to parse existing block data in the target blockchain network. The pre-selected smart contract protocol is determined based on the frequency of smart contract protocol usage, and it is highly likely that the pre-selected smart contract is consistent with the smart contract protocol used by the target blockchain network. For example, the pre-selected smart contract data can be based on the ERC-721 protocol or the ERC-1155 protocol. When the pre-selected smart contract protocol is consistent with the smart contract protocol used by the target blockchain network, using the pre-selected smart contract to parse the existing block data in the target blockchain network yields the data parsing results.

[0052] Optionally, transaction transfer data, smart contract data, and digital content identifiers can be extracted from the data parsing results. Based on the transaction transfer data, smart contract data, and digital content identifiers, the underlying block data can be determined.

[0053] The above technical solution provides a practical and feasible method for determining basic block data, which can be used to determine the basic block data in the target blockchain network and provides data support for determining the platform access address of the digital content trading platform.

[0054] In an optional embodiment, generating platform access addresses for multiple digital content trading platforms based on the base block data includes: extracting smart contract data and digital content identifiers from the base block data; concatenating the smart contract data and the digital content identifiers to obtain a data concatenation result; and generating platform access addresses for multiple digital content trading platforms based on the data concatenation result.

[0055] Smart contract data and platform access addresses are used to determine the platform access address of the digital content trading platform. Optionally, the smart contract data includes the smart contract protocol and the smart contract address. The digital content identifier is used to distinguish different digital content. The smart contract data and the digital content identifier are concatenated to obtain the concatenated data result. This concatenated data result is used to determine the platform access address of the digital content trading platform. The digital content trading platform may have multiple platform access addresses.

[0056] The above technical solution provides a practical method for determining platform access addresses, which can be used to determine the platform access addresses of digital content trading platforms. It provides technical support for retrieving target digital content from a target blockchain network within a digital content trading platform.

[0057] Example 2

[0058] Figure 2 This is a flowchart of the on-chain digital content acquisition method provided in Embodiment 2. This embodiment is a further optimization based on the above embodiments.

[0059] like Figure 2 As shown, the method includes:

[0060] S210. Obtain basic block data from the target blockchain network to be processed.

[0061] S220. Based on the basic block data, generate platform access addresses for multiple digital content trading platforms; wherein, the digital content trading platforms are used to trade digital content generated in the target blockchain network.

[0062] S230. The simulated browser cluster generates a data access request based on the platform access address and sends the data access request to the network proxy service.

[0063] Among them, the data access request is used to request the network proxy service to initiate data access to the digital content trading platform and obtain the target digital content from the digital content trading platform.

[0064] Data access requests are generated by a simulated browser cluster based on the platform's access address. The simulated browser cluster forwards the data access request to a network proxy service, which responds to the request to access data from the digital content trading platform. Optionally, the network proxy service, which is used to access data from the digital content trading platform, is an HTTP proxy service.

[0065] S240. Using the network proxy service based on a pre-selected network IP and data access request, the restriction bypass plugin is used to access the digital content trading platform to read target digital content from the target blockchain network.

[0066] It is known that digital content trading platforms may restrict data access requests from certain regions, by directly denying access to network IP (Internet Protocol) addresses from those regions. This application embodiment addresses this by setting up a network proxy service. This proxy service accesses the digital content trading platform based on a pre-selected network IP and data access request, thus bypassing the platform's IP restrictions and making it possible to obtain target digital content from the platform.

[0067] The pre-selected network IPs are used to bypass the IP restrictions of the digital content trading platform. Optionally, at least two pre-selected network IPs are used, and these pre-selected network IPs are stored in a network IP pool. The network IPs in the pool can be updated based on their validity. Initiating data access to the digital content trading platform based on the pre-selected network IPs can avoid the platform rejecting access.

[0068] The restriction bypass plugin is configured in the simulated browser cluster. This plugin assists the simulated browser cluster in bypassing page access restrictions of the digital content trading platform when reading target digital content. The specific type of restriction bypass plugin is not limited here; it is determined based on actual business needs. For example, the restriction bypass plugin could be a graphic CAPTCHA processing plugin, a browser fingerprint information processing plugin, etc. When the digital content trading platform requires the input of a graphic CAPTCHA, the simulated browser cluster can bypass the image CAPTCHA restriction by loading the restriction bypass plugin and continue data access.

[0069] Data access requests are generated by a cluster of simulated browsers based on the platform's access address. These data access requests determine the digital content trading platform from which data access is required.

[0070] This application embodiment includes a network proxy service. The network proxy service works in conjunction with a simulated browser cluster to access data from the digital content trading platform based on a pre-selected network IP and data access request. It reads the target digital content from the target blockchain network, which can break through the IP restrictions of the digital content trading platform and make it possible to obtain the target digital content from the digital content trading platform.

[0071] In an optional embodiment, the simulated browser cluster is constructed as follows: a virtual display screen and a simulated browser are created, and the virtual display screen and the simulated browser are integrated to obtain a browser image; the browser image is deployed to at least one target physical machine, the browser image is instantiated to obtain a browser container, and the simulated browser cluster is obtained based on the browser container.

[0072] The virtual display screen can simulate the display effect of a physical display screen. The simulated browser can be used to simulate real user operations occurring in a physical browser to automatically access the digital content trading platform. The target digital content accessed by the simulated browser is displayed through the virtual display screen. In this embodiment, the simulated browser and virtual display screen are created using virtualization technology. This virtualization technology can be any existing simulated browser creation technology or virtual display screen creation technology, and is not limited here; it is determined based on the actual situation.

[0073] Optionally, after creating the virtual display screen and the simulated browser, they are integrated into a single browser image. This browser image is then deployed to at least one target physical machine and instantiated to create a browser container. Optionally, at least two browser images are deployed on each target physical machine; correspondingly, at least two browser containers are created. A simulated browser cluster is then obtained based on these browser containers.

[0074] The above technical solution provides a practical and feasible scheme for constructing a simulated browser cluster, providing technical support for using simulated browser clusters to collect target digital content in the target blockchain network.

[0075] In an optional embodiment, the method further includes: feeding back data access results to the simulated browser cluster via the network proxy service based on the target network interface of the preselected network IP; listening to the target network interface of the preselected network IP via a listening proxy service to collect the data access results; extracting first digital content from the data access results fed back to the simulated browser cluster by the network proxy service; extracting second digital content from the data access results collected by the listening proxy service at the target network interface; and generating the target digital content based on the first digital content and the second digital content.

[0076] The target network interface of the pre-selected network IP is used to output the data access results obtained from the digital content trading platform. The network proxy service initiates data access to the digital content trading platform based on the pre-selected network IP, and the data access results are also fed back through the target network interface of the pre-selected network IP.

[0077] The monitoring proxy service is positioned between the network proxy service and the simulated browser cluster to monitor the target network interface of a pre-selected network IP. By monitoring the target network interface of the pre-selected network IP, the monitoring proxy service can collect data access results from the target network interface. Optionally, the monitoring proxy service can be a MITM (man in the middle) attack proxy service.

[0078] It is clear that the data access results output through the target network interface are not entirely the same as the data access results displayed through the simulated browser cluster. In other words, the data access results displayed by the simulated browser cluster do not represent the full content of the data access results output by the target network interface.

[0079] Extract the first digital content from the data access results fed back to the simulated browser cluster by the network proxy service. Extract the second digital content from the data access results collected by the listening proxy service at the target network interface. Generate the target digital content based on the first and second digital content.

[0080] The first digital content corresponds to the implicit digital content in the data access result, and the second digital content corresponds to the explicit digital content in the data access result. Neither the first nor the second digital content is complete; only the target digital content obtained by combining the first and second digital content is complete.

[0081] The above technical solution establishes a listening proxy service between the network proxy service and the simulated browser cluster. This service monitors the target network interface of a pre-selected network IP to collect data access results. Based on the data access results fed back to the simulated browser cluster by the network proxy service and the data access results collected by the listening proxy service at the target network interface, the target digital content is generated, ensuring the integrity and accuracy of the digital content.

[0082] Example 3

[0083] Figure 3 This is a schematic diagram of the structure of the on-chain digital content collection device provided in Embodiment 3 of this application. This embodiment can be applied to the collection of digital content in the blockchain network. The device can be implemented by software and / or hardware and can be integrated into electronic devices such as smart terminals.

[0084] like Figure 3 As shown, the device may include:

[0085] The basic block data acquisition module 310 is used to acquire basic block data from the target blockchain network to be processed;

[0086] The platform access address determination module 320 is used to generate platform access addresses for multiple digital content trading platforms based on the basic block data; wherein, the digital content trading platform is used to trade digital content generated in the target blockchain network;

[0087] The target digital content reading module 330 is used to read target digital content from the target blockchain network of the digital content trading platform based on the platform access address by simulating a browser cluster and a restriction bypass plugin.

[0088] This application's technical solution generates multiple platform access addresses for digital content trading platforms based on basic block data obtained from the target blockchain network to be processed. By simulating a browser cluster and using a restriction-breaking plugin, it reads target digital content from the target blockchain network from the digital content trading platforms based on these platform access addresses, thus achieving the collection of digital content from the blockchain network. The digital content trading platforms are used to trade digital content generated in the target blockchain network. By accessing the digital content trading platforms and reading the target digital content from the target blockchain network, the accuracy of the collected digital content can be guaranteed. This application reduces the cost of digital content collection by simulating a browser cluster to access the digital content trading platforms.

[0089] Optionally, the simulated browser cluster is constructed as follows: a virtual display screen and a simulated browser are created, and the virtual display screen and the simulated browser are integrated to obtain a browser image; the browser image is deployed to at least one target physical machine; the browser image is instantiated to obtain a browser container, and the simulated browser cluster is obtained based on the browser container.

[0090] Optionally, the target digital content reading module 330 includes: a data access request generation submodule, used to generate a data access request based on the platform access address through the simulated browser cluster and send the data access request to the network proxy service; and a target digital content reading submodule, used to access the digital content trading platform through the network proxy service based on a pre-selected network IP and the data access request, using the restriction bypass plugin to read target digital content from the target blockchain network.

[0091] Optionally, the apparatus further includes: a data access result feedback module, configured to feed back data access results to the simulated browser cluster via the network proxy service based on the target network interface of the preselected network IP; a data access result collection module, configured to collect the data access results by monitoring the target network interface of the preselected network IP via a monitoring proxy service; a first digital content extraction module, configured to extract first digital content from the data access results fed back to the simulated browser cluster by the network proxy service; a second digital content extraction module, configured to extract second digital content from the data access results collected by the monitoring proxy service at the target network interface; and a target digital content generation module, configured to generate the target digital content based on the first digital content and the second digital content.

[0092] Optionally, the basic block data acquisition module 310 includes: an existing block data synchronization submodule, used to deploy target blockchain nodes in the target blockchain network and synchronize existing block data in the target blockchain network through the target blockchain nodes; a data parsing result determination submodule, used to parse the existing block data based on a pre-selected smart contract protocol to obtain data parsing results; and basic block data determination, used to determine the basic block data of the target blockchain network based on the data parsing results.

[0093] Optionally, the platform access address determination module 320 includes: a first related data extraction submodule, used to extract smart contract data and digital content identifiers from the basic block data; a data splicing result determination submodule, used to splice the smart contract data and the digital content identifiers to obtain a data splicing result; and a platform access address determination submodule, used to generate platform access addresses for multiple digital content trading platforms based on the data splicing result.

[0094] Optionally, the device includes: a smart contract data determination module, configured to determine the smart contract data associated with the target digital content based on the platform access address to which the target digital content belongs after reading the target digital content from the target blockchain network based on the platform access address; a target metadata acquisition module, configured to acquire target metadata from the target digital content according to the smart contract protocol in the smart contract data and determine the target data type to which the target metadata belongs; and a target metadata update module, configured to, if the target data type is a data read address, perform data reading based on the data read address and update the target metadata according to the data read result until the target data type to which the target metadata belongs is a preset data type.

[0095] The on-chain digital content acquisition device provided in the embodiments of the invention can execute the on-chain digital content acquisition method provided in any embodiment of this application, and has the corresponding performance modules and beneficial effects for executing the on-chain digital content acquisition method.

[0096] The collection, storage, use, processing, transmission, provision, and disclosure of user data involved in the technical solution disclosed herein all comply with the provisions of relevant laws and regulations and do not violate public order and good morals.

[0097] Example 4

[0098] Figure 4 A schematic diagram of an electronic device 410, which can be implemented using an embodiment, is shown. The electronic device 410 includes at least one processor 411 and a memory, such as a read-only memory (ROM) 412, a random access memory (RAM) 413, etc., communicatively connected to the at least one processor 411. The memory stores computer programs executable by the at least one processor. The processor 411 can perform various appropriate actions and processes based on the computer program stored in the ROM 412 or loaded from storage unit 418 into the RAM 413. The RAM 413 may also store various programs and data required for the operation of the electronic device 410. The processor 411, ROM 412, and RAM 413 are interconnected via a bus 414. An input / output (I / O) interface 415 is also connected to the bus 414.

[0099] Multiple components in electronic device 410 are connected to I / O interface 415, including: input unit 416, such as keyboard, mouse, etc.; output unit 417, such as various types of displays, speakers, etc.; storage unit 418, such as disk, optical disk, etc.; and communication unit 419, such as network card, modem, wireless transceiver, etc. Communication unit 419 allows electronic device 410 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0100] Processor 411 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of processor 411 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. Processor 411 performs the various methods and processes described above, such as methods for acquiring on-chain digital content.

[0101] In some embodiments, the method for acquiring on-chain digital content may be implemented as a computer program tangibly contained in a computer-readable storage medium, such as storage unit 418. In some embodiments, part or all of the computer program may be loaded and / or installed on electronic device 410 via ROM 412 and / or communication unit 419. When the computer program is loaded into RAM 413 and executed by processor 411, one or more steps of the method for acquiring on-chain digital content described above may be performed. Alternatively, in other embodiments, processor 411 may be configured to perform the method for acquiring on-chain digital content by any other suitable means (e.g., by means of firmware).

[0102] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SoCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.

[0103] Computer programs used to implement the methods of this application may be written in any combination of one or more programming languages. These computer programs may be provided to the processor of a general-purpose computer, a special-purpose computer, or other programmable on-chain digital content acquisition device, such that when executed by the processor, the computer programs cause the functions / operations specified in the flowcharts and / or block diagrams to be implemented. The computer programs may be executed entirely on a machine, partially on a machine, or as a standalone software package, partially on a machine and partially on a remote machine, or entirely on a remote machine or server.

[0104] In the context of this application, a computer-readable storage medium can be a tangible medium that may contain or store a computer program for use by or in conjunction with an instruction execution system, apparatus, or device. A computer-readable storage medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium can be a machine-readable signal medium. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0105] To provide interaction with a user, the systems and techniques described herein can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the electronic device. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).

[0106] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., a server for acquiring on-chain digital content), or computing systems that include middleware components (e.g., an application server), or computing systems that include frontend components (e.g., a user computer with a graphical user interface or web browser through which a user can interact with implementations of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., a communication network). Examples of communication networks include local area networks (LANs), wide area networks (WANs), blockchain networks, and the Internet.

[0107] A computing system can include clients and servers. Clients and servers are generally located far apart and typically interact through communication networks. The client-server relationship is created by computer programs running on the respective computers and having a client-server relationship with each other. The server can be a cloud server, also known as a cloud computing server or cloud host, which is a hosting product within the cloud computing service system to address the shortcomings of traditional physical hosts and VPS services, such as high management difficulty and weak business scalability.

[0108] It should be understood that the various forms of processes shown above can be used to rearrange, add, or delete steps. For example, the steps described in this application can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution of this application can be achieved, and this is not limited herein.

[0109] The specific embodiments described above do not constitute a limitation on the scope of protection of this application. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this application should be included within the scope of protection of this application.

Claims

1. A method for collecting on-chain digital content, characterized in that, The method includes: Obtain basic block data from the target blockchain network to be processed; Based on the aforementioned basic block data, platform access addresses for multiple digital content trading platforms are generated; wherein, the digital content trading platforms are used to trade digital content generated in the target blockchain network; By using a simulated browser cluster and a restriction-breaking plugin, target digital content in the target blockchain network is read from the digital content trading platform based on the platform's access address; wherein, the restriction-breaking plugin is used to assist the simulated browser cluster in breaking through the page access restrictions of the digital content trading platform during the process of reading the target digital content; The step of reading target digital content from the target blockchain network of the digital content trading platform based on the platform access address by simulating browser clusters and restriction bypass plugins includes: The simulated browser cluster generates a data access request based on the platform access address and sends the data access request to the network proxy service. The network proxy service, based on a pre-selected network IP and data access request, utilizes the restriction bypass plugin to access the digital content trading platform in order to read target digital content from the target blockchain network.

2. The method according to claim 1, characterized in that, The simulated browser cluster is constructed in the following manner: Create a virtual display screen and a simulated browser, and integrate the virtual display screen and the simulated browser to obtain a browser image; Deploy the browser image to at least one target physical machine; The browser image is instantiated to obtain a browser container, and the simulated browser cluster is obtained based on the browser container.

3. The method according to claim 1, characterized in that, The method further includes: The network proxy service feeds back the data access results to the simulated browser cluster through the target network interface based on the pre-selected network IP. The target network interface of the pre-selected network IP is monitored by a monitoring proxy service to collect the data access results; Extract the first digital content from the data access results fed back to the simulated browser cluster by the network proxy service; Extract the second digital content from the data access results collected by the listening proxy service from the target network interface; The target digital content is generated based on the first digital content and the second digital content.

4. The method according to claim 1, characterized in that, The step of obtaining basic block data from the target blockchain network to be processed includes: Deploy target blockchain nodes in the target blockchain network, and synchronize existing block data in the target blockchain network through the target blockchain nodes; Based on the pre-selected smart contract protocol, the existing block data is parsed to obtain the data parsing result; Based on the data parsing results, the basic block data of the target blockchain network is determined.

5. The method according to claim 1, characterized in that, The process of generating platform access addresses for multiple digital content trading platforms based on the aforementioned basic block data includes: Extract smart contract data and digital content identifiers from the base block data; The smart contract data and the digital content identifier are concatenated to obtain the data concatenation result. Based on the data splicing results, platform access addresses for multiple digital content trading platforms are generated.

6. The method according to claim 1, characterized in that, After reading the target digital content from the target blockchain network based on the platform access address, the method includes: Based on the platform access address to which the target digital content belongs, determine the smart contract data associated with the target digital content; Based on the smart contract protocol in the smart contract data, obtain target metadata from the target digital content and determine the target data type to which the target metadata belongs; If the target data type is a data read address, then data is read based on the data read address and the target metadata is updated according to the data read result until the target data type to which the target metadata belongs is a preset data type.

7. A device for acquiring on-chain digital content, characterized in that, The device includes: The basic block data acquisition module is used to acquire basic block data from the target blockchain network to be processed; The platform access address determination module is used to generate platform access addresses for multiple digital content trading platforms based on the basic block data; wherein, the digital content trading platforms are used to trade digital content generated in the target blockchain network; The target digital content reading module is used to read target digital content from the target blockchain network of the digital content trading platform based on the platform access address by simulating a browser cluster and a restriction-breaking plugin; wherein, the restriction-breaking plugin is used to assist the simulated browser cluster in breaking through the page access restrictions of the digital content trading platform during the process of reading the target digital content; The target digital content reading module includes: The data access request generation submodule is used to generate a data access request based on the platform access address through the simulated browser cluster and send the data access request to the network proxy service. The target digital content reading submodule is used to access the digital content trading platform through the network proxy service based on a pre-selected network IP and data access request, using the restriction bypass plugin to read target digital content from the target blockchain network.

8. A computer-readable storage medium having a computer program stored thereon, characterized in that, When executed by the processor, the program implements the method for acquiring on-chain digital content as described in any one of claims 1-6.

9. An electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the method for acquiring on-chain digital content as described in any one of claims 1-6.

Images