Data acquisition method and device, equipment, storage medium and program product
By acquiring candidate indicator values from multiple data providers and verifying their reliability using data acquisition devices, the problem of insufficient reliability of crawler data is solved, and more accurate and reliable data acquisition is achieved.
Patent Information
- Application Number
- CN202511629128.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-11-07
- Publication Date
- 2026-02-06
AI Technical Summary
The reliability of data obtained from the Internet by web crawlers in existing technologies is difficult to guarantee, resulting in poor accuracy of the data obtained by the devices used for data collection.
After receiving a data request, the data acquisition device obtains candidate indicator values and release times from multiple data providing devices, confirms the reliability with the trusted device, determines the most likely true indicator value through comprehensive reliability parameters, and sends it to the data user device.
It improves the accuracy of data acquired by data acquisition devices, reduces the probability of inaccuracies, and enhances the credibility and reliability of data.
Smart Images

Figure CN121485944A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of data acquisition technology, and in particular to data acquisition methods, apparatus, devices, storage media, and program products. Background Technology
[0002] Currently, when data-using devices need to perform data analysis, they can use technologies such as web crawlers to obtain the data required for analysis from the Internet. This allows the data-using devices to accurately perform data analysis and ensure the accuracy of the analysis results.
[0003] However, since the reliability of data crawled from the Internet through technologies such as web crawlers is difficult to guarantee, the data obtained by the device may be inaccurate, resulting in poor accuracy of the data acquired by the device. Summary of the Invention
[0004] This application provides a data acquisition method, apparatus, device, storage medium, and program product, which can improve the accuracy of data acquired by the device.
[0005] To achieve the above objectives, the embodiments of this application adopt the following technical solutions: In a first aspect, embodiments of this application provide a data acquisition method, comprising: a data acquisition device receiving a first data request message from a data user device, the first data request message being used to request the data acquisition device to provide the index value of target index information; and, according to the first data request message, acquiring a candidate index value and a release time of the candidate index value from each of N data providing devices, thereby obtaining N candidate index values and N release times, where N is a positive integer; and sending the N candidate index values to M authorized devices, where M is a positive integer, so that the data acquisition device can receive M sets of reliable parameters fed back by the M authorized devices. The set of reliable parameters includes N reliable parameters determined by an authorized device for N candidate indicator values. Each reliable parameter is used to characterize the reliability of a candidate indicator value as the true indicator value of the target indicator information. Based on M sets of reliable parameters and N release times, a comprehensive reliable parameter is determined for each candidate indicator value. The comprehensive reliable parameter of each candidate indicator value is used to characterize the comprehensive reliability of each candidate indicator value as the true indicator value of the target indicator information. Then, the data acquisition device can determine the target candidate indicator value from the N candidate indicator values whose comprehensive reliable parameter meets the target condition, and send a first data response message to the data user device. The first data response message includes the target candidate indicator value.
[0006] As can be seen from the above, when the data acquisition device receives a first data request message from the data user device requesting feedback on the target indicator information, it can first obtain N candidate indicator values and their release times from N data providing devices. Then, it sends these N candidate indicator values to M authorized devices respectively, allowing each authorized device to determine the reliable parameters for each of the N candidate indicator values. In this way, the data acquisition device can receive M sets of reliable parameters from the M authorized devices, each set including N reliable parameters determined by one authorized device for the N candidate indicator values. Based on these M sets of reliable parameters and the N release times, it determines the reliability parameters for each candidate indicator value. By selecting a comprehensive reliability parameter for the index value, the overall reliability of each candidate index value as the true index value of the target index information can be obtained. Thus, the data acquisition device can determine the target candidate index value (e.g., the target candidate index value most likely to be the true index value of the target index information) from N candidate index values, which meets the target condition. The device then sends a first data response message including the target candidate index value to the data user device, so that the data user device can obtain the target candidate index value most likely to be the true index value of the target index information. Therefore, the probability of the target candidate index value obtained by the data user device being inaccurate can be reduced, thereby improving the accuracy of the data acquired by the device.
[0007] In one possible implementation of the first aspect, the determination of the comprehensive reliability parameter for each candidate indicator value based on M sets of reliable parameters and N release times includes: the data acquisition device can first obtain M reliable parameters corresponding to a candidate indicator value from the M sets of reliable parameters, and calculate the intermediate reliability parameter of the candidate indicator value based on the M reliable parameters corresponding to the candidate indicator value and the data source reliability parameter corresponding to the candidate indicator value, and determine the corresponding time decay parameter based on a release time of the candidate indicator value. The data source reliability parameter is used to characterize the reliability of the data providing device providing the true indicator value corresponding to the candidate indicator value. Thus, the data acquisition device can calculate the comprehensive reliability parameter of the candidate indicator value based on the intermediate reliability parameter, the indicator correction parameter corresponding to the target indicator information, and the time decay parameter.
[0008] Thus, it can be seen that the data acquisition device can first obtain M reliable parameters corresponding to a candidate indicator value from M sets of reliable parameters, and calculate the intermediate reliable parameters of the candidate indicator value based on the M reliable parameters corresponding to the candidate indicator value and the reliable parameters of the data source corresponding to the candidate indicator value. Furthermore, based on a release time of the candidate indicator value, a corresponding time decay parameter is determined. This intermediate reliable parameter integrates the reliability of the candidate indicator value as the true indicator value of the target indicator information determined by the M trusted devices and the reliability of the true indicator value provided by the data provider providing the candidate indicator value. In other words, this intermediate reliable parameter can more accurately characterize the reliability of the candidate indicator value as the true indicator value of the target indicator information, and the data acquisition device can combine this intermediate reliable parameter... The data acquisition device calculates the comprehensive reliability parameter of a candidate indicator value by combining the indicator correction parameters and time decay parameters corresponding to the target indicator information. In other words, the data acquisition device can also calculate the comprehensive reliability parameter of a candidate indicator value based on the intermediate reliability parameter and multiple other parameters. Therefore, the accuracy of the comprehensive reliability parameter of the candidate indicator value can be improved. Thus, in subsequent steps, the data acquisition device can accurately determine the target candidate indicator value that is most likely to be the true indicator value of the target indicator information from N candidate indicator values. This allows the data user device to obtain the target candidate indicator value that is most likely to be the true indicator value of the target indicator information, thereby reducing the probability of inaccurate target candidate indicator values obtained by the data user device. In this way, the accuracy of the data acquired by the device can be improved.
[0009] In another possible implementation of the first aspect, after the data acquisition device calculates the comprehensive reliability parameter of the candidate indicator value based on the intermediate reliability parameter, the indicator correction parameter corresponding to the target indicator information, and the time decay parameter, the method may further include: the data acquisition device updating the data source reliability parameter corresponding to the candidate indicator value based on the comprehensive reliability parameter of the candidate indicator value.
[0010] Therefore, since the data acquisition device can update the data source reliability parameter corresponding to a candidate indicator value based on the comprehensive reliability parameter of the candidate indicator value, so that the data source reliability parameter more accurately represents the reliability of the data providing device that provides the candidate indicator value, when the data acquisition device determines the comprehensive reliability parameter of the candidate indicator value of other indicator information again, the data acquisition device can accurately determine the comprehensive reliability parameter based on the more accurate data source reliability parameter (i.e., the updated data source reliability parameter), thereby reducing the probability of the target candidate indicator value obtained by the data using device being inaccurate, thus improving the accuracy of the data acquired by the device.
[0011] In another possible implementation of the first aspect, the method may further include: upon detecting a first event, the data acquisition device may generate a first event information body based on event-related information of the first event, and generate a first event information header based on event-related information of a second event, wherein the second event includes at least one of the following: the preceding event of the first event, and an event of the same type as the preceding event of the first event; and generate and store a storage structure based on the first event information body and the first event information header; wherein both the first event and the second event include at least one of the following: receiving a data request message from a data-using device, the data request message being used to request an indicator value for indicator information; obtaining candidate indicator values from a data-providing device; receiving reliable parameters from a trusted device; N data-providing devices changing; M trusted devices changing; the determination rule for comprehensive reliable parameters changing; the comprehensive reliable parameters or the parameters for determining comprehensive reliable parameters changing; and determining the true indicator value for indicator information.
[0012] Thus, it can be seen that, since the data acquisition device can generate a first event information body based on the event-related information of the first event when it hears a first event (i.e., receiving a data request message from the data user device, obtaining candidate indicator values from the data provider device, receiving reliable parameters from the trusted device, changes in N data provider devices, changes in M trusted devices, changes in the determination rules of the comprehensive reliable parameters, changes in the comprehensive reliable parameters or the parameters for determining the comprehensive reliable parameters, and determining the true indicator value of the indicator information), that is, when the data in the data acquisition device may change, and based on the event-related information of the first event, generate a first event information header based on the event-related information of the second event (i.e., at least one of the events preceding the first event and the events of the same type preceding the first event), and generate a storage structure based on the first event information body and the first event information header, this can make the storage structure related to the second event, increasing the difficulty of tampering with the storage structure and / or the storage structure corresponding to the second event. Therefore, the reliability of the data in the data acquisition device can be improved.
[0013] In another possible implementation of the first aspect, the aforementioned first event header includes a summary of event-related information about the second event.
[0014] Thus, since the first event header can include a summary of the event-related information of the second event, the storage structure can be associated with the second event, increasing the difficulty of tampering with the storage structure and / or the storage structure corresponding to the second event. Therefore, the reliability of the data in the data acquisition device can be improved.
[0015] In another possible implementation of the first aspect, the first event header further includes at least one of the following: a sequence number corresponding to the storage structure; a summary of the first event body; and first signature information, which is obtained by signing the summary of all information in the first event header.
[0016] Thus, since the header of the first event can include multiple different pieces of information, it can further increase the difficulty of tampering with the storage structure and / or the storage structure corresponding to the second event, thereby further improving the reliability of the data in the data acquisition device.
[0017] In another possible implementation of the first aspect, the aforementioned first event information body includes at least one of the following: an event type identifier for the first event; an event identifier for the first event; an identifier for the indicator information corresponding to the first event; an identifier for the indicator value corresponding to the first event; an indicator value corresponding to the first event; an identifier for the device corresponding to the first event; a device type identifier for the device corresponding to the first event; a reliability parameter corresponding to the first event; an event operation type corresponding to the first event; an identifier for the rule corresponding to the first event; the content of the rule corresponding to the first event; a description of the first event; time information of the first event; and second signature information, which is obtained by signing all the information in the first event information body.
[0018] Thus, since the first event information body can include a variety of information related to the first event, that is, the data acquisition device can store a variety of information related to the first event, more information related to the first event can be obtained when querying the storage structure, which can improve the convenience of data query.
[0019] In another possible implementation of the first aspect, the method further includes: a data acquisition device receiving a change request message from a target device, the change request message being used to request changes to metadata, the target device including at least one of the following: the data acquisition device, any one authorized device, and sending confirmation request messages to M authorized devices according to the change request message, the confirmation request messages being used to request the authorized devices to confirm the changes to metadata, and receiving confirmation feedback messages from the authorized devices, the confirmation feedback messages being used to instruct the authorized devices to confirm the changes to metadata, thereby changing the metadata according to the change request message when the number of received confirmation feedback messages is greater than or equal to a number threshold; wherein the metadata includes at least one of the following: device information of N data providing devices; device information of M authorized devices; and a rule for determining comprehensive reliability parameters.
[0020] Thus, it can be seen that when a data acquisition device receives a change request message, it can send confirmation request messages to M trusted devices. Only when the number of received confirmation feedback messages is greater than or equal to a certain threshold, that is, when most trusted devices confirm the change to the metadata, will the metadata be changed according to the change request message, rather than being changed directly according to the change request message. Therefore, the difficulty of tampering with the metadata can be increased, thereby improving the credibility of the data in the data acquisition device.
[0021] In another possible implementation of the first aspect, the above objective condition includes any one of the following: the comprehensive reliability parameter with the highest parameter value among the comprehensive reliability parameters of N candidate index values; the top Q comprehensive reliability parameters with the highest parameter values among the comprehensive reliability parameters of N candidate index values; where Q is a positive integer greater than 1.
[0022] Thus, since the target conditions can include the highest comprehensive reliability parameter among the comprehensive reliability parameters of N candidate index values and the top Q comprehensive reliability parameters with the highest comprehensive reliability parameters among the N candidate index values, the target candidate index value that satisfies the target conditions can be the candidate index value among the N candidate index values that is most likely to be the true index value of the target index information. Therefore, the data-using device can obtain the target candidate index value that is most likely to be the true index value of the target index information, thereby reducing the probability of the target candidate index value obtained by the data-using device being inaccurate. In this way, the accuracy of the data obtained by the device can be improved.
[0023] Secondly, embodiments of this application provide a data acquisition device, comprising: a receiving module, an acquisition module, a sending module, and a determining module. The receiving module is configured to receive a first data request message from a data-using device, the first data request message requesting the data acquisition device to provide the index value of target index information. The acquisition module is configured to, based on the first data request message received by the receiving module, acquire a candidate index value and a publication time of the candidate index value from each of N data-providing devices, thereby obtaining N candidate index values and N publication times, where N is a positive integer. The sending module is configured to send the N candidate index values acquired by the acquisition module to M authorized devices, where M is a positive integer. The receiving module is further configured to receive M sets of reliability parameters fed back by the M authorized devices, each set of reliability parameters including N reliability parameters determined by an authorized device for the N candidate index values, each reliability parameter characterizing the reliability of a candidate index value as the true index value of the target index information. The determining module is used to determine the comprehensive reliability parameter of each candidate indicator value based on M sets of reliability parameters and N release times received by the receiving module. The comprehensive reliability parameter of each candidate indicator value is used to characterize the comprehensive reliability of each candidate indicator value as the true indicator value of the target indicator information. From the N candidate indicator values, the module determines the target candidate indicator value whose comprehensive reliability parameter meets the target condition. The sending module is also used to send a first data response message to the data-using device, which includes the target candidate indicator value determined by the determining module.
[0024] Thirdly, embodiments of this application provide an electronic device, the method comprising: a transceiver, a memory, and at least one processor. The memory is communicatively connected to the processor. The memory is used to store computer program code, the computer program code including computer instructions. When the processor executes the computer instructions, it causes the electronic device to perform the method as described in the first aspect and any possible implementation thereof.
[0025] Fourthly, embodiments of this application provide a computer-readable storage medium storing computer instructions. When these computer instructions are executed by a processor, they are used to implement the method as described in the first aspect and any possible implementation thereof.
[0026] Fifthly, embodiments of this application provide a computer program product that, when running on a computer / executed by the computer's processor, implements the method described in the first aspect and any possible design thereof. The computer may be the data acquisition device described in the second aspect and any possible implementation thereof.
[0027] Understandably, the beneficial effects achieved by the data acquisition device of the second aspect, the electronic device of the third aspect, the computer-readable storage medium of the fourth aspect, and the computer program product of the fifth aspect provided above can be referred to as the beneficial effects of the first aspect and any possible implementation thereof, which will not be repeated here. Attached Figure Description
[0028] Figure 1 A flowchart illustrating a data acquisition method provided in an embodiment of this application; Figure 2 This application provides a schematic diagram of the system architecture for a data acquisition method according to an embodiment of the present application. Figure 3 A flowchart illustrating another data acquisition method provided in an embodiment of this application; Figure 4 A flowchart illustrating another data acquisition method provided in an embodiment of this application; Figure 5 A flowchart illustrating another data acquisition method provided in an embodiment of this application; Figure 6 This is a schematic diagram illustrating the relationship between storage structures in a data acquisition method provided in an embodiment of this application; Figure 7 A flowchart illustrating another data acquisition method provided in an embodiment of this application; Figure 8 This is a schematic diagram of the structure of a data acquisition device provided in an embodiment of this application; Figure 9 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation
[0029] Hereinafter, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of this embodiment, unless otherwise stated, "a plurality of" means two or more.
[0030] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application as detailed in the appended claims.
[0031] The technical solutions provided in this application, including the collection, storage, use, processing, transmission, provision, and disclosure of financial data or user data, comply with relevant laws and regulations and do not violate public order and good morals.
[0032] It should be noted that in the embodiments of this application, certain software, components, models and other existing solutions in the industry may be mentioned. These should be regarded as exemplary and are only intended to illustrate the feasibility of implementing the technical solution of this application. However, it does not mean that the applicant has used or necessarily used the solution.
[0033] Currently, data has become a core asset for enterprises and a key driving force for their development. Whether it's improving efficiency, promoting innovation, enhancing user experience, or mitigating risks, data plays an irreplaceable role. In the data-driven era, enterprises need to establish robust data management and analysis capabilities to transform data into real business value, thereby maintaining a competitive edge. In related technologies, data-using devices can acquire the necessary data through various channels when data analysis is required. These channels include obtaining data from data service providers, scraping from the internet via web crawlers, manually acquiring data from relevant channels, or retrieving data from the blockchain using blockchain technology.
[0034] However, since the data obtained through the above-mentioned methods may not meet the data requirements of the data-using devices, and the reliability of the data is difficult to guarantee, and the hardware and maintenance costs required to obtain the required data are high, the quality and accuracy of the data obtained by the devices are poor, and the cost of obtaining the data is high.
[0035] To address the aforementioned technical problems, embodiments of this application provide a data acquisition method, apparatus, device, storage medium, and program product. The data acquisition method, apparatus, device, storage medium, and program product provided in this application will be described in detail below with reference to the accompanying drawings and scenarios.
[0036] The data acquisition method provided in this application can be applied to data analysis scenarios.
[0037] Figure 1 A flowchart illustrating a data acquisition method provided in an embodiment of this application is shown. Figure 1 As shown, a data acquisition method provided in this application embodiment may include the following steps 101 to 107.
[0038] Step 101: The data acquisition device receives a first data request message from the data usage device.
[0039] In this embodiment of the application, the first data request message is used to request the indicator value of the target indicator information from the data acquisition device.
[0040] In some embodiments of this application, the data acquisition device described above may be called an indicator management center. Of course, the data acquisition device may also be called other names, and this application does not limit this.
[0041] In some embodiments of this application, the data acquisition device described above can authorize at least one device so that the at least one device can interact with the data acquisition device.
[0042] In some instances, where a data acquisition device can authorize at least one device, the data acquisition device and at least one device can provide relevant verification materials to a key management center and apply for a key pair from the key management center. If the key management center confirms that the verification materials are correct, it can send the key pair to the data acquisition device and at least one device, so that the data acquisition device and at least one device can interact using the key pair.
[0043] In some embodiments of this application, the aforementioned target indicator information may be at least a portion of the indicator information of the data required by the data-using device. Specifically, the target indicator information may be information about at least one data item within the data required by the data-using device.
[0044] For example, if the data used by the data-using device is the number of employees of a company, then the target indicator information can be the number of employees, and the indicator value of the target indicator information can be the number of employees of the company.
[0045] For example, Figure 2 A schematic diagram of the system architecture of a data acquisition method provided in an embodiment of this application is shown. Figure 2 As shown, the data acquisition device may include an indicator publishing module, so that the data acquisition device can receive a first data request message from the data-using device (e.g., any one of device A to device F) through the indicator publishing module.
[0046] Step 102: According to the first data request message, the data acquisition device obtains a candidate indicator value and a release time of the candidate indicator value from each of the N data providing devices, thereby obtaining N candidate indicator values and N release times.
[0047] In the embodiments of this application, N is a positive integer.
[0048] In some embodiments of this application, the aforementioned N data providing devices can be devices from at least one of the aforementioned devices. These N data providing devices may include devices belonging to data service providers, enterprises, users, etc.
[0049] It is understood that this application can integrate various methods of obtaining external data, broaden the channels for obtaining external data, and include other individuals or small groups in the open system, so that high-quality individuals or small groups can also participate, reduce the cost of data management for enterprises, and improve the quality and efficiency of data.
[0050] In some embodiments of this application, the data acquisition device can send the target indication information to each data providing device according to the first data request message, so that each data providing device can obtain a candidate indicator value and the release time of the candidate indicator value through a target method, and feed back the obtained candidate indicator value and the release time of the candidate indicator value to the data acquisition device. The target method may include, but is not limited to, at least one of the following: crawling from the Internet via a web crawler, manually obtaining from relevant channels, or obtaining from indicator values stored in the data providing device.
[0051] In some instances, combined Figure 2 The data acquisition device may include a timed scheduling module, so that the data acquisition device can periodically send the target indication information to each data providing device (e.g., device G to device J) according to the first data request message through the timed scheduling module, so as to update the previously acquired candidate indicator values and the release time of the candidate indicator values according to the candidate indicator values obtained from N data providing devices, and obtain N candidate indicator values and N release times.
[0052] In some instances, combined Figure 2 The data acquisition device may include an indicator acquisition module and an indicator input module. The data acquisition module can obtain a portion of candidate indicator values and their release times by crawling the Internet and / or obtaining them from the indicator values stored in the data providing device through the indicator acquisition module. The indicator input module can obtain another portion of candidate indicator values and their release times by manually obtaining them from relevant channels.
[0053] It is understandable that the N candidate indicator values obtained by the data acquisition device may be inaccurate. Therefore, the data acquisition device can send the N candidate indicator values to M trusted devices respectively, so as to confirm the reliability of the N candidate indicator values through the M trusted devices.
[0054] Step 103: The data acquisition device sends N candidate index values to each of the M authorized devices.
[0055] In the embodiments of this application, M is a positive integer.
[0056] In some embodiments of this application, the aforementioned M trust-granting devices can be devices from at least one of the aforementioned devices. These M trust-granting devices may include enterprise devices, user devices, etc., and the M trust-granting devices and the devices in the N data-providing devices may be at least partially identical.
[0057] For example, M trust devices may include device 1, device 2 and device 3, and N data providing devices may include device 2, device 4 and device 5. Among them, device 2 can be either a trust device or a data providing device, that is, the devices in the M trust devices and the N data providing devices can be at least partially the same.
[0058] In some embodiments of this application, the data acquisition device may directly send the N candidate indicator values to M authorized devices after acquiring N candidate indicator values and N release times; or, it may send the N candidate indicator values to the M authorized devices upon receiving a request from the M authorized devices.
[0059] In some embodiments of this application, the data acquisition device may send a message to each authorized device, the message including N candidate index values, thereby sending N candidate index values to M authorized devices respectively.
[0060] Step 104: The data acquisition device receives M sets of reliable parameters fed back by M trusted devices.
[0061] In this embodiment of the application, each of the above M groups of reliable parameters includes N reliable parameters determined by a trust device for N candidate index values. Each reliable parameter is used to characterize the reliability of a candidate index value as the true index value of the target index information.
[0062] It can be understood that each set of reliable parameters includes N reliable parameters, and each of these N reliable parameters corresponds to a candidate index value.
[0063] In some embodiments of this application, the parameter value of each reliable parameter is positively correlated with the reliability of a candidate index value as the true index value of the target index information.
[0064] It can be understood that the larger the value of a reliable parameter, the higher the reliability of a candidate indicator corresponding to that reliable parameter as the true value of the target indicator information, that is, the greater the probability that the candidate indicator is the true value of the target indicator information.
[0065] In some embodiments of this application, combined with Figure 2The data acquisition device may include an evaluation and determination module, through which the data acquisition device can receive M sets of reliable parameters fed back by M trusted devices.
[0066] Step 105: The data acquisition device determines the comprehensive reliability parameter for each candidate indicator value based on M sets of reliable parameters and N release times.
[0067] In this embodiment, the comprehensive reliability parameter of each candidate indicator value is used to characterize the comprehensive reliability of each candidate indicator value as the true indicator value of the target indicator information.
[0068] In some embodiments of this application, the parameter values of the above-mentioned comprehensive reliability parameters are positively correlated with the comprehensive reliability of the candidate index value as the true index value of the target index information.
[0069] In some embodiments of this application, combined with Figure 2 The data acquisition device may include a coefficient calculation module, which allows the data acquisition device to determine the comprehensive reliability parameters of each candidate indicator value based on M sets of reliable parameters and N release times.
[0070] In some examples, preset calculation rules are stored in the coefficient calculation module, which can then use these preset rules to calculate the comprehensive reliability parameters for each candidate indicator value based on M sets of reliable parameters and N release times.
[0071] It is understood that this application can dynamically adjust the calculation method of the coefficient calculation module by configuring custom rules or formulas, and can automatically trigger the calculation of correlation coefficients based on events, thereby selecting target candidate indicator values that meet the target conditions and feeding them back to the data-using device, providing a quantifiable judgment standard for the selection of multi-source data.
[0072] The following example, using any candidate indicator value, illustrates the specific scheme for determining the comprehensive reliability parameters of a data acquisition device for that candidate indicator value.
[0073] In some embodiments of this application, combined with Figure 1 ,like Figure 3 As shown, step 105 can be implemented through steps 1051 to 1053 as described below.
[0074] Step 1051: The data acquisition device obtains M reliable parameters corresponding to a candidate index value from the M sets of reliable parameters.
[0075] In some instances, a data acquisition device can obtain reliable parameters corresponding to the same candidate indicator value from M sets of reliable parameters, thus obtaining M reliable parameters corresponding to a candidate indicator value.
[0076] Step 1052: The data acquisition device calculates the intermediate reliability parameter of a candidate indicator value based on the M reliable parameters corresponding to a candidate indicator value and the reliable parameter of the data source corresponding to a candidate indicator value, and determines the corresponding time decay parameter based on the release time of a candidate indicator value.
[0077] In this embodiment of the application, the above-mentioned data source reliability parameter is used to characterize the reliability of the data providing device that provides the true indicator value corresponding to a candidate indicator value.
[0078] Optionally, the parameter values of the aforementioned data source reliability parameters are positively correlated with the reliability of the data providing equipment in providing true indicator values.
[0079] Optionally, the data acquisition device stores N data source reliability parameters corresponding to the data providing devices, so that the data acquisition device can obtain the data source reliability parameter corresponding to the candidate indicator value from the N data source reliability parameters corresponding to the data providing devices.
[0080] For example, the data source reliability parameters corresponding to the aforementioned N data providing devices are determined based on the initial reliability parameters of the N data providing devices and the reliability parameters of the candidate indicator values provided by the N data providing devices.
[0081] The initial reliability parameters of the N data providing devices can be the same or different. After each data providing device provides a candidate indicator value to the data acquiring device, the data acquiring device updates the initial reliability parameter based on the comprehensive reliability parameter of the candidate indicator value provided by each data providing device, thereby obtaining the data source reliability parameters corresponding to the N data providing devices.
[0082] Optionally, the parameter values of the aforementioned intermediate reliable parameters are positively correlated with the reliability of the candidate index values as the true index values of the target index information.
[0083] Optionally, the data acquisition device may first calculate the average value of M reliable parameters, and then determine the sum of the product of the average value and the first preset parameter value and the product of the reliable parameter of the data source and the second preset parameter value as the intermediate reliable parameter.
[0084] Optionally, the earlier the release time of a candidate metric value, the smaller the time decay parameter; conversely, the later the release time of a candidate metric value, the larger the time decay parameter. This is because an earlier release time might mean that the candidate metric value has become invalid due to time constraints (e.g., the existence of a newer version), thus requiring a smaller time decay parameter. Conversely, a later release time might mean a newer version of the candidate metric value, thus allowing for a larger time decay parameter.
[0085] Optionally, the data acquisition device stores a correspondence between the release time and the time decay parameter, so that the data acquisition device can determine the time decay parameter corresponding to the release time based on the correspondence.
[0086] Step 1053: The data acquisition device calculates a comprehensive reliability parameter for a candidate indicator value based on the intermediate reliability parameter, the indicator correction parameter corresponding to the target indicator information, and the time decay parameter.
[0087] Optionally, the data acquisition device may use a first algorithm to calculate a comprehensive reliability parameter for a candidate indicator value based on intermediate reliability parameters, indicator correction parameters corresponding to the target indicator information, and time decay parameters. The first algorithm may be: ,in, To comprehensively assess reliability parameters, For time decay parameters, For intermediate reliable parameters, The parameter is the parameter adjustment parameter corresponding to the target indicator information.
[0088] Optionally, after calculating the comprehensive reliability parameter of one of the candidate index values, the data acquisition device may also execute steps 1051 to 1053 at least once to calculate the comprehensive reliability parameter of each candidate index value.
[0089] Thus, it can be seen that the data acquisition device can first obtain M reliable parameters corresponding to a candidate indicator value from M sets of reliable parameters, and then calculate the intermediate reliable parameter of the candidate indicator value based on the M reliable parameters corresponding to the candidate indicator value and the reliable parameters of the data source corresponding to the candidate indicator value. Furthermore, based on a release time of the candidate indicator value, a corresponding time decay parameter is determined. This intermediate reliable parameter integrates the reliability of the candidate indicator value as the true indicator value of the target indicator information determined by the M trusted devices and the reliability of the true indicator value provided by the data provider providing the candidate indicator value. In other words, this intermediate reliable parameter can more accurately characterize the reliability of the candidate indicator value as the true indicator value of the target indicator information, and the data acquisition device can combine this intermediate reliable parameter... The data acquisition device calculates the comprehensive reliability parameter of a candidate indicator value by combining the indicator correction parameters and time decay parameters corresponding to the target indicator information. In other words, the data acquisition device can also calculate the comprehensive reliability parameter of a candidate indicator value based on the intermediate reliability parameter and multiple other parameters. Therefore, the accuracy of the comprehensive reliability parameter of the candidate indicator value can be improved. Thus, in subsequent steps, the data acquisition device can accurately determine the target candidate indicator value that is most likely to be the true indicator value of the target indicator information from N candidate indicator values. This allows the data user device to obtain the target candidate indicator value that is most likely to be the true indicator value of the target indicator information, thereby reducing the probability of inaccurate target candidate indicator values obtained by the data user device. In this way, the accuracy of the data acquired by the device can be improved.
[0090] Optionally, combined Figure 3 ,like Figure 4 As shown, after step 1053 above, the data acquisition method provided in this application embodiment may further include step 1054 below.
[0091] Step 1054: The data acquisition device updates the data source reliability parameter corresponding to a candidate indicator value based on the comprehensive reliability parameter of the candidate indicator value.
[0092] For example, the data acquisition device can determine the product value between the comprehensive reliable parameter and the preset parameter of a candidate indicator value, and then determine the sum of the product value and the reliable parameter of the data source as the updated reliable parameter of the data source.
[0093] Therefore, since the data acquisition device can update the data source reliability parameter corresponding to a candidate indicator value based on the comprehensive reliability parameter of the candidate indicator value, so that the data source reliability parameter more accurately represents the reliability of the data providing device that provides the candidate indicator value, when the data acquisition device determines the comprehensive reliability parameter of the candidate indicator value of other indicator information again, the data acquisition device can accurately determine the comprehensive reliability parameter based on the more accurate data source reliability parameter (i.e., the updated data source reliability parameter), thereby reducing the probability of the target candidate indicator value obtained by the data using device being inaccurate, thus improving the accuracy of the data acquired by the device.
[0094] Furthermore, since the data acquisition device can update the data source reliability parameter corresponding to a candidate indicator value, it can accurately determine the data source reliability parameter of each data provider. Therefore, the data acquisition device can take relevant measures for each data provider based on its data source reliability parameter (such as rewarding data providers with high data source reliability parameter values and deauthorizing data providers with low data source reliability parameter values), thereby ensuring that the data providers can provide accurate candidate indicator values.
[0095] Step 106: The data acquisition device determines the target candidate index value from N candidate index values, which shows that the comprehensive reliability parameters meet the target conditions.
[0096] In some embodiments of this application, the number of the above-mentioned target candidate index values may be at least one.
[0097] In some embodiments of this application, the above-mentioned target conditions include any one of the following: The comprehensive reliability parameter with the highest value among N candidate index values; The top Q comprehensive reliability parameters with the highest values among N candidate index values.
[0098] In this embodiment of the application, Q is a positive integer greater than 1.
[0099] It can be understood that if the overall reliability parameter has the highest value among the N candidate indicator values, then the number of target candidate indicator values is one. If the overall reliability parameter has the highest value among the top Q overall reliability parameters among the N candidate indicator values, then the number of target candidate indicator values is Q.
[0100] In some embodiments of this application, the data acquisition device can use a coefficient calculation module to determine the target candidate index value from N candidate index values, which shows that the comprehensive reliability parameters meet the target conditions.
[0101] Thus, since the target conditions can include the highest comprehensive reliability parameter among the comprehensive reliability parameters of N candidate index values and the top Q comprehensive reliability parameters with the highest comprehensive reliability parameters among the N candidate index values, the target candidate index value that satisfies the target conditions can be the candidate index value among the N candidate index values that is most likely to be the true index value of the target index information. Therefore, the data-using device can obtain the target candidate index value that is most likely to be the true index value of the target index information, thereby reducing the probability of the target candidate index value obtained by the data-using device being inaccurate. In this way, the accuracy of the data obtained by the device can be improved.
[0102] It can be understood that the candidate indicator value that satisfies the target conditions based on comprehensive reliable parameters is the candidate indicator value that is most likely to be the true indicator value of the target indicator information among N candidate indicator values.
[0103] Step 107: The data acquisition device sends a first data response message to the data user device.
[0104] In this embodiment of the application, the first data response message includes the target candidate index value.
[0105] This application provides a data acquisition method. A data acquisition device can receive a first data request message from a data user device. This first data request message requests the data acquisition device to provide the index value of a target index. Based on the first data request message, the device obtains a candidate index value and a release time of the candidate index value from each of N data providing devices, resulting in N candidate index values and N release times (N is a positive integer). The device then sends these N candidate index values to M authorized devices (M is a positive integer). Thus, the data acquisition device can receive M sets of reliable parameters from the M authorized devices. The system includes N reliable parameters determined by an authorization device for N candidate indicator values. Each reliable parameter characterizes the reliability of a candidate indicator value as the true indicator value of the target indicator information. Based on M sets of reliable parameters and N release times, a comprehensive reliable parameter is determined for each candidate indicator value. This comprehensive reliable parameter characterizes the overall reliability of each candidate indicator value as the true indicator value of the target indicator information. The data acquisition device can then determine the target candidate indicator value from the N candidate indicator values whose comprehensive reliable parameter meets the target conditions and send a first data response message to the data user device. This first data response message includes the target candidate indicator value. When the data acquisition device receives a first data request message from the data user device requesting feedback on the target indicator information, it can first obtain N candidate indicator values and their release times from N data providing devices. Then, it sends these N candidate indicator values to M authorized devices, allowing each authorized device to determine reliable parameters for each of the N candidate indicator values. This allows the data acquisition device to receive M sets of reliable parameters from the M authorized devices, each set including N reliable parameters determined by one authorized device for the N candidate indicator values. Based on these M sets of reliable parameters and the N release times, the data acquisition device determines each candidate indicator value. The comprehensive reliability parameters are used to determine the overall reliability of each candidate indicator value as the true indicator value of the target indicator information. Thus, the data acquisition device can determine the target candidate indicator value (e.g., the target candidate indicator value most likely to be the true indicator value of the target indicator information) from N candidate indicator values, and send a first data response message including the target candidate indicator value to the data user device. This allows the data user device to obtain the target candidate indicator value most likely to be the true indicator value of the target indicator information. Therefore, the probability of the target candidate indicator value obtained by the data user device being inaccurate can be reduced, thereby improving the accuracy of the data acquired by the device.
[0106] Furthermore, since the data acquisition device can obtain N candidate indicator values from N data providing devices, and each data providing device can obtain candidate indicator values in a different way, it can be ensured that the N candidate indicator values include candidate indicator values obtained in different ways. This can increase the probability that the N candidate indicator values include candidate indicator values that meet the data requirements of the data-using device, thereby improving the quality of the data acquired by the device.
[0107] Furthermore, since data acquisition devices can wirelessly obtain reliable data from the blockchain through blockchain technology, they can save on the hardware and maintenance costs required for blockchain technology, thereby reducing the hardware and maintenance costs of the devices and thus lowering the cost of data acquisition.
[0108] In some embodiments of this application, combined with Figure 1 ,like Figure 5 As shown, after step 107 above, the data acquisition method provided in this application embodiment may further include steps 201 to 203 as described below.
[0109] Step 201: When the data acquisition device detects the first event, it generates the first event information body based on the event-related information of the first event.
[0110] It should be noted that the execution order of step 201 and any of the steps 102 to 107 described above is not limited in the embodiments of this application; in one instance, the data acquisition device may execute any of the above steps first and then execute step 201; in another instance, the data acquisition device may execute step 201 first and then execute any of the above steps; in yet another instance, the data acquisition device may execute step 201 while executing any of the above steps. Figure 5 The illustration is based on step 107, where the data acquisition device executes step 107 first and then step 201.
[0111] In this embodiment of the application, the first event mentioned above includes at least one of the following: A data request message is received from the data-using device, which requests the indicator value of the indicator information; Obtain candidate indicator values from the data providing device; Reliable parameters were received from the trusted device; N data providing devices have changed; M credit devices have changed; The rules for determining comprehensive reliability parameters have changed; The overall reliability parameters or the parameters that determine the overall reliability parameters change; Determine the true value of the indicator information.
[0112] In some instances, when the first event includes receiving a data request message from a data-using device, the first event can be called an indicator release event; when the first event includes obtaining candidate indicator values from a data-providing device, the first event can be called an indicator acquisition event and / or indicator entry event; when the first event includes receiving reliable parameters from an authorized device, the first event can be called an evaluation event; when the first event includes changes in N data-providing devices, the first event can be called a source change event; when the first event includes changes in M authorized devices, the first event can be called a user change event; when the first event includes changes in the rules for determining comprehensive reliable parameters, the first event can be called a rule change event; when the first event includes changes in comprehensive reliable parameters or the parameters used to determine comprehensive reliable parameters, the first event can be called a coefficient update event; and when the first event includes determining the true indicator value of indicator information, the first event can be called an indicator selection event.
[0113] In some instances, the aforementioned event-related information may include, but is not limited to, at least one of the following: device identifier of the event-related device, identifier of the event-related metric, identifier of the event-related metric value, identifier of the event-related rule, etc. The identifier may be a Universally Unique Identifier (UUID), such as a 128-bit UUID. Of course, the identifier may also be other identifiers, and this application embodiment does not limit this.
[0114] In some instances, the aforementioned first event information body includes at least one of the following: an event type identifier for the first event; an event identifier for the first event; an identifier for the indicator information corresponding to the first event; an identifier for the indicator value corresponding to the first event; the indicator value corresponding to the first event; an identifier for the device corresponding to the first event; an device type identifier for the device corresponding to the first event; a reliability parameter corresponding to the first event; an event operation type corresponding to the first event; an identifier for the rule corresponding to the first event; the content of the rule corresponding to the first event; a description of the first event; time information of the first event; and second signature information, which is obtained by signing all the information in the first event information body.
[0115] Optionally, the event type identifier and event identifier mentioned above can be UUIDs, such as 128-bit UUIDs.
[0116] Optionally, when the first event includes receiving a data request message from a data-using device, that is, when the first event is called an indicator release event, the first event information body may specifically include: an event type identifier of the first event (e.g., event type code), an identifier of the indicator information corresponding to the first event (e.g., indicator number), an indicator name of the indicator information corresponding to the first event, a description of the indicator information corresponding to the first event, and a second signature information, wherein the second signature information is obtained by signing the event type identifier of the first event (e.g., event type code), the identifier of the indicator information corresponding to the first event (e.g., indicator number), the indicator name of the indicator information corresponding to the first event, and the description of the indicator information corresponding to the first event.
[0117] For example, in the case where the first event is called an indicator release event, the information body of the first event may include: event type code (1), indicator number (idx_id) of the indicator information, indicator name (idx_nm) of the indicator information, description information (idx_desc) of the indicator information, and second signature information (sign_e); where sign_e = sign(hash(1|idx_id| idx_nm| idx_desc),pk_e), where hash represents hash algorithms such as SM3 and SHA-256, 1|idx_id| idx_nm| idx_desc represents the information obtained by concatenating the event type code, indicator number, indicator name and description information of the indicator information, hash(1|idx_id| idx_nm| idx_desc) represents the information obtained by calculating 1|idx_id| idx_nm| idx_desc using a hash algorithm, and sign_e represents the second signature information, sign(hash(1|idx_id| idx_nm| idx_desc),pk_e) indicates that the data uses the device's key pk_e to sign hash(1|idx_id|idx_nm|idx_desc). The method for obtaining this key pk_e can be referred to the specific description in the above embodiments.
[0118] Optionally, when the first event includes obtaining candidate indicator values from a data providing device, that is, when the first event is called an indicator acquisition event, the first event information body may specifically include: an event type identifier (e.g., event type code) of the first event, an identifier of the indicator information corresponding to the first event (e.g., indicator number), an identifier of the indicator value corresponding to the first event (e.g., number), the indicator value corresponding to the first event, the time information of the first event, the identifier of the device corresponding to the first event (e.g., number of the data providing device), and second signature information, which is obtained by signing the event type identifier (e.g., event type code), the identifier of the indicator information corresponding to the first event (e.g., indicator number), the identifier of the indicator value corresponding to the first event (e.g., number), the indicator value corresponding to the first event, the time information of the first event, and the identifier of the device corresponding to the first event (e.g., number of the data providing device).
[0119] For example, in the case where the first event is called the indicator acquisition event, the information body of the first event may include: event type code (2), indicator number (idx_id), indicator value number (idx_val_id), indicator value (idx_val), date (date), source number (src_id), and second signature information (sign_p); where sign_p = sign(hash(2| idx_val_id | idx_val | date | src_id),pk_p); where hash represents hash algorithms such as SM3 and SHA-256, 2| idx_val_id | idx_val | date | src_id represents the information obtained by concatenating the event type code, indicator number of the indicator information, indicator value number, indicator value, time, and data providing device number, sign_p represents the second signature information, and (hash(2| idx_val_id | idx_val | date | src_id) represents the information obtained by concatenating 2| idx_val_id | idx_val | date | The src_id is the information obtained after being calculated using a hash algorithm. sign(hash(2| idx_val_id| idx_val | date | src_id),pk_p) means that the hash(2| idx_val_id | idx_val | date | src_id) is signed using the key pk_p of the trusted device (e.g., enterprise device). The method for obtaining the key pk_p can be referred to the specific description in the above embodiment.
[0120] Optionally, when the first event includes obtaining candidate indicator values from a data providing device, that is, when the first event is called an indicator entry event, the information body of the first event may specifically include: an event type identifier (e.g., event type code), an identifier of the indicator information corresponding to the first event (e.g., indicator number), an identifier of the indicator value corresponding to the first event (e.g., number), the indicator value corresponding to the first event, the time information of the first event, the description information of the first event (also known as a note), and a second signature information, which is obtained by signing the event type identifier (e.g., event type code), the identifier of the indicator information corresponding to the first event (e.g., indicator number), the identifier of the indicator value corresponding to the first event (e.g., number), the indicator value corresponding to the first event, the time information of the first event, and the description information of the first event (also known as a note).
[0121] For example, in the case where the first event is called the indicator entry event, the information body of the first event may include: event type code (3), indicator number (idx_id), indicator value number (idx_val_id), indicator value (idx_val), date (date), remark (remark), and second signature information (sign_u); where sign_u = sign(hash(3| idx_id|idx_val_id | idx_val | date | remark),pk_u); where hash represents hash algorithms such as SM3 and SHA-256, 3| idx_id| idx_val_id | idx_val | date | remark represents the information obtained by concatenating the event type code (3), indicator number (idx_id), indicator value number (idx_val_id), indicator value (idx_val), date (date), and remark (remark), and hash(3| idx_id| idx_val_id | idx_val | date | `remark)` represents the information obtained by hashing `3|idx_id|idx_val_id|idx_val|date|remark` using a hash algorithm. `sign_u` represents the second signature information. `sign(hash(3|idx_id|idx_val_id|idx_val|date|remark),pk_u)` means signing `hash(3|idx_id|idx_val_id|idx_val|date|remark)` using the key `pk_u` of the trusted device (e.g., the user equipment). The method for obtaining this key `pk_u` can be referred to the specific description in the above embodiments.
[0122] Optionally, when the first event includes receiving reliable parameters from the trust device, that is, when the first event is called an evaluation event, the first event information body may specifically include: an event type identifier of the first event (e.g., event type code), an identifier of the indicator information corresponding to the first event (e.g., indicator number), an identifier of the indicator value corresponding to the first event (e.g., indicator value number), reliable parameters corresponding to the first event, time information of the first event, description information of the first event, and second signature information, wherein the second signature information is information obtained by signing the event type identifier (e.g., event type code), the identifier of the indicator information corresponding to the first event (e.g., indicator number), the identifier of the indicator value corresponding to the first event (e.g., indicator value number), reliable parameters corresponding to the first event, time information of the first event, and description information of the first event.
[0123] For example, in the case where the first event is called the evaluation event, the information body of the first event may include: event type code (4), indicator number (idx_id), indicator value number (idx_val_id), reliable parameter (score, value 1-5), date (date), remark (remark), and second signature information (sign_u), where sign_u = sign(hash(4| idx_id|idx_val_id | score| date | remark),pk_u); where hash represents hash algorithms such as SM3 and SHA-256, 4| idx_id| idx_val_id | score| date | remark represents the information obtained by concatenating the event type code (4), indicator number (idx_id), indicator value number (idx_val_id), reliable parameter (score, value 1-5), date (date), and remark (remark), and hash(4| idx_id| idx_val_id | score| date | remark) ...). The information obtained by hashing idx_id|idx_val_id|score|date|remark is idx_id|idx_val_id|score|date|remark. Sign_u represents the second signature information. Sign(hash(4|idx_id|idx_val_id|score|date|remark),pk_u) means signing hash(4|idx_id|idx_val_id|score|date|remark) with the key pk_u of the trusted device (e.g., user equipment). The method for obtaining the key pk_u can be referred to the specific description in the above embodiments.
[0124] Optionally, when the first event includes changes in N data providing devices, that is, when the first event is called a source change event, the first event information body may specifically include: the event type identifier (e.g., event type code) corresponding to the first event, the event operation type (e.g., add, remove, or modify) corresponding to the first event, the identifier of the device (i.e., the identifier of the data providing device) corresponding to the first event, the reliability parameter (coe) corresponding to the first event, the time information (e.g., timestamp) of the first event, and the second signature information, which is information obtained by signing the event type identifier (e.g., event type code), the event operation type (e.g., add, remove, or modify) corresponding to the first event, the identifier of the device (i.e., the identifier of the data providing device), the reliability parameter (coe) corresponding to the first event, and the time information (e.g., timestamp) of the first event.
[0125] For example, in the case where the first event is called a source change event, the first event information body may include: event type code (5), event operation type (opt_type, value ADD / REMOVE / MODIFY), data provider device number (src_id), data provider device address (src_addr), data provider device name (src_nm), data provider device description information (src_desc), reliability coefficient (coe), timestamp (timestamp), and second signature information (sign_list); where sign_list=[ sign_e1|sign_e2|…|sign_en], that is, the second signature information is the information obtained by concatenating sign_e1, sign_e2, sign_e3, …, sign_en, where sign_en= sign(hash(5|opt_type |src_id| src_addr | src_nm | src_desc | coe | timestamp),pk_en), hash represents hash algorithms such as SM3 and SHA-256, 5| `opt_type | src_id | src_addr | src_nm | src_desc | coe | timestamp` represents the information obtained by concatenating a changed event type code, an event operation type, a data provider ID, a data provider address, a data provider name, a data provider description, a reliability coefficient, and a timestamp. `hash(5| opt_type | src_id | src_addr | src_nm | src_desc | coe | timestamp)` represents the information obtained by hashing `5| opt_type | src_id | src_addr | src_nm | src_desc | coe | timestamp` using a hash algorithm. `sign(hash(5|opt_type | src_id | src_addr | src_nm | src_desc | coe | timestamp), pk_en)` represents the hashing of `hash(5| opt_type | src_id | src_addr | src_nm | src_desc | coe | timestamp)` using the key `pk_en` of the nth data provider. The information obtained by signing (src_addr | src_nm | src_desc | coe | timestamp) can be found in the specific description of the above embodiment for the method of obtaining the key pk_en.
[0126] Optionally, when the first event includes changes in M authorized devices, that is, when the first event is called a user change event, the information body of the first event may specifically include: the event type identifier of the first event (e.g., event type code), the event operation type corresponding to the first event (e.g., add, remove, or modify), the device type identifier of the device corresponding to the first event (e.g., enterprise device, user device, etc.), the identifier of the device corresponding to the first event (e.g., number), the description information of the first event (e.g., user details), reliable parameters, timestamp, and second signature information. The second signature information is information obtained by signing the event type identifier (e.g., event type code), the event operation type corresponding to the first event, the device type identifier of the device corresponding to the first event, the identifier of the device corresponding to the first event, the description information of the first event, reliable parameters, and timestamp.
[0127] For example, in the case where the first event is called a user change event, the information body of the first event may specifically include: event type code (6), event operation type (opt_type, value ADD / REMOVE / MODIFY), device type identifier (usr_type, value 1=enterprise 2=individual), identifier of the device corresponding to the first event (usr_id), description information (usr_det), reliability parameter (coe), timestamp (timestamp) and second signature information (sign_list); where sign_list=[ sign_e1|sign_e2|…|sign_en], that is, the second signature information is the information concatenated by sign_e1, sign_e, …, sign_en, sign_en= sign(hash(6| usr_type | usr_id| usr_det | coe |timestamp),pk_en), hash represents hash algorithms such as SM3 and SHA-256, 6| usr_type | usr_id| usr_det| coe | The timestamp represents the information obtained by concatenating a changed event type code, an event operation type, a trusted device (e.g., user equipment) number, description information, reliability parameters, and a timestamp. hash(6| usr_type | usr_id| usr_det | coe | timestamp) represents the information obtained by hashing 6| usr_type | usr_id| usr_det| coe | timestamp using a hash algorithm. sign(hash(6| usr_type | usr_id| usr_det | coe | timestamp), pk_en) represents the information obtained by signing hash(6|usr_type | usr_id| usr_det | coe | timestamp) with the key pk_en of the nth trusted device. The method for obtaining the key pk_en can be referred to the specific description in the above embodiments.
[0128] Optionally, when the rules for determining comprehensive reliable parameters change in the first event, that is, when the first event is called a rule change event, the information body of the first event may specifically include: an event type identifier (e.g., event type code) corresponding to the first event, an identifier (e.g., code) of the rule corresponding to the first event, the content of the rule corresponding to the first event, the time information (e.g., timestamp) of the first event, and second signature information, which is information obtained by signing the event type code, the identifier of the rule corresponding to the first event, the content of the rule corresponding to the first event, and the time information of the first event.
[0129] For example, in the case where the first event is called a rule change event, the information body of the first event may specifically include: event type code (7), rule number (rule_id), rule content (rule_det), timestamp (timestamp), and second signature information (sign_list); where sign_list=[ sign_e1|sign_e2|…|sign_en], sign_en=sign(hash(7| rule_id| rule_det | timestamp),pk_en), sign_e1|sign_e2|…|sign_en represents the information obtained by concatenating sign_e1, sign_e, …sign_en, 7| rule_id| rule_det| timestamp represents the information obtained by concatenating the event type code of a rule change event, the code of a rule, the content of a rule, and the timestamp of a rule change event, hash(7| rule_id| rule_det |timestamp) represents the information obtained by calculating 7| rule_id| rule_det | timestamp using the hash algorithm, sign(hash(7| (rule_id|rule_det|timestamp),pk_en) represents the information obtained by signing (hash(7|rule_id|rule_det|timestamp) with the key pk_en of the nth trusted device. The method for obtaining the key pk_en can be referred to the specific description in the above embodiment.
[0130] Optionally, when the first event includes a change in the comprehensive reliability parameter or the parameter that determines the comprehensive reliability parameter, that is, when the first event is called a coefficient update event, the first event information body may specifically include: the event type identifier of the first event (e.g., event type code), the device type identifier of the device corresponding to the first event, the identifier of the device corresponding to the first event, the reliability parameter corresponding to the first event, the time information of the first event, and the second signature information. The second signature information is information obtained by signing the event type code, the device type identifier of the device corresponding to the first event, the identifier of the device corresponding to the first event, the reliability parameter corresponding to the first event, and the time information of the first event.
[0131] For example, in the case where the first event is called the coefficient update event, the information body of the first event may specifically include: event type code (8), device type identifier (sub_type, value 1=source 2=enterprise 3=person), device identifier (sub_id), reliable parameter (score, value 0-1), and timestamp.
[0132] Optionally, when the first event includes the actual indicator value of the indicator information, that is, when the first event is called the indicator selection event, the information body of the first event may specifically include: the event type identifier of the first event (e.g., event type code), the identifier of the indicator information corresponding to the first event (e.g., indicator number), the identifier of the indicator value corresponding to the first event (e.g., number), the reliable parameter corresponding to the first event, and the time information of the first event.
[0133] For example, in the case where the first event is called the indicator selection event, the information body of the first event may specifically include: event type code (9), indicator number (idx_id), indicator value number (idx_val_id), reliable parameter (score, value 0-1), and timestamp (timestamp).
[0134] Optionally, combined Figure 2 The data acquisition device may include a data event listening module and a data storage module, so that when the data acquisition device listens to the first event through the event listening module, it can generate the first event information body through the data storage module based on the event-related information of the first event.
[0135] Thus, since the first event information body can include a variety of information related to the first event, that is, the data acquisition device can store a variety of information related to the first event, more information related to the first event can be obtained when querying the storage structure, which can improve the convenience of data query.
[0136] Step 202: The data acquisition device generates a first event header based on the event-related information of the second event.
[0137] In this embodiment of the application, the second event includes at least one of the following: the event preceding the first event, or an event of the same type preceding the first event.
[0138] In this embodiment of the application, the second event mentioned above includes at least one of the following: A data request message is received from the data-using device, which requests the indicator value of the indicator information; Obtain candidate indicator values from the data providing device; Reliable parameters were received from the trusted device; N data providing devices have changed; M credit devices have changed; The rules for determining comprehensive reliability parameters have changed; The overall reliability parameters or the parameters that determine the overall reliability parameters change; Determine the true value of the indicator information.
[0139] For example, assuming the second event includes an event of the same type preceding the first event, then if the first event is obtaining candidate indicator values from a data providing device, the second event is also obtaining candidate indicator values from a data providing device. The candidate indicator values obtained by the second event and the candidate indicator values obtained by the first event can be the same or different. For example, the candidate indicator values obtained by the first event are candidate indicator values for one indicator information, while the candidate indicator values obtained by the second event are candidate indicator values for another indicator information. Alternatively, the first event and the second event may obtain different candidate indicator values for the same indicator information (e.g., provided by different data providing devices).
[0140] In some instances, the first event header mentioned above includes a summary of event-related information about the second event.
[0141] Optionally, the data acquisition device can use a hash algorithm to calculate a summary of the event-related information of the second event.
[0142] Thus, since the first event header can include a summary of the event-related information of the second event, the storage structure can be associated with the second event, increasing the difficulty of tampering with the storage structure and / or the storage structure corresponding to the second event. Therefore, the reliability of the data in the data acquisition device can be improved.
[0143] In some instances, the first event header may also include at least one of the following: a sequence number corresponding to the storage structure; a summary of the first event body; and first signature information, which is obtained by signing the summary of all information in the first event header.
[0144] Optionally, the sequence number corresponding to the above storage structure can be understood as a globally unique, incrementally increasing sequence number in the data acquisition device. The summary of the first event information body can be information calculated using the Haas algorithm by concatenating all the characters in the first event information body.
[0145] For example, Figure 6 This diagram illustrates the relationship between storage structures in a data acquisition method provided in an embodiment of this application. For example... Figure 6 As shown, assume the data acquisition device detects six first events and generates six storage structures. These six storage structures, ordered from earliest to latest storage time, are: storage structure 1 corresponding to evaluation event 1, storage structure 2 corresponding to indicator selection event 1, storage structure 3 corresponding to indicator release event 1, storage structure 4 corresponding to indicator selection event 2, storage structure 5 corresponding to evaluation event 2, and storage structure 6 corresponding to indicator release event 2. The first event header of storage structure 3 includes a summary 1 of event-related information from the previous event of the same type, a summary 2 of the previous event (i.e., indicator selection event 1), a global sequence number, a summary 3 of indicator release event 1, and first signature information. Figure 6 The dashed arrow indicates that the summary 2 of the previous event is the summary of indicator selection event 1; the first event information header of the storage structure 4 includes the summary 4 of the event-related information of the previous event of the same type (i.e., indicator selection event 1), the summary 3 of the previous event (i.e., indicator release event 1), the global sequence number, the summary 5 of indicator selection event 2, and the first signature information. Figure 6 The dashed arrows indicate that the summary 4 of the event-related information of the previous event of the same type is used as the summary of the event-related information of the indicator selection event 1, and the summary 3 of the previous event is used as the summary of the indicator publication event 1; the first event information header of the storage structure 5 includes the summary 6 of the event-related information of the previous event of the same type (i.e., evaluation event 1), the summary 5 of the previous event (i.e., indicator selection event 2), the global sequence number, the summary 7 of evaluation event 2, and the first signature information. Figure 6The dashed arrows indicate that the summary 6 of the event-related information of the previous event of the same type is a summary of the event-related information of the evaluation event 1, and that the summary 5 of the previous event is a summary of the indicator selection event 2; the first event information header of the storage structure 6 includes the summary 3 of the event-related information of the previous event of the same type (i.e., indicator release event 1), the summary 7 of the previous event (i.e., evaluation event 2), the global sequence number, the summary 8 of indicator release event 1, and the first signature information. Figure 6 The dashed arrow indicates that the summary of the event-related information of the previous event of the same type is used as an indicator to publish the summary of the event-related information of event 1, and indicates that the summary of the previous event is used as the summary of event 2.
[0146] Thus, since the header of the first event can include multiple different pieces of information, it can further increase the difficulty of tampering with the storage structure and / or the storage structure corresponding to the second event, thereby further improving the reliability of the data in the data acquisition device.
[0147] Optionally, the data acquisition device can generate a first event header based on the event-related information of the second event through the data storage module.
[0148] Step 203: The data acquisition device generates a storage structure based on the first event information body and the first event information header, and stores the storage structure.
[0149] Optionally, the data acquisition device can use a data storage module to encapsulate the first event information header outside the first event information body to obtain a storage structure, and store the storage structure in a preset storage area in the data acquisition device.
[0150] Thus, it can be seen that, since the data acquisition device can generate a first event information body based on the event-related information of the first event when it hears a first event (i.e., receiving a data request message from the data user device, obtaining candidate indicator values from the data provider device, receiving reliable parameters from the trusted device, changes in N data provider devices, changes in M trusted devices, changes in the determination rules of the comprehensive reliable parameters, changes in the comprehensive reliable parameters or the parameters for determining the comprehensive reliable parameters, and determining the true indicator value of the indicator information), that is, when the data in the data acquisition device may change, and based on the event-related information of the first event, generate a first event information header based on the event-related information of the second event (i.e., at least one of the events preceding the first event and the events of the same type preceding the first event), and generate a storage structure based on the first event information body and the first event information header, this can make the storage structure related to the second event, increasing the difficulty of tampering with the storage structure and / or the storage structure corresponding to the second event. Therefore, the reliability of the data in the data acquisition device can be improved.
[0151] Furthermore, this application employs a blockchain-like chain-based trusted data structure to store data, recording the actions of enterprises and data providers. If an enterprise unilaterally tampers with the data, other participants can quickly detect it, increasing their trust in the platform and providing reliable data support for the subsequent introduction of reward and punishment mechanisms. Moreover, compared to the traditional use of decentralized blockchains as trusted storage, the use of a semi-centralized indicator management center, combined with public and private key signatures and composite chain storage, is more efficient and provides similar reliability commitments. The composite chain structure allows users to focus only on the chain of a certain type of event without needing to save or verify the complete event chain, saving participants storage and verification costs.
[0152] In some embodiments of this application, combined with Figure 1 ,like Figure 7 As shown, after step 107 above, the data acquisition method provided in this application embodiment may further include steps 301 to 304 as described below.
[0153] Step 301: The data acquisition device receives a change request message from the target device.
[0154] In this embodiment of the application, the change request message is used to request changes to metadata, and the target device includes at least one of the following: a data acquisition device and any authorized device.
[0155] In this embodiment of the application, the aforementioned metadata includes at least one of the following: N data points provide device information; Device information for M authorized devices; Rules for determining comprehensive reliability parameters.
[0156] Step 302: The data acquisition device sends confirmation request messages to M authorized devices based on the change request message.
[0157] In this embodiment of the application, the aforementioned confirmation request message is used to request the authorized device to confirm the changes to metadata.
[0158] In some instances, combined Figure 2 The data acquisition device may also include a consensus negotiation module, which allows the data acquisition device to send confirmation request messages to M trusted devices.
[0159] Step 303: The data acquisition device receives the confirmation feedback message from the authorized device.
[0160] In this embodiment of the application, the aforementioned confirmation feedback message is used to instruct the authorization device to confirm the change to the metadata.
[0161] In some instances, after the data acquisition device sends a confirmation request message, if an authorized device agrees to the changes to the metadata, it can send a confirmation feedback message to the data acquisition device; conversely, if an authorized device disagrees with the changes to the metadata, it may not send a confirmation feedback message to the data acquisition device. Thus, the data acquisition device can receive a confirmation feedback message from an authorized device that agrees to the changes to the metadata.
[0162] Step 304: If the number of received confirmation feedback messages is greater than or equal to the quantity threshold, the data acquisition device modifies the metadata according to the change request message.
[0163] In some instances, the aforementioned quantity threshold can be determined by the number of M authorized devices. For example, the quantity threshold can be the product of the number M authorized devices M and a preset ratio, which can be 2 / 3. Of course, the preset ratio can also be other ratios, and this application embodiment does not limit this.
[0164] In some instances, combined Figure 2 The data acquisition device may also include a metadata management module, which allows the data acquisition device to modify the metadata based on the change request message when the consensus negotiation module confirms that the number of received confirmation feedback messages is greater than or equal to the quantity threshold.
[0165] Thus, it can be seen that when a data acquisition device receives a change request message, it can send confirmation request messages to M trusted devices. Only when the number of received confirmation feedback messages is greater than or equal to a certain threshold, that is, when most trusted devices confirm the change to the metadata, will the metadata be changed according to the change request message, rather than being changed directly according to the change request message. Therefore, the difficulty of tampering with the metadata can be increased, thereby improving the credibility of the data in the data acquisition device.
[0166] In some embodiments of this application, combined with Figure 2 The data acquisition device may also include an access control module and a data query module. The access control module controls access to authorized devices, signing and verifying all actions of these authorized devices, allowing only verified devices to interact with the data acquisition device. The data query module provides query functionality for all data from the data acquisition device, including metrics, metric values, reliable parameters, and device information.
[0167] Figure 8 This is a schematic diagram of the structure of a data acquisition device provided in an embodiment of this application. Figure 8 As shown, the data acquisition device 400 may include: a receiving module 401, an acquisition module 402, a sending module 403, and a determining module 404.
[0168] The receiving module 401 is configured to receive a first data request message from a data-using device, which requests the data acquisition device 400 to provide the index value of the target index information. The acquisition module 402 is configured to, based on the first data request message received by the receiving module 401, acquire a candidate index value and a release time of the candidate index value from each of the N data-providing devices, resulting in N candidate index values and N release times, where N is a positive integer. The sending module 403 is configured to send the N candidate index values acquired by the acquisition module 402 to each of the M authorized devices, where M is a positive integer. The receiving module 401 is also configured to receive M sets of reliability parameters fed back by the M authorized devices. Each set of reliability parameters includes N reliability parameters determined by an authorized device for the N candidate index values, and each reliability parameter characterizes the reliability of a candidate index value as the true index value of the target index information. The determining module 404 is configured to determine a comprehensive reliability parameter for each candidate indicator value based on the M sets of reliability parameters and N release times received by the receiving module 401. The comprehensive reliability parameter of each candidate indicator value characterizes the overall reliability of each candidate indicator value as the true indicator value of the target indicator information. Furthermore, it determines the target candidate indicator value from the N candidate indicator values whose comprehensive reliability parameter meets the target condition. The sending module 403 is further configured to send a first data response message to the data-using device, the first data response message including the target candidate indicator value determined by the determining module 404.
[0169] This application provides a data acquisition device. When the data acquisition device receives a first data request message from a data-using device requesting feedback on target indicator information, it can first obtain N candidate indicator values and their release times from N data-providing devices. Then, it sends these N candidate indicator values to M authorized devices, allowing each authorized device to determine reliable parameters for the N candidate indicator values. This allows the data acquisition device to receive M sets of reliable parameters from the M authorized devices, each set including N reliable parameters determined by one authorized device for the N candidate indicator values. Based on these M sets of reliable parameters and the N release times, the data acquisition device determines... By defining a comprehensive reliability parameter for each candidate indicator value, the overall reliability of each candidate indicator value as the true indicator value of the target indicator information can be determined. Thus, the data acquisition device can determine the target candidate indicator value (e.g., the target candidate indicator value most likely to be the true indicator value of the target indicator information) from N candidate indicator values, which satisfies the target condition. The device then sends a first data response message including the target candidate indicator value to the data-using device, so that the data-using device can obtain the target candidate indicator value most likely to be the true indicator value of the target indicator information. Therefore, the probability of the target candidate indicator value obtained by the data-using device being inaccurate can be reduced, thereby improving the accuracy of the data acquired by the device.
[0170] In other embodiments, the determining module 404 is specifically used to obtain M reliable parameters corresponding to a candidate indicator value from M sets of reliable parameters, calculate an intermediate reliable parameter of a candidate indicator value based on the M reliable parameters corresponding to a candidate indicator value and a data source reliable parameter corresponding to a candidate indicator value, and determine a corresponding time decay parameter based on a release time of the candidate indicator value. The data source reliable parameter is used to characterize the reliability of the data providing device corresponding to the candidate indicator value in providing the real indicator value, and calculates a comprehensive reliable parameter of a candidate indicator value based on the intermediate reliable parameter, the indicator correction parameter corresponding to the target indicator information, and the time decay parameter.
[0171] In other embodiments, the data acquisition device 400 provided in this application may further include an update module. This update module is used to update the data source reliability parameter corresponding to a candidate indicator value based on the comprehensive reliability parameter of the candidate indicator value, after the determining module 404 calculates the comprehensive reliability parameter of the candidate indicator value according to the intermediate reliability parameter, the indicator correction parameter corresponding to the target indicator information, and the time decay parameter.
[0172] In other embodiments, the data acquisition device 400 provided in this application may further include a generation module and a storage module. The generation module is configured to, upon detecting a first event, generate a first event information body based on event-related information of the first event; and generate a first event information header based on event-related information of a second event, the second event including at least one of the following: a preceding event of the first event, or an event of the same type as the preceding event of the first event; and generate a storage structure based on the first event information body and the first event information header. The storage module is configured to store the storage structure generated by the generation module. Both the first event and the second event include at least one of the following: receiving a data request message from a data-using device, the data request message being used to request an indicator value for indicator information; obtaining candidate indicator values from a data-providing device; receiving reliable parameters from an authorized device; N data-providing devices changing; M authorized devices changing; the determination rule for the comprehensive reliable parameters changing; the comprehensive reliable parameters or the parameters determining the comprehensive reliable parameters changing; and determining the true indicator value of the indicator information.
[0173] In other embodiments, the first event header described above includes a summary of event-related information about the second event.
[0174] In some other embodiments, the first event header may further include at least one of the following: a sequence number corresponding to the storage structure; a summary of the first event body; and first signature information, which is obtained by signing the summary of all information in the first event header.
[0175] In some other embodiments, the first event information body includes at least one of the following: an event type identifier for the first event; an event identifier for the first event; an identifier for the indicator information corresponding to the first event; an identifier for the indicator value corresponding to the first event; an indicator value corresponding to the first event; an identifier for the device corresponding to the first event; a device type identifier for the device corresponding to the first event; a reliability parameter corresponding to the first event; an event operation type corresponding to the first event; an identifier for the rule corresponding to the first event; the content of the rule corresponding to the first event; a description of the first event; time information of the first event; and second signature information, which is obtained by signing all the information in the first event information body.
[0176] In other embodiments, the receiving module 401 is further configured to receive a change request message from a target device, the change request message being used to request changes to metadata, the target device including at least one of the following: a data acquisition device 400, and any authorized device. The sending module 403 is further configured to send confirmation request messages to M authorized devices according to the change request message received by the receiving module 401, the confirmation request messages being used to request the authorized devices to confirm the changes to metadata. The receiving module 401 is further configured to receive confirmation feedback messages from the authorized devices, the confirmation feedback messages being used to instruct the authorized devices to confirm the changes to metadata. The data acquisition device 400 provided in this application embodiment may further include: a change module. The change module is configured to change the metadata according to the change request message when the number of confirmation feedback messages received by the receiving module 401 is greater than or equal to a number threshold; wherein the metadata includes at least one of the following: device information of N data providing devices; device information of M authorized devices; and a rule for determining comprehensive reliability parameters.
[0177] In other embodiments, the target condition includes any one of the following: the comprehensive reliability parameter with the highest parameter value among the comprehensive reliability parameters of N candidate index values; the top Q comprehensive reliability parameters with the highest parameter values among the comprehensive reliability parameters of N candidate index values; where Q is a positive integer greater than 1.
[0178] The data acquisition device provided in this application embodiment can execute the method shown in the above method embodiment. Its implementation principle and beneficial effects can be referred to the relevant description in the method embodiment, and will not be repeated here.
[0179] Figure 9 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Figure 9 As shown, the electronic device includes: a memory 501, a transceiver 502, and at least one processor 503.
[0180] The transceiver 502 is used to interact with other devices to send and receive data. For example, in this embodiment, the transceiver 502 can specifically be used to receive a first data request message or send N candidate index values, etc.
[0181] The memory 501 is used to store computer program code, which includes computer instructions. These computer instructions run in the aforementioned electronic device to implement the method shown in the above-described method embodiments. For example, the memory may include high-speed random access memory (RAM), and may also include non-volatile memory (NVM), such as at least one disk storage device, or a USB flash drive, portable hard drive, read-only memory, magnetic disk, or optical disk, etc.
[0182] Processor 503 can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. Processor 503 can also be other general-purpose processors. The general-purpose processor can be a microprocessor or any conventional processor.
[0183] The memory 501, transceiver 502, and processor 503 are communicatively connected. For example, the memory 501 and transceiver 502 can be connected to the processor 503 via a system bus and communicate with each other. The system bus can be a peripheral component interconnect (PCI) bus, an extended industry standard architecture (EISA) bus, an industry standard architecture (ISA) bus, etc. The system bus can be divided into address bus, data bus, control bus, etc. For ease of representation, only one thick line is used in the figure, but this does not mean that there is only one bus or one type of bus.
[0184] Optionally, the memory 501 can be either standalone or integrated with the processor 503. When the memory 501 is set up independently, it is connected to the processor 503 via a system bus.
[0185] This application also provides a chip for executing instructions, which is used to execute the data acquisition method described in the above embodiments.
[0186] This application also provides a computer-readable storage medium storing computer instructions. When these computer instructions are executed by a processor, they are used to implement the technical solution of the data acquisition method described in the above embodiments. Specifically, when the computer instructions are executed by a processor, the electronic device can perform the technical solution of the data acquisition method described in the above embodiments.
[0187] This application also provides a computer program product, which includes a computer program stored in a computer-readable storage medium. At least one processor can read the computer program from the computer-readable storage medium, and when the at least one processor executes the computer program, it can implement the technical solution of the data acquisition method in the above embodiments.
[0188] The aforementioned computer-readable storage media can be implemented from any type of volatile or non-volatile storage device or a combination thereof, such as Static Random-Access Memory (SRAM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Erasable Programmable Read-Only Memory (EPROM), Programmable Read-Only Memory (PROM), Read-Only Memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk. The computer-readable storage media can be any available medium accessible to a general-purpose or special-purpose computer.
[0189] An exemplary computer-readable storage medium is coupled to a processor, enabling the processor to read information from and write information to the storage medium. Of course, the computer-readable storage medium can also be a component of the processor. The processor and the computer-readable storage medium can reside in an application-specific integrated circuit (ASIC). Alternatively, the processor and the computer-readable storage medium can exist as discrete components in an electronic control unit or main control device; this application does not limit this.
[0190] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative; for instance, the division of modules is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple modules may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be indirect coupling or communication connection through some interfaces, devices, or modules, and may be electrical, mechanical, or other forms.
[0191] The modules described as separate components may or may not be physically separate. The components shown as modules may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to implement the solution of this embodiment according to actual needs.
[0192] Furthermore, the functional modules in the various embodiments of this application can be integrated into one processing unit, or each module can exist physically separately, or two or more modules can be integrated into one unit. The unit composed of the above modules can be implemented in hardware or in the form of hardware plus software functional units.
[0193] The integrated modules described above, implemented as software functional modules, can be stored in a computer-readable storage medium. These software functional modules, stored in a storage medium, include several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) or processor to execute some steps of the methods of the various embodiments of this application.
[0194] It should be understood that the steps of the method disclosed in the embodiments of this application can be directly implemented by a hardware processor, or implemented by a combination of hardware and software modules in the processor.
[0195] Those skilled in the art will understand that all or part of the steps of the above-described method embodiments can be implemented by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When executed, the program performs the steps of the above-described method embodiments; and the aforementioned storage medium includes various media capable of storing program code, such as ROM, RAM, magnetic disks, or optical disks.
[0196] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.
Claims
1. A data acquisition method, characterized in that, Applied to data acquisition devices, including: Receive a first data request message from the data usage device, the first data request message being used to request the data acquisition device to return the indicator value of the target indicator information; According to the first data request message, a candidate indicator value and a release time of the candidate indicator value are obtained from each of the N data providing devices, respectively, to obtain N candidate indicator values and N release times, where N is a positive integer; Send the N candidate index values to M authorized devices respectively, where M is a positive integer; Receive M sets of reliable parameters fed back by the M trust devices. Each set of reliable parameters includes N reliable parameters determined by a trust device for the N candidate index values. Each reliable parameter is used to characterize the reliability of a candidate index value as the true index value of the target index information. Based on the M sets of reliability parameters and the N release times, a comprehensive reliability parameter for each candidate indicator value is determined. The comprehensive reliability parameter for each candidate indicator value is used to characterize the comprehensive reliability of each candidate indicator value as the true indicator value of the target indicator information. From the N candidate index values, determine the target candidate index value whose comprehensive reliability parameters meet the target conditions; A first data response message is sent to the data-using device, the first data response message including the target candidate index value.
2. The method according to claim 1, characterized in that, The comprehensive reliability parameter for determining each candidate indicator value based on the M sets of reliability parameters and the N release times includes: From the M sets of reliable parameters, obtain the M reliable parameters corresponding to a candidate index value; Based on the M reliable parameters corresponding to a candidate indicator value and the data source reliability parameter corresponding to a candidate indicator value, the intermediate reliability parameter of a candidate indicator value is calculated, and the corresponding time decay parameter is determined based on a release time of a candidate indicator value. The data source reliability parameter is used to characterize the reliability of the data providing device corresponding to a candidate indicator value in providing the real indicator value. Based on the intermediate reliability parameter, the indicator correction parameter corresponding to the target indicator information, and the time decay parameter, a comprehensive reliability parameter for a candidate indicator value is calculated.
3. The method according to claim 2, characterized in that, After calculating a comprehensive reliability parameter for a candidate indicator value based on the intermediate reliability parameter, the indicator correction parameter corresponding to the target indicator information, and the time decay parameter, the method further includes: Update the data source reliability parameters corresponding to a candidate indicator value based on the comprehensive reliability parameters of the candidate indicator value.
4. The method according to claim 1, characterized in that, The method further includes: Upon detecting the first event, generate a first event information body based on the event-related information of the first event; Based on the event-related information of the second event, a first event information header is generated, wherein the second event includes at least one of the following: the previous event of the first event, or the previous event of the same type as the first event; Based on the first event information body and the first event information header, a storage structure is generated and the storage structure is stored. Wherein, both the first event and the second event include at least one of the following: A data request message is received from the data-using device, the data request message being used to request the indicator value of indicator information; Obtain candidate indicator values from the data providing device; Reliable parameters were received from the trusted device; The N data providing devices have changed; The M authorization devices have changed; The rules for determining comprehensive reliability parameters have changed; The overall reliability parameters or the parameters that determine the overall reliability parameters change; Determine the true value of the indicator information.
5. The method according to claim 4, characterized in that, The first event header includes a summary of event-related information about the second event.
6. The method according to claim 5, characterized in that, The first event header also includes at least one of the following: The sequence number corresponding to the storage structure; A summary of the first event information body; The first signature information is obtained by signing the summary of all information in the first event header.
7. The method according to any one of claims 4 to 6, characterized in that, The first event information body includes at least one of the following: The event type identifier of the first event; The event identifier of the first event; The identifier of the indicator information corresponding to the first event; The identifier of the indicator value corresponding to the first event; The index value corresponding to the first event; The identifier of the device corresponding to the first event; The device type identifier of the device corresponding to the first event; Reliable parameters corresponding to the first event; The event operation type corresponding to the first event; The identifier of the rule corresponding to the first event; The content of the rule corresponding to the first event; Description information of the first event; The time information of the first event; The second signature information is obtained by signing all the information in the first event information body.
8. The method according to claim 1, characterized in that, The method further includes: Receive a change request message from a target device, the change request message being used to request changes to metadata, the target device including at least one of the following: the data acquisition device, any authorized device; According to the change request message, a confirmation request message is sent to the M authorized devices, the confirmation request message being used to request the authorized devices to confirm the change of the metadata; Receive a confirmation feedback message from the authorization device, the confirmation feedback message being used to instruct the authorization device to confirm the change to the metadata; If the number of received confirmation feedback messages is greater than or equal to the quantity threshold, the metadata is modified according to the change request message; The metadata includes at least one of the following: The N data points provide the device information; The device information of the M authorized devices; Rules for determining comprehensive reliability parameters.
9. The method according to claim 1, characterized in that, The target condition includes any one of the following: The comprehensive reliability parameter with the highest parameter value among the N candidate index values; The top Q comprehensive reliability parameters with the highest values among the N candidate index values; Where Q is a positive integer greater than 1.
10. A data acquisition device, characterized in that, The data acquisition device includes: a receiving module, an acquisition module, a sending module, and a determining module; The receiving module is used to receive a first data request message from the data using device, wherein the first data request message is used to request the data acquisition device to return the indicator value of the target indicator information; The acquisition module is configured to acquire, according to the first data request message received by the receiving module, a candidate indicator value and a release time of the candidate indicator value from each of the N data providing devices, thereby obtaining N candidate indicator values and N release times, where N is a positive integer; The sending module is used to send the N candidate index values obtained by the acquisition module to M authorized devices respectively, where M is a positive integer; The receiving module is further configured to receive M sets of reliable parameters fed back by the M trust devices. Each set of reliable parameters includes N reliable parameters determined by a trust device for the N candidate index values. Each reliable parameter is used to characterize the reliability of a candidate index value as the true index value of the target index information. The determining module is used to determine the comprehensive reliability parameter of each candidate indicator value based on the M sets of reliability parameters received by the receiving module and the N release times. The comprehensive reliability parameter of each candidate indicator value is used to characterize the comprehensive reliability of each candidate indicator value as the true indicator value of the target indicator information. And from the N candidate indicator values, the target candidate indicator value whose comprehensive reliability parameter meets the target condition is determined. The sending module is further configured to send a first data response message to the data-using device, the first data response message including the target candidate index value determined by the determining module.
11. An electronic device, characterized in that, include: A transceiver, a memory, and at least one processor; the memory is communicatively connected to the processor; the memory is used to store computer program code, the computer program code including computer instructions; when the processor executes the computer instructions, the electronic device performs the method as described in any one of claims 1 to 9.
12. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer instructions that, when executed by a processor, are used to implement the method as described in any one of claims 1 to 9.
13. A computer program product, characterized in that, When the computer program product is run on a computer / executed by the computer's processor, it implements the method as described in any one of claims 1 to 9.