Resource processing method, device, electronic device and storage medium

Abstract

The present disclosure is about a resource processing method, device, electronic device and storage medium, and relates to the field of information processing technology, so as to at least solve the problem of low accuracy in deduplication of video resource recommendation by social platforms in related technologies. The method includes: obtaining identification information of candidate resources; increasing identification information corresponding to candidate resources according to the generation time of candidate resources; comparing identification information of candidate resources with the minimum value of identification information corresponding to hash value in filter when identification information of candidate resources is not stored in identification information set; determining whether identification information of candidate resources is stored in filter when identification information of candidate resources is greater than or equal to the minimum value of identification information corresponding to hash value in filter; determining that candidate resources are not recommended as resources for target account when identification information of candidate resources is stored in filter.

Description

Technical Field

[0001] The present disclosure relates to the field of information processing technology, and in particular to a resource processing method, device, electronic device and storage medium. Background Art

[0002] Social platforms can usually recommend content products (such as videos) that an account may be interested in, in order to increase stickiness to the account.

[0003] At present, social platforms may recommend content products repeatedly. For example, after a social platform recommends a first video product to an account, it may recommend the first video product to the account again in subsequent content recommendations, resulting in a poor user experience for the relevant users. In related technologies, to avoid this situation, social platforms usually store the identification information of video resources in filters and use filters to deduplicate the identification information of candidate resources.

[0004] However, when using filters to deduplicate candidate resources, since the identification information occupies a large storage space, multiple filters are usually required to be connected in series to filter the identification information of video resources. Multiple filters connected in series not only increase the misjudgment rate, but also reduce the accuracy of deduplication of candidate resources and the efficiency of deduplication of candidate resources. Summary of the invention

[0005] The present disclosure provides a resource processing method, device, electronic device and storage medium to at least solve the problem of low accuracy in deduplication of video resource recommendations by social platforms in the related art. The technical solution of the present disclosure is as follows:

[0006] According to a first aspect of an embodiment of the present disclosure, a resource processing method is provided, including: obtaining identification information of a candidate resource; according to a generation time of the candidate resource, the identification information corresponding to the candidate resource is incremented; in a case where the identification information of the candidate resource is not stored in an identification information set, comparing the identification information of the candidate resource with a minimum value of the identification information corresponding to the hash value in the filter; the identification information set stores encoding information of a first resource recommended for a target account in a first historical time period, and the filter stores a hash value of a second resource recommended for the target account in a second historical time period, the hash value corresponding to the identification information of the second resource; the second historical time period is earlier than the first historical time period; in a case where the identification information of the candidate resource is greater than or equal to the minimum value of the identification information corresponding to the hash value in the filter, determining whether the identification information of the candidate resource is stored in the filter; in a case where the identification information of the candidate resource is stored in the filter, determining that the candidate resource is not a recommended resource for the target account.

[0007] In combination with the first aspect, in a possible implementation, after obtaining the identification information of the candidate resource, the method further includes: when the identification information of the candidate resource is stored in the identification information set, determining that the candidate resource is not a recommended resource for the target account.

[0008] In combination with the first aspect, in a possible implementation manner, the method further includes: when the identification information of the candidate resource is less than a minimum value of the identification information corresponding to the hash value in the filter, determining that the candidate resource is not a recommended resource for the target account.

[0009] In combination with the first aspect, in a possible implementation method, before obtaining the identification information of the candidate resource, the above method also includes: obtaining the first identification information of the first resource recommended to the target account within a first historical time period; differentially encoding the first identification information of the first resource to obtain the encoding information of the first resource; and determining a set consisting of the encoding information of the first resource as an identification information set.

[0010] In combination with the first aspect, in a possible implementation method, before obtaining the identification information of the candidate resource, the above method also includes: obtaining the second identification information of the second resource recommended to the target account within the second historical time period; determining the hash value of the second identification information of the second resource, and storing the hash value in the filter.

[0011] In combination with the first aspect, in a possible implementation method, the above-mentioned determination of whether the identification information of the candidate resource is stored in the filter includes: determining a target hash value of the identification information of the candidate resource; if the target hash value is stored in the filter, determining that the identification information of the candidate resource is stored in the filter; if the target hash value is not stored in the filter, determining that the filter does not store the identification information of the candidate resource.

[0012] In combination with the first aspect, in a possible implementation, the above-mentioned determination of the target hash value of the identification information of the candidate resource includes: determining a first target hash value according to a hash algorithm and the identification information of the candidate resource; and determining a second target hash value according to the hash algorithm and the first target hash value.

[0013] In combination with the first aspect, in a possible implementation, when a target hash value is stored in the filter, determining that identification information of a candidate resource is stored in the filter includes: when a first target hash value or a second target hash value is stored in the filter, determining that identification information of a candidate resource is stored in the filter.

[0014] According to a second aspect of an embodiment of the present disclosure, a resource processing device is provided, comprising: an acquisition unit, for acquiring identification information of a candidate resource; the identification information corresponding to the candidate resource is incremented according to the generation time of the candidate resource; a judgment unit, for comparing the identification information of the candidate resource acquired by the acquisition unit with the minimum value of the identification information corresponding to the hash value in the filter when the identification information of the candidate resource is not stored in the identification information set; the identification information set stores encoding information of a first resource recommended for a target account in a first historical time period, the filter stores a hash value of a second resource recommended for the target account in a second historical time period, the hash value corresponding to the identification information of the second resource; the second historical time period is earlier than the first historical time period; the judgment unit, for determining whether the identification information of the candidate resource is stored in the filter when the identification information of the candidate resource is greater than or equal to the minimum value of the identification information corresponding to the hash value in the filter; a recommendation unit, for determining that the candidate resource is not a recommended resource for the target account when the judgment unit determines that the identification information of the candidate resource is stored in the filter.

[0015] In conjunction with the second aspect, in a possible implementation, the recommendation unit is further configured to determine that the candidate resource is not a recommended resource for the target account when the judgment unit determines that the identification information set stores identification information of the candidate resource.

[0016] In combination with the second aspect, in a possible implementation method, the above-mentioned recommendation unit is also used to determine that the candidate resource is not a recommended resource for the target account when the judgment unit determines that the identification information of the candidate resource is less than the minimum value of the identification information corresponding to the hash value in the filter.

[0017] In combination with the second aspect, in a possible implementation method, the above-mentioned device also includes an encoding unit; the acquisition unit is also used to obtain the first identification information of the first resource recommended to the target account within the first historical time period; the encoding unit is used to differentially encode the first identification information of the first resource obtained by the acquisition unit to obtain the encoding information of the first resource; the encoding unit is also used to determine the set consisting of the encoding information of the first resource as the identification information set.

[0018] In combination with the second aspect, in a possible implementation method, the above-mentioned device also includes a filter unit; the acquisition unit is also used to obtain the second identification information of the second resource recommended to the target account within the second historical time period; the filter unit is used to determine the hash value of the second identification information of the second resource obtained by the acquisition unit, and store the hash value in the filter.

[0019] In combination with the second aspect, in a possible implementation method, the above-mentioned filter unit is also used to determine the target hash value of the identification information of the candidate resource; the above-mentioned judgment unit is also used to determine that the identification information of the candidate resource is stored in the filter when the target hash value determined by the filter unit is stored in the filter; the above-mentioned judgment unit is also used to determine that the filter does not store the identification information of the candidate resource when the target hash value determined by the filter unit is not stored in the filter.

[0020] In combination with the second aspect, in a possible implementation manner, the filter unit is specifically used to: determine a first target hash value according to a hash algorithm and identification information of a candidate resource; and determine a second target hash value according to the hash algorithm and the first target hash value.

[0021] In combination with the second aspect, in a possible implementation manner, the above-mentioned judgment unit is specifically used to: when the first target hash value or the second target hash value is stored in the filter, determine that identification information of the candidate resource is stored in the filter.

[0022] According to a third aspect of an embodiment of the present disclosure, there is provided an electronic device, comprising: a processor; and a memory for storing processor-executable instructions; wherein the processor is configured to execute instructions to implement the resource processing method provided in the first aspect.

[0023] According to a fourth aspect of an embodiment of the present disclosure, a computer-readable storage medium is provided, the computer-readable storage medium comprising instructions; when the instructions are executed by a processor of an electronic device, the electronic device executes the resource processing method provided in the first aspect.

[0024] According to a fifth aspect of an embodiment of the present disclosure, a computer program product is provided. The computer program product includes instructions. When the instructions are executed on a processor of an electronic device, the electronic device executes the resource processing method provided in the first aspect.

[0025] The technical solution provided by the embodiments of the present disclosure brings at least the following beneficial effects: in the present disclosure, the identification information set is used to store the coding information of the identification information of the recommended resources in the first historical time period, and the filter is used to store the hash value of the identification information of the recommended resources in the second historical time period. Therefore, the deduplication of the identification information set can be used to achieve deduplication of the identification information corresponding to the coded information stored therein, that is, to achieve complete deduplication of the candidate resources in the first historical time period, and to achieve accurate deduplication of some candidate resources; and the deduplication of the recommended resources in the second historical time period through the filter can achieve erroneous deduplication of the recommended resources in the second historical time period; since the second historical time period is earlier than the first historical time period, the identification information set and the filter can respectively achieve deduplication of different precisions of recommended resources in different periods, thereby avoiding recommending duplicate resources to users and avoiding recently generated resources from being mistaken for recommended resources, so that recently generated resources can be recommended to each account as much as possible, thereby improving users' creative enthusiasm. At the same time, through the deduplication method combining the identification information set and the filter, the identification information of the resources stored in the filter is reduced. Therefore, under the condition of a certain misjudgment rate, the accuracy of the filter in deduplicating resources can be improved; and because the filter in the present disclosure stores the hash value of the identification information of the recommended resources, the hash value occupies a small storage space, so the deduplication of the recommended resources in the second historical time period can be achieved through one filter. Compared with the prior art of filtering the recommended resources through multiple filters connected in series, the efficiency of deduplication of recommended resources is improved.

[0026] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] The drawings herein are incorporated into and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the description are used to explain the principles of the present disclosure, and do not constitute improper limitations on the present disclosure.

[0028] Figure 1 It is a schematic diagram of the architecture of an implementation environment according to an exemplary embodiment.

[0029] Figure 2 The diagram is one of the flowcharts of a resource processing method according to an exemplary embodiment.

[0030] Figure 3 This is a second flowchart of a resource processing method according to an exemplary embodiment.

[0031] Figure 4 This is a third flowchart of a resource processing method according to an exemplary embodiment.

[0032] Figure 5 This is a fourth flowchart of a resource processing method according to an exemplary embodiment.

[0033] Figure 6 This is a fifth flowchart of a resource processing method according to an exemplary embodiment.

[0034] Figure 7 This is the sixth flowchart of a resource processing method according to an exemplary embodiment.

[0035] Figure 8 This is the seventh flowchart of a resource processing method according to an exemplary embodiment.

[0036] Fig. 9 This is an eighth flowchart of a resource processing method according to an exemplary embodiment.

[0037] Fig.10 The diagram is a schematic diagram of the structure of a resource processing device according to an exemplary embodiment.

[0038] Fig.11 The diagram is a schematic structural diagram of an electronic device according to an exemplary embodiment. DETAILED DESCRIPTION

[0039] In order to enable ordinary persons in the art to better understand the technical solutions of the present disclosure, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings.

[0040] It should be noted that the terms "first", "second", etc. in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present disclosure described herein can be implemented in an order other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0041] In related technologies, social platforms can recommend resources of interest to accounts, such as video resources, which can increase the stickiness of social platforms to corresponding users. In practice, social platforms focus on recommending resources based on the account's interest, but in the process of recommending resources, they may repeatedly recommend a resource to the same account, which will reduce the user experience of the corresponding user.

[0042] In order to avoid social platforms from repeatedly recommending a resource to the same account, the current resource recommendation deduplication method can be implemented through the identification information corresponding to various resources. For example, when each account releases a new video resource on the social platform, the server of the social platform can assign a unique identity document (ID) to these video resources, and the server can store the IDs corresponding to these video resources in the data set; when the server recommends a video resource to an account, it can compare the ID of the candidate video resource with the ID in the data set. If the ID of the candidate video resource is stored in the data set, the candidate video resource can be filtered, that is, the candidate video is no longer recommended to the account.

[0043] In another implementation, the social platform can also deduplicate video resources through a Bloom filter. For example, the server can store the IDs corresponding to the video resources in the Bloom filter. However, due to the low error rate of the Bloom filter, the space occupied by the IDs corresponding to these video resources is relatively large. For example, when the error rate of the Bloom filter is one thousandth, the ID corresponding to each video resource occupies approximately 14.35 bits of space. Therefore, when there are too many video resources in the social platform, it may be necessary to connect multiple Bloom filters in series to store the IDs corresponding to these video resources, which will increase the error rate of the Bloom filter; and when querying the identification information of the video resources through multiple series-connected Bloom filters, the efficiency is low.

[0044] Based on the above-mentioned resource recommendation deduplication method, there may be problems of occupying a large storage space and an excessively high false positive rate. The disclosed embodiment provides a resource processing method, in which an identification information set and a filter are deployed in an electronic device. The identification information set and the filter can be used to deduplicate the resources recommended to the account in different time periods. For example, the identification information set can store the first identification information of the first resource recommended to the account in a first historical time period, and the filter stores the second identification information of the second resource recommended to the account in a second historical time period. Through the combination of the identification information set and the filter, deduplication of recommendations for different resources can be achieved, and zero false positive recommendation deduplication for specific resources can be achieved through the information identification set; and by setting the minimum value of the filter, the identification information of the resources stored in the filter can be reduced, and under the condition of a certain false positive rate, the accuracy of the filter in deduplicating resources can also be improved.

[0045] Figure 1 is an architecture diagram of an implementation environment according to an exemplary embodiment. Figure 1 As shown, the following resource processing method can be applied in the implementation environment. The implementation environment includes a terminal 01 and an electronic device 02. The terminal 01 establishes a communication connection with the electronic device 02 through an application installed on the terminal 01.

[0046] In an practicable manner, the terminal 01 may run an application associated with the electronic device 02, and based on the application, the electronic device 02 may be logged in, thereby interacting with the electronic device 02. The application may be a short video application, a social network application, or a browser. In the embodiment of the present disclosure, the application is taken as an example for explanation, and the user may refresh the resource request in the short video application to obtain the video resources recommended by the electronic device 02.

[0047] In an practicable manner, the electronic device 02 may be a server, a server cluster consisting of multiple servers, or a cloud computing service center. The electronic device 02 may include a processor, a memory, a network interface, and the like.

[0048] In an operative manner, the terminal 01 is used to provide voice and / or data connectivity services to the user. The terminal 01 may have different names, such as UE, end, terminal unit, terminal station, mobile station, mobile station, remote station, remote terminal, mobile device, wireless communication device, vehicle user equipment, terminal agent or terminal device, etc.

[0049] Optionally, the terminal 01 may be any handheld device, vehicle-mounted device, wearable device, or computer with communication functions, which is not limited in the embodiments of the present disclosure. For example, the handheld device may be a smart phone. The vehicle-mounted device may be a vehicle-mounted navigation system. The wearable device may be a smart bracelet. The computer may be a personal digital assistant (PDA), a tablet computer, or a laptop computer.

[0050] Those skilled in the art should understand that the above terminals are only examples, and other existing or future terminals, if applicable to the present disclosure, should also be included in the protection scope of the present disclosure and are included here by reference.

[0051] Based on the above implementation environment, the specific implementation process of the resource processing method provided by the embodiment of the present disclosure is as follows:

[0052] The resource processing method provided by the embodiment of the present disclosure is exemplarily described below in conjunction with the accompanying drawings.

[0053] Figure 2 is a flow chart of a resource processing method according to an exemplary embodiment. Figure 2 As shown, the resource processing method can be applied to the above-mentioned server, and the method includes the following S11 to S13.

[0054] S11. The electronic device obtains identification information of the candidate resource.

[0055] Among them, according to the generation time of the candidate resources, the identification information corresponding to the candidate resources is incremented. For example, the candidate resources may be video resources uploaded by various accounts in the short video application platform, and according to the upload time of these video resources, the corresponding identification information may be incremented from 00000001 in sequence.

[0056] As a possible implementation method, taking the short video application platform as an example, when the target account requests video resources, the electronic device can obtain the video resources that the target account is interested in from the electronic device according to the video recommendation algorithm, and then obtain the identification information corresponding to these video resources.

[0057] Since the video resources in the short video application platform can be published by various accounts, when these video resources are published, the electronic device can assign unique identification information to these video resources. For example, the identification information of the video resource can be an eight-digit number, such as 00000001. When the short video application platform generates new video resources, the identification information of these video resources can be incremented from 00000001, such as 00000002, 00000003, 00000004, etc. Therefore, when the electronic device obtains the candidate resource, it can also obtain the identification information corresponding to the candidate resource.

[0058] Exemplarily, when the electronic device recommends a video resource to the target account, the electronic device may determine the first candidate video resource and the identification information of the first candidate video resource from the electronic device, and the identification information may be 06320301. Of course, when the electronic device recommends a video resource to the target account, it may also simultaneously determine multiple candidate video resources from the electronic device, such as the first candidate video resource, the second candidate video resource, the third candidate video resource, etc., and then determine the identification information corresponding to these candidate video resources, such as the identification information of the first candidate video resource may be identification information one, the identification information of the second candidate video resource may be identification information two, and the identification information of the third candidate video resource may be identification information three.

[0059] When the identification information allocated by the electronic device to the video resource is an eight-digit number, the identification information one in the above example may be 01200100, the identification information two may be 01351203, the identification information three may be 01351205, and so on.

[0060] S12: When the identification information of the candidate resource is not stored in the identification information set, the electronic device compares the identification information of the candidate resource with the minimum value of the identification information corresponding to the hash value in the filter.

[0061] S13: When the identification information of the candidate resource is greater than or equal to the minimum value of the identification information corresponding to the hash value in the filter, the electronic device determines whether the identification information of the candidate resource is stored in the filter.

[0062] Among them, the identification information set stores the encoding information of the first resource recommended to the target account in the first historical time period, and the filter stores the hash value of the second resource recommended to the target account in the second historical time period, and the hash value corresponds to the identification information of the second resource; the second historical time period is earlier than the first historical time period.

[0063] As a possible implementation method, in the embodiment of the present disclosure, the identification information set can store identification information corresponding to new resources, and the filter can store identification information corresponding to old resources, where new resources refer to resources that have been recently added to the social platform, such as resources that have been added within 30 days before the current moment (in this case, the first historical time period is the 30 days before the current moment); old resources refer to resources that have been previously added to the social platform, such as resources that have been added to the social platform within 30 days before the first historical time period (in this case, the second historical time period is from 30 days before the current moment to 60 days before the current moment).

[0064] When the electronic device determines that the identification information set does not store the identification information of the candidate resource, it can be determined that the electronic device has not recommended the corresponding candidate resource to the target account in the first historical time period. At this time, the electronic device can compare the hash value of the identification information of the candidate resource with the hash value of the identification information stored in the filter to determine whether the filter stores the identification information of the candidate resource. Since the identification information set stores the coded information of the identification information, only the complete information of the first bit of identification information is stored. Therefore, when determining whether the identification information set stores the identification information of the candidate resource, it is necessary to determine based on the first bit of identification information and the coded information.

[0065] In the embodiment of the present disclosure, the identification information of the resources stored in the filter has a lower limit value, and the lower limit value can be the minimum value of the identification information corresponding to the resources newly added by the social platform in the second historical time period. When the identification information of the resource is less than the minimum value, it can be determined that the time when the resource was added is earlier than the second time period, that is, the embodiment of the present disclosure limits the range of the identification information corresponding to the hash value in the filter, and thus reduces the number of identification information corresponding to the resources in the filter. Therefore, when the identification information of the candidate resource is greater than or equal to the minimum value of the identification information corresponding to the hash value in the filter, the filter can be used to implement recommendation deduplication of the candidate resource, that is, determine whether the identification information of the candidate resource is stored in the filter.

[0066] Correspondingly, since the filter is used to recommend and remove duplicate old resources, an upper limit value of the identification information is also set, and the upper limit value may be the maximum value of the identification information corresponding to all new resources on the social platform within the second historical time period.

[0067] Exemplarily, the filter is used to recommend and remove duplicate resources within the second historical time period, and the identification information of the resources within the second historical time period is determined, that is, the second identification information is determined, which may include an upper limit and a lower limit. For example, the upper limit of the second identification information may be identification information 2, and the lower limit may be identification information 1. At this time, when the identification information corresponding to the candidate resource is between identification information 1 and identification information 2, the filter can be used to determine whether the corresponding candidate resource has been recommended to the target account.

[0068] Since the filter has restrictions on the identification information of the resource, when the identification information of the candidate resource is not stored in the identification information set, it can be determined whether the identification information of the candidate resource meets the determination requirements of the filter.

[0069] When the identification information of the candidate resource is within the identification information range of the filter storage resource, it can be determined whether the filter stores the identification information of the candidate resource. Since the filter actually stores the hash value of the identification information, it is actually determined whether the filter stores the hash value corresponding to the identification information of the candidate resource.

[0070] In some embodiments, since the identification information corresponding to the resources in the social platform can be added in an incremental manner, and the first identification information stored in the identification information set is the identification information of the new resource, that is, the first identification information is constantly increasing, at this time the first identification information stored in the identification information set can include a lower limit, such as the first identification information can be identification information greater than 01351203, but does not include an upper limit.

[0071] S14: When identification information of a candidate resource is stored in the filter, the electronic device determines that the candidate resource is not a recommended resource for the target account.

[0072] As a possible implementation, when a hash value corresponding to the identification information of a candidate resource is stored in the filter, it can be determined that the electronic device has recommended the candidate resource to the target account, and the candidate resource is no longer used as a recommended resource for the target account.

[0073] When the hash value corresponding to the identification information of the candidate resource is not stored in the filter, it can be determined that the electronic device has not recommended the candidate resource to the target account. In this case, the candidate resource can be used as a recommended resource for the target account.

[0074] Since the encoding information in the identification information set in the present disclosure is the encoding information corresponding to the identification information of the recommended resource, and the hash value in the filter is the hash value corresponding to the identification information of the recommended resource, when deduplication of candidate resources is achieved through the identification information set and the filter, it is possible to avoid recommending duplicate resources to users, thereby improving user experience.

[0075] The technical solution provided by the above-mentioned embodiment has at least the following beneficial effects: since in the present disclosure, the identification information set is used to store the encoding information of the identification information of the recommended resources in the first historical time period, and the filter is used to store the hash value of the identification information of the recommended resources in the second historical time period, the storage space occupied by the identification information in the corresponding identification information set or the filter is reduced; the identification information set can be used to deduplicate the identification information corresponding to the encoding information stored therein, thereby achieving accurate deduplication of the recommended resources in the first historical time period; and the deduplication of the recommended resources in the second historical time period by the filter can achieve erroneous deduplication of the recommended resources in the second historical time period; since the second historical time period is earlier than the first historical time period, the identification information set and the filter can respectively achieve deduplication of recommended resources in different periods with different precisions, thereby avoiding recommending duplicate resources to users and avoiding recently generated resources from being mistaken for recommended resources, so that recently generated resources can be recommended to each account as much as possible, thereby improving users' creative enthusiasm.

[0076] At the same time, through the deduplication method combining the identification information set and the filter, the identification information of the resources stored in the filter is reduced. Therefore, under the condition of a certain misjudgment rate, the accuracy of the filter in deduplicating resources can be improved; and because the filter in the present disclosure stores the hash value of the identification information of the recommended resources, the hash value occupies a small storage space, so the deduplication of the recommended resources in the second historical time period can be achieved through one filter. Compared with the prior art of filtering the recommended resources through multiple filters connected in series, the efficiency of deduplication of recommended resources is improved.

[0077] In one practicable manner, combining Figure 2 ,like Figure 3 As shown, after S11, the above method further includes S12b.

[0078] S12b: When identification information of a candidate resource is stored in the identification information set, the electronic device determines that the candidate resource is not a recommended resource for the target account.

[0079] As a possible implementation, when identification information of a candidate resource is stored in the identification information set, it can be determined that the electronic device has recommended the corresponding candidate resource to the target account. In this case, the candidate resource may no longer be used as a recommended resource for the target account.

[0080] The technical solution provided by the above-mentioned embodiments has at least the following beneficial effects: In the present disclosure, the identification information set stores the coding information of the identification information of the recommended resources in the first historical time period. When deduplication of resources is realized through the identification information set, all the candidate resources corresponding to the coding information stored therein can be deduplicated, that is, accurate deduplication of a specific time period is realized, duplicate resources are avoided to be recommended to users, and the accuracy of deduplication of candidate resources is improved.

[0081] In one practicable manner, combining Figure 3 ,like Figure 4 As shown, after S12, the above method further includes S13b.

[0082] S13b: When the identification information of the candidate resource is less than the minimum value of the filter, the electronic device determines that the candidate resource is not a recommended resource for the target account.

[0083] As a possible implementation method, when the identification information of a candidate resource is less than the minimum value of the filter, it can be determined that the candidate resource is a resource newly added to the social platform before the second historical time period, and the resource is too old. At this time, the electronic device no longer recommends these resources to the target account, that is, the candidate resource is no longer used as a recommended resource for the target account.

[0084] The present disclosure actually divides the resources generated in the electronic device into three parts. For example, the first part may be the resources generated in the first historical time period mentioned above, the second part may be the resources generated in the second historical time period, and the third part may be the resources generated before the second historical time period. Based on the above steps S12b and S13b, accurate deduplication of the first part of resources and the third part of resources can be achieved, and based on the above steps S13 and S14, deduplication of the second part of resources with errors can be achieved.

[0085] The technical solution provided by the above-mentioned embodiments has at least the following beneficial effects: in the present disclosure, a minimum value of identification information is set in the filter, and when the identification information of the candidate resource is greater than or equal to the minimum value, the candidate resource can be deduplicated, thereby reducing the identification information of the resource stored in the filter. Therefore, under the condition of a certain misjudgment rate, the accuracy of the filter in deduplicating resources can be improved; and when the identification information of the candidate resource is less than the minimum value, the corresponding candidate resource will no longer be determined as a recommended resource and recommended to the target account, and accurate deduplication of candidate resources whose identification information is less than the minimum value can also be achieved.

[0086] In one practicable manner, combining Figure 4 ,like Figure 5 As shown, before S11, the above method also includes S21-S23.

[0087] S21. The electronic device obtains first identification information of a first resource recommended to a target account within a first historical time period.

[0088] S22. The electronic device performs differential encoding on the first identification information of the first resource to obtain encoding information of the first resource.

[0089] S23. The electronic device determines a set of encoding information of the first resource as an identification information set.

[0090] As a possible implementation, since the present disclosure stores the identification information of resources that have been recently recommended by the electronic device to the target account in the identification information set to achieve deduplication of recommendations for these resources, before using the resource processing method provided by the present disclosure, it is necessary to preset the corresponding identification information set in the electronic device, that is, to obtain the first identification information of the first resource that has been recommended by the electronic device to the target account in the first historical time period.

[0091] After the first identification information of the first resource is obtained, the encoding information of the first resources can be determined by differential encoding, and the encoding information is combined into an identification information set.

[0092] Exemplarily, if the first resource includes the first resource one, the first resource two, the first resource three and the first resource four, and the first identification information of the first resource one is A, the first identification information of the first resource two is B, the first identification information of the first resource three is C, the first identification information of the first resource four is D, and the first resource one is the first identification information in the identification information set, then the coding information stored in the identification information set of these first resources can be A, BA, CB and DC. Of course, when the identification information set includes more first identification information, the corresponding coding information can also be stored according to the same method. Here A, B, C, and D can be eight-bit numbers. In differential coding storage, the first identification information in the identification information set is complete, such as A; and the storage of other identification information is the corresponding coding information, such as BA, CB, etc. Compared with the identification information, the coding information occupies less storage space.

[0093] The technical solution provided by the above-mentioned embodiments has at least the following beneficial effects: in the present disclosure, the identification information set stores the encoding information of the identification information corresponding to the recommended resources within the first historical time period. Since when the candidate resources are deduplicated through the identification information set, all the resources including the encoding information corresponding to the identification information can be deduplicated, thereby achieving accurate deduplication of a specific time period; and the identification information of the recommended resources is stored in the identification information set in a differentially coded manner. Since the storage space occupied by the differentially coded information is smaller than that of the original identification information, when the identification information of the recommended resources is stored in a differentially coded manner here, the storage space occupied by these resources can be reduced.

[0094] In some embodiments, corresponding to the setting of the above-mentioned identification information set, after the electronic device obtains the identification information of the candidate resource, it can match it with the coding information in the identification information set. If the identification information of the candidate resource can be determined based on the coding information in the identification information set, it can be determined that the identification information set stores the identification information of the candidate resource.

[0095] Exemplarily, if the identification information of the candidate resource is D', and the coded information in the identification information set is A, B, C, D, E..., then when A+B+C=D' or A+B+C+D=D', it can be determined that the identification information set stores the identification information of the candidate resource.

[0096] In one practicable manner, combining Figure 5 ,like Figure 6 As shown, before S11, the above method also includes S24-S26.

[0097] S24. The electronic device obtains second identification information of a second resource that has been recommended to the target account within a second historical time period.

[0098] S25. The electronic device determines a hash value of the second identification information of the second resource.

[0099] S26. The electronic device stores the hash value in the filter.

[0100] As a possible implementation method, corresponding to the identification information set, the identification information stored in the filter also needs to be preset by the electronic device. The difference is that here the electronic device obtains the second identification information of the second resource that has been recommended to the target account within the second historical time period.

[0101] After determining the second identification information corresponding to the second resource, the hash values ​​corresponding to the second identification information can be determined, and the hash values ​​can be stored in the filter. Since the storage space occupied by the hash value is smaller, when storing the identification information of the second historical time period, one filter can be used to reduce the number of filters. When the false positive rate of the filter is constant, the present disclosure can reduce the false positive rate and improve the deduplication efficiency when using a filter to deduplicate the identification information of the second historical time period. In the present disclosure, the false positive of the filter refers to determining a candidate resource that has not been recommended as a candidate resource that has been recommended.

[0102] The technical solution provided by the above-mentioned embodiment has at least the following beneficial effects: in the present disclosure, the filter stores the hash value of the identification information corresponding to the recommended resources in the second historical time period. When the candidate resources in the second historical time period are deduplicated through the filter, the candidate resources in a specific time period with errors can be deduplicated; and because the filter stores the hash value of the identification information of the resource, the storage space occupied when storing the identification information can be reduced, thereby reducing the storage space occupied by the identification information of the recommended resources and reducing the number of filters; at the same time, due to the reduction in the number of filters, the misjudgment rate of filtering the identification information in the second historical time period can be reduced, thereby improving the deduplication efficiency.

[0103] In a possible implementation, the filter in the present disclosure may store any one of the two hash values ​​corresponding to the second identification information. Figure 6 ,like Figure 7 As shown, the above S25 may specifically include S251-S252.

[0104] S251. The electronic device determines a first hash value according to a hash algorithm and second identification information.

[0105] S252: The electronic device determines a second hash value according to the hash algorithm and the first target hash value.

[0106] As a possible implementation manner, the first hash value may be determined according to the following formula:

[0107] p1 = hash(key).

[0108] Among them, p1 is the first hash value, hash is a hash algorithm, such as a message digest algorithm, and key is the second identification information.

[0109]

[0110] Among them, p2 is the second hash value, and f(key) is the fingerprint corresponding to the second identification information.

[0111] At this time, the above S26 may be that the electronic device stores the first hash value or the second hash value in the filter.

[0112] In one practicable manner, combining Figure 7 ,like Figure 8 As shown, S13 specifically includes S131-S133.

[0113] S131. The electronic device determines a target hash value of identification information of a candidate resource.

[0114] S132: When the target hash value is stored in the filter, the electronic device determines that identification information of the candidate resource is stored in the filter.

[0115] S133: When the target hash value is not stored in the filter, the electronic device determines that the filter does not store identification information of the candidate resource.

[0116] As a possible implementation manner, the target hash value may be determined by calculating identification information of the candidate resource using a hash algorithm.

[0117] When the filter can query that it stores the target hash value, it can be determined that the filter has stored the identification information of the candidate resource; otherwise, it is determined that the filter does not store the identification information of the candidate resource. The hash algorithm used to determine the target hash value in S131 is the same as the hash algorithm used in S251.

[0118] The technical solution provided by the above embodiment has at least the following beneficial effects: the target hash value of the identification information of the disclosed candidate resources determines whether the filter stores the identification information of the candidate resources, which can increase the security performance of information in the electronic device; correspondingly, it also reduces the storage space that may be occupied by these identification information.

[0119] In one practicable manner, combining Figure 8 ,like Fig. 9 As shown, S131 specifically includes S1311-S1312.

[0120] S1311. The electronic device determines a first target hash value according to a hash algorithm and identification information of a candidate resource.

[0121] S1312: The electronic device determines a second target hash value according to the hash algorithm and the first target hash value.

[0122] As a possible implementation method, the above S1311-S1312 can refer to S241-S242, which will not be repeated here.

[0123] In one practicable manner, combining Fig. 9 The above step S132 may specifically be: when the first target hash value or the second target hash value is stored in the filter, determining that identification information of the candidate resource is stored in the filter.

[0124] It should be noted that the filter in the present disclosure may be a cuckoo filter. Since the information stored in the cuckoo filter occupies less storage space in the case of a low false positive rate, it is possible to avoid the situation where the information in the Bloom filter occupies a large space, resulting in the need to connect multiple Bloom filters in series, thereby avoiding an increase in the false positive rate.

[0125] The technical solution provided by the above-mentioned embodiment has at least the following beneficial effects: the filter of the present disclosure stores the first target hash value or the second target hash value to avoid the identification information of the recommended resources having no corresponding storage location in the filter, and provides a flexible storage method. Therefore, a flexible query method can also be provided here to ensure that when the filter stores the identification information of the candidate resource, it can be queried according to the first target hash value or the second target hash value to avoid errors. At the same time, since the present disclosure only sets one filter, compared with the prior art of deduplicating recommended resources through multiple filters connected in series, the efficiency of deduplicating recommended resources is improved.

[0126] Fig.10 is a schematic diagram showing the structure of a resource processing device according to an exemplary embodiment. Fig.10 As shown, the account identification device 30 includes an acquisition unit 301 , a judgment unit 302 , a recommendation unit 303 , an encoding unit 304 and a filter unit 305 .

[0127] The acquisition unit 301 is used to acquire identification information of a candidate resource; according to the generation time of the candidate resource, the identification information corresponding to the candidate resource is incremented. For example, the acquisition unit 301 may execute the above S11.

[0128] The judgment unit 302 is used to compare the identification information of the candidate resource obtained by the acquisition unit 301 with the minimum value of the identification information corresponding to the hash value in the filter when the identification information set does not store the identification information of the candidate resource; the identification information set stores the encoding information of the first resource recommended for the target account in the first historical time period, and the filter stores the hash value of the second resource recommended for the target account in the second historical time period, and the hash value corresponds to the identification information of the second resource; the second historical time period is earlier than the first historical time period. For example, the judgment unit 302 can execute the above S12.

[0129] The judgment unit 302 is further used to determine whether the identification information of the candidate resource is stored in the filter when the identification information of the candidate resource is greater than or equal to the minimum value of the identification information corresponding to the hash value in the filter; for example, the judgment unit 302 can execute the above S13.

[0130] The recommendation unit 303 determines that the candidate resource is not a recommended resource for the target account when the determination unit 302 determines that the identification information of the candidate resource is stored in the filter. For example, the recommendation unit 303 may execute the above S14.

[0131] Optionally, the recommendation unit 303 is further configured to determine that the candidate resource is not a recommended resource for the target account when the determination unit 302 determines that the identification information set contains identification information of the candidate resource. For example, the recommendation unit 303 may execute the above S12b.

[0132] Optionally, the recommendation unit 303 is further configured to determine that the candidate resource is not a recommended resource for the target account when the judgment unit determines that the identification information of the candidate resource is less than the minimum value of the identification information corresponding to the hash value in the filter. For example, the recommendation unit 303 may execute the above S13b.

[0133] Optionally, the acquisition unit 301 is further configured to acquire first identification information of a first resource that has been recommended to the target account in the first historical time period. For example, the acquisition unit 301 may execute the above S21.

[0134] The encoding unit 304 is configured to perform differential encoding on the first identification information of the first resource acquired by the acquiring unit 301 to obtain encoding information of the first resource. For example, the encoding unit 304 may execute the above S22.

[0135] The encoding unit is further configured to determine a set of encoding information of the first resource as an identification information set. For example, the encoding unit 304 may execute the above S23.

[0136] Optionally, the acquisition unit 301 is further configured to acquire second identification information of a second resource recommended to the target account in a second historical time period. For example, the acquisition unit 301 may execute the above S24.

[0137] The filter unit 305 is used to determine the hash value of the second identification information of the second resource obtained by the obtaining unit 301, and store the hash value in the filter. For example, the filter unit 305 can execute the above S25-S26.

[0138] Optionally, the filter unit 305 is further configured to determine a target hash value of the identification information of the candidate resource. For example, the filter unit 305 may execute the above S131.

[0139] The judgment unit 302 is further configured to determine whether identification information of a candidate resource is stored in the filter when the filter stores the target hash value determined by the filter unit 305. For example, the judgment unit 302 may execute the above S132.

[0140] The judgment unit 302 is further configured to determine that the filter does not store the identification information of the candidate resource when the filter does not store the target hash value determined by the filter unit 305. For example, the judgment unit 302 may execute the above S133.

[0141] Optionally, the filter unit 305 is specifically configured to: determine a first target hash value according to the hash algorithm and the identification information of the candidate resource; and determine a second target hash value according to the hash algorithm and the first target hash value. For example, the filter unit 305 may execute the above S1311-S1312.

[0142] Optionally, the judging unit 302 is specifically configured to: when the first target hash value or the second target hash value is stored in the filter, determine whether identification information of the candidate resource is stored in the filter. For example, the judging unit 302 may specifically execute the above S132.

[0143] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0144] Fig.11 4 is a schematic diagram of the structure of an electronic device 40 provided by the present disclosure. Figure 6 The electronic device 40 may include at least one processor 401 and a memory 403 for storing instructions executable by the processor 401. The processor 401 is configured to execute the instructions in the memory 403 to implement the resource processing method in the above embodiment. Fig.10 The functions implemented by the acquisition unit 301, the judgment unit 302, the recommendation unit 303, the encoding unit 304 and the filter unit 305 in the resource processing device are similar to those Fig.11 The function of processor 401 in is the same.

[0145] In addition, the electronic device 40 may further include a communication bus 402 and at least one communication interface 404 .

[0146] Processor 401 may be a GPU, a microprocessing unit, an ASIC, or one or more integrated circuits for controlling the execution of the program of the disclosed solution.

[0147] Communication bus 402 may include a pathway for transmitting information between the above-mentioned components.

[0148] The communication interface 404 uses any transceiver or other device for communicating with other devices or communication networks, such as Ethernet, radio access network (RAN), wireless local area networks (WLAN), etc.

[0149] The memory 403 may be a read-only memory (ROM) or other types of static storage devices that can store static information and instructions, a random access memory (RAM) or other types of dynamic storage devices that can store information and instructions, or an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compressed optical disc, laser disc, optical disc, digital versatile disc, Blu-ray disc, etc.), a magnetic disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store the desired program code in the form of an instruction or data structure and can be accessed by a computer, but is not limited thereto. The memory may exist independently and be connected to the processing unit via a bus. The memory may also be integrated with the processing unit and be a volatile storage medium in the GPU.

[0150] The memory 403 is used to store instructions for executing the solution of the present disclosure, and the execution is controlled by the processor 401. The processor 401 is used to execute the instructions stored in the memory 403, so as to realize the functions in the method of the present disclosure.

[0151] In a specific implementation, as an embodiment, the processor 401 may include one or more GPUs, such as Fig.11 GPU0 and GPU1 in .

[0152] In a specific implementation, as an embodiment, the electronic device 40 may include multiple processors, such as Fig.11 401 and processor 407 in FIG. Each of these processors may be a single-core (single-CPU) processor or a multi-core (multi-GPU) processor. A processor herein may refer to one or more devices, circuits, and / or processing cores for processing data (e.g., computer program instructions).

[0153] In a specific implementation, as an embodiment, the electronic device 40 may further include an output device 405 and an input device 406. The output device 405 communicates with the processor 401 and may display information in a variety of ways. For example, the output device 405 may be a liquid crystal display (LCD), a light emitting diode (LED) display device, a cathode ray tube (CRT) display device, or a projector. The input device 406 communicates with the processor 401 and may receive user input in a variety of ways. For example, the input device 406 may be a mouse, a keyboard, a touch screen device, or a sensor device.

[0154] Those skilled in the art will understand that Fig.11 The structure shown in the figure does not constitute a limitation on the electronic device 40, and may include more or less components than those shown in the figure, or combine some components, or adopt a different component arrangement.

[0155] In addition, the present disclosure also provides a computer-readable storage medium, which includes instructions. When the instructions are executed by a processor of an electronic device, the electronic device executes the resource processing method provided in the above embodiment.

[0156] In addition, the present disclosure also provides a computer program product, which includes instructions. When the instructions are executed on a processor of an electronic device, the electronic device executes the resource processing method provided in the above embodiments.

[0157] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The specification and examples are intended to be exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0158] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A resource processing method, characterized in that: include: Obtain identification information of a candidate resource; according to the generation time of the candidate resource, the identification information corresponding to the candidate resource is incremented; In the case where the identification information of the candidate resource is not stored in the identification information set, the identification information of the candidate resource is compared with the minimum value of the identification information corresponding to the hash value in the filter; the identification information set stores the encoding information of the first resource recommended for the target account in the first historical time period, the identification information set stores the complete information of the first bit of identification information, and it is determined whether the identification information of the candidate resource is stored in the identification information set according to the first bit of identification information and the encoding information, the filter stores the hash value of the second resource recommended for the target account in the second historical time period, and the hash value corresponds to the identification information of the second resource; the second historical time period is earlier than the first historical time period; In a case where the identification information of the candidate resource is greater than or equal to the minimum value of the identification information corresponding to the hash value in the filter, determining whether the identification information of the candidate resource is stored in the filter; In a case where the identification information of the candidate resource is stored in the filter, it is determined that the candidate resource is not used as a recommended resource for the target account.

2. The resource processing method according to claim 1, characterized in that: After obtaining the identification information of the candidate resource, the method further includes: In a case where the identification information of the candidate resource is stored in the identification information set, it is determined that the candidate resource is not used as a recommended resource for the target account.

3. The resource processing method according to claim 2, characterized in that: The method further comprises: When the identification information of the candidate resource is smaller than the minimum value of the identification information corresponding to the hash value in the filter, it is determined that the candidate resource is not used as a recommended resource for the target account.

4. The resource processing method according to claim 1, characterized in that: Before obtaining the identification information of the candidate resource, the method further includes: Acquire first identification information of a first resource recommended to the target account within the first historical time period; Performing differential encoding on the first identification information of the first resource to obtain encoding information of the first resource; A set consisting of the encoding information of the first resource is determined as the identification information set.

5. The resource processing method according to claim 1, characterized in that: Before obtaining the identification information of the candidate resource, the method further includes: Acquire second identification information of a second resource recommended to the target account within the second historical time period; A hash value of the second identification information of the second resource is determined, and the hash value is stored in the filter.

6. The resource processing method according to claim 5, characterized in that: The determining whether the identification information of the candidate resource is stored in the filter includes: Determining a target hash value of the identification information of the candidate resource; In a case where the target hash value is stored in the filter, determining that identification information of the candidate resource is stored in the filter; In a case where the target hash value is not stored in the filter, it is determined that the filter does not store identification information of the candidate resource.

7. The resource processing method according to claim 6, characterized in that: The determining of a target hash value of the identification information of the candidate resource includes: Determine a first target hash value according to a hash algorithm and identification information of the candidate resource; A second target hash value is determined according to the hash algorithm and the first target hash value.

8. The resource processing method according to claim 7, characterized in that: In a case where the target hash value is stored in the filter, determining that identification information of the candidate resource is stored in the filter includes: In a case where the first target hash value or the second target hash value is stored in the filter, it is determined that identification information of the candidate resource is stored in the filter.

9. A resource processing device, characterized in that: include: An acquisition unit, used to acquire identification information of candidate resources; According to the generation time of the candidate resource, the identification information corresponding to the candidate resource is incremented; a judgment unit, configured to compare the identification information of the candidate resource obtained by the obtaining unit with the minimum value of the identification information corresponding to the hash value in the filter when the identification information of the candidate resource is not stored in the identification information set; the identification information set stores the coding information of the first resource recommended to the target account in the first historical time period, the identification information set stores the complete information of the first bit of identification information, and determines whether the identification information of the candidate resource is stored in the identification information set according to the first bit of identification information and the coding information; the filter stores the hash value of the second resource recommended to the target account in the second historical time period, and the hash value corresponds to the identification information of the second resource; the second historical time period is earlier than the first historical time period; a judgment unit, configured to determine whether the identification information of the candidate resource is stored in the filter if the identification information of the candidate resource is greater than or equal to a minimum value of the identification information corresponding to the hash value in the filter; The recommendation unit determines that the candidate resource is not a recommended resource for the target account when the judgment unit determines that the identification information of the candidate resource is stored in the filter.

10. The resource processing device according to claim 9, characterized in that: The recommendation unit is further configured to determine that the candidate resource is not a recommended resource for the target account when the judgment unit determines that the identification information set stores the identification information of the candidate resource.

11. The resource processing device according to claim 9, characterized in that: The recommendation unit is further configured to determine that the candidate resource is not a recommended resource for the target account if the judgment unit determines that the identification information of the candidate resource is less than a minimum value of the identification information corresponding to the hash value in the filter.

12. The resource processing device according to claim 9, characterized in that: The device also includes an encoding unit; The acquisition unit is further configured to acquire first identification information of a first resource recommended to the target account within the first historical time period; The encoding unit is configured to perform differential encoding on the first identification information of the first resource acquired by the acquiring unit to obtain encoding information of the first resource; The encoding unit is further used to determine a set consisting of encoding information of the first resource as the identification information set.

13. The resource processing device according to claim 9, characterized in that: The device also includes a filter unit; The acquisition unit is further configured to acquire second identification information of a second resource recommended to the target account within the second historical time period; The filter unit is used to determine a hash value of the second identification information of the second resource acquired by the acquisition unit, and store the hash value in the filter.

14. The resource processing device according to claim 13, characterized in that: The filter unit is further used to determine a target hash value of the identification information of the candidate resource; The judgment unit is further configured to determine that identification information of the candidate resource is stored in the filter when the target hash value determined by the filter unit is stored in the filter; The judgment unit is further configured to determine that the filter does not store the identification information of the candidate resource when the target hash value determined by the filter unit is not stored in the filter.

15. The resource processing device according to claim 14, characterized in that: The filter unit is specifically used for: Determine a first target hash value according to a hash algorithm and identification information of the candidate resource; A second target hash value is determined according to the hash algorithm and the first target hash value.

16. The resource processing device according to claim 15, characterized in that: The judging unit is specifically used for: In a case where the first target hash value or the second target hash value is stored in the filter, it is determined that identification information of the candidate resource is stored in the filter.

17. An electronic device, characterized in that: include: processor; a memory for storing instructions executable by the processor; The processor is configured to execute the instructions to implement the resource processing method according to any one of claims 1 to 8.

18. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes instructions; when the instructions are executed by a processor of an electronic device, the electronic device executes the resource processing method as described in any one of claims 1 to 8.

19. A computer program product, characterized in that The computer program product comprises instructions, and when the instructions are executed on a processor of an electronic device, the electronic device executes the resource processing method according to any one of claims 1 to 8.

Images