Method, device, electronic device and storage medium for sending page data

Abstract

The present invention discloses a method, device, electronic device and storage medium for sending page data, and relates to the field of computer technology. A specific implementation of the method includes: dividing the page content into page modules according to the attributes of the page content to be sent; calculating the weight of each page module according to the size of the page module; determining the module group corresponding to the page to be sent in sequence according to the weight of each page module; sending a page request according to the module group, each page request includes a page module included in the module group. This implementation can solve the problem that when the size of the request data is determined according to the grouping cardinality, it is easy to have an unsaturated request, thereby causing a waste of network resources.

Description

Technical Field

[0001] The present invention relates to the field of computer technology, and in particular to a method, device, electronic device and storage medium for sending page data. Background Art

[0002] With the rapid development of technologies such as front-end and back-end separation and big data, a large number of data interaction scenarios will appear between the front-end and the back-end (F2E) and between the back-end and the back-end (E2E). For example, in some page processing scenarios, the front-end needs to send the content of the current page to the back-end so that the back-end can process the content of the page sent by the front-end. However, when the page content is large, multiple requests are usually required to send the content in the page. When the page data is sent through multiple requests, how to reasonably determine the size of the request data so that network resources can be reasonably used becomes an important issue.

[0003] In order to ensure the success rate of the request, the size of the requested data cannot exceed the threshold. Therefore, in the existing method, the grouping cardinality is usually set according to the size of the largest page module. The content of each grouping cardinality page module is sent through one request, that is, to ensure that the size of the request does not exceed the threshold when the grouping cardinality page modules are all the largest modules. In this way, the number of page modules sent for each request can be limited, thereby limiting the size of the request data.

[0004] In the process of implementing the present invention, the inventors found that there are at least the following problems in the prior art:

[0005] Since the size of most page modules is smaller than the maximum page module, and some page modules are much smaller than the maximum page module, determining the size of the request data according to the grouping cardinality may easily lead to unsaturated requests, thereby causing a waste of network resources. Summary of the invention

[0006] In view of this, an embodiment of the present invention provides a method, device, system and storage medium for sending page data, which can solve the problem that when the size of request data is determined according to the packet cardinality, it is easy to have unsaturated requests, thereby causing a waste of network resources.

[0007] To achieve the above objective, according to one aspect of an embodiment of the present invention, a method for sending page data is provided.

[0008] A method for page data in an embodiment of the present invention includes: dividing the page content to be sent into page modules according to the attributes of the page content to be sent; calculating the weight of each of the page modules according to the size of the page modules; determining the module group corresponding to the page to be sent in turn according to the weight of each of the page modules, wherein the sum of the weights of the page modules included in each of the module groups is not greater than a weight threshold, and if, when the module group is determined, the page module includes remaining page modules whose module groups have not been determined, then the sum of the weights of any of the remaining page modules and the weights of the page modules included in the module group is greater than the weight threshold; sending a page request according to the module group, each of the page requests including a page module included in the module group.

[0009] In one embodiment, dividing the page content into page modules according to the attributes of the page content to be sent includes:

[0010] The page content is divided into page modules according to HTML (Hypertext Markup Language) tags and / or functions of the page content.

[0011] In yet another embodiment, calculating the weight of each of the page modules according to the size of the page modules includes:

[0012] For each of the page modules, the original functional content and the additional functional contents corresponding to the page module are determined based on the page content corresponding to the page module, and the weight of the original functional content and the weight of each additional functional content are determined based on the function of the page content included in the page module, and the weight of the page module is calculated based on the weight of the original functional content and the weight of the additional functional content.

[0013] In yet another embodiment, determining in sequence the module group corresponding to the to-be-sent page according to the weight of each of the page modules includes:

[0014] Determine a weight series according to the weight of the page module;

[0015] Selecting a weight group including at least one weight from the weight sequence, so that the sum of the weights in the weight group is not greater than the weight threshold, and the sum of the weights after adding any of the remaining weights that have not been selected to the weight group is greater than the weight threshold, and determining the page modules corresponding to the weights included in the weight group as a module group;

[0016] The remaining weights are updated to the weight sequence, and the weight group is reselected from the updated weight sequence, and the page modules corresponding to the weights included in the reselected weight group are determined as a module group until the updated weight sequence is empty.

[0017] In yet another embodiment, calculating the weight of each of the page modules according to the size of the page modules includes:

[0018] The ratio between the sizes of the page modules is determined as the weight of the page modules.

[0019] To achieve the above objective, according to another aspect of the present invention, a device for page data is provided.

[0020] A device for page data of the present invention comprises: a division unit, used for dividing the page content to be sent into page modules according to the attributes of the page content to be sent; a calculation unit, used for calculating the weight of each page module according to the size of the page module; a determination unit, used for determining the module group corresponding to the page to be sent in turn according to the weight of each page module, wherein the sum of the weights of the page modules included in each module group is not greater than a weight threshold, and if, when the module group is determined, the page module includes remaining page modules whose module groups are not determined, then the sum of the weights of any remaining page modules and the weights of the page modules included in the module group is greater than the weight threshold; a sending unit, used for sending a page request according to the module group, each page request including a page module included in the module group.

[0021] In one embodiment, the division unit is specifically used to divide the page content into page modules according to HTML tags and / or functions of the page content.

[0022] In yet another embodiment, the computing unit is specifically configured to:

[0023] For each of the page modules, the original functional content and the additional functional contents corresponding to the page module are determined according to the page content corresponding to the page module, and the weight of the original functional content and the weight of each additional functional content are determined according to the functional type to which the page content corresponding to the page module belongs, and the weight of the page module is calculated according to the weight of the original functional content and the weight of the additional functional content.

[0024] In yet another embodiment, the determining unit is specifically configured to:

[0025] Determine a weight series according to the weight of the page module;

[0026] Selecting a weight group including at least one weight from the weight sequence, so that the sum of the weights in the weight group is not greater than the weight threshold, and the sum of the weights after adding any of the remaining weights that have not been selected to the weight group is greater than the weight threshold, and determining the page modules corresponding to the weights included in the weight group as a module group;

[0027] The remaining weights are updated to the weight sequence, and the weight group is reselected from the updated weight sequence, and the page modules corresponding to the weights included in the reselected weight group are determined as a module group until the updated weight sequence is empty.

[0028] In yet another embodiment, the calculation unit is specifically configured to determine a ratio between sizes of each of the page modules as a weight of each of the page modules.

[0029] To achieve the above objective, according to another aspect of an embodiment of the present invention, an electronic device is provided.

[0030] An electronic device according to an embodiment of the present invention includes: one or more processors; a storage device for storing one or more programs, when the one or more programs are executed by the one or more processors, the one or more processors implement the method of page data provided by the embodiment of the present invention.

[0031] To achieve the above objective, according to another aspect of an embodiment of the present invention, a computer readable medium is provided.

[0032] A computer-readable medium according to an embodiment of the present invention stores a computer program, and when the program is executed by a processor, the method for processing page data provided by the embodiment of the present invention is implemented.

[0033] An embodiment of the above invention has the following advantages or beneficial effects: In the embodiment of the present invention, for the page content to be sent, it can be divided into multiple page modules according to its attributes, and then the weight of each page module is calculated according to the size of the page module, and then according to the weight of the page module, the module group is determined in turn, so that the page request is sent based on the module group. Since in the embodiment of the present invention, the sum of the weights of the page modules in the module group is not greater than the weight threshold, it is ensured that the sum of the sizes of the page modules included in the module group will not exceed the threshold; and in the embodiment of the present invention, the module groups are determined sequentially. After determining the page modules included in a module group, if the page modules also include remaining page modules whose module groups have not been determined, then the sum of the weights of any remaining page modules and the weights of the page modules included in the module group is greater than the weight threshold, that is, the sum of the weights after adding any remaining page modules to the module group will be greater than the weight threshold, thereby ensuring that the weights of the page modules included in the module group are as close to the weight threshold as possible, that is, ensuring that the size of the page modules included in the module group is as close to the threshold as possible, thereby achieving the size of the page modules included in the module group as close to the threshold as possible, so that when the page request is sent, the request data carried is as close to the threshold as possible, avoiding the problem of unsaturated request data due to too small request data of the page request, resulting in waste of network resources.

[0034] The further effects of the above-mentioned non-conventional optional manner will be described below in conjunction with the specific implementation manner. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] The accompanying drawings are used to better understand the present invention and do not constitute an improper limitation of the present invention.

[0036] Figure 1 is a schematic diagram of a main process of a method for sending page data according to an embodiment of the present invention;

[0037] Figure 2 is a schematic diagram of a DIV box in a page according to an embodiment of the present invention;

[0038] Figure 3 is a schematic diagram of request data including a page module according to an embodiment of the present invention;

[0039] Figure 4 is a schematic diagram of a main process of a method for determining a module group according to an embodiment of the present invention;

[0040] Figure 5 is a schematic diagram of a weight group determined according to an embodiment of the present invention;

[0041] Figure 6 is a schematic diagram comparing a page request sending method according to an embodiment of the present invention with a page request sending method in the prior art;

[0042] Figure 7 is a schematic diagram of main units of a device for sending page data according to an embodiment of the present invention;

[0043] Figure 8 is an exemplary system architecture diagram to which embodiments of the present invention may be applied;

[0044] Fig. 9 It is a schematic diagram of the structure of a computer system suitable for implementing the embodiment of the present invention. DETAILED DESCRIPTION

[0045] The following is a description of exemplary embodiments of the present invention in conjunction with the accompanying drawings, including various details of the embodiments of the present invention to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be recognized by those of ordinary skill in the art that various changes and modifications may be made to the embodiments described herein without departing from the scope and spirit of the present invention. Similarly, for clarity and conciseness, the description of well-known functions and structures is omitted in the following description.

[0046] It should be pointed out that the embodiments of the present invention and the features in the embodiments may be combined with each other if there is no conflict.

[0047] An embodiment of the present invention provides a method for sending page data. The method can be used in a scenario where page data is sent, for example, a scenario where a front end sends page data to a back end server.

[0048] The embodiment of the present invention provides a method for sending page data, which can be set and executed by a terminal, such as Figure 1 As shown, the method includes the following steps.

[0049] S101: Divide the page content into page modules according to the attributes of the page content to be sent.

[0050] In order to facilitate determining that the request data is included in the page request to be sent, the page content to be sent may be divided. In this step, the page content to be sent may be divided into a plurality of page modules.

[0051] In this step, the page modules may be divided according to the attributes of the page content. Specifically, the page content may be divided into page modules according to the HTML tags and / or functions of the page content.

[0052] In one implementation of the embodiment of the present invention, this step may be performed by dividing the page content into page modules according to HTML tags of the page content.

[0053] Web pages are usually composed of DIV (DIVision, positioning technology in cascading style sheets) boxes, which can be as follows Figure 2 The DIV box in the page attributes is embodied by HTML tags, so the attributes of the content in the page will include different HTML tags, so in the embodiment of the present invention, the page modules can be divided according to the HTML tags of the page content.

[0054] It should be noted that the HTML tags of the page content are either nested or on a par with each other. Figure 2 As shown, the page contents between DIV box 2 and DIV box 6 do not overlap, indicating that DIV box 2 and DIV box 6 are at the same level, so the HTML tags of DIV box 2 and the HTML tags of DIV box 6 are at the same level. Figure 2 As shown, DIV box 6 includes the page content of DIV box 7, which means that DIV box 6 and DIV box 7 are nested with each other, so the HTML tag of DIV box 6 and the HTML tag of DIV box 7 are in a nested relationship. For the nested DIV boxes, in the embodiment of the present invention, they can be regarded as a whole, that is, the HTML tag of the DIV box with the largest page content range can be used to divide the page module. Figure 2As shown, DIV box 6 includes DIV box 7 and DIV box 8, wherein DIV box 6 includes the largest range of page content, so the page module is divided by the HTML tag of DIV box 6. In the embodiment of the present invention, the DIV boxes corresponding to the page content to be sent can be marked by preset identifiers to determine which are the page content to be sent.

[0055] In another implementation manner of the embodiment of the present invention, this step may be performed by dividing the page content into page modules according to the functions of the page content.

[0056] Since the functions of the content in the page are usually different, the modules can be divided according to the different functions of the page content in this step. For example, the functions of the page content may include: product recommendation, coupons, hot pictures, etc. Therefore, according to these functions, the page content can be divided into a product recommendation module, a coupon module, a hot picture module, etc.

[0057] It should be noted that some pages may include multiple contents corresponding to a certain function, so after dividing the page modules in this step, there may be multiple page modules corresponding to one function.

[0058] S102: Calculate the weight of each page module according to the size of the page module.

[0059] Among them, after dividing the page content into page modules in the embodiment of the present invention, the size of the page module can be determined according to the page content corresponding to each page module, and then the weight of each page module can be calculated according to the size of each page module.

[0060] In this step, the ratio between the sizes of the page modules can be determined as the weight of each page module. That is, after the size of each page module is determined, the ratio is directly calculated to serve as the weight of each page module.

[0061] Specifically, after the size of each page module is determined, the common divisor of the size of each page module may be calculated first, and then the weight of each page module may be calculated according to the size of the page module and the common divisor.

[0062] In the embodiment of the present invention, the weight of each page module is calculated in order to group the page modules. Since the size of the page modules is usually large, the weight of each page module is calculated first, and then the page modules are grouped based on the weight, thereby simplifying the calculation process.

[0063] For the method of dividing the page module by HTML tags, in the embodiment of the present invention, all the contents of the page module can be directly obtained by the JS method (html method), and then the size of the page module can be directly obtained by the size method. For example, for DIV box 6, the complete contents of DIV box 6 (including DIV box 7 and DIV box 8) can be obtained by "$(DIV box 6).html()", and then the size can be directly obtained by the size method.

[0064] In another implementation of the embodiment of the present invention, the original functional content and the additional functional content can be divided according to the function of the page content. The original functional content represents the most original content of the page, and the additional functional content represents the function realized by adding content on the basis of the original functional content, such as price display, main picture display, item display, etc., and the size of the original functional content and each additional functional content is fixed. Therefore, this step can first determine the weight of each function corresponding to the original functional content and the weight of each additional functional content, and then determine the weight of the page module through the original functional content and additional functional content included in the page module.

[0065] Taking the division of page modules according to the functions of the page content in step S101, the functions of the page content include product recommendations, coupons, and picture hot spots as an example. First, the size of the original function content included in each function and the size of the different additional function contents can be determined, and then the common divisor of the size of the original function content corresponding to each function is selected, thereby determining the weight of each function corresponding to the original function content, and then calculating the weight of each function corresponding to the different additional function contents based on the determined common divisor. Specifically, the result can be shown in Table 1.

[0066] Table 1

[0067]

[0068] As shown in Table 1, the original function content of the product recommendation function is large, the original function content of the coupon function is second, and the original function content of the picture hot zone function is the smallest, that is, the weight of the original function content corresponding to the product recommendation function is 5, the weight of the original function content corresponding to the coupon function is 3, and the weight of the original function content corresponding to the picture hot zone function is 1. The corresponding weights of different additional content functions are shown in Table 1.

[0069] After the weights shown in Table 1 are determined through the above process, the weight of each page module can be determined based on the content included in the area.

[0070] Specifically, for each page module, the method for determining the weight of the page module can be performed as follows: according to the page content corresponding to the page module, determine the original functional content and each additional functional content corresponding to the page module, and according to the function of the page content included in the page module, determine the weight of the original functional content and the weight of each additional functional content, and calculate the weight of the page module based on the weight of the original functional content and the weight of the additional functional content.

[0071] For example, the page module is a product recommendation module, corresponding to the product recommendation function, which includes the original functional content and additional functional content corresponding to the product recommendation, and the additional functional content is taken as price display and main picture display as examples. Then, according to the function of the page content included in the page module, that is, the product recommendation function, the weight of the original functional content is 5, and the weight of the additional functional content is 2, that is, the sum of the weight of the price display and the weight of the main picture display. 1. The weight of the page module can be determined by adding the weight of the original functional content 5 and the weight of the additional functional content 1.

[0072] It should be noted that for the same function, such as product recommendation, it may include multiple page modules, that is, multiple page modules realize the function of product recommendation, and these page modules all include original functional content and additional functional content. At this time, if the page content corresponding to a function is grouped as a whole, the sum of the weights of the page modules included in the function can be determined as the weight of the page content corresponding to the function, and then this weight is given to perform the subsequent process of determining the module group. If the page content corresponding to a function is taken as a whole, the weight of the whole can be calculated by ∑w=N(W1+W2+…+Wn), where ∑w represents the overall weight of the page content corresponding to a certain function, N represents the number of page modules included in a certain function, W1 represents the weight of the original functional content corresponding to a certain function, W2,…,Wn represent the weight of the additional functional content corresponding to a certain function, and n represents the number of additional functional content corresponding to a certain function.

[0073] It should be noted that, in order to avoid the page content corresponding to a function being too large when the page content corresponding to a function is processed as a whole, or the page content corresponding to a certain function in the page content to be sent corresponds to different items, etc., in the embodiment of the present invention, the page content corresponding to a function can also be divided into different parts, each part can include one or more page modules, and then the weight is calculated by taking each part as a whole, and the calculation method is the same as the weight calculation method when the page content corresponding to a function is a whole. For example, every 20 page modules belonging to various functions can be set as a whole. Taking the product recommendation function as an example, every 20 page modules belonging to the product recommendation function are a whole, and each page module includes all additional functional contents. According to the data in Table 1, it can be calculated that the overall weight corresponding to the product recommendation function is ∑w=20*(5+1+1+0)=140.

[0074] S103: According to the weight of each page module, the module group corresponding to the page to be sent is determined in sequence.

[0075] Among them, the sum of the weights of the page modules included in each module group is not greater than the weight threshold, and if the module group is determined, the page module includes remaining page modules whose module groups have not been determined, then the sum of the weights of any remaining page modules and the weights of the page modules included in the module group is greater than the weight threshold.

[0076] The weight threshold is determined according to the size of the request data that the page request can carry. In the embodiment of the present invention, the maximum value of the request data that the page request can carry can be determined first, and then the maximum value is divided by the common divisor when the page module calculates the weight in step S102, so as to obtain the weight threshold. Therefore, the weight threshold can represent the maximum value of the sum of the weights of the page modules that each page request can carry.

[0077] like Figure 3 , which is a schematic diagram of the page modules included in the page data determined according to the weights of the page modules. Figure 3 In the data, every 20 page modules belonging to various functions are set as a whole. This page data includes 3 functions belonging to the whole of the product recommendation function, one function belonging to the whole of the coupon function and 3 functions belonging to the whole of the picture hot zone function.

[0078] In the embodiment of the present invention, the page module can be divided into module groups according to the weight threshold, so that each module group corresponds to the request data of a page request. The page content to be sent includes multiple page modules, and the weights of each page module are not necessarily the same. Therefore, this step needs to determine the module group corresponding to the page to be sent in turn according to the weight of each page module.

[0079] In order to avoid a decrease in the success rate of page requests due to excessive page data, the sum of the weights of the page modules in the module group should not be greater than the weight threshold. In order to avoid undersaturated page requests and low utilization of network resources due to too small page data, the sum of the weights of the page modules in the module group needs to be as close to the weight threshold as possible.

[0080] Since the module groups in the embodiment of the present invention are determined in sequence, each page module will also determine the module group to which it belongs in sequence, that is, except for the last module group, after the other module groups are determined, there will be page modules whose module groups have not yet been determined, that is, remaining page modules. In order to make the sum of the weights of the page modules in the module group as close to the weight threshold as possible, each module group needs to include as many page modules as possible. Therefore, the embodiment of the present invention is arranged that after the module group is determined, if any remaining page module is added to the module group, the sum of the weights of the page modules in the module group is greater than the weight threshold, that is, if the module group is determined, the page module includes the remaining page modules whose module groups have not been determined, then the sum of the weights of any remaining page modules and the weights of the page modules included in the module group is greater than the weight threshold. When the last module group is determined, the remaining page modules may be insufficient, so it is only necessary to ensure that the sum of the weights of the page modules in the module group is not greater than the weight threshold.

[0081] If, when the module group is determined, the page module includes remaining page modules whose module groups have not been determined, it means that this module group is not the last module group. At this time, if the sum of the weight of any remaining page module and the weight of the page modules included in the module group is not greater than the weight threshold, it means that the remaining page module can still be added to the module group. Only when the sum of the weight of any remaining page module and the weight of the page modules included in the module group is greater than the weight threshold, the sum of the weights of the page modules in the module group is closest to the weight threshold.

[0082] Specifically, the embodiment of the present invention can determine each module group by a cyclic calculation. This step can be performed as follows: determine a weight series according to the weight of the page module; select a weight group including at least one weight from the weight series, so that the sum of the weights in the weight group is not greater than the weight threshold, and if any of the remaining weights that have not been selected is added to the weight group, the sum of the weights is greater than the weight threshold, and the page modules corresponding to the weights included in the weight group are determined as a module group; update the remaining weights to the weight series, and reselect the weight group from the updated weight series, and determine the page modules corresponding to the weights included in the reselected weight group as a module group, until the updated weight series is empty.

[0083] In the embodiment of the present invention, the weights of the modules of each page are grouped into a series, that is, the weight series is determined, and then the module groups are determined in sequence by a cyclic calculation.

[0084] First, a weight group is selected from the weight sequence, the weight group includes at least one weight, the sum of the weights in the weight group is not greater than the weight threshold, and for the remaining weights that have not been selected in the weight sequence, the sum of the weights after adding any remaining weight to the weight group is greater than the weight threshold, so that the weight group can meet the requirements of the weights in the module group, so the page modules corresponding to the weights in the weight group can be determined as a module group, that is, a module group is determined. After a module group is determined, the page modules included in the module group have been determined to belong to the module group, so the weights of the page modules in the weight sequence that have been determined to belong to the module group are deleted to avoid the page modules being repeatedly determined to belong to the module group. After the weights of the page modules that have been determined to belong to the module group in the weight sequence are deleted, the remaining weights are updated to a new weight sequence, and then a weight group including at least one weight can be selected from the new weight sequence again, and the weight group needs to be able to meet the requirements of the weights in the module group, that is, the sum of the weights in the weight group is not greater than the weight threshold, and for the remaining weights that have not been selected in the weight sequence, the sum of the weights after adding any remaining weight to the weight group is greater than the weight threshold. In this way, the page modules corresponding to the weights in the weight group selected again can be determined as another module group, that is, a new module group is determined again. After a module group is determined again, the weights of the page modules that have been determined to belong to the module group in the weight sequence are deleted, and the weight sequence is updated again. Therefore, the above process is executed cyclically until the updated weight sequence is empty, that is, there is no unselected weight in the weight sequence, indicating that all page modules have been determined to belong to the module group, and then the cycle can be ended.

[0085] S104: Sending page requests according to the module groups, each page request including a page module included in the module group.

[0086] After determining each module group, the content corresponding to the page module included in a module group can be determined as the request data of a page request to send a page request, thereby ensuring that the request data of each page request does not exceed the threshold and is as close to the threshold as possible.

[0087] Since in the embodiment of the present invention, the sum of the weights in the module group is not greater than the weight threshold, it is ensured that the sum of the sizes of the page modules included in the module group will not exceed the threshold, and in the embodiment of the present invention, the module groups are determined sequentially. After determining the page modules included in a module group, if the page modules also include remaining page modules whose module groups have not been determined, then the sum of the weights of any remaining page modules and the weights of the page modules included in the module group is greater than the weight threshold, that is, the sum of the weights after adding any remaining page modules to the module group will be greater than the weight threshold, thereby ensuring that the weights of the page modules included in the module group are as close to the weight threshold as possible, that is, ensuring that the size of the page modules included in the module group is as close to the threshold as possible, thereby achieving the size of the page modules included in the module group as close to the threshold as possible, so that when the page request is sent, the request data carried is as close to the threshold as possible, avoiding the problem of unsaturated request data due to too small request data of the page request, resulting in waste of network resources.

[0088] Combine the following Figure 1 The method embodiment shown in the figure specifically describes the method for determining the module group in the embodiment of the present invention. Figure 4 As shown, the method includes the following steps.

[0089] S401: Determine a weight sequence according to the weight of the page module.

[0090] In an embodiment of the present invention, after determining the weight of each page module, the corresponding relationship between the page module and the weight can be stored. Specifically, it can be stored in a key-value manner. For example, the storage method can be {"34456789":70, "34456790":80, "34456791":120, "34456792":30, "34456793":140, "34456794":20, "34456795":60}, wherein key represents the identifier of the page module, such as 34456789, 34456790, etc., and value represents the weight of the page module, such as 70, 80, etc.

[0091] In this step, the weights of the page modules are arranged to determine a weight sequence. The weight arrangement order is not limited in the embodiment of the present invention, for example, the weight values ​​may be arranged in descending order.

[0092] The embodiment of the present invention is described using the weight series: 11, 10, 9, 9, 8, 8, 7, 6, 5, 5, 4, 3, 2, 2, 2, 2, 1, 1, 1 as an example.

[0093] S402: According to the weight order of the weight sequence, determine the first weight as the target weight, and add the target weight to the target weight group.

[0094] In the embodiment of the present invention, the weight group is determined by adding and summing the weights in sequence, and then the module group is determined. Therefore, in this step, the first weight in the weight sequence can be used as the target weight according to the weight order of the weight sequence. In this step, the first weight is selected, and the weight selected later will belong to the same weight group as the first weight. In the embodiment of the present invention, the weight group is represented by the target weight group, so the target weight is first added to the target weight group, and the weight added to the target weight group later will belong to the same weight group as the first weight.

[0095] The embodiment of the present invention is illustrated using the weight series: 11, 10, 9, 9, 8, 8, 7, 6, 5, 5, 4, 3, 2, 2, 2, 2, 1, 1, 1 as an example. At this time, the first weight is 11, and the weight included in the target weight group is 11.

[0096] S403: Determine whether the sum of the weights after adding the weight of the next digit of the target weight to the target weight group is greater than the weight threshold. If so, execute step S405; if not, execute step S404.

[0097] Among them, the sum of the weights in the target weight group needs to be no greater than the weight threshold and as close to the weight threshold as possible, so in the embodiment of the present invention, after the target weight is added to the target weight group, that is, on the basis of the existing weights in the target weight group, the weight arrangement order in the weight series is used to judge whether the sum of the weights in the target weight group is greater than the weight threshold after the next weight is added to the target weight group, that is to say, whether the sum of the weights after adding the weight of the next digit of the target weight to the target weight group is greater than the weight threshold. If the sum of the weights after the weight of the next digit of the target weight in the target weight group is greater than the weight threshold, it means that the target weight group cannot add the weight of the next digit of the target weight to the target weight group; if the sum of the weights after the weight of the next digit of the target weight in the target weight group is not greater than the weight threshold, it means that the target weight group can add the weight of the next digit of the target weight to the target weight group.

[0098] For example, the weight series is: 11, 10, 9, 9, 8, 8, 7, 6, 5, 5, 4, 3, 2, 2, 2, 2, 1, 1, 1. At this time, the target weight is 11, the weight included in the target weight group is 11, and the weight next to the target weight is 10. Assuming the weight threshold is 20, it can be determined that the sum of the weights after adding the weight next to the target weight to the target weight group is greater than the weight threshold.

[0099] S404: Add the weight of the next digit of the target weight to the target weight group.

[0100] After it is determined in step S403 that the sum of the weights after the weight of the next digit of the target weight in the target weight group is added is not greater than the weight threshold, the weight of the next digit of the target weight can be added to the target weight group, indicating that the weight of the next digit of the target weight and the weight in the target weight group can belong to the same weight group, that is, the page module corresponding to the weight of the next digit of the target weight and the page module corresponding to the weight in the target weight group can belong to the same module group.

[0101] It should be noted that, since the maximum value of the sum of weights in the target weight group in the embodiment of the present invention is the weight threshold, when the sum of weights in the target weight group is equal to the weight threshold, no weight can be added to the target weight group, so after executing this step, it is also possible to determine whether the sum of weights in the target weight group is equal to the weight threshold. If the sum of weights in the target weight group is equal to the weight threshold, it means that the sum of weights in the target weight group has reached the maximum value, and it is impossible to add any weights later. At this time, step S407 can be directly executed without executing step S405, thereby simplifying the calculation process; if the sum of weights in the target weight group is not equal to the weight threshold, step S405 needs to be executed.

[0102] For example, the weight sequence is: 11, 10, 9, 9, 8, 8, 7, 6, 5, 5, 4, 3, 2, 2, 2, 2, 1, 1, 1, and the weight threshold is 20. After executing this step, the target weight is the second weight 10, and the weights included in the target weight group are the first weight 11 and the third weight 9. At this time, if it is determined that 11+9 is equal to the weight threshold 20, step 407 can be directly executed without executing step S405.

[0103] S405: Determine whether the weight next to the target weight is the last one in the weight sequence. If so, execute step S407; if not, execute step 406.

[0104] In order to make the sum of the weights in the target weight group as close to the weight threshold as possible, it is necessary to perform the judgment of step S403 on each weight in the weight sequence, so that the sum of the weights in the target weight group is as large as possible without being greater than the weight threshold. Therefore, after executing S403, it is also necessary to judge whether the weight of the next digit of the target weight is the last one in the weight sequence. If the weight of the next digit of the target weight is the last one in the resequence, it means that all the weights in the weight sequence have been judged in step S403, and no more weights can be added to the target weight group. At this time, the page module corresponding to the weight in the target weight group can be determined as a module group; if the weight of the next digit of the target weight is not the last one in the resequence, it means that there are weights in the weight sequence that have not passed the judgment of step S403, and step S406 can be executed at this time.

[0105] S406: Update the weight of the next digit of the target weight to the target weight.

[0106] After determining in step S405 that the weight next to the target weight is not the last one in the heavy sequence, it means that there are weights in the weight sequence that have not passed the judgment of S403. At this time, the weight next to the target weight can be updated to the target weight, and then step S403 is executed to realize the judgment of the weight next to the target weight.

[0107] S407: Determine the page modules corresponding to the weights in the target weight group as a module group, and clear the target weight group.

[0108] After determining in step S405 that the weight of the next bit of the target weight is the last one in the reorder, it means that no more weight can be added to the target weight group. At this time, the weight added to the target weight group has been determined, and this round of circulation ends. Then, the page modules corresponding to the weights in the target weight group can be determined as a module group, that is, the determination process of a module group is completed, and the page modules corresponding to the weights in the target weight group are the page modules included in the module group. Then, the target weight group needs to be cleared to facilitate the execution of the next round of circulation and to re-determine a new module group.

[0109] S408: updating the remaining weights after deleting the weights included in the target weight group in the weight sequence into a new weight sequence.

[0110] After executing step S408, a module group is determined, and the module group to which the page module belongs has been determined. In order to avoid the module group to which the page module belongs being repeatedly determined, the weights included in the target weight group in the weight sequence are deleted in this step. The remaining weights after the deletion can form a new weight sequence, and the new module group is determined by executing the process from step S402 to step S407 again.

[0111] For example, the weight sequence is: 11, 10, 9, 9, 8, 8, 7, 6, 5, 5, 4, 3, 2, 2, 2, 2, 1, 1, 1. As an example, assume that the weight threshold is 20. After determining that the first weight 11 and the third weight 9 are a target weight group through steps S402 to S407, the first weight 11 and the third weight 9 can be deleted from the original weight sequence in this step. The remaining weights are: 10, 9, 8, 8, 7, 6, 5, 5, 4, 3, 2, 2, 2, 2, 1, 1, 1, and the remaining weights are updated to a new weight sequence.

[0112] S409: Determine whether the new weight sequence includes weights. If so, execute step S402; if not, end the process.

[0113] After the weight sequence is updated in step S408, it is necessary to check whether the updated weight sequence is empty. If so, it means that the weights in the weight sequence have been grouped, that is, the module groups to which the page modules belong have been determined, and the process can be ended; if not, it means that there are still ungrouped weights in the weight sequence, that is, there are still page modules that have not been determined to which module groups they belong, and step S402 needs to be executed again.

[0114] The embodiment of the present invention takes the weight sequence of 11, 10, 9, 9, 8, 8, 7, 6, 5, 5, 4, 3, 2, 2, 2, 2, 1, 1, 1 as an example for explanation, and sets the weight threshold to 20. After executing the embodiment of the present invention, the result obtained can be as follows: Figure 5 As shown, the target weight groups determined in sequence are: [11,9], [10,9,1], [8,8,4], [7,6,5,2], [5,3,2,2,2,1,1].

[0115] In the embodiment of the present invention, by cyclically calculating the target weight group, the weight in the target weight group is made not greater than the weight threshold and is as close to the weight threshold as possible, thereby achieving that the sum of the weights in the determined module group is not greater than the weight threshold, and ensuring that the weights of the page modules included in the module group are as close to the weight threshold as possible, that is, ensuring that the size of the page modules included in the module group is as close to the threshold as possible, thereby achieving that the size of the page modules included in the module group is as close to the threshold as possible, so that when the page request is sent, the request data carried is as close to the threshold as possible, avoiding the problem of unsaturated request data due to too small request data of the page request, resulting in waste of network resources.

[0116] Figure 6 FIG. 2 is a schematic diagram showing a comparison between the method of sending a page request in an embodiment of the present invention and the method of sending a page request in the prior art. Figure 6 As shown, the current technology network occupancy is the way of sending page requests in the prior art, and the optimized network occupancy is the way of sending page requests in the embodiment of the present invention. Figure 6As shown, the prior art limits the maximum number of modules for each page request. Since the number of modules is limited, most of the request data of the page request has not reached the saturation state. This method wastes a lot of network resources. In the embodiment of the present invention, the number of page modules in the page data is determined according to the size of the page content corresponding to the page module. For page modules with large page content, the number of modules in the request data is less, and for modules with small page content, the number of modules in the request data is more, so that except for the request data of the last page request, which may be unsaturated, the other request data are nearly saturated, so the utilization rate of network resources is improved. And if the number of page modules for each request data increases on average, the number of concurrent page requests will decrease, so the pressure on the server is also relieved.

[0117] In order to solve the problems existing in the prior art, an embodiment of the present invention provides a device 700 for sending page data, such as Figure 7 As shown, the device 700 includes:

[0118] The division unit 701 is used to divide the page content into page modules according to the attributes of the page content to be sent;

[0119] A calculation unit 702, configured to calculate the weight of each of the page modules according to the size of the page modules;

[0120] A determination unit 703 is used to determine the module group corresponding to the to-be-sent page in sequence according to the weight of each of the page modules, wherein the sum of the weights of the page modules included in each of the module groups is not greater than a weight threshold, and if, when the module group is determined, the page modules include remaining page modules whose module groups have not been determined, then the sum of the weights of any of the remaining page modules and the weights of the page modules included in the module group is greater than the weight threshold;

[0121] The sending unit 704 is used to send a page request according to the module group, each of the page requests includes a page module included in the module group.

[0122] It should be understood that the manner of implementing the embodiments of the present invention is different from the Figure 1 The method of the illustrated embodiment is the same and will not be repeated here.

[0123] In an implementation of the embodiment of the present invention, the division unit 701 is specifically configured to divide the page content into page modules according to HTML tags and / or functions of the page content.

[0124] In another implementation of the embodiment of the present invention, the calculation unit 702 is specifically configured to:

[0125] For each of the page modules, the original functional content and the additional functional contents corresponding to the page module are determined according to the page content corresponding to the page module, and the weight of the original functional content and the weight of each additional functional content are determined according to the functional type to which the page content corresponding to the page module belongs, and the weight of the page module is calculated according to the weight of the original functional content and the weight of the additional functional content.

[0126] In another implementation of the embodiment of the present invention, the determining unit 703 is specifically configured to:

[0127] Determine a weight series according to the weight of the page module;

[0128] Selecting a weight group including at least one weight from the weight sequence, so that the sum of the weights in the weight group is not greater than the weight threshold, and the sum of the weights after adding any of the remaining weights that have not been selected to the weight group is greater than the weight threshold, and determining the page modules corresponding to the weights included in the weight group as a module group;

[0129] The remaining weights are updated to the weight sequence, and the weight group is reselected from the updated weight sequence, and the page modules corresponding to the weights included in the reselected weight group are determined as a module group until the updated weight sequence is empty.

[0130] In another implementation of the embodiment of the present invention, the calculation unit 702 is specifically configured to determine the ratio between the sizes of the page modules as the weight of the page modules.

[0131] It should be understood that the manner of implementing the embodiments of the present invention is different from the Figure 1 or Figure 2 The method of the illustrated embodiment is the same and will not be repeated here.

[0132] In an embodiment of the present invention, the page content to be sent can be first divided into multiple page modules according to its attributes, and then the weight of each page module is calculated according to the size of the page module, and then the module groups are determined in turn according to the weights of the page modules, so that the page request is sent based on the module groups. Since in the embodiment of the present invention, the sum of the weights in the module group is not greater than the weight threshold, it is ensured that the sum of the sizes of the page modules included in the module group will not exceed the threshold, and in the embodiment of the present invention, the module groups are determined sequentially. After determining the page modules included in a module group, if the page modules also include remaining page modules whose module groups have not been determined, then the sum of the weights of any remaining page modules and the weights of the page modules included in the module group is greater than the weight threshold, that is, the sum of the weights after adding any remaining page modules to the module group will be greater than the weight threshold, thereby ensuring that the weights of the page modules included in the module group are as close to the weight threshold as possible, that is, ensuring that the size of the page modules included in the module group is as close to the threshold as possible, thereby achieving the size of the page modules included in the module group as close to the threshold as possible, so that when the page request is sent, the request data carried is as close to the threshold as possible, avoiding the problem of unsaturated request data due to too small request data of the page request, resulting in waste of network resources.

[0133] According to an embodiment of the present invention, the present invention also provides an electronic device and a readable storage medium.

[0134] The electronic device of the present invention comprises: at least one processor; and a memory connected to the at least one processor in communication; wherein the memory stores instructions executable by the one processor, and the instructions are executed by the at least one processor so that the at least one processor executes the method for sending page data provided in an embodiment of the present invention.

[0135] Figure 8 An exemplary system architecture 800 is shown to which the method for sending page data or the apparatus for sending page data according to the embodiment of the present invention can be applied.

[0136] like Figure 8 As shown, system architecture 800 may include terminal devices 801, 802, 803, a network 804, and a server 805. Network 804 is used to provide a medium for communication links between terminal devices 801, 802, 803 and server 805. Network 804 may include various connection types, such as wired, wireless communication links, or optical fiber cables, etc.

[0137] Users can use terminal devices 801, 802, and 803 to interact with server 805 through network 804 to receive or send messages, etc. Various communication client applications can be installed on terminal devices 801, 802, and 803, such as shopping applications, web browser applications, search applications, instant messaging tools, email clients, social platform software, etc. (only examples).

[0138] The terminal devices 801 , 802 , and 803 may be various electronic devices having a display screen and supporting web browsing, including but not limited to smart phones, tablet computers, laptop computers, desktop computers, and the like.

[0139] The server 805 may be a server that provides various services, such as a backend management server (only an example) that provides support for shopping websites browsed by users using the terminal devices 801, 802, and 803. The backend management server may analyze and process the received data such as product information query requests, and feed back the processing results (such as product information - only an example) to the terminal device.

[0140] It should be noted that the method for sending page data provided in the embodiment of the present invention is generally executed by the server 805 , and accordingly, the device for sending page data is generally disposed in the server 805 .

[0141] It should be understood that Figure 8 The number of terminal devices, networks and servers in the embodiment is only for illustration. Any number of terminal devices, networks and servers may be provided according to implementation requirements.

[0142] Reference below Fig. 9 , which shows a schematic diagram of the structure of a computer system 900 suitable for implementing an embodiment of the present invention. Fig. 9 The computer system shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

[0143] like Fig. 9 As shown, the computer system 900 includes a central processing unit (CPU) 901, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 902 or a program loaded from a storage part 908 into a random access memory (RAM) 903. In the RAM 903, various programs and data required for the operation of the system 900 are also stored. The CPU 901, the ROM 902, and the RAM 903 are connected to each other via a bus 904. An input / output (I / O) interface 905 is also connected to the bus 904.

[0144] The following components are connected to the I / O interface 905: an input section 906 including a keyboard, a mouse, etc.; an output section 907 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 908 including a hard disk, etc.; and a communication section 909 including a network interface card such as a LAN card, a modem, etc. The communication section 909 performs communication processing via a network such as the Internet. A drive 910 is also connected to the I / O interface 905 as needed. A removable medium 911, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 910 as needed, so that a computer program read therefrom is installed into the storage section 908 as needed.

[0145] In particular, according to the embodiments disclosed in the present invention, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present invention include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 909, and / or installed from the removable medium 911. When the computer program is executed by the central processing unit (CPU) 901, the above-mentioned functions defined in the system of the present invention are executed.

[0146] It should be noted that the computer-readable medium shown in the present invention may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present invention, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device. In the present invention, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. This propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than computer-readable storage media, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, optical cable, RF, etc., or any suitable combination of the above.

[0147] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present invention. In this regard, each box in the flow chart or block diagram can represent a unit, a program segment, or a part of a code, and the above-mentioned unit, program segment, or a part of a code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flow chart, and the combination of the boxes in the block diagram or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0148] The units involved in the embodiments of the present invention may be implemented by software or hardware. The units described may also be set in a processor, for example, it may be described as: a processor includes a division unit, a calculation unit, a determination unit, and a sending unit. The names of these units do not constitute a limitation on the units themselves in some cases, for example, the division unit may also be described as a "unit of the function of the division unit".

[0149] As another aspect, the present invention further provides a computer-readable medium, which may be included in the device described in the above embodiment; or may exist independently without being assembled into the device. The above computer-readable medium carries one or more programs, and when the above one or more programs are executed by a device, the device executes the method for sending page data provided by the present invention.

[0150] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may occur depending on design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A method for sending page data, characterized in that: include: Dividing the page content into page modules according to the attributes of the page content to be sent; According to the size of the page module, the weight of each page module is calculated, wherein all the contents of the page module are directly obtained through the JS method, and then the size of the page module is obtained through the size method; According to the weight of each of the page modules, the page modules are divided into module groups, and the module groups corresponding to the to-be-sent pages are determined in sequence, wherein the sum of the weights of the page modules included in each of the module groups is not greater than a weight threshold, and if, when the module group is determined, the page modules include remaining page modules whose module groups have not been determined, then the sum of the weights of any of the remaining page modules and the weights of the page modules included in the module group is greater than the weight threshold; Sending a page request according to the module group, each of the page requests including a page module included in the module group; The step of dividing the page content into page modules according to the attributes of the page content to be sent includes: The page content is divided into page modules according to HTML tags and / or functions of the page content.

2. The method according to claim 1, characterized in that Calculating the weight of each of the page modules according to the size of the page modules includes: For each of the page modules, the original functional content and the additional functional contents corresponding to the page module are determined based on the page content corresponding to the page module, and the weight of the original functional content and the weight of each additional functional content are determined based on the function of the page content included in the page module, and the weight of the page module is calculated based on the weight of the original functional content and the weight of the additional functional content.

3. The method according to claim 1, characterized in that The step of sequentially determining the module group corresponding to the page to be sent according to the weight of each of the page modules includes: Determine a weight series according to the weight of the page module; Selecting a weight group including at least one weight from the weight sequence, so that the sum of the weights in the weight group is not greater than the weight threshold, and the sum of the weights after adding any of the remaining weights that have not been selected to the weight group is greater than the weight threshold, and determining the page modules corresponding to the weights included in the weight group as a module group; The remaining weights are updated to the weight sequence, and the weight group is reselected from the updated weight sequence, and the page modules corresponding to the weights included in the reselected weight group are determined as a module group until the updated weight sequence is empty.

4. The method according to claim 1, characterized in that: Calculating the weight of each of the page modules according to the size of the page modules includes: The ratio between the sizes of the page modules is determined as the weight of the page modules.

5. A device for sending page data, characterized in that: include: A division unit, used for dividing the page content into page modules according to the attributes of the page content to be sent; A calculation unit, used for calculating the weight of each of the page modules according to the size of the page modules, wherein all the contents of the page modules are directly obtained through the JS method, and then the size of the page module is obtained through the size method; A determination unit, configured to divide the page modules into module groups according to the weight of each of the page modules, and determine the module groups corresponding to the to-be-sent pages in sequence, wherein the sum of the weights of the page modules included in each of the module groups is not greater than a weight threshold, and if, when the module group is determined, the page modules include remaining page modules whose module groups have not been determined, then the sum of the weights of any of the remaining page modules and the weights of the page modules included in the module group is greater than the weight threshold; A sending unit, used for sending a page request according to the module group, each of the page requests including a page module included in the module group; The division unit is specifically used to divide the page content into page modules according to the HTML tags and / or functions of the page content.

6. The device according to claim 5, characterized in that The computing unit is specifically used for: For each of the page modules, the original functional content and the additional functional contents corresponding to the page module are determined according to the page content corresponding to the page module, and the weight of the original functional content and the weight of each additional functional content are determined according to the functional type to which the page content corresponding to the page module belongs, and the weight of the page module is calculated according to the weight of the original functional content and the weight of the additional functional content.

7. An electronic device, characterized in that: include: one or more processors; a storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 4.

8. A computer readable medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method according to any one of claims 1 to 4 is implemented.

Images