Garbage disposal method and device, electronic equipment, storage medium and program product

Abstract

The invention discloses a garbage treatment method and device, electronic equipment, a storage medium and a program product, and relates to the technical field of smart home. The method comprises the following steps: firstly, acquiring a user throwing sequence for throwing garbage uploaded by a garbage can terminal; according to the user putting sequence, processing preference information of the user for the target garbage category is determined; and generating a processing optimization scheme associated with the user delivery sequence under the condition that the processing preference information meets the processing optimization condition. And finally, issuing the processing optimization scheme to the user terminal, and displaying the processing optimization scheme. Therefore, accurate garbage classification can be performed through image recognition, and a corresponding processing optimization scheme can be provided for the user under the condition that excessive garbage generated by the user is analyzed.

Description

Technical Field

[0001] The present invention relates to the field of smart home technology, and in particular to a garbage disposal method, device, electronic equipment, storage medium and program product. Background Art

[0002] With the acceleration of urbanization, people's living standards and consumption levels are gradually improving, and the amount of domestic waste generated by households is also increasing.

[0003] In daily life, users usually place domestic waste in the same trash can, lack the management and classification of domestic waste, and lack analysis of the causes of excessive domestic waste, resulting in unnecessary waste generation due to living consumption habits, reducing the efficiency of waste classification and treatment and the environmental protection factor. Summary of the invention

[0004] In view of the technical problems that the current garbage classification is inaccurate and there is a lack of analysis of the factors causing excessive garbage generation, which reduces the garbage treatment efficiency and environmental protection factor, the present invention is proposed to provide a garbage treatment method, device, electronic device, storage medium and program product that overcome the above problems or at least partially solve the above problems.

[0005] Based on the first aspect of the present invention, a garbage processing method is provided, which is applied to a server, and the method comprises:

[0006] Obtaining a user placement sequence of garbage uploaded by the garbage bin terminal, wherein the user placement sequence is determined by the garbage bin terminal according to the garbage placement time, garbage category and garbage weight, and the garbage category is obtained by identifying the first garbage image according to a preset garbage classification model;

[0007] Determining the user's processing preference information for the target garbage category based on the user delivery sequence;

[0008] When the processing preference information meets the processing optimization condition, generating a processing optimization plan associated with the user delivery sequence;

[0009] The processing optimization plan is sent to the user terminal and displayed.

[0010] In an optional invention, the step of determining the user's processing preference information for the target garbage category based on the user delivery sequence includes:

[0011] Filtering out multiple user delivery records corresponding to the target garbage category from the user delivery sequence;

[0012] According to the plurality of user delivery records, the user's processing preference information for the target garbage category is determined.

[0013] In an optional invention, the step of determining the user's processing preference information for the target garbage category based on the plurality of user delivery records includes:

[0014] Determining the frequency of delivery of the target garbage category according to the delivery time in the plurality of user delivery records;

[0015] Determining the cumulative weight of garbage of the target garbage category according to the weights of garbage in the plurality of user garbage placement records;

[0016] According to at least one of the delivery frequency, the cumulative delivery weight and the delivery time, the user's processing preference information for the target garbage category is generated.

[0017] An optional invention content, when the target garbage category is abnormal discarded objects, determining that the processing preference information meets the processing optimization condition includes:

[0018] If the frequency of abnormal discarded objects is greater than or equal to the first frequency, or the cumulative weight of abnormal discarded objects is greater than or equal to the first weight, it is determined that the processing preference information meets the processing optimization condition.

[0019] In an optional aspect of the invention, the abnormal discards include at least one of the following: food and harmful substances.

[0020] An optional invention content, in the case where the abnormal discarded objects include food, the generating of the processing optimization scheme associated with the user delivery sequence includes:

[0021] Acquire expiration warning information of the refrigerator terminal, wherein the expiration warning information at least includes food type and expiration time;

[0022] Determining the frequency of users discarding expired food based on the target time interval between the delivery time and the expiration time of the food and the delivery weight;

[0023] When it is determined that the frequency of users discarding expired food is greater than or equal to the second frequency, determining an ingredient purchase suggestion and / or an ingredient usage suggestion corresponding to the expired food;

[0024] The food purchase suggestion and / or food usage suggestion is used as a processing optimization solution associated with the user delivery sequence.

[0025] In an optional embodiment of the invention, the method further comprises:

[0026] When it is determined that the frequency of users discarding expired food is less than the second frequency, matching corresponding food cooking suggestions and / or food preservation suggestions;

[0027] The ingredient cooking suggestion and / or ingredient storage suggestion is used as a processing optimization solution associated with the user delivery sequence.

[0028] Based on the second aspect of the present invention, a garbage disposal method is also provided, which is applied to a garbage bin terminal, and the method comprises:

[0029] Acquire a first garbage image captured by a built-in camera device and a garbage weight detected by a weight sensor;

[0030] Inputting the first garbage image into a preset garbage classification model for identification to obtain a corresponding garbage category;

[0031] Generate user placement records based on placement time, garbage category and garbage weight;

[0032] Generate a user delivery sequence based on multiple user delivery records within a preset time period;

[0033] The user delivery sequence is uploaded to the server, so that the server determines the user's processing preference information for the target garbage category based on the user delivery sequence, and generates a processing optimization plan associated with the user delivery sequence when the processing preference information meets the processing optimization conditions, and the server sends the processing optimization plan to the user terminal for display.

[0034] An optional invention content is to input the first garbage image into a preset garbage classification model for identification to obtain a corresponding garbage category, including:

[0035] Calculating image similarity between the first garbage image and cluster center images associated with a plurality of garbage categories;

[0036] The garbage category corresponding to the cluster center image with the highest image similarity is determined as the garbage category of the garbage in the first garbage image.

[0037] In an optional embodiment of the invention, the method further comprises:

[0038] Providing an interactive interface, and displaying the identified garbage categories on the interactive interface;

[0039] Based on an editing operation on a category determination control associated with the displayed garbage category, the garbage category is updated.

[0040] In an optional embodiment of the invention, the method further comprises:

[0041] Acquire a second garbage image captured by an external camera device;

[0042] Identify the second junk image to obtain a junk category corresponding to the second junk image;

[0043] An interactive interface is provided, and the identified garbage categories are displayed in the interactive interface to remind users to classify and dispose of the garbage.

[0044] Based on the third aspect of the present invention, a garbage disposal device is also provided, which is applied to a server, and the device comprises:

[0045] A sequence acquisition module is used to acquire a user placement sequence of garbage uploaded by a garbage bin terminal, wherein the user placement sequence is determined by the garbage bin terminal according to the garbage placement time, garbage category and garbage weight, and the garbage category is obtained by identifying the first garbage image according to a preset garbage classification model;

[0046] A processing preference determination module, used to determine the user's processing preference information for the target garbage category based on the user's delivery sequence;

[0047] An optimization scheme determination module, configured to generate a processing optimization scheme associated with the user delivery sequence when the processing preference information meets the processing optimization condition;

[0048] The solution sending module is used to send the processing optimization solution to the user terminal and display it.

[0049] Based on the fourth aspect of the present invention, there is also provided a garbage disposal device, which is applied to a garbage bin terminal, and the device comprises:

[0050] A data acquisition module, used to acquire a first garbage image taken by a built-in camera device and a garbage weight detected by a weight sensor;

[0051] A category recognition module, used for inputting the first garbage image into a preset garbage classification model for recognition to obtain a corresponding garbage category;

[0052] A record determination module is used to generate user placement records based on placement time, garbage category and garbage weight;

[0053] A sequence generation module, used to generate a user delivery sequence based on multiple user delivery records within a preset time period;

[0054] The sequence uploading module is used to upload the user delivery sequence to the server, so that the server can determine the user's processing preference information for the target garbage category based on the user delivery sequence, and generate a processing optimization plan associated with the user delivery sequence when the processing preference information meets the processing optimization conditions, and the server can send the processing optimization plan to the user terminal for display.

[0055] According to a fifth aspect of the present invention, there is also provided an electronic device, comprising:

[0056] one or more processors;

[0057] Memory;

[0058] One or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs are configured to execute any of the methods described in the above invention.

[0059] Based on the sixth aspect of the present invention, a computer-readable storage medium is also provided, which stores a computer program used in conjunction with an electronic device, characterized in that the computer program can be executed by a processor to perform any of the methods described in the above invention content.

[0060] Based on the seventh aspect of the present invention, a computer program product is also provided, including a computer program / computer executable instructions, characterized in that the computer program / computer executable instructions, when executed by a processor in an electronic device, implements any method described in the above invention contents.

[0061] Compared with the prior art, the present invention includes first obtaining the user placement sequence of garbage uploaded by the garbage bin terminal, wherein the user placement sequence is determined by the garbage bin terminal based on the garbage placement time, garbage category and garbage weight, and the garbage category is obtained by identifying the first garbage image based on a preset garbage classification model. Then, based on the user placement sequence, the user's processing preference information for the target garbage category is determined. And when the processing preference information meets the processing optimization conditions, a processing optimization plan associated with the user placement sequence is generated. Finally, the processing optimization plan is sent to the user terminal and displayed. Therefore, accurate garbage classification can be performed through image recognition, and when it is analyzed that the user generates excessive garbage, the corresponding processing optimization plan can be determined. Improve garbage disposal efficiency, environmental protection coefficient and user experience.

[0062] The above description is only an overview of the technical solution of the present invention. In order to more clearly understand the technical means of the present invention, it can be implemented according to the contents of the specification. In order to make the above and other purposes, features and advantages of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0063] By reading the detailed description of the preferred embodiment below, various other advantages and benefits will become clear to those of ordinary skill in the art. The accompanying drawings are only used for the purpose of illustrating the preferred embodiment and are not considered to be limitations of the present invention. In addition, the same reference symbols are used to represent the same components throughout the accompanying drawings.

[0064] In the attached picture:

[0065] Figure 1 It is a schematic diagram of the steps of a garbage disposal method provided by an embodiment of the present invention;

[0066] Figure 2 is a schematic diagram of the steps of another garbage disposal method provided by an embodiment of the present invention;

[0067] Figure 3 This is a schematic diagram of the steps of another garbage disposal method provided by an embodiment of the present invention;

[0068] Figure 4 It is a structural block diagram of a garbage disposal device provided by an embodiment of the present invention.

[0069] Figure 5 is a structural block diagram of another garbage disposal device provided by an embodiment of the present invention; DETAILED DESCRIPTION

[0070] The exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. Although the exemplary embodiments of the present invention are shown in the accompanying drawings, it should be understood that the present invention can be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided in order to enable a more thorough understanding of the present invention and to enable the scope of the present invention to be fully communicated to those skilled in the art.

[0071] With the acceleration of urbanization, people's living standards and consumption levels are gradually improving, and the amount of domestic waste generated by households is also increasing.

[0072] In daily life, users usually place domestic waste in the same trash can, lack the management and classification of domestic waste, and lack analysis of the causes of excessive domestic waste, resulting in unnecessary waste generation due to living consumption habits, reducing the efficiency of waste classification and the environmental protection factor.

[0073] Reference Figure 1 , shows a garbage disposal method provided by an embodiment of the present invention, which is applied to a server, and the method may include:

[0074] S101. Obtain a user placement sequence of garbage uploaded by a garbage bin terminal, wherein the user placement sequence includes placement time, garbage category, and garbage weight.

[0075] In an embodiment of the present invention, when a user puts garbage into a trash can, a built-in camera installed inside the trash can can capture a first image of the garbage put in by the user, and a weight sensor can detect a change in the total weight of the garbage in the trash can, wherein the changed weight value is the weight of the garbage put in by the current user. The built-in camera can be a miniature camera, which is installed on the top of the trash can or on the inner wall of the trash can to capture the first image of the garbage. The weight sensor is installed at the bottom of the trash can to measure the total weight of the garbage stored in the trash can. The weight of the garbage can can also be used to assist in the classification of the put garbage.

[0076] When obtaining the total weight of the garbage, the garbage bin terminal can determine the weight of the garbage placed by the user based on the difference between the total weight of the garbage detected this time and the total weight of the garbage detected last time.

[0077] After acquiring the first garbage image, the first garbage image is input into a preset garbage classification model for identification to obtain the corresponding garbage category. For example, for daily home scenes, the corresponding garbage categories may include but are not limited to plastic, metal, paper, food, etc. Among them, food can be understood as organic waste generated in household kitchen activities, including but not limited to: expired food, food residues left over during consumption, and remaining parts generated when the kitchen processes food ingredients, such as fruit peels, vegetable roots, stems, etc.

[0078] After determining the category of garbage placed by the user, a user placement record can be generated according to the current garbage placement time, garbage category and garbage weight, and the user placement record can be stored locally, so as to obtain multiple user placement records within a preset time period, generate a user placement sequence according to the time sequence, and upload it to the server. In some embodiments, the preset time period can be a time period such as one day, one week and one month, and the preset time period is not limited too much.

[0079] S102: Determine the user's processing preference information for the target garbage category based on the user delivery sequence.

[0080] In an embodiment of the present invention, when the server obtains the user placement sequence uploaded by the trash bin terminal, the server can analyze the user placement sequence. For example, the cumulative weight of garbage generated by the user within a preset time period and the weight of classified garbage corresponding to different garbage categories can be analyzed. Thus, the user's processing preference information for garbage of the target garbage category within the preset time period can be obtained. The processing preference information can be used to characterize the garbage placement habits formed by the user for the target garbage category within the preset time period. It can include the user's placement time distribution, placement frequency and cumulative placement weight of garbage of the target garbage category.

[0081] S103: When the processing preference information meets the processing optimization conditions, generate a processing optimization solution associated with the user delivery sequence.

[0082] In the embodiment of the present invention, the processing optimization condition refers to the relevant conditions for determining the user's garbage disposal habits, whether there is excessive and / or wrong disposal. The processing optimization condition can be pre-set according to the target garbage category. The target garbage category can be determined based on the abnormal discarded objects set during garbage classification. The abnormal discarded objects can include food and / or harmful substances, etc.

[0083] In some embodiments, when the target garbage category is food, determining the processing optimization condition associated with the food may include: the frequency of food (abnormal discarded objects) being placed is greater than or equal to a first frequency, or the cumulative weight of food (abnormal discarded objects) being placed is greater than or equal to a first weight. The first frequency and the first weight may be determined based on actual test results, and are not limited here.

[0084] In other embodiments, when the target garbage category is hazardous materials, determining the processing optimization conditions associated with the hazardous materials may include: determining the presence of hazardous materials (abnormally discarded objects) being placed.

[0085] When the processing preference information does not meet the processing optimization conditions, it can be determined that the user has not placed any harmful substances, or the amount of food waste generated is within a normal range, and the frequency of placement is also within a normal range.

[0086] In the case where the processing preference information meets the processing optimization conditions, it can be determined that the amount of abnormal discarded objects currently generated by the user is within a large range, and the frequency of delivery is also high. It can be determined that the user has generated a large number of abnormal discarded objects within a preset time period. Thus, a processing optimization plan associated with the user's delivery sequence can be generated. The processing optimization plan includes a related plan to reduce the amount of garbage generated in the target garbage category, which can be determined based on the user's processing preference information for garbage.

[0087] Alternatively, if the processing preference information meets the processing optimization conditions, it can be determined that the user has currently placed harmful substances in the trash can, and thus a processing optimization plan associated with the user's placement sequence can be generated. For example, the processing optimization plan may include a plan for additional processing of harmful substances. For example, when the harmful substances are objects such as batteries, the processing optimization plan may be to remind the user to pack the batteries and send them to a unified placement area for harmful substances.

[0088] S104: Send the processing optimization solution to the user terminal and display it.

[0089] In an embodiment of the present invention, after determining the processing optimization plan, the server can send the processing optimization plan to the user terminal and display it. After the user receives the processing optimization plan based on the user terminal, the user can reasonably handle the abnormal abandoned objects according to the processing optimization plan. For example, by guiding the user to reduce the amount of abnormal abandoned objects or to place them correctly, it is convenient for faster classification of garbage and subsequent unified processing of garbage. And thereby improve the user's environmental protection coefficient and user experience.

[0090] Reference Figure 2 , shows another garbage disposal method provided by an embodiment of the present invention, the method may include:

[0091] S201. Obtain a user placement sequence of garbage uploaded by a garbage bin terminal, wherein the user placement sequence includes placement time, garbage category, and garbage weight.

[0092] In the embodiment of the present invention, the description of step S201 refers to the description of step S101 described above.

[0093] S202: Filter out a plurality of user delivery records corresponding to a target garbage category from the user delivery sequence.

[0094] In an embodiment of the present invention, when analyzing the user's processing preference information corresponding to a certain target garbage category, multiple user placement records corresponding to the target garbage category can be pre-screened from the user placement sequence, so as to obtain multiple sample records of the processing preference information corresponding to the target garbage category. The target garbage category can be determined based on the abnormal discarded objects set during garbage classification. For example, the abnormal discarded objects can include food and / or harmful substances, etc., and correspondingly, the target garbage category can include food and / or harmful substances. In other embodiments, the target garbage category can also be a subcategory further subdivided from the food category. Or it can be a subcategory further subdivided from the harmful substance category.

[0095] S203: Determine the frequency of delivery of the target garbage category according to the delivery time in the plurality of user delivery records.

[0096] S204: Determine the cumulative weight of garbage of the target garbage category according to the weights in the plurality of user placement records.

[0097] S205: Generate user processing preference information for the target garbage category based on at least one of the delivery frequency, the cumulative delivery weight, and the delivery time.

[0098] In an embodiment of the present invention, the user's processing preference information for the target garbage category can be determined based on the plurality of user placement records, wherein the processing preference information can be used to characterize the garbage placement habits formed by the user for the target garbage category within a preset time period.

[0099] In some optional implementations, the frequency of garbage placement of the target garbage category can be determined based on the placement time in multiple user placement records. For example, the frequency of food placement by users is 60 times in one month. And the cumulative weight of garbage placed in the target garbage category can be determined based on the placement weight in multiple user placement records. For example, the cumulative weight of food placed by users in one month is 35kg. The time distribution of garbage placement of the target garbage category by users can also be determined based on the placement time in multiple user placement records. For example, on working days (Monday to Friday) in a month, users place garbage between 8 and 9 in the morning and between 7 and 11 in the evening.

[0100] Thus, the user's processing preference information for the target garbage category can be generated based on at least one of the delivery frequency, the cumulative delivery weight, and the delivery time.

[0101] S206: Determine whether the processing preference information meets the processing optimization condition.

[0102] In an embodiment of the present invention, the processing optimization condition refers to the relevant conditions for determining the user's garbage placement habits, whether there is excessive placement and / or wrong placement. The processing optimization condition can be pre-set according to the target garbage category. In some embodiments, when the target garbage category is food, determining the processing optimization condition associated with the food may include: the frequency of food placement is greater than or equal to the first frequency, or the cumulative weight of food placed is greater than or equal to the first weight. Among them, the first frequency and the first weight can be determined according to actual test results, and no excessive restrictions are made here.

[0103] In other embodiments, when the target garbage category is hazardous materials, determining the processing optimization conditions associated with the hazardous materials may include: determining the presence of hazardous materials (abnormally discarded objects) being placed.

[0104] When the processing preference information does not meet the processing optimization conditions, it can be determined that the user has not placed harmful substances, or the amount of food waste generated is within a normal range, and the frequency of placement is also within a normal range.

[0105] When the processing preference information meets the processing optimization conditions, it can be determined that the amount of abnormal discards currently generated by the user is within a large range and the frequency of placement is also high. It can be determined that the user has generated excessive amounts of target waste categories within a preset time period.

[0106] Alternatively, when the processing preference information meets the processing optimization conditions, it can be determined that the user currently puts harmful substances into the trash can, and then when the processing optimization conditions are met, the following step S207 is executed.

[0107] S207: Generate a processing optimization solution associated with the user delivery sequence.

[0108] In an embodiment of the present invention, when it is determined that a user has generated excessive food waste within a preset time period, a processing optimization plan associated with the user's delivery sequence can be generated. The processing optimization plan includes a plan related to reducing food waste, which can be determined based on the user's garbage processing preference information.

[0109] In other embodiments, when U determines that the user has currently placed harmful substances into the trash can, a treatment optimization plan associated with the user's placement sequence may be generated. For example, the treatment optimization plan may include a plan for additional treatment of harmful substances. For example, when the harmful substances are objects such as batteries, the treatment optimization plan may be to remind the user to pack the batteries and send them to a unified placement area for harmful substances.

[0110] When the processing preference information meets the processing optimization condition, the server can also obtain the expiration warning information of the refrigerator terminal, wherein the expiration warning information at least includes the food type and expiration time. And according to the target time interval between the delivery time and the expiration time of the food, and the delivery weight, the frequency of the user discarding expired food is determined.

[0111] In some optional embodiments, the refrigerator terminal can obtain the information by scanning the barcode on the food packaging through a scanner when the food is placed in the refrigerator. This method is suitable for barcodes that include information such as food production date and shelf life. Alternatively, a radio frequency reader is used to scan food with radio frequency tags, etc., or the refrigerator terminal can provide a display interface, so that when the user puts food into the refrigerator, the food type, food production date and food shelf life can be obtained by editing the food information input control on the display interface, so that the expiration time of the current food can be calculated based on the food production date and food shelf life. This method is suitable for ingredients that do not have standard packaging, such as vegetables and fruits.

[0112] Alternatively, by establishing a communication connection between the refrigerator terminal and the user terminal, the food type and expiration time can be obtained based on the food type, food production date and food shelf life sent to the refrigerator terminal by the user terminal. Alternatively, by using a camera device configured inside the refrigerator, food images are captured and image recognition is performed to determine the type of food. The method for identifying the type of food can refer to the method for identifying the type of garbage. Therefore, based on the type of food, the shelf life in the database that is consistent with the type of food can be matched.

[0113] When the refrigerator terminal determines that the time interval between the current time and the expiration time is less than or equal to the preset time interval, it can generate expiration warning information based on the type of food and the expiration time, and upload it to the server. After obtaining the expiration warning information, the server determines the frequency of users discarding expired food based on the target time interval between the delivery time of the food and the expiration time, and the delivery weight.

[0114] For example, the target time interval may be within 24 hours, and the delivered weight matches the preset food weight of the corresponding food type. Matching can be understood as the weight difference between the delivered weight and the preset food weight is within the preset difference range. Thus, it can be determined whether the user discards expired food based on the comprehensive analysis of the expiration warning information and the user behavior sequence.

[0115] In some optional implementations, when it is determined that the frequency of the user discarding expired food is greater than or equal to the second frequency, the ingredient purchase suggestion and / or ingredient use suggestion corresponding to the expired food are determined. The ingredient purchase suggestion and / or ingredient use suggestion are used as the processing optimization scheme associated with the user delivery sequence. Among them, the second frequency can be determined according to the actual test results, for example, the second frequency can be 5 times, 8 times and 10 times. Therefore, the ingredient purchase suggestion can be determined according to the food type of the discarded expired food. Or the ingredient use suggestion can be determined according to the food type. Or the ingredient purchase suggestion and ingredient use suggestion can be determined according to the food type. For example, in the case where the food type of the discarded expired food is apples, the ingredient purchase suggestion can be: it is recommended to reduce the purchase amount of apples. For example, in the case where the food type of the discarded expired food is potatoes, the ingredient purchase suggestion can be: it is recommended to reduce the purchase amount of potatoes. And the corresponding ingredient use suggestion can include different potato cooking methods. Therefore, the user can be guided to reduce the purchase of expired food through the ingredient purchase suggestion. The user is guided to increase the consumption of food that is easy to expire in the future through the food use suggestion.

[0116] At least one of the above two suggestions is selected as the processing optimization solution for the user's delivery sequence association, so as to guide the user to reduce the amount of food discarded in daily life, further improve the user's environmental protection coefficient and avoid food waste, and improve the user experience.

[0117] In other optional implementations, when it is determined that the frequency of the user discarding expired food is less than the second frequency, the corresponding ingredient cooking suggestion and / or ingredient storage suggestion is matched. Wherein, when it is determined that the frequency of the user discarding expired food is less than the second frequency, it can be determined that the amount of leftover food (leftovers) in the food put in by the user is too much, and thus, the ingredient cooking suggestion can be a suggestion for recommending the user to change the cooking method, or to reduce the amount of cooking ingredients, etc. The ingredient storage suggestion can be used to recommend the user to change the food storage method, such as changing the food storage container or vacuum packaging, etc.

[0118] At least one of the above two suggestions is selected as the processing optimization solution for the user's delivery sequence association, so as to guide the user to reduce the amount of food discarded in daily life, further improve the user's environmental protection coefficient and avoid food waste, and improve the user experience.

[0119] In some optional embodiments of the invention, after identifying the garbage category, the garbage bin terminal can also input the first garbage image into the sub-classification model for identification to obtain the sub-garbage category belonging to the garbage category. For example, for food, the corresponding sub-garbage category may include but is not limited to fruits, leftovers, vegetables, meat, and milk, etc., and upload them to the server. After receiving the garbage category and sub-garbage category, the server can more accurately determine the user's placement of expired food and / or leftover food.

[0120] S208: Send the processing optimization solution to the user terminal and display it.

[0121] In an embodiment of the present invention, after determining the processing optimization plan, the server can send the processing optimization plan to the user terminal and display it. After the user receives the processing optimization plan based on the user terminal, the user can reasonably handle the abnormal abandoned objects according to the processing optimization plan. For example, by guiding the user to reduce the amount of abnormal abandoned objects or to place them correctly, it is convenient for faster classification of garbage and subsequent unified processing of garbage. And thereby improve the user's environmental protection coefficient and user experience.

[0122] Reference Figure 3 , shows another garbage disposal method provided by an embodiment of the present invention, which is applied to a garbage bin terminal. The method may include:

[0123] S301: Acquire a first garbage image taken by a built-in camera device and a garbage weight detected by a weight sensor.

[0124] S302: Input the first garbage image into a preset garbage classification model for identification to obtain a corresponding garbage category.

[0125] S303: Generate a user placement record based on the placement time, garbage category and garbage weight.

[0126] S304: Generate a user delivery sequence based on multiple user delivery records within a preset time period.

[0127] S305, uploading the user delivery sequence to the server, so that the server determines the user's processing preference information for the target garbage category based on the user delivery sequence, and generates a processing optimization plan associated with the user delivery sequence when the processing preference information meets the processing optimization conditions, and the server sends the processing optimization plan to the user terminal for display, so as to guide the user to reduce the amount of garbage generated in the target garbage category.

[0128] In the embodiment of the present invention, the description of the above steps S301-S305 refers to the description of the above embodiment of the present invention.

[0129] In some optional embodiments of the invention, the step of inputting the first garbage image into a preset garbage classification model for identification to obtain a corresponding garbage category includes:

[0130] The image similarity between the first garbage image and the cluster center images associated with the multiple garbage categories is calculated, and the garbage category corresponding to the cluster center image with the highest image similarity is determined as the garbage category of the garbage in the first garbage image.

[0131] In an embodiment of the present invention, the garbage classification model may include a K-Means algorithm, which divides garbage categories into K categories, and each garbage category is preset with a cluster center image, so that the image similarity between the first garbage image and the distance center image associated with each garbage category can be calculated respectively. The garbage category corresponding to the cluster center image with the highest image similarity with the first garbage image is determined as the garbage category associated with the first garbage image.

[0132] The method also includes a training step of a garbage classification model: first, according to the number of garbage categories, K garbage categories are preset, for example, the garbage categories may include five categories: plastic, metal, paper, hazardous materials and food. Then, multiple training sample images corresponding to different garbage categories are obtained.

[0133] One of the training sample images is selected as the cluster center image. The image similarity between the cluster center image and each other training sample image belonging to the current garbage category is calculated respectively. The cluster center image of the current garbage category is updated so that the cumulative image similarity between the other training sample images in the current garbage category, except for the updated cluster center image, and the cluster center image reaches the highest. The cumulative image similarity is the sum of the image similarities between each training sample image and the cluster center image.

[0134] Finally, a plurality of test sample images are respectively input into the garbage classification model for recognition test, and a trained garbage classification model is obtained when no classification recognition error occurs.

[0135] In some optional embodiments of the invention, the method may further include:

[0136] Providing an interactive interface, and displaying the identified garbage categories on the interactive interface;

[0137] Based on an editing operation on a category determination control associated with the displayed garbage category, the garbage category is updated.

[0138] In an embodiment of the present invention, after the trash can terminal identifies the garbage category, the garbage category can also be displayed on the interactive interface, so that the garbage category can be updated through the user's editing operation on the category determination control in the interactive interface. For example, when the user determines that the garbage category is incorrectly identified, the trash can terminal can obtain the correct garbage category based on the triggering of the editing operation on the category determination control, and update the correct garbage category. And based on the correct garbage category and the first garbage image, an error recognition record is generated and uploaded to the server. When the server receives too many error recognition records uploaded by different trash can terminals, it determines to continue training the garbage classification model. Thereby, the accuracy of garbage classification can be further improved, the efficiency of garbage classification can be improved, and the user experience can be improved.

[0139] In some optional embodiments of the invention, the trash can terminal also provides a voice interaction function. For example, the trash can terminal performs user voice detection, determines the user's voice interaction request based on the user's voice information, determines the user's voice text based on the voice recognition of the user's voice information, and determines the voice instruction based on the semantic recognition of the user's voice text. The result of the instruction executed in response to the voice instruction is played by voice. For example, the voice instruction can be to query the current status of the trash can. Or it can be a timed reminder for garbage disposal.

[0140] In some optional embodiments of the invention, the method further comprises:

[0141] A second garbage image captured by an external camera device is obtained, and the second garbage image is identified to obtain the garbage category corresponding to the second garbage image. Finally, an interactive interface is provided, and the identified garbage category is displayed in the interactive interface to remind the user to classify and dispose of the garbage.

[0142] In an embodiment of the present invention, the external camera device is installed on the outer surface of the trash can, so that before the user puts the trash into the trash can, the trash to be put can be photographed and used as the second trash image. After obtaining the second trash image, the trash can terminal can apply a preset trash classification model to identify the second trash image to obtain the trash category corresponding to the trash to be put. An interactive interface is provided, and the identified trash category is displayed in the interactive interface, so that a correct classification can be provided for the user for the trash to be put. For example, it can be displayed that the trash to be put is dry trash, or wet trash, etc. Therefore, the user can be reminded to correctly classify the trash before putting it in. So that the user can correctly put out different categories of trash.

[0143] In other implementations, after the garbage category is identified, the garbage category may be converted into voice data and announced, so that the user may be reminded to dispose of the garbage in a classified manner through voice.

[0144] In some optional embodiments, a photoelectric sensor may be provided in the trash can, and the photoelectric sensor is installed at the edge of the top of the trash can body. The trash can terminal obtains the sensor signal detected by the photoelectric sensor. When the sensor signal of the photoelectric sensor changes significantly, it is determined that the height of the trash in the trash can reaches the height of the photoelectric sensor. The trash can terminal controls the trash compression device to compress the trash in the trash can. The trash compression device may be provided above the barrel body. For example, the trash compression device may include a telescopic rod and a compression plate on the telescopic rod. When the telescopic rod is extended, the compression plate is driven to press down the trash in the barrel body, thereby achieving trash compression.

[0145] The above-mentioned garbage compression device is only a structural example proposed in an embodiment of the present invention and does not constitute a structural limitation of the garbage compression device.

[0146] In summary, an embodiment of the present invention discloses a method for handling garbage, which may include first obtaining a user placement sequence of garbage uploaded by a garbage bin terminal, wherein the user placement sequence is determined by the garbage bin terminal according to the time of garbage placement, garbage category and garbage weight, and the garbage category is obtained by identifying a first garbage image according to a preset garbage classification model. Then, based on the user placement sequence, the user's processing preference information for the target garbage category is determined. And when the processing preference information meets the processing optimization conditions, a processing optimization plan associated with the user placement sequence is generated. Finally, the processing optimization plan is sent to the user terminal and displayed. Thus, accurate garbage classification can be performed through image recognition, and the corresponding processing optimization plan can be determined according to the user's garbage placement situation. Thus, the user can be guided to reduce the amount of abnormal discarded objects or to place them correctly. Improve garbage disposal efficiency, environmental protection coefficient and user experience.

[0147] It should be noted that, for the method embodiments, for the sake of simplicity, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the embodiments of the present application are not limited by the described order of actions, because according to the embodiments of the present application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present application.

[0148] Reference Figure 4 , shows a garbage disposal device provided by an embodiment of the present invention, which is applied to a server, and the device may include:

[0149] The sequence acquisition module 401 is used to obtain the user placement sequence of garbage uploaded by the garbage bin terminal, wherein the user placement sequence is determined by the garbage bin terminal based on the garbage placement time, garbage category and garbage weight, and the garbage category is obtained by identifying the first garbage image based on a preset garbage classification model.

[0150] The processing preference determination module 402 is used to determine the user's processing preference information for the target garbage category according to the user delivery sequence.

[0151] The optimization scheme determination module 403 is used to generate a processing optimization scheme associated with the user delivery sequence when the processing preference information meets the processing optimization conditions.

[0152] The solution sending module 404 is used to send the processing optimization solution to the user terminal and display it.

[0153] In an optional embodiment of the invention, the processing preference determination module 402 includes:

[0154] The record screening submodule is used to screen out a plurality of user delivery records corresponding to a target garbage category from the user delivery sequence.

[0155] The processing preference determination submodule is used to determine the user's processing preference information for the target garbage category based on the multiple user delivery records.

[0156] In an optional embodiment of the invention, the processing preference determination submodule may include:

[0157] The delivery frequency determination unit is used to determine the delivery frequency of the garbage of the target garbage category according to the delivery time in the plurality of user delivery records.

[0158] The placement weight determination unit is used to determine the cumulative placement weight of the garbage of the target garbage category according to the placement weights in the plurality of user placement records.

[0159] The processing preference determining unit is used to generate the user's processing preference information for the target garbage category according to at least one of the delivery frequency, the cumulative delivery weight and the delivery time.

[0160] In an optional embodiment of the invention, the device further comprises an optimization determination module. When the target garbage category is food, the optimization determination module is used to:

[0161] If the frequency of food delivery is greater than or equal to the first frequency, or the cumulative weight of food delivery is greater than or equal to the first weight, it is determined that the processing preference information meets the processing optimization condition.

[0162] If the frequency of food delivery is less than the first frequency, and the cumulative weight of food delivery is less than the first weight, it is determined that the processing preference information does not meet the processing optimization condition.

[0163] In an optional embodiment of the invention, the optimization solution determination module 403 includes:

[0164] The warning information acquisition submodule is used to obtain the expiration warning information of the refrigerator terminal, wherein the expiration warning information at least includes the food type and expiration time.

[0165] The expired food discarding submodule is used to determine the frequency of users discarding expired food based on the target time interval between the delivery time and the expiration time of the food, and the delivery weight.

[0166] The optimization solution determination submodule is used to determine ingredient purchase suggestions and / or ingredient usage suggestions corresponding to the expired food when it is determined that the frequency of users discarding expired food is greater than or equal to the second frequency.

[0167] The food purchase suggestion and / or food usage suggestion is used as a processing optimization solution associated with the user delivery sequence.

[0168] In an optional embodiment of the invention, the optimization scheme determination submodule is further used for:

[0169] When it is determined that the frequency of users discarding expired food is less than the second frequency, corresponding ingredient cooking suggestions and / or ingredient storage suggestions are matched.

[0170] The ingredient cooking suggestion and / or ingredient storage suggestion is used as a processing optimization solution associated with the user delivery sequence.

[0171] Reference Figure 5 , shows another garbage disposal device provided by an embodiment of the present invention, which is applied to a garbage bin terminal, and the device may include:

[0172] The data acquisition module 501 is used to acquire a first garbage image taken by a built-in camera device and a garbage weight detected by a weight sensor.

[0173] The category recognition module 502 is used to input the first garbage image into a preset garbage classification model for recognition to obtain a corresponding garbage category.

[0174] The record determination module 503 is used to generate a user placement record according to the placement time, garbage category and garbage weight.

[0175] The sequence generation module 504 is used to generate a user delivery sequence based on multiple user delivery records within a preset time period.

[0176] The sequence uploading module 505 is used to upload the user delivery sequence to the server, so that the server can determine the user's processing preference information for the target garbage category based on the user delivery sequence, and generate a processing optimization plan associated with the user delivery sequence when the processing preference information meets the processing optimization conditions, and the server can send the processing optimization plan to the user terminal for display.

[0177] In an optional embodiment of the invention, the category identification module 502 may also be used for:

[0178] The image similarity between the first garbage image and cluster center images associated with a plurality of garbage categories is calculated.

[0179] The garbage category corresponding to the cluster center image with the highest image similarity is determined as the garbage category of the garbage in the first garbage image.

[0180] In an optional embodiment of the invention, the method further comprises a category display module, wherein the category display module is used to:

[0181] An interactive interface is provided, and the identified garbage categories are displayed on the interactive interface.

[0182] Based on an editing operation on a category determination control associated with the displayed garbage category, the garbage category is updated.

[0183] In an optional invention, the device may further include:

[0184] The second image acquisition module is used to acquire a second garbage image taken by an external camera device.

[0185] The second classification determination module is used to identify the second garbage image and obtain the garbage category corresponding to the second garbage image.

[0186] The category display module is also used to provide an interactive interface and display the identified garbage categories in the interactive interface to remind the user to classify and dispose of the garbage.

[0187] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0188] It is easy for a person skilled in the art to think that any combination of the above embodiments is feasible, so any combination of the above embodiments is an implementation scheme of the present invention. However, due to space limitations, this specification will not describe them in detail here.

[0189] In the description provided herein, a large number of specific details are described. However, it is understood that embodiments of the present invention can be practiced without these specific details. In some instances, well-known methods, structures and techniques are not shown in detail so as not to obscure the understanding of this description.

[0190] Similarly, it should be understood that in order to streamline the present invention and aid in understanding one or more of the various inventive aspects, in the above description of exemplary embodiments of the present invention, various features of the present invention are sometimes grouped together into a single embodiment, figure, or description thereof. However, this disclosed method should not be interpreted as reflecting the intention that the claimed invention requires more features than those expressly recited in each claim. Rather, as reflected in the claims, inventive aspects lie in less than all of the features of the individual embodiments previously disclosed. Therefore, the claims that follow the detailed description are hereby expressly incorporated into the detailed description, with each claim itself serving as a separate embodiment of the present invention.

[0191] Those skilled in the art will appreciate that the modules in the devices in the embodiments may be adaptively changed and arranged in one or more devices different from the embodiments. The modules or units or components in the embodiments may be combined into one module or unit or component, and in addition they may be divided into a plurality of submodules or subunits or subcomponents. Except that at least some of such features and / or processes or units are mutually exclusive, all features disclosed in this specification (including the accompanying claims, abstracts and drawings) and all processes or units of any method or device disclosed in this manner may be combined in any combination. Unless otherwise expressly stated, each feature disclosed in this specification (including the accompanying claims, abstracts and drawings) may be replaced by an alternative feature providing the same, equivalent or similar purpose.

[0192] An electronic device, comprising:

[0193] one or more processors;

[0194] Memory;

[0195] One or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs are configured to execute the method described in the above embodiment.

[0196] A computer-readable storage medium stores a computer program used in combination with an electronic device, wherein the computer program can be executed by a processor to implement the method described in the above embodiment.

[0197] A computer program product includes a computer program / computer executable instructions, wherein the computer program / computer executable instructions, when executed by a processor in an electronic device, implements the method described in any one of the above-mentioned embodiments of the invention.

[0198] It will be appreciated by those skilled in the art that the embodiments of the present invention may be provided as methods, devices, or computer program products. Therefore, the embodiments of the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the embodiments of the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.

[0199] The embodiments of the present invention are described with reference to the flowcharts and / or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of the processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing terminal device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0200] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing terminal device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0201] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device so that a series of operating steps are executed on the computer or other programmable terminal device to produce a computer-implemented process, thereby providing instructions for executing on the computer or other programmable terminal device to implement the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0202] Although the preferred embodiments of the present invention have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present invention.

[0203] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the elements.

[0204] The garbage disposal method and the garbage disposal device provided by the present invention are introduced in detail above. The principle and implementation mode of the present invention are explained by using specific examples in this article. The description of the above embodiments is only used to help understand the method of the present invention and its core idea. At the same time, for those skilled in the art, according to the idea of ​​the present invention, there will be changes in the specific implementation mode and the scope of application. In summary, the content of this specification should not be understood as limiting the present invention.

Claims

1. A method for treating garbage, characterized in that: Applied to the server, the method includes: Obtaining a user placement sequence of garbage uploaded by the garbage bin terminal, wherein the user placement sequence is determined by the garbage bin terminal according to the garbage placement time, garbage category and garbage weight, and the garbage category is obtained by identifying the first garbage image according to a preset garbage classification model; Determining the user's processing preference information for the target garbage category based on the user delivery sequence; When the processing preference information meets the processing optimization condition, generating a processing optimization plan associated with the user delivery sequence; The processing optimization plan is sent to the user terminal and displayed.

2. The garbage disposal method according to claim 1, characterized in that: Determining the user's processing preference information for the target garbage category based on the user delivery sequence includes: Filtering out multiple user delivery records corresponding to the target garbage category from the user delivery sequence; According to the plurality of user delivery records, the user's processing preference information for the target garbage category is determined.

3. The garbage disposal method according to claim 2, characterized in that: Determining the user's processing preference information for the target garbage category based on the plurality of user delivery records includes: Determining the frequency of delivery of the target garbage category according to the delivery time in the plurality of user delivery records; Determining the cumulative weight of garbage of the target garbage category according to the weights of garbage in the plurality of user garbage placement records; According to at least one of the delivery frequency, the accumulated delivery weight and the delivery time, the user's processing preference information for the target garbage category is generated.

4. The garbage disposal method according to claim 3, characterized in that: In the case where the target garbage category is abnormal discarded objects, determining that the processing preference information meets the processing optimization condition includes: If the frequency of abnormal discarded objects is greater than or equal to the first frequency, or the cumulative weight of abnormal discarded objects is greater than or equal to the first weight, it is determined that the processing preference information meets the processing optimization condition.

5. The garbage disposal method according to claim 4, characterized in that: The abnormal discarded objects include at least one of the following: food and harmful substances.

6. The garbage disposal method according to claim 5, characterized in that: In the case where the abnormal discarded objects include food, the generating of a processing optimization scheme associated with the user delivery sequence includes: Acquire expiration warning information of the refrigerator terminal, wherein the expiration warning information at least includes food type and expiration time; Determining the frequency of users discarding expired food based on the target time interval between the delivery time and the expiration time of the food and the delivery weight; When it is determined that the frequency of users discarding expired food is greater than or equal to the second frequency, determining an ingredient purchase suggestion and / or an ingredient usage suggestion corresponding to the expired food; The food purchase suggestion and / or food usage suggestion is used as a processing optimization solution associated with the user delivery sequence.

7. The garbage disposal method according to claim 6, characterized in that: The method further comprises: When it is determined that the frequency of users discarding expired food is less than the second frequency, matching corresponding food cooking suggestions and / or food preservation suggestions; The ingredient cooking suggestion and / or ingredient storage suggestion is used as a processing optimization solution associated with the user delivery sequence.

8. A method for treating garbage, characterized in that: Applied to a trash can terminal, the method comprises: Acquire a first garbage image captured by a built-in camera device and a garbage weight detected by a weight sensor; Inputting the first garbage image into a preset garbage classification model for identification to obtain a corresponding garbage category; Generate user placement records based on placement time, garbage category and garbage weight; Generate a user delivery sequence based on multiple user delivery records within a preset time period; The user delivery sequence is uploaded to the server, so that the server determines the user's processing preference information for the target garbage category based on the user delivery sequence, and generates a processing optimization plan associated with the user delivery sequence when the processing preference information meets the processing optimization conditions, and the server sends the processing optimization plan to the user terminal.

9. The garbage disposal method according to claim 8, characterized in that: The step of inputting the first garbage image into a preset garbage classification model for identification to obtain a corresponding garbage category includes: Calculating image similarity between the first garbage image and cluster center images associated with a plurality of garbage categories; The garbage category corresponding to the cluster center image with the highest image similarity is determined as the garbage category of the garbage in the first garbage image.

10. The garbage disposal method according to claim 8, characterized in that: The method further comprises: Providing an interactive interface, and displaying the identified garbage categories on the interactive interface; Based on an editing operation on a category determination control associated with the displayed garbage category, the garbage category is updated.

11. The garbage disposal method according to claim 8, characterized in that: The method further comprises: Acquire a second garbage image captured by an external camera device; Identify the second junk image to obtain a junk category corresponding to the second junk image; An interactive interface is provided, and the identified garbage categories are displayed in the interactive interface to remind users to classify and dispose of the garbage.

12. A garbage disposal device, characterized in that: Applied to the server, the device comprises: A sequence acquisition module is used to acquire a user placement sequence of garbage uploaded by a garbage bin terminal, wherein the user placement sequence is determined by the garbage bin terminal according to the garbage placement time, garbage category and garbage weight, and the garbage category is obtained by identifying the first garbage image according to a preset garbage classification model; A processing preference determination module, used to determine the user's processing preference information for the target garbage category based on the user's delivery sequence; An optimization scheme determination module, configured to generate a processing optimization scheme associated with the user delivery sequence when the processing preference information meets the processing optimization condition; The solution sending module is used to send the processing optimization solution to the user terminal and display it.

13. A garbage disposal device, characterized in that: Applied to a trash can terminal, the device comprises: A data acquisition module, used to acquire a first garbage image taken by a built-in camera device and a garbage weight detected by a weight sensor; A category recognition module, used for inputting the first garbage image into a preset garbage classification model for recognition to obtain a corresponding garbage category; A record determination module is used to generate user placement records based on placement time, garbage category and garbage weight; A sequence generation module, used to generate a user delivery sequence based on multiple user delivery records within a preset time period; The sequence uploading module is used to upload the user delivery sequence to the server, so that the server can determine the user's processing preference information for the target garbage category based on the user delivery sequence, and generate a processing optimization plan associated with the user delivery sequence when the processing preference information meets the processing optimization conditions, and the server can send the processing optimization plan to the user terminal for display.

14. An electronic device, characterized in that: include: one or more processors; Memory; One or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs are configured to execute the method according to any one of claims 1 to 11.

15. A computer-readable storage medium storing a computer program for use in conjunction with an electronic device, characterized in that: The computer program can be executed by a processor to implement the method according to any one of claims 1 to 9.

16. A computer program product comprising a computer program / computer executable instructions, characterized in that: The computer program / computer executable instructions, when executed by a processor in an electronic device, implement the method according to any one of claims 1 to 11.

Images