Weighing processing method, device and electronic equipment

Abstract

The embodiment of the present application discloses a weighing processing method, device and electronic device, the method comprising: obtaining a commodity object visual material information library, the visual material information library including first visual material information of a commodity body corresponding to the commodity object, and second visual material information of an additional mark; collecting visual features of the commodity body and the additional mark corresponding to the weighing object; and identifying the weighing object by comparing the collected visual feature information with the visual material information in the material information library. Through the embodiment of the present application, the weighing efficiency can be improved and the reliance on the subjective judgment of the weighing operator can be reduced.

Description

Technical Field

[0001] The present application relates to the field of intelligent weighing technology, and in particular to weighing processing methods, devices and electronic equipment. Background Art

[0002] When using smart weighing equipment for weighing in a physical store, the visual detection capability of the device can be used to collect visual features of the weighing object, and then match them with the visual features of the commodity object materials stored in the database to identify which specific commodity object in the system the current weighing object corresponds to, and then determine the unit price and calculate the amount payable based on the weighing results.

[0003] It can be seen that in the above-mentioned intelligent weighing process, the visual features of the commodity object material are used as an important basis for identifying the weighing object. For example, the specific commodity object material may include a photo of the commodity object, etc., and the specific visual features may include color features, shape / contour features, texture features, spatial relationship features, etc. However, in practical applications, commodity objects with similar visual features are often encountered. For example, the same banana, but different brands of bananas correspond to different commodity objects, and correspondingly, the unit price is also different. However, different brands of bananas may have a high similarity in visual features. At this time, when the weighing object is identified according to the pre-saved commodity object material, there may be a problem of not being able to determine which specific commodity object it corresponds to. In response to this problem, the processing method in the prior art is to display multiple commodity objects with similar visual features to the weighing operator for selection. That is to say, assuming that the weighing object is a banana, but there are two brands of bananas in the system, corresponding to different commodity objects, at this time, both commodity objects can be returned to the weighing operator, and the weighing operator can choose from them. Obviously, this will increase the workload of the weighing operator and the weighing efficiency is relatively low; and because the weighing operator can only make judgments through visual observation or based on his own experience, there may be cases of misjudgment, which may cause losses to consumers or merchants.

[0004] Therefore, in the case where there are multiple commodity objects with similar visual features, how to further improve the weighing efficiency and reduce the reliance on the subjective judgment of the weighing operator has become a technical problem that needs to be solved by those skilled in the art. Summary of the invention

[0005] The present application provides a weighing processing method, device and electronic equipment, which can improve weighing efficiency and reduce reliance on the subjective judgment of the weighing operator.

[0006] This application provides the following solutions:

[0007] A weighing processing method, characterized by comprising:

[0008] Acquire a commodity object visual material information library, wherein the visual material information library includes first visual material information of a commodity body corresponding to the commodity object and second visual material information of an additional mark;

[0009] Collect visual features of the goods and additional marks corresponding to the weighing object;

[0010] By comparing the collected visual feature information with the visual material information in the material information library, commodity object recognition is performed on the weighing object.

[0011] The second visual material information is visual material information independent of the first visual material information.

[0012] The first visual material information and the second visual material information corresponding to the same commodity object are entered into the visual material information library at different time points.

[0013] Among them, the additional marks corresponding to the same commodity object are not fixed;

[0014] The method further comprises:

[0015] After receiving new second visual material information submitted for a designated commodity object, the corresponding relationship between the designated commodity object and the second visual material information is updated.

[0016] The additional mark is used to enhance the first visual material information, and multiple commodity objects with similar first visual material information correspond to different additional marks, so as to distinguish and identify the multiple commodity objects with similar first visual material information.

[0017] Wherein, different additional marks corresponding to the plurality of commodity objects having similar first visual material information have different feature values ​​in the same visual feature dimension;

[0018] The visual feature collection of the goods body and the additional mark corresponding to the weighing object includes:

[0019] When collecting visual feature information of the additional mark corresponding to the weighing object, visual features of the additional mark are collected only from the same visual feature dimension;

[0020] The step of identifying the commodity object on the weighing object comprises:

[0021] Determining a plurality of matching commodity objects by comparing the visual features of the commodity body with the first visual material information in the visual material information library;

[0022] The features of the additional marks collected from the same visual feature dimension are compared with the second visual material information corresponding to the multiple commodity objects to determine the target commodity object identification that matches the weighing object.

[0023] Among them, different additional marks corresponding to multiple commodity objects with similar first visual material information have different colors, shapes or numbers.

[0024] The same additional mark can be reused between different commodity objects whose first visual material information is not similar.

[0025] The additional mark is used to be attached or drawn on the product body, or placed on a shelf for stacking the product body, or laid in a container for carrying the weighing object.

[0026] Wherein, the step of identifying the commodity object of the weighing object includes:

[0027] Comparing the collected visual features of the commodity body corresponding to the weighing object with the first visual material information in the visual material information library to determine a matching commodity object;

[0028] If there are multiple matching commodity objects, a commodity object recognition result is provided according to the second visual material information corresponding to the multiple matching commodity objects.

[0029] Wherein, providing a commodity object recognition result according to the second visual material information corresponding to the matched plurality of commodity objects includes:

[0030] Comparing the collected visual features of the additional mark with the second visual material information corresponding to the multiple commodity objects to determine the matching target commodity objects;

[0031] or,

[0032] The matched multiple commodity objects are displayed, and the second visual material information respectively corresponding to the multiple commodity objects is enhanced and displayed, so that the weighing operator can select the multiple commodity objects according to the second visual material information.

[0033] A method for processing commodity object material information, comprising:

[0034] Providing an option to submit additional markup related visual material for the product object;

[0035] After receiving the visual material with additional marks related to the target commodity object through the operation option, it is saved in the commodity object visual material information library so as to be used for commodity object identification on the weighing object by comparing the collected visual feature information with the visual material information in the visual material information library to determine the commodity object matching the weighing object, wherein the collected visual feature information includes: the visual feature information of the additional marks related to the weighing object.

[0036] Among them, it also includes:

[0037] A similarity comparison is performed on the visual material information of the commodity bodies corresponding to multiple commodity objects under the same category. If the similarity reaches a target threshold, prompt information is provided to submit additional tag-related visual material information for the multiple commodity objects.

[0038] A weighing processing device, comprising:

[0039] A visual material information library acquisition unit, used to acquire a commodity object visual material information library, wherein the visual material information library includes first visual material information of a commodity body corresponding to the commodity object and second visual material information of an additional mark;

[0040] A visual feature acquisition unit, used to acquire visual features of the goods body and the additional marks corresponding to the weighing object;

[0041] The weighing object identification unit is used to identify the commodity object of the weighing object by comparing the collected visual feature information with the visual material information in the material information library.

[0042] A commodity object material information processing device, comprising:

[0043] An operation option providing unit, used to provide an operation option for submitting additional markup related visual materials for a commodity object;

[0044] A visual material receiving unit is used to save the visual material with additional marks related to the target commodity object in a commodity object visual material information library after receiving it through the operation option, so as to be used for determining the commodity object matching the weighing object by comparing the collected visual feature information with the visual material information in the visual material information library when identifying the commodity object of the weighing object, wherein the collected visual feature information includes: the visual feature information of the additional marks related to the weighing object.

[0045] A computer-readable storage medium stores a computer program, which, when executed by a processor, implements the steps of any of the methods described above.

[0046] An electronic device, comprising:

[0047] one or more processors; and

[0048] A memory associated with the one or more processors, the memory being used to store program instructions, wherein the program instructions, when read and executed by the one or more processors, execute the steps of any of the methods described above.

[0049] According to the specific embodiments provided in this application, this application discloses the following technical effects:

[0050] Through the embodiment of the present application, the second visual material information of the additional mark can be added on the basis of the first visual material information of the commodity body stored in the commodity object visual material information library. In this way, when visually identifying the weighing object, the visual features of the commodity body and the additional mark corresponding to the weighing object can be collected, and the recognition result can be provided through the first visual material information and the second visual material information stored in the material library. In this way, it can help to quickly and accurately identify the commodity object corresponding to the weighing object, improve the weighing efficiency, and reduce the reliance on the subjective judgment of the weighing operator.

[0051] Of course, any product implementing the present application does not necessarily need to achieve all of the advantages described above at the same time. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0053] Figure 1 It is a schematic diagram of the system architecture provided by the embodiment of the present application;

[0054] Figure 2 is a flow chart of the first method provided in an embodiment of the present application;

[0055] Figure 3 is a flow chart of the second method provided in an embodiment of the present application;

[0056] Figure 4 is a schematic diagram of a first device provided in an embodiment of the present application;

[0057] Figure 5 is a schematic diagram of a second device provided in an embodiment of the present application;

[0058] Figure 6 It is a schematic diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0059] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0060] The inventor of the present application discovered in the process of realizing the present application that although some commodity objects have similarities in visual materials, for example, bananas of different brands have similar fruit shapes, colors, sizes, etc., the specific goods may also be associated with some additional identification materials, and there may be some visual differences in such additional identification materials between different commodity objects. For example, two different brands of bananas can be distinguished from another brand without a "fruit mark" because one brand of bananas has a "fruit mark" (a label attached to the fruit body, etc., used to display a specific brand logo (e.g., logo, etc.), etc. In addition to the "fruit mark", the visual characteristics of the commodity bodies corresponding to different commodity objects can also be enhanced by providing additional marks specifically for visual identification for specific commodity objects.

[0061] Therefore, in the embodiment of the present application, in addition to saving the visual material of the commodity body corresponding to the specific commodity object, the visual material of the additional identification material associated with the commodity object can also be saved in the commodity object visual material library. In this way, when identifying the commodity object for the weighing object, in addition to collecting the visual features of the commodity body corresponding to the weighing object, the visual features of the specific additional identification material can also be collected. If there are multiple commodity objects with similar visual features of the commodity body, the identification and discrimination of similar commodity objects can also be achieved through this additional identification material.

[0062] Of course, in the specific implementation, in addition to using the "fruit label" as a specific additional mark, there may be other ways, for example, other marks that can be attached (for example, attached or drawn, etc.) to the goods themselves, or marked materials that can be placed on the "head of the pile" and other shelves for stacking specific goods, or marked materials laid in containers such as pallets (the specific weighing object is placed in such a container, and then placed on the weighing equipment together with the container for weighing), etc. In short, this additional mark can be collected by the visual collection device of the weighing equipment together with the goods themselves, and can have a certain degree of distinction between different commodity objects in terms of visual features.

[0063] It should be noted that the embodiments of the present application involve the following concepts: commodity object, weighing object, goods, and goods body. To facilitate understanding, the meanings of these concepts are first introduced below.

[0064] Product objects mainly refer to the expression of specific products at the data level in a specific information system. For example, when a merchant releases a product to an information system, the information system can generate the corresponding product object and provide it with a unique identifier within the system, including product ID, etc. In addition, in the information system, a specific product object can also be associated with a variety of attribute information, including price, unit price, etc.

[0065] Goods, the commodity objects published in the information system correspond to specific physical entities in specific physical stores. Such physical entities may be the "goods" described in the embodiments of this application. For example, the commodity object with ID "1000012" in the information system corresponds to a certain brand of "banana" in the physical store. Goods are tangible and have weight. The visual materials associated with specific commodity objects are collected by taking photos of such goods.

[0066] The product itself refers to the specific product itself, for example, the fruit of a banana, etc.

[0067] The weighing object refers to the object placed on the weighing device for weighing. In other words, what is actually placed on the weighing object is the goods in the physical store. The visual features of the goods are collected by the intelligent weighing device (in the embodiment of the present application, specifically including the visual material collection of the goods themselves and the additional marking materials), and compared with the materials in the material library to determine the corresponding commodity object, thereby realizing the commodity object identification of the weighing object.

[0068] From the perspective of system architecture, Figure 1 As shown, the embodiment of the present application may involve an intelligent weighing device, which may include a hardware part and a software part, wherein the software part may also be divided into a client and a server, the client runs on the weighing device terminal, and the server can run on a cloud server. Specific visual materials can be stored in a material database on the server, and the client is used to collect visual features of the weighing object and upload them to the server. After the server identifies the corresponding commodity object information, it returns it to the client, and the client can display the identification result through a display screen associated with the weighing device. Of course, in another implementation method, the specific material database can also be stored locally on the weighing device, so commodity object identification can be performed locally on the weighing device.

[0069] In the embodiment of the present application, the material information stored in the specific material database may include the visual material of the product itself, and may also include the visual material of the associated additional mark. In the specific implementation, the specific visual material may be provided by the merchant (for example, the store manager of a specific physical store, etc.), and for this purpose, a workbench may also be provided for the merchant user, so that the merchant user can upload, update, edit, and process the specific visual material.

[0070] In addition, in actual applications, when providing commodity object information to consumer users, the material information stored in the specific material database can also be used to provide the consumer users with richer information to help the consumer users make commodity object selections or purchase decisions.

[0071] The specific technical solutions provided in the embodiments of the present application are described in detail below.

[0072] Embodiment 1

[0073] First, this embodiment provides a weighing processing method from the perspective of a weighing device. Specifically, the execution subject of the method may be Figure 1 The server or client shown, see Figure 2 , the method may include:

[0074] S201: Acquire a commodity object visual material information library, wherein the visual material information library includes first visual material information of a commodity body corresponding to the commodity object and second visual material information of a related additional mark.

[0075] Specific visual materials are materials used to identify weighing objects by visual detection. In the prior art, usually only the visual material information of the goods body corresponding to the commodity object is saved in the material library, including photos of the goods body uploaded by the merchant. In the embodiment of the present application, in order to facilitate further identification or distinction of commodity objects with similar appearance, the visual material information of the additional marks corresponding to such commodity objects can also be saved in the material library. Specifically, the visual material information of such additional marks can also be submitted by the merchant. For example, the merchant (for example, staff in a physical store, etc.) can take photos of the additional marks related to the specific commodity object and enter them into the visual material information library.

[0076] It should be noted here that, since the specific weighing scene usually occurs in a physical store, different physical stores may sell different commodity objects, or the same commodity object may correspond to different additional marks, etc. Therefore, the specific visual material library can be created and maintained in units of physical stores, that is, each physical store can have its own visual material information library. Of course, in another way, if there are chain stores, etc., different physical stores may sell the same commodity objects uniformly, and the same commodity objects also use the same additional marks uniformly, then multiple physical stores can also share the same visual material information library. Alternatively, there may be situations where different physical stores have some similarities and some differences in commodity objects or additional marks. In this case, the same visual material information library can also be shared among multiple physical stores, where, for the different parts, the applicable physical store range can be determined by associating the corresponding physical store identification, etc.

[0077] Among them, in the specific implementation, a workbench can be provided for merchant users so that they can upload, update or edit the visual materials of specific additional marks. Specifically, for the first visual material information of the product body associated with the same commodity object, and the second visual material information of the additional mark, the two can be independent of each other and can be recorded in the visual material information library together, or they can be recorded in the visual material information library at different times. For example, the merchant initially only uploaded the first visual material information of the product body corresponding to each commodity object, and then found that the product bodies of some commodity objects were very similar to each other, so that they were difficult to distinguish, so the visual material information related to the additional mark can be uploaded for these similar commodity objects, and so on. In other words, the visual material related to the additional mark can be independent of the visual material of the product body, and the same commodity object can correspond to two visual material information in the material information library, corresponding to the product body and the additional mark respectively. These two visual material information can be used to quickly identify and distinguish multiple commodity objects that are similar in appearance.

[0078] There may be many specific additional marks, for example, as mentioned above, additional marks may be attached to the goods themselves (e.g., fruit marks, etc.), or additional marks placed on shelves for stacking goods (e.g., price tags placed at the top of piles, etc.), or additional marks placed in containers for carrying weighing objects (e.g., small fruits such as strawberries, although also non-standard products weighed in bulk, may be pre-packaged in containers such as baskets and basins, but the weight of the fruits in each container is different, and the price needs to be determined after specific weighing. Such containers may also have some padding paper, etc. At this time, such padding paper can also become additional marks in the embodiments of the present application), etc. In specific implementation, the merchant may collect the visual material of such additional marks by taking photos, etc., and submit them to the system.

[0079] It should be noted here that the specific fruit labels, paper pads in containers, etc. are usually provided by the brand of the commodity object. The visual features of the specific marks may be relatively complex, and may even directly include specific trademark patterns and other information, so that the specific commodity object can be directly identified based on the visual features of such additional marks. For example, a certain brand of apple may have a fruit label on each apple body, and the fruit label contains the trademark pattern of the brand. Therefore, even without relying on the visual features of the apple body, the corresponding weight can be identified as an apple through the fruit label, and can be distinguished from apples of other brands, etc.

[0080] When the fruit label is used as an additional mark, it has the characteristic of high differentiation. However, in practical applications, the visual features of additional marks such as fruit labels are relatively complex. Therefore, when collecting features of such additional marks and performing subsequent comparisons, the requirements for computing resources are relatively high, and even a relatively long computing time is required. The embodiment of the present application is to identify commodity objects in an intelligent weighing scenario. The computing resources of the intelligent weighing device itself may be relatively limited, and the tolerance for computing time is relatively low. Therefore, if the fruit label is directly used as an additional mark, the weighing efficiency may be reduced.

[0081] To this end, in a more preferred embodiment, additional marks specifically used for visual identification during the weighing process can also be provided for commodity objects. Such additional marks can be used to enhance the first visual material information of the commodity body, and by corresponding different additional marks to multiple commodity objects with similar first visual material information, multiple commodity objects with similar first visual material information can be distinguished and identified. In other words, commodity objects can be preliminarily screened by the visual features of the commodity body, and then matching commodity objects can be further determined from the preliminary screening results by the visual features of the additional marks.

[0082] In this implementation, the specific additional mark can have a relatively simple visual feature. For example, for multiple commodity objects that are easy to confuse in terms of the visual features of the goods themselves, additional marks of different colors, shapes, and numbers can be used. There can also be many specific forms of such additional marks, for example, stickers, or even colors or patterns drawn with a marker, and so on. For example, there are three types of apples in a store that are easy to confuse in appearance. At this time, in order to facilitate the distinction during weighing, these three apples can be respectively affixed with red, green, and yellow stickers as their respective additional marks. In this way, when weighing, the specific type of apple can be distinguished by identifying the color of the specific additional mark.

[0083] That is to say, different additional marks may correspond to multiple commodity objects with similar first visual material information, and these additional marks may have different feature values ​​in the same visual feature dimension. For example, the color, shape, number, etc. mentioned above. In this way, when collecting features of the additional marks of the weighing object, it is only necessary to collect visual features from the same visual feature dimension. When performing feature comparison later, the first visual material information can be used to preliminarily identify multiple possible commodity objects, and then the features of the additional marks can be compared with the second visual material information by comparing them in the same visual feature dimension, so as to determine the commodity object that specifically matches the current weighing object. In this way, the feature collection and comparison process can be simplified.

[0084] In the method of identifying the commodity object by a specially added simple additional mark, since the additional mark is only used to further distinguish from the multiple commodity objects preliminarily determined after the comparison based on the visual features of the commodity body. Therefore, the same additional mark can also be reused between different commodity objects with dissimilar first visual material information. For example, three kinds of apples that are easily confused in a store can use red, green and yellow stickers of three different colors as additional marks. When weighing, firstly, the three kinds of apples may be identified by the visual features of the weighing object itself, and then, the color of the additional mark associated with the weighing object can be further determined which of the three kinds of apples is mentioned above. In addition, there are three kinds of bananas that are easily confused in the store. Since the visual features of the banana body are obviously different from those of apples, these three kinds of bananas can also use red, green and yellow stickers of three different colors as additional marks, and so on.

[0085] In addition, in specific implementation, the additional mark corresponding to the same commodity object may not be fixed. For example, in the case of using a single-color sticker as an additional mark, a certain brand of Apple uses a yellow sticker as an additional mark on the first day, and can use a green sticker as an additional mark on the second day, and so on, as long as it is ensured that multiple commodity objects with similar visual features have different additional marks in the same time period.

[0086] That is to say, the second visual material information of the specific commodity object stored in the visual material information library is the visual material information corresponding to the additional mark currently used by the specific commodity object. When the additional mark of the specific commodity object changes, the specific merchant can also update the second visual material information corresponding to the commodity object through the aforementioned workbench. In other words, after receiving the new second visual material information submitted for the specified commodity object, the corresponding relationship between the specified commodity object and the second visual material information can be updated.

[0087] It should be noted that, in actual applications, it is not necessary to provide visual materials related to the additional mark for all commodity objects. Instead, only commodity objects that have similarities in the visual materials of the commodity body can be further identified or distinguished through the visual materials related to the additional mark. Therefore, it is possible to selectively provide some commodity objects with visual material information related to the additional mark according to specific needs. Moreover, in an optional implementation, the similarity between the visual materials of the commodity bodies associated with different commodity objects can also be calculated by the server, etc. If it is found that some commodity objects have similarities in the visual materials of the commodity body, which may be indistinguishable or misidentified, the associated merchant users can be prompted to supplement the visual material information related to the additional mark for these commodity objects, and so on.

[0088] S202: Collect visual features of the goods body and related additional marks corresponding to the weighing object.

[0089] Since the visual materials of the goods body and the additional marks are saved in the material information library, when the intelligent weighing equipment is used to weigh the goods, the visual features of the goods body corresponding to the weighing object and the related additional marks can be collected. Among them, in specific implementation, in order to facilitate the visual feature collection of both, when the goods body corresponding to the weighing object is placed on the weighing platform of the weighing equipment, the additional marks can also be placed on the weighing platform at the same time, so that the additional marks also enter the detection range of the visual detection device of the weighing equipment. Among them, if the specific additional marks are attached to the goods body, or laid in a specific container, etc., then this condition can naturally be met. If the additional mark is a price tag placed on a shelf such as a "dump head", then when the weighing object is placed on the weighing platform, this price tag can also be placed on the weighing platform so that its visual features can be detected by the visual detection device of the weighing equipment. Since most of these price tags exist in the form of "playing cards", the impact of their weight on the weight of the weighing object can be almost ignored. Of course, if the specific additional mark itself is heavy, it does not need to be placed on the weighing platform of the weighing equipment. Instead, after placing the weighing object on the weighing platform, the weighing operator can hold the additional mark so that its visual characteristics can be collected, and so on.

[0090] In the process of collecting visual features, the visual features of the specific commodity itself can be collected from multiple dimensions. As for the visual features of the additional marks, if different additional marks are used to distinguish multiple commodity objects with similar first visual material information, and different additional marks have different feature values ​​in the same visual feature dimension, the visual features can be collected only from the same visual feature dimension.

[0091] In specific implementation, since the area of ​​the additional mark may usually be relatively small and may be blocked by the product body, etc., the completeness and clarity of the visual feature collection of the additional mark can also be judged. If it does not meet the requirements, prompt information can be provided to prompt the weighing operator to adjust the product body or the placement of the additional mark so that the collected visual features of the additional mark can meet the requirements.

[0092] S203: performing commodity object recognition on the weighing object by comparing the collected visual feature information with the visual material information in the material information library.

[0093] Since the visual features of the goods and related additional marks are collected, the weighing object can be identified by comparing the collected visual feature information with the visual material information in the material information library. That is, it is determined which commodity object in the system the current weighing object specifically corresponds to, so as to determine the unit price, commodity name and other information, and then generate label information for settlement, etc.

[0094] Specifically, when identifying the commodity object of the weighing object, the two kinds of visual feature information can be compared with the visual material at the same time, or, in another implementation mode, the visual features of the commodity body corresponding to the weighing object collected can be compared with the first visual material information in the visual material information library to determine the matching commodity object. If there are multiple matching commodity objects, the commodity object identification result is provided according to the second visual material information corresponding to the multiple matching commodity objects. For example, the visual features of the additional mark collected can be compared with the second visual material information corresponding to the multiple commodity objects to determine the matching target commodity object. In other words, the first visual material information can be used to perform preliminary commodity object identification. If multiple similar commodity objects are found, the second visual material information can be used to further identify or distinguish the target commodity object that matches the current weighing object from the multiple similar commodity objects. In this way, the identification result finally returned to the weighing operator for confirmation can only include the target commodity object.

[0095] Alternatively, in another way, the multiple matching commodity objects preliminarily identified above can also be displayed, and the second visual material information corresponding to the multiple commodity objects can be enhanced and displayed (for example, the fruit label can be enlarged and displayed, etc.), so that the weighing operator can select the multiple commodity objects according to the second visual material information. That is to say, after completing the preliminary identification, if multiple similar commodity objects are found, further judgment can be left to the weighing operator. Of course, in order to help the weighing operator make judgments, the visual material information related to the specific additional mark can be enlarged and enhanced, so that the weighing operator can make judgments more quickly and accurately based on the enhanced displayed information.

[0096] In summary, through the embodiments of the present application, the second visual material information of the additional mark can be added on the basis of the first visual material information of the commodity body stored in the commodity object visual material information library. In this way, when visually identifying the weighing object, the visual features of the commodity body and the additional mark corresponding to the weighing object can be collected, and the recognition result can be provided through the first visual material information and the second visual material information stored in the material library. In this way, it can help to quickly and accurately identify the commodity object corresponding to the weighing object, improve the weighing efficiency, and reduce the reliance on the subjective judgment of the weighing operator.

[0097] Embodiment 2

[0098] The second embodiment provides a method for processing commodity object material information from the perspective of a workbench provided to merchant users. Figure 3 , the method may include:

[0099] S301: providing an operation option for submitting additional mark-related visual materials for a commodity object;

[0100] S302: After receiving the visual material with additional marks related to the target commodity object through the operation option, it is saved in the commodity object visual material information library for use in commodity object identification on the weighing object by comparing the collected visual feature information with the visual material information in the visual material information library to determine the commodity object that matches the weighing object, wherein the collected visual feature information includes: the visual feature information of the additional marks related to the weighing object.

[0101] In specific implementation, the similarity between the first visual materials of multiple product objects associated with the same merchant user can also be judged. If it is found that there is a high similarity between the first visual materials of certain product objects, the merchant user can be prompted to submit additional tag-related visual materials for these product objects, and so on.

[0102] For the parts not described in detail in the above-mentioned embodiment 2, please refer to the description in the above-mentioned embodiment 1, which will not be repeated here.

[0103] It should be noted that the embodiments of the present application may involve the use of user data. In actual applications, user-specific personal data can be used in the scheme described herein within the scope permitted by applicable laws and regulations, subject to the requirements of applicable laws and regulations of the country where the user is located (for example, with the user's explicit consent, effective notification to the user, etc.).

[0104] Corresponding to the first embodiment, the present application embodiment also provides a weighing processing device, see Figure 4 , the device may include:

[0105] The visual material information library acquisition unit 401 is used to acquire a visual material information library of a commodity object, wherein the visual material information library includes first visual material information of a commodity body corresponding to the commodity object and second visual material information of an additional mark;

[0106] A visual feature collection unit 402 is used to collect visual features of the goods body and the additional mark corresponding to the weighing object;

[0107] The weighing object identification unit 403 is used to identify the commodity object of the weighing object by comparing the collected visual feature information with the visual material information in the material information library.

[0108] The second visual material information is visual material information independent of the first visual material information.

[0109] In a specific implementation, the first visual material information and the second visual material information corresponding to the same commodity object may be entered into the visual material information library at different time points.

[0110] The additional mark corresponding to the same commodity object may be non-fixed; in this case, the device may further include:

[0111] The material updating unit is configured to update the corresponding relationship between the designated commodity object and the second visual material information after receiving new second visual material information submitted for the designated commodity object.

[0112] In a specific implementation, the additional mark is used to enhance the first visual material information, and multiple commodity objects with similar first visual material information correspond to different additional marks, so as to distinguish and identify the multiple commodity objects with similar first visual material information.

[0113] At this time, different additional marks corresponding to the plurality of commodity objects having similar first visual material information may have different feature values ​​in the same visual feature dimension;

[0114] The visual feature acquisition unit can be specifically used for:

[0115] When collecting visual feature information of the additional mark corresponding to the weighing object, visual features of the additional mark are collected only from the same visual feature dimension;

[0116] The weighing object identification unit can be specifically used for:

[0117] Determining a plurality of matching commodity objects by comparing the visual features of the commodity body with the first visual material information in the visual material information library;

[0118] The features of the additional marks collected from the same visual feature dimension are compared with the second visual material information corresponding to the multiple commodity objects to determine the target commodity object identification that matches the weighing object.

[0119] Among them, different additional marks corresponding to multiple commodity objects with similar first visual material information have different colors, shapes or numbers.

[0120] The same additional mark can be reused between different commodity objects whose first visual material information is not similar.

[0121] Specifically, the additional mark can be attached to or drawn on the product body, or placed on a shelf for stacking the product body, or laid in a container for carrying the weighing object.

[0122] Specifically, the weighing object identification unit can be used for:

[0123] Comparing the collected visual features of the commodity body corresponding to the weighing object with the first visual material information in the visual material information library to determine a matching commodity object;

[0124] If there are multiple matching commodity objects, a commodity object recognition result is provided according to the second visual material information corresponding to the multiple matching commodity objects.

[0125] More specifically, the weighing object identification unit can be used for:

[0126] The collected visual features of the additional mark are compared with the second visual material information corresponding to the multiple commodity objects to determine the matching target commodity objects.

[0127] Alternatively, the weighing object identification unit may be used for:

[0128] The matched multiple commodity objects are displayed, and the second visual material information respectively corresponding to the multiple commodity objects is enhanced and displayed, so that the weighing operator can select the multiple commodity objects according to the second visual material information.

[0129] Corresponding to the second embodiment, the present application embodiment also provides a commodity object material information processing device, see Figure 5 , the device may include:

[0130] An operation option providing unit 501 is used to provide an operation option for submitting additional mark-related visual materials for a commodity object;

[0131] The visual material receiving unit 502 is used to save the visual material with additional marks related to the target commodity object into the commodity object visual material information library after receiving it through the operation option, so as to be used for determining the commodity object matching the weighing object by comparing the collected visual feature information with the visual material information in the visual material information library when identifying the commodity object of the weighing object, wherein the collected visual feature information includes: the visual feature information of the additional marks related to the weighing object.

[0132] In addition, an embodiment of the present application further provides a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, the steps of any one of the methods in the aforementioned method embodiments are implemented.

[0133] And an electronic device, comprising:

[0134] one or more processors; and

[0135] A memory associated with the one or more processors, the memory being used to store program instructions, wherein the program instructions, when read and executed by the one or more processors, execute the steps of the method described in any one of the aforementioned method embodiments.

[0136] in, Figure 6 The architecture of the electronic device is shown as an example, which may include a processor 610, a video display adapter 611, a disk drive 612, an input / output interface 613, a network interface 614, and a memory 620. The processor 610, the video display adapter 611, the disk drive 612, the input / output interface 613, the network interface 614, and the memory 620 may be communicatively connected via a communication bus 630.

[0137] Among them, the processor 610 can be implemented by a general-purpose CPU (Central Processing Unit), a microprocessor, an application-specific integrated circuit (Application Specific Integrated Circuit, ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solution provided in this application.

[0138] The memory 620 can be implemented in the form of ROM (Read Only Memory), RAM (Random Access Memory), static storage device, dynamic storage device, etc. The memory 620 can store an operating system 621 for controlling the operation of the electronic device 600, and a basic input and output system (BIOS) for controlling the low-level operation of the electronic device 600. In addition, a web browser 623, a data storage management system 624, and a weighing processing system 625, etc. can also be stored. The above-mentioned weighing processing system 625 can be an application program that specifically implements the operations of the aforementioned steps in the embodiment of the present application. In short, when the technical solution provided by the present application is implemented by software or firmware, the relevant program code is stored in the memory 620 and is called and executed by the processor 610.

[0139] The input / output interface 613 is used to connect the input / output module to realize information input and output. The input / output module can be configured in the device as a component (not shown in the figure), or it can be externally connected to the device to provide corresponding functions. The input device may include a keyboard, a mouse, a touch screen, a microphone, various sensors, etc., and the output device may include a display, a speaker, a vibrator, an indicator light, etc.

[0140] The network interface 614 is used to connect to a communication module (not shown) to realize communication interaction between the device and other devices. The communication module can realize communication through a wired mode (such as USB, network cable, etc.) or a wireless mode (such as mobile network, WIFI, Bluetooth, etc.).

[0141] The bus 630 comprises a pathway for transmitting information between the various components of the device (eg, the processor 610, the video display adapter 611, the disk drive 612, the input / output interface 613, the network interface 614, and the memory 620).

[0142] It should be noted that, although the above device only shows a processor 610, a video display adapter 611, a disk drive 612, an input / output interface 613, a network interface 614, a memory 620, a bus 630, etc., in the specific implementation process, the device may also include other components necessary for normal operation. In addition, it can be understood by those skilled in the art that the above device may also only include components necessary for implementing the solution of the present application, and does not necessarily include all the components shown in the figure.

[0143] It can be known from the description of the above implementation methods that those skilled in the art can clearly understand that the present application can be implemented by means of software plus a necessary general hardware platform. Based on such an understanding, the technical solution of the present application can be essentially or partly contributed to the prior art in the form of a software product, which can be stored in a storage medium such as ROM / RAM, a magnetic disk, an optical disk, etc., and includes several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in the various embodiments of the present application or certain parts of the embodiments.

[0144] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can refer to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the system or system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can refer to the partial description of the method embodiment. The system and system embodiments described above are merely schematic, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without creative work.

[0145] The weighing processing method, device and electronic device provided by the present application are introduced in detail above. The principle and implementation method of the present application are described in detail using specific examples. The description of the above embodiments is only used to help understand the method and core idea of ​​the present application. At the same time, for those skilled in the art, according to the idea of ​​the present application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as limiting the present application.

Claims

1. A weighing processing method, characterized in that: include: Acquire a visual material information library of a commodity object, wherein the visual material information library includes first visual material information of a commodity body corresponding to the commodity object, and second visual material information of an additional mark; the additional mark is used to enhance the distinguishability of the first visual material information in terms of visual features, including fruit labels, stickers or additional marks drawn on the commodity body, price tag-type additional mark materials placed on the shelf where the commodity is located, and / or padding paper-type additional mark materials laid in a container for carrying a weighing object; Collect visual features of the goods and additional marks corresponding to the weighing object; By comparing the collected visual feature information with the visual material information in the material information library, commodity object recognition is performed on the weighing object.

2. The method according to claim 1, characterized in that The additional marks corresponding to the same commodity object are not fixed; The method further comprises: After receiving new second visual material information submitted for a designated commodity object, the corresponding relationship between the designated commodity object and the second visual material information is updated.

3. The method according to claim 1, characterized in that The visual feature collection of the goods body and the additional mark corresponding to the weighing object includes: When collecting visual feature information of the additional mark corresponding to the weighing object, the visual features of the additional mark are collected only from the same visual feature dimension; The step of identifying the commodity object on the weighing object comprises: Determining a plurality of matching commodity objects by comparing the visual features of the commodity body with the first visual material information in the visual material information library; The features of the additional marks collected from the same visual feature dimension are compared with the second visual material information corresponding to the multiple commodity objects to determine the target commodity object identification that matches the weighing object.

4. The method according to claim 3, characterized in that The same additional mark can be reused between different commodity objects whose first visual material information is not similar.

5. The method according to any one of claims 1 to 4, characterized in that: The step of identifying the commodity object on the weighing object comprises: Comparing the collected visual features of the commodity body corresponding to the weighing object with the first visual material information in the visual material information library to determine a matching commodity object; If there are multiple matching commodity objects, a commodity object recognition result is provided according to the second visual material information corresponding to the multiple matching commodity objects.

6. The method according to claim 5, characterized in that The providing a commodity object recognition result according to the second visual material information corresponding to the matched plurality of commodity objects includes: Comparing the collected visual features of the additional mark with the second visual material information corresponding to the multiple commodity objects to determine the matching target commodity objects; or, The matched multiple commodity objects are displayed, and the second visual material information respectively corresponding to the multiple commodity objects is enhanced and displayed, so that the weighing operator can select the multiple commodity objects according to the second visual material information.

7. A method for processing commodity object material information, characterized in that: include: Providing an option to submit additional markup related visual material for the product object; After receiving the visual material of the additional mark related to the target commodity object through the operation option, it is saved in the commodity object visual material information library, so as to be used for commodity object identification on the weighing object by comparing the collected visual feature information with the visual material information in the visual material information library to determine the commodity object matching the weighing object, wherein the collected visual feature information includes: the visual feature information of the additional mark related to the weighing object; the additional mark is used to enhance the distinguishability of the visual material information in terms of visual features, including fruit labels, stickers or drawn additional marks attached to the commodity body, price tag-type additional mark materials placed on the shelf where the goods are located, and / or paper padding-type additional mark materials laid in the container for carrying the weighing object.

8. A weighing processing device, characterized in that: include: A visual material information library acquisition unit, used to acquire a visual material information library of a commodity object, wherein the visual material information library includes first visual material information of a commodity body corresponding to the commodity object, and second visual material information of an additional mark; the additional mark is used to enhance the distinguishability of the first visual material information in terms of visual features, including fruit labels, stickers or additional marks drawn on the commodity body, price tag-type additional mark materials placed on the shelf where the commodity is located, and / or padding paper-type additional mark materials laid in a container for carrying a weighing object; A visual feature acquisition unit, used to acquire visual features of the goods body and the additional marks corresponding to the weighing object; The weighing object identification unit is used to identify the commodity object of the weighing object by comparing the collected visual feature information with the visual material information in the material information library.

9. A commodity object material information processing device, characterized in that: include: An operation option providing unit, used to provide an operation option for submitting additional markup related visual materials for a commodity object; A visual material receiving unit is used to save the visual material of the additional mark related to the target commodity object in the commodity object visual material information library after receiving it through the operation option, so as to be used for determining the commodity object matching the weighing object by comparing the collected visual feature information with the visual material information in the visual material information library when identifying the commodity object of the weighing object, wherein the collected visual feature information includes: the visual feature information of the additional mark related to the weighing object; the additional mark is used to enhance the distinguishability of the visual material information in terms of visual features, including fruit labels, stickers or drawn additional marks attached to the commodity body, price tag-type additional mark materials placed on the shelf where the commodity is located, and / or paper padding-type additional mark materials laid in the container for carrying the weighing object.

Images