Smart badge authentication method and device based on multi-party interconnection

Abstract

The present invention provides a smart badge authentication method and device based on multi-party interconnection, which relates to intelligent interaction technology. By constructing a digital database adaptation layer, the data structures and grammatical rules of different database systems can be intelligently identified and analyzed to ensure seamless data connection between different databases, and a comprehensive digital database corresponding to all commodities in the exhibition, namely the source database, is constructed, and a database corresponding to the smart badge, namely the target database, is constructed. Through the data mapping technology, the data structure of the source database is mapped to the data structure of the target database to maintain the consistency and integrity of the data, and a real-time monitoring function is provided to track the data changes in the database adaptation process in real time to ensure the accuracy and consistency of the data. Users can socialize through the smart badge to realize data exchange and business card exchange, thereby improving the interaction efficiency.

Description

Technical Field

[0001] The present invention relates to intelligent interaction technology, and in particular to an intelligent chest card authentication method and device based on multi-party interconnection. Background Art

[0002] With the rapid development of information technology and the widespread application of technologies such as the Internet of Things and mobile payments, consumers' demand for convenient and intelligent purchasing experience is increasing.

[0003] In the prior art, there are two ways for users to purchase items. The first is to take the items directly on site, and the second is to select items remotely through a food delivery platform and then have them delivered remotely. However, when users select items on site and need them delivered, they often need to contact the responsible personnel for communication. The responsible personnel can only complete the whole process after recording the item information and delivery information. In this process, the interaction efficiency between users and the required items is low.

[0004] Therefore, how to automatically process user-item interaction data to improve interaction efficiency has become an urgent problem that needs to be solved. Summary of the invention

[0005] The present invention provides a smart chest card authentication method and device based on multi-party interconnection, which can automatically process user's item interaction data to improve interaction efficiency.

[0006] A first aspect of the present invention provides a smart badge authentication method based on multi-party interconnection, comprising:

[0007] Determine the authentication attribute of the smart badge according to the linkage authentication information of the user end, wherein the authentication attribute includes a master attribute and a subordinate attribute;

[0008] receiving item interaction information, determining delivery item addition information according to the additional purchase mode of the target item, and generating main display data or sub-display data corresponding to the delivery item addition information according to the authentication attribute;

[0009] Synchronize the sub-display data to the main display data in real time, and dynamically display the main display data and / or sub-display data based on the display interface of the smart badge;

[0010] The item listing data corresponding to the smart badge of the master attribute is obtained, each item listing data is divided into a plurality of associated extraction groups based on category, and the associated extraction groups are sent to the merchant end.

[0011] Optionally, in a possible implementation of the first aspect, receiving item interaction information, determining delivery item addition information according to the purchase mode of the target item, and generating main display data or sub-display data corresponding to the delivery item addition information according to the authentication attribute include:

[0012] Determining an additional purchase mode of the target object according to the item interaction information, wherein the additional purchase mode includes a weighing mode and an independent mode;

[0013] Based on the independent mode, the additional purchase quantity of the target object is obtained, and according to the weighing mode, the first position of the smart badge is obtained, and the second position of each weighing device is determined, and the weighing device corresponding to the second position closest to the first position is obtained as the target weighing device;

[0014] Acquire the current weighing weight of the target weighing device, and obtain the delivery item addition information according to the additional purchase quantity and the current weighing weight;

[0015] Determine the item amount corresponding to the delivery item addition information, generate a real-time amount display axis according to the master attribute, obtain main display data based on the real-time amount display axis, generate a limited amount display axis based on the subordinate attribute, and obtain sub-display data based on the limited amount display axis.

[0016] Optionally, in a possible implementation manner of the first aspect, determining the item amount corresponding to the delivery item addition information, generating a real-time amount display axis according to the master control attribute, and obtaining main display data based on the real-time amount display axis includes:

[0017] Obtaining a preset amount level segment corresponding to the amount of the item, and determining a maximum amount value and a minimum amount value of the amount level segment;

[0018] The total amount span is obtained by subtracting the minimum amount from the maximum amount, the item amount is subtracted from the minimum amount to obtain the item amount span, and the item amount ratio is obtained according to the ratio of the item amount span to the total amount span;

[0019] Determine the total length of the standard display axis, obtain the current display length according to the product of the total length and the item amount ratio, and generate a real-time display axis corresponding to the current display length;

[0020] Amount display slots are constructed at both ends of the real-time display axis, and the minimum amount value and the item amount are filled in the amount display slots respectively to obtain the real-time amount display axis, and main display data is obtained based on the real-time amount display axis.

[0021] Optionally, in a possible implementation manner of the first aspect, generating a limit amount display axis based on the subordinate attribute, and obtaining sub-display data according to the limit amount display axis includes:

[0022] Obtain the limit amount uploaded by the smart badge of the master control attribute, and obtain the current limit ratio according to the ratio of the item amount to the limit amount;

[0023] Retrieving a reference display axis, determining a reference length of the reference display axis, and obtaining a restricted length according to a product of the reference length and the current restricted ratio;

[0024] Determine the amount display direction of the reference display axis, obtain the starting point of the reference display axis in the amount display direction, construct an amount display slot at a position of the limited length from the starting point, and fill the amount display slot based on the item amount;

[0025] Obtain the number axis segment corresponding to the limit length. When the limit length is less than the warning length threshold, update the number axis segment according to the standard pixel value. When the limit length is greater than or equal to the warning length threshold, update the number axis segment according to the warning pixel value.

[0026] Optionally, in a possible implementation manner of the first aspect, synchronizing the sub-display data to the main display data in real time, and dynamically displaying the main display data and / or the sub-display data based on a display interface of the smart badge includes:

[0027] When the smart badge corresponds to the master control attribute, the display interface is divided into a main display area and a related display area;

[0028] Synchronizing the restricted amount display axis to the amount display area in the associated display area, and displaying the real-time amount display axis in the amount display area in the main display area;

[0029] Constructing a first display slot corresponding to the target object of the main control attribute in the main display area, and filling the display image corresponding to the target object of the main control attribute into the first display slot;

[0030] Constructing a second display slot corresponding to the target object of the subordinate attribute in the associated display area, and filling the display image corresponding to the target object of the subordinate attribute into the second display slot;

[0031] When the smart badge corresponds to the subordinate attribute, the limit amount display axis is displayed at a preset position on the display interface, a third display slot corresponding to the target object of the subordinate attribute is constructed, and a display image corresponding to the target object of the subordinate attribute is filled into the third display slot.

[0032] Optionally, in a possible implementation manner of the first aspect, obtaining item list data corresponding to the smart badge of the master control attribute, dividing each item list data into a plurality of associated extraction groups based on category, and sending the associated extraction groups to a merchant end, includes:

[0033] Determine the placement position of each target object in the item list data, and obtain the target object whose placement position is located in the shelf area as the object to be picked;

[0034] Counting the first quantity of the same type of to-be-picked objects and the second quantity of the different types of to-be-picked objects in each of the item list data;

[0035] Calculating the sum of the first quantity and the second quantity to obtain a total quantity, and determining the item similarity between each item listing data according to a ratio of the first quantity to the total quantity;

[0036] The item listing data whose item similarity is greater than a similarity threshold is divided into the same associated extraction group, a shortest action route passing through the placement points of each of the items to be picked is generated, and the associated extraction group and the shortest action route are sent to the merchant end.

[0037] Optionally, in a possible implementation manner of the first aspect, after sending the associated extraction group and the shortest action route to the merchant end, the method further includes:

[0038] Obtaining the automatic sorting device assigned by the merchant end to the associated extraction group, and sending the shortest action route corresponding to the associated extraction group to the automatic sorting device;

[0039] Controlling the automatic sorting device to go to the shooting points corresponding to the placement positions in sequence based on the shortest action route, and obtaining shelf images collected by the automatic sorting device at the shooting points;

[0040] Determine the placement height of each object to be picked corresponding to the placement position point according to the shelf image, and determine the current sorting height of the automatic sorting device;

[0041] The height difference between the current sorting height and each placement height is obtained, and the objects to be picked are arranged in order from small to large according to the height difference to obtain a sorting sequence, and the automatic sorting device is controlled to complete the sorting of the corresponding objects to be picked based on the sorting sequence and the placement height. When the automatic sorting device completes the sorting operation of all the objects to be inspected, the sorting completion information is sent to the merchant end, and the merchant end delivers the delivery objects to the delivery address specified by the user end in combination with the delivery address reserved by the user end.

[0042] Optionally, in a possible implementation of the first aspect, controlling the automatic sorting device to go to the shooting points corresponding to the placement positions in sequence based on the shortest action route, and acquiring the shelf images collected by the automatic sorting device at the shooting points, includes:

[0043] In response to the shooting and collecting information, a plurality of preset shooting heights are determined, and the preset shooting heights are arranged from small to large to obtain a shooting height sequence;

[0044] Based on the shooting height sequence, the shooting height of the shooting component of the automatic sorting device is adjusted in sequence to obtain shelf images captured by the shooting component at each of the preset shooting heights;

[0045] Extracting the contours of the objects to be picked in the shelf images, and counting the total number of contours of the objects to be picked in each of the shelf images, wherein contours of the objects to be picked in different shelf images whose contour similarity is greater than a contour similarity threshold are counted as the same contour of the objects to be picked;

[0046] The number of objects to be picked corresponding to the current placement position is obtained. When the total number of outlines is greater than or equal to the number of objects to be picked, the acquisition operation of the shooting component is stopped and multiple shelf images are obtained.

[0047] Optionally, in a possible implementation of the first aspect, determining the placement height of each to-be-picked object corresponding to the placement position point according to the shelf image includes:

[0048] Arrange the shelf images from small to large according to the preset shooting height to obtain an image sequence, and sequentially determine the shelf images in the image sequence as target images;

[0049] Extract all the object contours in the target image, determine that the object contours with the same vertical axis coordinate value are the same group of object contour groups, and sequentially number the object contour groups from small to large in a bottom-to-top direction to obtain the hierarchical number of each object contour group;

[0050] If the same object contour group exists in adjacent target images, the level numbers of the object contour groups in the adjacent target images are synchronized;

[0051] The object contour group in which the contour of the object to be picked is located is obtained as the target contour group, the level number corresponding to the target contour group is determined as the target number, and the preset placement height corresponding to the target number is determined as the placement height corresponding to the corresponding object to be picked.

[0052] A second aspect of the present invention provides a smart badge authentication device based on multi-party interconnection, comprising:

[0053] A determination module, used to determine the authentication attribute of the smart badge according to the linkage authentication information of the user end, wherein the authentication attribute includes a master attribute and a subordinate attribute;

[0054] A receiving module, configured to receive item interaction information, determine delivery item addition information according to the target item purchase mode, and generate main display data or sub-display data corresponding to the delivery item addition information according to the authentication attribute;

[0055] A synchronization module, used for synchronizing the sub-display data to the main display data in real time, and dynamically displaying the main display data and / or sub-display data based on the display interface of the smart badge;

[0056] The acquisition module is used to acquire the item listing data corresponding to the smart badge of the master attribute, divide each item listing data into multiple associated extraction groups based on category, and send the associated extraction groups to the merchant end.

[0057] The beneficial effects of the present invention are as follows:

[0058] 1. The present invention can perform the operation of adding goods to a shopping cart through a smart badge, can automatically process the user's item interaction data, improve the interaction efficiency, and can improve the overall shopping efficiency and convenience during shopping.

[0059] 2. The present invention can reflect the dynamic changes of the user's consumption amount in real time by generating a real-time amount display axis, and enable the user to intuitively see the range of the current item amount.

[0060] 3. The present invention can set a limit amount for a subordinate smart card by using a user of a master smart card, thereby preventing the holder of the subordinate smart card from overspending.

[0061] 4. The present invention can synchronize the sub-display data of the subordinate smart badge to the main display data of the master smart badge in real time, and realize the sharing and interaction of the selected goods through collaborative linkage, so as to ensure that the holder of the master smart badge can obtain the purchase information of the subordinate smart badge in real time.

[0062] 5. The present invention can divide the listed data of items of the same category into the same associated extraction group, and sort the commodities in the same associated extraction group together, which can improve the efficiency of sorting.

[0063] 6. The present invention can allocate automatic sorting equipment to the associated extraction group, and automatically adjust the sorting height of the automatic sorting equipment in combination with the placement height of each object to be picked up on the shelf to achieve automated sorting operation, thereby improving sorting efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0064] Figure 1 It is a flowchart of a smart badge authentication method based on multi-party interconnection provided by an embodiment of the present invention;

[0065] Figure 2 It is a schematic diagram of a display interface corresponding to a smart badge with a master control attribute provided by an embodiment of the present invention;

[0066] Figure 3It is a schematic diagram of a display interface corresponding to a smart badge with subordinate attributes provided by an embodiment of the present invention;

[0067] Figure 4 It is a structural diagram of a smart badge authentication device based on multi-party interconnection provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0068] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0069] The technical solution of the present invention is described in detail with specific embodiments below. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described in detail in some embodiments.

[0070] See also Figure 1 , is a schematic diagram of a smart badge authentication method based on multi-party interconnection provided by an embodiment of the present invention, Figure 1 The execution subject of the method shown may be a software and / or hardware device. The execution subject of the present application may include but is not limited to at least one of the following: user equipment, network equipment, etc. Among them, user equipment may include but is not limited to computers, smart phones, personal digital assistants (PDA) and the electronic devices mentioned above. Network equipment may include but is not limited to a single network server, a server group consisting of multiple network servers, or a cloud based on cloud computing consisting of a large number of computers or network servers, wherein cloud computing is a type of distributed computing, a super virtual computer composed of a group of loosely coupled computers. This embodiment does not limit this. It includes steps S1 to S4, as follows:

[0071] S1, determining the authentication attributes of the smart badge according to the linkage authentication information of the user end, wherein the authentication attributes include a master attribute and a subordinate attribute.

[0072] The user terminal refers to a terminal held by a user who has shopping needs, such as a mobile phone. The linkage authentication information refers to information that can be used to confirm the user's identity and usage authority when performing smart badge authentication. This information may include the user's identity information, such as name, gender, etc. The smart badge refers to a device equipped with a small but clear display screen and supporting touch screen operation. The smart badge in this solution can not only be used as a credential for identity identification, but also can be used for interactive operations, such as adding items to purchase, viewing information about added items, etc. The authentication attribute refers to the attribute of the smart badge when performing authentication. The master attribute refers to the attribute of the smart badge used by the main user, and the subordinate attribute refers to the attribute of the smart badge used by the secondary user. In the collaborative shopping scenario, the smart badge used by the main user can be a smart badge held by a parent, and the corresponding authentication attribute can be a master attribute. The smart badge used by the secondary user can be a smart badge held by a child, and the corresponding authentication attribute can be a subordinate attribute. The smart badge with the master attribute can view and manage the shopping information of all other smart badges that are linked and authenticated, such as the smart badge held by the child, to achieve shopping information sharing and management within the family.

[0073] In the traditional exhibition shopping model, after customers purchase goods on site at the exhibition, when customers hope that the purchased goods can be delivered to their homes, they may need to communicate with the staff at the exhibition and explain their delivery requirements in detail. Then the staff often manually records the product information and delivery information. This process takes a long time and may affect the interaction efficiency between customers and the required goods. This solution can quickly select goods in the exhibition through smart badges, and can quickly add goods to the purchase through smart badges, so that the user's item interaction data can be automatically processed through smart badges, improving the interaction efficiency. After shopping, the merchant can quickly sort the goods purchased by the user, and can deliver the goods purchased by the user to the delivery address specified by the user, which can improve the convenience of shopping.

[0074] In this solution, a comprehensive digital database, namely the source database, can be built for all the goods in the exhibition. The database contains detailed information about the goods, such as name, price, category, etc., and a corresponding database, namely the target database, can be built for the smart badge. The database is used to store the information of the goods selected by the user, including the name, quantity, price, etc. Through the data mapping technology, the data structure of the source database can be mapped to the data structure of the target database, so that when the user is purchasing goods, the information of the goods selected by the user can be updated in real time to the target database corresponding to the smart badge. Through the data mapping technology, the accuracy and completeness of the user's shopping list can be ensured. In addition, when performing data mapping, the SQL statements in the source database can be parsed and converted according to the developed intelligent parsing engine to generate equivalent SQL statements suitable for the target database, thereby ensuring smooth operation when updating data across database systems.

[0075] In actual applications, when going to an exhibition to shop, multiple family members may go to the exhibition to shop together. At this time, the user can enter the APP corresponding to the smart badge through the user terminal, such as a mobile phone, and perform identity authentication according to the linkage authentication information on the user terminal, such as face recognition, and bind the smart badge to the user's identity information. In addition, the identity information of multiple family members can be bound to the corresponding smart badge through a user's mobile phone. When authenticating the smart badge, the authentication attribute of the smart badge can be selected according to the user role. For example, the authentication attribute corresponding to the smart badge used by the parent can select the master attribute, and the authentication attribute corresponding to the smart badge used by the child can select the subordinate attribute. When the user uses the smart badge to shop, the identity information that the user has bound can be verified first. The user who passes the identity authentication can perform subsequent commodity selection operations, and the commodity information selected by the user can be updated in real time to the target database corresponding to the smart badge.

[0076] When multiple family members go shopping together, their respective identity information has been bound to the corresponding smart badge. Each family member can directly select and purchase goods through the smart badge, which improves the convenience of shopping. The shopping information can be recorded and managed accordingly according to the authentication attributes of the smart badge. The smart badge with the master attribute can view and manage the shopping information of all other linked and authenticated smart badges. For example, parents can view and manage the shopping information of the subordinate smart badges held by their children through the smart badge with the master attribute, thereby realizing the sharing and management of shopping information within the family.

[0077] Through the above implementation, the user's item interaction data can be automatically processed to improve the interaction efficiency, and the overall shopping efficiency and convenience during shopping can be improved.

[0078] S2, receiving item interaction information, determining delivery item addition information according to the additional purchase mode of the target item, and generating main display data or sub-display data corresponding to the delivery item addition information according to the authentication attribute.

[0079] Among them, item interaction information refers to the information displayed on the display screen of the smart badge that can be used to purchase additional items, such as the name of the item, the measurement method, etc. The target item refers to the item to be purchased additionally, the purchase mode refers to the mode for purchasing additional items, the delivery item addition information refers to the weight information or quantity information of the purchased additional items, the main display data refers to the data of the purchased additional items displayed on the display screen of the smart badge with the main control attribute, and the sub-display data refers to the data of the purchased additional items displayed on the display screen of the smart badge with the subordinate attribute.

[0080] After completing the binding authentication, users can use the smart badge to purchase products. In the product display area, each product is equipped with a corresponding QR code. Users can use the smart badge to scan the QR code corresponding to the target item they want to purchase. The display screen of the smart badge will display detailed information of the target item. According to the displayed product information, the corresponding purchase mode of the target item can be determined. According to the corresponding purchase mode, the target item can be purchased. You can purchase products of corresponding quantity or weight. After completing the purchase, the smart badge can automatically generate delivery item addition information, including the weight and quantity of the product. The delivery item addition information is an important basis for subsequent delivery and settlement.

[0081] When the user performs the corresponding add-to-purchase operation on the target item he wants to purchase through the smart badge, this solution can track the data of the added product in the target database corresponding to the smart badge in real time. That is to say, each time the user performs an add-to-purchase operation, the product data stored in the target database will be updated to ensure the accuracy and consistency of the data.

[0082] Due to different authentication attributes, the display data of smart badges is different. In order to be able to intuitively view the additional purchase data of smart badges with subordinate attributes through the smart badge with master attributes, the main display data corresponding to the smart badge with master attributes can be generated according to the delivery item addition information displayed on the display screen of the smart badge with master attributes, and the sub-display data corresponding to the smart badge with subordinate attributes can be generated according to the delivery item addition information displayed on the display screen of the smart badge with subordinate attributes, and the sub-display data can be synchronized to the main display data later.

[0083] In some embodiments, step S2 includes S21 to S24, which are specifically as follows:

[0084] S21, determining an additional purchase mode of the target object according to the item interaction information, wherein the additional purchase mode includes a weighing mode and an independent mode.

[0085] Specifically, after scanning the QR code corresponding to the target object through the smart badge, the purchase mode of the target object can be determined according to the item interaction information on the display screen of the smart badge. If the target object is individually packaged, you can add it to the purchase by selecting the quantity, and the corresponding purchase mode can be determined to be the independent mode. If the target object needs to be weighed, it needs to be added to the purchase according to the weight, and the corresponding purchase attribute can be determined to be the weighing mode. For example, for individually packaged potato chips, you can add them to the purchase by selecting the quantity, so the corresponding purchase mode can be determined to be the independent mode. For apples, you may need to add them to the purchase according to the weight, so the corresponding purchase mode can be determined to be the weighing mode.

[0086] Among them, the weighing mode refers to the purchase mode corresponding to the goods that need to be weighed, and the independent mode refers to the purchase mode corresponding to the goods that can be purchased by quantity.

[0087] S22, obtaining the additional purchase quantity of the target object based on the independent mode, obtaining the first position of the smart badge according to the weighing mode, determining the second position of each weighing device, and obtaining the weighing device corresponding to the second position closest to the first position as the target weighing device.

[0088] Among them, the first position refers to the position of the smart badge, the weighing device refers to a device that can weigh the target object, such as an electronic scale, the second position refers to the position corresponding to each weighing device, and the target weighing device refers to the weighing device closest to the position of the smart badge.

[0089] Specifically, if the purchase mode of the target object is an independent mode, the purchase quantity input by the user according to his or her own needs can be obtained; if the purchase mode of the target object is a weighing mode, the smart badge can remind the user to weigh the target object. At this time, the position corresponding to the smart badge can be obtained according to the built-in positioning system of the smart badge, that is, the first position. Since there may be multiple devices for weighing in the exhibition, in order to improve shopping efficiency, the position information corresponding to each weighing device can be obtained, and the position corresponding to each weighing device can be determined as the second position. By comparing the distance between the first position and all the second positions, the nearest weighing device can be determined and determined as the target weighing device. The user can take the selected target area to the nearest target weighing device for weighing, thereby saving the user's time.

[0090] S23, obtaining the current weighing weight of the target weighing device, and obtaining delivery item addition information according to the additional purchase quantity and the current weighing weight.

[0091] Specifically, after determining the target weighing device, the user can go to the target weighing device to weigh the target object. When the weighing is completed, the smart badge can remind the user that the weighing has been completed. In actual applications, the weighing device can transmit the weight data of the target object to the smart badge through a communication protocol such as a WIFI protocol. For example, the weighing device and the smart badge can be connected to the same WIFI network in the exhibition. The weighing device sends the weight data to the IP address of the smart badge through the WIFI protocol. After the smart badge receives the data, it decodes and processes it to obtain the corresponding weight. Therefore, the weight of the target object after being weighed by the target weighing device, that is, the current weighing weight, can be obtained through the smart badge. The corresponding delivery item addition information can be obtained according to the additional purchase quantity and the current weighing weight.

[0092] When the additional purchase mode of the target object is the weighing mode, after the target object is weighed, the target object can be placed in a locker specially used for storing target objects in the weighing mode. Specifically, the user can scan the QR code on the locker through the smart badge. After the scanning is completed, an idle locker can be allocated to the user, and the door lock of the locker allocated to the user will be unlocked immediately, allowing the user to put the target object in. After the locker is closed, the smart badge can update the user's shopping information and record the number and location information of the locker where the target object is stored. Subsequent delivery personnel can go to the corresponding locker to obtain the corresponding target object based on the information of the additional purchase goods in the smart badge.

[0093] The current weighing weight refers to the weight corresponding to the current target object.

[0094] S24, determine the amount of the item corresponding to the delivery item addition information, generate a real-time amount display axis according to the master attribute, obtain main display data based on the real-time amount display axis, generate a restricted amount display axis based on the subordinate attribute, and obtain sub-display data based on the restricted amount display axis.

[0095] Among them, the item amount refers to the total amount corresponding to the purchased goods, the real-time amount display axis refers to the number axis that can display the total amount corresponding to the smart badge with the main attribute in real time, and the limit amount display axis refers to the number axis that can display the consumption amount and the remaining amount corresponding to the smart badge with the subordinate attribute in real time.

[0096] Specifically, after obtaining the delivery item addition information, the smart badge can automatically calculate the total amount required for the additional purchase of goods. In order to enable the user to intuitively see the current consumption amount, the corresponding amount display axis can be generated in combination with the item amount. The amount display axis can intuitively display the total amount of the user's current shopping. In addition, the amount display axes generated by smart badges with different authentication attributes are different. For the smart badge with the master attribute, in order to enable the user holding the smart badge with the master attribute to intuitively see the current consumption amount, the item amount corresponding to the smart badge with the master attribute can be combined to generate a real-time amount display axis corresponding to the smart badge with the master attribute. According to the real-time amount display axis, the main display data corresponding to the smart badge with the master attribute can be obtained.

[0097] In order to prevent the holders of subordinate smart badges from overspending, the master smart badge can be used to set a corresponding consumption limit for the subordinate smart badge. For example, parents can set a corresponding consumption limit for their children to prevent their children from overspending. In combination with the consumption limit, a display axis of the amount limit corresponding to the subordinate smart badge can be generated, so that the holders of the subordinate smart badge can intuitively see the remaining consumption amount to avoid overspending. According to the display axis of the amount limit, the sub-display data corresponding to the subordinate smart badge can be obtained.

[0098] Through the above implementation, it is possible to provide intuitive shopping amount display for the holders of the smart badges with master attributes and subordinate attributes, respectively, so that the users can grasp the shopping consumption situation in real time.

[0099] In some embodiments, the step S24 of "determining the amount of the item corresponding to the delivery item addition information, generating a real-time amount display axis according to the master control attribute, and obtaining the main display data based on the real-time amount display axis" includes the following steps:

[0100] S24A1, obtaining the preset amount level segment corresponding to the amount of the item, and determining the maximum amount value and the minimum amount value of the amount level segment.

[0101] Specifically, the amount level segments corresponding to different item amounts may be different. In order to dynamically reflect the changes in the user's consumption amount in real time, multiple pre-configured amount level segments can be called up, and the item amount can be compared with the multiple pre-configured amount level segments to determine the amount level segment corresponding to the item amount, and the maximum amount value and the minimum amount value can be obtained from the amount level segment. For example, there are three pre-configured amount level segments, namely 0-200, 0-500, and 0-1000. When the item amount is 480, it can be determined that the amount level segment corresponding to the item amount is 0-500, and 0 can be determined as the minimum amount value, and 500 can be determined as the maximum amount value.

[0102] Among them, the amount level segment refers to the level segment corresponding to the pre-configured item amount, the maximum amount value refers to the amount value with a large value in the real-time amount level segment, and the minimum amount value refers to the amount value with a small value in the amount level segment.

[0103] S24A2, the maximum amount value minus the minimum amount value is used to obtain the total amount span, the item amount minus the minimum amount value is used to obtain the item amount span, and the item amount ratio is obtained according to the ratio of the item amount span to the total amount span.

[0104] Specifically, by calculating the difference between the maximum amount value and the minimum amount value, the corresponding total amount span can be obtained. By subtracting the minimum amount value from the item amount, the corresponding item amount span can be obtained. By calculating the ratio of the item amount span to the total amount span, the item amount ratio corresponding to the current item amount can be obtained.

[0105] Among them, the total amount span refers to the total span of the amount level segments corresponding to the item amount, the item amount span refers to the span between the item amount and the minimum amount value, and the item amount ratio refers to the proportion of the item amount in the corresponding amount level segment.

[0106] S24A3, determine the total length of the standard display axis, obtain the current display length according to the product of the total length and the item amount ratio, and generate a real-time display axis corresponding to the current display length.

[0107] Specifically, according to the amount level segment corresponding to the item amount, the corresponding standard amount display axis, that is, the standard display axis, can be obtained, and the total length corresponding to the standard display axis can be obtained. By multiplying the total length with the item amount ratio, the length of the amount display axis corresponding to the current item amount can be obtained, that is, the current display length. The larger the item amount, the longer the corresponding current display length. According to the current display length, the corresponding real-time display axis can be generated.

[0108] Among them, the standard display axis refers to the pre-configured standard amount display axis, the total length refers to the length of the standard display axis, the current display length refers to the length of the amount display axis corresponding to the item amount, and the real-time display axis refers to the display axis that can display the current item amount in real time.

[0109] S24A4, constructing amount display slots at both ends of the real-time display axis, filling the minimum amount value and the item amount in the amount display slots respectively, obtaining the real-time amount display axis, and obtaining main display data based on the real-time amount display axis.

[0110] Specifically, after obtaining the real-time display axis, in order to reflect the dynamic changes of the user's consumption amount in real time and enable the user to intuitively see the range of the current item amount, two amount display slots can be constructed at both ends of the real-time display axis, and the minimum amount value and the item amount can be filled into the two amount display slots respectively. For example, when the real-time display axis is displayed vertically on the display screen of the smart badge, the minimum amount value can be filled into the amount display slot at the lower end of the real-time display axis, and the item amount can be filled into the amount display slot at the upper end of the real-time display axis to obtain the corresponding real-time amount display axis. Through the real-time amount display axis, the user can intuitively see the dynamic changes of the consumption amount, and can intuitively see the amount level segment where the item amount is located. According to the real-time amount display axis, the corresponding main display data can be obtained. Among them, the amount display slot refers to the slot where the amount value can be displayed.

[0111] Through the above implementation, the user can intuitively see the dynamic changes of the consumption amount and can intuitively see the amount level segment of the item amount.

[0112] In some embodiments, the step S24 of "generating a limit amount display axis based on the subordinate attribute, and obtaining sub-display data according to the limit amount display axis" includes the following steps:

[0113] S24B1, obtaining the limit amount uploaded by the smart badge of the master control attribute, and obtaining the current limit ratio according to the ratio of the item amount to the limit amount.

[0114] In order to prevent the holders of the subordinate smart badge from overspending without restraint, the user holding the master smart badge can upload the limit consumption amount for the subordinate smart badge, i.e., the limit amount, through the master smart badge. For example, when the uploaded limit amount is 200, the consumption amount of the holder of the subordinate smart badge cannot exceed 200 yuan. If it exceeds 200 yuan, the master smart badge can remind the user, and the user can delete the added purchase items on the subordinate smart badge through the master smart badge. In order to enable the holders of the subordinate smart badge to intuitively see whether their current consumption amount exceeds the limit amount, the corresponding limit amount display axis can be generated in combination with the current consumption amount and the limit amount.

[0115] Specifically, the limit amount uploaded by the smart badge of the master attribute can be obtained, and the current limit ratio can be obtained by calculating the ratio between the amount of items corresponding to the smart badge of the subordinate attribute and the limit amount. The limit amount refers to the limit consumption amount uploaded by the user of the smart badge of the master attribute for the smart badge of the subordinate attribute, and the current limit ratio refers to the ratio between the amount of items corresponding to the smart badge of the subordinate attribute and the limit amount.

[0116] S24B2, retrieve a reference display axis, determine a reference length of the reference display axis, and obtain a restricted length according to the product of the reference length and the current restricted ratio.

[0117] Specifically, the standard amount display axis corresponding to the pre-configured limit amount, i.e., the reference display axis, can be retrieved, and the length of the reference display axis, i.e., the reference length, can be obtained. By multiplying the reference length by the current limit ratio, the length of the display axis corresponding to the current item amount, i.e., the limit length, can be obtained. Among them, the reference display axis refers to the pre-configured standard amount display axis corresponding to the limit amount, the reference length refers to the length corresponding to the reference display axis, and the limit length refers to the length of the display axis corresponding to the item amount of the smart badge with the current subordinate attribute.

[0118] S24B3, determine the amount display direction of the reference display axis, obtain the starting point of the reference display axis in the amount display direction, construct an amount display slot at a position of the limited length from the starting point, and fill the amount display slot based on the item amount.

[0119] Specifically, the amount display direction of the reference display axis can be obtained. For example, when the reference display axis is displayed vertically in the display interface of the smart badge with subordinate attributes, the direction from bottom to top can be determined as the amount display direction, and the starting point of the reference display axis in the amount display direction can be obtained. For example, when the amount display direction is from bottom to top, the lower end point of the reference display axis can be determined as the starting point, and a corresponding amount display slot can be constructed at a position with a limited length from the starting point, and the item amount corresponding to the smart badge with subordinate attributes can be filled into the constructed amount display slot. For example, when the item amount corresponding to the smart badge with subordinate attributes is 120, 120 can be filled into the amount display slot.

[0120] The amount display direction refers to the extension direction of the reference display axis, and the starting point refers to the starting point of the reference display axis in the amount display direction.

[0121] S24B4, obtain the number axis segment corresponding to the limit length. When the limit length is less than the warning length threshold, update the number axis segment according to the standard pixel value. When the limit length is greater than or equal to the warning length threshold, update the number axis segment according to the warning pixel value.

[0122] Specifically, the number axis segment corresponding to the limit length can be obtained. In order to be able to intuitively see whether the current item amount is about to exceed the limit amount, a warning length threshold can be pre-configured. When the limit length is less than the warning length threshold, it can be considered that the corresponding item amount is not close to the limit amount. At this time, the standard pixel value can be used to update the number axis segment. For example, the number axis segment can be updated by the green pixel value, indicating that the current item amount is not close to or about to exceed the limit amount. When the limit length is greater than or equal to the warning length threshold, it can be considered that the current item amount is close to or about to exceed the limit amount. At this time, the number axis segment can be updated by the warning pixel value, for example, the number axis segment can be updated by the red pixel value.

[0123] Among them, the number axis segment refers to an axis segment determined on the reference display axis according to the limit length, the warning length threshold refers to the value that can be used to determine whether the amount of the item is close to or about to exceed the limit amount, the standard pixel value refers to the pixel value used on the number axis segment to indicate that the current item amount is not close to the limit amount, and the warning pixel value refers to the pixel value used on the number axis segment to indicate that the current item amount is close to or about to exceed the limit amount.

[0124] Through the above implementation, the relationship between the current consumption amount and the limit amount of the subordinate smart badge can be intuitively displayed, so as to avoid excessive and uncontrolled consumption by the holder of the subordinate smart badge.

[0125] S3, synchronizing the sub-display data with the main display data in real time, and dynamically displaying the main display data and / or sub-display data based on the display interface of the smart badge.

[0126] After obtaining the main display data corresponding to the smart badge with the main attribute and the sub-display data corresponding to the smart badge with the subordinate attribute, the sub-display data can be synchronized to the main display data in real time. That is, every time a product is purchased by the smart badge with the subordinate attribute, it can be displayed in real time on the smart badge with the main attribute, so that the holder of the smart badge with the main attribute can pay attention to the purchase information of the holder of the smart badge with the subordinate attribute in real time. According to the display interface of the smart badge, the corresponding display data can be dynamically displayed. For the smart badge with the main attribute, the main display data and the sub-display data can be displayed at the same time, and for the smart badge with the subordinate attribute, the corresponding sub-display data can be displayed. Since the shopping situation may be changing in real time, the display interface can be dynamically updated in real time, so that the user can intuitively see the information of all the current purchased products in real time.

[0127] The display interface refers to an interface on the display screen of the smart badge that can display the data of the added-to-purchase goods.

[0128] Based on the above embodiment, the specific implementation of step S3 may be:

[0129] S31, when the smart badge corresponds to the main control attribute, dividing the display interface into a main display area and a related display area.

[0130] Specifically, when the authentication attribute of the smart badge is a subordinate attribute, in order to enable the smart badge with a master attribute to synchronously display the main display data and the sub-display data, the display interface of the smart badge can be divided into a main display area and an associated display area. For example, the display interface of the smart badge can be divided into two left and right areas, the left area can be used as the main display area, and the right area can be used as the associated display area.

[0131] The main display area refers to an area for displaying main display data, and the associated display area refers to an area for displaying sub-display data.

[0132] S32, synchronizing the restricted amount display axis to the amount display area in the associated display area, and displaying the real-time amount display axis in the amount display area in the main display area.

[0133] Specifically, each display area has a corresponding area for the amount display axis, namely, the amount display area. In the associated display area, the restricted amount display axis can be synchronized to the corresponding amount display area. In the main display area, the real-time amount display axis can be synchronized to the corresponding amount display area.

[0134] The amount display area refers to an area where the amount display axis can be displayed, including an area where the restricted amount display axis is displayed and an area where the real-time amount display axis is displayed.

[0135] S33, constructing a first display slot corresponding to the target object of the main control attribute in the main display area, and filling the display image corresponding to the target object of the main control attribute into the first display slot.

[0136] In order to allow users to intuitively view the goods purchased through the smart badge of the master attribute and the goods purchased through the smart badge of the subordinate attribute, slots for displaying the corresponding goods can be constructed in the corresponding display area. Specifically, each target object corresponding to the smart badge of the master attribute can be determined as a target object of the master attribute, and a display slot corresponding to each target object of the master attribute is constructed in the main display area, that is, a first display slot, and the display image corresponding to the target object of the master attribute is obtained, and the corresponding display image can be filled into the first display slot. Among them, the first display slot refers to a slot for displaying the display image corresponding to the target object of the master attribute, and the display image refers to the image corresponding to the target object.

[0137] S34, constructing a second display slot corresponding to the target object of the subordinate attribute in the associated display area, and filling the display image corresponding to the target object of the subordinate attribute into the second display slot.

[0138] Specifically, each target object corresponding to the smart badge of the subordinate attribute can be determined as a target object of the subordinate attribute, and a display slot corresponding to each target object of the subordinate attribute is constructed in the associated display area, that is, a second display slot, and the display image corresponding to the target object of the subordinate attribute is obtained, and the corresponding display image can be filled into the second display slot. The second display slot refers to a slot for displaying the display image corresponding to the target object of the subordinate attribute in the display interface corresponding to the smart badge of the master attribute.

[0139] See also Figure 2 , which is a schematic diagram of a display interface corresponding to a smart badge with a master control attribute provided by an embodiment of the present invention, such as Figure 2 As shown in , multiple first display slots can be constructed in the main display area on the left, and the display image of the target object of the main control attribute can be displayed in the corresponding first display slot. In the main display area on the left, the real-time amount display axis can be displayed in the amount display area in the main display area. In the associated display area on the right, multiple second display slots can be constructed, and the display image of the target object of the subordinate attribute can be displayed in the corresponding second display slots, and the limit amount display axis can be displayed in the amount display area in the associated display area. Figure 2 , a user holding a smart badge with master attributes can intuitively see the shopping information of all associated smart badges.

[0140] S35, when the smart badge corresponds to the subordinate attribute, the limit amount display axis is displayed at a preset position of the display interface, a third display slot corresponding to the target object of the subordinate attribute is constructed, and a display image corresponding to the target object of the subordinate attribute is filled into the third display slot.

[0141] Specifically, when the authentication attribute corresponding to the smart badge is a subordinate attribute, in order to enable the holder of the subordinate smart badge to intuitively see whether his current consumption amount exceeds the limit amount, the display axis of the limit amount can be pre-configured in the display interface of the subordinate smart badge, see Figure 3 , which is a schematic diagram of a display interface corresponding to a smart badge with subordinate attributes provided by an embodiment of the present invention, such as Figure 3 As shown in , in the display interface of the subordinate attribute smart badge, the limit amount display axis can be displayed in the rectangular area on the right, and in the remaining area of ​​the display interface, a corresponding third display slot can be constructed for the subordinate attribute target, and the display image corresponding to the subordinate attribute target can be obtained, and the display image corresponding to the target can be filled into the corresponding third display slot. Among them, the third display slot refers to the slot for displaying the display image of the subordinate attribute target in the display interface corresponding to the subordinate attribute smart badge.

[0142] Through the above implementation, the user can intuitively view the commodities purchased through the smart badge with the master attribute and the commodities purchased through the smart badge with the subordinate attribute.

[0143] S4, obtaining item listing data corresponding to the smart badge of the master attribute, dividing each item listing data into a plurality of associated extraction groups based on category, and sending the associated extraction groups to the merchant end.

[0144] In actual applications, multiple families may collaborate to shop at the same time during the same period of time. Since the smart badge with the primary attribute contains the purchased items of all associated smart badges, the item list data corresponding to multiple smart badges with the primary attribute can be obtained. Since there may be goods of the same category in multiple item list data, the goods of the same category purchased by multiple families can be sorted together to improve the efficiency of sorting.

[0145] Specifically, since the merchandise in the exhibition is generally divided by category when it is zoned, such as seafood area, snack area, wine and beverage area, etc., the merchandise of the same category is usually located in one area and is relatively close to each other. Therefore, the multiple item listing data can be divided according to the category, and the item listing data of the same category can be determined as the same associated extraction group, and multiple associated extraction groups can be obtained. Subsequently, the merchandise in the same associated extraction group can be sorted in the same manner, which can improve the efficiency of merchandise sorting.

[0146] Among them, the item list data refers to the data of purchased goods recorded by all associated smart badges, the associated extraction group refers to a group composed of item list data of the same category, and the merchant end refers to the terminal held by the exhibition staff, such as a mobile phone, computer and other terminals.

[0147] Based on the above embodiment, the specific implementation of step S4 may be:

[0148] S41, determining the placement position of each target object in the item list data, and obtaining the target object whose placement position is located in the shelf area as the object to be picked.

[0149] Specifically, the position point corresponding to each target object in the item list data, that is, the placement position point, can be obtained. If the placement position point of the target object is located in the shelf area, the corresponding target object can be determined as the object to be picked.

[0150] Among them, the placement point refers to the location point of the target object, the shelf area refers to the area in the exhibition specifically used to place goods, usually composed of multiple shelves, each shelf has multiple levels and positions for placing different goods, and the object to be picked refers to the target object whose placement point is located in the shelf area.

[0151] S42, counting the first quantity of the same type of objects to be picked and the second quantity of the different types of objects to be picked in each of the item list data.

[0152] Specifically, the number of objects to be picked of the same type in each item list data may be counted and recorded as the first number, and the number of objects to be picked of different types may be counted and recorded as the second number. The first number refers to the number of objects to be picked of the same type in each item list data, and the second number refers to the number of objects to be picked of different types in each item list data.

[0153] S43, calculating the sum of the first quantity and the second quantity to obtain a total quantity, and determining the item similarity between each item listing data according to the ratio of the first quantity to the total quantity.

[0154] Specifically, the total quantity can be obtained by adding the first quantity to the second quantity, and the similarity between the items in the item list data, that is, the item similarity, can be obtained by calculating the ratio of the first quantity to the total quantity. The total quantity refers to the sum of the quantities of all items to be picked in the item list data, including items to be picked of the same type and items to be picked of different types, and the item similarity refers to the similarity in commodity types between multiple item list data.

[0155] S44, dividing the item listing data whose item similarity is greater than the similarity threshold into the same associated extraction group, generating the shortest action route passing through the placement points of each of the items to be picked up, and sending the associated extraction group and the shortest action route to the merchant end.

[0156] Specifically, after obtaining the item similarity between each item list data, if the item similarity is greater than the similarity threshold, it can be considered that the commodity types in the corresponding item list data have high similarity and can be sorted together. The corresponding item list data can be divided into the same associated extraction group, and the placement positions corresponding to each to-be-picked object in the same associated extraction group can be obtained. Through the path optimization algorithm, a shortest action route passing through multiple placement positions can be generated. According to the shortest action route, the to-be-picked objects can be sorted quickly to improve efficiency, and the associated extraction group and the shortest action route can be sent to the merchant end so that the merchant can sort according to the instructions.

[0157] Among them, the similarity threshold refers to a threshold that can be used to determine whether the item similarity between different item list data is high enough. If the item similarity is greater than the similarity threshold, it can be considered that the item similarity between the corresponding item list data is high, and the corresponding item list data can be divided into the same associated extraction group. If the item similarity is less than the similarity threshold, it can be considered that the similarity between the corresponding item list data is not high, and the corresponding item list data cannot be divided into the same associated extraction group. The shortest action route refers to the shortest path when sorting the items to be picked in the associated extraction group.

[0158] Through the above implementation, the efficiency of commodity sorting can be improved.

[0159] Based on the above steps, this solution also includes the following embodiments:

[0160] A1, obtaining the automatic sorting device assigned by the merchant end to the associated extraction group, and sending the shortest action route corresponding to the associated extraction group to the automatic sorting device.

[0161] In some embodiments, in order to enable rapid sorting of objects to be picked in an associated extraction group, after receiving the associated extraction group and the corresponding shortest action route, the merchant side can assign corresponding automatic sorting equipment to the associated extraction group, such as an intelligent sorting robot with a robotic arm, and the shortest action route corresponding to the associated extraction group can be sent to the corresponding automatic sorting equipment through the merchant side, and the automatic sorting equipment can automatically sort the objects to be picked in the associated extraction group, thereby improving the sorting efficiency.

[0162] The automatic sorting device refers to a device that can automatically sort the objects to be picked in the associated extraction group, for example, it can be an intelligent sorting robot with a robotic arm.

[0163] A2, controlling the automatic sorting device to go to the shooting points corresponding to the placement positions in sequence based on the shortest action route, and obtaining the shelf images collected by the automatic sorting device at the shooting points.

[0164] In actual applications, the placement point of the objects to be picked is the position point from a bird's-eye view. Since the shelves may have multiple levels, and the levels of each object to be picked on the shelves may be different, there may be multiple objects to be picked corresponding to the same placement point. The specific level of the object to be picked on the shelf cannot be accurately determined only by the placement point. When the automatic sorting equipment performs automatic sorting, it is necessary to adjust the height of the automatic sorting equipment accordingly based on the specific position point of the object to be picked on the shelf, so that it can automatically sort the objects to be picked on the corresponding level. At this time, the automatic sorting equipment can be controlled to capture images of the goods on the shelf, obtain the corresponding shelf image, and determine the specific position point of the object to be picked on the shelf according to the shelf image.

[0165] Specifically, a corresponding position point for image acquisition, i.e., a shooting point, can be pre-configured for each placement position point on the shortest route, and the automatic sorting equipment can be controlled to go to the shooting points corresponding to each placement position point in turn along the shortest route to capture images of the goods on the shelf and obtain corresponding shelf images.

[0166] The shooting point refers to a location point where the image of the goods on the shelf can be captured, and the shelf image refers to an image obtained by the automatic sorting equipment capturing the image of the shelf at the corresponding shooting point.

[0167] In some embodiments, the specific implementation of step A2 may be:

[0168] A21, in response to the shooting and collecting information, determining a plurality of preset shooting heights, and arranging the preset shooting heights from small to large to obtain a shooting height sequence.

[0169] In actual applications, there may be multiple shelves in the shelf area, and the distance between adjacent shelves is limited. If the shelf is imaged at a single fixed shooting height, it may be difficult to capture a relatively complete shelf image, which may make it impossible to accurately determine the specific level corresponding to each object to be picked. Therefore, this solution can make corresponding adjustments to the shooting height, pre-configure multiple shooting heights, and combine multiple preset shooting heights to collect images of the shelves in sequence to obtain a more complete shelf image, so as to more accurately determine the specific position of each object to be picked on the shelf.

[0170] Specifically, when the automatic sorting equipment reaches the corresponding shooting point, it can send corresponding shooting and acquisition information. After responding to the shooting and acquisition information, it can pre-configure multiple shooting heights, that is, preset shooting heights. By arranging the multiple preset shooting heights from small to large, the corresponding shooting height sequence can be obtained.

[0171] Among them, the shooting and acquisition information refers to the information of image acquisition of the shelf, the preset shooting height refers to the pre-configured shooting height when shooting the image of the shelf, and the shooting height sequence refers to the sequence obtained by arranging multiple preset shooting heights.

[0172] A22, adjusting the shooting height of the shooting component of the automatic sorting device in sequence based on the shooting height sequence, and obtaining the shelf images captured by the shooting component at each of the preset shooting heights.

[0173] The shooting component refers to a component configured on the automatic sorting device that can capture images, such as a miniature camera.

[0174] Specifically, according to each preset shooting height in the shooting height sequence, the shooting height of the shooting component of the automatic sorting equipment is adjusted in sequence, and the shooting component is controlled to shoot images at each preset shooting height in sequence from small to large, so that the shelf image corresponding to each preset shooting height can be obtained.

[0175] A23, extracting the contours of the objects to be picked in the shelf images, and counting the total number of contours of the objects to be picked in each of the shelf images, wherein contours of the objects to be picked in different shelf images whose contour similarity is greater than a contour similarity threshold are counted as the same contour of the objects to be picked.

[0176] Specifically, after obtaining the shelf images corresponding to each preset shooting height, the contours of the objects to be picked in each shelf image, i.e., the contours of the objects to be picked, can be extracted respectively through contour extraction technology such as edge detection algorithm, and the number of contours of the objects to be picked in each shelf image can be counted. By adding the number of contours of the objects to be picked corresponding to each shelf image, the total number of contours of the objects to be picked, i.e., the total number of contours can be obtained. When taking images, the goods on the same layer may be photographed repeatedly. At this time, in order to avoid repeated counting when obtaining the number of contours of the objects to be picked and obtain a more accurate number of contours of the objects to be picked, the contours of the objects to be picked in different shelf images can be compared for contour similarity through contour comparison technology. If there are contours of the objects to be picked whose contour similarity is greater than the contour similarity threshold, the corresponding contours of the objects to be picked can be determined as the same contour of the objects to be picked.

[0177] Among them, the contour of the object to be picked refers to the contour corresponding to the object to be picked on the shelf, the total number of contours refers to the total number of all contours of the objects to be picked in multiple shelf images, the contour similarity refers to the similarity between the contours of the objects to be picked in different shelf images, and the contour similarity threshold refers to a pre-configured threshold used to determine whether the contours of the objects to be picked in different shelf images are similar enough. If the contour similarity is greater than the contour similarity threshold, it can be considered that the corresponding contours of the objects to be picked are similar enough, and the corresponding contours of the objects to be picked can be regarded as the same contour of the objects to be picked. If the contour similarity is less than the contour similarity threshold, it can be considered that the corresponding contours of the objects to be picked are not similar.

[0178] A24, obtaining the number of objects to be picked corresponding to the current placement position point, and when the total number of contours is greater than or equal to the number of objects to be picked, stopping the acquisition operation of the shooting component and obtaining multiple shelf images.

[0179] Specifically, the number of objects to be picked corresponding to the current placement position can be obtained. When the total number of contours is greater than or equal to the number of objects to be picked, it can be considered that a sufficient number of objects to be picked have been obtained. At this time, the image acquisition operation of the shooting component at the shooting point corresponding to the current placement position can be stopped to obtain the corresponding multiple shelf images.

[0180] Through the above implementation, a more complete shelf image can be obtained, so that the specific location of the items to be picked on the shelf can be determined more accurately, thereby reducing misjudgments during sorting and improving the accuracy of sorting.

[0181] A3, determining the placement height of each object to be picked corresponding to the placement position point according to the shelf image, and determining the current sorting height of the automatic sorting device.

[0182] Specifically, since different layers of the shelf may be filled with different commodities, there may be multiple objects to be picked at the placement location. After the shelf image is obtained, the placement heights corresponding to the objects to be picked at the placement location can be determined respectively according to the multiple shelf images, and the sorting height corresponding to the automatic sorting device at the current moment, that is, the current sorting height, can be obtained. When the automatic sorting device performs sorting operations later, it can optimize its corresponding sorting path based on the current sorting height. For example, if the current sorting height corresponding to the automatic sorting device is low, the automatic sorting device can first sort the objects to be picked at a lower level, and then gradually increase the sorting height to sort the objects to be picked at a higher level, thereby reducing unnecessary height adjustments during the sorting process and improving sorting efficiency.

[0183] Among them, the placement height refers to the height corresponding to each object to be picked on the shelf. The current sorting height may be the height corresponding to the current position of the robotic arm on the automatic sorting device. The current sorting height may correspond to the last sorting height when the automatic sorting device performs a sorting operation on the object to be picked at the previous placement position.

[0184] In some embodiments, the step A3 of "determining the placement height of each object to be picked corresponding to the placement position point according to the shelf image" includes the following steps:

[0185] A31, arranging the shelf images from small to large according to the preset shooting height to obtain an image sequence, and sequentially determining the shelf images in the image sequence as target images.

[0186] Specifically, after acquiring multiple shelf images, each shelf image has a corresponding preset shooting height. In combination with the preset shooting height, the shelf images can be arranged in ascending order to obtain a corresponding image sequence, and each shelf image in the image sequence can be determined as a target image in turn.

[0187] The image sequence refers to a sequence obtained by arranging multiple shelf images in combination with a preset shooting height, and the target image refers to the shelf image currently undergoing contour extraction.

[0188] A32, extracting all the object contours in the target image, determining that the object contours with the same vertical axis coordinate value are the same group of object contour groups, and sequentially numbering each of the object contour groups from small to large in a bottom-to-top direction to obtain the hierarchical number of each of the object contour groups.

[0189] If the same object contour group exists in adjacent target images, the level numbers of the object contour groups in the adjacent target images are synchronized.

[0190] Specifically, by using the contour extraction technology to extract the contours of the objects in the target contour, multiple object contours can be extracted, and the coordinate values ​​of multiple contour points corresponding to each object contour can be obtained. If the longitudinal coordinate values ​​of the contour points corresponding to different object contours are the same, it can be considered that the corresponding object contours are on the same layer of the shelf, and the corresponding object contours can be determined as the same group of object contour groups. From bottom to top, each object contour group is numbered sequentially, and the bottommost object contour group is numbered 1, and the number increases upward in sequence. The level number corresponding to each object contour group can be obtained. If the same object contour group exists in adjacent target images, the level number of the same object contour group can be synchronized to avoid repeated numbering of the same object contour group.

[0191] For example, in a target image, three item contour groups can be determined, and each item contour group has a corresponding level on the shelf. The three item contour groups are numbered sequentially from bottom to top, and the level number corresponding to the item contour group in the lower layer is 1, the level number corresponding to the item contour group in the middle layer is 2, and the level number corresponding to the item contour group in the upper layer is 3. If in an adjacent target image, there is an item contour group that is the same as the item contour group corresponding to level number 3, then the shelf number 3 can be synchronized to the adjacent target image, that is, in the adjacent target image, the sequential numbering starts from level number 3. If there are three item contour groups in the adjacent target image, the three item contour groups are numbered sequentially from bottom to top, and the corresponding level numbers are 3, 4, and 5, respectively.

[0192] Among them, the item contour refers to the contour corresponding to each commodity on the shelf, the item contour group refers to a group composed of item contours with the same vertical axis coordinate value, and the level number refers to the number corresponding to each item contour group after the item contour groups are numbered sequentially from bottom to top.

[0193] A33, obtaining the object contour group where the contour of the object to be picked is located as the target contour group, determining the level number corresponding to the target contour group as the target number, and determining the preset placement height corresponding to the target number as the placement height corresponding to the corresponding object to be picked.

[0194] Specifically, the item contour group containing the contours of the objects to be picked can be determined as the target contour group, and the level number corresponding to the target contour group can be determined as the target number. The corresponding preset placement height can be configured in advance for each level number. The larger the level number, the larger the corresponding preset placement height can be. Therefore, the preset placement height corresponding to the target number can be determined as the placement height corresponding to the objects to be picked.

[0195] Among them, the target contour group refers to the item contour group with the contours of the items to be picked, the target number refers to the level number corresponding to the target contour group, and the preset placement height refers to the placement height pre-configured for each level number.

[0196] A4, obtaining the height difference between the current sorting height and each placement height, arranging each object to be picked in order from small to large according to the height difference to obtain a sorting sequence, controlling the automatic sorting device to complete the sorting of the corresponding objects to be picked based on the sorting sequence and the placement height, and when the automatic sorting device completes the sorting operation of all objects to be inspected, sending the sorting completion information to the merchant end, and the merchant end delivers the delivery object to the delivery address specified by the user end in combination with the delivery address reserved by the user end.

[0197] Specifically, the difference between the current sorting height and each placement height, that is, the height difference, can be obtained. According to the height difference, the objects to be picked at the current placement position are arranged in order from small to large to obtain a corresponding sorting sequence. The automatic sorting device is controlled to adjust the sorting height of the automatic sorting device to the placement height of each object to be picked in turn according to the placement height corresponding to each object to be picked in the sorting sequence, and sorting operations are performed on each object to be picked. After completing the sorting of each object to be picked in the sorting sequence, the automatic sorting device can be controlled to move to the next placement position along the shortest action route, and continue to sort each object to be picked at the next placement position until the automatic sorting device completes the sorting of all objects to be picked in the associated extraction group. When the automatic sorting device completes the sorting operation of all objects to be picked, the corresponding sorting completion information can be sent to the merchant end. After receiving the sorting completion information, the management personnel of the merchant end can arrange special delivery personnel in combination with the delivery address reserved by the user through the user end to deliver the goods purchased by the user to the designated delivery address.

[0198] Among them, the height difference refers to the difference between the current sorting height and each placement height, the sorting order sequence refers to the sequence obtained by arranging each object to be picked in combination with the height difference, the sorting completion information refers to the information that the sorting operation is completed for all objects to be inspected, the delivery object refers to the goods purchased by the user that need to be delivered, and the delivery address refers to the address reserved by the user, for example, it can be the user's home address.

[0199] Through the above implementation, automated sorting operations can be performed through automatic sorting equipment to improve sorting efficiency.

[0200] See also Figure 4 , is a structural diagram of a smart badge authentication device based on multi-party interconnection provided by an embodiment of the present invention. The data processing system of the smart badge authentication device based on multi-party interconnection includes:

[0201] A determination module, used to determine the authentication attribute of the smart badge according to the linkage authentication information of the user end, wherein the authentication attribute includes a master attribute and a subordinate attribute;

[0202] A receiving module, configured to receive item interaction information, determine delivery item addition information according to the target item purchase mode, and generate main display data or sub-display data corresponding to the delivery item addition information according to the authentication attribute;

[0203] A synchronization module, used for synchronizing the sub-display data to the main display data in real time, and dynamically displaying the main display data and / or sub-display data based on the display interface of the smart badge;

[0204] The acquisition module is used to acquire the item listing data corresponding to the smart badge of the master attribute, divide each item listing data into multiple associated extraction groups based on category, and send the associated extraction groups to the merchant end.

[0205] Figure 4 The apparatus of the embodiment shown can be used to perform Figure 1 The implementation principles and technical effects of the steps in the method embodiment shown are similar and will not be repeated here.

[0206] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A smart badge authentication method based on multi-party interconnection, characterized in that: include: Determine the authentication attribute of the smart badge according to the linkage authentication information of the user end, wherein the authentication attribute includes a master attribute and a subordinate attribute; Receive item interaction information, determine delivery item addition information according to the target item purchase mode, and generate main display data or sub-display data corresponding to the delivery item addition information according to the authentication attribute, which specifically includes: Determining an additional purchase mode of the target object according to the item interaction information, wherein the additional purchase mode includes a weighing mode and an independent mode; Based on the independent mode, the additional purchase quantity of the target object is obtained, and according to the weighing mode, the first position of the smart badge is obtained, and the second position of each weighing device is determined, and the weighing device corresponding to the second position closest to the first position is obtained as the target weighing device; Acquire the current weighing weight of the target weighing device, and obtain the delivery item addition information according to the additional purchase quantity and the current weighing weight; Determine the amount of the item corresponding to the delivery item addition information, generate a real-time amount display axis according to the master attribute, obtain main display data based on the real-time amount display axis, generate a limit amount display axis based on the subordinate attribute, and obtain sub-display data based on the limit amount display axis; Synchronizing the sub-display data to the main display data in real time, and dynamically displaying the main display data and / or the sub-display data based on the display interface of the smart badge, specifically includes: When the smart badge corresponds to the master control attribute, the display interface is divided into a main display area and a related display area; Synchronizing the restricted amount display axis to the amount display area in the associated display area, and displaying the real-time amount display axis in the amount display area in the main display area; Constructing a first display slot corresponding to the target object of the main control attribute in the main display area, and filling the display image corresponding to the target object of the main control attribute into the first display slot; Constructing a second display slot corresponding to the target object of the subordinate attribute in the associated display area, and filling the display image corresponding to the target object of the subordinate attribute into the second display slot; When the smart badge corresponds to the subordinate attribute, the limit amount display axis is displayed at a preset position on the display interface, a third display slot corresponding to the target object of the subordinate attribute is constructed, and a display image corresponding to the target object of the subordinate attribute is filled into the third display slot; Acquiring item listing data corresponding to the smart badge of the master attribute, dividing each item listing data into a plurality of associated extraction groups based on categories, and sending the associated extraction groups to the merchant end, which specifically includes: Determine the placement position of each target object in the item list data, and obtain the target object whose placement position is located in the shelf area as the object to be picked; Counting the first quantity of the same type of to-be-picked objects and the second quantity of the different types of to-be-picked objects in each of the item list data; Calculating the sum of the first quantity and the second quantity to obtain a total quantity, and determining the item similarity between each item listing data according to a ratio of the first quantity to the total quantity; Divide the item list data whose item similarity is greater than a similarity threshold into the same associated extraction group, generate the shortest action route passing through the placement points of each of the items to be picked up, and send the associated extraction group and the shortest action route to the merchant end; After sending the associated extraction group and the shortest action route to the merchant end, the method further includes: Obtaining the automatic sorting device assigned by the merchant end to the associated extraction group, and sending the shortest action route corresponding to the associated extraction group to the automatic sorting device; Controlling the automatic sorting device to go to the shooting points corresponding to the placement positions in sequence based on the shortest action route, and obtaining shelf images collected by the automatic sorting device at the shooting points; Determine the placement height of each object to be picked corresponding to the placement position point according to the shelf image, and determine the current sorting height of the automatic sorting device; The height difference between the current sorting height and each placement height is obtained, and the objects to be picked are arranged in order from small to large according to the height difference to obtain a sorting sequence, and the automatic sorting device is controlled to complete the sorting of the corresponding objects to be picked based on the sorting sequence and the placement height. When the automatic sorting device completes the sorting operation of all the objects to be inspected, the sorting completion information is sent to the merchant end, and the merchant end delivers the delivery objects to the delivery address specified by the user end in combination with the delivery address reserved by the user end.

2. The method according to claim 1, characterized in that Determining the item amount corresponding to the delivery item addition information, generating a real-time amount display axis according to the master control attribute, and obtaining main display data based on the real-time amount display axis, including: Obtaining a preset amount level segment corresponding to the amount of the item, and determining a maximum amount value and a minimum amount value of the amount level segment; The total amount span is obtained by subtracting the minimum amount from the maximum amount, the item amount is subtracted from the minimum amount to obtain the item amount span, and the item amount ratio is obtained according to the ratio of the item amount span to the total amount span; Determine the total length of the standard display axis, obtain the current display length according to the product of the total length and the item amount ratio, and generate a real-time display axis corresponding to the current display length; Amount display slots are constructed at both ends of the real-time display axis, and the minimum amount value and the item amount are filled in the amount display slots respectively to obtain the real-time amount display axis, and main display data is obtained based on the real-time amount display axis.

3. The method according to claim 1, characterized in that Generating a limit amount display axis based on the subordinate attribute, and obtaining sub-display data according to the limit amount display axis, including: Obtain the limit amount uploaded by the smart badge of the master control attribute, and obtain the current limit ratio according to the ratio of the item amount to the limit amount; Retrieving a reference display axis, determining a reference length of the reference display axis, and obtaining a restricted length according to a product of the reference length and the current restricted ratio; Determine the amount display direction of the reference display axis, obtain the starting point of the reference display axis in the amount display direction, construct an amount display slot at a position of the limited length from the starting point, and fill the amount display slot based on the item amount; Obtain the number axis segment corresponding to the limit length. When the limit length is less than the warning length threshold, update the number axis segment according to the standard pixel value. When the limit length is greater than or equal to the warning length threshold, update the number axis segment according to the warning pixel value.

4. The method according to claim 1, characterized in that: Controlling the automatic sorting device to go to the shooting points corresponding to the placement positions in sequence based on the shortest action route, and obtaining the shelf images collected by the automatic sorting device at the shooting points, including: In response to the shooting and collecting information, a plurality of preset shooting heights are determined, and the preset shooting heights are arranged from small to large to obtain a shooting height sequence; Based on the shooting height sequence, the shooting height of the shooting component of the automatic sorting device is adjusted in sequence to obtain shelf images captured by the shooting component at each of the preset shooting heights; Extracting the contours of the objects to be picked in the shelf images, and counting the total number of contours of the objects to be picked in each of the shelf images, wherein contours of the objects to be picked in different shelf images whose contour similarity is greater than a contour similarity threshold are counted as the same contour of the objects to be picked; The number of objects to be picked corresponding to the current placement position is obtained. When the total number of outlines is greater than or equal to the number of objects to be picked, the acquisition operation of the shooting component is stopped and multiple shelf images are obtained.

5. The method according to claim 4, characterized in that Determining the placement height of each to-be-picked object corresponding to the placement position point according to the shelf image includes: Arrange the shelf images from small to large according to the preset shooting height to obtain an image sequence, and sequentially determine the shelf images in the image sequence as target images; Extract all the object contours in the target image, determine that the object contours with the same vertical axis coordinate value are the same group of object contour groups, and sequentially number the object contour groups from small to large in a bottom-to-top direction to obtain the hierarchical number of each object contour group; If the same object contour group exists in adjacent target images, the level numbers of the object contour groups in the adjacent target images are synchronized; The object contour group in which the contour of the object to be picked is located is obtained as the target contour group, the level number corresponding to the target contour group is determined as the target number, and the preset placement height corresponding to the target number is determined as the placement height corresponding to the corresponding object to be picked.

6. A smart badge authentication device used in the smart badge authentication method based on multi-party interconnection as claimed in claim 1, characterized in that: include: A determination module, used to determine the authentication attribute of the smart badge according to the linkage authentication information of the user end, wherein the authentication attribute includes a master attribute and a subordinate attribute; A receiving module, configured to receive item interaction information, determine delivery item addition information according to the target item purchase mode, and generate main display data or sub-display data corresponding to the delivery item addition information according to the authentication attribute; A synchronization module, used for synchronizing the sub-display data to the main display data in real time, and dynamically displaying the main display data and / or sub-display data based on the display interface of the smart badge; The acquisition module is used to acquire the item listing data corresponding to the smart badge of the master attribute, divide each item listing data into multiple associated extraction groups based on category, and send the associated extraction groups to the merchant end.

Images