A shopping process control method, device and user terminal

Abstract

The present invention provides a shopping process control method, device and user terminal, wherein the method includes: receiving a shopping instruction to open the shopping compartment of an automatic vending machine; identifying the user's shopping behavior and generating prompt information; Signal; identify the product captured by the user, confirm the product information of the product captured by the user, and generate a shopping list based on the product information; the product information includes the product type and product quantity; receive the settlement instruction generated by the user closing the shopping warehouse, according to the shopping list The list shows the settlement interface. The present invention realizes automatic real-time prompts for each step of the user's shopping process in an open shopping environment, automatically identifies and judges the products purchased by the user, generates a shopping list, provides convenience for the user's shopping process, and improves the efficiency of the user's shopping. Reduce labor costs, shorten settlement time, high settlement efficiency, simple shopping process, and improve user experience.

Description

technical field

[0001] The present invention relates to the technical field of image recognition, and more specifically, to a shopping process control method, device and user terminal. Background technique

[0002] Material circulation is the most basic element of human society. As an important means of current material circulation, the retail industry or open related industries that sell directly to consumers (hereinafter referred to as the retail industry or retail enterprises) need to employ a large number of cashiers to realize the purchase and sale of goods. The purchased items are counted one by one, and after the statistics are completed, the payment is completed together with the consumer.

[0003] The automatic vending cabinet solves the defects of manual statistics and manual settlement in the retail industry, and is a consumer-oriented sales method with unmanned sales and automatic settlement. Through the user's selection, the types and total value of the commod...

Examples

Embodiment 1

[0068] refer to figure 2 , the first embodiment of the present invention provides a shopping process control method, including:

[0069] Step S100, receiving a shopping instruction, and opening the shopping compartment of the vending machine according to the shopping instruction;

[0070] As mentioned above, the shopping process control method provided by this embodiment can be applied to an open shopping environment, such as shopping malls, supermarkets and other places, that is, unattended, and users can freely pick up goods. In this embodiment, it can be an open vending machine. After the user starts shopping, the door of the vending machine is opened, and the user directly takes the goods inside, and the vending machine monitors the user's shopping through the image acquisition device. Behaviors and purchased items are identified and counted to realize the final settlement of the user's purchased items.

[0071] As mentioned above, the shopping instruction can be genera...

Embodiment 2

[0089] refer to image 3 , the second embodiment of the present invention provides a shopping process control method, based on the above figure 2 In the first embodiment shown, in the step S300, "according to the shopping action start instruction, identify the user's shopping action, and generate prompt information according to the identified shopping action, so as to facilitate the The prompt information "prompts the user" includes:

[0090] Step S310, collecting the shopping behavior image of the user according to the shopping action start instruction;

[0091] As mentioned above, the shopping behavior image may be a plurality of single-frame static pictures, static pictures with a certain time sequence, or may be a video file or a dynamic picture file. In this embodiment, it is dynamic video data.

[0092] Step S320, extracting an initial key frame in the shopping behavior image, identifying the initial key frame, and confirming the user's upper limb outline in the init...

Embodiment 3

[0104] refer to Figure 4 , the third embodiment of the present invention provides a shopping process control method, based on the above image 3 In the second embodiment shown, in the step S340, "based on the three-dimensional coordinates of the joint points of the upper limbs, identify the shopping behavior of the user, and generate prompt information according to the identified shopping behavior, In order to prompt the user according to the prompt information", including:

[0105] Step S341, taking the coordinates of the left and right elbow joints, the coordinates of the left and right hands, and the coordinates of the left and right shoulders in the three-dimensional coordinates of the joint points of the upper limbs as key points;

[0106] As mentioned above, the three-dimensional coordinates of upper limb joint points may include, but not limited to, left and right elbow coordinates, left and right hand coordinates, left and right shoulder coordinates, central axis coo...

technical field

[0001] The present invention relates to the technical field of image recognition, and more specifically, to a shopping process control method, device and user terminal. Background technique

[0002] Material circulation is the most basic element of human society. As an important means of current material circulation, the retail industry or open related industries that sell directly to consumers (hereinafter referred to as the retail industry or retail enterprises) need to employ a large number of cashiers to realize the purchase and sale of goods. The purchased items are counted one by one, and after the statistics are completed, the payment is completed together with the consumer.

[0003] The automatic vending cabinet solves the defects of manual statistics and manual settlement in the retail industry, and is a consumer-oriented sales method with unmanned sales and automatic settlement. Through the user's selection, the types and total value of the commod...

Examples

Embodiment 1

[0068] refer to figure 2 , the first embodiment of the present invention provides a shopping process control method, including:

[0069] Step S100, receiving a shopping instruction, and opening the shopping compartment of the vending machine according to the shopping instruction;

[0070] As mentioned above, the shopping process control method provided by this embodiment can be applied to an open shopping environment, such as shopping malls, supermarkets and other places, that is, unattended, and users can freely pick up goods. In this embodiment, it can be an open vending machine. After the user starts shopping, the door of the vending machine is opened, and the user directly takes the goods inside, and the vending machine monitors the user's shopping through the image acquisition device. Behaviors and purchased items are identified and counted to realize the final settlement of the user's purchased items.

[0071] As mentioned above, the shopping instruction can be genera...

Embodiment 2

[0089] refer to image 3 , the second embodiment of the present invention provides a shopping process control method, based on the above figure 2 In the first embodiment shown, in the step S300, "according to the shopping action start instruction, identify the user's shopping action, and generate prompt information according to the identified shopping action, so as to facilitate the The prompt information "prompts the user" includes:

[0090] Step S310, collecting the shopping behavior image of the user according to the shopping action start instruction;

[0091] As mentioned above, the shopping behavior image may be a plurality of single-frame static pictures, static pictures with a certain time sequence, or may be a video file or a dynamic picture file. In this embodiment, it is dynamic video data.

[0092] Step S320, extracting an initial key frame in the shopping behavior image, identifying the initial key frame, and confirming the user's upper limb outline in the init...

Embodiment 3

[0104] refer to Figure 4 , the third embodiment of the present invention provides a shopping process control method, based on the above image 3 In the second embodiment shown, in the step S340, "based on the three-dimensional coordinates of the joint points of the upper limbs, identify the shopping behavior of the user, and generate prompt information according to the identified shopping behavior, In order to prompt the user according to the prompt information", including:

[0105] Step S341, taking the coordinates of the left and right elbow joints, the coordinates of the left and right hands, and the coordinates of the left and right shoulders in the three-dimensional coordinates of the joint points of the upper limbs as key points;

[0106] As mentioned above, the three-dimensional coordinates of upper limb joint points may include, but not limited to, left and right elbow coordinates, left and right hand coordinates, left and right shoulder coordinates, central axis coo...

Images