Intelligent product interactive display and sale system

Abstract

The application provides a product intelligent interactive exhibition and sale system, and relates to the technical field of automatic exhibition and sale equipment, comprising a product information storage module, a dynamic parameter monitoring module, a wisdom interaction module and an exhibition and sale terminal; the product information storage module is used for storing the photos, images and graphic and text introduction information, exhibition and sale interaction information and dynamic parameter information of the product to the cloud; the dynamic parameter monitoring module is used for detecting the current position of the product and the hand posture information of the user, and sending the detection information to the wisdom interaction module; the wisdom interaction module is used for carrying out multifunctional interactive operation according to the interactive information input by the user and the flow information in the exhibition and sale hall; the exhibition and sale terminal is used for visually displaying the product information and selling the product; the application can improve the exhibition efficiency, and can also display the corresponding product on the display screen according to the interactive action, and automatically display the position and specific information of the corresponding product, so as to achieve the effect of linkage and interconnection.

Description

Technical Field

[0001] This invention relates to the field of automated exhibition and sales equipment technology, specifically to an intelligent interactive product exhibition and sales system. Background Technology

[0002] During product demonstrations, to better enable users to understand the product's detailed features and usage, it's essential to increase user-product interaction. Traditionally, this involves sales staff providing explanations and demonstrating product use. However, this approach has low levels of automation and a poor user experience. Furthermore, it fails to effectively address the user's desire to purchase the product while learning about it. With the development of intelligent technologies, multifunctional media and sales terminals can be combined with traditional methods to achieve automated user-product interaction and sales processes, significantly improving user satisfaction.

[0003] In conclusion, overcoming the aforementioned shortcomings is a problem that urgently needs to be solved by those skilled in the art. Summary of the Invention

[0004] This solution addresses the problems and needs mentioned above by proposing an intelligent interactive product display and sales system, which solves the aforementioned technical issues through the adoption of the following technical solutions.

[0005] To achieve the above objectives, the present invention provides the following technical solution: an intelligent interactive product display and sales system, comprising: a product information storage module, a dynamic parameter monitoring module, an intelligent interaction module, and a display and sales terminal;

[0006] The product information storage module is used to store product photos, videos, graphic and textual descriptions, sales interaction information, and dynamic parameter information of the product to the cloud.

[0007] The dynamic parameter monitoring module is used to detect the current position of the product and the user's hand posture information, and send the detection information to the intelligent interaction module;

[0008] The intelligent interaction module is used to perform multi-functional interactive operations based on the interactive information input by the user and the flow of people in the exhibition hall;

[0009] The display and sales terminal is connected to the product information storage module, and the display and sales terminal is used to visually display product information and sell products.

[0010] Furthermore, the product information storage module includes a cloud storage module, a storage management module, and a product information retrieval list. Both the product information retrieval list and the cloud storage module are connected to the storage management module. The storage management module is used to associate the product information retrieval list with the product display and sales information, product number, name, keywords, and production date stored in the cloud storage module, and to dynamically update and manage the stored data. The product information retrieval list includes the product number, name, keywords, and production date.

[0011] Furthermore, the dynamic parameter monitoring module includes an infrared detection module and a visual monitoring system;

[0012] The infrared detection module is installed on the product display stand. The infrared detection module includes several sets of infrared detection circuits, radio frequency receiving modules, and controllers. Each set of infrared detection circuits includes an infrared detector and a radio frequency transmitting module. The infrared detector is used to detect whether the product has left the display stand. When the product is detected to have left the display stand, the detection information is sent to the radio frequency receiving module through the radio frequency transmitting module. The controller is connected to the radio frequency receiving module. The controller determines the product number that has left the display stand based on the transmitted detection signal and transmits the number information to the visual monitoring system.

[0013] The visual monitoring system includes a multi-angle image acquisition module and a gesture position recognition module. The multi-angle image acquisition module includes an image sensor, a multi-angle control console, and a motor drive device for controlling the rotation of the multi-angle control console. The image sensor is mounted on the multi-angle control console and, upon receiving detection information that the product has left the display stand, acquires image information of the user's hand and transmits the image information to the gesture position recognition module for recognizing the relative position information of the user's hand and the product.

[0014] Furthermore, the process by which the gesture position recognition module recognizes the relative position information of the user's hand and the product is as follows:

[0015] Acquire three sets of images of the user's hand from different angles;

[0016] The acquired image information of each group of users' hands is processed into grayscale to obtain grayscale images;

[0017] Then, adaptive threshold image processing is performed on the grayscale image to separate the hand and product areas from the background area to obtain the region of interest image, and pixel value statistics are performed on the region of interest image.

[0018] Based on the set pixel threshold, the hand pixel region is confirmed, and the coordinate values ​​of the index finger's skeletal structure in the region of interest image and the coordinate values ​​of the top, bottom, left, and right ends of the product are calculated. The horizontal and vertical proportions of the index finger's coordinate values ​​are calculated, whereby the horizontal proportion is the ratio of the x-axis value of the index finger's tip to the difference between the x-coordinates of the left and right ends, and the vertical proportion is the ratio of the y-axis value of the index finger's tip to the difference between the y-coordinates of the top and bottom ends.

[0019] The system obtains three sets of coordinate ratios from different angles. Based on the average of the three sets of coordinate ratios, it determines the position of the user's hand on the product and transmits the identified position information to the smart interaction module to display the corresponding position and function of the product.

[0020] Furthermore, the process of determining the coordinate values ​​of the left and right ends of the product is as follows: draw a horizontal line through the coordinate point of the index finger's tip, and the points where the horizontal line intersects with the left and right sides of the product are the left and right end coordinate values, respectively. The process of determining the coordinate values ​​of the top and bottom ends of the product is as follows: draw a vertical line through the coordinate point of the index finger's tip that is perpendicular to the horizontal line, and the points where the vertical line intersects with the top and bottom sides of the product are the top and bottom end coordinate values, respectively.

[0021] Furthermore, the intelligent interaction module includes an operation discrimination module and an interactive information output module. The operation discrimination module receives infrared detection information sent by the dynamic parameter monitoring module to determine whether the product has been picked up or put down. When the product is detected to have been picked up, it obtains the position information of the user's hand on the product based on visual monitoring information, and determines the corresponding position on the product based on the identified position. The interactive information output module outputs interactive control information to the display and sales terminal to control the display and sales terminal to display information on the corresponding position and function of the product. When the product is detected to have been put down, it controls the display and sales terminal to continue to visualize the original display information.

[0022] Furthermore, the intelligent interaction module also includes a crowd density detection module. The crowd density detection module is used to acquire the image information of people in the current exhibition hall, calculate the crowd density information according to the crowd density detection algorithm, and send the crowd density detection information to the exhibition and sales terminal through the interactive information output module. The exhibition and sales terminal then displays product information according to the display scheme and rules set based on the crowd density.

[0023] Furthermore, the sales terminal includes a visualization module and a sales management module; the visualization module is used to acquire stored product display information, and to display the product display information and sales information on a display screen and acquire user selection instructions; the sales management module is used to manage product sales orders based on user purchase information.

[0024] Furthermore, the product sales method for managing product sales orders based on user purchase information includes:

[0025] Obtain user instruction information, access the product details page according to the user instruction information, and display the details page. Based on the user's selection information, proceed to view detailed information about the product's photos, images, details, and parameters.

[0026] Obtain the product's QR code information, access the product's purchase page based on the QR code information, display the purchase page and the mailing function option, and store the delivery address information when the user's input delivery address information is detected.

[0027] When a purchase order is submitted through the purchase page and a successful payment message is received, return and mailing options are displayed.

[0028] When the option to return the product is detected, a message to refund the user is sent to the management server. If the option to mail the product is detected, a message to remind the user to ship the product is sent to the management server.

[0029] As can be seen from the above technical solution, the beneficial effects of the present invention are: the present invention can improve display efficiency, and can also display the corresponding products on the display screen according to the interactive actions, and automatically display the location and specific information of the corresponding products, so as to achieve the effect of linkage and interconnection, and greatly improve the user experience satisfaction.

[0030] In addition to the objectives, features, and advantages described above, the preferred embodiments of the invention will be described in more detail below with reference to the accompanying drawings, so as to facilitate a better understanding of the features and advantages of the invention. Attached Figure Description

[0031] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the accompanying drawings used in the description of the embodiments of the present invention or the prior art will be briefly introduced below. The accompanying drawings are only used to illustrate some embodiments of the present invention, and are not intended to limit all embodiments of the present invention to this.

[0032] Figure 1 This is a schematic diagram of the composition structure of an intelligent interactive product display and sales system according to the present invention.

[0033] Figure 2 This is a schematic diagram of the composition of the dynamic parameter monitoring module in this invention.

[0034] Figure 3 This is a schematic diagram of the composition structure of the intelligent interaction module in this invention.

[0035] Figure 4This is a schematic diagram illustrating the specific steps of the process for recognizing the relative position information of the user's hand and the product in this embodiment.

[0036] Figure 5 This is a schematic diagram illustrating the specific steps of the product sales method in this embodiment. Detailed Implementation

[0037] To make the objectives, technical solutions, and advantages of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. The same reference numerals in the drawings represent the same components. It should be noted that the described embodiments are only some, not all, of the embodiments of the present invention. All other embodiments obtained by those skilled in the art based on the described embodiments of the present invention without creative effort are within the scope of protection of the present invention.

[0038] This application first stores photos, videos, and textual descriptions of the products to be exhibited in the cloud, and then manages this information in a structured manner, assigning numbers, names, keywords, and product production dates for easy and automatic retrieval. The products are then visualized on the sales terminal. During user interaction with the products, a dynamic parameter monitoring module detects the product's current position and the user's hand posture in real time. Based on the detection results, the relative position of the user's hand and the product is identified, and the display terminal visually displays and explains the product's details. When the product is detected as being placed down, the original display continues. Furthermore, the display information and plan can be automatically adjusted based on the density of people in the exhibition hall. During the sales process, users can purchase products by accessing the sales management module on the sales terminal, achieving a synergistic effect and greatly improving user experience and satisfaction.

[0039] like Figures 1 to 5 As shown, the intelligent interactive sales system for this product includes: a product information storage module, a dynamic parameter monitoring module, a smart interaction module, and a sales terminal.

[0040] The product information storage module is used to store product photos, videos, graphic and textual descriptions, sales interaction information, and dynamic parameter information of the product in the cloud.

[0041] The product information storage module includes a cloud storage module, a storage management module, and a product information retrieval list. Both the product information retrieval list and the cloud storage module are connected to the storage management module. The storage management module is used to associate the product information retrieval list with the product display and sales information, product number, name, keywords, and production date stored in the cloud storage module, and to dynamically update and manage the stored data. The product information retrieval list includes the product number, name, keywords, and production date.

[0042] The photos, videos, and text descriptions of the products to be exhibited are first stored in the cloud, and then numbered, named, labeled with keywords and the product production date to facilitate quick and automatic retrieval by the exhibition and sales terminals.

[0043] The dynamic parameter monitoring module is used to detect the current position of the product and the user's hand posture information, and sends the detection information to the intelligent interaction module. When the user interacts with the product, the system detects the product's position and the position pointed to by the user's index finger. Based on the detection results, the system provides detailed introductions and demonstrations of the product's specific functions and materials through the sales terminal.

[0044] Specifically, the dynamic parameter monitoring module includes an infrared detection module and a visual monitoring system. The infrared detection module is mounted on the product display stand and includes several sets of infrared detection circuits, a radio frequency (RF) receiving module, and a controller. Each set of infrared detection circuits includes an infrared detector and an RF transmitting module. The infrared detector detects whether the product has left the display stand. When a product leaves the display stand, the detection information is transmitted to the RF receiving module via the RF transmitting module. The controller is connected to the RF receiving module and determines the product number that left the display stand based on the transmitted detection signal, then transmits this number information to the visual monitoring system. The visual monitoring system includes a multi-angle image acquisition module and a gesture position recognition module. The multi-angle image acquisition module includes an image sensor, a multi-angle control console, and a motor drive device that controls the rotation of the multi-angle control console. The image sensor is mounted on the multi-angle control console and, upon receiving detection information that a product has left the display stand, acquires an image of the user's hand and transmits this image information to the gesture position recognition module for recognizing the relative position of the user's hand and the product.

[0045] In this embodiment, the display stand is a conventional item display stand. When inspecting items, the infrared detection module only needs to be placed below the product placement position on the display stand. The detection information of each product is transmitted to the controller via wireless transmission. The controller then sends the image acquisition signal to the multi-angle image acquisition module. The multi-angle image acquisition module is set in an unobstructed position that can collect image information of the user's hand and the product.

[0046] like Figure 4 As shown, the process by which the gesture position recognition module recognizes the relative position information of the user's hand and the product is as follows:

[0047] S1: Acquire image information of the user's hand from three different angles;

[0048] S2: Perform grayscale processing on the acquired image information of each group of users' hands to obtain grayscale images;

[0049] S3: Then, adaptive threshold image processing is performed on the grayscale image to separate the hand and product areas from the background area in the image to obtain the region of interest image, and pixel value statistics are performed on the region of interest image.

[0050] S4: Based on the set pixel threshold, confirm the hand pixel area, calculate the coordinate values ​​of the index finger tip in the region of interest image and the coordinate values ​​of the top, bottom, left, and right ends of the product, and calculate the horizontal and vertical proportions of the index finger tip coordinate values. The horizontal proportion is the ratio of the x-axis x-coordinate value of the index finger tip to the difference between the x-coordinates of the left and right ends, and the vertical proportion is the ratio of the y-axis y-coordinate value of the index finger tip to the difference between the y-coordinates of the top and bottom ends. The process of determining the left and right end coordinate values ​​of the product is to draw a horizontal line through the index finger tip coordinate point, and the points where the horizontal line intersects the left and right lines of the product are the left and right end coordinate values, respectively. The process of determining the top and bottom end coordinate values ​​of the product is to draw a vertical line through the index finger tip coordinate point perpendicular to the horizontal line, and the points where the vertical line intersects the top and bottom lines of the product are the top and bottom end coordinate values, respectively.

[0051] S5: Obtain three sets of coordinate ratios from different angles, determine the position of the user's hand on the product based on the average of the three sets of coordinate ratios, and transmit the identified position information to the smart interaction module to display the corresponding position and function information of the product.

[0052] The intelligent interaction module is used to perform multi-functional interactive operations based on user-input interactive information and pedestrian flow information in the exhibition hall. The intelligent interaction module includes an operation discrimination module, an interactive information output module, and a pedestrian flow density detection module. The operation discrimination module receives infrared detection information sent by the dynamic parameter monitoring module to determine whether a product has been picked up or put down. When a product is detected as being picked up, it obtains the position information of the user's hand on the product based on visual monitoring information, determines the corresponding position on the product based on the identified position, and outputs interactive control information to the exhibition terminal through the interactive information output module. This controls the exhibition terminal to display information about the corresponding position and function of the product. When a product is detected as being put down, it controls the exhibition terminal to continue displaying the original information. The pedestrian flow density detection module obtains the image information of people in the current exhibition hall, calculates the pedestrian density information based on a crowd density detection algorithm, and sends the pedestrian density detection information to the exhibition terminal through the interactive information output module. The exhibition terminal then displays product information according to a display scheme and rules set based on the pedestrian density.

[0053] The sales terminal is connected to the product information storage module. The sales terminal is used for visually displaying product information and selling products. The sales terminal includes a visualization module and a sales management module. The visualization module is used to acquire stored product display information and display the product display and sales information on a smart display screen, as well as to acquire user selection instructions. The sales management module is used to manage product sales orders based on user purchase information.

[0054] like Figure 5 As shown, the product sales method for managing product sales orders based on user purchase information includes:

[0055] S1: Obtain the user's instruction information, access the product details page according to the user's instruction information, and display the details page. Based on the user's selection information, proceed to view the product's photos, images, details, and parameters in detail.

[0056] S2: Obtain the product's QR code information, access the product's purchase page based on the QR code information, display the purchase page and the mailing function option, and store the delivery address information when the user's input delivery address information is detected.

[0057] S3: When a purchase order is submitted through the purchase page and a message indicating successful payment is received, the return and mailing options are displayed;

[0058] S4: When the option to return the product is detected, send a refund message to the management server. If the option to mail the product is detected, send a shipping reminder message to the management server.

[0059] It should be noted that the embodiments described in this invention are merely preferred ways of implementing this invention. Any modifications that are merely obvious and belong to the overall concept of this invention should be within the protection scope of this invention.

Claims

1. A product intelligent interactive display and sale system, characterized in that, include: Product information storage module, dynamic parameter monitoring module, intelligent interaction module, and sales terminal; The product information storage module is used to store product photos, videos, graphic and textual descriptions, sales interaction information, and dynamic parameter information of the product in the cloud. The dynamic parameter monitoring module is used to detect the current position of the product and the user's hand posture information, and send the detection information to the intelligent interaction module; The intelligent interaction module is used to perform multi-functional interactive operations based on the interactive information input by the user and the flow of people in the exhibition hall; The display and sales terminal is connected to the product information storage module, and the display and sales terminal is used to visually display product information and sell products; The dynamic parameter monitoring module includes an infrared detection module and a visual monitoring system; The infrared detection module is installed on the product display stand. The infrared detection module includes several sets of infrared detection circuits, radio frequency receiving modules, and controllers. Each set of infrared detection circuits includes an infrared detector and a radio frequency transmitting module. The infrared detector is used to detect whether the product has left the display stand. When the product is detected to have left the display stand, the detection information is sent to the radio frequency receiving module through the radio frequency transmitting module. The controller is connected to the radio frequency receiving module. The controller determines the product number that has left the display stand based on the transmitted detection signal and transmits the number information to the visual monitoring system. The visual monitoring system includes a multi-angle image acquisition module and a gesture position recognition module. The multi-angle image acquisition module includes an image sensor, a multi-angle control console, and a motor drive device for controlling the rotation of the multi-angle control console. The image sensor is set on the multi-angle control console and, after receiving detection information that the product leaves the display stand, acquires image information of the user's hand and transmits the image information to the gesture position recognition module to identify the relative position information of the user's hand and the product. The process by which the gesture position recognition module recognizes the relative position information of the user's hand and the product is as follows: Acquire three sets of images of the user's hand from different angles; The acquired image information of each group of users' hands is processed into grayscale to obtain grayscale images; Then, adaptive threshold image processing is performed on the grayscale image to separate the hand and product areas from the background area to obtain the region of interest image, and pixel value statistics are performed on the region of interest image. Based on the set pixel threshold, the hand pixel region is confirmed, and the coordinate values ​​of the index finger's skeletal structure in the region of interest image and the coordinate values ​​of the top, bottom, left, and right ends of the product are calculated. The horizontal and vertical proportions of the index finger's coordinate values ​​are calculated, whereby the horizontal proportion is the ratio of the x-axis value of the index finger's tip to the difference between the x-coordinates of the left and right ends, and the vertical proportion is the ratio of the y-axis value of the index finger's tip to the difference between the y-coordinates of the top and bottom ends. The system obtains three sets of coordinate ratios from different angles. Based on the average of the three sets of coordinate ratios, it determines the position of the user's hand on the product and transmits the identified position information to the smart interaction module to display the corresponding position and function of the product. The process for determining the coordinate values ​​of the left and right ends of the product is as follows: draw a horizontal line through the coordinate point at the end of the index finger, and the points where the horizontal line intersects with the left and right sides of the product are the coordinate values ​​of the left and right ends, respectively. The process for determining the coordinate values ​​of the top and bottom ends of the product is as follows: draw a vertical line through the coordinate point at the end of the index finger that is perpendicular to the horizontal line, and the points where the vertical line intersects with the top and bottom sides of the product are the coordinate values ​​of the top and bottom ends, respectively.

2. The product intelligentized interactive display and sale system according to claim 1, characterized in that, The product information storage module includes a cloud storage module, a storage management module, and a product information retrieval list. Both the product information retrieval list and the cloud storage module are connected to the storage management module. The storage management module is used to associate the product information retrieval list with the product display and sales information, product number, name, keywords, and production date stored in the cloud storage module, and to dynamically update and manage the stored data. The product information retrieval list includes the product number, name, keywords, and production date.

3. The product intelligentized interactive display and sale system according to claim 1, characterized in that, The intelligent interaction module includes an operation discrimination module and an interactive information output module. The operation discrimination module receives infrared detection information sent by the dynamic parameter monitoring module to determine whether the product has been picked up or put down. When the product is detected to have been picked up, it obtains the position information of the user's hand on the product based on visual monitoring information, and determines the corresponding position on the product based on the identified position. The interactive information output module outputs interactive control information to the display and sales terminal to control the display and sales terminal to display information on the corresponding position and function of the product. When the product is detected to have been put down, it controls the display and sales terminal to continue to visualize the original display information.

4. The product intelligentized interactive display and sale system of claim 3, wherein, The intelligent interaction module also includes a crowd density detection module. The crowd density detection module is used to acquire the image information of people in the current exhibition hall, calculate the crowd density information according to the crowd density detection algorithm, and send the crowd density detection information to the exhibition and sales terminal through the interactive information output module. The exhibition and sales terminal then displays product information according to the display scheme and rules set based on the crowd density.

5. The product intelligentized interactive display and sale system according to claim 1, characterized in that, The sales terminal includes a visualization module and a sales management module; the visualization module is used to acquire stored product display information, and to display the product display information and sales information on the display screen and acquire user selection instructions. The sales management module is used to manage product sales orders based on user purchase information.

6. The product intelligentized interactive display and sale system of claim 5, wherein, The product sales method for managing product sales orders based on user purchase information includes: Obtain user instruction information, access the product details page according to the user instruction information, and display the details page. Based on the user's selection information, proceed to view the product's photos, images, details, and parameters in detail. Obtain the product's QR code information, access the product's purchase page based on the QR code information, display the purchase page and the mailing function option, and store the delivery address information when the user's input delivery address information is detected. When a purchase order is submitted through the purchase page and a successful payment message is received, return and mailing options are displayed. When the option to return the product is detected, a message to refund the user is sent to the management server. If the option to mail the product is detected, a message to remind the user to ship the product is sent to the management server.

Images