AI intelligent trolley with virtual human assistant and use method thereof

Abstract

The invention discloses an AI intelligent trolley with a virtual human assistant and a using method thereof.The AI intelligent trolley comprises a trolley body and trundles arranged at the bottom of the trolley body, and the trolley body is provided with the virtual human shopping assistant used for providing shopping guidance. The virtual human display device comprises a plurality of modules such as a data processing module, an image generation module, a display module, an input module, an output module, an artificial intelligence module, a network communication module, an indoor positioning module and a storage module, so that the virtual human display device is arranged to provide intelligent shopping service for a user; the AI intelligent trolley not only has basic functions of a traditional trolley, but also integrates various intelligent modules, and can provide rich interaction experience and convenient service, thereby improving shopping satisfaction and efficiency of users.

Description

Technical Field

[0001] The present invention relates to the technical field of AI intelligence, and in particular to an AI smart trolley with a virtual human assistant and a method of using the same. Background Art

[0002] As people's living standards continue to improve and the pace of life continues to accelerate, people's requirements for the convenience and speed of shopping in shopping malls are getting higher and higher. Traditional shopping carts only have basic carrying functions and cannot meet the diverse needs of users during shopping. With the development of artificial intelligence technology, consumers expect to obtain convenient information query, personalized services and rich interactive experience during the shopping process, so as to realize various functions such as shopping guides, voice interaction, and face recognition. Summary of the invention

[0003] In view of this, an object of the present invention is to provide an AI smart trolley with a virtual human assistant and a method of using the same, so as to provide smart shopping services.

[0004] The technical solution adopted by the present invention to solve the technical problem is:

[0005] An AI smart shopping cart with a virtual human assistant comprises a cart body and casters arranged at the bottom of the cart body, the cart body is provided with a virtual human shopping assistant for providing shopping guidance, and the casters are provided with a locking mechanism capable of locking the casters;

[0006] The virtual shopping assistant includes:

[0007] Data processing module: including central processing unit and graphics processing unit, used for logical operations, data management and application execution, as well as image processing;

[0008] Image generation module: including a graphics rendering engine, capable of generating high-quality virtual human images in real time based on the preset virtual human model and animation data;

[0009] Display module: including a touch screen display, supporting multi-touch operation and providing a clear visual experience;

[0010] Input module: including a camera and a microphone array, used to identify the user's facial information and collect the user's voice information;

[0011] Output module: including a speaker for playing the voice output of the virtual person;

[0012] Artificial intelligence module: integrates natural language processing, emotion recognition and behavior prediction to understand user needs and respond accordingly;

[0013] Network communication module: supports Wi-Fi or Bluetooth connection to achieve communication with the Internet and wireless control of the locking mechanism;

[0014] Indoor positioning module: uses Bluetooth beacon or UWB technology to achieve accurate indoor positioning;

[0015] Storage module: used to store the operating system, applications, and user data.

[0016] In a preferred embodiment of the present invention, the locking mechanism includes an electromagnetic lock disposed at the bottom of the vehicle body and communicatively connected to the network communication module, and a friction block disposed at the output end of the electromagnetic lock and capable of abutting against the outer side of the caster.

[0017] The present invention also provides a method for using the AI ​​smart trolley, the method steps comprising:

[0018] S1. Establish a temporary information database for temporary storage of user identity information to identify the user;

[0019] S2. When the user uses the AI ​​smart trolley as described above to shop, when entering the pick-up area to pick up the AI ​​smart trolley, the virtual human shopping assistant is started and the user's face is photographed through the camera on the input module, and then the user's face information is stored in the temporary information database, and the network communication module controls the lock mechanism to unlock, and at this time the display module displays a virtual human to provide shopping guide services for the user;

[0020] S3. After the AI ​​smart trolley is taken out from the pick-up area, the artificial intelligence module generates a dialogue content for communicating with the user, and the speaker on the output module outputs voice to communicate with the user, and the microphone on the input module collects the user's voice information, and the ASR system accurately extracts and recognizes the voice information, converts the user's voice command into data information that can be processed by the system, so as to identify the user's shopping needs;

[0021] S4. When shopping is completed and the AI ​​smart trolley is pushed back to the car pick-up area, the indoor positioning module senses that the AI ​​smart trolley is in the car pick-up area, and the camera on the input module observes that the user has left, then the network communication module will be used to control the locking mechanism to lock the car, and the user identity information stored in the temporary information data will be cleared.

[0022] In a preferred embodiment of the present invention, S3 further comprises:

[0023] S310. During the shopping process, the camera on the input module will track the user. When the user is beyond the recognition range of the camera and the time exceeds 1-3 minutes, the network communication module will control the lock mechanism to lock the car and then start timing, and the timing time is 3-30 minutes.

[0024] In a preferred embodiment of the present invention, the S310 further includes:

[0025] S311. When the timing time is exceeded, the indoor positioning module will locate the position of the AI ​​smart trolley, and feed back the location information of the AI ​​smart trolley to the background through the network communication module, and notify the mall staff to handle it.

[0026] In a preferred embodiment of the present invention, the S310 further includes:

[0027] S312. When the camera recognizes the user again within the timing time, the network communication module controls the lock and the vehicle locking mechanism to unlock.

[0028] In a preferred embodiment of the present invention, S3 further comprises:

[0029] S320. Establish a product information database for storing product information.

[0030] The product information includes basic information, parameter specifications, functional characteristics, price information, instructions for use, and sales area. When the user needs to view the product information, the display screen on the display module will display several sections of the product information for the user to click and select to view.

[0031] In a preferred embodiment of the present invention, the S320 further includes:

[0032] S321. When the user expresses the intention to purchase a product, the location of the product sales area will be displayed on the display screen.

[0033] In a preferred embodiment of the present invention, the S321 further includes:

[0034] S322. The indoor positioning module will locate the position of the AI ​​smart cart and plan the route through the A* algorithm to help the user navigate to the product sales area.

[0035] In a preferred embodiment of the present invention, S2 further comprises:

[0036] S210. Establish a virtual human character image database for storing a plurality of virtual human character images for users to select.

[0037] The beneficial effect of the present invention is that the AI ​​smart trolley includes a body and casters, a virtual human shopping assistant providing shopping guidance is provided on the body, and a locking mechanism capable of locking the casters is provided on the casters. In this way, by providing a virtual human shopping assistant to serve the user, the AI ​​smart trolley not only has the basic functions of a traditional trolley, but also integrates a variety of intelligent modules, can provide a rich interactive experience and convenient services, thereby improving the user's shopping satisfaction and efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] Figure 1 is a schematic diagram of an AI smart cart with a virtual human assistant of the present invention;

[0039] Figure 2 It is a schematic diagram of a locking mechanism in an AI smart trolley with a virtual human assistant of the present invention;

[0040] Figure 3 It is a flow chart of a method for using an AI smart trolley of the present invention;

[0041] Figure 4 It is a flow chart of steps S310-S312 in a method for using an AI smart cart of the present invention;

[0042] Figure 5 It is a flow chart of steps S320-S322 in a method for using an AI smart cart of the present invention. DETAILED DESCRIPTION

[0043] The technical solutions in the embodiments of the present invention will be described clearly and completely below in conjunction with the accompanying drawings.

[0044] Reference Figure 1 to Figure 2 An AI smart trolley with a virtual human assistant comprises a body 1 and casters 2 arranged at the bottom of the body 1, wherein the body 1 is provided with a virtual human shopping assistant 3 for displaying the virtual human assistant, and the casters 2 are provided with a locking mechanism 4 for locking the casters 2. In this way, by providing a virtual human shopping assistant 3 to serve the user, the AI ​​smart trolley not only has the basic functions of a traditional trolley, but also integrates a variety of intelligent modules, can provide a rich interactive experience and convenient services, thereby improving the user's shopping satisfaction and efficiency. The virtual human shopping assistant 3 can be purchased on the market.

[0045] Specifically, the virtual human shopping assistant 3 includes the following modules:

[0046] Data processing module: It consists of a central processing unit (CPU) and a graphics processing unit (GPU). As the core computing unit of the entire system, the CPU is responsible for processing various data instructions, including but not limited to the analysis of user input data, the judgment of system operation logic, and data interaction with other modules. The GPU focuses on image-related data processing, such as rendering preprocessing of virtual human images, generation of graphic effects, etc. The two work together to ensure the efficiency and accuracy of system data processing, and ensure that the virtual human assistant can quickly respond to various operations and requests from users.

[0047] Image generation module: built-in integrated high-performance graphics rendering engine. Based on the preset virtual human model and rich animation data, the engine can generate realistic virtual human images with rich expressions and movements in real time. By carefully constructing the appearance features, body movement library and facial expression library of the virtual human model, and combining the flexible use of animation data, a highly attractive and interactive virtual image can be presented on the display module, which greatly enhances the visual interaction effect with the user and makes the shopping process no longer boring and monotonous.

[0048] Display module: It uses a high-resolution touch screen display and supports multi-touch operation. The high-resolution screen can clearly display the virtual human image generated by the image generation module, allowing users to intuitively feel the image and expression changes of the virtual assistant. The multi-touch function provides users with a convenient way of interaction. Users can use simple touch operations such as clicking, sliding, zooming and other gestures to input relevant instructions, such as querying product information, selecting shopping routes, etc., to interact with the smart shopping assistant conveniently and quickly, realizing seamless human-computer interaction.

[0049] Input module: equipped with high-definition camera and microphone array. The high-definition camera is used to identify the user's facial information, which can realize functions such as face recognition login and emotion analysis based on user expressions, further enriching the dimension of interaction. The microphone array is used to collect the user's voice information. It can receive sound signals from different directions, and accurately extract and recognize voice information through advanced voice recognition algorithms, converting the user's voice commands into data information that can be processed by the system, thereby realizing functions such as voice control and query, freeing the user's hands and allowing them to focus more on the shopping process.

[0050] Output module: Built-in high-fidelity speakers. When the system generates voice responses based on the user's interactive needs, the high-fidelity speakers can play the voice information clearly and realistically, providing high-quality auditory feedback. Whether it is the virtual assistant's shopping suggestions, product information introductions or navigation guidance voice, they can be conveyed to the user in a clear and pleasant voice, ensuring that the user will not miss any important information, improving the integrity of the interactive experience.

[0051] Artificial Intelligence Module: Integrates advanced AI technologies such as natural language processing (NLP), emotion recognition and behavior prediction. NLP technology enables the virtual assistant to understand the user's natural language questions or instructions, accurately analyze semantics, and generate reasonable, accurate and logical responses to provide users with personalized shopping advice and suggestions. The emotion recognition function can judge the user's emotional state based on information such as voice tone and facial expressions, so as to adjust the response strategy and provide more considerate services. Behavior prediction technology predicts the user's possible needs in advance through a comprehensive analysis of the user's shopping history, current shopping behavior and environmental information, such as recommending related products and planning the best shopping route, further improving the convenience and efficiency of shopping.

[0052] Network communication module: Use Wi-Fi or Bluetooth connection to establish a communication connection with the Internet. Through this connection, on the one hand, data can be uploaded and downloaded, such as updating the product information database, obtaining real-time promotion information, etc.; on the other hand, the locking mechanism 4 can be wirelessly controlled to work.

[0053] Indoor positioning module: Uses Bluetooth beacon or UWB (ultra-wideband) technology to achieve accurate indoor positioning. In indoor environments such as large supermarkets or shopping malls, this module can accurately determine the location information of the trolley and combine it with the mall's indoor map system. Users can use the virtual assistant to query their location and the location of the target product, and obtain navigation route guidance to quickly find the desired product, greatly saving shopping time and improving the convenience of the shopping experience.

[0054] Storage module: including memory (RAM) and solid-state drive (SSD), used to store operating systems, applications and user data. Memory provides space for temporary storage of data when the system is running, ensuring the smooth operation of the system; solid-state drive is used to store large amounts of data for a long time, such as virtual human model data, product information database and temporary information database, to ensure the security and stable storage of data.

[0055] The locking mechanism 4 includes an electromagnetic lock 41 disposed at the bottom of the vehicle body 1 and connected to the network communication module through communication, and a friction block 42 disposed at the output end of the electromagnetic lock 41 and capable of abutting against the outer side of the caster 2, and the friction block 42 is elastic. The electromagnetic lock 41 is provided with a Wi-Fi module or a Bluetooth module to realize wireless connection with the network communication module, thereby controlling the electromagnetic lock 41 to work, so that the friction block 42 can abut against the outer side of the caster 2 to lock the caster 2, thereby performing locking and unlocking operations.

[0056] Reference Figures 3 to 5The present invention also provides a method for using the AI ​​smart cart, the method steps comprising:

[0057] S1. Establish a temporary information database for temporary storage of user identity information to identify the user;

[0058] S2. When a user uses the AI ​​smart trolley as claimed in claim 1 or 2 to shop, when entering the pick-up area to pick up the AI ​​smart trolley, the virtual human shopping assistant 3 is started and the user's face is photographed through the camera on the input module, and then the user's face information is stored in the temporary information database, and the network communication module controls the locking mechanism to unlock the AI ​​smart trolley, and at this time the display module displays the virtual human assistant to provide shopping guide services for the user;

[0059] S3. After the AI ​​smart trolley is taken out from the pick-up area, the artificial intelligence module generates a dialogue content for communicating with the user, and the speaker on the output module outputs voice to communicate with the user, and the microphone on the input module collects the user's voice information, and the ASR system accurately extracts and recognizes the voice information, converts the user's voice command into data information that can be processed by the system, so as to identify the user's shopping needs;

[0060] S4. When shopping is completed and the AI ​​smart trolley is pushed back to the car pick-up area, the indoor positioning module senses that the AI ​​smart trolley is in the car pick-up area, and the camera on the input module observes that the user has left, then the network communication module will be used to control the locking mechanism to lock the car, and the user identity information stored in the temporary information data will be cleared.

[0061] In this solution, S3 also includes:

[0062] S310. During the shopping process, the camera on the input module will track the user. When the user is beyond the recognition range of the camera and the time exceeds 1-3 minutes, the network communication module will control the lock mechanism to lock the car and then start timing, and the timing time is 3-30 minutes.

[0063] Furthermore, the S310 further includes:

[0064] S311. When the timing time is exceeded, the indoor positioning module will locate the position of the AI ​​smart trolley, and feed back the location information of the AI ​​smart trolley to the background through the network communication module, and notify the mall staff to handle it.

[0065] Furthermore, the S310 further includes:

[0066] S312. When the camera recognizes the user again within the timing time, the network communication module controls the lock and the vehicle locking mechanism to unlock.

[0067] In this way, through the steps S310-S312, when the user leaves the mall without returning the trolley, the trolley is parked randomly, thereby affecting other people's shopping. At the same time, the goods (especially frozen goods) stored in the trolley can be processed in time to avoid economic losses. It also prevents others from pushing the user's trolley away, resulting in the need to take a new trolley.

[0068] In a preferred embodiment of the present invention, S3 further comprises:

[0069] S320. Establish a product information database for storing product information.

[0070] The product information includes basic information, parameter specifications, functional characteristics, price information, instructions for use, related recommendations, and sales areas. When the user needs to indicate that he needs to view the product information, the display screen on the display module will display several sections of the product information for the user to click and select to view.

[0071] Furthermore, the S320 also includes:

[0072] S321. When the user expresses the intention to purchase a product, the location of the product sales area will be displayed on the display screen.

[0073] Furthermore, the S321 further includes:

[0074] S322. The indoor positioning module will locate the position of the AI ​​smart cart and plan the route through the A* algorithm to help the user navigate to the product sales area.

[0075] In this way, through steps S320-S322, users can understand the information of the products more clearly and navigate, thereby replacing manual shopping guides, saving manpower and improving shopping efficiency.

[0076] In a preferred embodiment of the present invention, S2 further comprises:

[0077] S210. Establish a virtual human character database for storing a number of virtual human character images for users to choose from, so as to increase users' shopping interest and avoid users' disgust.

[0078] Based on the above ideal embodiments of the present invention, the relevant staff can make various changes and modifications without departing from the technical concept of the present invention through the above description. The technical scope of the present invention is not limited to the contents of the specification, and its technical scope must be determined according to the scope of the claims.

Claims

1. An AI smart trolley with a virtual human assistant, comprising a trolley body (1) and casters (2) arranged at the bottom of the trolley body (1), characterized in that: The vehicle body (1) is provided with a virtual human shopping assistant (3) for providing shopping guidance, and the casters (2) are provided with locking mechanisms (4) for locking the casters (2); The virtual shopping assistant (3) comprises: Data processing module: including central processing unit and graphics processing unit, used for logical operations, data management and application execution, as well as image processing; Image generation module: including a graphics rendering engine, capable of generating high-quality virtual human images in real time based on the preset virtual human model and animation data; Display module: including a touch screen display, supporting multi-touch operation and providing a clear visual experience; Input module: including a camera and a microphone array, used to identify the user's facial information and collect the user's voice information; Output module: including a speaker for playing the voice output of the virtual person; Artificial intelligence module: integrates natural language processing, emotion recognition and behavior prediction to understand user needs and respond accordingly; Network communication module: supports Wi-Fi or Bluetooth connection, realizes communication with the Internet and wirelessly controls the locking mechanism (4); Indoor positioning module: uses Bluetooth beacon or UWB technology to achieve accurate indoor positioning; Storage module: used to store the operating system, applications, and user data.

2. The AI ​​smart cart with a virtual human assistant according to claim 1, characterized in that: The locking mechanism (4) comprises an electromagnetic lock (41) arranged at the bottom of the vehicle body (1) and communicatively connected to the network communication module, and a friction block (42) arranged at the output end of the electromagnetic lock (41) and capable of abutting against the outer side of the caster (2).

3. A method for using an AI smart trolley, characterized in that: The method steps include: S1. Establish a temporary information database for temporary storage of user identity information to identify the user; S2. When a user uses the AI ​​smart trolley as claimed in claim 1 or 2 to shop, when entering the pick-up area to pick up the AI ​​smart trolley, a virtual human shopping assistant (3) is started and the user's face is photographed through the camera on the input module, and then the user's face information is stored in a temporary information database, and the network communication module controls the locking mechanism to unlock, and at this time the display module displays a virtual human to provide shopping guide services for the user; S3. After the AI ​​smart trolley is taken out from the pick-up area, the artificial intelligence module generates a dialogue content for communicating with the user, and the speaker on the output module outputs voice to communicate with the user, and the microphone on the input module collects the user's voice information, and the ASR system accurately extracts and recognizes the voice information, converts the user's voice command into data information that can be processed by the system, so as to identify the user's shopping needs; S4. When shopping is completed and the AI ​​smart trolley is pushed back to the car pick-up area, the indoor positioning module senses that the AI ​​smart trolley is in the car pick-up area, and the camera on the input module observes that the user has left, then the network communication module will be used to control the locking mechanism to lock the car, and the user identity information stored in the temporary information data will be cleared.

4. The method for using the AI ​​smart trolley according to claim 3, characterized in that: The S3 also includes: S310. During the shopping process, the camera on the input module will track the user. When the user is beyond the recognition range of the camera and the time exceeds 1-3 minutes, the network communication module will control the lock mechanism to lock the car and then start timing, and the timing time is 3-30 minutes.

5. The method for using the AI ​​smart trolley according to claim 4, characterized in that: The S310 further includes: S311. When the timing time is exceeded, the indoor positioning module will locate the position of the AI ​​smart trolley, and feed back the location information of the AI ​​smart trolley to the background through the network communication module, and notify the mall staff to handle it.

6. The method for using the AI ​​smart trolley according to claim 4, characterized in that: The S310 further includes: S312. When the camera recognizes the user again within the timing time, the network communication module controls the lock and the vehicle locking mechanism to unlock.

7. The method for using the AI ​​smart trolley according to any one of claims 3 to 6, characterized in that: The S3 also includes: S320. Establish a product information database for storing product information. The product information includes basic information, parameter specifications, functional characteristics, price information, instructions for use, and sales area. When the user needs to view the product information, the display screen on the display module will display several sections of the product information for the user to click and select to view.

8. The method for using the AI ​​smart trolley according to claim 7, characterized in that: The S320 further includes: S321. When the user expresses the intention to purchase a product, the location of the product sales area will be displayed on the display screen.

9. The method for using the AI ​​smart trolley according to claim 8, characterized in that: The S321 also includes: S322. The indoor positioning module will locate the position of the AI ​​smart cart and plan the route through the A* algorithm to help the user navigate to the product sales area.

10. The method for using the AI ​​smart trolley according to claim 3, characterized in that: The S2 also includes: S210. Establish a virtual human character image database for storing a plurality of virtual human character images for users to select.

Images