Mobile sales system and server device

Abstract

To provide a mobile sales system and a server apparatus for facilitating the purchase of products.SOLUTION: A mobile sales system 1 is provided with a mobile sales robot 10 that acquires identification information that can identify a user conducting a transaction, detects a product taken out from its own device and transmits to a server apparatus user identification information and product identification information that can identify the product; and a server apparatus 30 that stores the product identification information for each user identified by the user identification information transmitted from the mobile sales robot 10 in association with each other, and transmits to a transmission source device the product identification information stored in association with the user corresponding to the user identification information when the user identification information is transmitted from the mobile sales robot 10 or other terminal device, and executes payment of the product related to the product identification information in response to payment instructions from the transmission source device.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] An embodiment of the present invention relates to a mobile sales system and a server device. [Background technology]

[0002] Conventionally, a system has been proposed that has a robot that moves around a store selling products and assists customers in their shopping (for example, Patent Document 1). The robot in the system patrols the store, accepting purchased products from customers and carrying them to the cash register, thereby assisting customers in their shopping.

[0003] As such, conventional systems are limited to providing transportation support for transporting purchased items to the cash register, and there is a demand for the construction of a system that is more useful to customers who purchase products. Summary of the Invention [Problem to be solved by the invention]

[0004] The problem to be solved by the present invention is to provide a mobile sales system and a server device that enable easy purchase of products. [Means for solving the problem]

[0005] The mobile sales system of the embodiment is a mobile sales system having one or more self-propelled mobile sales devices loaded with goods, and a server device connected to the mobile sales devices via a network, wherein the mobile sales devices have an acquisition means for acquiring user identification information that can identify a user who is making a transaction; a transaction start request means for, upon receiving a transaction start operation, transmitting a transaction start request including the user identification information to the server device and obtaining a transaction identifier capable of identifying the transaction from the server device; a detection means for detecting a product removed from the device; said transaction identifier and commodity identification information capable of identifying the commodity detected by the detection means. A registration request containing Send to the server device Registration Request Means and a payment request means for transmitting a payment request including the user identification information and the transaction identifier to the server device when a payment start operation is received; and The server device comprises: authentication means for authenticating the user identification information corresponding to the mobile selling device that transmitted the transaction start request and the user identification information included in the transaction start request, based on a first data table that stores user identification information of users who can use the mobile selling device in association with each of the mobile selling devices; and transaction start means for issuing the transaction identifier and providing it to the mobile selling device that transmitted the transaction start request when the authentication is successful. The aforementioned The above-mentioned information included in the transaction start request A user identified by user identification information and , the The transaction identifier issued in response to a transaction start request, and the product identification information included in the registration request including the transaction identifier.an information management means for storing the above in association with each other; The payment information included in the payment request is retrieved from a second data table that stores payment information used for electronic payment for each user. User payment information corresponding to the user identification information Read , The transaction identifier included in the payment request The product corresponding to the product identification information stored in association with electronic and a payment means for executing the payment. [Brief explanation of the drawings]

[0006] [Figure 1] FIG. 1 is a diagram illustrating an example of a configuration of a mobile sales system according to an embodiment. [Figure 2] FIG. 2 is a perspective view showing an example of the external configuration of the mobile vending device according to the embodiment. [Figure 3] FIG. 3 is a perspective view showing an example of the external configuration of the mobile vending device according to the embodiment. [Figure 4] FIG. 4 is a perspective view showing an example of the external configuration of the mobile vending device according to the embodiment. [Figure 5] FIG. 5 is a diagram illustrating an example of a hardware configuration of the mobile vending device according to the embodiment. [Figure 6] FIG. 6 is a diagram illustrating an example of a data configuration of the product master according to the embodiment. [Figure 7] FIG. 7 is a diagram illustrating an example of a data configuration of a stocked product table according to the embodiment. [Figure 8] FIG. 8 is a diagram illustrating an example of a hardware configuration of a user terminal according to the embodiment. [Figure 9] FIG. 9 is a diagram illustrating an example of a hardware configuration of a server device according to the embodiment. [Figure 10] FIG. 10 is a diagram illustrating an example of a data configuration of a robot management table according to the embodiment. [Figure 11] FIG. 11 is a diagram illustrating an example of a data configuration of a product management table according to the embodiment. [Figure 12] FIG. 12 is a diagram illustrating an example of a data configuration of a user management table according to the embodiment. [Figure 13]FIG. 13 is a diagram illustrating an example of a data configuration of a call management table according to the embodiment. [Figure 14] FIG. 14 is a diagram illustrating an example of a data configuration of a transaction management table according to the embodiment. [Figure 15] FIG. 15 is a block diagram illustrating an example of the functional configuration of each device constituting the mobile sales system according to the embodiment. [Figure 16] FIG. 16 is a diagram illustrating an example of an authentication screen displayed on the display unit of the mobile sales robot according to the embodiment. [Figure 17] FIG. 17 is a diagram illustrating an example of a product registration screen displayed on the display unit of the mobile sales robot according to the embodiment. [Figure 18] FIG. 18 is a diagram illustrating an example of a map display screen displayed on the display unit of the user terminal according to the embodiment. [Figure 19] FIG. 19 is a diagram illustrating an example of a call screen displayed on a display unit of a user terminal according to the embodiment. [Figure 20] FIG. 20 is a diagram illustrating an example of a product confirmation screen displayed on the display unit of the user terminal according to the embodiment. [Figure 21] FIG. 21 is a sequence chart showing an example of the operation of the mobile sales system according to the embodiment. [Figure 22] FIG. 22 is a sequence chart showing an example of the operation of the mobile sales system according to the embodiment. [Figure 23] FIG. 23 is a sequence chart showing an example of the operation of the mobile sales system according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0007] Hereinafter, embodiments will be described in detail with reference to the drawings. However, the present invention is not limited to the embodiments described below.

[0008] Fig. 1 is a diagram showing an example of the configuration of a mobile sales system according to an embodiment. As shown in Fig. 1, the mobile sales system 1 includes a mobile sales robot 10, a user terminal 20, and a server device 30. The mobile sales robot 10, the user terminal 20, and the server device 30 are connected to a network N such as a LAN (Local Area network).

[0009] The mobile sales robot 10 is a self-propelled sales device that transports and sells merchandise without any human intervention, and is an example of a mobile sales device. For example, the mobile sales robot 10 travels within a predetermined area such as a shopping mall and sells merchandise at each location it travels to. The mobile sales robot 10 performs patrol travel, traveling along a predetermined route, and call travel, traveling to a call location designated by a customer. The number of mobile sales robots 10 is not limited to the example shown in FIG. 1.

[0010] The external configuration of the mobile sales robot 10 will now be described with reference to Figures 2 to 4. Figures 2 to 4 are perspective views showing an example of the external configuration of the mobile sales robot 10.

[0011] 2 to 4, the configuration of the mobile sales robot 10 will be described using three mutually perpendicular axial directions: the X-axis, the Y-axis, and the Z-axis. The X-axis runs through the mobile sales robot 10 from front to back, and extends from the rear to the front of the mobile sales robot 10. The Y-axis runs through the mobile sales robot 10 from left to right, and extends from the left side to the right side of the mobile sales robot 10. The Z-axis runs through the mobile sales robot 10 from top to bottom, and extends from the bottom to the top of the mobile sales robot 10. Hereinafter, the left side of the mobile sales robot 10 (the negative Y-axis side) will also be referred to as the front side of the mobile sales robot 10. The right side of the mobile sales robot 10 (the positive Y-axis side) will also be referred to as the back side of the mobile sales robot 10.

[0012] The mobile sales robot 10 comprises a main body 11, a moving unit 12, and a user interface unit 13. The main body 11 is formed of a box-shaped housing with open front and back sides. A storage unit 111 is provided inside the main body 11.

[0013] The storage section 111 is a space for storing products C to be sold, such as food products, and is an example of a mounting section. In the storage section 111, shelves 112 capable of displaying the products C are arranged in multiple vertical stages across the front-to-rear direction of the mobile sales robot 10. The products C are placed on the shelves 112 by a store clerk or the like managing the mobile sales robot 10. The products C stored in the storage section 111 are not limited to food products, and may be products of other categories, such as medicines or leisure goods. Furthermore, the storage section 111 may store products C of multiple categories.

[0014] The shelf 112 may be divided into a plurality of areas, for example, to sort and place the same type of products C. In this case, the shelf 112 may be divided into a plurality of areas by using trays or the like, for example.

[0015] Shelf labels 113 for displaying the name and price of product C are provided on the front side of the shelves 112. The shelf labels 113 may be electronic shelf labels or digital signage that digitally display information. Each shelf 112 is also provided with a weight detection unit 159 (see FIG. 5) that can detect the weight of product C placed on the shelf 112. The weight detection unit 159 detects a change in weight, thereby detecting that a product placed on the shelf 112 has been removed from the shelf 112 or that the product has been returned to the shelf 112. Details of the weight detection unit will be described later.

[0016] In this embodiment, the shelf tags 113 are provided on the front side of the shelf 112, but the shelf tags 113 may also be provided on the back side of the shelf 112. Also, in this embodiment, both the front side and back side of the main body 11 (storage section 111) are open, but the main body 11 may be open on one side (for example, the front side).

[0017] Alternatively, a door made of a light-transmitting material such as glass may be attached to either or both of the front and back sides of the main body 11 (storage section 111) in an openable and closable manner, allowing access to the inside of the storage section 111 through the door. For example, a door may be attached to the front side of the main body 11, and the back side of the main body 11 may be covered with a wall. In this case, the wall on the back side may be made of a light-transmitting material such as glass. This prevents products in the storage section 111 from falling out of the storage section 111 when the mobile sales robot 10 is moving, etc.

[0018] Furthermore, the door may be configured to be lockable by providing an electronic lock or the like, which can prevent unauthorized removal of merchandise from the storage section 111, for example, when the mobile sales robot 10 is moving.

[0019] A light emitting unit 114 and a distance measuring sensor 115 are provided on the front side of the main body 11. The light emitting unit 114 has a light emitting element such as an LED (Light Emitting Diode) and emits light under the control of a control unit 154 (described later) to indicate the operating status of the mobile sales robot 10. For example, the light emitting unit 114 emits light when the mobile sales robot 10 is moving, thereby indicating that the mobile sales robot 10 is moving.

[0020] The light emitted by the light emitting unit 114 is not limited to a single color. For example, the light emitting unit 114 may emit different colors or change light emission patterns depending on the operating state of the mobile sales robot 10. The light emitting unit 114 may be provided on the rear side of the main body 11, not necessarily on the front side.

[0021] The ranging sensor 115 is a sensor device for detecting objects present around the mobile sales robot 10 and detecting the distance to the objects. The sensing results of the ranging sensor 115 are output to the control unit 154 (described later) and are used for collision avoidance during movement, user detection, etc. The ranging sensor 115 can be realized by, for example, a sensor device that detects objects and measures distances using captured images or ultrasonic waves, or a sensor device such as LiDAR (Light Detection and Ranging) that detects objects using laser light.

[0022] The position where the distance measurement sensor 115 is provided is not limited to the front of the mobile sales robot 10. For example, the distance measurement sensor 115 may be provided at another position, such as the rear of the mobile sales robot 10. Furthermore, the imaging unit 134, which will be described later, may be used as the distance measurement sensor 115.

[0023] The moving unit 12 is provided below the main body unit 11 and movably supports the main body unit 11. Specifically, the moving unit 12 includes a non-drive wheel 121, a drive wheel 122, and a drive unit 123 that drives the drive wheel 122.

[0024] The non-drive wheels 121 are small wheels that can freely change direction in response to the direction of the force generated by the rotation of the drive wheels 122, thereby changing the traveling direction of the mobile sales robot 10 (movement unit 12).

[0025] The drive wheels 122 are rotationally driven by the drive unit 123 to move the mobile sales robot 10 (movement unit 12) forward or backward.

[0026] The driving unit 123 has a driving source such as a motor or a power supply. The driving unit 123 drives and rotates the driving wheels 122 under the control of the control unit 154, which will be described later, to move the mobile sales robot 10 (movement unit 12) in the direction and position instructed by the control unit 154.

[0027] For example, the drive unit 123 rotates the pair of left and right drive wheels 122 at the same speed or in opposite directions to move the mobile sales robot 10 forward or backward. Also, the drive unit 123 changes the direction of travel of the mobile sales robot 10 to the left or right by varying the rotation speeds of the pair of left and right drive wheels 122. Note that the number of wheels and the drive method of the movement unit 12 are not limited to the above example.

[0028] The user interface unit 13 is provided on the upper part of the main body unit 11. The user interface unit 13 includes a first display unit 131, a second display unit 132, a third display unit 133, an imaging unit 134, a disinfection device 135, and the like.

[0029] The first display unit 131 is a display device installed on the front side of the mobile sales robot 10. The second display unit 132 is a display device installed on the rear side of the mobile sales robot 10. The third display unit 133 is a display device installed on the rear side of the mobile sales robot 10. The first display unit 131, the second display unit 132, and the third display unit 133 display various information related to the sale of the product C, etc., under the control of the control unit 154, which will be described later.

[0030] The imaging unit 134 is installed on the rear side of the mobile sales robot 10. The imaging unit 134 is a digital camera having an imaging element such as a CCD (Charge Coupled Device) or a CMOS (Complementary MOS). The imaging unit 134 captures an image of a user using the mobile sales robot 10 to obtain an image of the user's face, etc.

[0031] The disinfection device 135 is a device for disinfecting a user of the mobile sales robot 10. In this embodiment, disinfection means killing (or removing) pathogenic bacteria, viruses, and other microorganisms present on an object to render them harmless. Disinfection can also be interpreted as sterilization, sterilization, or sterilization.

[0032] The disinfection device 135 may have any configuration. For example, the disinfection device 135 may be a sprayer that sprays a disinfectant such as alcohol. Alternatively, the disinfection device 135 may be an ultraviolet disinfection device that irradiates ultraviolet rays. The disinfection device 135 performs a disinfection operation such as spraying a disinfectant or irradiating ultraviolet rays in response to a user operation.

[0033] The operating status of the disinfection device 135 may be configured to be electrically output to the control unit 154 described later. In this case, for example, the user interface unit 13 or the disinfection device 135 includes a sensor device (hereinafter also referred to as a disinfection operation detection unit) that detects the disinfection operation of the disinfection device 135. When the disinfection operation detection unit detects that the disinfection operation has been performed by the disinfection device 135, it outputs a detection signal to the control unit 154 described later.

[0034] The configuration of the user interface unit 13 is not limited to the illustrated example. For example, the number and installation positions of the display devices included in the user interface unit 13 are not limited to those shown in the illustration. The user interface unit 13 may be configured without the disinfection device 135. Furthermore, the user interface unit 13 may include a reader device that reads information stored in a code symbol such as a two-dimensional code, or a reader device that reads information from a card medium such as an IC card or a credit card.

[0035] Returning to FIG. 1, the user terminal 20 is a device used by a user of the mobile sales system 1, and is an example of a terminal device. The user terminal 20 is realized by a portable terminal device such as a smartphone or a tablet terminal. The user terminal 20 accepts a call request from a user requesting to call the mobile sales robot 10, and transmits the accepted call request to the server device 30. Note that the number of user terminals 20 is not limited to the example in FIG. 1.

[0036] The server device 30 manages the mobile sales system 1. The server device 30 is realized by, for example, an information processing device such as a PC (Personal Computer). The server device 30 manages the products sold by each of the mobile sales robots 10. The server device 30 also manages the mobile sales robot 10 and causes the mobile sales robot 10 to travel to a call position specified in a call request received from the user terminal 20. For example, the server device 30 manages the current positions of the mobile sales robot 10 and the user terminal 20, and upon receiving a call request for the mobile sales robot 10 from the user terminal 20, causes the mobile sales robot 10 specified in the call request to travel toward the position of the user terminal 20.

[0037] The hardware configuration and functional configuration of each device included in the mobile sales system 1 will be described below.

[0038] First, we will explain the hardware configuration of the mobile sales robot 10. Fig. 5 is a diagram showing an example of the hardware configuration of the mobile sales robot 10. As shown in Fig. 5, the mobile sales robot 10 includes a CPU (Central Processing Unit) 151, a ROM (Read Only Memory) 152, and a RAM (Random Access Memory) 153.

[0039] The CPU 151 is an example of a processor, and performs overall control of each part of the mobile sales robot 10. The ROM 152 stores various programs. The RAM 153 is a workspace for developing programs and various data.

[0040] The CPU 151, ROM 152, and RAM 153 are connected via a bus or the like to form a computer-configured control unit 154. In the control unit 154, the CPU 151 operates in accordance with a program stored in the storage unit 162 and loaded into the RAM 153, thereby executing various processes.

[0041] The mobile sales robot 10 also includes the above-mentioned light-emitting unit 114, driving unit 123, and imaging unit 134. The mobile sales robot 10 also includes a display unit 155, an operation unit 156, a sound collection unit 157, a sensor unit 158, a weight detection unit 159, a positioning unit 160, a communication unit 161, and a memory unit 162.

[0042] The display unit 155 is a display device such as the first display unit 131, the second display unit 132, and the third display unit 133 described above. The display unit 155 is configured with an LCD (Liquid Crystal Display) or the like. The display unit 155 displays various information under the control of the CPU 151. Note that if the shelf tag 113 is an electronic shelf tag, the display unit 155 includes the electronic shelf tag.

[0043] Operation unit 156 is an input device such as a keyboard, a pointing device, etc. Operation unit 156 outputs the content of an operation received from a user to CPU 151. Note that operation unit 156 may be a touch panel provided on the display screen of display unit 155.

[0044] The sound collection unit 157 collects sounds around the mobile sales robot 10 and outputs the audio signals of the collected sounds to the CPU 151. The sound collection unit 157 is realized by, for example, a sound collection device such as a microphone. For example, the sound collection unit 157 collects sounds from users who wish to purchase a product while the mobile sales robot 10 is traveling to stop the traveling.

[0045] The sensor unit 158 ​​is a sensor device such as the distance measurement sensor 115, the disinfection operation detection unit, etc. The sensor unit 158 ​​outputs the detection result obtained by sensing to the CPU 151.

[0046] Weight detection unit 159 is a weight sensor that detects the weight of the product stored in storage unit 111. Specifically, weight detection unit 159 is provided on each shelf 112, and detects the weight and weight change of the product placed on shelf 112.

[0047] Here, each shelf 112 is associated in advance with the weight detection unit 159 installed on that shelf 112, and when a weight change is detected by the weight detection unit 159, it is possible to identify the shelf 112 where the change occurred.

[0048] If the shelf 112 is divided into a plurality of areas, a weight detection unit 159 may be provided for each divided area. In this case, each divided area is associated with the weight detection unit 159 provided in that area.

[0049] The positioning unit 160 measures the position of the mobile sales robot 10. The positioning unit 160 can be realized by a positioning device using a positioning technology such as GPS (Global Positioning System).

[0050] The positioning unit 160 may be realized by a position measurement device that uses positioning technology such as beacon positioning, RFID (Radio Frequency Identifier) ​​positioning, etc. In this case, by providing a terminal that supports positioning technology such as beacon positioning or RFID positioning at each position within the range in which the mobile sales robot 10 can move, the position of the mobile sales robot 10 can be measured (identified) by a positioning system formed by the terminal and the positioning unit 160.

[0051] The communication unit 161 is a wireless communication interface that can be connected to the network N. The communication unit 161 communicates with external devices such as the server device 30 via the network N.

[0052] The storage unit 162 has a storage medium such as a hard disk drive (HDD) or flash memory, and maintains the stored contents even when the power is cut off. The storage unit 162 stores programs that can be executed by the CPU 151 and various setting information.

[0053] The storage unit 162 also stores map information 1621, a product master 1622, and a stocked product table 1623. The map information 1621 is information showing a map of the range in which the mobile sales robot 10 moves.

[0054] The product master 1622 is a data table that stores information about products for sale. Fig. 6 is a diagram showing an example of the data configuration of the product master 1622. As shown in Fig. 6, the product master 1622 stores product information about a product corresponding to a product code, in association with the product code that identifies the product. The product information includes, for example, the product name, type, price, weight, image data, etc.

[0055] The data configuration of the product master 1622 is not limited to the example shown in Fig. 6. For example, the product master 1622 may store image data representing the characteristics of the product in the product information.

[0056] The storage unit 162 may be configured not to store the product master 1622. In this case, the mobile sales robot 10 can handle the product master 3162 in the same way as in the configuration in which the product master 1622 is stored, by referring to the product master 3162 stored in the server device 30.

[0057] The stored product table 1623 is a data table for storing information about products stored in the storage section 111. Fig. 7 is a diagram showing an example of the data configuration of the stored product table 1623. As shown in Fig. 7, the stored product table 1623 associates each shelf 112 provided in the storage section 111 with an identifiable shelf ID, and stores the product code of the product placed on the shelf 112 with the shelf ID and the quantity of the product placed.

[0058] The data configuration of the stored product table 1623 is not limited to the example in Fig. 7. For example, if the shelf 112 is divided into multiple areas, the stored product table 1623 may assign an identifier to each divided area and store the product code and quantity of the product placed in that area in association with each other.

[0059] Next, a description will be given of the hardware configuration of the user terminal 20. Fig. 8 is a diagram showing an example of the hardware configuration of the user terminal 20. As shown in Fig. 8, the user terminal 20 includes a CPU 211, a ROM 212, and a RAM 213.

[0060] The CPU 211 is an example of a processor, and performs overall control of each unit of the user terminal 20. The ROM 212 stores various programs. The RAM 213 is a workspace where programs and various data are developed.

[0061] The CPU 211, ROM 212, and RAM 213 are connected via a bus or the like to form a computer-configured control unit 214. In the control unit 214, the CPU 211 operates in accordance with a program stored in the storage unit 220 and loaded into the RAM 213, thereby executing various processes.

[0062] The user terminal 20 also includes a display unit 215, an operation unit 216, an imaging unit 217, a positioning unit 218, a communication unit 219, a storage unit 220, and the like.

[0063] The display unit 215 is a display device and is configured, for example, with an LCD or the like. The display unit 215 displays various information under the control of the CPU 211. The operation unit 216 is an input device such as a keyboard or a pointing device. The operation unit 216 outputs the contents of an operation received from a user to the CPU 211. Note that the operation unit 216 may be a touch panel provided on the display screen of the display unit 215.

[0064] The imaging unit 217 is a digital camera having an imaging element such as a CCD or CMOS, etc. The imaging unit 217 captures an image of the user who uses the user terminal 20, thereby acquiring an image of the user's face, etc.

[0065] The positioning unit 218 measures the location of the user terminal 20. The positioning unit 218 can be realized by a positioning device using a positioning technique such as GPS. Alternatively, similar to the positioning unit 160 described above, the positioning unit 218 may be realized by a position measurement device using a positioning technique such as beacon positioning or RFID positioning.

[0066] The communication unit 219 is a wireless communication interface that can be connected to the network N. The communication unit 219 communicates with external devices such as the server device 30 via the network N.

[0067] The storage unit 220 has a storage medium such as a HDD or flash memory, and maintains its stored contents even when the power is turned off. The storage unit 220 stores programs that can be executed by the CPU 211 (including application programs related to the processing of the mobile sales system 1) and various setting information.

[0068] The storage unit 220 also stores map information 2201. Here, the map information 2201, like the map information 1621, is information showing a map of the area in which the mobile sales robot 10 moves.

[0069] Next, a description will be given of the hardware configuration of the server device 30. Fig. 9 is a diagram showing an example of the hardware configuration of the server device 30. As shown in Fig. 9, the server device 30 includes a CPU 311, a ROM 312, and a RAM 313.

[0070] The CPU 311 is an example of a processor, and performs overall control of each unit of the server device 30. The ROM 312 stores various programs. The RAM 313 is a workspace where programs and various data are developed.

[0071] The CPU 311, ROM 312, and RAM 313 are connected via a bus or the like to form a computer-configured control unit 314. In the control unit 314, the CPU 311 operates in accordance with a program stored in the storage unit 316 and loaded into the RAM 313, thereby executing various processes.

[0072] The server device 30 also includes a communication unit 315 and a storage unit 316. The communication unit 315 is a wired or wireless communication interface connectable to a network N. The communication unit 315 communicates with external devices such as the mobile sales robot 10 and the user terminal 20 via the network N.

[0073] The storage unit 316 has a storage medium such as an HDD or flash memory, and maintains the stored contents even when the power is cut off. The storage unit 316 stores programs that can be executed by the CPU 311 and various setting information.

[0074] The storage unit 316 also stores map information 3161 and a product master 3162. The map information 3161 is information showing a map of the area in which the mobile sales robot 10 moves. The product master 3162 is a data table that stores information about products for sale. The data structure of the product master 3162 is the same as that of the product master 1622 described above.

[0075] The storage unit 316 also stores a robot management table 3163, a product management table 3164, a user management table 3165, a call management table 3166, a transaction management table 3167, and the like.

[0076] The robot management table 3163 is a data table for managing the position and status of the mobile sales robot 10. Fig. 10 is a diagram showing an example of the data configuration of the robot management table 3163. As shown in Fig. 10, the robot management table 3163 stores, in association with a robot ID, position information indicating the current position of the mobile sales robot 10 corresponding to the robot ID and status information indicating the status of the mobile sales robot 10. The robot ID identifies the mobile sales robot 10 and is an example of mobile sales device identification information.

[0077] Here, the location information may be represented by coordinate values ​​such as longitude and latitude, etc. Alternatively, the location information may be represented by block numbers or the like obtained by dividing the area in which the mobile sales robot 10 can move into a plurality of blocks.

[0078] The state of the mobile sales robot 10 may be, for example, a "moving" state in which the mobile sales robot 10 moves to a call position designated by a user, a "waiting for transaction" state in which the mobile sales robot 10 has arrived at the call position and is waiting for an operation to start a transaction, a "transaction in progress" state in which a transaction has been started by a user operation, etc. In addition, the state of the mobile sales robot 10 may be a "waiting for call" state in which the mobile sales robot 10 can respond to a call from a user when the mobile sales robot 10 is patrolling, etc., or a "not selling" state in which the mobile sales robot 10 cannot sell due to replenishing products, etc.

[0079] The information stored in the robot management table 3163 is updated according to the movement and state of the mobile sales robot 10 under the control of the information management unit 3142 described later.

[0080] The product management table 3164 is a data table for managing products sold by each mobile sales robot 10. Fig. 11 is a diagram showing an example of the data configuration of the product management table 3164. As shown in Fig. 11, the product management table 3164 stores, in association with a robot ID, the product code of a product sold by the mobile sales robot 10 of that robot ID and the inventory quantity of that product.

[0081] The information stored in the product management table 3164 is updated according to the number of products in stock held by the mobile sales robot 10 under the control of the information management unit 3142 (to be described later).

[0082] The user management table 3165 is a data table for managing users who use the mobile sales system 1. Fig. 12 is a diagram showing an example of the data configuration of the user management table 3165. As shown in Fig. 12, the user management table 3165 associates each user with an identifiable user ID and stores user information about the user with that user ID.

[0083] The user information includes feature information that indicates the user's facial features and payment information used for electronic payment. The feature information is, for example, facial image data obtained by capturing an image of the user's face, feature quantities that indicate facial features, etc., and is used as matching data in the face authentication process described below.

[0084] The payment information is information such as an account for using an electronic payment service with which the user has previously signed up. Here, electronic payment services include code payment, electronic money payment, credit card payment, etc. Furthermore, if the electronic payment service is credit card payment, the payment information may be the number of a credit card owned by the user.

[0085] The user information is acquired from the user by, for example, a known method such as membership registration, and is registered in the user management table 3165. The user ID may be automatically assigned, or may be unique information input by the user.

[0086] The user information is not limited to the above examples and may include other information. For example, the user information may include personal information such as the user's name, age, address, etc. The user information may also include the terminal ID of the terminal (user terminal 20) used by the user, the communication address of the terminal, etc.

[0087] The call management table 3166 is a data table for managing calls to the mobile sales robot 10 by the user terminal 20. Fig. 13 is a diagram showing an example of the data configuration of the call management table 3166. As shown in Fig. 13, the call management table 3166 stores, in association with each other, the terminal ID of the user terminal 20 that made the call, the date and time when the call was accepted (call date and time), location information indicating the call location (hereinafter simply referred to as "call location"), the robot ID of the mobile sales robot 10 corresponding to the call, and the date and time when the mobile sales robot 10 arrived at the call location (arrival date and time).

[0088] The transaction management table 3167 is a data table for managing transactions via the mobile sales robot 10. FIG. 14 is a diagram showing an example of the data configuration of the transaction management table 3167. As shown in FIG. 14, the transaction management table 3167 stores the user ID of the user performing the transaction, the product code of the product registered in the transaction, a payment flag, etc., in association with a transaction ID that identifies the transaction. Here, the payment flag is flag information that indicates the payment status of the transaction. The payment flag stores flag information that can determine, for example, whether the transaction is unsettled, settled, or on hold.

[0089] The transaction management table 3167 may store, in association with a product code, the robot ID of the mobile sales robot 10 in which the product corresponding to the product code was registered, i.e., the robot ID of the mobile sales robot 10 that picked up the product. The transaction management table 3167 may also store, in association with a product code, the date and time when the product code was stored, i.e., the date and time when the product was registered.

[0090] Next, a description will be given of the functional configuration of each device constituting the mobile sales system 1. Fig. 15 is a block diagram showing the functional configuration of each device constituting the mobile sales system 1. First, the mobile sales robot 10 will be described.

[0091] The control unit 154 of the mobile sales robot 10 realizes, as functional units, a transmitting / receiving unit 1541, an input receiving unit 1542, a self-location determining unit 1543, a traveling control unit 1544, a display control unit 1545, a sales support unit 1546, and a status management unit 1547 by the CPU 151 operating in accordance with the programs stored in the ROM 152 and the storage unit 162. Each of these functions may be configured by hardware such as a dedicated circuit.

[0092] The transmitting / receiving unit 1541 transmits and receives various information to and from an external device such as the server device 30 via the communication unit 161. For example, the transmitting / receiving unit 1541 transmits, to the server device 30, location information indicating the location of the device, status information indicating the status of the device, product codes and inventory quantities of products stored in the device, etc. as needed. The transmitting / receiving unit 1541 also transmits to the server device 30 a transaction start request, a registration request, a settlement request, a transaction suspension request, etc., which will be described later. The transmitting / receiving unit 1541 also receives from the server device 30 a transaction ID, an existing product code, a settlement completion notification, an suspension completion notification, etc., which will be described later.

[0093] The input accepting unit 1542 accepts various types of input information via the operation unit 156 and the imaging unit 134. For example, the input accepting unit 1542 accepts input of information instructing the start or suspension of a transaction, and information instructing the start of payment via the operation unit 156. The input accepting unit 1542 also accepts input of characteristic information such as facial image data of the user via the imaging unit 134.

[0094] The self-location identifying unit 1543 identifies the current location of the mobile sales robot 10 in the map information 2201 based on the output of the positioning unit 160. The self-location identifying unit 1543 also associates the location information indicating the current location of the mobile sales robot 10 with the robot ID and transmits the information to the server device 30.

[0095] The travel control unit 1544 controls the drive unit 123 to control the travel of the mobile sales robot 10. For example, under the control of the travel control unit 1544, the mobile sales robot 10 performs patrol travel along a predetermined route and call travel to a call location designated by a customer.

[0096] Specifically, when the transmitting / receiving unit 1541 receives a movement instruction from the server device 30, the traveling control unit 1544 determines a movement route to the call position based on the position identified by the self-position identifying unit 1543 and the map information 1621. Then, the traveling control unit 1544 causes the mobile sales robot 10 to travel to the call position based on the determined movement route. Furthermore, when the traveling control unit 1544 detects an object such as an obstacle on the movement route based on the sensing results of the distance measuring sensor 115, etc., it causes the mobile sales robot 10 to travel around the object.

[0097] There is no particular restriction on the control method for determining a travel route and detecting and avoiding obstacles, and for example, known car navigation technology or automatic driving technology may be used.

[0098] Furthermore, when the travel control unit 1544 detects that any or all of the products stored in the storage unit 111 are out of stock, it moves the mobile sales robot 10 to a predetermined position in the back yard, for example, to replenish the products. Note that, when the mobile sales robot 10 travels in a shopping mall or the like, the travel control unit 1544 may move the mobile sales robot 10 to a store selling the products that are out of stock.

[0099] The traveling control unit 1544 also recognizes the sound picked up by the sound collection unit 157 from the surrounding area and outputs a stop command to the driving unit 123 as necessary. For example, when the traveling control unit 1544 recognizes a sound for stopping the mobile sales robot 10 through voice recognition, it stops the mobile sales robot 10.

[0100] The display control unit 1545 controls the display unit 155 and causes various types of information to be displayed on the display unit 155. For example, the display control unit 1545 cooperates with the sales support unit 1546 to cause the display unit 155 to display various screens (GUI: Graphical User Interface).

[0101] The sales support unit 1546 is an example of an acquiring means, a detecting means, and a first transmitting means. The sales support unit 1546 executes various processes to support the purchase of the products sold by the mobile sales robot 10 in cooperation with other functional units of the mobile sales robot 10 and the server device 30. In addition, the sales support unit 1546 cooperates with the display control unit 1545 to display on the display unit 155 various screens to support the purchase of the products sold by the mobile sales robot 10.

[0102] For example, in response to an instruction to start a transaction, the sales support unit 1546 displays a screen prompting the user to capture a facial image of the user who will perform the transaction on the display unit 155. Specifically, the sales support unit 1546 displays an authentication screen prompting the user to capture a facial image with the imaging unit 134 on any of the first display unit 131, the second display unit 132, and the third display unit 133.

[0103] Here, the instruction to start a transaction is not limited to a user operation via the operation unit 156. For example, the trigger for starting a transaction may be the mobile sales robot 10 arriving at a call position. Alternatively, the trigger for starting a transaction may be the capturing of a face image by the imaging unit 134. Alternatively, the trigger for starting a transaction may be the operation of the disinfection device 135. Alternatively, the trigger for starting a transaction may be the inclusion of a predetermined sound, such as a sound requesting the purchase of a product, in the sound collected by the sound collection unit 157. Note that, if sound is used as a trigger for starting a transaction, it is preferable to limit the state of the mobile sales robot 10 to when it is traveling around.

[0104] 16 is a diagram showing an example of an authentication screen displayed on the display unit 155 of the mobile sales robot 10. FIG. 16 shows an example of an authentication screen displayed on the third display unit 133.

[0105] As shown in FIG. 16 , the authentication screen 40 has an image display area 41 for displaying an image captured by the imaging unit 134. The image captured by the imaging unit 134 is displayed in real time in the image display area 41. A photographing frame 42 is also displayed superimposed on the image display area 41. The photographing frame 42 indicates the area in which the user's face is located within the range captured by the imaging unit 134. The user of the mobile sales robot 10 adjusts the position of their face on the authentication screen 40 so that their face is positioned within the photographing frame 42.

[0106] When the face enters the photographing frame 42, the sales support unit 1546 acquires the image photographed by the photographing unit 134 as face image data, and transmits a transaction start request including the face image data to the server device 30. The server device 30 that has received the transaction start request transmits a transaction start notification including a transaction ID to the mobile sales robot 10 that sent the request, as will be described later.

[0107] When the transmitting / receiving unit 1541 receives a transaction start notification from the server device 30, the sales support unit 1546 stores the transaction ID included in the transaction start notification in the RAM 153 and starts the transaction related to the transaction ID. Specifically, the sales support unit 1546 puts its own mobile sales robot 10 into a state where it can register and settle products. When a transaction start notification including a product code is sent from the server device 30 in conjunction with the sending of a transaction start request, the sales support unit 1546 stores the product code as an existing product code together with the transaction ID in the RAM 153.

[0108] Here, the existing product code means the product code of a product that a user using the mobile sales robot 10 has taken out from another mobile sales robot 10 and for which payment has not yet been completed, as will be described later.

[0109] After the transaction begins, when the sales support unit 1546 detects a change in weight of the shelf 112 via the weight detection unit 159, it reads the product code corresponding to the shelf ID of the shelf 112 where the weight change occurred from the stored product table 1623, and identifies the product that was removed from the shelf 112 or the product that was returned to the shelf 112.

[0110] For example, if the weight change is a decrease in weight, the sales support unit 1546 reads out the product code stored in association with the shelf ID of the shelf 112 where the weight change occurred. Then, the sales support unit 1546 refers to the product master 1622 and identifies the product code corresponding to the decreased weight among the weights associated with the read product codes, thereby identifying the product removed from the shelf 112. In this case, the sales support unit 1546 reads out the identified product code from the product master 1622 and stores it in the RAM 153, thereby registering the product. The sales support unit 1546 also subtracts the quantity of the identified product code stored in the stocked product table 1623 by the number of products removed from the shelf 112. Furthermore, the sales support unit 1546 sends a registration request including the identified product code and the transaction ID to the server device 30. Based on the registration request, the server device 30 then registers the product code specified in the registration request in association with the corresponding transaction ID in the transaction management table 3167.

[0111] The sales support unit 1546 executes the above-described process each time a product is taken out of the shelf 112, thereby sequentially registering the product as it is taken out of the shelf 112. Hereinafter, the product code registered by the sales support unit 1546 in the mobile sales robot 10 currently being used by the user will also be referred to as a new product code. In other words, all product codes registered in the mobile sales robot 10 currently being used by the user will be new product codes.

[0112] On the other hand, if the weight change is an increase in weight, the sales support unit 1546 reads out the product code stored in association with the shelf ID of the shelf 112 where the weight change occurred. The sales support unit 1546 then references the product master 1622 and identifies the product code corresponding to the increased weight from among the weights associated with the read product codes, thereby identifying the product that has been returned to the shelf 112. In this case, the sales support unit 1546 deletes the identified product code from the new product codes stored in the RAM 153. The sales support unit 1546 also increases the quantity of the identified product code stored in the stocked product table 1623 by the number of products returned to the shelf 112. Furthermore, the sales support unit 1546 sends a cancellation request including the identified product code and the transaction ID to the server device 30. Based on the cancellation request, the server device 30 then deletes the product code specified in the registration request from the product codes associated with the corresponding transaction ID in the transaction management table 3167.

[0113] In this way, the mobile sales robot 10 automatically registers or cancels the registration of a product when the product is taken out of or returned from the storage unit 111. This eliminates the need for the user to perform operations to read or cancel the product code of the product to be purchased. This allows the user to easily purchase products.

[0114] Furthermore, the sales support unit 1546 displays a product registration screen on the display unit 155, which displays a list of product names, etc., of the products, based on the product information of the products corresponding to the product codes stored in the RAM 153. Note that it is preferable that the sales support unit 1546 displays products corresponding to new product codes and products corresponding to existing product codes in a distinguishable manner.

[0115] 17 is a diagram showing an example of a product registration screen displayed on the display unit 155 of the mobile sales robot 10. FIG. 17 shows an example of a product registration screen displayed on the first display unit 131.

[0116] As shown in FIG. 17, the product registration screen 50 displays information about the product that the user has taken out from the mobile sales robot 10. Specifically, the product registration screen 50 displays a product icon 51, product name 52, registered points 53, and subtotal 54 of the product corresponding to the product code stored in the RAM 153. Here, the product icon 51 is an image representing the product. The product name 52 is the name of the product. The registered points 53 indicates the number of products. The subtotal 54 indicates the subtotal price of each product. The sales support unit 1546 derives the subtotal price of each product by multiplying the number of products for each product code stored in the RAM 153 by the price of the corresponding product stored in the product master 1622.

[0117] 17 shows an example in which products corresponding to new product codes and products corresponding to existing product codes are displayed in a distinguishable manner from the product codes stored in RAM 153. Specifically, in FIG. 17, "Product D" corresponding to the new product code is displayed with hatching.

[0118] This allows the user to easily check the products that he or she has taken out from the mobile sales robot 10 by looking at the product registration screen. In addition, since the user can distinguish between products that correspond to new product codes and products that correspond to existing product codes, the user can easily check the products that he or she has taken out from other mobile sales robots 10 other than the mobile sales robot 10 that he or she is currently using.

[0119] In addition, if the robot ID of the mobile sales robot 10 that retrieved the product and the date and time of retrieval are stored in association with the existing product code, the sales support unit 1546 may display this information in association with the corresponding product.

[0120] The product registration screen 50 also displays a total number of items 55, a total amount 56, a checkout button 57, and a transaction interruption button 58. The total number of items 55 is the total number of registered products. The total amount 56 is the total amount of registered products. The sales support unit 1546 derives the total number of items by adding up the number of product codes stored in RAM 153. The sales support unit 1546 derives the total amount of products by adding up the subtotal amounts of each product.

[0121] The checkout button 57 is an operator for instructing payment for the product. By operating the checkout button 57, the user can make payment for the product.

[0122] When the sales support unit 1546 detects that the checkout button 57 has been operated, it causes the display unit 155 to display a screen that prompts the user to capture a facial image. For example, the sales support unit 1546 causes the display unit 155 (display unit 133) to display the authentication screen 40 similar to that shown in FIG. 16 described above.

[0123] When the sales support unit 1546 acquires the user's facial image data, it transmits a payment request including the facial image data and the transaction ID to the server device 30. Upon receiving the payment request, the server device 30 identifies the user ID of the user corresponding to the facial image data from the user management table 3165, as will be described later, and executes payment processing for the product related to the transaction ID specified in the payment request using the payment information associated with the user ID. Then, upon completing the payment processing, the server device 30 transmits a payment completion notification to the mobile sales robot 10 that sent the request.

[0124] When the transmitting / receiving unit 1541 receives the payment completion notice, the sales support unit 1546 causes the display unit 155 to display a screen informing the user that payment has been completed.

[0125] This allows a user to make payment for goods picked up from one or more mobile vending robots 10 using any mobile vending robot 10. Therefore, a user can make payment for goods picked up from the mobile vending robot 10 at any location and timing.

[0126] In the present embodiment, an example has been described in which the user's facial image data is acquired twice, at the start of the transaction and at the time of payment. However, the present invention is not limited to this. Alternatively, facial image data may be acquired once from the start of the transaction to the completion of payment (or the suspension of the transaction). For example, if facial image data is acquired at the start of the transaction, the facial image data may be stored in RAM 153 or the like, and the facial image data may be included in the payment request and transmitted. Furthermore, if facial image data is acquired at any timing from the start of the transaction to the completion of payment (or the suspension of the transaction), the sales support unit 1546 may transmit an authentication request including the transaction ID and the facial image data when an instruction to complete the payment (or the suspension of the transaction) is issued. Furthermore, the server device 30 may execute the payment process based on the authentication result of the facial image data transmitted once.

[0127] On the other hand, the transaction interruption button 58 is an operator for instructing the suspension of a transaction. By operating the transaction interruption button 58, the user can interrupt a transaction being carried out by the mobile sales robot 10.

[0128] When the sales support unit 1546 detects that the transaction suspension button 58 has been operated, it transmits a transaction suspension request including the transaction ID to the server device 30. Upon receiving the transaction suspension request, the server device 30 updates the settlement flag of the transaction ID specified in the transaction suspension request to "on hold," as described below, and transmits a suspension completion notification to the requesting mobile sales robot 10. When the transmission / reception unit 2141 receives the suspension completion notification, the purchase support unit 2145 displays on the display unit 215 a screen informing the user that the suspension of the transaction has been completed or that the transaction status has been put on hold.

[0129] When a user associated with a transaction ID whose settlement flag is "on hold" accesses the server device 30 from the mobile sales robot 10 or the user terminal 20, the server device 30 reads out the product code (i.e., the existing product code) stored in the transaction management table in association with the transaction ID. The server device 30 then transmits the read product code to the device from which the access originated and resumes the transaction.

[0130] This allows the user to temporarily suspend a transaction and resume it at another time, for example, when the user wants to continue purchasing products sold by other mobile sales robots 10, or when an emergency arises and the user is unable to make payment on the spot.

[0131] The instruction to suspend a transaction is not limited to a user operation via the transaction suspension button 58. For example, the trigger for starting a transaction may be the inclusion of a predetermined sound, such as a sound requesting suspension of a transaction, in the sound picked up by the sound pickup unit 157. If sound is used as a trigger for suspending a transaction, it is preferable to limit the state of the mobile sales robot 10 to when a transaction is in progress.

[0132] In the above example, a registration request is sent every time a product is picked up, but the timing of sending the registration request is not limited to this. For example, the sales support unit 1546 may send a registration request including the new product code and transaction ID registered up to that point to the server device 30 when a payment instruction or an interruption instruction is issued.

[0133] Returning to FIG. 15 , the state management unit 1547 updates the state information representing the state of the mobile vending robot 10 according to the state of the mobile vending robot 10. For example, when the mobile vending robot 10 is moving to the call position, the state management unit 1547 updates the state information to the "moving" state. Also, for example, when the mobile vending robot 10 has arrived at the call position but has not received an instruction to start a transaction, the state management unit 1547 updates the state information to the "waiting for transaction." Also, for example, when the state management unit 1547 receives an instruction to start a transaction, the state management unit 1547 updates the state information to the "in transaction." Also, when the state management unit 1547 receives a settlement completion notice or an interruption completion notice, the state management unit 1547 updates the state information to the "waiting for transaction."

[0134] The state information updated by the state management unit 1547 is stored in, for example, the RAM 153, and the contents of the state information are notified to the server device 30 every time the state information is updated.

[0135] Next, a description will be given of the functional configuration of the user terminal 20. The control unit 214 of the user terminal 20 functions as a transmission / reception unit 2141, an input reception unit 2142, a self-position identification unit 2143, a display control unit 2144, and a purchase support unit 2145, as a result of the CPU 211 operating in accordance with programs stored in the ROM 212 or the storage unit 220. Note that each of these functions may be configured using hardware such as a dedicated circuit.

[0136] The transmitting / receiving unit 2141 transmits and receives various information to and from external devices such as the server device 30 via the communication unit 219. For example, the transmitting / receiving unit 2141 receives the robot ID, current location, status information, arrival notification, etc. of the mobile sales robot 10 from the server device 30. The transmitting / receiving unit 2141 also transmits product information requests, call requests, login requests, payment requests, etc., which will be described later, to the server device 30. The transmitting / receiving unit 2141 also receives unpaid product information, payment completion notifications, etc., which will be described later, from the server device 30.

[0137] The input receiving unit 2142 receives various types of input information via the operation unit 216 and the imaging unit 217. For example, the input receiving unit 2142 receives input of a product information request or a call request via the operation unit 216. The input receiving unit 2142 also receives input of user face image data and the like via the imaging unit 217.

[0138] The self-location identifying unit 2143 identifies the location of the user terminal 20 within the area represented by the map information 2201 based on the output of the positioning unit 218 .

[0139] The display control unit 2144 controls the display unit 215 and causes various types of information to be displayed on the display unit 215. For example, the display control unit 2144 cooperates with the purchase support unit 2145 to cause the display unit 215 to display various screens (GUIs).

[0140] The purchase support unit 2145 cooperates with other functional units of its own terminal and the server device 30 to execute various processes to support the purchase of products sold by the mobile sales robot 10. In addition, the purchase support unit 2145 cooperates with the display control unit 2144 to display on the display unit 215 various screens to support the purchase of products sold by the mobile sales robot 10.

[0141] For example, the purchase support unit 2145 displays on the display unit 215 a screen for supporting calling the mobile sales robot 10. In addition, the purchase support unit 2145 displays on the display unit 215 a screen for supporting payment for merchandise.

[0142] An example of a screen that the purchase support unit 2145 displays on the display unit 215 in cooperation with the display control unit 2144 will be described below.

[0143] First, examples of screens for assisting in calling the mobile sales robot 10 will be described with reference to Fig. 18 and Fig. 19. Fig. 18 is a diagram showing an example of a map display screen displayed on the display unit 215 of the user terminal 20. Fig. 19 is a diagram showing an example of a call screen displayed on the display unit 215 of the user terminal 20.

[0144] When a product information request menu is selected from a menu selection screen (not shown) on the user terminal 20, the purchase support unit 2145 displays the map display screen 60 shown in Figure 16 on the display unit 215 based on the map information 2201 stored in the memory unit 220.

[0145] The map display screen 60 has a map display area 61. The purchase support unit 2145 displays a map of the range in which the mobile sales robot 10 can move in the map display area 61 based on the map information 2201. Here, the purchase support unit 2145 may display a map of the vicinity of the location of the user terminal 20 based on the location information identified by the self-location identification unit 2143, or may display a map of the vicinity of the location of the mobile sales robot 10 based on the location information of the mobile sales robot 10 provided by the server device 30. In addition, the display control unit 2144 changes the range of the map displayed in the map display area 61 in response to an operation on the map (for example, a scroll operation, a zoom-in / zoom-out operation, etc.).

[0146] In addition, the purchase support unit 2145 superimposes on the map in the map display area 61 the position of the terminal identified by the self-position identification unit 2143 and the position of the mobile sales robot 10 provided by the server device 30 in a distinguishable manner.

[0147] In Fig. 18, the position of the terminal itself is shown by a hatched circular terminal mark 62. Also, the position of each mobile sales robot 10 is shown by a robot mark 63 that resembles each mobile sales robot. The robot mark 63 also displays robot identification information such as a robot ID. The robot marks 63 are displayed in a state where they can be selected by the user.

[0148] The user can select the corresponding mobile sales robot 10 by touching any of the robot marks 63 displayed on the map display screen. When the purchase support unit 2145 receives the selection (designation) of the mobile sales robot 10 via the input receiving unit 2142, it transmits a product information request including the terminal ID of the user terminal 20 and the robot ID of the designated mobile sales robot 10 to the server device 30. The server device 30 that has received the product information request reads out product information of the product sold by the mobile sales robot 10 with the robot ID designated in the product information request from the product management table 3164 and the product master 3162, as will be described later, and transmits the product information to the user terminal 20 that made the request.

[0149] When the transmitting / receiving unit 2141 receives the product information, the purchase support unit 2145 displays the product information in association with the robot mark 73 of the selected mobile sales robot 10, as shown in the call screen 70 of Fig. 19. In other words, the call screen 70 is a screen that is displayed when any one of the robot marks 63 displayed on the map display screen 60 is touched.

[0150] 19, the call screen 70 has a map display area 71 and a product information display area 72. The map display area 71 is an area for displaying a map based on map information 2201, similar to the map display area 61 of the map display screen 60. Note that the map display area 71 is smaller than the map display area 61 of the map display screen 60. The purchase support unit 2145 displays the robot mark 63 touched on the map display screen 60 and a map of its vicinity in the map display area 71 of the call screen 70.

[0151] The product information display area 72 is an area for displaying product information of the products mounted on the selected mobile sales robot 10. The purchase support unit 2145 displays the product information transmitted from the server device 30 in response to the selection of the mobile sales robot 10 in the product information display area 72. Specifically, the purchase support unit 2145 displays the product information by product, arranged vertically. The displayed product information includes product images, product names, prices, etc. The product information display area 72 can be scrolled vertically, and the purchase support unit 2145 updates the displayed product information in response to the scroll operation. This allows the product information display area 72 to display product information for all products mounted on the mobile sales robot 10.

[0152] The call screen 70 also has a call button 74 for calling the selected mobile sales robot 10. The user can check the products mounted on the mobile sales robot 10 selected on the map display screen on the call screen, and if there is a product that the user wishes to purchase, he or she can operate the call button 74 to call the mobile sales robot 10. By calling the mobile sales robot 10 using the map display screen 60 and the call screen 70, the user can select the mobile sales robot 10 to be called while checking the location of the mobile sales robot 10. This allows the user to efficiently call the mobile sales robot 10, for example, by calling the mobile sales robot 10 closest to the user's location.

[0153] Specifically, when the input receiving unit 2142 receives an operation of the call button 74 on the call screen 70, the purchase support unit 2145 transmits a call request including the terminal ID of the user's own user terminal 20, the robot ID of the selected mobile sales robot 10, and the location information (call location) identified by the self-location identifying unit 2143 to the server device 30. Upon receiving the call request, the server device 30 causes the mobile sales robot 10 with the robot ID specified in the call request to travel to the call location specified in the call request, as will be described later.

[0154] This allows the user to check the products carried by the mobile sales robot 10 before calling the mobile sales robot 10. Therefore, the mobile sales system 1 can improve user convenience.

[0155] In addition, the server device 30 predicts the time (hereinafter also referred to as arrival time) until the mobile sales robot 10 corresponding to the robot ID arrives at the call location based on the current location and call location of the robot ID specified in the call request, the number of call requests for that robot ID registered in the call management table 3166, etc., and transmits this to the user terminal 20 that made the request.

[0156] The call screen 70 also has an arrival time display area 75 that displays the time it will take for the selected mobile sales robot 10 to arrive at the location of the user terminal 20. The purchase support unit 2145 displays the arrival time transmitted from the server device 30 in response to the selection of the mobile sales robot 10 in the arrival time display area 75. The arrival time display area 75 may also display information for identifying the mobile sales robot 10, such as the robot ID of the mobile sales robot 10 that is scheduled to arrive.

[0157] The timing for displaying the arrival time is not limited to after the call button 74 is operated. For example, the purchase support unit 2145 may display the arrival time when the mobile sales robot 10 is selected on the map display screen 60. In this case, the purchase support unit 2145 may acquire the arrival time from the server device 30 when the mobile sales robot 10 is selected by including the location information identified by the self-location identification unit 2143 in a product information request and transmitting the request to the server device 30.

[0158] Furthermore, the call screen 70 identifiably displays the mobile sales robot 10 selected on the map display screen 60. Specifically, in the map display area 71, a robot mark 73 bearing the indication "Robot B," which is information identifying the mobile sales robot 10 selected on the map display screen, is displayed together with a map of the surrounding area. This allows the user to check the location, identification information, product information of the products carried by the selected mobile sales robot 10, etc., on a single screen. The information identifying the mobile sales robot 10 may be a unique number, name, etc., assigned to each mobile sales robot 10.

[0159] After the transmitting / receiving unit 2141 transmits the call request, the purchase support unit 2145 displays the current location of the mobile sales robot 10 to be called on the map display screen 60 or the call screen 70 using the robot mark 63 or 73, etc., based on the location information of the mobile sales robot 10 to be called, etc., provided by the server device 30. This allows the user to easily confirm the current location of the mobile sales robot 10 selected to be called by looking at the map displayed on the map display screen 60 or the call screen 70. When the current location of the mobile sales robot 10 to be called is displayed on the map display screen 60, it is preferable that the purchase support unit 2145 displays the mobile sales robot 10 to be called in a manner that allows the mobile sales robot 10 to be distinguished from other mobile sales robots 10.

[0160] Furthermore, when the mobile sales robot 10 to be called moves to the call position, the purchase support unit 2145 displays a screen notifying that the mobile sales robot 10 has arrived at the call position on the display unit 215. Specifically, when the purchase support unit 2145 detects that the mobile sales robot 10 to be called has arrived at the call position based on the arrival notification at the call position provided by the server device 30, the purchase support unit 2145 displays a screen notifying that the mobile sales robot 10 has arrived at the call position on the display unit 215. This allows the user to easily recognize that the mobile sales robot 10 has arrived at the call position by looking at the screen displayed on the display unit 215.

[0161] The method of notifying the arrival of the mobile sales robot 10 is not limited to the method using a display screen. For example, the purchase support unit 2145 may cooperate with a notification unit such as a speaker or vibrator provided in the user terminal 20 to notify the user that the mobile sales robot 10 has arrived at the called location by sound or vibration. The purchase support unit 2145 may also display the robot number or robot ID displayed on the arriving mobile sales robot 10 on a pop-up screen. This allows the user to more easily recognize the mobile sales robot 10 that he or she has called. The method of displaying the robot number, etc. on the mobile sales robot 10 is not limited.

[0162] In the present embodiment, the mobile sales robot 10 is notified of its arrival at the call position in response to a notification from the server device 30. However, the present invention is not limited to this. The user terminal 20 may determine whether or not it has arrived by determining this on its own. In this case, for example, the purchase support unit 2145 of the user terminal 20 determines whether or not the location information of the mobile sales robot 10 to be called, which is provided by the server device 30, has entered a predetermined range based on the location information of the call position. When the mobile sales robot 10 enters the predetermined range, the purchase support unit 2145 determines that the mobile sales robot 10 has arrived at the call position, and causes the display unit 215 to display a screen notifying the mobile sales robot 10 of its arrival at the call position.

[0163] The screen for assisting in calling the mobile sales robot 10 is not limited to the examples shown in FIGS.

[0164] Next, an example of a screen for supporting payment for a product will be described with reference to Fig. 20 and the above-mentioned Fig. 16. Here, Fig. 20 is a diagram showing an example of a product confirmation screen displayed on the display unit 215 of the user terminal 20.

[0165] When a menu for accessing the server device 30 is selected from a menu selection screen (not shown) on the user terminal 20, the purchase support unit 2145 causes the display unit 215 to display an authentication screen that prompts the user to enter login information for logging in to the server device 30. In this embodiment, an example will be described in which facial image data of the user is used as the login information. In this case, the authentication screen displayed by the purchase support unit 2145 may be a screen that prompts the user to capture an image of their face, similar to the authentication screen 40 in FIG. 16 .

[0166] When the login information is entered, the purchase support unit 2145 sends a login request including the login information to the server device 30. Upon receiving the login request, the server device 30 identifies the user corresponding to the login information from the user management table 3165, as described below. The server device 30 then generates unpaid product information including the transaction IDs of transactions for which the payment flag is "on hold" among the transactions related to the identified user, as well as the product codes and product information of the products related to the transaction IDs, and sends the information to the user terminal 20 that made the request.

[0167] When the transmitting / receiving unit 2141 receives the unpaid product information, the purchase support unit 2145 displays the confirmation screen shown in FIG. 20 on the display unit 215 based on the unpaid product information.

[0168] The confirmation screen 80 displays information about products that the user has taken out of one or more mobile sales robots 10 and for which payment has not yet been completed. For example, the confirmation screen 80, like the product registration screen 50 in FIG. 17 described above, displays a product icon 81 representing the product, a product name 82, the number of products 83, and a subtotal 84 for each product. The confirmation screen also displays a total number of products 85 and a total amount 86. Here, the subtotal 84, the total number of products 85, and the total amount 86 are assumed to be included in the unpaid product information, but the purchase support unit 2145 may be configured to derive them from the content included in the unpaid product information.

[0169] This allows the user to easily check the unpaid items that he or she has taken out from one or more mobile sales robots 10 by looking at the confirmation screen 80 displayed on the display unit 215. If the robot ID of the mobile sales robot 10 that took out the item and the date and time of taking out are stored in association with each item, the purchase support unit 2145 may display this information on the confirmation screen 80.

[0170] The confirmation screen 80 also has a checkout button 87. Similar to the checkout button 57 described above, the checkout button 87 is an operator for instructing payment for the product. After checking the unpaid products on the confirmation screen 80, the user can pay for the products by operating the checkout button 87.

[0171] When the purchase support unit 2145 detects via the input receiving unit 2142 that the checkout button 87 has been operated, it causes the display unit 215 to display an authentication screen that prompts the user to capture a facial image. For example, the purchase support unit 2145 causes the display unit 215 to display an authentication screen similar to the authentication screen 40 of FIG. 16. When the purchase support unit 2145 acquires the user's facial image data, it transmits the acquired facial image data and a transaction ID to the server device 30 as a payment request. Here, the transaction ID was provided by the server device 30 when the login request was transmitted.

[0172] Upon receiving the payment request, the server device 30 identifies the user ID of the user corresponding to the facial image data from the user management table 3165, and executes payment processing for the product related to the transaction ID specified in the payment request, using the payment information associated with the user ID, as will be described later. Then, upon completing the payment processing, the server device 30 transmits a payment completion notification to the user terminal 20 that originated the request.

[0173] When the transmitting / receiving unit 2141 receives the payment completion notice, the purchase support unit 2145 causes the display unit 215 to display a screen informing the user that payment has been completed.

[0174] This allows the user of the user terminal 20 to make payments for the products that he or she has taken out from one or more mobile sales robots 10 using the user terminal 20. Therefore, the user of the user terminal 20 can make payments for the products that he or she has taken out from the mobile sales robot 10 at any location and timing.

[0175] In this embodiment, the user's facial image data is acquired twice, once at login and once at payment, but this is not limiting. For example, the facial image data acquired at login may be stored in RAM 153 or the like, and the facial image data may be included in the payment request and transmitted. Furthermore, the server device 30 may execute the payment process based on the authentication result of the facial image data transmitted once.

[0176] 15, the functional configuration of server device 30 will be described. Control unit 314 of server device 30 functions as a transmission / reception unit 3141, an information management unit 3142, an authentication unit 3143, a payment processing unit 3144, and a robot management unit 3145 by CPU 311 operating in accordance with programs stored in ROM 312 or storage unit 316. Note that each of these functions may be configured using hardware such as a dedicated circuit.

[0177] The transmitting / receiving unit 3141 transmits and receives various information to and from external devices such as the user terminal 20 and each mobile sales robot 10 via the communication unit 315. For example, the transmitting / receiving unit 3141 receives, from each mobile sales robot 10, location information, status information, product codes and inventory quantities of products stored in the mobile sales robot 10. The transmitting / receiving unit 3141 also receives transaction start requests, registration requests, settlement requests, transaction suspension requests, and the like from the mobile sales robot 10. The transmitting / receiving unit 3141 also receives product information requests, call requests, login requests, settlement requests, and the like from the user terminal 20.

[0178] Furthermore, for example, the transmitting and receiving unit 3141 transmits a transaction ID, an existing product code, a payment completion notice, an interruption completion notice, etc. to the mobile sales robot 10. Furthermore, the transmitting and receiving unit 3141 transmits unpaid product information, a payment completion notice, etc. to the mobile sales robot 10 to the user terminal 20.

[0179] The information management unit 3142 is an example of an information management means and a second transmission means. The information management unit 3142 stores information in the storage unit 316 and updates various pieces of information stored in the storage unit 316 based on the information received by the transmission / reception unit 3141. The information management unit 3142 also reads various pieces of information transmitted by the transmission / reception unit 3141 from the storage unit 316 as appropriate.

[0180] For example, the information management unit 3142 updates the robot management table 3163 based on the position information and status information received by the transmitting / receiving unit 3141 from the mobile sales robot 10.

[0181] For example, when the transmitting / receiving unit 3141 receives a product information request from the user terminal 20, the information management unit 3142 reads out a product code corresponding to the robot ID included in the product information request from the product management table 3164. The information management unit 3142 also references the product master 3162 and reads out product information corresponding to the product code. The information management unit 3142 then controls the transmitting / receiving unit 3141 to transmit the read product code and product information to the user terminal 20 that sent the request.

[0182] For example, when the transmitting / receiving unit 3141 receives a call request or an arrival notification from the mobile sales robot 10 or the user terminal 20, the information management unit 3142 stores the information in the call management table 3166 as appropriate.

[0183] Furthermore, for example, when the transmitting / receiving unit 3141 receives a transaction start request from the mobile sales robot 10, the information management unit 3142 issues a transaction ID and stores it in the transaction management table 3167 in association with the user ID of the user performing the transaction (hereinafter also referred to as the transaction user). The information management unit 3142 also notifies the issued transaction ID to the mobile sales robot 10 that sent the transaction start request. In addition, along with the issuance of the transaction ID, the information management unit 3142 sets a settlement flag in the transaction management table 3167, which indicates an unsettled state.

[0184] Here, the information management unit 3142 cooperates with the authentication unit 3143 (described later) to identify the user ID from the user management table 3165 based on the facial image data included in the received content.

[0185] If there is a transaction ID with a settlement flag in the "pending" state among the transaction IDs related to the user ID of the transacting user stored in the transaction management table 3167, the information management unit 3142 determines that the transaction related to that transaction ID has been resumed. In this case, the information management unit 3142 transmits the corresponding transaction ID with the settlement flag in the "pending" state to the mobile sales robot 10 that sent the transaction start request. Furthermore, if a product code is stored in association with the "pending" transaction ID, the information management unit 3142 transmits the product code as an existing product code to the mobile sales robot 10 that sent the transaction start request.

[0186] Furthermore, for example, when the transmitting / receiving unit 3141 receives a registration request from the mobile sales robot 10, the information management unit 3142 stores the product code in the transaction management table 3167 based on the transaction ID and product code included in the registration request. Specifically, the information management unit 3142 searches the transaction management table 3167 for an entry corresponding to the transaction ID included in the product registration request. Then, the information management unit 3142 registers the product by storing the product code included in the product registration request in association with the searched transaction ID.

[0187] Furthermore, for example, when the transmitting / receiving unit 3141 receives a cancellation request from the mobile sales robot 10, the information management unit 3142 deletes the product code from the transaction management table 3167 based on the transaction ID and product code included in the cancellation request. Specifically, the information management unit 3142 searches the transaction management table 3167 for an entry corresponding to the transaction ID included in the product registration request. Then, the information management unit 3142 cancels the product by deleting the product code included in the cancellation request from the product codes stored in association with the searched transaction ID.

[0188] The information management unit 3142 may store the robot ID of the mobile sales robot 10 that sent the product registration request in association with the product code. The information management unit 3142 may also store the date and time of registration in association with the corresponding product code.

[0189] Furthermore, for example, when the transmitting / receiving unit 3141 receives a transaction interruption request from the mobile sales robot 10, the information management unit 3142 updates the settlement flag in the transaction management table 3167 corresponding to the transaction ID to the "on hold" state based on the transaction ID included in the transaction interruption request. Then, the information management unit 3142 transmits an interruption completion notice to the mobile sales robot 10 that made the request, notifying that the interruption of the transaction has been completed.

[0190] Furthermore, for example, when the transmitting / receiving unit 3141 receives a login request from the user terminal 20, the information management unit 3142, in cooperation with the authentication unit 3143 (described later), identifies the user ID of the user corresponding to the facial image data included in the login request from the user management table 3165. The information management unit 3142 also reads out the product code associated with the transaction ID for which the payment flag is "on hold" from among the transaction IDs associated with the identified user ID. The information management unit 3142 also references the product master 3162 and reads out the product information corresponding to the product code. The information management unit 3142 then controls the transmitting / receiving unit 3141 to generate unpaid product information including the transaction ID for which the payment flag is "on hold," the product code and product information read based on the transaction ID, and transmits the information to the user terminal 20 that issued the request.

[0191] If the user specified in the login request does not exist in the user management table 3165, the information management unit 3142 controls the transmission / reception unit 3141 to send error information informing that fact to the requesting user terminal 20. The information management unit 3142 may also derive the number of items, subtotal, total number of items, total amount, etc. for each item based on the item code associated with the transaction ID whose payment flag is "on hold," and send the derived information together with the unpaid item information.

[0192] Furthermore, for example, when the transmitting / receiving unit 3141 receives a payment request from the mobile sales robot 10 or the user terminal 20, the information management unit 3142 updates the payment flag of the transaction ID for which the payment processing has been completed to "paid" in cooperation with the payment processing unit 3144. Then, the information management unit 3142 transmits a payment completion notification to the requesting mobile sales robot 10 or the user terminal 20 notifying that the payment has been completed.

[0193] The authentication unit 3143 performs face authentication processing of the user based on the facial image data transmitted from the mobile sales robot 10 and the user terminal 20. Specifically, the authentication unit 3143 extracts feature information indicating facial features from the facial image data transmitted from the mobile sales robot 10 and the user terminal 20. Then, the authentication unit 3143 compares the extracted feature information with the feature information stored in the user management table 3165 and performs face authentication to identify the user ID of the user corresponding to the facial image data. Here, known technology can be used for face authentication.

[0194] The payment processing unit 3144 is an example of a payment means. Based on a payment request transmitted from the mobile sales robot 10 or the user terminal 20, the payment processing unit 3144 executes payment processing for the transaction specified in the payment request. Specifically, the payment processing unit 3144, in cooperation with the authentication unit 3143, identifies the user ID of the user corresponding to the facial image data included in the payment request, etc., from the user management table. Then, the payment processing unit 3144 performs payment for the product related to the transaction ID specified in the payment request using payment information stored in association with the identified user ID. More specifically, the payment processing unit 3144 calculates the total price of the products corresponding to the product codes associated with the transaction ID specified in the payment request based on the product master 1622, and executes payment processing to pay the calculated total price using the payment information.

[0195] For example, the payment processing unit 3144 executes payment by communicating with a payment server of a payment service provider. If the payment information indicates a prepaid amount, the payment is executed by subtracting the total price of the product from the prepaid amount. The payment processing unit 3144 may also execute electronic payment by credit card payment or two-dimensional code payment.

[0196] The robot management unit 3145 sets the destination and content of information to be sent by the transmission / reception unit 3141 based on a call request from the user terminal 20 and the location information and status information from each mobile sales robot 10. For example, when the transmission / reception unit 3141 receives a call request from the user terminal 20, the robot management unit 3145 sets the mobile sales robot 10 with the robot ID included in the call request as the destination of the movement instruction and sets the call location included in the call request as the content of the transmission. Also, for example, the robot management unit 3145 checks the status information of each mobile sales robot 10 stored in the robot management table 3163 and selects the mobile sales robot 10 that corresponds to the call request from among the mobile sales robots 10 in the "waiting for call" state.

[0197] For call requests whose arrival dates and times are not registered in the call management table 3166, the robot management unit 3145 sets the call locations specified in the call requests in order from the earliest call date and time, and causes the transmitting / receiving unit 3141 to transmit them. This allows the robot management unit 3145 to move the target mobile sales robots 10 in the order in which the call requests were made.

[0198] The robot management unit 3145 also sets the user terminal 20 that is the source of the call request as the destination, calculates the arrival time of the selected mobile sales robot 10 at the call location, and sets the arrival time as the content of the message. The arrival time is calculated based on the number of call requests (unprocessed requests with no arrival date and time registered) to the mobile sales robot 10 registered in the call management table 3166, the location information and status information of the mobile sales robot 10 registered in the robot management table 3163, etc.

[0199] In addition, the robot management unit 3145 refers to the product management table 3164 and sets the mobile sales robot 10 with a robot ID whose inventory quantity for any or all of the products it carries has reached zero as the destination of the movement instruction, and sets the location where the products will be replenished as the movement destination.

[0200] The mobile sales robot 10 may have some or all of the functions of the above-mentioned transmission / reception unit 3141, information management unit 3142, authentication unit 3143, payment processing unit 3144, and robot management unit 3145. In this case, the user terminal 20 transmits and receives various information to and from the mobile sales robot 10.

[0201] The operation of the mobile sales system 1 having the devices configured as described above will now be described.

[0202] First, with reference to FIG. 21, an example of the operation of the mobile sales robot 10 called via the user terminal 20 until it arrives at the called position will be described.

[0203] 21 is a sequence chart showing an example of the operation of the mobile sales system 1. This sequence chart shows a case where a user checks the product information of a product mounted on the mobile sales robot 10, calls the mobile sales robot 10, and purchases the product of the mobile sales robot 10.

[0204] First, to call the mobile sales robot 10, the user starts the application program of the mobile sales system 1 installed in the user terminal 20. When the product information request menu is selected, the user terminal 20 displays a map display screen shown in Fig. 18 and accepts the selection of the mobile sales robot 10 (step S1). The user terminal 20 transmits a product information request including the robot ID of the selected mobile sales robot 10 and the terminal ID of the user terminal 20 to the server device 30 (step S2).

[0205] The server device 30 reads out product information from the storage unit 316 in response to the received product information request (step S3). Specifically, the information management unit 3142 reads out a product code corresponding to the robot ID included in the product information request from the product management table 3164. Next, the information management unit 3142 reads out product information corresponding to the read product code from the product master 3162. The information management unit 3142 transmits the read out product information to the user terminal 20 (step S4).

[0206] The user terminal 20 displays the received product information on the display unit 215 (step S5). When the user checks the displayed product information and finds a product that the user wants to purchase, the user performs an operation to call the mobile sales robot carrying the product. This inputs a call request to the user terminal 20 (step S6). The user terminal 20 acquires location information of the location where the user terminal 20 is located (step S7), and transmits a call request to the server device 30 with the acquired location information as the call location (step S8).

[0207] When the server device 30 receives the call request (step S9), it transmits a movement instruction including a call position to the mobile sales robot 10 specified in the call request (step S10).

[0208] The mobile sales robot 10 controls the driving unit 123 to move to the call position specified in the movement instruction (step S11). When the mobile sales robot 10 arrives at the call position, the mobile sales robot 10 transmits an arrival notification to the server device 30 (step S12). Note that the mobile sales robot 10 may transmit only location information indicating its own location to the server device 30, and the server device 30 may determine whether the mobile sales robot 10 has arrived at the call position.

[0209] The server device 30 updates the call management table 3166 based on the received arrival notification (step S13). Specifically, the information management unit 3142 registers the arrival date and time of the corresponding call request in the call management table 3166. Next, the information management unit 3142 transmits the arrival notification to the user terminal 20 that is the source of the call request (step S14).

[0210] When the user terminal 20 receives the arrival notification, the display unit 215 displays information indicating that the called mobile sales robot 10 has arrived (step S15).

[0211] By the above operations, the mobile sales system 1 can move the mobile sales robot 10 to a call position designated by the user in response to a request from the user terminal 20.

[0212] Next, an example of an operation relating to the purchase of a commodity sold by the mobile sales robot 10 will be described with reference to Fig. 22. Fig. 22 is a sequence chart showing an example of the operation of the mobile sales system 1. The operation in Fig. 22 is executed, for example, after step S15 in Fig. 21.

[0213] First, the user instructs the mobile sales robot 10 to start a transaction. When the mobile sales robot 10 receives the instruction to start a transaction (step S21), it displays the authentication screen 40 shown in Fig. 16 and prompts the user to capture a facial image (step S22). When the mobile sales robot 10 acquires facial image data of the user who will perform the transaction (step S23), it transmits a transaction start request including the acquired facial image data to the server device 30 (step S24).

[0214] When the server device 30 receives a transaction start request from the mobile sales robot 10, it identifies the user ID of the user who will perform the transaction from the user management table 3165 based on the facial image data included in the transaction start request (step S25). The server device 30 also issues a transaction ID, associates it with the identified user ID, and registers it in the transaction management table (step S26). Then, the server device 30 transmits a transaction start notification including the issued transaction ID to the mobile sales robot 10 that has issued the transaction start request (step S27).

[0215] If the transaction ID associated with the user ID identified in step S25 already exists in the transaction management table 3167 and the settlement flag for that transaction ID is "on hold," the information management unit 3142 determines that the "on hold" transaction has resumed without issuing a new transaction ID. In this case, the information management unit 3142 sends a transaction start notification to the requesting mobile sales robot 10, including the transaction ID whose settlement flag is "on hold" and the product code (i.e., the existing product code) associated with that transaction ID.

[0216] When the mobile sales robot 10 receives the transaction start notification, it stores the transaction ID and other information included in the transaction start notification in the RAM 153 and permits processing related to the sale of the commodity. Then, when the mobile sales robot 10 detects that a commodity has been removed from the storage unit 111 (step S28), it registers the commodity code of the commodity in the RAM 213 (step S29). In addition, the mobile sales robot 10 transmits a registration request to the server device 30, including the commodity code of the commodity removed from the storage unit 111 and the transaction ID stored in the RAM 153 (step S30).

[0217] When the server device 30 receives the registration request, it registers the product code specified in the registration request in the transaction management table 3167 in association with the transaction ID specified in the registration request (step S31). Note that in step S31, the server device 30 (information management unit 3142) may store the robot ID of the mobile sales robot 10 that sent the registration request and the registration date and time of the product in association with the product code.

[0218] Steps S28 to S31 are executed every time a product is taken out of the storage section 111. When the mobile sales robot 10 detects that a product has been returned to the shelf 112, it executes an operation to cancel the registered product.

[0219] After receiving the transaction start notification in step S27, the mobile sales robot 10 waits for an input to instruct the start of payment or to interrupt the transaction.

[0220] When the mobile sales robot 10 receives an input to start payment, it displays an authentication screen 40 prompting the user to take a facial image (step S41). When the mobile sales robot 10 acquires facial image data (step S42), it transmits a payment request including the acquired facial image data and a transaction ID to the server device 30 (step S43).

[0221] When the server device 30 receives a payment request from the mobile sales robot 10, it identifies the user ID of the corresponding user from the user management table based on the facial image data included in the payment request (step S44). The server device 30 also executes payment for the product related to the transaction ID specified in the payment request using the payment information associated with the identified user ID (step S45). When the payment is successfully completed, the server device 30 updates the payment flag of the corresponding transaction ID stored in the transaction management table 3167 to "paid" (step S46). Then, the server device 30 transmits a payment completion notification to the mobile sales robot 10 that has requested the payment (step S47).

[0222] When the mobile sales robot 10 receives the payment completion notice, it displays information indicating that the payment has been completed on the display unit 215 (step S48).

[0223] On the other hand, when the mobile sales robot 10 receives an input to suspend the transaction, it transmits a transaction suspension request including the transaction ID to the server device 30 (step S51).

[0224] When the server device 30 receives the transaction interruption request from the mobile sales robot 10, it updates the settlement flag of the corresponding transaction ID stored in the transaction management table 3167 to "on hold" based on the transaction ID included in the transaction interruption request (step S52). Then, the server device 30 transmits an interruption completion notice to the mobile sales robot 10 that has requested the transaction interruption request (step S53).

[0225] When the mobile sales robot 10 receives the interruption completion notice, it displays information indicating that the interruption of the transaction has been completed on the display unit 215 (step S54).

[0226] Through the above operations, the mobile sales system 1 enables the sale of merchandise carried by the mobile sales robot 10. The mobile sales system 1 also enables a transaction to be interrupted, and enables the registration status of a merchandise taken out from the mobile sales robot 10 to be handed over to another mobile sales robot 10.

[0227] Next, referring to Fig. 23, an example of operation when payment for a commodity picked up by the mobile sales robot 10 is made using the user terminal 20 will be described. Fig. 23 is a sequence chart showing an example of operation of the mobile sales system 1. Note that the operation of Fig. 23 is executed, for example, after step S54 of Fig. 22.

[0228] First, to access the server device 30, the user starts the application program of the mobile sales system 1 installed in the user terminal 20. When the user terminal 20 is instructed to log in to the server device 30 (step S61), it displays an authentication screen prompting the user to capture a facial image (step S62). When the user terminal 20 acquires facial image data (step S63), it transmits a login request including the acquired facial image data to the server device 30 (step S64).

[0229] When the server device 30 receives a login request from the user terminal 20, it identifies the user ID of the corresponding user from the user management table based on the facial image data included in the login request (step S65). Next, the server device 30 references the transaction management table 3167 and identifies, from among the transaction IDs related to the identified user ID, transaction IDs whose payment flag status is "on hold" (step S66). Next, the server device 30 generates unpaid product information based on the transaction ID identified in step S66 and the product code associated with the transaction ID (step S67). The server device 30 then transmits the generated unpaid product information to the user terminal 20 that has issued the login request (step S68).

[0230] When the user terminal 20 receives the unpaid product information, it displays the confirmation screen 80 shown in Fig. 20 on the display unit 215 based on the unpaid product information (step S69). The user checks the displayed confirmation screen, and if the user wishes to make payment, performs an operation to instruct the start of payment.

[0231] When the user terminal 20 receives the instruction to start payment, it displays an authentication screen on the display unit 215, prompting the user to take a facial image (step S70). When the user terminal 20 acquires the facial image data (step S71), it transmits a payment request including the transaction ID included in the unpaid product information and the acquired facial image data to the server device 30 (step S72).

[0232] When the server device 30 receives a payment request from the user terminal 20, it identifies the user ID of the corresponding user from the user management table 3165 based on the facial image data included in the payment request (step S73). Next, the server device 30 executes payment for the product related to the transaction ID specified in the payment request using the payment information associated with the user ID (step S74). When the payment is successfully completed, the server device 30 updates the payment flag of the corresponding transaction ID stored in the transaction management table 3167 to "paid" (step S75). Then, the server device 30 transmits a payment completion notification to the user terminal 20 that has requested the payment request (step S76).

[0233] When the user terminal 20 receives the payment completion notice, it displays information indicating that the payment has been completed on the display unit 215 (step S77).

[0234] Through the above operations, the mobile sales system 1 enables users to make payments for products picked up from one or more mobile sales robots 10 from the user terminal 20. This allows users to make payments for products picked up from the mobile sales robot 10 at a location away from the mobile sales robot 10 and at any timing.

[0235] As described above, the mobile sales system 1 of the above embodiment includes one or more self-propelled mobile sales robots 10 carrying merchandise, and a server device 30 connected to the mobile sales robots 10 via a network N. The sales support unit 1546 of the mobile sales robot 10 acquires facial image data that can identify a user conducting a transaction and detects the product code of the product removed from the mobile sales robot 10. The sales support unit 1546 also transmits the facial image data and the product code of the product removed from the mobile sales robot 10 to the server device 30. The information management unit 3142 of the server device 30 associates the product code transmitted from the mobile sales robot 10 with the user ID of the user identified by the facial image data transmitted from the mobile sales robot 10 and stores the associated product code. When facial image data is transmitted from the mobile sales robot 10 or the user terminal 20, the information management unit 3142 transmits the stored product code associated with the user ID of the user corresponding to the facial image data to the transmission source device. Then, when the payment processing unit 3144 of the server device 30 receives a payment request from the transmitting device, it executes payment for the product corresponding to the product code stored in association with the user based on the payment information of the user corresponding to the facial image data transmitted from the transmitting device.

[0236] As a result, the mobile sales system 1 enables a user to make payments for products taken out from one or more mobile sales robots 10 at any location and timing using the mobile sales robot 10 and the user terminal 20. Therefore, the mobile sales system 1 enables a user to easily purchase products using the mobile sales robot 10.

[0237] In addition, in the mobile sales system 1, the information management unit 3142 manages the product codes of unpaid products stored in association with the same user ID as one transaction, and when face image data is transmitted from the mobile sales robot 10 or the user terminal 20, it transmits the product codes for one transaction of the user corresponding to the face image data to the transmission source device. Furthermore, when the transmission source device instructs it to execute payment, the payment processing unit 3144 executes payment for the one transaction.

[0238] As a result, the mobile sales system 1 can settle all the unsettled products that a user has taken from one or more mobile sales robots 10 as one transaction. Therefore, the mobile sales system 1 can make it possible for a user to easily purchase products even when the user has taken products from multiple mobile sales robots 10.

[0239] In the mobile sales system 1, when the sales support unit 1546 of the mobile sales robot 10 receives an instruction to suspend a transaction, it transmits a transaction suspension request to the server device 30. In addition, the information management unit 3142 of the server device 30 sets the status of the transaction instructed by the transaction suspension request to "on hold," and when face image data is sent from the mobile sales robot 10 or the user terminal 20, it transmits the product code of the transaction in "on hold" status for the corresponding user to the transmission source device.

[0240] This allows the mobile sales system 1 to make payments for products related to an interrupted transaction using the mobile sales robot 10 or the user terminal 20. Furthermore, the mobile sales system 1 can explicitly manage transactions for which interruption has been instructed, making it easier to distinguish them from transactions currently in progress for which payment has not yet been made.

[0241] In the above embodiment, the programs executed by the mobile sales robot 10, the user terminal 20, and the server device 30 may be recorded on a computer-readable recording medium such as a CD-ROM and provided. Also, the programs executed by the above devices may be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network, or may be provided via a network such as the Internet.

[0242] Furthermore, the above-described embodiments can be modified as appropriate by partially changing the configuration or functions of each of the above-described devices. Therefore, below, several modifications of the above-described embodiments will be described as other embodiments. Note that below, differences from the above-described embodiments will be mainly described, and detailed descriptions of commonalities with the contents already described will be omitted. Furthermore, the modifications described below may be implemented individually or in appropriate combination.

[0243] (Variation 1) In the above embodiment, payment for the merchandise picked up by the mobile sales robot 10 is made in accordance with a payment instruction explicitly input by the user. However, the payment method for the merchandise is not limited to this.

[0244] For example, each time the mobile sales robot 10 detects that a product has been taken out, it may transmit a payment request for that product to the server device 30. Specifically, each time the sales support unit 1546 of the mobile sales robot 10 detects that a product has been taken out, it transmits a payment request including the product ID and transaction ID of the taken product to the server device 30. Furthermore, based on the transaction ID included in the payment request, the payment processing unit 3144 of the server device 30 identifies the user ID stored in association with the transaction ID from the transaction management table 3167.

[0245] The payment processing unit 3144 then reads out payment information corresponding to the identified user ID from the user management table 3165, and makes payment for the product corresponding to the product code included in the payment request using the payment information for prepaid payment, etc. The information management unit 3142 also stores the product code for which payment has been completed in the transaction management table 3167 in association with the transaction ID included in the payment request.

[0246] Furthermore, when this modified example is adopted, it becomes possible to determine whether or not payment has been made for each product code by storing a payment flag in association with each product code in the transaction management table 3167. Furthermore, for example, if the prepaid amount is less than the product price, the payment flag is set to "unsettled," and if an instruction to abort the transaction is given, only the products with the payment flag set to "unsettled" are updated to "on hold."

[0247] When a login request is received from the user terminal 20, the information management unit 3142 transmits the unpaid product information generated for the product whose payment flag is "pending" to the requesting user terminal 20. When a payment request is received from the mobile sales robot 10 or the user terminal 20, the payment processing unit 3144 executes payment for the product whose payment flag is "unpaid" or "pending."

[0248] As a result, in the mobile sales system 1, payment for a product can be made every time the product is picked up from the mobile sales robot 10. Furthermore, in the mobile sales system 1, for products for which payment could not be made due to insufficient balance or the like, payment can be made separately via the user terminal 20 or the like. Therefore, the mobile sales system 1 can improve the convenience of users in purchasing products using the mobile sales robot 10.

[0249] (Variation 2) In the above embodiment, facial image data is used as user identification information for identifying (specifying) a user. However, other information may be used as long as it can identify a user. For example, the user identification information may be a combination of a user ID and a password. Furthermore, for example, the user identification information may be biometric information other than facial image data.

[0250] When this modification is adopted, the user management table 3165 stores user identification information such as a pair of a user ID and a password and biometric information as characteristic information. Furthermore, the mobile sales robot 10 and the user terminal 20 display an authentication screen prompting the user to enter a pair of a user ID and a password or biometric information when starting a transaction, starting a settlement, or logging into the server device 30. This allows the same operation as in the above-described embodiment to be performed even when using user identification information other than facial image data.

[0251] (Variation 3) In the above embodiment, even if the user operating the mobile sales robot 10 that has reached the call position is a user other than the user who called the mobile sales robot 10, the user can purchase the product sold by the mobile sales robot 10. However, when starting a transaction with the mobile sales robot 10, a match determination may be made as to whether or not the user is the user who called the mobile sales robot 10, and only if the user is the user who called the mobile sales robot 10, processing related to the sale of the product may be permitted.

[0252] When this modification is adopted, for example, when an instruction to call the mobile sales robot 10 is given, the purchase support unit 2145 of the user terminal 20 may acquire the user's facial image data, include it in a call request, and send it to the server device 30. In this case, the information management unit 3142 of the server device 30 stores the facial image data included in the call request or the feature information extracted from the facial image data in the call management table 3166 in association with the robot ID of the mobile sales robot 10 to be called.

[0253] Then, when a transaction start request including facial image data is transmitted from the mobile sales robot 10 that has arrived at the call position, the information management unit 3142 determines whether or not to start the transaction based on the facial authentication result between the facial image data included in the transaction start request and the feature information associated with the corresponding robot ID in the call management table 3166. Specifically, if the facial authentication is successful, the information management unit 3142 transmits a transaction start notification to the mobile sales robot 10, and if the facial authentication is unsuccessful, the information management unit 3142 transmits error information to the mobile sales robot 10 notifying of an authentication error.

[0254] When the mobile sales robot 10 receives error information notifying an authentication error, the sales support unit 1546 displays a screen based on the error information on the display unit 155 and does not permit processing related to the sale of the product. For example, the sales support unit 1546 may lock the electronic lock on the door provided in the storage unit 111 to prevent the product from being removed.

[0255] As a result, the mobile sales system 1 according to this modification can prevent a situation in which users other than the user who called the mobile sales robot 10 use the mobile sales robot 10 that has reached the calling position. Therefore, the mobile sales system 1 according to this modification can improve convenience for users who call the mobile sales robot 10.

[0256] The user identification information used to determine whether the calling user is a match is not limited to face image data. For example, a passcode or the like designated by the user may be used to determine whether the calling user is a match.

[0257] Furthermore, instead of the face image data described above, a passcode such as a one-time password may be used to determine whether the calling user matches. In this case, upon receiving the call location, the information management unit 3142 issues a passcode and transmits it to the requesting user terminal 20. The information management unit 3142 also stores the issued passcode in the call management table 3166 in association with the robot ID of the mobile sales robot 10 to be called.

[0258] Then, when a transaction start request including a passcode is transmitted from the mobile sales robot 10 that has arrived at the call position, the information management unit 3142 determines whether or not to start the transaction based on the result of authentication (comparison) between the passcode included in the transaction start request and the passcode associated with the corresponding robot ID in the call management table 3166. In this case, it is preferable that the mobile sales robot 10, in response to an instruction to start the transaction, displays an authentication screen on the display unit 155 that prompts the user to enter a passcode.

[0259] (Variation 4) In the above embodiment, unsettled transactions made by a user with the same user ID using one or more mobile vending robots 10 are managed as a single transaction using the same transaction ID. However, this is not the only possible configuration. For example, a transaction ID may be issued for each mobile vending robot 10, and the transaction ID may be managed in association with the user ID of the user who made the transaction.

[0260] Specifically, every time the information management unit 3142 receives a transaction start request from the mobile sales robot 10, it issues a new transaction ID, associates it with the user ID identified based on the transaction start request, and stores it in the transaction management table 3167. In addition, the information management unit 3142 sets the issued transaction ID as a new transaction ID, includes it in a transaction start notification, and sends it to the mobile sales robot 10 that made the request.

[0261] In addition, the information management unit 3142 refers to the transaction management table 3167, and if a transaction ID with a payment flag of "pending" is associated with the user ID identified based on the transaction start request, it sets that transaction ID as an existing transaction ID and sends it together with the existing product code stored in association with that existing transaction ID in the transaction start notification.

[0262] On the other hand, when the sales support unit 1546 of the mobile sales robot 10 detects the removal of a product, it registers a new product code based on the new transaction ID. In addition, when the sales support unit 1546 receives the existing transaction ID and the existing product code, it displays the product corresponding to the existing product code for each existing transaction ID in a state where it can be identified as corresponding to the new product code.

[0263] Furthermore, when an instruction to start payment is received, the sales support unit 1546 may display a screen on which a transaction to be paid can be selected from a new transaction ID and an existing transaction ID, and may transmit a payment request for the selected transaction to the server device 30. In this case, the payment request includes the face image data as well as the transaction ID of the transaction to be paid selected from the new transaction ID and the existing transaction ID. When the server device 30 receives the payment request, the payment processing unit 3144 performs payment for the product related to the transaction ID of the transaction to be paid and updates the payment flag related to the transaction ID to the "paid" state. Then, the information management unit 3142 includes the transaction ID of the transaction for which payment has been completed in a transaction completion notice and transmits the transaction completion notice to the mobile sales robot 10. When the sales support unit 1546 receives the transaction completion notice from the server device 30, it displays a screen on the display unit 155 notifying the user that payment for the transaction ID included in the transaction completion notice has been completed.

[0264] In addition, even when a login request and a payment request are made from the user terminal 20, the operations other than issuing a transaction ID are the same as when the mobile sales robot 10 sends a transaction start request and a payment request.

[0265] Furthermore, when an instruction to suspend a transaction is received, the sales support unit 1546 transmits a transaction suspension request to the server device 30. In this case, the sales support unit 1546 may transmit the remaining transaction IDs, other than the transaction ID transmitted in the settlement request, among the new transaction ID and the existing transaction ID, in the transaction suspension request. Furthermore, since the server device 30 maintains the latest settlement flags for existing transaction IDs other than the new transaction ID, the transaction suspension request including the new transaction ID may be transmitted only when the new transaction ID is in an unsettled state.

[0266] As a result, in the mobile sales system 1 according to this modification, transactions can be managed for each mobile sales robot 10 from which the user has retrieved goods. Also, in the mobile sales system 1 according to this modification, settlement or suspension can be performed for each transaction. Therefore, the mobile sales system 1 according to this modification can improve user convenience.

[0267] (Variation 5) In the above-described embodiment, there is no particular restriction on the deadline for settlement of a transaction that has been moved to the "on hold" state, but a reminder or the like may be sent to notify the user that there is a transaction on hold or that there is an unsettled transaction.

[0268] In this case, when the information management unit 3142 of the server device 30 receives a transaction suspension request, it stores date and time information indicating the date and time when the request was received in association with the corresponding transaction ID in the transaction management table 3167. Then, when a predetermined time has passed (e.g., every hour) since the date and time information associated with the transaction ID in the "on hold" state, the information management unit 3142 sends a reminder to a terminal such as the user terminal 20, based on the user information associated with the user ID of the transaction ID, to notify the user that a transaction is on hold.

[0269] As a result, in the mobile sales system 1 according to this modification, if there is a pending transaction, the user of the transaction can be notified of this fact. Therefore, the mobile sales system 1 according to this modification can prompt the user to resume the transaction or execute the payment, thereby improving user convenience.

[0270] (Variation 6) In the above embodiment, a call request is sent from the user terminal 20 carried by the user to the server device 30, but this is not limiting. For example, the call request may be sent to the server device 30 from a terminal device connected to the network N, for example, a terminal device installed in a facility where the mobile sales robot 10 travels. When using a terminal device installed in a facility, it is desirable that the user be able to set the call location to any location.

[0271] In the above embodiment, a login request and a payment request are transmitted from the user terminal 20 carried by the user to the server device 30, but this is not limiting. For example, the login request and the payment request may be transmitted to the server device 30 from a terminal device connected to the network N, for example, a terminal device installed in a facility where the mobile sales robot 10 travels.

[0272] Although the embodiments of the present invention have been described above, these embodiments are presented as examples and are not intended to limit the scope of the invention. The above embodiments can be embodied in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope and spirit of the invention, and are also included in the inventions and their equivalents as set forth in the claims. [Explanation of symbols]

[0273] 1 Mobile sales system 10 Mobile Sales Robot 20 User terminal 30 Server device 1541 Transmitter / Receiver 1542 Input reception section 1543 Self-location part 1544 Travel control unit 1545 Display control unit 1546 Sales Support Department 1547 Status Management Department 2141 Transmitter / Receiver 2142 Input reception section 2143 Self-location part 2144 Display control unit 2145 Purchasing Support Department 3141 Transmitter / Receiver 3142 Information Management Department 3143 Authentication Department 3144 Payment processing unit 3145 Robot Management Department N Network [Prior art documents] [Patent documents]

[0274] [Patent Document 1] Japanese Patent Application Laid-Open No. 2008-87892

Claims

1. A mobile sales system having one or more self-propelled mobile sales devices loaded with products, and a server device connected to the mobile sales devices via a network, The mobile sales device is an acquisition means for acquiring user identification information capable of identifying a user who performs a transaction; a transaction start request means for, upon receiving a transaction start operation, transmitting a transaction start request including the user identification information to the server device and obtaining a transaction identifier capable of identifying the transaction from the server device; a detection means for detecting a product removed from the device; a registration request means for transmitting a registration request to the server device, the registration request including the transaction identifier and product identification information capable of identifying the product detected by the detection means; a payment request means for transmitting a payment request including the user identification information and the transaction identifier to the server device when a payment start operation is received; and Equipped with The server device an authentication means for authenticating the user identification information corresponding to the mobile selling device that transmitted the transaction start request and the user identification information included in the transaction start request, based on a first data table that stores user identification information of users who can use the mobile selling device in association with each of the mobile selling devices; a transaction start means for issuing the transaction identifier and providing it to the mobile vending machine that transmitted the transaction start request when the authentication is successful; an information management means for storing, in association with each other, a user identified by the user identification information included in the transaction start request, the transaction identifier issued in response to the transaction start request, and the commodity identification information included in the registration request including the transaction identifier; a payment means for reading out the payment information of the user corresponding to the user identification information included in the payment request from a second data table storing payment information used for electronic payment for each user, and for executing electronic payment for the product corresponding to the product identification information stored in association with the transaction identifier included in the payment request; A mobile sales system equipped with the above.

2. The mobile sales device is A receiving means for receiving an instruction to suspend a transaction; an interruption request means for transmitting an interruption request including a transaction identifier of the transaction to the server device when the acceptance means accepts the interruption instruction; Further provided with In response to the interruption request, the information management means sets the status of the transaction corresponding to the transaction identifier included in the interruption request to a pending status. The mobile sales system according to claim 1.

3. When a pending transaction is stored in association with the user corresponding to the user identification information included in the transaction start request, the transaction start means provides the transaction identifier of the transaction and existing product identification information stored in association with the transaction identifier to the mobile sales device that transmitted the transaction start request. The mobile sales system according to claim 2.

4. The transaction initiation means issues a new transaction identifier each time it receives the transaction initiation request, by associating the new transaction identifier with the user corresponding to the user identification information included in the transaction initiation request. The mobile sales system according to any one of claims 1 to 3.

5. The mobile sales device is The system further includes a display control means for distinguishably displaying the product detected by the detection means and the product corresponding to the existing product identification information transmitted from the server device. The mobile sales system according to claim 3.

6. A server device connected via a network to one or more self-propelled mobile sales devices carrying products, a first receiving means for receiving a transaction start request including user identification information of a user making a transaction from the mobile sales device; an authentication means for authenticating the user identification information corresponding to the mobile selling device that transmitted the transaction start request and the user identification information included in the transaction start request, based on a first data table that stores user identification information of users who can use the mobile selling device in association with each of the mobile selling devices; issuing means for issuing a transaction identifier capable of identifying the transaction when the authentication is successful, and providing the transaction identifier to the mobile vending machine that transmitted the transaction start request; a second receiving means for receiving, from the mobile sales device, a registration request including the product identification information of the product taken out by the mobile sales device and the transaction identifier; an information management means for storing, in association with each other, a user identified by the user identification information included in the transaction start request, the transaction identifier issued in response to the transaction start request, and the commodity identification information included in the registration request including the transaction identifier; a third receiving means for receiving a payment request from the mobile sales device, the payment request including the user identification information and the transaction identifier, and instructing execution of payment; a payment means for reading out the payment information of the user corresponding to the user identification information included in the payment request from a second data table storing payment information used for electronic payment for each user, and for executing electronic payment for the product corresponding to the product identification information stored in association with the transaction identifier included in the payment request; A server device comprising:

Images