Sales information processing system

Abstract

To improve operability by a customer in the case that devices for displaying and selling commodities are used as a set of a plurality of devices in order to accommodate varying types and quantities of the commodities, or the like.SOLUTION: A sales information processing system including selling devices for selling displayed commodities and an information processing device for managing a plurality of selling devices includes a cooperation part for making the plurality of selling devices cooperate to operate, a display part provided in the selling devices for displaying information toward a customer, an imaging part provided in the selling devices for acquiring image information to identify the customer, a distance measurement part provided in the selling devices for measuring distance between the customer identified by the image information outputted by the imaging part and the own device, and a display control part for displaying a registration screen showing information on commodities registered as transaction objects in the display part having the closest distance to the customer among the plurality of selling devices that currently and cooperatively operate on the basis of transition of outputs of the imaging part and the distance measurement part, and for changing selling devices to be made to display the registration screen following the movement of the customer.SELECTED DRAWING: Figure 6

Description

Technical Field

[0001] Embodiments of the present invention relate to a sales information processing system.

Background Art

[0002] Conventionally, a system having a robot that moves inside a store selling products to assist customers in shopping has been proposed (for example, Patent Document 1). The robot of the above system patrols inside the store and assists customers in shopping by receiving purchased products from customers and transporting them to the cash register.

[0003] As described above, the conventional system only assists customers in shopping inside the store, and for a business operator selling products, it is desired to construct a more useful system.

Summary of the Invention

Problems to be Solved by the Invention

[0004] The problem to be solved by the present invention is to provide a system that can improve the operability by customers when a plurality of devices for displaying and selling products are used in sets to correspond to the types and quantities of products.

Means for Solving the Problems

[0005] The sales information processing system according to the embodiment is a sales information processing system including a sales device that sells displayed products and an information processing device that manages a plurality of the sales devices, and includes a cooperation unit that operates a plurality of the sales devices in cooperation, a display unit provided in the sales device that displays information for customers, an imaging unit provided in the sales device that acquires image information for identifying a customer, a distance measurement unit provided in the sales device that measures the distance between the customer specified by the image information output from the imaging unit and the own device, and a display control unit that, based on the transition of the outputs of the imaging unit and the distance measurement unit, causes a registration screen showing information of products registered as transaction targets to be displayed on the display unit of the sales device that is the closest to the customer among the plurality of sales devices operating in cooperation, and changes the sales device that displays the registration screen as the customer moves.

Brief Description of the Drawings

[0006]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Figure 21

Figure 22

Figure 23

Embodiments for Carrying Out the Invention

[0007] Hereinafter, embodiments of the sales information processing system will be described in detail with reference to the drawings. Note that the present invention is not limited to the embodiments described below.

[0008] (First Embodiment) FIG. 1 is a diagram showing an operating state in which a plurality of mobile vending robots 10 according to the first embodiment are operated in cooperation. The mobile vending robot 10 is an example of a vending device that sells products displayed in a provided display section. In the present embodiment, the sales information processing system will be described by taking as an example an operation in which a plurality of (for example, three) mobile vending robots 10 are operated in cooperation.

[0009] First, the mobile vending robot 10 is a self-propelled vending device that unmannedly conveys and sells products. For example, the mobile vending robot 10 travels within a predetermined range such as a shopping mall and sells products at each position of the travel destination. The mobile vending robot 10 performs a circuit travel along a predetermined route and a call travel toward a call position designated by a customer (user).

[0010] Here, with reference to FIGS. 2 to 4, the external configuration of the mobile vending robot 10 will be described. FIGS. 2 to 4 are perspective views showing an example of the external configuration of the mobile vending robot 10.

[0011] In FIGS. 2 to 4, the configuration of the mobile vending robot 10 will be described using three axial directions of an X axis, a Y axis, and a Z axis that are orthogonal to each other. The X axis penetrates the mobile vending robot 10 from front to back and is an axis that extends from the rear to the front of the mobile vending robot 10. The Y axis penetrates the mobile vending robot 10 from left to right and is an axis that extends from the left side to the right side of the mobile vending robot 10. The Z axis penetrates the mobile vending robot 10 from top to bottom and is an axis that extends from the bottom to the top of the mobile vending robot 10.

[0012] The mobile vending robot 10 includes a main body portion 11, a moving portion 12, and a user interface portion 13. The main body portion 11 is formed of a box-shaped housing with the front and rear sides open. A storage portion 111 is provided inside the main body portion 11.

[0013] The storage unit 111 is a space for storing the merchandise C to be sold, such as food products. In the storage unit 111, shelves 112 on which the merchandise C can be displayed are arranged in multiple vertical tiers extending in the front-rear direction of the mobile vending robot 10. The shelf 112 is an example of a display unit for displaying merchandise. The merchandise C is placed on the shelf 112 by a store employee or the like who manages the mobile vending robot 10. The merchandise C stored in the storage unit 111 is not limited to food products, and may be merchandise of other genres such as pharmaceuticals and leisure goods. Further, the storage unit 111 may store merchandise C of a plurality of genres.

[0014] Note that the shelf 112 may be divided into a plurality of areas, for example, for classifying and placing merchandise C of the same type. In this case, the shelf 112 may be divided into a plurality of areas by using, for example, a tray or the like.

[0015] Further, in the storage unit 111, the merchandise is displayed assuming that the customer views it from the left side (negative Y-axis direction side) of the mobile vending robot 10. Therefore, hereinafter, the left side of the mobile vending robot 10 is also referred to as the front side of the storage unit 111. Also, the right side (positive Y-axis direction side) of the mobile vending robot 10 is also referred to as the back side of the storage unit 111.

[0016] Further, on the front side of the shelf 112, a shelf label 113 for displaying the name and price of the merchandise C is provided. The shelf label 113 displays the information of the merchandise on display (merchandise information: for example, price, merchandise name, etc.) in a rewritable manner. The shelf label 113 may be an electronic shelf label or a bar type (landscape) signage display. The electronic shelf label is a display device constituted by, for example, electronic paper or the like. The signage display is a display device constituted by, for example, a liquid crystal panel or the like.

[0017] In addition, each of the shelves 112 is provided with a weight detection unit 159 (see FIG. 8, described later) capable of detecting the weight of the product C placed on the shelf 112. The weight detection unit 159 is for detecting that the product placed on the shelf 112 has been taken out from the shelf 112 or the product has been returned to the shelf 112 by detecting a change in weight. Details of the weight detection unit 159 will be described later.

[0018] In this embodiment, the shelf label 113 is provided on the front side of the shelf 112, but it may be configured to also provide the shelf label 113 on the back side of the shelf 112. Also, in this embodiment, both the front side and the back side of the main body 11 (accommodation unit 111) are open, but it may be configured to open only one side (for example, the front side).

[0019] Further, a door portion formed of a light-transmitting member such as glass may be detachably attached to either one or both of the front side and the back side of the main body 11 (accommodation unit 111) so that the accommodation unit 111 can be accessed through the door portion. For example, a door portion may be attached to the front side of the main body 11, and the back side of the main body 11 may be covered with a wall surface. Also, in this case, the wall surface on the back side may be formed using a light-transmitting member such as glass. This can prevent the products in the accommodation unit 111 from falling out of the accommodation unit 111 when the mobile vending robot 10 is moving or the like.

[0020] Furthermore, it may be configured to be lockable by providing an electronic lock or the like on the door portion. This can also prevent the products in the accommodation unit 111 from being illegally taken out when the mobile vending robot 10 is moving or the like.

[0021] A light emitting unit 114 is provided on the front side of the main body 11. The light emitting unit 114 has a light emitting element such as an LED (Light Emitting Diode), and notifies the operating state of the mobile vending robot 10 by emitting light according to the control of a control unit 154 described later. For example, the light emitting unit 114 emits light when the mobile vending robot 10 is moving, thereby notifying that the mobile vending robot 10 is in motion.

[0022] Note that the emission color of the light emitting unit 114 is not limited to a single color. For example, the light emitting unit 114 may vary the emission color or change the emission pattern according to the operating state of the mobile vending robot 10. Also, the light emitting unit 114 may be provided not only on the front side of the main body unit 11 but also on the rear side.

[0023] The moving unit 12 is provided below the main body unit 11 and supports the main body unit 11 so as to be movable. Specifically, the moving unit 12 includes a non-driven wheel 121, a driving wheel 122, and a driving unit 123 that drives the driving wheel 122.

[0024] The non-driven wheel 121 is a small wheel. The non-driven wheel 121 changes the traveling direction of the mobile vending robot 10 (moving unit 12) by freely changing its direction according to the direction of the force generated by the rotation of the driving wheel 122.

[0025] The driving wheel 122 is rotationally driven by the driving unit 123 to move the mobile vending robot 10 (moving unit 12) forward, backward, and turn.

[0026] The driving unit 123 has a driving source such as a motor and a power source. The driving unit 123 rotates the driving wheel 122 according to the control of a control unit 154 described later, thereby moving the mobile vending robot 10 (moving unit 12) to the direction and position indicated by the control unit 154.

[0027] The user interface unit 13 is provided on the upper part of the main body unit 11. The user interface unit 13 includes a first display unit 131, a second display unit 132, a third display unit 133, an imaging unit 134, a distance measuring unit 135, a disinfection device 136, and the like.

[0028] The first to third display units 131 to 133 are display devices constituted by, for example, a liquid crystal panel or the like. The first display unit 131 is installed on the front side of the housing unit 111. The second display unit 132 is installed on the back side of the housing unit 111. The third display unit 133 is installed on the rear side of the mobile vending robot 10. The first display unit 131, the second display unit 132, and the third display unit 133 display various types of information related to the sale of the product C and the like according to the control of the control unit 154 described later.

[0029] The imaging unit 134 is provided on each of the front, rear, left, and right surfaces of the user interface unit 13, and acquires image information for identifying customers. The captured image by the imaging unit 134 is transmitted to the server device 30 described later and used for customer recognition and tracking by the server device 30. Note that, as customer recognition, image recognition that enables identification of a person and face authentication for settlement are performed. Further, the imaging unit 134 is, for example, a digital camera having an imaging element such as a CCD (Charge Coupled Device) or a CMOS (Complementary MOS).

[0030] In practice, the imaging unit 134 does not have to be individually provided on the four front, rear, left, and right surfaces of the user interface unit 13, as long as it can image 360° around.

[0031] The distance measuring unit 135 is a device for detecting an object existing around the mobile vending robot 10 or detecting the distance to the object. The sensing result of the distance measuring unit 135 is output to the control unit 154 described later and used for collision avoidance during movement and detection of customers and the like. The distance measuring unit 135 can be realized by, for example, a TOF (Time Of Fright) sensor. Alternatively, the distance measuring unit 135 can be realized by a device that detects an object and measures the distance by ultrasonic waves, or a device such as LiDAR (Light Detection and ranging) that detects an object by laser light.

[0032] In addition, the distance measurement unit 135 is an example of a distance measurement unit provided in the mobile vending robot 10. It is provided on each of the front, rear, left, and right sides of the user interface unit 13, and measures the distance between the customer identified by the image information output by the imaging unit 134 and the own device.

[0033] In practice, the distance measurement unit 135 does not necessarily need to be individually provided on the four front, rear, left, and right sides of the user interface unit 13, as long as it can measure the distance to surrounding objects.

[0034] The disinfection device 136 is a device for a user who uses the mobile vending robot 10 to perform disinfection. In the present embodiment, disinfection means killing (or removing) pathogenic bacteria, viruses, and other microorganisms present in the object to a harmless level. Also, disinfection is assumed to be interchangeable with sterilization, bactericidal action, or sterilization.

[0035] The device configuration of the disinfection device 136 is not particularly limited. For example, the disinfection device 136 may be a sprayer that sprays a disinfectant such as alcohol. Also, the disinfection device 136 may be an ultraviolet disinfection device that irradiates ultraviolet rays. The disinfection device 136 performs a disinfection operation such as spraying a disinfectant or irradiating ultraviolet rays in response to a user operation.

[0036] Also, the operating status of the disinfection device 136 may be configured to be electrically output to the control unit 154 described later. In this case, for example, the user interface unit 13 or the disinfection device 136 includes a sensor device (hereinafter also referred to as a disinfection operation detection unit) that detects the disinfection operation of the disinfection device 136. Then, when the disinfection operation detection unit detects that a disinfection operation has been performed by the disinfection device 136, it outputs a detection signal to the control unit 154 described later.

[0037] Note that the configuration of the user interface unit 13 is not limited to the illustrated example. For example, the number and installation position of the display devices included in the user interface unit 13 are not limited to the illustrated example. Further, the user interface unit 13 may include a reader device that reads information held in a code symbol such as a two-dimensional code, a reader device that reads information from a card medium such as an IC card or a credit card, and the like.

[0038] Now, in the present embodiment, as shown in FIG. 1, a plurality (for example, three) of mobile vending robots 10 are arranged in a row and operate in cooperation. In such an operation, the sales information processing system of the present embodiment causes the registration screen 40 to be displayed on the first display unit 131 or the second display unit 132 of the'mobile vending robot 10 closest to customer U'. FIG. 5 is a diagram showing an example of the display content of the registration screen 40. The registration screen 40 displays a list of information on the products registered as transaction targets.

[0039] More specifically, on the registration screen 40, for example, as shown in FIG. 5, information for identifying the product C taken out by the customer from the storage unit 111, that is, the product icon 41, the product name 42, the registered quantity 43, and the subtotal 44 are arranged and displayed. The product icon 41 is an image showing the product C. The product name 42 is the name of the product C. The registered quantity 43 indicates the number of the product C. The subtotal 44 indicates the subtotal amount of each product C.

[0040] Next, FIG. 6 is a diagram for explaining the screen transition when the customer moves. When the customer U moves from the position shown in FIG. 1 to the position shown in FIG. 6, the'mobile vending robot 10 closest to customer U' changes. Therefore, as shown in FIG. 6, the sales information processing system of the present embodiment changes the mobile vending robot 10 that displays the registration screen 40 in accordance with the movement of the customer U. In other words, when the mobile vending robot 10 is closer to the customer U than the other mobile vending robots 10 in cooperation, the registration screen 40 that displays the transaction targets of the customer U is displayed using the display unit (the first display unit 131 or the second display unit 132) facing the customer U.

[0041] FIG. 7 is a diagram showing an example of the configuration of the sales information processing system 1. As shown in this figure, the sales information processing system 1 includes a mobile sales robot 10, a user terminal 20, and a server device 30. The mobile sales robot 10, the user terminal 20, and the server device 30 are connected to a network N such as a LAN (Local Area Network). Note that the number of mobile sales robots 10 is not limited to the example in this figure.

[0042] The user terminal 20 is a device used by a customer and is an example of a terminal device possessed by the customer. The user terminal 20 is realized by a portable terminal device such as a smartphone or a tablet terminal. The user terminal 20 receives a call request for requesting a call of the mobile sales robot 10 from the customer and transmits the received call request to the server device 30. Note that the number of user terminals 20 is not limited to the example in FIG. 1.

[0043] The server device 30 is an example of an information processing device that manages a plurality of sales devices (mobile sales robots 10). The server device 30 manages the sales information processing system 1. The server device 30 is realized by an information processing device such as a PC (Personal Computer), for example. The server device 30 manages the products sold by each of the mobile sales robots 10. In addition, the server device 30 manages the mobile sales robot 10 and causes the mobile sales robot 10 to travel toward the call position specified by the call request received from the user terminal 20. For example, when the server device 30 manages the current positions of the mobile sales robot 10 and the user terminal 20 and receives a call request for the mobile sales robot 10 from the user terminal 20, the server device 30 causes the mobile sales robot 10 specified by the call request to travel toward the position of the user terminal 20.

[0044] Hereinafter, the hardware configuration and functional configuration of each device included in the sales information processing system 1 will be described.

[0045] First, the hardware configuration of the mobile vending robot 10 will be described. FIG. 8 is a diagram showing an example of the hardware configuration of the mobile vending robot 10. As shown in this figure, the mobile vending robot 10 includes a CPU (Central Processing Unit) 151, a ROM (Read Only Memory) 152, a RAM (Random Access Memory) 153, and a storage unit 162.

[0046] The CPU 151 is an example of a processor and comprehensively controls each part of the mobile vending robot 10. The ROM 152 stores various programs. The RAM 153 is a workspace for expanding programs and various data.

[0047] The storage unit 162 has a storage medium such as an HDD (Hard Disk Drive) or a flash memory, and maintains the stored content even when the power is turned off. The storage unit 162 stores programs that can be executed by the CPU 151 and various setting information.

[0048] The CPU 151, the ROM 152, and the RAM 153 are connected via a bus or the like to form a control unit 154 of a computer configuration. In the control unit 154, the CPU 151 operates according to the programs stored in the ROM 152 and the storage unit 162 and expanded in the RAM 153, thereby executing various processes.

[0049] In addition, the mobile vending robot 10 includes the above-described light emitting unit 114, drive unit 123, and imaging unit 134. The mobile vending robot 10 also includes a display unit 155, an operation unit 156, a sound collection unit 157, a sensor unit 158, a weight detection unit 159, a positioning unit 160, and a communication unit 161, etc.

[0050] The display unit 155 is a display device such as the above-described first display unit 131, second display unit 132, third display unit 133, and shelf label 113. Under the control of the CPU 151, the display unit 155 displays various information. Here, the first display unit 131, second display unit 132, and third display unit 133 are examples of display units that display information for customers and display a registration screen showing information on products registered as transaction targets.

[0051] The operation unit 156 outputs the operation content received from the user to the CPU 151. The operation unit 156 is a touch panel provided over the display screen of the display unit 155 excluding the shelf label 113.

[0052] The sound collection unit 157 collects the sound around the mobile vending robot 10 and outputs the sound signal of the collected sound to the CPU 151. The sound collection unit 157 is realized by a sound collection device such as a microphone, for example. The sound collection unit 157 collects, for example, the sound for stopping the travel from a user who wishes to purchase a product during the patrol travel of the mobile vending robot 10.

[0053] The sensor unit 158 is a sensor device such as the above-described distance measurement unit 135 and disinfection operation detection unit. The sensor unit 158 outputs the detection result obtained by sensing to the CPU 151.

[0054] The weight detection unit 159 is a weight sensor that detects the weight of the product stored in the storage unit 111. Specifically, the weight detection unit 159 is provided on each of the shelves 112 and detects the weight and weight change of the product placed on the shelf 112.

[0055] Here, it is assumed that each of the shelves 112 and the weight detection unit 159 provided on the shelf 112 are associated in advance, and when a weight change is detected by the weight detection unit 159, it is possible to identify the shelf 112 where the change occurred.

[0056] In addition, when the shelf 112 is divided into a plurality of regions, a weight detection unit 159 may be provided for each of the divided regions. In this case, it is assumed that each of the divided regions is associated with the weight detection unit 159 provided in that region.

[0057] The positioning unit 160 measures the position where the mobile vending robot 10 is located. The positioning unit 160 can be realized by a positioning device using a positioning technology such as GPS (Global Positioning System).

[0058] Alternatively, the positioning unit 160 may be realized by a position measurement device using a positioning technology such as beacon positioning or RFID (Radio Frequency Identifier) positioning. In this case, by providing a terminal corresponding to a positioning technology such as beacon positioning or RFID positioning at each position within the range where the mobile vending robot 10 can move, the position where the mobile vending robot 10 is located can be measured (identified) by the positioning system formed by the terminal and the positioning unit 160.

[0059] The communication unit 161 is a wireless communication interface connectable to the network N. The communication unit 161 communicates with an external device such as the server device 30 via the network N.

[0060] In addition, the storage unit 162 stores map information 1621, a product master 1622, and a stored product table 1623. Here, the map information 1621 is information indicating a map of the range where the mobile vending robot 10 moves.

[0061] The product master 1622 is a data table storing information regarding products to be sold. FIG. 9 is a diagram showing an example of the data configuration of the product master 1622. As shown in this figure, the product master 1622 stores product information corresponding to the product code in association with the product code for identifying the product. The product information includes a product name, type, price, weight, and image data, etc.

[0062] Note that the data configuration of the product master 1622 is not limited to the example in FIG. 9. For example, the product master 1622 may store image data representing the characteristics of the product in the product information.

[0063] Further, the storage unit 162 may be configured not to store the product master 1622. In this case, the mobile vending robot 10 can handle the product master 3162 (described later) stored in the server device 30 in the same manner as holding the product master 1622 by referring to the product master 3162.

[0064] The stored product table 1623 is a data table for storing information about the products stored in the storage unit 111. FIG. 10 is a diagram showing an example of the data configuration of the stored product table 1623. As shown in this figure, the stored product table 1623 associates each shelf 112 provided in the storage unit 111 with a shelf ID that can be identified, and stores the product code of the product placed on the shelf 112 with the shelf ID and the quantity of the placed product.

[0065] Note that the data configuration of the stored product table 1623 is not limited to the example in FIG. 10. For example, when the shelf 112 is divided into a plurality of regions, the stored product table 1623 may assign an identifier to each divided region and store the product code and quantity of the product placed in the region in association with each other.

[0066] Next, the hardware configuration of the user terminal 20 will be described. FIG. 11 is a diagram showing an example of the hardware configuration of the user terminal 20. As shown in this figure, the user terminal 20 includes a CPU 211, a ROM 212, and a RAM 213.

[0067] The CPU 211 is an example of a processor and comprehensively controls each part of the user terminal 20. The ROM 212 stores various programs. The RAM 213 is a workspace for expanding programs and various data.

[0068] The CPU 211, ROM 212, and RAM 213 are connected via a bus or the like and constitute a control unit 214 of a computer configuration. In the control unit 214, the CPU 211 operates according to a control program stored in the storage unit 220 and expanded in the RAM 213 to execute various processes.

[0069] The user terminal 20 further includes a display unit 215, an operation unit 216, an imaging unit 217, a positioning unit 218, a communication unit 219, a storage unit 220, and the like.

[0070] The display unit 215 is a display device and is composed of, for example, an LCD or the like. The display unit 215 displays various information under the control of the CPU 211. The operation unit 216 is an input device such as a keyboard or a pointing device. The operation unit 216 outputs the operation content received from the user to the CPU 211. Note that the operation unit 216 is, for example, a touch panel provided on the display screen of the display unit 215.

[0071] The imaging unit 217 is a digital camera having an imaging element such as a CCD or a CMOS. The imaging unit 217 captures an image of the user using the user terminal 20 to obtain a face image or the like of the user.

[0072] The positioning unit 218 measures the position where the user terminal 20 is located. The positioning unit 218 can be realized by a positioning device using a positioning technology such as GPS. Further, the positioning unit 218 may be realized by a position measurement device using a positioning technology such as beacon positioning or RFID positioning, similar to the positioning unit 160 described above.

[0073] The communication unit 219 is a wireless communication interface connectable to the network N. The communication unit 219 communicates with an external device such as the server device 30 via the network N.

[0074] The storage unit 220 has a storage medium such as an HDD or a flash memory, and maintains the stored content even when the power is turned off. The storage unit 220 stores programs that can be executed by the CPU 211 (including application programs related to the processing of the sales information processing system 1) and various setting information.

[0075] In addition, the storage unit 220 stores map information 2201 and the like. Here, the map information 2201 is information showing a map of the range where the mobile vending robot 10 moves, similar to the map information 1621.

[0076] Next, the hardware configuration of the server device 30 will be described. FIG. 12 is a diagram showing an example of the hardware configuration of the server device 30. As shown in this figure, the server device 30 includes a CPU 311, a ROM 312, and a RAM 313.

[0077] The CPU 311 is an example of a processor and comprehensively controls each part of the server device 30. The ROM 312 stores various programs. The RAM 313 is a workspace for expanding programs and various data.

[0078] The CPU 311, ROM 312, and RAM 313 are connected via a bus or the like and constitute a control unit 314 of a computer configuration. In the control unit 314, various processes are executed by the CPU 311 operating according to a control program stored in the storage unit 316 and expanded in the RAM 313.

[0079] In addition, the server device 30 includes a communication unit 315 and a storage unit 316 and the like. The communication unit 315 is a wired or wireless communication interface that can be connected to the network N. The communication unit 315 communicates with external devices such as the mobile vending robot 10 and the user terminal 20 via the network N.

[0080] The storage unit 316 has a storage medium such as an HDD or a flash memory, and maintains the stored content even when the power is turned off. The storage unit 316 stores programs that can be executed by the CPU 311 and various setting information.

[0081] Further, the storage unit 316 stores map information 3161 and product master 3162. The map information 3161 is information indicating a map of the range in which the mobile vending robot 10 moves. The product master 3162 is a data table storing information regarding products to be sold. Note that the data configuration of the product master 3162 is the same as that of the product master 1622 described above.

[0082] Also, the storage unit 316 stores a robot management table 3163, a product management table 3164, a user management table 3165, a call management table 3166, a transaction management table 3167, and the like.

[0083] The robot management table 3163 is a data table for managing the position and state of the mobile vending robot 10. FIG. 13 is a diagram showing an example of the data configuration of the robot management table 3163. As shown in this figure, the robot management table 3163 stores position information indicating the current position of the mobile vending robot 10 corresponding to the robot ID and state information indicating the state of the mobile vending robot 10 in association with the robot ID. The robot ID identifies the mobile vending robot 10 and is an example of mobile vending device identification information.

[0084] Here, the position information may be indicated by coordinate values such as longitude and latitude. Further, the position information may be indicated by a block number or the like obtained by dividing the range in which the mobile vending robot 10 can move into a plurality of blocks.

[0085] The states of the mobile vending robot 10 include, for example, the "moving" state in which the mobile vending robot 10 moves to the calling position designated by the user, the "transaction waiting" state in which the mobile vending robot 10 arrives at the calling position and waits for the operation to start the transaction, the "transaction in progress" state in which the transaction is started by the user operation, and the like. Further, the state of the mobile vending robot 10 includes the "call waiting" state in which it is possible to respond to a call from the user, such as during the patrol of the mobile vending robot 10, and the "sales impossible" state in which sales by the mobile vending robot 10 cannot be performed due to replenishment of goods or the like, and the like.

[0086] Note that the information stored in the robot management table 3163 is updated according to the movement of the mobile vending robot 10 and the state of the mobile vending robot 10 under the control of the information management unit 3142 described later.

[0087] The product management table 3164 is a data table for managing the products sold by each of the mobile vending robots 10. FIG. 14 is a diagram showing an example of the data configuration of the product management table 3164. As shown in this figure, the product management table 3164 stores, in association with the robot ID, the product code of the product sold by the mobile vending robot 10 with the robot ID and the inventory quantity of the product.

[0088] The information stored in the product management table 3164 is updated according to the inventory quantity of the products held by the mobile vending robot 10 under the control of the information management unit 3142 described later.

[0089] The user management table 3165 is a data table for managing the users who use the sales information processing system 1. FIG. 15 is a diagram showing an example of the data configuration of the user management table 3165. As shown in this figure, the user management table 3165 stores user information related to the user with the user ID in association with the user ID that can identify each user.

[0090] User information includes feature information indicating the characteristics of the user (customer)'s face and payment information used for electronic payment. The feature information is, for example, a face image obtained by imaging the user's face, a feature amount indicating the characteristics of the face, etc., and is used as comparison data in the face authentication process described later. The payment information is information such as an account for using an electronic payment service that the user has previously contracted. Here, the electronic payment service includes code payment, electronic money payment, credit payment, etc. Also, when the electronic payment service is credit payment, the above payment information may be the number of the credit card owned by the user.

[0091] User information is obtained from the user by, for example, a method such as known membership registration and registered in the user management table 3165. The user ID may be automatically assigned or may use unique information input by the user. Note that the user information is not limited to the above example and may include other information. For example, the user information may include personal information such as the user's name, age, address, etc. Also, the user information may include the terminal ID of the terminal (user terminal 20) used by the user and the communication address of the terminal.

[0092] The call management table 3166 is a data table for managing the call of the mobile sales robot 10 by the user terminal 20. FIG. 16 is a diagram showing an example of the data configuration of the call management table 3166. As shown in this figure, the call management table 3166 associates and stores the terminal ID of the user terminal 20 that made the call, the date and time when the call was received (call date and time), position information indicating the call position (hereinafter, also simply referred to as "call position"), authentication information used for authenticating the calling user, the robot ID of the mobile sales robot 10 corresponding to the call, and the date and time when the mobile sales robot 10 arrived at the call position (arrival date and time), etc.

[0093] The authentication information can be, for example, a PIN code composed of a sequence of numbers with a predetermined number of digits, a face image of the user, a user ID, etc. In the former case, the PIN code may be issued by the control unit 314 or may be specified by the user. Also, in the latter case, a face image or user ID transmitted from the user terminal 20 of the user who made the call, or a user ID specified by the control unit 314 from the user management table 3165 based on the transmitted face image, etc. can be used. In the present embodiment, a form in which the control unit 314 issues a PIN code at the time of receiving a call will be described.

[0094] The transaction management table 3167 is a data table for managing transactions via the mobile vending robot 10. FIG. 17 is a diagram showing an example of the data configuration of the transaction management table 3167. As shown in this figure, the transaction management table 3167 stores, in association with a transaction ID that identifies a transaction, the robot ID of the mobile vending robot 10 where the transaction was conducted, the user ID of the user who conducted the transaction, the product code of the product purchased by the user, and a settlement flag for determining whether the settlement has been completed, etc.

[0095] Next, the functional configurations of the respective devices constituting the sales information processing system 1 will be described. FIG. 18 is a block diagram showing the functional configurations of the respective devices constituting the sales information processing system 1. First, the user terminal 20 will be described.

[0096] The control unit 214 of the user terminal 20 functions as a transmission / reception unit 2141, an input reception unit 2142, a self-position specifying unit 2143, and a display control unit 2144 by operating according to control programs stored in the ROM 212 and the storage unit 220 by the CPU 211. Note that each of these functions may be configured by hardware such as a dedicated circuit.

[0097] The transmission / reception unit 2141 transmits and receives various information to and from external devices such as the server device 30 via the communication unit 219. Note that the function and operation in which the transmission / reception unit 2141 "receives" information from the server device 30 etc. can also be referred to as "acquisition" of information.

[0098] For example, the transceiver unit 2141 receives from the server device 30 each piece of information regarding the robot ID, current position, and state of the mobile vending robot 10. Also, the transceiver unit 2141 transmits a call request to the server device 30.

[0099] The call request is for requesting the call of the mobile vending robot 10 by specifying the mobile vending robot 10. The call request includes information such as the terminal ID of the user terminal 20 which is the requester, the robot ID of the mobile vending robot 10 to be specified, and the call position. Also, in the case of a configuration where the user designates authentication information, the call request further includes the designated authentication information. Note that in the present embodiment, the call position is the position where the user terminal 20 exists, that is, the position measured by the positioning unit 218, but the user may be able to specify the call position desired by the user on the user terminal 20.

[0100] Also, the transceiver unit 2141 receives the pin code issued by the server device 30 in association with the call request. The pin code is authentication information for authenticating (verifying) the user who called the mobile vending robot 10 and the user who intends to start shopping with the mobile vending robot.

[0101] Furthermore, the transceiver unit 2141 receives an arrival notice and a payment completion notice from the server device 30. The arrival notice indicates that the mobile vending robot 10 has arrived at the call position specified in the call request. The payment completion notice indicates that the payment related to the purchase of the goods stored in the mobile vending robot 10 has been completed.

[0102] The input reception unit 2142 receives input information based on the operation of the operation unit 216. For example, the input reception unit 2142 receives a call request from the operation unit 216.

[0103] The self-position identification unit 2143 identifies the position of the user terminal 20 within the area represented by the map information 2201 based on the output of the positioning unit 218.

[0104] The display control unit 2144 causes the display unit 215 to display various information. Specifically, the display control unit 2144 causes the display unit 215 to display various screens (GUI: Graphical User Interface) for assisting in the purchase of products sold by the mobile vending robot 10. For example, the display control unit 2144 causes the display unit 215 to display a display screen for assisting in calling the mobile vending robot 10.

[0105] Here, with reference to FIG. 19, an example of calling a plurality of mobile vending robots 10 using the selection screen 2151 displayed by the display control unit 2144 will be described. FIG. 19 is a diagram schematically showing an example of the selection screen 2151 displayed on the display unit 215 of the user terminal 20 and the call result.

[0106] The display control unit 2144 causes an icon 2152 indicating the position of the mobile vending robot 10 to be selectably displayed on the map shown by the selection screen 2151 in correspondence with the position where each mobile vending robot 10 exists.

[0107] The display control unit 2144 causes the selection screen 2151 to display a map of the range where the mobile vending robot 10 can move based on the map information 2201. Here, the display control unit 2144 may display a map around the position where its own user terminal 20 exists (indicated by the icon 2153) based on the position information specified by the self-position specifying unit 2143, or may display a map around the position where the mobile vending robot 10 exists based on the position information of the mobile vending robot 10 provided from the server device 30. Further, the display control unit 2144 changes the range of the map displayed on the selection screen 2151 according to operations on the map (for example, scroll operation, zoom-in / zoom-out operation, etc.).

[0108] In addition, the display control unit 2144 causes an icon 2152 representing the mobile vending robot 10 to be displayed overlaid on the map of the selection screen 2151. Specifically, the display control unit 2144 causes the icon 2152 to be displayed at the position where the mobile vending robot 10 exists on the map. Robot identification information such as a robot ID is also displayed on the icon 2152.

[0109] The user can select the mobile vending robot 10 via the operation unit 216 by touching any of the icons 2152 displayed on the display unit 215. In the sales information processing system 1 of the present embodiment, a plurality of icons 2152 can be selected.

[0110] Also, in the sales information processing system 1 of the present embodiment, the maximum number of selectable units is set. The maximum number of units is, for example, three. This number limit can be implemented by guiding the user through the user interface (selection screen 2151), functionally restricting it, or limiting the maximum number of units accepted on the server device 30 side.

[0111] Also, when calling a plurality of mobile vending robots 10, the calling location is limited according to its size and the like. For example, a plurality of mobile vending robots 10 can be called at a wide intersection, but a plurality of calls cannot be accepted in a narrow passage or the like.

[0112] When the input reception unit 2142 receives the designation of the mobile vending robot 10 based on the output of the operation unit 216, the transmission / reception unit 2141 transmits a call request including the terminal ID of its own user terminal 20 and the robot ID of the designated mobile vending robot 10 to the server device 30.

[0113] In the present embodiment, the call request is transmitted from the user terminal 20 carried (owned) by the customer to the server device 30, but it is not limited to this. The call request may be transmitted from a terminal device installed in the facility where the mobile vending robot 10 travels to the server device 30. In this case, it is desirable that the user can set the call position at an arbitrary location on the terminal device.

[0114] Returning to FIG. 18, the functional configuration of the server device 30 will be described. The control unit 314 of the server device 30 functions as a transmission / reception unit 3141, an information management unit 3142, a verification unit 3143, a settlement processing unit 3144, a robot management unit 3145, a display control unit 3146, and a settlement control unit 3147 by operating according to the control programs stored in the ROM 312 and the storage unit 316 by the CPU 311. Note that each of these functions may be configured by hardware such as a dedicated circuit.

[0115] The transmission / reception unit 3141 transmits and receives various types of information to and from external devices such as the user terminal 20 and each mobile vending robot 10 via the communication unit 315. For example, the transmission / reception unit 3141 receives position information indicating the position of each mobile vending robot 10 and status information indicating the status from each of the mobile vending robots 10. Further, the transmission / reception unit 3141 transmits position information indicating the position of each mobile vending robot 10 and status information indicating the status to the user terminal 20.

[0116] In addition, the transmission / reception unit 3141 receives a call request from the user terminal 20 and transmits a movement instruction to the mobile vending robot 10 specified by the robot ID included in the call request. The movement instruction instructs the mobile vending robot 10 to move to the call position included in the call request from the user terminal 20. The movement instruction includes information such as the terminal ID of the user terminal 20 that transmitted the call request and the call position.

[0117] In addition, when the transmission / reception unit 3141 receives an arrival notice from the mobile vending robot 10, it transmits the arrival notice to the user terminal 20 that is the source of the call request for the mobile vending robot 10. The arrival notice indicates that the mobile vending robot 10 has arrived at the designated call position. The arrival notice includes information such as the robot ID of the mobile vending robot that has arrived at the call position.

[0118] In addition, the transceiver unit 3141 transmits a PIN code (authentication information) to the user terminal 20 in response to a call request, and receives the PIN code input by the user to the mobile vending robot 10 from the mobile vending robot 10. When the PIN code transmitted to the user terminal 20 and the PIN code input to the mobile vending robot 10 are verified by the verification unit 3143, the transceiver unit 3141 transmits an authentication notice to the mobile vending robot 10. The authentication notice indicates that the user who called the mobile vending robot 10 and the user who intends to start shopping with the mobile vending robot match.

[0119] Furthermore, the transceiver unit 3141 receives a settlement request from the mobile vending robot 10, and when settlement processing is performed in response to the settlement request, transmits a settlement completion notice to the mobile vending robot 10 and the user terminal 20. The settlement request requests settlement processing for the price of the goods purchased by the user with the mobile vending robot 10. The settlement request includes information necessary for the settlement processing executed by the server device 30. The information necessary for the settlement processing is the face image data of the user in this embodiment. Instead of the face image data, a user ID or the like may be used. The settlement completion notice indicates that the settlement has been completed in response to the settlement request. The settlement completion notice includes information such as a transaction ID for specifying the settled transaction.

[0120] Based on the information received by the transceiver unit 3141, the information management unit 3142 stores information in the storage unit 316 or updates various information stored in the storage unit 316. In addition, the information management unit 3142 appropriately reads out various information transmitted by the transceiver unit 3141 from the storage unit 316.

[0121] For example, the information management unit 3142 updates the robot management table 3163 based on the position information and status information received by the transceiver unit 3141 from the mobile vending robot 10.

[0122] When the transceiver unit 3141 receives a call request or an arrival notice, the information management unit 3142 appropriately stores information in the call management table 3166. Also, when the transceiver unit 3141 receives a settlement request, the information management unit 3142 stores various information in the transaction management table 3167 and reads out settlement information from the user management table 3165. Specifically, the information management unit 3142 reads out settlement information from the user management table 3165 based on the face image data included in the settlement request. Further, when the settlement is completed by the settlement processing unit 3144, the information management unit 3142 updates the settlement flag in the transaction management table 3167.

[0123] Also, the information management unit 3142 manages the order of movement of the mobile sales robot 10 to the call position. Specifically, for call requests for which the arrival date and time are not registered in the call management table 3166, the information management unit 3142 moves the mobile sales robot 10 to the call position specified by the call request in order from the call request with the earliest call time.

[0124] The verification unit 3143 verifies whether the user who called the mobile sales robot 10 matches the user who intends to start shopping with the mobile sales robot 10. Specifically, when the transceiver unit 3141 receives a call request from the user terminal 20, the verification unit 3143 issues a PIN code associated with the call request. Then, the verification unit 3143 verifies whether the PIN code received from the mobile sales robot 10 by the transceiver unit 3141 matches the issued PIN code.

[0125] Note that the verification unit 3143 may perform verification between the user who called the mobile sales robot 10 and the user who intends to start shopping with the mobile sales robot 10 by face authentication. In this case, the transceiver unit 3141 receives face image data from the mobile sales robot. Then, the verification unit 3143 refers to the user management table 3165 and performs verification based on the feature amount of the received face image data and the feature amount of the face of the calling user.

[0126] In the sales information processing system 1, it is not essential to match the user who called the mobile sales robot 10 with the user who intends to start shopping using the mobile sales robot 10. In other words, the server device 30 does not necessarily have to have the function of the collation unit 3143.

[0127] The settlement processing unit 3144 executes settlement processing related to the settlement request received by the transmission / reception unit 3141 from the mobile sales robot 10. In the present embodiment, the settlement processing unit 3144 executes electronic settlement processing by face authentication. Specifically, the settlement processing unit 3144 performs settlement with the settlement business operator using the settlement information read by the information management unit 3142 based on the face image data. The settlement processing unit 3144 executes settlement processing by communicating with the settlement server of the settlement business operator. Note that the settlement processing unit 3144 may perform electronic settlement by credit card settlement or two-dimensional code settlement. Also, when the mobile sales robot 10 reads information stored in a credit card, reads a two-dimensional code, or performs accounting processing with cash, the settlement processing unit 3144 completes the settlement processing upon receiving the result of the accounting processing.

[0128] The robot management unit 3145 sets the transmission destination and transmission content of the information to be transmitted by the transmission / reception unit 3141 based on a call request from the user terminal 20, position information and status information from each mobile sales robot 10, and the like. For example, when the transmission / reception unit 3141 receives a call request from the user terminal 20, the robot management unit 3145 sets the mobile sales robot 10 with the robot ID included in the call request as the transmission destination of the movement instruction, and sets the call position included in the call request as the transmission content. Also, for example, the robot management unit 3145 checks the status information of each mobile sales robot 10 stored in the robot management table 3163, and selects the mobile sales robot 10 corresponding to the call request from among the mobile sales robots 10 in the "awaiting call" state.

[0129] At the same time, the robot management unit 3145 sets the user terminal 20, which is the source of the call request, as the destination, calculates the arrival time until the selected mobile vending robot 10 arrives at the call position, and sets the arrival time as the transmission content. The arrival time is calculated based on the number of call requests (unhandled ones with no registered arrival date and time) to the corresponding mobile vending robot 10 registered in the call management table 3166, the preset purchase restriction time for one transaction, the position information and status information of the mobile vending robot 10 registered in the robot management table 3163, and so on.

[0130] Also, the robot management unit 3145 refers to the product management table 3164, sets the mobile vending robot 10 with a robot ID for which the inventory quantity of any or all of the mounted products has become 0 as the destination for sending the movement instruction, and sets the position for replenishing the product as the movement destination.

[0131] Here, the information management unit 3142 also functions as an example of a cooperation unit that operates and cooperates with a plurality of mobile vending robots 10 associated with each other. The information management unit 3142 as the cooperation unit associates and operates a plurality of mobile vending robots 10 in cooperation. Specifically, the information management unit 3142 recognizes the mobile vending robots 10 with robot IDs whose positions indicated by the position information recorded in the robot management table 3163 are substantially the same as being in cooperation. Also, the information management unit 3142 recognizes the mobile vending robots 10 with robot IDs whose terminal IDs, call dates and times, call positions, and authentication information recorded in the call management table 3166 are the same as being in cooperation.

[0132] Note that the movement instructions received by the plurality of mobile vending robots 10 recognized by the information management unit 3142 as being in cooperation include information related to each other. For example, the movement instructions transmitted by the transmission / reception unit 3141 include the robot ID for the mobile vending robot 10 that receives this to recognize other mobile vending robots 10 that are in cooperation with itself, and information indicating the number of cooperating units.

[0133] The display control unit 3146 controls the display content of the display unit 155 of a plurality of mobile vending robots 10 in cooperation based on the transitions of the outputs of the imaging unit 134 and the distance measuring unit 135 received by the transmission / reception unit 3141 from the mobile vending robot 10. More specifically, the display control unit 3146 causes the registration screen 40 to be displayed on the display unit 155 (the one facing the customer among the first display unit 131 and the second display unit 132) of the mobile vending robot 10 that is closest to the customer. Further, as the customer moves, the display control unit 3146 changes the mobile vending robot 10 on which the registration screen 40 is to be displayed.

[0134] More specifically, the control unit 314 of the server device 30 recognizes a person (customer) by image recognition based on the output of the imaging unit 134 received from each mobile vending robot 10, and tracks the person based on the output of the distance measuring unit 135. By performing the processing of this flow for each customer, the control unit 314 can track the customer, and thereby the control unit 314 can grasp the display unit 155 of the mobile vending robot 10 that is closest to the customer. As a result, the display control unit 3146 repeatedly determines and changes the mobile vending robot 10 on which the registration screen 40 facing the tracked customer is to be displayed and its display unit 155.

[0135] The settlement control unit 3147 accepts an operation related to the accounting process by the mobile vending robot 10 that is closest to the customer among a plurality of mobile vending robots 10 in cooperation based on the transitions of the outputs of the imaging unit 134 and the distance measuring unit 135.

[0136] In addition, the settlement control unit 3147 accepts an operation of a customer regarding payment for all products sold by a plurality of mobile vending robots 10 in cooperation via the mobile vending robot 10 that is closest to the customer at the start of the operation.

[0137] The mobile vending robot 10 may have some or all of the functions of the above-described transmission / reception unit 3141, information management unit 3142, verification unit 3143, settlement processing unit 3144, robot management unit 3145, display control unit 3146, and settlement control unit 3147. In this case, the user terminal 20 transmits and receives various information to and from the mobile vending robot 10.

[0138] Next, the functional configuration of the mobile vending robot 10 will be described. The control unit 154 of the mobile vending robot 10 functions as a transmission / reception unit 1541, an input reception unit 1542, a self-position identification unit 1543, an information processing unit 1544, a drive control unit 1545, and a display control unit 1546 by operating according to the control programs stored in the ROM 152 and the storage unit 162 by the CPU 151. Note that each of these functions may be configured by hardware such as a dedicated circuit.

[0139] The transmission / reception unit 1541 transmits and receives various information to and from an external device such as the server device 30 via the communication unit 161. For example, the transmission / reception unit 1541 transmits the position information indicating the position of its own device and the status information indicating the status to the server device 30 at any time.

[0140] In addition, the transmission / reception unit 1541 transmits an authentication request to the server device 30 and receives an authentication notification from the server device 30. The authentication request requests authentication of the PIN code input to the input reception unit 1542 and includes the PIN code received by the input reception unit 1542 and the robot ID. The authentication notification becomes trigger information for permitting processing related to the sale of goods, as will be described later. Therefore, the transmission / reception unit 1541 functions as an input unit to which the trigger information is input. Further, the transmission / reception unit 3141 transmits a settlement request to the server device 30 and receives a settlement completion notification from the server device 30.

[0141] The input reception unit 1542 receives input information based on the operation of the operation unit 156. For example, the input reception unit 1542 receives a PIN code or a settlement instruction input by the user's operation.

[0142] The own position specifying unit 1543 specifies the position of the mobile vending robot 10 in the map information 2201 based on the output of the positioning unit 160.

[0143] The information processing unit 1544 executes various processes based on various information input to the mobile vending robot 10.

[0144] For example, when the transmission / reception unit 1541 receives a movement instruction from the server device 30, the information processing unit 1544 determines a movement route to the calling position based on the map information 1621.

[0145] Also, when the weight detection unit 159 detects a change in the weight of the shelf 112, the information processing unit 1544 reads out the product code corresponding to the shelf ID of the shelf 112 with the weight change from the stored product table 1623, and identifies the product taken out from the shelf 112 or the product returned to the shelf 112. The information processing unit 1544 functions as a detection unit that detects the product taken out from the mounting unit.

[0146] For example, when the weight change is a decrease in weight, the information processing unit 1544 reads out the product code stored in association with the shelf ID of the shelf 112 with the weight change. Then, the information processing unit 1544 refers to the product master 1622 and identifies the product code corresponding to the decreased weight among the weights associated with the read product code, thereby identifying the product taken out from the shelf 112. In this case, the information processing unit 1544 registers by transmitting the identified product code to the server device 30 (hereinafter, also referred to as "product registration"). Also, the information processing unit 1544 subtracts the quantity of the identified product code stored in the stored product table 1623 by the number of products taken out from the shelf 112.

[0147] For example, when the weight change is an increase in weight, the information processing unit 1544 reads out the product code stored in association with the shelf ID of the shelf 112 where the weight change occurred. Then, the information processing unit 1544 refers to the product master 1622 and identifies the product code corresponding to the increased weight among the weights associated with the read product code, thereby identifying the product returned to the shelf 112. In this case, the information processing unit 1544 requests the server device 30 to delete the product information corresponding to the identified registered product code. Also, the information processing unit 1544 increases the quantity of the identified product code stored in the stored product table 1623 by the number of products returned to the shelf 112.

[0148] When registering product information, the server device 30 reads out and registers the product information of the product corresponding to the received product code from the product master 3162. In this case, the information processing unit 1544 functions to cause the server device 30 to register product information and can be said to function as a registration unit that executes product registration.

[0149] When the input reception unit 1542 receives a settlement instruction, the information processing unit 1544 executes accounting processing. The accounting processing is part or all of the processing for the user to pay the purchase price of the product. In this embodiment, it includes calculation of the purchase price of the registered product, acquisition of face image data, and transmission of a settlement request.

[0150] When the settlement processing executed by the server device 30 is performed by the mobile sales robot 10, the accounting processing executed by the information processing unit 1544 includes the settlement processing. Also, the mobile sales robot 10 may be equipped with an automatic change dispenser or the like for performing cash settlement. In this case, the information processing unit 1544 controls the automatic change dispenser. Thus, the information processing unit 1544 functions as an accounting processing unit that executes accounting processing responsible for part or all of the processing related to the payment of the purchase price. The accounting processing unit executes the processing related to the payment of the product registered as the transaction target upon receiving the customer's operation.

[0151] In addition, when accounting processing is performed by reading information stored in a credit card, reading a two-dimensional code, or using cash in the accounting processing unit, the information processing unit 1544 transmits the result of the accounting processing to the server device 30.

[0152] Further, the information processing unit 1544 performs voice recognition on the voice collected by the sound collection unit 157 from the surroundings, and outputs a stop instruction to the drive control unit 1545 as necessary. For example, when the information processing unit 1544 recognizes a voice for stopping the mobile vending robot 10 through voice recognition, it outputs a stop instruction to the drive control unit 1545.

[0153] When the transmission / reception unit 1541 of the information processing unit 1544 receives an authentication notice from the server device 30, it permits the processing related to the sale of goods. That is, when the collation unit 3143 of the server device 30 collates the user who called the mobile vending robot 10 with the user who intends to start shopping, the information processing unit 1544 permits the processing related to the sale of goods.

[0154] For example, the information processing unit 1544 collaborates with the display control unit 1546 to display an initial screen for starting shopping on the display unit 155, thereby permitting the processing related to the sale of goods. Also, when the storage unit 111 is provided with a lockable door, the information processing unit 1544 unlocks the door to permit the processing related to the sale of goods. The information processing unit 1544 functions as a permission unit that permits the processing related to the sale of goods when the user who called the mobile vending robot 10 is collated with the user who intends to start shopping.

[0155] In this embodiment, the trigger information for permitting processing related to the sale of products at the called position is the authentication notification from the server device 30. However, during the patrol travel of the mobile vending robot 10, such trigger information is not set. During the patrol travel of the mobile vending robot 10, the mobile vending robot 10 stops at the sales position according to the user's voice. That is, since no call request and issuance of a PIN code corresponding to the call request are made. For the sale of products during the patrol travel of the mobile vending robot 10, it is not necessary to set the trigger information for permitting the processing related to the sale of the product, or other information different from the authentication notification may be used as the trigger information.

[0156] For example, information indicating that it has been detected that the user has looked at the imaging unit 134, that it has been detected that the user has performed a predetermined action such as blinking in front of the imaging unit 134, that it has been detected that the user has operated the disinfection device 136, etc. may be used as the trigger information. Note that a user who purchases a product during the patrol travel of the mobile vending robot 10 can purchase the product by face authentication if the settlement information has been registered in advance in the user management table 3165. Also, when the mobile vending robot 10 is equipped with a settlement device such as a card settlement terminal or a change machine, the user can purchase the product regardless of whether the settlement information has been registered.

[0157] Also, for the sale of products at the designated called position, the trigger information for permitting the processing related to the sale of the product may be the above-mentioned information instead of the above authentication notification, or may be information indicating that the mobile vending robot 10 has arrived at the called position. Furthermore, it is not necessary to set the trigger information for permitting the processing related to the sale of the product.

[0158] The information processing unit 1544 executes alarm processing for issuing an alarm as necessary. For example, while the mobile vending robot 10 is in motion, or when it is detected that a product has been illegally removed from the shelf 112 in a state where processing related to the sale of the product is not permitted, the information processing unit 1544 executes alarm processing. The alarm processing includes causing the light emitting unit 114 to emit light, changing to a color indicating a warning, or generating an alarm sound from a microphone (not shown) to notify the surrounding area of an abnormality.

[0159] In addition, the information processing unit 1544 may execute alarm processing when it is detected that a product is about to be illegally removed. For example, while the mobile vending robot 10 is in motion, or when it is detected that a hand has been inserted into the storage unit 111 in a state where processing related to the sale of the product is not permitted, the information processing unit 1544 may execute alarm processing. The information processing unit 1544 functions as an alarm unit that issues an alarm when it is detected that a product has been illegally removed, in other words, when a product has been illegally removed or is about to be removed.

[0160] The drive control unit 1545 controls the drive unit 123 to cause the mobile vending robot 10 to move or stop. The mobile vending robot 10 performs circuit running along a predetermined route and call running toward a call position designated by a customer under the control of the drive control unit 1545.

[0161] In addition, the drive control unit 1545 also functions as an example of a collective control unit and a linked running control unit. The drive control unit 1545 as the collective control unit causes a plurality of mobile vending robots 10 to gather at one location in response to a call command from the user terminal 20. Further, the drive control unit 1545 as the linked running control unit controls the drive unit 123 while detecting the position of the mobile vending robot 10 in cooperation with itself using the imaging unit 134 and the distance measuring unit 135, and causes it to run in a row with other mobile vending robots 10.

[0162] Note that the collective control unit and the coupled travel control unit do not necessarily have to be handled by the control unit 154 of the mobile vending robot 10. For example, the control unit 314 of the server device 30 may have them as one function, and the mobile vending robot 10 may be remotely controlled.

[0163] Further, when it is detected that the inventory of any one or all of the products stored in the storage unit 111 has run out, the drive control unit 1545 moves the mobile vending robot 10 to, for example, the backyard. This is to replenish the product whose inventory has run out. When the mobile vending robot 10 travels in a shopping mall or the like, the drive control unit 1545 may move the mobile vending robot 10 to the store that sells the product whose inventory has run out.

[0164] The display control unit 1546 controls the display unit 155 to display various information on the display unit 155. The display control unit 1546 causes the first display unit 131, the second display unit 132, and the third display unit 133 to display content corresponding to their respective installation positions. For example, the first display unit 131 displays information about the product taken out from the storage unit 111. The second display unit 132 displays information related to the promotion of the product, such as information for promoting the product stored in the storage unit 111. The third display unit 133 displays information related to the settlement of the product, such as information for guiding the settlement method of the product. Further, when the shelf label 113 is an electronic shelf label, the display control unit 1546 also controls the display of the electronic shelf label.

[0165] The operation of the sales information processing system 1 having each device with the above configuration will be described. FIG. 20 is a sequence chart showing an example of the operation of the sales information processing system 1. This sequence chart shows a case where a user checks the product information of the products mounted on the mobile vending robot 10, calls the mobile vending robot 10, and purchases the products of the mobile vending robot 10.

[0166] When the user calls the mobile vending robot 10, the user activates the application program of the sales information processing system 1 installed on the user terminal 20. The user terminal 20 accepts the selection of the mobile vending robot 10 from the selection screen 2151 shown in FIG. 19 (step S1). When the user performs an operation to complete the selection of the mobile vending robot 10, the user terminal 20 acquires the position information of the location where the device is located (step S7), and transmits a call request with the acquired position information as the call location to the server device 30 (step S8).

[0167] In addition, when the user selects a plurality of mobile vending robots 10 in step S1, the call request transmitted to the server device 30 in step S8 includes information on the plurality of mobile vending robots 10.

[0168] When the server device 30 receives the call request, it executes call request reception processing (step S9). The details of the call request reception processing will be described later. The server device 30 transmits the pin code issued in the call request reception processing to the user terminal 20 (step S10). In addition, the server device 30 transmits a movement instruction including the call location to the mobile vending robot 10 specified in the call request (step S11).

[0169] The mobile vending robot 10 controls the drive unit 123 and moves to the call location specified in the movement instruction (step S12). When the mobile vending robot 10 arrives at the call location, the mobile vending robot 10 transmits an arrival notice to the server device 30 (step S13). Note that the mobile vending robot 10 may transmit only the position information indicating the location of its own device to the server device 30, and the server device 30 may determine the arrival of the mobile vending robot 10 at the call location.

[0170] The server device 30 updates the call management table 3166 based on the received arrival notice (step S14). Specifically, the server device 30 registers the arrival date and time of the corresponding call request in the call management table 3166. Next, the server device 30 transmits an arrival notice to the user terminal 20 which is the source of the call request (step S15).

[0171] When the user terminal 20 receives the arrival notice, it displays information indicating that the called mobile vending robot 10 has arrived on the display unit 215 (step S16). Thereby, the user recognizes the arrival of the mobile vending robot 10 and inputs the PIN code received from the server device 30 into the operation unit 156 of the mobile vending robot 10.

[0172] When the mobile vending robot 10 receives the input of the PIN code (step S17), it transmits an authentication request including the input PIN code and the robot ID to the server device 30 (step S18).

[0173] The server device 30 performs PIN code authentication (step S19). Specifically, the server device 30 authenticates the PIN code when the combination of the PIN code and the robot ID included in the received authentication request is stored in the call management table 3166. When the server device 30 authenticates the PIN code and determines that the user who made the call request matches the user who is about to start shopping, it transmits an authentication notice to the mobile vending robot 10 (step S20).

[0174] When the mobile vending robot 10 receives the authentication notice, it permits the processing related to the sale of goods. Then, when it detects that a product has been taken out from the storage unit 111 (step S21), it executes product registration for the product (step S22).

[0175] Here, as shown in FIGS. 1 and 6, the registration screen 40 for displaying information on registered products moves following the customer U. To achieve this, the sales information processing system 1 changes the mobile sales robot 10 that displays the registration screen 40 as the customer U moves. In other words, each mobile sales robot 10 uses the display unit (the first display unit 131 or the second display unit 132) facing the customer U to display the registration screen 40 that shows the transaction target of the customer U when it is closest to the customer U among the other mobile sales robots 10 in cooperation.

[0176] The mobile sales robot 10 executes product registration every time a product is taken out from the shelf 112, and cancels the product registration when the product is returned to the shelf 112. The mobile sales robot 10 executes accounting processing when an accounting instruction is input (step S23). Then, the mobile sales robot 10 transmits a settlement request to the server device 30 based on the accounting processing (step S24).

[0177] The server device 30 executes settlement processing based on the received settlement request (step S25). When the settlement is successfully completed in the settlement processing, the server device 30 transmits a settlement completion notice to the mobile sales robot 10 (step S26) and also to the user terminal 20 (step S27). The user terminal 20 displays information indicating that the settlement has been completed on the display unit 215 when it receives the settlement completion notice (step S28).

[0178] Through the above operations, the sales information processing system 1 can move the mobile sales robot 10 carrying the product to the position designated by the user and sell the product.

[0179] Here, in the processing of steps S23 to S26, the operation related to accounting is received by the mobile sales robot 10 that was closest to the customer U at the start of the operation. That is, the customer U inputs an accounting instruction to the mobile sales robot 10 that is displaying the registration screen 40.

[0180] Also, in the processes of steps S23 to S28, regardless of which mobile vending robot 10 the customer U purchases all the products from, the operations related to the payment of all the products are accepted by a single mobile vending robot 10.

[0181] Thus, according to the present embodiment, when a plurality of mobile vending robots 10 for displaying and selling products are used in a set to correspond to the types and quantities of products, etc., product registration and payment can be performed collectively instead of for each mobile vending robot 10. Therefore, the operability for the customer can be improved.

[0182] According to the operation of linking a plurality of such mobile vending robots 10, it is possible to easily realize sales forms such as selling products with different appropriate temperatures (for example, warm products and cold products) together, or displaying products that are often purchased together (for example, bento and drinks) close to each other, and increasing the number of displays because it is a time zone or place with a large number of sales.

[0183] Here, FIG. 21 is a diagram showing another example of the arrangement of a plurality of mobile vending robots 10. In FIGS. 1, 6, and 19, examples of operating the linked mobile vending robots 10 arranged in a line are shown, but the implementation is not limited to this. For example, when a plurality of mobile vending robots 10 move autonomously and gather from different places to a certain place, it may be difficult to line up in a line. Also, in some cases, the visibility of the products may be better when a plurality of mobile vending robots 10 are arranged with a certain gap between them rather than being arranged in a line. Therefore, as shown in FIG. 21, the linked mobile vending robots 10 may not be lined up as long as they gather with a certain sense of distance, for example, approaching each other to such an extent that the distance between them is less than or equal to a predetermined value.

[0184] (Second Embodiment) Next, a second embodiment, which is a modification of the first embodiment, will be described. In the description of the second embodiment, the points different from the first embodiment will be mainly described, and the detailed description of the points common to the already described content will be omitted.

[0185] FIG. 22 is a diagram showing an example in which there are two customers U with respect to a mobile vending robot during cooperation. Here, the two customers U are respectively labeled as "A" and "B". The sales information processing system 1 causes the mobile vending robot 10 closest to the customer U of "A" to display the registration screen 40 of "A". Further, the sales information processing system 1 causes the mobile vending robot 10 closest to the customer U of "B" to display the registration screen 40 of "A".

[0186] FIG. 23 is a diagram showing a state in which the customer has moved and the customer U of "A" has shifted to settlement. As shown in this figure, the registration screen 40 for the customer U of "B" follows the customer U of "B", and the registration screen 40 for the customer U of "A" follows the customer U of "A". Further, the display content is switched according to the shopping progress status of each customer U.

[0187] As described above, according to the present embodiment, the same correspondence can be made for a plurality of customers U. Note that the customer U may access the mobile vending robot 10 from the back side of the mobile vending robot 10 in FIGS. 22 and 23. In that case, the registration screen 40 and the like are displayed on the display unit (second display unit 132) on the back side of the mobile vending robot 10.

[0188] The programs executed by the respective devices of the above-described embodiments are provided by being pre-installed in a ROM or the like. The programs executed by the respective devices of the above-described embodiments may be configured to be recorded on a computer-readable recording medium such as a CD-ROM, a flexible disk (FD), a CD-R, or a DVD (Digital Versatile Disk) in an installable format or an executable format file and provided.

[0189] Furthermore, the program executed by each device of the above-described embodiments may be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network. Also, the program executed by each device of the above-described embodiments may be configured to be provided or distributed via a network such as the Internet.

[0190] Although several embodiments of the present invention have been described, these embodiments are presented by way of example and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, changes, and combinations can be made without departing from the gist of the invention. These embodiments and their modifications are included in the scope and gist of the invention, and are also included in the invention described in the claims and the equivalent scope thereof.

Explanation of Reference Numerals

[0191] 1... Sales information processing system, 10... Mobile vending robot, 11... Main body part, 111... Storage part, 112... Shelf, 113... Shelf label, 114... Light emitting part, 12... Moving part, 121... Non-driving wheel, 122... Driving wheel, 123... Driving part, 13... User interface part, 131... First display part, 132... Second display part, 133... Third display part, 134... Imaging part, 135... Distance measuring part, 136... Disinfection device, 154... Control part, 1541... Transceiving part, 1542... Input receiving part, 1543... Self-position specifying part, 1544... Information processing part, 1545... Driving control part, 1546... Display control part, 155... Display part, 156... Operation part, 157... Sound collecting part, 158... Sensor part, 159... Weight detecting part, 160... Positioning part, 161... Communication part, 162... Storage part, 1621… Map information, 1622… Product master, 1623… Stored product table, 20… User terminal, 214… Control unit, 2141… Transmission / reception unit, 2142… Input reception unit, 2143… Self-position determination unit, 2144… Display control unit, 215… Display unit, 2151… Selection screen, 2152… Icon, 2153… Icon, 216… Operation unit, 217… Imaging unit, 218… Positioning unit, 219… Communication unit, 220… Memory unit, 2201… Map information, 30… Server device, 314… Control unit, 3141… Transmission / reception unit, 3142… Information management unit, 3143… Verification unit, 3144… Settlement processing unit, 3145… Robot management unit, 3146… Display control unit, 3147… Settlement control unit, 315… Communication unit, 316… Memory unit, 3161… Map information, 3162… Product master, 3163… Robot management table, 3164… Product management table, 3165… User management table, 3166… Call management table, 3167… Transaction management table, 40… Registration screen, 41… Product icon, 42… Product name, 43… Registered points, 44… Subtotal.

Prior art documents

Patent documents

[0192]

Patent Document 1

Claims

1. A sales information processing system including a sales device for selling displayed products and an information processing device for managing a plurality of said sales devices, a cooperation unit for operating a plurality of said sales devices in cooperation, a display unit provided in said sales device for displaying information directed to customers, an imaging unit provided in said sales device for acquiring image information for identifying customers, a distance measuring unit provided in said sales device for measuring the distance between the customer identified by the image information output by said imaging unit and the own device, a display control unit for displaying a registration screen showing information on products registered as transaction targets on the display unit of the sales device that is the closest to the customer among a plurality of said sales devices operating in cooperation based on the transitions of the outputs of said imaging unit and said distance measuring unit, and changing the sales device for displaying said registration screen as the customer moves, A sales information processing system comprising.

2. An accounting processing unit provided in said sales device for receiving and executing processing related to payment for products registered as transaction targets upon receiving a customer's operation, A settlement control unit for receiving a customer's operation related to payment by the accounting processing unit of the sales device that is the closest to the customer among a plurality of said sales devices operating in cooperation based on the transitions of the outputs of said imaging unit and said distance measuring unit, The sales information processing system according to claim 1, further comprising.

3. The settlement control unit receives a customer's operation related to payment for all products sold by a plurality of said sales devices operating in cooperation via the sales device that is the closest to the customer at the start of the operation. The sales information processing system according to claim 2.

4. The sales device further comprises a driving unit for self-propelling the own device. The sales information processing system according to any one of claims 1 to 3.

5. An aggregation control unit that aggregates a plurality of the vending machines in response to a call command from a terminal device possessed by a customer; A connected travel control unit that controls the drive unit and causes a plurality of the vending machines to travel in a row; The vending information processing system according to claim 4, further comprising at least any one of the above.

Images