Sales data processing system and program

Abstract

To notify a store clerk that a customer moving through a retail store needs assistance from the store clerk and enable the store clerk to provide assistance.SOLUTION: A sales data processing system includes: a registration unit that registers information on items identified by information acquired by a mobile terminal as sales data; a status recognition unit that recognizes the status of an operator of the mobile terminal based on the information acquired by the mobile terminal in parallel with the processing by the registration unit; a determination unit that determines whether or not support by a clerk is required based on the status of the operator recognized by the status recognition unit; and a request outputting unit that outputs information requesting support for the operator to a clerk terminal operated by the clerk when the determination unit determines that support is required.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] An embodiment of the present invention relates to a sales data processing system and a program. [Background technology]

[0002] For example, in a retail store where customers go around the sales floor and carry the products they want to buy from the display area, there are cases where customers who cannot find the product they are looking for ask a salesperson. This is likely to happen when the store is large. Furthermore, there are also cases where the customer cannot find the salesperson they want to ask. In such cases, the customer feels dissatisfied. Therefore, such cases are a cause of lowering customer satisfaction.

[0003] Here, Patent Document 1 discloses a technology in which a reception device captures a customer's face image, analyzes the customer's emotions based on the face image, and transmits the analysis results to a terminal of a receptionist. If the customer's dissatisfaction can be detected, a store clerk can rush to the dissatisfied customer and provide support. However, the conventional technology cannot recognize the emotions of a customer who is moving around the store.

[0004] Note that the above is merely an example, and regardless of the type of business, the longer a customer continues to require assistance from a store clerk, the lower the customer satisfaction level becomes. Summary of the Invention [Problem to be solved by the invention]

[0005] The problem to be solved by the present invention is to, when a customer moving around a sales floor of a retail store is in a state requiring the assistance of a store clerk, notify the store clerk of the state and enable the customer to provide assistance. [Means for solving the problem]

[0006] A sales data processing system according to an embodiment includes a registration unit that registers information on a product identified by information acquired by a mobile terminal as sales data, a status recognition unit that recognizes a status of an operator of the mobile terminal from information acquired by the mobile terminal in parallel with processing by the registration unit, a determination unit that determines whether support from a store clerk is required based on the status of the operator recognized by the status recognition unit, and a request output unit that outputs information requesting support for the operator to a store clerk terminal operated by a store clerk when the determination unit determines that the support is required. The mobile terminal includes a camera that captures an image of a side facing a display unit that displays information to an operator of the mobile terminal or an operation unit that accepts operations for the mobile terminal, and the state recognition unit estimates a state of the operator based on an image captured by the camera. do. [Brief description of the drawings]

[0007] [Figure 1] FIG. 1 is a diagram illustrating an example of a configuration of a sales data processing system according to an embodiment. [Diagram 2] FIG. 2 is a diagram showing an example of the appearance of a cart POS. [Diagram 3] FIG. 3 is a diagram illustrating an example of a hardware configuration of a mobile terminal. [Figure 4] FIG. 4 is a diagram illustrating an example of a functional configuration of the mobile terminal. [Diagram 5] FIG. 5 is a diagram illustrating an example of a hardware configuration of the server. [Figure 6] FIG. 6 is a diagram illustrating an example of a functional configuration of the server. [Figure 7] FIG. 7 is a diagram illustrating an example of a hardware configuration of the store clerk terminal. [Figure 8] FIG. 8 is a diagram illustrating an example of a functional configuration of the store clerk terminal. [Figure 9] FIG. 9 is a diagram illustrating an example of a processing flow of each component of the sales data processing system. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] The embodiment will be described with reference to the drawings. Fig. 1 is a diagram showing an example of the configuration of a sales data processing system in the embodiment. The sales data processing system includes a server 100, a mobile terminal 200, and a salesperson terminal 300.

[0009] The mobile terminal 200 is a terminal device used by a customer moving around the store. The mobile terminal 200 transmits a code capable of identifying a product to the server 100 and receives product information from the server 100. The mobile terminal 200 also transmits a facial image and a voice of the customer to the server 100.

[0010] The server 100 is also called a store server or a store terminal, and is, for example, a PC (Personal Computer) installed in the back yard of a store. The server 100 is connected to a headquarters server belonging to a headquarters that manages multiple stores via a network such as a dedicated line, and is capable of transmitting and receiving various data to and from the headquarters server.

[0011] The server 100 transmits information about the product (product information) identified based on the code received from the mobile terminal 200 to the mobile terminal 200. The product information is, for example, the price and the name. The server 100 also recognizes the state of the customer based on the face image and voice received from the mobile terminal 200. If the customer is in a state where he or she needs the support of a store clerk, the server 100 transmits information to the store clerk terminal 300 indicating that support is to be requested.

[0012] The clerk terminal 300 is a terminal device used by a clerk, such as a smartphone. When the clerk terminal 300 receives information requesting support from a customer from the server 100, the clerk terminal 300 notifies the clerk of the support request by displaying the information on a display device or emitting a sound from a speaker.

[0013] 2 is a diagram showing an example of the appearance of the cart POS 500. The cart POS 500 is a shopping cart 510 used for transporting products purchased by customers in a store, to which a mobile terminal 200, a scanner 520, and a battery 530 are attached.

[0014] Shopping cart 510 comprises a storage section 511, caster sections 512, and a handle section 513. Storage section 511 is a basket-shaped container with an open top, and stores products purchased by customers. Caster sections 512 are a number of wheels provided on the lower part of legs supporting storage section 511, and caster sections 512 enable shopping cart 510 to move forward, backward, left and right. Handle section 513 is a part that a customer holds when moving shopping cart 510.

[0015] The scanner 520 incorporates an LED (Light Emitting Diode) that irradiates illumination light onto the product, a light receiving element such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) that receives light reflected from a code symbol attached to the product, and a decoder (none of which are shown) that decodes the code symbol drawn by the light received by the light receiving element. Also, a reading window is provided on one side of the scanner 520 to emit light from the LED and read the code symbol.

[0016] When a customer places an item to be purchased in the storage unit 511, the customer holds the code symbol attached to the item over the reading window to have the scanner 520 read the code symbol. The scanner 520 reads the code symbol, such as a barcode or two-dimensional code, attached to the item. That is, the scanner 520 obtains a product code that uniquely identifies the item by decoding the code symbol (image), and outputs the product code to the mobile terminal 200.

[0017] Instead of the scanner 520, the cart POS 500 may be provided with a hand scanner that the customer holds and brings close to the code symbol attached to the product to read the code symbol.

[0018] Mobile terminal 200 registers, as sales data, information on a product (product information) that is identified (uniquely specified) based on the product code input from scanner 520. The product is specified by server 100 to which the product code is input from mobile terminal 200. Server 100 outputs product information corresponding to the product code, i.e., price, name (product name), etc., to mobile terminal 200.

[0019] Battery 530 supplies (feeds) power to mobile terminal 200 and scanner 520. Battery 530 is heavy, and is therefore installed as low as possible, for example, below storage unit 511. Battery 530 is a rechargeable battery (secondary battery), such as a lithium ion battery or a nickel-metal hydride battery.

[0020] 3 is a diagram showing an example of a hardware configuration of mobile terminal 200. Mobile terminal 200 includes a CPU (Central Processing Unit) 211, a ROM (Read Only Memory) 212, a RAM (Random Access Memory) 213, a communication I / F (Interface) 214, a display unit 215, an operation unit 216, a short-range communication I / F 217, a camera 218, a microphone 219, a storage unit 220, and the like.

[0021] Display unit 215 is, for example, a display device such as an LCD (Liquid Crystal Display), and displays information to an operator (customer) of mobile terminal 200. Operation unit 216 is, for example, a touch panel provided over the display surface of display unit 215, and receives input operations to mobile terminal 200 and outputs information based on the operations.

[0022] The communication I / F 214 enables communication with an external device, and mediates communication with the server 100, etc. The short-distance communication I / F 217 performs non-contact communication (short-distance wireless communication) with the scanner 520 using NFC (Near Field communication), Bluetooth (registered trademark), or the like. The CPU 211 controls the scanner 520 via the short-distance communication I / F 217, and acquires a product code output by the scanner 520.

[0023] Camera 218 includes a light receiving element such as a CCD or CMOS, converts light received by the light receiving element into an electrical signal, and outputs the signal. Camera 218 is provided on the exterior housing of mobile terminal 200, and captures an image of the side facing display unit 215 and operation unit 216. Display unit 215 is viewed by the operator (customer) of mobile terminal 200, and faces the face of the customer. In other words, the captured image output by camera 218 includes an image of the customer's face when the customer is looking at mobile terminal 200. Note that the captured image by camera 218 does not need to be displayed on display unit 215. Microphone 219 collects sounds outside mobile terminal 200, converts the input voice into an electrical signal, and outputs the electrical signal.

[0024] The storage unit 220 stores programs and various files. The storage unit 220 may be any storage device, such as a solid state drive (SSD). When the mobile terminal 200 is started up, all or part of the programs stored in the storage unit 220 are executed by the CPU 211. One of the programs stored in the storage unit 220 is a POS application 221. The POS application 221 is application software that causes the mobile terminal 200 to function as a POS (Point Of Sales) terminal.

[0025] The ROM 212 stores various programs and data executed by the CPU 211. The RAM 213 is used for expanding the programs executed by the CPU 211 and temporarily storing various values. The CPU 211 functions as the control unit 210 by executing the programs stored in the ROM 212 and the storage unit 220. The CPU 211 executes the POS application 221, causing the control unit 210 to function as various functional units (see FIG. 4) described below.

[0026] 4 is a diagram showing an example of the functional configuration of the mobile terminal 200. The control unit 210 includes an imaging unit 201, a reading unit 202, a registration unit 203, and the like.

[0027] The imaging unit 201 controls the camera 218 to acquire a captured image output by the camera 218 and transmits it to the server 100. The reading unit 202 controls the scanner 520 to acquire a product code output by the scanner 520 and transmits it to the server 100. The registration unit 203 registers sales data. That is, the registration unit 203 stores the product information input from the server 100 in the storage unit 220 as sales data. The product information is information received from the server 100 and is uniquely identified by the product code acquired by the mobile terminal 200.

[0028] Next, the server 100 will be described. Fig. 5 is a diagram showing an example of the hardware configuration of the server 100. The server 100 includes a CPU 111, a ROM 112, a RAM 113, a communication I / F 114, a storage unit 120, etc. The communication I / F 114 enables communication with external devices, and mediates communication with the mobile terminal 200, the store clerk terminal 300, etc.

[0029] The storage unit 120 stores programs and various files. The storage unit 120 may be any storage device, such as a hard disk drive (HDD) or SSD. When the server 100 is started up, all or part of the programs stored in the storage unit 120 are executed by the CPU 111. One of the files stored in the storage unit 120 is a product master 121. The product master 121 stores product information such as price and name (product name) in association with a product code, which is an identification code capable of identifying (uniquely specifying) a product.

[0030] The ROM 112 stores various programs and various data executed by the CPU 111. The RAM 113 is used for expanding the programs executed by the CPU 111 and temporarily storing various values. The CPU 111 functions as the control unit 110 by executing the programs stored in the ROM 112 and the storage unit 120. The control unit 110 includes various functional units (see FIG. 6) which will be described below.

[0031] 6 is a diagram showing an example of a functional configuration of the server 100. The control unit 110 includes a product identification unit 101, a state recognition unit 102, a determination unit 103, a request output unit 104, and the like.

[0032] The product identification unit 101 uses the product code input from the mobile terminal 200 as a key to obtain the price and product name from the product master 121 , and outputs them to the mobile terminal 200 . In this embodiment, the scanner 520 identifies the product based on the product code that it reads and outputs by reading the code symbol. However, the present invention is not limited to this embodiment, and it is also possible to use, for example, a general object recognition technology to identify the product based on its external features.

[0033] State recognition unit 102 recognizes the state of the operator of mobile terminal 200 from information acquired by mobile terminal 200. More specifically, state recognition unit 102 estimates the emotion of the operator from the facial expression of the operator included in the image information output by camera 218. State recognition unit 102 also recognizes the state of the operator from the voice information output by microphone 219. This process is performed in parallel with the process by registration unit 203.

[0034] Image information output by camera 218 and audio information output by microphone 219 are examples of information acquired by mobile terminal 200. When mobile terminal 200 acquires this image information or audio information, it outputs it to server 100. When image information or audio information is input from mobile terminal 200 to server 100, state recognition unit 102 recognizes the state of the operator of mobile terminal 200 based on the input information. The state of the operator may be, for example, feelings such as dissatisfaction or anger, or a situation in which the operator is searching around for a product because he or she cannot find it.

[0035] When image information is input from the mobile terminal 200 to the server 100, the state recognition unit 102 extracts a face image included in the image information, analyzes the face image, and estimates emotions from facial expressions. Existing technology may be used for this analysis process. Also, when voice information is input from the mobile terminal 200 to the server 100, the state recognition unit 102 extracts words included in the voice information.

[0036] The judgment unit 103 judges whether or not support from a store clerk is required based on the state of the operator recognized by the state recognition unit 102. For example, when the state recognition unit 102 judges that the operator is dissatisfied, angry, or in trouble, it judges that support from a store clerk is required.

[0037] More specifically, when the information acquired from the mobile terminal 200 is image information, if the emotion estimated from the face image included in the image information is related to, for example, dissatisfaction, anger, confusion, etc., the judgment unit 103 judges that the assistance of a store clerk is required. Also, when the information acquired from the mobile terminal 200 is voice information, if the words included in the voice information include words related to dissatisfaction or anger, or words such as "Where is it?" or "I can't find it," the judgment unit 103 judges that the assistance of a store clerk is required.

[0038] When the determination unit 103 determines that support is required, the request output unit 104 outputs information requesting support for the operator to the store clerk terminal 300 operated by the store clerk. In addition, the request output unit 104 includes information that can identify the operator in the information requesting support. Examples of the information that can identify the operator include a face image.

[0039] Furthermore, the request output unit 104 includes, in the information for requesting support, information indicating the position of the mobile terminal 200. The information indicating the position of the mobile terminal 200 is, for example, information for displaying an image indicating the current value of the mobile terminal 200 on a map inside the store, or the name of a sales floor near the mobile terminal 200.

[0040] For example, if a store is large enough and can be seen from anywhere in the store, it is not necessary to include information indicating the location of the mobile terminal 200.

[0041] Next, we will explain the clerk terminal 300. Fig. 7 is a diagram showing an example of the hardware configuration of the clerk terminal 300. The clerk terminal 300 includes a CPU 311, a ROM 312, a RAM 313, a communication I / F 314, a display unit 315, an operation unit 316, a storage unit 320, and the like.

[0042] The display unit 315 is, for example, a display device such as an LCD, and displays information to an operator (store clerk) of the store clerk terminal 300. The operation unit 316 is, for example, a touch panel or the like provided over the display surface of the display unit 315, and receives input operations to the store clerk terminal 300 and outputs information based on the operations. The communication I / F 314 enables communication with external devices, and intermediates communication with the server 100, etc.

[0043] The storage unit 320 stores programs and various files. The storage unit 320 may be any storage device, such as an SSD. When the store clerk terminal 300 is started up, all or part of the programs stored in the storage unit 320 are executed by the CPU 311.

[0044] The ROM 312 stores various programs and various data executed by the CPU 311. The RAM 313 is used for expanding the programs executed by the CPU 311 and for temporarily storing various values. The CPU 311 functions as the control unit 310 by executing the programs stored in the ROM 312 and the storage unit 320. The control unit 310 includes various functional units (see FIG. 8) which will be described next.

[0045] 8 is a diagram showing an example of the functional configuration of the store clerk terminal 300. The control unit 310 includes a receiving unit 301, a notification unit 302, and the like.

[0046] The receiving unit 301 receives various types of information from the server 100. When the receiving unit 301 receives information requesting support for the operator, the notifying unit 302 notifies the store clerk by displaying the information on the display unit 315, for example. If the store clerk terminal 300 is equipped with a speaker or the like, the notification unit 302 can emit a sound through the speaker in conjunction with the notification on the display unit 315, making it easier for the store clerk carrying the store clerk terminal 300 to notice the request for support.

[0047] In a sales data processing system with such a configuration, the mobile terminal 200 starts capturing images with the camera 218 when a customer enters the store and starts the POS application 221, and the server 100 analyzes the captured images output by the camera 218 to recognize the state of the customer, and if support is required, outputs a support request to the store clerk terminal 300. This series of processing flow will be described in more detail with reference to Figure 9. Figure 9 is a diagram that shows an example of the processing flow of each component of the sales data processing system.

[0048] First, when a customer who has entered the store starts using mobile terminal 200, POS application 221 is started up in mobile terminal 200, and the customer is prompted to log in. The customer logs in by, for example, entering a member ID (step S11). The member ID may be entered by having scanner 520 read a code symbol such as a barcode or two-dimensional code displayed on a membership card, or may be entered manually using operation unit 216.

[0049] After logging in, the mobile terminal 200 displays a screen (product registration screen) that displays a list of information on products registered as sales data on the display unit 215. This screen includes a button that instructs the scanner 520 to start reading the code symbol. When the button is operated via the operation unit 216, the scanner 520 starts irradiating light and capturing an image.

[0050] In parallel with the sales data processing as described above, mobile terminal 200 captures images using camera 218 (step S12) and transmits the captured images to server 100. It is not necessary to display the images captured by camera 218 on display unit 215. Capture of images continues until a transaction is processed at mobile terminal 200 (No in step S13). When operation unit 216 receives an operation from the operator (customer) to perform a transaction (Yes in step S13), mobile terminal 200 stops capturing images and ends this process.

[0051] When the captured image is input from the mobile terminal 200, the server 100 analyzes it (step S21) and recognizes the state of the customer (step S22). Next, the server 100 judges whether the customer needs assistance from a store clerk based on the state of the customer (step S23). If it is judged in step S23 that assistance is not required, the server 100 ends this process. Moreover, if it is determined in step S23 that support is necessary, the server 100 makes a support request (step S24).

[0052] When a support request is input from the server 100, the store clerk terminal 300 receives it (step S31), displays it on the display unit 315 (step S32), and ends this process.

[0053] In this way, according to the sales data processing system of this embodiment, the mobile terminal 200 used to register products purchased by the customer collects the customer's facial expressions and words to recognize the customer's condition, and if necessary, requests support from a sales clerk via the sales clerk terminal 300. In this way, when a customer moving around the sales floor of a retail store reaches a state where the customer needs the support of a sales clerk, the customer's condition can be notified to the sales clerk so that the sales clerk can provide support.

[0054] The mobile terminal 200 moves with the customer as he moves through the store, and the camera 218 can capture the customer's facial expression when the customer views or operates the display contents of the mobile terminal 200. Therefore, for example, if a customer who is walking and pushing the cart POS 500 by holding the handle 513 is in trouble because he cannot find a desired product, the camera 218 captures the customer's facial expression, and the state recognition unit 102 analyzes the customer's facial expression, thereby recognizing the customer's troubled state and enabling a store clerk to provide support.

[0055] Furthermore, by capturing the words uttered by the customer with microphone 219, if the words of the customer include expressions that suggest the customer is in a difficult position, this can be recognized and a store staff member can provide support.

[0056] In this embodiment, facial images and voice are obtained from mobile terminal 200 as information used to recognize the customer's condition, but in practice, the customer's condition may be recognized from information other than facial images and voice.

[0057] In addition, in the present embodiment, an example in which the mobile terminal 200 is a tablet terminal has been described, but in practice, the mobile terminal 200 may be, for example, a mobile terminal such as a smartphone. In addition, the smartphone as a mobile terminal may be provided in the store or may be owned by the customer.

[0058] In addition, in the present embodiment, an example has been described in which the mobile terminal 200 is a tablet terminal attached to the shopping cart 510, but in practice, the mobile terminal 200 may be, for example, a customer terminal such as a smartphone carried by a customer. In this case, it is preferable to provide the shopping cart 510 with a holder for holding the customer terminal. In this case, the customer terminal functions as the mobile terminal of this embodiment by starting a predetermined application software (corresponding to the POS application 221 in the embodiment) that has been installed. In addition, when a smartphone is used as the mobile terminal, the smartphone can also function as the scanner 520 as described below.

[0059] A more detailed description will be given of a case where a smartphone carried by a customer is used as a mobile terminal. Many recent smartphones are equipped with cameras on both the side with the display device and the back side, and such smartphones are capable of capturing images on both sides. When such a smartphone is used as a mobile terminal, the holder holds the smartphone with the camera on the back side of the display device facing the storage section 511. In this manner of use, when a customer puts an item into the storage section 511, the customer captures an image of the item with the camera on the back side (rear camera). Also, the camera on the display device side (front camera) captures an image of the customer. In this manner, the smartphone can be used in place of the mobile terminal 200, which is the tablet terminal of the above embodiment, and the scanner 520.

[0060] Furthermore, when a customer uses a smartphone as a mobile terminal, the smartphone, which is a mobile terminal, performs a store entry process instead of the login in step S11. The store entry process is, for example, as follows. First, the customer starts (executes) the POS application 221 when entering the store. Next, the customer obtains an access code for wirelessly connecting to the in-store system by, for example, following the instructions of the POS application 221 and having the camera read a two-dimensional code displayed at the store entrance or the like. After the above store entry process, the POS application 221 starts a product registration process.

[0061] After the store entry process, the POS application 221 performs product registration process using the rear camera and captures the customer's face image using the front camera in parallel. At this time, the display device (corresponding to the display unit 215) displays a product registration screen.

[0062] Furthermore, in this embodiment, a captured image including a face image of the customer is transmitted from the mobile terminal 200 to the server 100, and the server 100 performs a process of recognizing the state of the customer, but this is not the only possible embodiment. That is, for example, the mobile terminal 200 may include functional units equivalent to the state recognition unit 102, the determination unit 103, and the request output unit 104 of this embodiment.

[0063] In addition, in the present embodiment, the server 100 is described as a PC installed in, for example, a backyard of a store, but the present invention is not limited to this. For example, the server 100 may be a virtual server in a cloud environment. In this case, the virtual server is constructed, for example, in a headquarters server belonging to the headquarters, for each store or for each appropriately configured group. In this case, the mobile terminal 200 and the store clerk terminal 300 communicate with the virtual server.

[0064] The sales data processing system of this embodiment is equipped with a control device such as a CPU, a storage device such as a ROM and a RAM, an external storage device such as a HDD and a CD drive, a display device such as a display device, and input devices such as a keyboard and a mouse, and has a hardware configuration that utilizes a normal computer.

[0065] Furthermore, the programs executed by the sales data processing system of this embodiment are provided in a state that they are pre-installed in a storage device such as a ROM.

[0066] The programs executed by the sales data processing system of this embodiment may be configured to be provided by being recorded in an installable or executable format on a computer-readable recording medium such as a CD-ROM, a flexible disk (FD), a CD-R, or a DVD (Digital Versatile Disk).

[0067] Furthermore, the program executed by the sales data processing system of this embodiment may be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network. Also, the program executed by the sales data processing system of this embodiment may be provided or distributed via a network such as the Internet.

[0068] The program executed by the sales data processing system of this embodiment has a modular configuration including the above-mentioned units (product identification unit 101, status recognition unit 102, judgment unit 103, request output unit 104, imaging unit 201, reading unit 202, registration unit 203, receiving unit 301, notification unit 302, etc.). The CPU (processor) loads the above-mentioned units onto the main storage device by reading and executing the program from the above-mentioned storage device. As a result, the product identification unit 101, status recognition unit 102, judgment unit 103, request output unit 104, imaging unit 201, reading unit 202, registration unit 203, receiving unit 301, and notification unit 302 are generated on the main storage device.

[0069] Although some embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope and spirit of the invention, and are included in the scope of the invention and its equivalents described in the claims. [Explanation of symbols]

[0070] 100…server, 101: product identification unit; 102: state recognition unit; 103: judgment unit; 104: request output unit; 110...control unit, 111...CPU, 112...ROM, 113...RAM, 114...Communication I / F, 120: storage unit; 121: product master; 200...mobile terminal, 201: imaging unit; 202: reading unit; 203: registration unit; 210...control unit, 211...CPU, 212...ROM, 213...RAM, 214...Communication I / F, 215...Display unit, 216...Operation unit, 217...Near field communication I / F, 218…Camera, 219…Microphone, 220...memory unit, 221...POS application, 300: Store clerk terminal, 301: Receiving unit; 302: Notification unit; 310...control unit, 311...CPU, 312...ROM, 313...RAM, 314...Communication I / F, 315...display section, 316...operation section, 320...Storage section, 500…Cart POS, 510…Shopping cart, 511: storage section, 512: caster section, 513: handle section, 520…scanner, 530...battery. [Prior art documents] [Patent documents]

[0071] [Patent Document 1] JP 2018-036712 A

Claims

1. a registration unit that registers information on a product identified by information acquired by the mobile terminal as sales data; a state recognition unit that recognizes a state of an operator of the mobile terminal based on information acquired by the mobile terminal in parallel with the processing by the registration unit; a determination unit that determines whether assistance from a store clerk is required based on the state of the operator recognized by the state recognition unit; a request output unit that outputs, when the determination unit determines that the support is required, information requesting support for the operator to a store clerk terminal operated by the store clerk; Equipped with the mobile terminal includes a camera that captures an image of a side facing a display unit that displays information to an operator of the mobile terminal or an operation unit that accepts operations on the mobile terminal; The state recognition unit estimates a state of the operator based on a captured image acquired from the camera. Sales data processing system.

2. a registration unit that registers information on a product identified by information acquired by the mobile terminal as sales data; a state recognition unit that recognizes a state of an operator of the mobile terminal based on information acquired by the mobile terminal in parallel with the processing by the registration unit; a determination unit that determines whether assistance from a store clerk is required based on the state of the operator recognized by the state recognition unit; a request output unit that outputs, when the determination unit determines that the support is required, information requesting support for the operator to a store clerk terminal operated by the store clerk; Equipped with the mobile terminal includes a camera that captures an image of a side facing a display unit that displays information to an operator of the mobile terminal or an operation unit that accepts operations on the mobile terminal; The state recognition unit estimates the emotion of the operator from a facial expression of the operator included in image information output by the camera. Sales data processing system.

3. a registration unit that registers information on a product identified by information acquired by the mobile terminal as sales data; a state recognition unit that recognizes a state of an operator of the mobile terminal based on information acquired by the mobile terminal in parallel with the processing by the registration unit; a determination unit that determines whether assistance from a store clerk is required based on the state of the operator recognized by the state recognition unit; a request output unit that outputs, when the determination unit determines that the support is required, information requesting support for the operator to a store clerk terminal operated by the store clerk; Equipped with The mobile terminal includes a microphone; The state recognition unit recognizes the state of the operator from voice information output by the microphone. Sales data processing system.

4. The request output unit includes information capable of identifying the operator in the information requesting support.

4. A sales data processing system according to claim 1.

5. The request output unit includes information indicating a location of the mobile terminal in the information requesting support.

5. A sales data processing system according to claim 1.

6. The sales data processing system computer A registration function for registering information on a product identified by information acquired by the mobile terminal as sales data; a status recognition function that recognizes a status of an operator of the mobile terminal based on information acquired by the mobile terminal in parallel with the processing by the registration function; a determination function for determining whether assistance from a store clerk is required based on the state of the operator recognized by the state recognition function; a request output function that outputs information requesting support for the operator to a store clerk terminal operated by the store clerk when the determination function determines that the support is required; Realize this, The state recognition function estimates the state of the operator based on an image captured by a camera capturing an image of a side facing a display unit that displays information to an operator of the mobile terminal or an operation unit that accepts operations on the mobile terminal. Program for.

Images