Product sales data processing device, product sales data processing system, and program

Abstract

To provide a product sales data processing deice, product sales data processing system, and program, which allow for displaying a screen in a display format suitable for each customer.SOLUTION: A self POS terminal (product sales data processing device ) comprises: an attribute estimation unit configured to estimate an attribute of a customer based on information on the customer; and a display format switching unit configured to change the display format of a screen displayed for the customer to a display format suitable for the attribute of the customer from among a plurality of predetermined display formats.SELECTED DRAWING: Figure 10

Description

Technical Field

[0001] Embodiments of the present invention relate to a product sales data processing device, a product sales data processing system, and a program.

Background Art

[0002] Conventionally, there is known a product sales data processing device that determines whether a customer is a foreigner based on information such as the nationality of the customer read from the customer's mobile terminal, and sets the language to be used for providing information to the customer when the customer is a foreigner (for example, Patent Document 1).

[0003] The attributes of customers who shop at a store have variations according to various attributes such as age, gender, height, and eyesight, not just whether they are Japanese or foreigners. Therefore, it is desired that the product sales data processing device can provide information according to the attributes of the customer, for example, can change the display form of the screen to a form suitable for the customer.

Summary of the Invention

Problems to be Solved by the Invention

[0004] The problem to be solved by the present invention is to provide a product sales data processing device, a product sales data processing system, and a program that can display a screen in a display form according to the customer.

Means for Solving the Problems

[0005] The product sales data processing device according to the embodiment includes an attribute estimation unit and a display form change unit. , monitoring unit, re-change instruction reception unit, display format re-change unit The attribute estimation unit estimates the attributes of the customer based on information related to the customer. The display form change unit changes the display form of the screen displayed to the customer to a display form corresponding to the attributes of the customer among a plurality of predetermined display forms. The monitoring unit has the store clerk face-to-face with the customer monitor the state of the screen displayed to the customer. The re-change instruction receiving unit receives an instruction from the store clerk to change the screen display format back to one of several predetermined display formats after the display format change unit has changed the display format of the screen displayed to the customer. The display format re-change unit changes the display format of the screen displayed to the customer back based on the instruction received by the re-change instruction receiving unit.

Brief Description of the Drawings

[0006] [Figure 1]Figure 1 is an external perspective view showing an example of a self-service POS terminal according to the first embodiment. [Figure 2] Figure 2 is a hardware block diagram showing an example of the hardware configuration of a self-service POS terminal according to the first embodiment. [Figure 3] Figure 3 shows an example of the data structure of a product master. [Figure 4] Figure 4 shows an example of the data structure of a screen master. [Figure 5] Figure 5 shows an example of the information acquired by the self-service POS terminal of the first embodiment to estimate customer attributes, the attributes to be estimated, and the display format of the screen that changes according to the estimated attributes. [Figure 6] Figure 6 shows an example of the default screen displayed by a self-service POS terminal. [Figure 7] Figure 7 is the first diagram showing an example of how to change the screen displayed by a self-service POS terminal. [Figure 8] Figure 8 is the second diagram showing an example of how to change the screen displayed by a self-service POS terminal. [Figure 9] Figure 9 is the third figure showing an example of how to change the screen displayed by a self-service POS terminal. [Figure 10] Figure 10 is a functional block diagram showing an example of the functional configuration of a self-service POS terminal according to the first embodiment. [Figure 11] Figure 11 is a flowchart showing an example of the processing flow performed by the self-service POS terminal of the first embodiment. [Figure 12] Figure 12 is a flowchart showing an example of the process flow for estimating customer attributes. [Figure 13] Figure 13 is a block diagram showing an example of the hardware configuration of a face-to-face POS terminal according to the second embodiment. [Figure 14] Figure 14 is a functional block diagram showing an example of the functional configuration of a face-to-face POS terminal in the second embodiment. [Figure 15] Figure 15 is a first flowchart showing an example of the processing flow performed by the face-to-face POS terminal of the second embodiment. [Figure 16] Figure 16 is a second flowchart showing an example of the processing flow performed by the face-to-face POS terminal of the second embodiment. [Figure 17] Figure 17 is a block diagram showing an example of a schematic configuration of a product sales data processing system, which is a modified example of the second embodiment. [Figure 18] Figure 18 is a hardware block diagram showing an example of the hardware configuration of a store server included in a modified product sales data processing system of the second embodiment. [Figure 19] Figure 19 is a functional block diagram showing an example of the functional configuration of a product sales data processing system in a modified version of the second embodiment. [Figure 20] Figure 20 is a flowchart showing an example of the processing flow performed by a self-service POS terminal in a modified product sales data processing system of the second embodiment. [Figure 21] Figure 21 is a flowchart showing an example of the processing flow performed by the store server in a modified product sales data processing system of the second embodiment. [Modes for carrying out the invention]

[0007] The embodiments will be described in detail below with reference to the drawings. However, the invention is not limited to the embodiments described below.

[0008] (First embodiment) A self-service POS terminal 10, which is a first embodiment of this disclosure, will be described using Figure 1.

[0009] The self-service POS terminal 10 allows customers to register the products they wish to purchase in a store, and to perform payment processing for the registered products, all through the customer's own operation. The self-service POS terminal 10 is an example of a product sales data processing device as described in this disclosure.

[0010] (Overview of a self-service POS terminal) Using FIG. 1, the schematic configuration of the self-POS terminal 10 according to the embodiment will be described. FIG. 1 is an external perspective view showing an example of the self-POS terminal of the first embodiment.

[0011] The self-POS terminal 10 includes a main body 15, a first mounting table 16 installed on a side surface of the main body 15, and a second mounting table 17 placed on a side surface of the main body 15 opposite to the side surface where the first mounting table 16 is installed. An input / output device for performing input / output of various information with respect to the self-POS terminal 10 is installed in the main body 15.

[0012] Specifically, the main body 15 includes a display device 21, an operation device 22, a speaker 23, a camera 24, a scanner 25, a card reader / writer 26, a change dispenser 27, a receipt printer 28, and a warning lamp 29.

[0013] The display device 21 is, for example, a liquid crystal panel or an organic EL panel, and displays various screens according to instructions from the control unit 11 (see FIG. 2).

[0014] The operation device 22 is, for example, a touch panel provided laminated on the display surface of the display device 21. The operation device 22 outputs information indicating the position touched by the customer to the control unit 11.

[0015] The speaker 23 transmits information to the customer by voice or sound according to instructions from the control unit 11.

[0016] The camera 24 is installed facing the customer operating the self-POS terminal 10, and captures an image or video including the customer's face. The captured image or video is output to the control unit 11.

[0017] Scanner 25 is a so-called fixed scanner having an imaging window and an imaging unit (not shown) located behind the imaging window. The imaging unit captures a code symbol, such as a barcode, that a customer holds up to the imaging window when registering a product to be purchased. The code symbol has a product code registered in it, which is identification information that uniquely identifies the product. The imaging unit decodes the information registered in the captured code symbol to obtain the product code. The self-service POS terminal 10 obtains the product information of the product held up to scanner 25 by comparing the decoded product code with the product master 122 (see Figure 2) and registers the product.

[0018] The self-service POS terminal 10 may also be equipped with a handheld scanner (not shown) in addition to the scanner 25. The handheld scanner reads the code symbol attached to the product when it is difficult to hold the product up to the scanner 25, such as when the product is heavy or large.

[0019] The card reader / writer 26 reads information necessary for payment processing related to registered goods from card media such as point cards, electronic money cards, and credit cards, such as the bank account from which payments are withdrawn when making credit card payments, or the charged amount on electronic money cards. The card reader / writer 26 also reads and writes information to card media such as credit cards and prepaid or postpaid electronic money cards. For example, the card reader / writer 26 reads information used for credit card payments and electronic payments and outputs it to the control unit 11. The card reader / writer 26 also receives instructions from the control unit 11 and adds points corresponding to the purchase amount to the points recorded on the point card.

[0020] The change machine 27 accepts banknotes or coins inserted by a customer as payment for goods when the customer chooses to pay with cash. The change machine 27 dispenses change in banknotes or coins, calculated by subtracting the total amount of the inserted banknotes or coins from the total amount of the goods. The change machine 27 includes a banknote slot 271 for inserting banknotes, a banknote outlet 272 for dispensing banknotes as change, a coin slot 273 for inserting coins, and a coin outlet 274 for dispensing coins as change.

[0021] The receipt printer 28 prints the result of the payment processing onto a receipt and issues it from the receipt issuing slot 281.

[0022] The warning light 29 is composed of, for example, a red LED and lights up or flashes when a malfunction occurs in the self-service POS terminal 10 or when it is necessary to call a store employee.

[0023] The first display stand 16 is a stand for placing products before registration.

[0024] The second display stand 17 is a stand for placing products whose identification information has been read by the scanner 25. Above the first display stand, there is a hook 19 for hanging a store-provided shopping basket or reusable bag to hold the products whose identification information has been read.

[0025] (Hardware configuration of self-service POS terminals) The hardware configuration of the self-service POS terminal 10 according to the embodiment will be explained using Figure 2. Figure 2 is a hardware block diagram showing an example of the hardware configuration of the self-service POS terminal of the first embodiment.

[0026] The self-service POS terminal 10 has a configuration in which a control unit 11, a storage unit 12, a peripheral device controller 13, and a communication interface 14 are connected to each other by an internal bus.

[0027] The control unit 11 controls the overall operation of the self-service POS terminal 10. The control unit 11 comprises a CPU (Central Processing Unit) 111, a ROM (Read Only Memory) 112, and a RAM (Random Access Memory) 113. The CPU 111 connects to the ROM 112 and the RAM 113 via internal buses such as an address bus and a data bus. The CPU 111 loads various programs stored in the ROM 112 and the memory unit 12 into the RAM 113. The CPU 111 controls the operation of the self-service POS terminal 10 by operating according to the various programs loaded into the RAM 113. In other words, the control unit 11 has the configuration of a typical computer.

[0028] The storage unit 12 is a storage device such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive). Alternatively, the storage unit 12 may be a non-volatile memory such as flash memory that retains stored information even when the power is turned off. The storage unit 12 stores the control program 121, the product master 122, the member master 123, the screen master 124, and the product registration file 125.

[0029] The control program 121 is a program that controls the overall operation of the self-service POS terminal 10. The control program 121 may be provided stored in the memory unit 12, or it may be provided as an installable or executable file recorded on a computer-readable non-temporary recording medium such as a CD-ROM, flexible disk (FD), CD-R, or DVD. The control program 121 may also be provided by storing it on a computer connected to a network and downloading it via the network. Furthermore, the control program 121 may be provided or distributed via a network such as the Internet.

[0030] The product master 122 is a master file that stores product information such as the product name and price of the products to be sold. The product master 122 stores the product name, unit price, additional information, etc., associated with the product code. Since the contents of the product master 122 are updated as needed, the self-service POS terminal 10 obtains the latest product master 122, for example, from the store server via the communication interface 14. The data structure of the product master 122 will be described in detail later (see Figure 3).

[0031] Member Master 123 is a master file that stores the customer's name, date of birth, gender, nationality, mobile device email address, etc., associated with the customer's member ID.

[0032] The screen master 124 is a file that stores master data for various screens that the self-service POS terminal 10 displays on the display device 21. The screen master 124 stores a screen ID that uniquely identifies the screen, along with attribute information of the customer to whom the screen is displayed, screen information which is the design data of the screen, and button information to be displayed on the screen. The data structure of the screen master 124 will be described in detail later (see Figure 4).

[0033] The product registration file 125 is a file that stores product information corresponding to the product code read by the self-service POS terminal 10. The information stored in the product registration file 125 is subject to payment processing.

[0034] The control unit 11 is connected via the peripheral device controller 13 to a display device 21, an operation device 22, a speaker 23, a camera 24, a scanner 25, a card reader / writer 26, a change dispenser 27, a receipt printer 28, and a warning light 29, which perform input and output of various information. The outlines of each input / output device are as described above.

[0035] Furthermore, the control unit 11 communicates with the store server via the communication interface 14. The store server performs tasks such as updating the product master 122 on the self-service POS terminal 10.

[0036] (Data structure of the product master) Figure 3 illustrates the data structure of product master 122. Figure 3 shows an example of the data structure of product master.

[0037] The product master 122 stores product information associated with the product codes of the products handled by the store. Product information includes, for example, the product name, the hiragana spelling of the product name, the unit price, and additional information. The product name field stores the name of the product corresponding to the product code. The hiragana spelling of the product name field stores the hiragana spelling of the product name. The hiragana spelling of the product name is used on the display screen of the self-service POS terminal 10, as described later. The unit price field stores the unit price of the product corresponding to the product code. The additional information field stores additional information about the product corresponding to the product code. For example, the additional information field stores the type of product. If the product is clothing, the additional information field also stores the size, color, design, material, brand, etc. Image data representing the product corresponding to the product code may also be stored in the additional information field. Note that the product master 122 may store information other than the information shown in Figure 3.

[0038] (Data structure of the screen master) Figure 4 will be used to explain the data structure of the screen master 124. Figure 4 is a diagram showing an example of the data structure of a screen master.

[0039] The screen master 124 stores customer attribute information, screen information, and button information, associated with a screen ID that uniquely identifies the screen that the self-service POS terminal 10 displays on the display device 21.

[0040] Customer attribute information is represented by attribute IDs, which are numerical values ​​unique to each customer's characteristics, such as being a child, short, elderly, foreigner, visually impaired, or colorblind. Attribute IDs may represent a single attribute or a combination of multiple attributes (for example, being short and visually impaired).

[0041] Screen information is associated with the screen ID and stores the background pattern, screen title, and on-screen text.

[0042] The background pattern is the background pattern of the screen that the self-service POS terminal 10 displays on the display device 21. The background pattern includes, for example, the background color and information about the lines drawn on the background.

[0043] The screen title is the title information of the screen that the self-service POS terminal 10 displays on the display device 21. The screen title includes, for example, the title name, the title's display position, the title's display size, the title's font, the title's display color, etc.

[0044] The on-screen text refers to information about the characters included in the screen that the self-service POS terminal 10 displays on the display device 21. The on-screen text includes the characters to be displayed, their display position, display size, font, and display color.

[0045] Button information refers to information about various buttons (switches) placed on the screen. Button information associates the screen ID with a button ID that uniquely identifies the button, and stores information such as the button's position, shape, size, name, name display size, name display font, and name display color.

[0046] (Switching screen displays according to customer attributes) Using Figure 5, we will explain the function of the self-service POS terminal 10 of this disclosure that changes the display format of the display screen according to the customer's attributes. Figure 5 is a diagram showing the information acquired by the self-service POS terminal of the first embodiment to estimate the customer's attributes, the attributes to be estimated, and an example of the display format of the screen that is changed according to the estimated attributes.

[0047] The self-service POS terminal 10 obtains information necessary to estimate customer attributes from images and videos, including the customer's face, captured by the camera 24. The self-service POS terminal 10 also obtains information necessary to estimate customer attributes from the settings information of the customer's mobile device, read by the scanner 25. More specifically, the customer displays code information, including membership information, on the screen of their mobile device for the scanner 25 to read. The code information includes a membership code that uniquely identifies the customer, as well as settings information such as font size, font color, and contrast displayed on the customer's mobile device. Furthermore, the self-service POS terminal 10 obtains information necessary to estimate customer attributes from the customer's membership card, read by the card reader / writer 26.

[0048] The self-service POS terminal 10 analyzes images and videos, including the customer's face, captured by the camera 24, to estimate the customer's age group, whether they appear to be a foreigner, the position of their eyes, etc. The estimation method is not limited, but for example, the captured images and videos can be compared with a database accumulated using machine learning or the like.

[0049] If the customer's image or video indicates that the customer is a child or a foreigner, the self-service POS terminal 10 changes the characters displayed on the display device 21 to hiragana. This improves the visibility of the screen.

[0050] If the customer's image or video indicates that their eye level is low, the self-service POS terminal 10 will assume the customer is a wheelchair user or is short in stature and will change the placement of the buttons displayed on the display device 21 to the bottom of the screen. This improves the ease of pressing the buttons.

[0051] If the customer's image or video indicates that the customer is elderly, the self-service POS terminal 10 enlarges the font size on the display device 21. This improves the visibility of the screen.

[0052] Furthermore, if the customer's attributes are not any of the above based on the customer's image or video, the self-service POS terminal 10 displays a screen with a default display format on the display device 21. The default display format is the standard display format before changing the font type, font size, color, etc. The default display format may be set as appropriate by store staff or other personnel.

[0053] The self-service POS terminal 10 estimates that a customer has low vision if the settings information of the customer's mobile device, as read by the scanner 25, indicates that the font size displayed on the mobile device is set to a large size. If it estimates that a customer has low vision, the self-service POS terminal 10 enlarges the font size displayed on the display device 21. This improves the visibility of the screen.

[0054] Furthermore, if the settings information of the customer's mobile device indicates that the text color or contrast displayed on the mobile device has been changed from the default high setting, it is presumed that the customer has color blindness. If it is presumed that the customer has color blindness, the self-POS terminal 10 changes the text color and contrast of the screen displayed on the display device 21 to match the settings information of the mobile device. This improves the visibility of the screen.

[0055] The self-service POS terminal 10 estimates whether the customer is Japanese and their age, etc., from the membership card held by the customer, which is read by the card reader / writer 26.

[0056] If the customer is presumed to be a foreigner based on their membership card, the self-service POS terminal 10 changes the characters displayed on the display device 21 to hiragana. This improves the visibility of the screen.

[0057] If the customer is estimated to be elderly based on their membership card, the self-service POS terminal 10 enlarges the font size on the display device 21. This improves the visibility of the screen.

[0058] The self-service POS terminal 10 can estimate the same customer attributes from different sources. For example, whether a customer is elderly can be estimated from the customer's image or video, as well as from the customer's membership card. The self-service POS terminal 10 may increase the accuracy of the estimation when the same attribute is estimated from different sources. Furthermore, the display format on the screen may be changed only when the accuracy of the estimation exceeds a predetermined value. In addition, if the attributes estimated from the mobile device settings information or membership card registration information are contradictory to the attributes estimated from the customer's image or video, the attributes estimated from the mobile device settings information or membership card registration information, which were registered by the customer themselves, may be deemed more reliable than the attributes estimated from the customer's image or video.

[0059] Furthermore, if the self-service POS terminal 10 is estimated to have two or more different attributes, it may simultaneously change two or more display formats. For example, if the customer is estimated to be a short elderly person, the self-service POS terminal 10 may enlarge the font size on the screen displayed on the display device 21 and place buttons at the bottom of the screen.

[0060] It should be noted that Figure 5 shows only one example of customer attributes, and the attributes that the self-service POS terminal 10 can estimate are not limited to the example shown in Figure 5. Furthermore, the relationship between customer attributes and the screen display format corresponding to those attributes is not limited to the example in Figure 5. For example, if a customer's attribute is estimated to be that of a foreigner, the screen may display in English or a mix of English and hiragana. Moreover, multiple different display formats may be combined for a single customer attribute. For example, if a customer's attribute is that of a child, the screen display format may be in hiragana, and the buttons may be placed at the bottom of the screen.

[0061] (Example of display format change) Figures 6 to 9 illustrate examples of how to change the display format of the screen that the self-service POS terminal 10 displays on the display device 21. Figure 6 is a diagram showing an example of the default screen displayed by the self-service POS terminal. Figure 7 is the first diagram showing an example of how to change the screen displayed by the self-service POS terminal. Figure 8 is the second diagram showing an example of how to change the screen displayed by the self-service POS terminal. Figure 9 is the third diagram showing an example of how to change the screen displayed by the self-service POS terminal.

[0062] Figure 6 shows an example of the payment method selection screen displayed on the display device 21. In particular, Figure 6 shows the default screen 30 with no changes made to the display format.

[0063] The default screen 30 shown in Figure 6 is an example of a payment method selection screen displayed when a customer selects a payment method at a self-service POS terminal 10, also known as a self-checkout register.

[0064] The default screen 30 includes a screen name 41, operation guidance 42, and operation buttons: a cash payment button 43, a credit card payment button 44, an electronic money payment button 45, a code payment button 46, a points payment button 47, a gift certificate payment button 48, and a scroll button 49.

[0065] The screen name 41 represents the name of the function implemented by the screen shown by the default screen 30. The screen shown in Figure 6 is a screen that implements the self-checkout function, so the screen name 41 is displayed as "Self-Checkout".

[0066] Operation guidance 42 is text that indicates the actions to be performed by the customer on the default screen 30.

[0067] The cash payment button 43 is an operator that customers press when making a cash payment.

[0068] The credit card payment button 44 is the operator that customers press when making a credit card payment. Credit card payment is a payment method that uses the customer's own credit card.

[0069] The electronic money payment button 45 is an operator that customers press when making an electronic money payment. Electronic money payment is a payment method in which payment is made using electronic money charged to an IC card, for example.

[0070] The code payment button 46 is the operator that customers press when making a code payment. A code payment is a payment method in which a payment is made, for example, using a payment app pre-installed on a mobile device that the customer possesses.

[0071] The points payment button 47 is the operator that customers press when paying with points. Points payment is a payment method in which points, for example, awarded based on the amount of purchase at a store, are used to pay for goods.

[0072] The gift certificate payment button 48 is the button that customers press when making a payment using a gift certificate.

[0073] The scroll button 49 is used to scroll the control buttons up and down when not all control buttons can be displayed in the area where the control buttons are shown. In the example in Figure 6, all control buttons are displayed on the screen, so the scroll button 49 is disabled. An example where the scroll button 49 is enabled will be described later (see Figure 9).

[0074] The default screen 30 also includes the number of items 50, the total amount 51, a staff call button 52, and a back button 53.

[0075] The item count of 50 indicates the total number of items purchased by the customer.

[0076] The total amount of 51 indicates the total price of the items purchased by the customer.

[0077] The staff call button 52 is an operator to be pressed when assistance from a staff member is needed. When the staff call button 52 is pressed, the self-service POS terminal 10 illuminates or flashes the warning light 29. Upon noticing the illuminated or flashing warning light 29, a staff member approaches the customer, inquires about the situation, and takes the necessary action.

[0078] The back button 53 is an operator that returns to the screen that was displayed before transitioning to the current display screen. When the back button 53 is pressed, the self-service POS terminal 10 displays the screen that was displayed before transitioning to the current display screen.

[0079] If the customer's attributes are estimated to be "low-set eyes," the self-service POS terminal 10 displays the button-bottom layout screen 31 shown in Figure 7 on the display device 21. The information displayed on the button-bottom layout screen 31 is the same as the information displayed on the default screen 30.

[0080] The button-bottom-arranged screen 31 is a screen in which the controls displayed on the default screen 30 are placed at the bottom of the screen. In the button-bottom-arranged screen 31, the number of items 50 and the total amount 51 are moved to the top of the screen as the placement of the controls is changed.

[0081] For customers with lower eye levels, such as short customers or those using wheelchairs, the controls are positioned at the bottom of the screen, making button operation easier.

[0082] If the customer's attributes are estimated to be "child" or "foreigner," the self-service POS terminal 10 displays the hiragana-based screen 32 shown in Figure 8 on the display device 21. The information displayed on the hiragana-based screen 32 is the same as the information displayed on the default screen 30.

[0083] The Hiragana display screen 32 is a screen where all the characters displayed on the default screen 30 have been changed to Hiragana. The layout of the Hiragana display screen 32 is the same as that of the default screen 30.

[0084] Children and foreigners will find it easier to understand the content on the screen because the text is written in hiragana.

[0085] If the customer's attributes are estimated to be "elderly" or "visually impaired," the self-service POS terminal 10 displays the enlarged display screen 33 shown in Figure 9 on the display device 21. The enlarged display screen 33 displays the information that was displayed on the default screen 30 in a larger size.

[0086] In the enlarged display screen 33, since the information is displayed in an enlarged format, if it becomes impossible to display all the information that was displayed on the default screen 30 on a single screen, the information may be displayed across multiple screens. For example, in the enlarged display screen 33 shown in Figure 9, the number of payment method selection controls displayed on a single screen is reduced to three. Controls that cannot be displayed on a single screen can be displayed by operating the scroll button 49. In the example in Figure 9, the scroll button 49, which scrolls the controls downwards, becomes active. When the scroll button 49 is pressed, the currently displayed cash payment button 43, credit payment button 44, and electronic money payment button 45 are replaced by the code payment button 46, point payment button 47, and gift certificate payment button 48. Alternatively, when the scroll button 49 is pressed, the credit payment button 44 and electronic money payment button 45 may move one position to the left, and the code payment button 46 may be displayed in the empty space. Of course, in the enlarged display screen 33, the enlarged display may be performed on a single screen as much as possible without using multiple screens.

[0087] Note that in the enlarged display screen 33, the staff call button 52 and the back button 53 are not enlarged. This is because, due to the limited screen area, only the main controls on that screen were enlarged. In other words, all information displayed on the screen may be enlarged, or only some of it may be enlarged. If only some information is enlarged, for example, on the payment method selection screen, only the controls that are frequently used by the customer may be enlarged. Alternatively, only the main controls and the operation guidance 42 may be enlarged.

[0088] The display configurations provided by the self-service POS terminal 10 are not limited to the button-bottom screen 31, the hiragana display screen 32, and the enlarged display screen 33. If the customer's attribute is estimated to be "color blind," the self-service POS terminal 10 may change the default screen 30 to a screen with altered text color and contrast. Furthermore, if multiple attributes are estimated, such as "a child with low-set eyes," the self-service POS terminal 10 may change the screen configuration to one that combines the features of the button-bottom screen 31 and the hiragana display screen 32.

[0089] In this explanation, we used the payment method selection screen as an example to illustrate how to change the display format of a screen. However, the same method of changing the display format can also be applied to other screens, such as the registration details screen that shows the results of product registration. This allows the product information of registered products to be displayed in a format that suits the customer's attributes, making it easier for customers to confirm their registration details.

[0090] (Functional configuration of self-service POS terminals) The functional configuration of the self-service POS terminal 10 of the first embodiment will be explained using Figure 10. Figure 10 is a functional block diagram showing an example of the functional configuration of the self-service POS terminal of the first embodiment.

[0091] The control unit 11 of the self-service POS terminal 10 deploys the control program 121 to the RAM 113 and operates it, thereby realizing the attribute estimation unit 61, the display format change unit 62, the product registration unit 63, the payment processing unit 64, the receipt issuing unit 65, the display control unit 66, and the operation control unit 67 as functional units, as shown in Figure 10. Some or all of these functional units may be realized by dedicated hardware.

[0092] The attribute estimation unit 61 estimates the customer's attributes based on information relating to the customer. More specifically, the attribute estimation unit 61 estimates the customer's attributes based on information obtained from images and videos including the customer's face, the customer's mobile device settings, the customer's membership card, etc.

[0093] The display format change unit 62 changes the display format of the screen shown to the customer to a display format that is appropriate to the customer's attributes from among a predetermined number of display formats.

[0094] The product registration unit 63 performs a product registration process that generates a product registration file 125 containing product information related to the product purchased by the customer.

[0095] The payment processing unit 64 performs a payment process to pay the amount related to the product registration file 125 generated by the product registration unit 63 using the payment method selected by the customer.

[0096] The receipt issuing unit 65 prints the result of the payment processing onto a receipt and issues it.

[0097] The display control unit 66 controls the screen to be displayed on the display device 21 according to instructions from the control unit 11.

[0098] The operation control unit 67 outputs the operation information acquired by the operation device 22 to the control unit 11.

[0099] (Process flow of a self-service POS terminal) The processing flow of the self-service POS terminal 10 will be explained using Figure 11. Figure 11 is a flowchart showing an example of the processing flow of the self-service POS terminal in the first embodiment.

[0100] The attribute estimation unit 61 reads code information, which includes the customer's membership information and the settings information of the mobile device, displayed on the customer's mobile device. Alternatively, the attribute estimation unit 61 reads membership information recorded on the customer's membership card (step S11).

[0101] Furthermore, the attribute estimation unit 61 captures images and videos, including the customer's face, using the camera 24 (step S12).

[0102] The attribute estimation unit 61 estimates the customer's attributes based on the information obtained in steps S11 and S12. Then, the attribute estimation unit 61 decides how to change the display format of the screen to be displayed on the display device 21 (step S13). The flow of processing performed by the attribute estimation unit 61 in step S13 is explained in detail in Figure 12.

[0103] The display mode changing unit 62 changes the display mode of the screen to be displayed on the display device 21 to the display mode determined in step S13 (step S14).

[0104] The product registration unit 63 determines whether the product has been scanned by the scanner 25 (step S15). If it is determined that the product has been scanned (step S15: Yes), the process proceeds to step S16. On the other hand, if it is not determined that the product has been scanned (step S15: No), step S15 is repeated.

[0105] In step S15, if it is determined that the product has been scanned, the product registration unit 63 performs a product registration process to register the scanned product (step S16).

[0106] Next, the product registration unit 63 instructs the display control unit 66 to display the product information of the registered product on the display device 21 (step S17).

[0107] The operation control unit 67 determines whether the payment button (not shown) displayed on the display device 21 has been pressed (step S18). If it is determined that the payment button has been pressed (step S18: Yes), the process proceeds to step S19. On the other hand, if it is not determined that the payment button has been pressed (step S18: No), the process returns to step S15. The payment button is pressed by the customer after they have finished scanning all items to signal the start of payment.

[0108] In step S18, if it is determined that the payment button has been pressed, the payment processing unit 64 displays the payment method selection screen on the display device 21 (step S19). The payment method selection screen is, for example, the screen illustrated in Figures 6 to 9.

[0109] The operation control unit 67 determines whether a payment method has been selected on the payment method selection screen (step S20). If it is determined that a payment method has been selected (step S20: Yes), the process proceeds to step S21. On the other hand, if it is not determined that a payment method has been selected (step S20: No), the process repeats step S20.

[0110] In step S20, if it is determined that a payment method has been selected, the settlement processing unit 64 performs settlement processing according to the selected payment method (step S21).

[0111] The settlement processing unit 64 determines whether the settlement process has been completed (step S22). If it is determined that the settlement process has been completed (step S22: Yes), the process proceeds to step S23. On the other hand, if it is determined that the settlement process has not been completed (step S22: No), the process repeats step S22.

[0112] In step S22, if it is determined that the payment process is complete, the receipt issuing unit 65 prints the payment details on the receipt printer 28 and issues a receipt (step S23). After that, the self-service POS terminal 10 terminates the process shown in Figure 11.

[0113] (Attribute estimation process flow) Using Figure 12, we will explain the process by which the self-service POS terminal 10 estimates customer attributes, that is, the process performed in step S13 of Figure 11. Figure 12 is a flowchart showing an example of the process flow for estimating customer attributes.

[0114] The display mode changing unit 62 sets the display mode of the screen to be displayed on the display device 21 to the default display mode (step S31). The default display mode is, for example, the display mode shown in Figure 6.

[0115] The attribute estimation unit 61 determines whether it has read the customer's membership card (step S32). If it is determined that it has read the customer's membership card (step S32: Yes), it proceeds to step S33. On the other hand, if it is not determined that it has read the customer's membership card (step S32: No), it proceeds to step S35.

[0116] In step S32, if it is determined that the customer's membership card has been read, the attribute estimation unit 61 determines whether the customer's nationality is Japanese (step S33). If it is determined that the customer's nationality is Japanese (step S33: Yes), the process proceeds to step S34. On the other hand, if it is not determined that the customer's nationality is Japanese (step S33: No), the process proceeds to step S35.

[0117] In step S33, if it is determined that the customer's nationality is Japanese, the display format change unit 62 sets the format of the screen displayed on the display device 21 to the hiragana display screen 32 (step S34). Then, the process proceeds to step S35.

[0118] If it is not determined in step S32 that the customer's membership card has been read, or if it is not determined in step S33 that the customer's nationality is Japanese, or if, following step S34, the attribute estimation unit 61 determines whether it has read the settings information of the customer's mobile device (step S35). If it is determined that the settings information of the customer's mobile device has been read (step S35: Yes), the process proceeds to step S36. On the other hand, if it is not determined that the settings information of the customer's mobile device has been read (step S35: No), the process proceeds to step S40.

[0119] In step S35, if it is determined that the settings information of the customer's mobile device has been read, the attribute estimation unit 61 determines whether the font size is set to large on the customer's mobile device (step S36). If it is determined that the font size is set to large on the customer's mobile device (step S36: Yes), the process proceeds to step S37. On the other hand, if it is not determined that the font size is set to large on the customer's mobile device (step S36: No), the process proceeds to step S38.

[0120] In step S36, if it is determined that the font size is set to large on the customer's mobile device, the display format change unit 62 sets the screen format displayed on the display device 21 to the enlarged display screen 33 (step S37). Then, the process proceeds to step S40.

[0121] On the other hand, if it is not determined in step S36 that the font size is set to large on the customer's mobile device, the attribute estimation unit 61 determines from the settings information of the customer's mobile device whether it is estimated that the customer has a color blindness (step S38). If it is estimated that the customer has a color blindness (step S38: Yes), the process proceeds to step S39. On the other hand, if it is not estimated that the customer has a color blindness (step S38: No), the process proceeds to step S40.

[0122] In step S38, if it is estimated that the customer has a color blindness, the display mode changing unit 62 sets the screen mode displayed on the display device 21 to a character color / contrast changing screen (not shown) (step S39). Then, the process proceeds to step S40.

[0123] Following step S37 or step S39, the attribute estimation unit 61 detects the customer's eye position from the images and videos, including the customer's face, captured by the camera 24 (step S40).

[0124] The attribute estimation unit 61 determines whether the customer's eye position detected in step S40 is low, that is, lower than a predetermined position on the captured screen (step S41). If it is determined that the customer's eye position is low (step S41: Yes), the process proceeds to step S42. On the other hand, if it is not determined that the customer's eye position is low (step S41: No), the process proceeds to step S43.

[0125] In step S41, if it is determined that the customer's eye position is low, the display format change unit 62 sets the format of the screen displayed on the display device 21 to the button-bottom-displayed screen 31 (step S42). Then, the process proceeds to step S43.

[0126] If it is not determined in step S41 that the customer's eye position is low, or if, following step S42, the attribute estimation unit 61 determines from the image or video including the customer's face whether the customer is a foreigner or a child (step S43). If it is determined that the customer is a foreigner or a child (step S43: Yes), the process proceeds to step S44. On the other hand, if it is not determined that the customer is a foreigner or a child (step S43: No), the process proceeds to step S45.

[0127] In step S43, if it is determined that the customer is a foreigner or a child, the display format change unit 62 sets the format of the screen displayed on the display device 21 to the hiragana display screen 32 (step S44). Then, the process proceeds to step S45.

[0128] If, in step S43, the customer is not determined to be a foreigner or a child, or following step S44, the attribute estimation unit 61 determines whether the customer is elderly based on images or videos including the customer's face (step S45). If the customer is determined to be elderly (step S45: Yes), the process proceeds to step S46. On the other hand, if the customer is not determined to be elderly (step S45: No), the self-service POS terminal 10 terminates the process shown in Figure 12 and proceeds to step S14 in Figure 11.

[0129] In step S45, if it is determined that the customer is elderly, the display format change unit 62 sets the format of the screen displayed on the display device 21 to the enlarged display screen 33 (step S46). After that, the self-service POS terminal 10 completes the process shown in Figure 12 and proceeds to step S14 in Figure 11.

[0130] In Figure 12, the self-service POS terminal 10 estimates customer attributes using various pieces of information, but the order of estimation is not limited to the example in Figure 12.

[0131] (Effects of the first embodiment) As described above, the self-service POS terminal 10 (product sales data processing device) of the first embodiment includes an attribute estimation unit 61 that estimates the customer's attributes based on information relating to the customer, and a display format changing unit 62 that changes the display format of the screen displayed to the customer to a display format that corresponds to the customer's attributes from among a predetermined number of display formats. Therefore, it is possible to display a screen with a display format that corresponds to the customer. This improves the operability of the self-service POS terminal 10, and thus reduces the time customers have to wait in line for the self-service POS terminal 10 in stores.

[0132] Furthermore, in the self-service POS terminal 10 (product sales data processing device) of the first embodiment, the attribute estimation unit 61 estimates the customer's attributes based on setting information related to the screen display of the mobile terminal held by the customer, registration information on the membership card, or an image including the customer's face. Therefore, customer attributes related to the screen display format can be easily and reliably obtained.

[0133] (Second embodiment) Next, with reference to the drawings, a second embodiment of the present disclosure, a face-to-face POS terminal 70, will be described.

[0134] Unlike the self-service POS terminal 10 described in the first embodiment, the face-to-face POS terminal 70 allows the store clerk and customer to interact face-to-face, and the clerk and customer collaborate to register and process the purchase of the customer's items. The face-to-face POS terminal 70 is an example of a product sales data processing device in this disclosure.

[0135] (Hardware configuration of face-to-face POS terminals) The hardware configuration of the face-to-face POS terminal 70 according to the embodiment will be explained using Figure 13. Figure 13 is a block diagram showing an example of the hardware configuration of the face-to-face POS terminal according to the second embodiment.

[0136] The face-to-face POS terminal 70 has a configuration in which a control unit 71, a storage unit 72, a peripheral device controller 73, and a communication interface 74 are connected to each other by an internal bus.

[0137] The control unit 71 controls the overall operation of the face-to-face POS terminal 70. The control unit 71 comprises a CPU 711, a ROM 712, and a RAM 713. The CPU 711 connects to the ROM 712 and the RAM 713 via internal buses such as an address bus and a data bus. The CPU 711 loads various programs stored in the ROM 712 and the memory unit 72 into the RAM 713. The CPU 711 controls the operation of the face-to-face POS terminal 70 by operating according to the various programs loaded into the RAM 713. In other words, the control unit 71 has the configuration of a typical computer.

[0138] The storage unit 72 is a storage device such as an HDD or SSD. Alternatively, the storage unit 72 may be a non-volatile memory such as flash memory that retains stored information even when the power is turned off. The storage unit 72 stores the control program 721, the product master 722, the member master 723, the screen master 724, and the product registration file 725.

[0139] The control program 721 is a program that controls the overall operation of the face-to-face POS terminal 70. The control program 721 may be provided stored in the memory unit 12, or it may be provided as an installable or executable file recorded on a computer-readable non-temporary recording medium such as a CD-ROM, flexible disk (FD), CD-R, or DVD. The control program 721 may also be provided by storing it on a computer connected to a network and downloading it via the network. Furthermore, the control program 721 may be provided or distributed via a network such as the Internet.

[0140] Product master 722 is the same as product master 122 described in the first embodiment.

[0141] The member master 723 is the same as the member master 123 described in the first embodiment.

[0142] The screen master 724 is the same as the screen master 124 described in the first embodiment.

[0143] Product registration file 725 is the same as product registration file 125 described in the first embodiment.

[0144] The control unit 71 is connected via the peripheral device controller 73 to the following devices for inputting and outputting various information: a staff-side display device 81, a staff-side operation device 82, a staff-side speaker 83, a customer-side display device 84, a customer-side operation device 85, a customer-side speaker 86, a camera 87, a scanner 88, a card reader / writer 89, a change dispenser 90, and a receipt printer 91.

[0145] The employee-side display device 81 is, for example, an LCD panel or an OLED panel, and displays various screens to the employee according to instructions from the control unit 71.

[0146] The employee-side operating device 82 is, for example, a touch panel mounted on the display surface of the employee-side display device 81. The employee-side operating device 82 outputs information indicating the location touched by the employee to the control unit 71.

[0147] The store employee's speaker 83 transmits information to the store employee via voice or sound in response to instructions from the control unit 71.

[0148] The customer-side display device 84 is, for example, an LCD panel or an OLED panel, and displays various screens to the customer according to the instructions of the control unit 71.

[0149] The customer-side operating device 85 is, for example, a touch panel mounted on the display surface of the customer-side display device 84. The customer-side display device 84 outputs information indicating the location touched by the customer to the control unit 71. The customer inputs age verification information when purchasing age-restricted products via the customer-side operating device 85. The customer may also select a payment method via the customer-side operating device 85.

[0150] The customer-side speaker 86 transmits information to the customer via voice or sound in response to instructions from the control unit 71.

[0151] Camera 87 is positioned facing the customers and captures images and videos, including their faces. The captured images and videos are output to the control unit 71.

[0152] Scanner 88 is the same fixed scanner as scanner 25 described in the first embodiment. The store clerk holds the product the customer is purchasing over scanner 88 to read the information registered in the code symbol attached to the product. The face-to-face POS terminal 70 decodes the information read by scanner 88 to obtain the product code. Then, the face-to-face POS terminal 70 compares the obtained product code with the product master 722 to obtain the product information of the product held over scanner 88 and registers the product.

[0153] The face-to-face POS terminal 70 may be equipped with a handheld scanner (not shown) in addition to the scanner 88. The handheld scanner reads the code symbol attached to the product when it is difficult to hold the product up to the scanner 88, such as when the product is heavy or large.

[0154] The card reader / writer 89 is the same as the card reader / writer 26 described in the first embodiment.

[0155] The change dispenser 90 is the same as the change dispenser 27 described in the first embodiment.

[0156] The receipt printer 91 is the same as the receipt printer 28 described in the first embodiment.

[0157] Furthermore, the control unit 71 communicates with the store server via the communication interface 74. The store server performs tasks such as updating the product master 722 on the face-to-face POS terminal 70. The configuration of the face-to-face POS terminal 70 may be such that, for example, only a display device is on the customer side, and all basic operations are performed by the store staff. Alternatively, it may be a so-called face-to-face self-service POS terminal where the store staff registers the products, but the customer handles the payment. In this case, the change dispenser and receipt printer are located on the customer side.

[0158] (Functional configuration of a face-to-face POS terminal) The functional configuration of the face-to-face POS terminal 70 according to the embodiment will be explained using Figure 14. Figure 14 is a functional block diagram showing an example of the functional configuration of the face-to-face POS terminal of the second embodiment.

[0159] The control unit 71 of the face-to-face POS terminal 70 deploys the control program 721 to the RAM 713 and operates it, thereby realizing the following functional units as shown in Figure 14: the attribute estimation unit 61, the display format change unit 62, the customer-side display screen monitoring unit 37, the display format re-change instruction reception unit 38, the display format re-change unit 39, the product registration unit 63, the payment processing unit 64, the receipt issuing unit 65, the display control unit 66, and the operation control unit 67. Some or all of these functional units may be realized by dedicated hardware.

[0160] The functions of the attribute estimation unit 61, the display format change unit 62, the product registration unit 63, the payment processing unit 64, the receipt issuing unit 65, the display control unit 66, and the operation control unit 67 are as described in the first embodiment, so a further explanation will be omitted.

[0161] The customer-side display screen monitoring unit 37 causes the store clerk to monitor the state of the screen displayed on the customer-side display device 84. Specifically, the customer-side display screen monitoring unit 37 displays the screen displayed on the customer-side display device 84 on a portion of the store clerk-side display device 81. The screen displayed on a portion of the store clerk-side display device 81 may be a scaled-down copy of the screen displayed on the customer-side display device 84, or it may be simplified to the extent that the display format of the screen displayed on the customer-side display device 84 is recognizable. Alternatively, the customer-side display screen monitoring unit 37 may display the display format of the screen displayed on the customer-side display device 84 as text information on a portion of the store clerk-side display device 81. The store clerk monitors this screen and the state of the customer viewing it. If the store clerk observes unnatural behavior from the customer after the display format change unit 62 has changed the display format of the screen, the store clerk determines that the change in the display format made by the display format change unit 62 is not appropriate and instructs the control unit 71 to change the display format of the screen again. Unnatural customer behavior includes, for example, delays in operations when customer interaction is required, or head tilting. Unnatural customer behavior can also be described as behavior that suggests the customer is confused by a change in the display format. The customer-side display screen monitoring unit 37 is an example of a monitoring unit in this disclosure.

[0162] The display format re-change instruction receiving unit 38 receives an instruction from a store employee to change the display format of the screen to one of a predetermined set of display formats after the display format change unit 62 has changed the display format of the screen displayed on the customer-side display device 84. The display format re-change instruction receiving unit 38 is an example of a re-change instruction receiving unit in this disclosure. The display format re-change instruction receiving unit 38 also receives an instruction to change the display format when a store employee facing a customer presses a display format re-change button (not shown) displayed on the employee-side display device 81.

[0163] The display format re-change unit 39 changes the display format of the screen displayed on the customer-side display device 84 based on the instructions received by the display format re-change instruction receiving unit 38. The display format re-change unit 39 may also revert the screen format displayed on the employee-side display device 81 back to the format before the display format change unit 62 changed it, or the employee may press a button to select a display format (for example, a button to select the default screen 30, button-bottom-arranged screen 31, hiragana display screen 32, enlarged display screen 33, etc.) displayed on the employee-side display device 81 after pressing the display format re-change button, thereby instructing the employee to select the new screen format.

[0164] (Process flow of a face-to-face POS terminal) Figures 15 and 16 will be used to explain the processing flow of the face-to-face POS terminal 70. Figure 15 is a first flowchart showing an example of the processing flow of the product sales data processing device of the second embodiment. Figure 16 is a second flowchart showing an example of the processing flow of the face-to-face POS terminal of the second embodiment.

[0165] The attribute estimation unit 61 reads code information, which includes the customer's membership information and the settings information of the mobile device, displayed on the customer's mobile device. Alternatively, the attribute estimation unit 61 reads membership information recorded on the customer's membership card (step S51).

[0166] Furthermore, the attribute estimation unit 61 captures images and videos, including the customer's face, using the camera 24 (step S52).

[0167] The attribute estimation unit 61 estimates the customer's attributes based on the information obtained in steps S51 and S52. Then, the attribute estimation unit 61 decides how to change the display format of the screen to be displayed on the customer-side display device 84 (step S53). The flow of processing performed by the attribute estimation unit 61 in step S53 is as shown in Figure 12.

[0168] The display format changing unit 62 changes the display format of the screen to be displayed on the customer-side display device 84 to the display format determined in step S53 (step S54).

[0169] The product registration unit 63 determines whether the product has been scanned by the scanner 88 (step S55). If it is determined that the product has been scanned (step S55: Yes), the process proceeds to step S56. On the other hand, if it is determined that the product has not been scanned (step S55: No), the process repeats step S55.

[0170] In step S55, if it is determined that the product has been scanned, the product registration unit 63 performs a product registration process to register the scanned product (step S56).

[0171] Next, the product registration unit 63 instructs the display control unit 66 to display the product information of the registered product on the employee-side display device 81 and the customer-side display device 84 (step S57).

[0172] The operation control unit 67 determines whether the payment button (not shown) displayed on the employee-side display device 81 has been pressed (step S58). If it is determined that the payment button has been pressed (step S58: Yes), the process proceeds to step S59. On the other hand, if it is not determined that the payment button has been pressed (step S58: No), the process returns to step S55. The payment button is pressed by the employee to signal the start of payment after they have finished scanning all the items brought in by the customer.

[0173] In step S58, if it is determined that the payment button has been pressed, the payment processing unit 64 displays a payment method selection screen on the customer-side display device 84 (step S59). The payment method selection screen is, for example, one of the screens illustrated in Figures 6 to 9.

[0174] The operation control unit 67 determines whether the customer has selected a payment method on the payment method selection screen (step S60). If it is determined that the customer has selected a payment method (step S60: Yes), the process proceeds to step S61. On the other hand, if it is not determined that the customer has selected a payment method (step S60: No), the process repeats step S60.

[0175] In step S60, if it is determined that the customer has selected a payment method, the settlement processing unit 64 performs settlement processing according to the selected payment method (step S61).

[0176] The settlement processing unit 64 determines whether the settlement process has been completed (step S62). If it is determined that the settlement process has been completed (step S62: Yes), the process proceeds to step S63. On the other hand, if it is determined that the settlement process has not been completed (step S62: No), the process repeats step S62.

[0177] In step S62, if it is determined that the payment process is complete, the receipt issuing unit 65 prints the payment details on the receipt printer 28 and issues a receipt (step S63). After that, the face-to-face POS terminal 70 terminates the process shown in Figure 15.

[0178] Figure 16 is a flowchart illustrating an example of an interrupt process, which is executed when a predetermined condition is met while the face-to-face POS terminal 70 is performing the process shown in Figure 15. The customer-side display screen monitoring unit 37 performs the process shown in Figure 16 when a predetermined condition is met, for example, when the display format of the customer-side display device 84 is changed. That is, the screen displayed on the customer-side display device 84 is displayed on a part of the employee-side display device 81, and when the employee instructs the display format to be changed again, the display format of the customer-side display device 84 is changed again. The process flow shown in Figure 16 will be explained below.

[0179] The customer-side display screen monitoring unit 37 displays the status of the screen shown on the customer-side display device 84 on a portion of the employee-side display device 81 (step S71).

[0180] The display format change instruction receiving unit 38 determines whether the store clerk has given an instruction to change the display format of the customer-side display device 84 (step S72). If it is determined that there is an instruction to change the display format of the customer-side display device 84 (step S72: Yes), the process proceeds to step S73. On the other hand, if it is not determined that there is an instruction to change the display format of the customer-side display device 84 (step S72: No), the face-to-face POS terminal 70 terminates the interrupt processing shown in Figure 16 and continues the processing shown in the flowchart in Figure 15. The display format change instruction receiving unit 38 determines that there is an instruction to change the display format of the customer-side display device 84 on the condition that the store clerk has pressed a display format change button (not shown) displayed on the store clerk-side display device 81.

[0181] In step S72, if it is determined that there is an instruction to change the display format of the customer-side display device 84 again, the display format change unit 39 obtains the changed display format selected by the store clerk (step S73).

[0182] The display mode re-change unit 39 re-changes the display mode of the customer-side display device 84 (step S74). After that, the face-to-face POS terminal 70 finishes the interrupt processing in Figure 16 and continues the processing in the flowchart in Figure 15. Here, it has been explained that the processing in Figure 16 is performed when the display mode of the customer-side display device 84 is changed, but for example, the processing in Figure 15 may be interrupted and the processing in Figure 16 performed at predetermined intervals. In this case, even if the display mode of the customer-side display device 84 is not changed, the store clerk can change the display mode of the customer-side display device 84 when they notice unusual behavior from the customer.

[0183] In this example, we have described how to change the display format of the customer-side display device 84, but similarly, the display format of the employee-side display device 81 may be changed according to the employee's attributes. In that case, the attribute estimation unit 61 may, for example, read code information including the employee's attributes displayed on the employee's nameplate at the start of work, and change the display format of the employee-side display device 81 according to the read attributes.

[0184] (Effects of the second embodiment) As described above, the face-to-face POS terminal 70 (product sales data processing device) of the second embodiment includes a customer-side display screen monitoring unit 37 (monitoring unit) that allows a store clerk facing the customer to monitor the state of the screen displayed to the customer, a display format change instruction receiving unit 38 (re-change instruction receiving unit) that receives an instruction from the store clerk to change the display format of the screen back to one of a predetermined set of display formats after the display format change unit 62 has changed the display format of the screen displayed to the customer, and a display format change unit 39 that changes the display format of the screen displayed to the customer back based on the instruction received by the display format change instruction receiving unit 38.Therefore, it is possible to display a screen with a display format that suits the customer.In addition, if the display format of the screen does not suit the customer's preference, the display format can be changed back at the instruction of the store clerk, so that a screen with a display format that is more suitable for the customer's attributes can be displayed. In this example, we have described a scenario where, when the display format of the customer-side display device 84 is changed, the store clerk notices the customer's unusual behavior and instructs the clerk to change the display format again. However, even if the display format of the customer-side display device 84 is not changed, the clerk may change the display format of the customer-side display device 84 if they notice the customer's unusual behavior.

[0185] (Modified version of the second embodiment) In the second embodiment, an example was described in which the display format is changed again at the instruction of a store employee if the display format does not suit the customer's preference. However, the instruction to change the format may be given without the operation of a store employee. The modification of the second embodiment described below is an example in which the store server 75 analyzes the behavior of the customer viewing the screen and causes the display format to be changed again.

[0186] (Outline configuration of the product sales data processing system) Using Figure 17, we will explain a modified version of the second embodiment, the product sales data processing system 80. Figure 17 is a block diagram showing an example of the schematic configuration of the product sales data processing system of the modified version of the second embodiment.

[0187] The product sales data processing system 80 comprises a self-service POS terminal 10 and a store server 75. At the store, the product sales data processing system 80 performs a registration process to register the products that the customer purchases, and a payment process related to the products registered through the registration process, all at the customer's own discretion.

[0188] The self-service POS terminal 10 is as described in the first embodiment. The self-service POS terminal 10 has the same hardware configuration as shown in Figure 2.

[0189] The store server 75 is connected to the self-service POS terminal 10 in a communication-enabled manner and assists in the operation of the self-service POS terminal 10. The self-service POS terminal 10 receives the latest product master data obtained from an external source. The store server 75 also determines whether the display format of the screen shown on the display device 21, which has been modified by the self-service POS terminal 10 according to the customer's attributes, is appropriate for the customer. If the store server 75 determines that the display format of the screen shown on the display device 21 is not appropriate for the customer, it causes the display format of the screen shown on the display device 21 to be changed again.

[0190] (Overview of Self-Service POS Terminal Hardware) The hardware configuration of the self-service POS terminal 10 is as shown in Figure 2, so a further explanation will be omitted.

[0191] (Overview of store server hardware) The hardware configuration of the store server 75 included in the product sales data processing system 80 will be explained using Figure 18. Figure 18 is a hardware block diagram showing an example of the hardware configuration of the store server included in a product sales data processing system of a modified version of the second embodiment.

[0192] The store server 75 has a configuration in which the control unit 76, the storage unit 77, and the communication interface 78 are connected to each other by an internal bus.

[0193] The control unit 76 controls the overall operation of the store server 75. The control unit 76 comprises a CPU 761, a ROM 762, and a RAM 763. The CPU 761 connects to the ROM 762 and the RAM 763 via internal buses such as an address bus and a data bus. The CPU 761 loads various programs stored in the ROM 762 and the memory unit 77 into the RAM 763. The CPU 761 controls the operation of the store server 75 by operating according to the various programs loaded into the RAM 763. In other words, the control unit 76 has the configuration of a typical computer.

[0194] The memory unit 77 is a storage device such as an HDD or SSD. Alternatively, the memory unit 77 may be a non-volatile memory such as flash memory that retains stored information even when the power is turned off. The memory unit 77 stores the control program 771, the member master 772, and the screen master 773.

[0195] The control program 771 is a program that controls the overall operation of the store server 75. The control program 771 may be provided stored in the memory unit 77, or it may be provided as an installable or executable file recorded on a computer-readable non-temporary recording medium such as a CD-ROM, flexible disk (FD), CD-R, or DVD. The control program 771 may also be provided by storing it on a computer connected to a network and downloading it via the network. Furthermore, the control program 771 may be provided or distributed via a network such as the Internet.

[0196] Member master 772 is the same as member master 123 described in the first embodiment.

[0197] The screen master 773 is the same as the screen master 124 described in the first embodiment.

[0198] Furthermore, the control unit 76 communicates with the self-service POS terminal 10 via the communication interface 78.

[0199] (Functional configuration of the product sales data processing system) The functional configuration of the product sales data processing system 80 will be explained using Figure 19. Figure 19 is a functional block diagram showing an example of the functional configuration of a product sales data processing system in a modified form of the second embodiment.

[0200] The control unit 11 of the self-service POS terminal 10 loads the control program 121 shown in Figure 2 into the RAM 113 and operates it, thereby realizing the following functional units: the attribute estimation unit 61, the display format change unit 62, the product registration unit 63, the payment processing unit 64, the member information output unit 92, the display screen output unit 93, the customer image output unit 94, the display format re-change instruction reception unit 95, the display format re-change unit 39, the receipt issuing unit 65, the display control unit 66, and the operation control unit 67, as shown in Figure 19. Some or all of these functional units may be realized by dedicated hardware.

[0201] The functions of the attribute estimation unit 61, the display format change unit 62, the product registration unit 63, the payment processing unit 64, the receipt issuing unit 65, the display control unit 66, and the operation control unit 67 are as described in the first embodiment, so a further explanation will be omitted. Also, the function of the display format re-change unit 39 is as described in the second embodiment, so a further explanation will be omitted.

[0202] The member information output unit 92 outputs member information obtained by the self-service POS terminal 10 from the customer's mobile device or membership card to the store server 75.

[0203] The display screen output unit 93 outputs the screen displayed on the display device 21 and the screen ID of that screen (see Figure 4) to the store server 75.

[0204] The customer image output unit 94 outputs images and videos, including the customer's face, captured by the camera 24 of the self-service POS terminal 10, to the store server 75.

[0205] The display format change instruction receiving unit 95 receives an instruction from the store server 75 to change the screen display format back to one of several predetermined display formats.

[0206] Furthermore, the control unit 76 of the store server 75 deploys the control program 771 shown in Figure 18 into the RAM 113 and operates it, thereby realizing the following functional units as shown in Figure 19: the member information acquisition unit 101, the display screen acquisition unit 102, the customer image acquisition unit 103, the customer status analysis unit 104, the display format re-change instruction unit 105, and the payment completion information acquisition unit 106. Note that some or all of these functional units may be realized by dedicated hardware.

[0207] The member information acquisition unit 101 acquires member information obtained from the customer's mobile device or membership card via the self-service POS terminal 10.

[0208] The display screen acquisition unit 102 acquires the screen ID (see Figure 4) of the screen displayed on the display device 21 from the self-service POS terminal 10.

[0209] The customer image acquisition unit 103 acquires images and videos, including the customer's face, captured by the camera 24, from the self-service POS terminal 10.

[0210] The customer state analysis unit 104 determines whether the screen after the display format change unit 62 has changed the display format of the screen displayed on the display device 21 is a desirable screen for the customer. Specifically, the customer state analysis unit 104 determines whether the display format is desirable by processing images or videos that include the customer's face. That is, the customer state analysis unit 104 determines unnatural behavior of the customer by processing images or videos that include the customer's face. For example, the customer state analysis unit 104 determines that the screen after the display format change is not a desirable screen for the customer if the customer makes a surprised or anxious expression, or if no operation is performed for a predetermined period of time in a situation where operation is required. The customer state analysis unit 104 analyzes the customer's reaction to the change in the display format of the screen by performing known facial expression recognition and behavior recognition on images or videos that include the customer's face. Note that the customer state analysis unit 104 is an example of a determination unit in this disclosure.

[0211] The display mode change instruction unit 105, after the display mode change unit 62 has changed the display mode of the screen displayed on the display device 21, outputs an instruction to the self-service POS terminal 10 to change the screen display mode back to one of a predetermined set of display modes, based on the customer's behavior. Display format change instruction unit 105 This is an example of a re-modification instruction output unit in this disclosure.

[0212] The payment completion information acquisition unit 106 acquires payment completion information from the self-service POS terminal 10, indicating that the payment process has been completed.

[0213] (Processing flow performed by the product sales data processing system) Figures 20 and 21 illustrate the processing flow performed by the product sales data processing system 80. Figure 20 is a flowchart showing an example of the processing flow performed by a self-service POS terminal in a modified version of the product sales data processing system of the second embodiment. Figure 21 is a flowchart showing an example of the processing flow performed by a store server in a modified version of the product sales data processing system of the second embodiment.

[0214] First, using Figure 20, we will explain the processing flow performed by the self-service POS terminal 10 provided in the product sales data processing system 80.

[0215] The attribute estimation unit 61 reads code information, which includes the customer's membership information and the settings information of the mobile device, displayed on the customer's mobile device. Alternatively, the attribute estimation unit 61 reads membership information recorded on the customer's membership card (step S81).

[0216] The member information output unit 92 outputs the customer's member information obtained in step S81 to the store server 75 (step S82).

[0217] Furthermore, the attribute estimation unit 61 captures images and videos, including the customer's face, using the camera 24 (step S83).

[0218] The attribute estimation unit 61 estimates the customer's attributes based on the information obtained in steps S81 and S83. Then, the attribute estimation unit 61 decides how to change the display format of the screen to be displayed on the display device 21 (step S84). The processing flow performed by the attribute estimation unit 61 in step S84 is the same as the flowchart shown in Figure 12.

[0219] The display format change unit 62 changes the display format of the screen to be displayed on the display device 21 to the display format determined in step S84, and outputs the changed screen ID (see Figure 4) to the store server 75 (step S85).

[0220] The customer image output unit 94 outputs images and videos, including the customer's face, captured by the camera 24, to the store server 75 (step S86).

[0221] The display format change instruction receiving unit 95 determines whether it has obtained the screen ID of the changed screen to be displayed on the display device 21 from the store server 75 (step S87). If it is determined that the changed screen ID has been obtained (step S87: Yes), the process proceeds to step S88. On the other hand, if it is not determined that the changed screen ID has been obtained (step S87: No), the process proceeds to step S89.

[0222] In step S87, if it is determined that there is an instruction to change the display format of the screen again, the display format change unit 39 changes the display format of the screen to be displayed on the display device 21 back to the display format instructed by the store server 75, and outputs the screen ID after the change to the store server 75 (step S88).

[0223] The product registration unit 63 determines whether the product has been scanned by the scanner 25 (step S89). If it is determined that the product has been scanned (step S89: Yes), the process proceeds to step S90. On the other hand, if it is determined that the product has not been scanned (step S89: No), the process returns to step S86.

[0224] In step S89, if it is determined that the product has been scanned, the product registration unit 63 performs a product registration process to register the scanned product (step S90).

[0225] Next, the product registration unit 63 instructs the display control unit 66 to display the product information of the registered product on the display device 21 (step S91).

[0226] The operation control unit 67 determines whether the payment button (not shown) displayed on the display device 21 has been pressed (step S92). If it is determined that the payment button has been pressed (step S92: Yes), the process proceeds to step S93. On the other hand, if it is not determined that the payment button has been pressed (step S92: No), the process returns to step S86. The payment button is pressed by the customer after they have finished scanning all items to signal the start of payment.

[0227] In step S92, if it is determined that the payment button has been pressed, the settlement processing unit 64 displays the payment method selection screen on the display device 21 (step S93). The payment method selection screen is, for example, the screen illustrated in Figures 6 to 9.

[0228] The operation control unit 67 determines whether a payment method has been selected on the payment method selection screen (step S94). If it is determined that a payment method has been selected (step S94: Yes), the process proceeds to step S95. On the other hand, if it is not determined that a payment method has been selected (step S94: No), the process repeats step S94.

[0229] In step S94, if it is determined that a payment method has been selected, the settlement processing unit 64 performs settlement processing according to the selected payment method (step S95).

[0230] The settlement processing unit 64 determines whether the settlement process has been completed (step S96). If it is determined that the settlement process has been completed (step S96: Yes), the process proceeds to step S97. On the other hand, if it is determined that the settlement process has not been completed (step S96: No), the process repeats step S96.

[0231] In step S96, if it is determined that the payment process is complete, the receipt issuing unit 65 prints the payment details on the receipt printer 28 and issues a receipt (step S98). After that, the self-service POS terminal 10 terminates the process shown in Figure 20.

[0232] Next, using Figure 21, we will explain the processing flow performed by the store server 75 of the product sales data processing system 80.

[0233] The member information acquisition unit 101 acquires member information obtained from the customer's mobile device or membership card via the self-service POS terminal 10 (step S101).

[0234] The display screen acquisition unit 102 acquires the screen ID (see Figure 4) of the screen displayed on the display device 21 from the self-service POS terminal 10 (step S102).

[0235] The customer image acquisition unit 103 acquires images and videos, including the customer's face, captured by the camera 24 from the self-service POS terminal 10 (step S103).

[0236] The customer status analysis unit 104 analyzes images and videos, including the customer's face, captured by the camera 24 to determine whether the screen of the display device 21 after the display format has been changed is undesirable to the customer (step S104).

[0237] The customer status analysis unit 104 determines whether it estimates that the screen of the display device 21 after the display format has been changed is not a desirable screen for the customer (step S105). If it is determined that it is estimated that the screen is not a desirable screen for the customer (step S105: Yes), the process proceeds to step S106. On the other hand, if it is not determined that it is estimated that the screen is not a desirable screen for the customer (step S105: No), the process proceeds to step S107.

[0238] In step S105, if it is determined that the screen is not desirable for the customer, the display format change instruction unit 105 determines the screen ID to be changed and outputs it to the self-service POS terminal 10 (step S106).

[0239] If it is not determined in step S105 that the screen is not favorable to the customer, or if, following step S106, the payment completion information acquisition unit 106 determines whether it has acquired payment completion information from the self-service POS terminal 10 indicating that the payment process has been completed (step S107). If it is determined that payment completion information has been acquired (step S107: Yes), the store server 75 terminates the process shown in Figure 21. On the other hand, if it is not determined that payment completion information has been acquired (step S107: No), the process returns to step S102.

[0240] (Effects and benefits of the modified version of the second embodiment) As described above, the product sales data processing system 80, a modified version of the second embodiment, comprises a self-service POS terminal 10 (product sales data processing device) having an attribute estimation unit 61 that estimates the attributes of a customer based on information relating to the customer, a display format change unit 62 that changes the display format of the product sales screen to a display format from a predetermined plurality of display formats that corresponds to the attributes, and a display format re-change unit 39 that re-changes the display format of the screen in response to a re-change instruction from the store server 75 (server device); a display screen acquisition unit 102 that acquires identification information (screen ID) that identifies the screen after the change made by the display format change unit 62, and a display format re-change instruction unit 105 (re-change instruction output unit) that, after the display format change unit 62 has changed the display format of the screen, outputs an instruction to the self-service POS terminal 10 to change the display format of the screen back to one of a predetermined plurality of display formats based on the customer's behavior.Therefore, it is possible to display a screen with a display format that corresponds to the customer. Furthermore, if the screen display format does not suit the customer's preferences, the display format can be changed again, allowing for the display of a screen format that is more suitable for the customer's attributes.

[0241] Furthermore, in the product sales data processing system 80, a modified version of the second embodiment, the store server 75 (server device) is further equipped with a customer state analysis unit 104 (determination unit) that determines customer behavior after the display format change unit 62 has changed the display format of the screen. The display format re-change instruction unit 105 (re-change instruction output unit) outputs an instruction to the self-service POS terminal 10 (product sales data processing device) to re-change the display format of the screen to one of a predetermined set of display formats, provided that it is determined that the display format of the screen after the change is not desirable to the customer. Therefore, the system can accurately recognize customer behavior when the display format of the screen is changed and re-change the display format of the screen if it does not suit the customer's preferences.

[0242] Although embodiments of the present invention have been described above, these embodiments are illustrative and are not intended to limit the scope of the invention. This novel embodiment can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their variations are included in the scope and spirit of the invention, as well as in the claims of the invention and its equivalents. [Explanation of Symbols]

[0243] 10 Self-service POS terminal (product sales data processing device) 21 Display Devices 22 Operating devices 23 speakers 24 cameras 25 Scanners 26 Card Reader / Writer 27 Change machine 28 Receipt printers 29 Warning light 30 Default screen 31 Buttons at the bottom of the screen 32 Hiragana display screen 33 Enlarged view 37 Customer side display screen monitoring department (monitoring department) 38 Display Format Revision Instruction Reception Unit 39 Display format re-change section 61 Attribute estimation part 62 Display format change section 63 Product Registration Department 64 Payment Processing Unit 65 Receipt Issuance Department 66 Display Control Unit 67 Operation Control Unit 70. Face-to-face POS terminal (product sales data processing device) 75 Store Servers 80 Product Sales Data Processing System 92 Member Information Output Section 93 Display screen output section 94 Customer Image Output Unit 95 Display Format Re-change Instruction Reception Unit 101 Member Information Acquisition Department 102 Display screen acquisition section 103 Customer Image Acquisition Unit 104 Customer Status Analysis Department (Decision Department) 105 Display format change instruction unit (change instruction output unit) 106 Payment Completion Information Acquisition Unit [Prior art documents] [Patent Documents]

[0244] [Patent Document 1] Japanese Patent Publication No. 2020-201975

Claims

1. An attribute estimation unit that estimates the attributes of a customer based on information relating to that customer, A display format changing unit that changes the display format of the screen shown to the customer to a display format that matches the customer's attributes from among a predetermined number of display formats, A monitoring unit that allows the store clerk interacting with the customer to monitor the status of the screen displayed to the customer, After the display format changing unit has changed the display format of the screen shown to the customer, the re-change instruction receiving unit receives an instruction from the store clerk to change the display format of the screen back to one of a predetermined set of display formats. The system includes a display format re-change unit that, based on the instructions received by the re-change instruction receiving unit, re-changes the display format of the screen displayed to the customer. Product sales data processing device.

2. The attribute estimation unit, Based on settings information related to the screen display of the mobile device held by the customer, registration information on the membership card, or an image including the customer's face, the attributes of the customer are estimated. Product sales data processing device according to claim 1.

3. An attribute estimation unit that estimates the attributes of a customer based on information relating to that customer, A display format changing unit that changes the display format of the screen related to product sales to a display format according to the attribute from among a predetermined number of display formats, A product sales data processing device having a display format re-change unit that re-changes the display format of the screen in response to a re-change instruction from a server device, A display screen acquisition unit that acquires identification information to identify the screen after it has been changed by the display format change unit, The server device includes: a display format changing unit that, after changing the display format of the screen, outputs a re-change instruction output unit that, based on the customer's attributes estimated from an image or video including the customer's face, instructs the product sales data processing device to change the display format of the screen back to one of a predetermined set of display formats; Product sales data processing system.

4. The server device further includes a determination unit that, after the display format changing unit has changed the display format of the screen, determines, based on the processing result of an image or video including the customer's face, whether the display format of the screen after the change in display format is undesirable to the customer. The re-change instruction output unit, on the condition that it determines that the display format of the screen after the change in display format is not desirable to the customer, outputs an instruction to the product sales data processing device to change the display format of the screen back to one of a predetermined set of display formats. Product sales data processing system according to claim 3.

5. A computer that controls a product sales data processing device, An attribute estimation unit that estimates the attributes of a customer based on information relating to that customer, A display format changing unit that changes the display format of the product sales screen to a display format that corresponds to the customer's attributes from among a predetermined number of display formats, A monitoring unit that allows the store clerk interacting with the customer to monitor the status of the screen displayed to the customer, After the display format changing unit has changed the display format of the screen shown to the customer, the re-change instruction receiving unit receives an instruction from the store clerk to change the display format of the screen back to one of a predetermined set of display formats. Based on the instructions received by the aforementioned re-change instruction receiving unit, it is possible to make it function as a display format re-change unit that changes the display format of the screen displayed to the customer. program.

Images