Sales data processing device and program

Abstract

To support the rapid and accurate reading of symbol codes. [Solution] The sales data processing device comprises a reading means, an execution means, an acquisition means, and a display control means. The reading means reads the symbol code in a reading area where the symbol code can be read. The execution means performs processing based on the symbol code read by the reading means. The acquisition means acquires an image including the reading area. The display control means displays a guide image that guides the reading area on the image acquired by the acquisition means. The display control means performs display control to change the display mode of the guide image.

Description

Technical Field

[0001] The present invention relates to a sales data processing device and a program.

Background Art

[0002] A sales data processing device (cash register) used in a store or the like reads symbol codes such as various barcodes and performs processing according to the read symbol code. For example, the sales data processing device reads a product code attached to a product and performs processing to register the product corresponding to the read product code. For example, the registration device includes an imaging unit. The registration device can register a product by reading a barcode presented in the imaging area by an operator (see, for example, Patent Document 1 below).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the prior art, there is a problem that an operator may not be able to present a symbol code at an appropriate reading position, and as a result, the symbol code may not be read quickly and accurately.

[0005] The present invention has been made in view of such circumstances, and an object thereof is to provide a technology capable of assisting quick and accurate reading of symbol codes.

Means for Solving the Problems

[0006] To solve the above-mentioned problems, a sales data processing device according to one aspect of the present invention comprises: a reading means for reading a symbol code in a reading area from which a symbol code can be read; an execution means for performing processing based on the symbol code read by the reading means; an acquisition means for acquiring an image including the reading area; and a display control means for displaying a guide image that guides the reading area on the image acquired by the acquisition means, wherein the display control means performs display control to change the display mode of the guide image.

[0007] To solve the above-mentioned problems, another aspect of the present invention is a sales data processing device comprising: a reading means for reading a symbol code in a reading area from which a symbol code can be read; an execution means for performing processing based on the symbol code read by the reading means; an acquisition means for acquiring an image including the reading area; and a display control means for displaying a guide image that guides the reading area on the image acquired by the acquisition means, wherein the display control means performs display control to display the guide image in multiple colors.

[0008] To solve the above-mentioned problems, another aspect of the present invention is a program that causes the computer of a sales data processing device to function as a reading means for reading a symbol code in a reading area from which a symbol code can be read, an execution means for performing processing based on the symbol code read by the reading means, an acquisition means for acquiring an image including the reading area, and a display control means for displaying a guide image that guides the reading area on the image acquired by the acquisition means, wherein the display control means performs display control to change the display mode of the guide image.

[0009] To solve the above-mentioned problems, another aspect of the present invention is a program that causes the computer of a sales data processing device to function as a reading means for reading a symbol code in a reading area from which a symbol code can be read, an execution means for performing processing based on the symbol code read by the reading means, an acquisition means for acquiring an image including the reading area, and a display control means for displaying a guide image that guides the reading area on the image acquired by the acquisition means, wherein the display control means performs display control to display the guide image in multiple colors. [Brief explanation of the drawing]

[0010] [Figure 1] This figure shows an example of the network configuration of the sales data processing system according to this embodiment. [Figure 2] This is a perspective view showing an example of the appearance of a registration and settlement device. [Figure 3] This figure shows an example of the hardware configuration of a registration and settlement device. [Figure 4] This is a block diagram showing an example of the functional configuration of a registration and settlement device. [Figure 5] This figure shows an example of screen transitions for the customer-side display unit controlled by the display control unit. [Figure 6] This figure shows an example of screen transitions for the customer-side display unit controlled by the display control unit. [Figure 7] This flowchart shows an example of the registration and settlement process performed by the registration and settlement device according to this embodiment. [Figure 8] This flowchart shows an example of the settlement process performed by the registration settlement device according to this embodiment. [Figure 9] This figure shows an example of a reading support image and guide image related to Modification 1. [Modes for carrying out the invention]

[0011] (Embodiment) The following embodiment describes a configuration in which a fully self-checkout system is used.

[0012] (Network configuration of sales data processing system St) Figure 1 shows an example of the network configuration of the sales data processing system St according to this embodiment. The sales data processing system St is installed in various types of stores. These stores include, for example, retail stores and restaurants. Retail stores include, for example, supermarkets, convenience stores, drugstores, discount stores, department stores, and general merchandise stores. Restaurants include fast food restaurants, restaurants, bars, cafes, diners, and food courts. In this embodiment, the store is a supermarket.

[0013] The sales data processing system St shown in Figure 1 comprises a store controller 10, a transaction status management device 11, and registration and settlement devices 20 (20-1 to 20-n). Each device is connected to the others via a network 55. Each device is a computer device equipped with a CPU (Central Processing Unit), ROM (Read Only Memory), RAM (Random Access Memory), a communication unit, etc. The network 55 can be a LAN (Local Area Network) or a WAN (Wide Area Network), and may be wired or wireless.

[0014] (Store controller 10) The store controller 10 stores various types of information necessary for transactions. The various types of information include registration information and settlement information generated by the registration settlement device 20. Further, the various types of information include a product master. The product master is a file that stores product information such as product identification information (e.g., JAN (Japanese Article Number) code), product name, and selling price for each product. Additionally, the product master includes product identification information, product name, unit price (per gram) of non-fixed-weight products (products that require weighing) in addition to fixed-amount products. Also, the various types of information stored by the store controller 10 include inventory status, sales history, deposit and withdrawal records, information related to special sales, member information, and the like.

[0015] (Transaction status management device 11) The transaction status management device 11 is a monitor for surveillance. Specifically, the transaction status management device 11 displays the processing status etc. of the registration settlement device 20 and controls the registration settlement device 20. For example, a store employee (surveillance store employee) is placed at the transaction status management device 11, and the registration settlement device 20 is monitored by the surveillance store employee. The status of each of the plurality of registration settlement devices 20 is displayed on the transaction status management device 11. Specifically, the transaction status management device 11 displays a plurality of screens (split screens) corresponding to each of the plurality of registration settlement devices 20 and displays the status of each registration settlement device 20. Note that the transaction status management device 11 can also cancel the split screen and display a screen corresponding to one registration settlement device 20 (display in a large screen) according to the operation of the surveillance store employee. The surveillance store employee supports customers operating the registration settlement device 20 and, when an age-verification product such as alcohol is registered in the registration settlement device 20 in the full self-service mode described later, verifies the age of the customer.

[0016] (Registration settlement device 20) The registration settlement device 20 (20-1 to 20-n) is an example of a sales data processing device. The registration settlement device 20 is a POS (Point Of sales) terminal device capable of registering and settling goods. Specifically, the registration settlement device 20 includes a registration unit and a settlement unit. The registration unit executes a registration process for registering goods. In the registration process, the registration unit generates registration information including the goods information of the goods purchased by the customer. The settlement unit executes a settlement process based on the registration information generated in the registration process. In the settlement process, the settlement unit generates settlement information including the settlement type and the amount of income and expenditure. In FIG. 1, the number (n) of the registration settlement devices 20 indicates a plurality of devices, but it may also be one device.

[0017] (Operation mode) The registration settlement device 20 can switch the operation mode. The operation mode referred to here includes (A) full self-service mode, (B) clerk registration mode, and (C) accounting dedicated mode. Each operation mode will be described below. The registration settlement device 20 according to the present embodiment is assumed to operate in the full self-service mode.

[0018] (A) The full self-service mode is an operation mode in which the customer registers (self-registers) goods on the device itself and the customer settles (self-settles) on the device itself.

[0019] (B) The clerk registration mode is an operation mode in which the clerk registers goods and performs face-to-face settlement on the device itself or self-settlement on the registration settlement device 20 in the accounting dedicated mode. Face-to-face settlement is settlement performed on the device itself when the customer faces the clerk and is based on the customer's operation. The registration settlement device 20 can also be provided with a change machine on the clerk side instead of or in addition to the customer side. In this case, the settlement in the clerk registration mode can also be settlement performed by the clerk receiving cash or the like from the customer instead of or in addition to the face-to-face settlement.

[0020] In the employee registration mode, the registration payment device 20 outputs registration information to enable self-payment at other registration payment devices 20 (in the payment-only mode). Outputting registration information involves transmitting the registration information to other registration payment devices 20. However, outputting registration information may also involve encoding the registration information and displaying it on a display medium. The display medium may be, for example, paper or an electronic device such as a smartphone.

[0021] (C) The dedicated payment mode is a mode that operates in the other registration payment device 20 described above. Specifically, the dedicated payment mode is a mode in which self-payment is performed by acquiring registration information registered by the registration payment device 20 in the employee registration mode. Acquisition of registration information is done by receiving registration information from the registration payment device 20 in the employee registration mode. However, acquisition of registration information may also be done by reading a code displayed on a display medium.

[0022] Furthermore, the registration and payment device 20 does not need to be capable of switching operating modes. Specifically, the registration and payment device 20 may be a registration and payment device that only has the function of full self mode.

[0023] (Configuration equipped with a staff terminal) The sales data processing system St may include an employee terminal carried by the employee. The employee terminal may, for example, be capable of displaying a screen similar to that of the transaction status management device 11. The employee terminal may also notify the employee when a customer calls for assistance from the registration and settlement device 20, or when customer fraud is detected. Such notification allows the employee carrying the employee terminal to go to the registration and settlement device 20 in full self-service mode or in accounting-only mode to provide customer support, etc.

[0024] (Configuration with a management server) The sales data processing system St may include a management server for managing the registration and settlement devices 20. The management server stores a registration and settlement program that the registration and settlement devices 20 can store, and can perform product registration and settlement processing using this program. This allows the management server to manage and control each of the multiple registration and settlement devices 20 for each predetermined storage area. In this case, the registration and settlement device 20 (information processing device) may be equipped with drivers for screen control and printer control, or it may be a thin client that operates by the execution of the registration and settlement program on the management server.

[0025] (Example configuration of the registration and settlement device 20) Next, the configuration of the registration and settlement device 20 will be explained using Figures 2 and 3. Figure 2 shows an example of the appearance of the registration and settlement device 20. Figure 3 shows an example of the hardware configuration of the registration and settlement device 20. Although not shown in Figure 2, a counter for placing shopping baskets is placed on either side or one side of the registration and payment device 20.

[0026] The registration and payment device 20 includes a CPU 201, a ROM 202, a RAM 203, a hard disk 204, a customer-side display unit 205, a customer-side scanner unit 206, a card payment unit 208, a change dispenser 209, a staff-side display unit 210, a key operation unit 211, a staff-side scanner unit 212, a printing unit 213, an audio output unit 214, a communication unit 215, a guide camera 216, a surveillance camera 217, and a signpost 220. Each unit is connected to the others via a bus so that they can communicate with each other.

[0027] The CPU 201 is a central processing unit that controls the operation of the registration and settlement device 20 by reading and executing various programs stored in the ROM 202. These various programs include the sales data processing program according to this embodiment. ROM202 is read-only memory that stores various information used by the CPU201, including various programs.

[0028] RAM203 is a read-and-write memory that stores various types of information. For example, RAM203 stores information obtained from external sources (such as product master data obtained from the store controller 10) and information generated during processing. This information also includes registration information indicating registered products and settlement information generated during settlement.

[0029] The hard disk 204 stores various types of information. For example, the hard disk 204 stores (records) the imaging results (e.g., video) captured by the surveillance camera 217. The hard disk 204 may store various programs executed by the CPU 201 instead of the ROM 202. Alternatively, the hard disk 204 may store information acquired from external sources or information generated during processing instead of the RAM 203.

[0030] The customer-side display unit 205 is a touch display for customers. The customer-side display unit 205 displays various information related to registration and payment to the customer and accepts various inputs from the customer related to registration and payment. These various inputs include, for example, inputs related to registration and payment. For example, the customer-side display unit 205 displays preset keys (product selection buttons) corresponding to products and accepts registration of products corresponding to the pressed preset key. Also, for example, the customer-side display unit 205 displays payment type selection buttons corresponding to payment types and accepts selection of payment type when these buttons are pressed.

[0031] The customer-side scanner unit 206 is a scanner unit for the customer. Specifically, the customer-side scanner unit 206 includes an imaging unit. The imaging unit is an image sensor having an image element such as a CCD (Charge Coupled Device) or CMOS (Complementary Metal Oxide Semiconductor). The imaging unit reads (images) the product. When the operator (customer) holds the product over the customer-side scanner unit 206, the imaging unit images the product. The imaging unit optically images the code symbol (barcode, 2D code, etc.) held over the imaging window, or the whole or a part of the product (object).

[0032] Code symbols include barcodes (product codes) attached to products and employee codes attached to employee name tags. Product codes are codes that identify products, such as JAN codes, PLU (Price Look Up) codes, and in-store codes. When the customer-side scanner unit 206 reads a product code, the registration and payment device 20 registers the product corresponding to that product code. The reading method used by the customer-side scanner unit 206 is not limited to CCD or CMOS; laser or pen-based methods are also possible.

[0033] The card payment unit 208 processes payments based on information stored in various media such as various cards and mobile terminals. These various cards include credit cards, prepaid cards such as electronic money, and point cards. Electronic money is charged to charging media such as transportation IC cards and mobile terminals. Charging to charging media may be done by depositing cash at a designated charging terminal, or, if the charging media is associated with a credit card, by depositing from the credit card.

[0034] The change dispenser 209 is a cash payment mechanism. The change dispenser 209 is facing the customer and accepts various operations and cash insertions from the customer. Specifically, the change dispenser 209 has an input slot and an output slot for banknotes and coins. The change dispenser 209 calculates the amount to be inserted into the input slot, calculates the change amount which is the difference between the inserted amount and the purchase amount, and dispenses the change from the output slot. In addition to being installed on the customer side, the change dispenser 209 may also be installed on the employee side. In this case, the change dispenser 209 may accept various operations and cash insertions from the employee.

[0035] The employee-side display unit 210 is a touch display for employees. The employee-side display unit 210 displays various information to employees and accepts various inputs from them. The employee-side display unit 210 displays preset keys corresponding to products, and when an employee operates one of these preset keys, the product is registered.

[0036] The key operation unit 211 is located on the employee's side and is equipped with various keys (hardware keys, buttons). The key operation unit 211 receives various inputs from the employee. The key operation unit 211 is equipped with a registration button corresponding to a product, and when the employee operates this registration button, the product is registered.

[0037] The employee-side scanner unit 212 is a scanner unit for employees. Specifically, the employee-side scanner unit 212 includes an imaging unit. The imaging unit is an image sensor having an image element such as a CCD or CMOS. The imaging unit reads (images) the product. When an operator holds a product over the employee-side scanner unit 212, the imaging unit images the product. The imaging unit optically images the code symbol (such as a barcode or 2D code attached to the product) held over the imaging window, or the whole or a part of the product (object). Note that the reading method by the employee-side scanner unit 212 is not limited to CCD or CMOS; it can also be a laser method or a pen method.

[0038] The registration and payment device 20 performs processing based on the code read by the customer-side scanner unit 206 or the employee-side scanner unit 212. The registration and payment device 20 determines the type of code read (product code, employee code, etc.) by checking the values ​​of flags etc. indicated by predetermined digits in the code, the number of digits read, etc. For example, if the registration and payment device 20 determines that the read code is a product code, it performs product registration processing. Also, if the registration and payment device 20 determines that the read code is an employee code, it performs login processing.

[0039] The printing unit 213 prints and outputs various media (receipts, invoices, etc.). The printing unit 213 has a rotatable mechanism and is configured so that the media output slot faces from the employee side to the customer side, and vice versa.

[0040] The audio output unit 214 outputs sound. For example, the audio output unit 214 outputs reading sounds (scanning sounds) when various codes are scanned, voice guidance, and warning sounds. These sounds are related to product registration and payment.

[0041] The communication unit 215 is an interface for sending and receiving information with other devices (such as the store controller 10 and the transaction status management device 11).

[0042] The guide camera 216 captures images (hereinafter referred to as "reading support images") to assist in reading product codes. The guide camera 216 is a camera that captures video or a series of still images. The guide camera 216 can use a CCD camera or a CMOS camera. The guide camera 216 is a camera with higher resolution or more pixels than the imaging unit of the customer-side scanner unit 206. The guide camera 216 only needs to have performance sufficient to capture reading support images. The imaging area captured by the guide camera 216 includes the reading area in which the symbol code can be read by the customer-side scanner unit 206.

[0043] The surveillance camera 217 is mounted above the customer-side display unit 205. The surveillance camera 217 is a camera that captures video or a series of still images. The surveillance camera 217 can be a CCD camera or a CMOS camera. The surveillance camera 217 is a camera for monitoring customers and captures images of customer registration and payment operations.

[0044] The sign pole 220 is equipped with, for example, a light-emitting part (e.g., an LED (light-emitting diode)) and can be lit in a predetermined lighting pattern. The lighting pattern includes a color pattern and a flashing pattern. The sign pole 220 can provide various notifications depending on the lighting pattern. These notifications include, for example, a notification that the sign pole is in use, a notification to call a staff member, or a notification that a customer has committed an illegal act.

[0045] (Regarding inappropriate product listings) In the fully self-service registration and payment device 20, customers register their products. When registering products, customers perform a scan registration operation by holding the product code over the customer-side scanner unit 206. When the registration and payment device 20 reads the product code, it registers the product corresponding to that product code. In fully self-service checkouts, some customers may be unfamiliar with the registration operation, so the registration and payment device 20 displays a reading support image on the product registration screen. The reading support image is captured by a guide camera 216. The reading support image displays a guide image to assist with the scan registration operation. Specifically, the guide image is an image that guides the customer-side scanner unit 206 to the reading area where the product code can be read.

[0046] In this case, if the guide image and its background color were the same or similar in color, the visibility of the guide image would decrease, making it difficult for the customer to identify the reading area. For example, if the customer was wearing white clothing, and the background color of the reading support image was mainly white, then if the guide image was displayed in white, the visibility of the guide image would decrease.

[0047] As a result, customers were sometimes unable to hold the product code in the correct position. Therefore, it was sometimes impossible to register products quickly and accurately. In this embodiment, control over the display of guide images is implemented to support the reading of symbol codes quickly and accurately. The functional configuration of the registration and settlement device 20 will now be described with reference to Figure 4.

[0048] (Functional configuration of the registration and settlement device 20) Figure 4 is a block diagram showing an example of the functional configuration of the registration and settlement device 20. As shown in Figure 4, the registration and settlement device 20 comprises a reading unit 401, an execution unit 402, an acquisition unit 403, and a display control unit 404. Each functional unit is implemented by the CPU 201. That is, the CPU 201 implements each functional unit by executing the sales data processing program according to this embodiment. As mentioned above, the registration and settlement device 20 according to this embodiment operates in full self-service mode.

[0049] In the following sections, we will describe each functional part shown in Figure 4, with reference to Figures 5 and 6. Figures 5 and 6 show an example of screen transitions of the customer-side display unit 205 controlled by the display control unit 404.

[0050] (Reading unit 401) The reading unit 401 reads the symbol code within a reading area where the symbol code can be read. Specifically, the reading unit 401 reads the symbol code in response to a product presentation operation by an operator (e.g., a customer) (hereinafter referred to as "scan registration operation"). The symbol code is, for example, a product code attached to a product. The reading unit 401 controls the customer-side scanner unit 206 to read the product code. The reading area is the area where the product code can be read, and is formed, for example, at a position several centimeters away from the customer-side scanner unit 206. The reading unit 401 reads the product code by aiming at the product code within the reading area 524 (Figure 5(B)).

[0051] (Execution Unit 402: Registration Unit 402a) The execution unit 402 performs processing according to the symbol code read by the reading unit 401. The execution unit 402 includes a registration unit 402a. The registration unit 402a registers products by scan registration and preset registration.

[0052] Scan registration is the process of registering a product corresponding to the product code read by the reading unit 401. Preset registration is the process of registering a product in response to the operation of an operator corresponding to the product (for example, preset key 542 (Figure 5(D))). Preset key 542 is displayed on the customer-side display unit 205. In addition to scan registration and preset registration, product registration also includes registration by manually entering the product code and registration by searching for the category to which the product belongs. Manual entry and search registration may be performed only by store staff, and specifically, they may be performed from an operation screen (maintenance screen) that can be displayed by store staff.

[0053] (Acquisition section 403) The acquisition unit 403 acquires the captured image (reading support image) captured by the guide camera 216. The reading support image includes the reading area. The reading support image includes images related to the customer's scan registration operation. The positional relationship between the guide camera 216 and the customer-side scanner unit 206 is such that the aiming range for imaging by the guide camera 216 and the aiming range for reading by the customer-side scanner unit 206 overlap. The reading support image is a real-time video.

[0054] (Display control unit 404) The display control unit 404 displays the reading support image 523 acquired by the acquisition unit 403 (Figure 5(B): reading support image 523 captured by the guide camera 216). Along with the reading support image 523, the display control unit 404 displays a guide image 525 (Figure 5(B)) that guides the user to the reading area 524 of the product code. The guide image 525 includes an outer frame image 525a (Figure 5(B)) showing the outer frame of the reading area 524 and a message image 525b (Figure 5(B)) indicating that the product code should be held over the reading area 524.

[0055] The outer frame image 525a is a bracket-shaped image placed at the four corners (four vertices) of the reading area 524. Note that the images within the brackets are not limited to being placed at the four corners of the reading area 524; they may also be placed at the two diagonal corners of the reading area 524. Furthermore, the outer frame image 525a is not limited to a bracket-shaped image; it may also be a rectangular image surrounding the reading area 524. Additionally, the guide image 525 may be a cross-shaped image indicating the center of the reading area 524, or an arrow-shaped image indicating the center position of the reading area 524, either in place of or in addition to the outer frame image 525a.

[0056] Message image 525b is a text image that reads, "Please bring the product's barcode close to the scanner." Message image 525b may be displayed within the reading area 524 or outside the reading area 524.

[0057] (Guide image display control: Control related to changing the display mode of guide image 525) The display control unit 404 performs guide image display control. Guide image display control is the control of changing the display mode of the guide image 525 (outer frame image 525a and message image 525b). The display mode includes color, size, shape, pattern, and blinking mode. Guide image display control will be explained below, with examples of display modes such as color, size, shape, pattern, and blinking mode.

[0058] (Change color) The guide image display control is a control that changes the color of the guide image 525. The color of the guide image 525 is changed after a predetermined amount of time has elapsed. For example, the display control unit 404 changes the color of the guide image 525 (outer frame image 525a and message image 525b) in a preset transition pattern, such as "black" → "white" → "black" → "white" →... every predetermined amount of time (for example, 5 seconds). Note that the number of changeable colors is not limited to two, but may be three or more. Furthermore, the outer frame image 525a and message image 525b may be displayed in different colors. In addition, the outer frame image 525a and message image 525b may be changed in different color transition patterns.

[0059] (Change size) The guide image display control may be a control that changes the size of the guide image 525. For example, the display control unit 404 may change the size of the guide image 525 (outer frame image 525a and message image 525b) in a preset transition pattern, such as "small" → "large" → "small" → "large" →... every predetermined time (for example, 5 seconds). Note that the outer frame image 525a and message image 525b may be changed in different transition patterns regarding their size. Specifically, they may be changed in a transition pattern such that when the outer frame image 525a becomes larger, the message image 525b becomes smaller.

[0060] (Change in shape) The guide image display control may be a control that changes the shape of the guide image 525. For example, the display control unit 404 may change the shape of the outer frame image 525a in a preset transition pattern, such as "bracket shape" → "cross shape" → "bracket shape" → "cross shape" → ... every predetermined time (for example, 5 seconds). Alternatively, the display control unit 404 may change the shape of the message image 525b (for example, the font format) in a preset transition pattern, such as "Gothic font" → "Mincho font" → "Gothic font" → "Mincho font" → ... every predetermined time (for example, 5 seconds).

[0061] (Change of pattern) The guide image display control may be a control that changes the pattern of the guide image 525 (for example, the pattern of the bracket-shaped border of the image). For example, the display control unit 404 may change the pattern of the outer frame image 525a in a preset transition pattern, such as "solid border" → "dashed border" → "solid border" → "dashed border" →... every predetermined time (for example, 5 seconds). Similarly, the display control unit 404 may change the pattern of the message image 525b in a preset transition pattern, such as "solid line" → "dashed line" → "solid line" → "dashed line" →... every predetermined time (for example, 5 seconds). Note that the outer frame image 525a and the message image 525b may be changed in different transition patterns for their patterns. Specifically, the message image 525b may be changed in a transition pattern such that when the outer frame image 525a becomes a solid line, the message image 525b becomes a dashed line.

[0062] (Change in flashing pattern) The guide image display control may be a control that changes the blinking pattern (including vibration pattern) of the guide image 525. For example, the display control unit 404 may change the blinking pattern (or vibration pattern) of the outer frame image 525a in a preset transition pattern, such as "blinking pattern 1 (high speed)" → "blinking pattern 2 (low speed)" → "blinking pattern 1 (high speed)" → "blinking pattern 2 (low speed)" → ... every predetermined time (for example, 5 seconds). Similarly, the display control unit 404 may change the blinking pattern (or vibration pattern) of the message image 525b in a preset transition pattern, such as "blinking pattern 1" → "blinking pattern 2" → "blinking pattern 1" → "blinking pattern 2" → ... every predetermined time (for example, 5 seconds). Note that the outer frame image 525a and the message image 525b may be changed in different transition patterns for their blinking patterns. Specifically, the transition may be such that when the outer frame image 525a starts blinking rapidly, the message image 525b starts blinking slowly.

[0063] (Regarding the display of guide images when registering presets) The display control unit 404 displays the reading support image 523 and the guide image 525 when registering a scan, that is, when registering a product according to the product code. The display control unit 404 controls the display of the guide image during product registration. On the other hand, the display control unit 404 does not display the reading support image 523 and the guide image 525 when registering a preset, that is, when registering a product according to the operation of the preset key 542 (Figure 5(D)). The display control unit 404 does not control the display of the guide image during preset registration. Once the display control unit 404 has finished registering a product according to the operation of the preset key 542, it displays the reading support image 523 and the guide image 525 and resumes the display of the guide image.

[0064] (Execution Unit 402: Settlement Unit 402b) In this embodiment, the symbol code includes, for example, a payment code used for code-based payments. Specifically, the reading unit 401 reads the payment code via the customer-side scanner unit 206. The execution unit 402 includes a settlement unit 402b. The settlement unit 402b performs code-based payment according to the payment code read by the reading unit 401. Code-based payment is a payment according to a payment code (a code including customer identification information) displayed on a mobile terminal.

[0065] Let me add some information about code-based payments. Code-based payments are executed by having a payment code displayed on a mobile terminal read by the registration and settlement device 20, which then requests a withdrawal from the code-based payment server. The payment code is a code in which customer identification information is represented by a two-dimensional code or the like. The customer displays the payment code on their mobile terminal and has the customer-side scanner unit 206 read the payment code.

[0066] When the registration and settlement device 20 reads the payment code, it requests the code payment server to deduct the amount from the balance corresponding to the customer identification information. The code payment server deducts the payment amount from the balance. Once the deduction is complete, the code payment server sends a deduction completion notification to the registration and settlement device 20 and the mobile terminal. Upon receiving the deduction completion notification, the registration and settlement device 20 and the mobile terminal display a payment completion screen indicating that the payment has been completed, and the payment is completed. If the deduction cannot be made by the code payment server due to insufficient funds or other reasons, an error notification is sent to the registration and settlement device 20 and the mobile terminal to inform the customer of the error.

[0067] In addition, the settlements performed by settlement unit 402b also include cash payments, credit card payments, electronic money payments, and point payments using earned points.

[0068] In code payment, the acquisition unit 403 acquires a reading support image 623 (Figure 6(B)) captured by the guide camera 216. The reading support image 623 includes images related to the customer's scanning and registration operation of the payment code.

[0069] The display control unit 404 displays a guide image 625 that guides the reader through the reading area 624. The display control unit 404 controls the display of the guide image related to the payment code scan registration operation. Specifically, in code payment, the display control unit 404 controls the display of the guide image 625 that guides the reader through the reading area 624. Note that the guide image display control related to the payment code scan registration operation can be performed in the same way as the guide image display control related to the product code scan registration operation.

[0070] (An example of a screen transition controlled by the display control unit 404) Next, an example of screen transitions on the customer-side display unit 205 will be described with reference to Figures 5 and 6.

[0071] (Figure 5(A): Standby screen 510) Figure 5(A) shows the standby screen 510. The standby screen 510 includes a trade start button 511 and a monitoring image 512. The Start Trade button 511 is a button that accepts the start of a trade. When the Start Trade button 511 is pressed, the user transitions to the registration start screen 520 shown in Figure 5(B). The surveillance image 512 shows an image captured by the surveillance camera 217. The surveillance image 512 shows operations related to customer registration and payment when a customer is facing the device.

[0072] (Figure 5(B): Registration Start Screen 520) Figure 5(B) shows the registration start screen 520. The registration start screen 520 includes a total field 521, a selection button 522, a reading support image 523, and a reading procedure image 526. The total column 521 shows the total number of registered items and the total price. The selection button 522 includes a cancel button 522a, a staff call button 522b, a membership card reading button 522c, a shopping bag purchase button 522d, and a preset registration button 522e.

[0073] The Cancel button 522a is a button that accepts the cancellation of a transaction. When the Cancel button 522a is pressed, the system returns to the waiting screen 510. The staff call button 522b is a button used to receive requests for staff assistance. The member card reading button 522c is a button that accepts the start of reading the member card. The shopping bag purchase button 522d is a button that accepts the purchase (registration) of a shopping bag. The preset registration button 522e is a button that accepts product registration using a preset key. When the preset registration button 522e is pressed, the system transitions to the preset registration screen 540 shown in Figure 5(D).

[0074] Image 526 of the reading procedure is an animated image showing how to bring the product code close to the customer-side scanner unit 206.

[0075] The reading support image 523 shows an image captured by the guide camera 216. The reading support image 523 includes the reading area 524. The guide image 525 is also displayed on the reading support image 523. The reading area 524 is the area where the product code can be read. Guide image 525 includes outer frame image 525a and message image 525b. The outer frame image 525a is an image that shows the range of the reading area 524. Message image 525b is a text image indicating that the customer's scanner unit 206 should read the product code.

[0076] (Figure 5(C): Scan registration screen 530) Figure 5(C) shows the scan registration screen 530 displayed when a customer performs a scan registration operation. On the scan registration screen 530, product 531 is displayed in the imaging area. Product 531 is the product that the customer has picked up and brought close to the customer-side scanner unit 206. When the registration and settlement device 20 reads the product code attached to product 531, it registers product 531. The registered product is displayed in the product registration field 532.

[0077] The display mode (e.g., color) of the guide image 525 (outer frame image 525a and message image 525b) changes according to the passage of a predetermined time (e.g., 5 seconds). In this embodiment, both the display mode of the outer frame image 525a and the display mode of the message image 525b change according to the passage of a predetermined time. Note that it is sufficient for at least one of the display modes of the outer frame image 525a and the message image 525b to change according to the passage of a predetermined time.

[0078] The scan registration screen 530 includes a payment start button 533. When the payment start button 533 is pressed, the screen transitions to the payment type selection screen 610 shown in Figure 6(A).

[0079] (Figure 5(D): Preset registration screen 540) Figure 5(D) shows the preset registration screen 540. The reading support image 523 and guide image 525 are not displayed on the preset registration screen 540. The preset registration screen 540 includes a classification key 541, a preset key 542, a previous screen button 543, a monitoring image 512, and a selection button 522.

[0080] Classification key 541 is a key (button) corresponding to the classification of the product. Classifications include, for example, vegetables, fruits, and fresh fish. In the diagram, vegetables are selected from the classification key 541. Preset key 542 is a key (button) corresponding to a product. When preset key 542 is pressed, the product corresponding to preset key 542 is registered. Specifically, when preset key 542 is pressed, a quantity editing screen (not shown) is displayed, and the product is registered by accepting the quantity confirmation on that screen. The previous screen button 543 is a button that accepts the transition to the scan registration screen 530.

[0081] (Transition to scan registration screen 530 after preset registration) When the preset key 542 is pressed and the preset registration is complete, the system automatically transitions to the scan registration screen 530 without requiring the previous screen button 543 to be pressed. However, the transition to the scan registration screen 530 is not limited to automatic; it can also be done manually. Specifically, even if a product is registered by pressing the preset key 542, the system may remain on the preset registration screen 540 and transition to the scan registration screen 530 by pressing the previous screen button 543.

[0082] (Display format of guide image 525 after preset registration) On the scan registration screen 530 after preset registration is complete, the guide image 525 is displayed in the same format as before transitioning to the preset registration screen 540. For example, the guide image 525 is set to change from "black" to "white" to "black" to "white" to... every predetermined time (for example, 5 seconds). Suppose that when the preset registration button 522e is pressed on the scan registration screen 530, the guide image 525 is displayed as "white". In this case, on the scan registration screen 530 that is transitioned to after preset registration, the display control unit 404 displays the guide image 525 as "white" to "black" to "white" to "black" to...

[0083] (Figure 6(A): Payment type selection screen 610) Figure 6(A) shows the payment type selection screen 610. The payment type selection screen 610 includes payment type selection buttons 611. The payment type selection buttons 611 are buttons corresponding to payment types. Payment types include, for example, cash, credit card, electronic money, code payment, and point redemption. If, for example, code payment is selected from the payment type selection buttons 611, the screen transitions to the code reading screen 620 shown in Figure 6(B).

[0084] (Figure 6(B): Code reading screen 620) Figure 6(B) shows the code reading screen 620. The code reading screen 620 includes a settlement amount field 621, a code payment procedure image 622, and a reading support image 623. The settlement amount column 621 shows the total payment amount and any outstanding amount. Code payment procedure image 622 is an animated image showing how to bring the payment code close to the customer-side scanner unit 206. Code payment procedure image 622 allows even customers who are unfamiliar with the code payment procedure to easily perform a code payment.

[0085] The reading support image 623 shows an image captured by the guide camera 216. The reading support image 623 includes the reading area 624 and the guide image 625. Reading area 624 is the area where the payment code is read. Guide image 625 includes outer frame image 625a and message image 625b. The outer frame image 625a is an image that shows the range of the reading area 624. Message image 625b is a text image indicating that the customer's scanner unit 206 should read the payment code.

[0086] On the code reading screen 620, the reading support image 623 displays the mobile terminal 626. The mobile terminal 626 is in the customer's hand and is being brought close to the customer-side scanner unit 206 by the customer. When the registration and settlement device 20 reads the payment code displayed on the mobile terminal 626, it performs code payment based on the read payment code. Once the code payment is complete, the device transitions to the settlement completion screen 630 shown in Figure 6(C).

[0087] (Figure 6(C): Payment completion screen 630) Figure 6(C) shows the settlement completion screen 630. On the settlement completion screen 630, the settlement amount field 621 shows a deficit of ¥0, indicating that the settlement is complete. The settlement completion screen 630 also includes an information image 631. The information image 631 includes a notification and image prompting the customer to receive a receipt.

[0088] (Registration and settlement process performed by the registration and settlement device 20) Figure 7 is a flowchart illustrating an example of the registration and settlement process performed by the registration and settlement device 20 according to this embodiment. As shown in Figure 7, the registration and settlement device 20 determines whether or not the transaction start button 511 has been pressed on the standby screen 510 (Figure 5A), that is, whether or not the registration of goods has started (step S701). The registration and settlement device 20 waits until the registration of goods starts (step S701: NO), and when the registration of goods starts (step S701: YES), it displays the reading support image 523 and the guide image 525 (Figures 5(B), (C)) on the registration start screen 520 (Figure 5(B)) (step S702).

[0089] Then, the registration and payment device 20 performs guide image display control (for example, control to change the color of guide image 525) (step S703). Next, the registration and payment device 20 determines whether or not the product code has been scanned (read) by the customer-side scanner unit 206 (step S704). If the product code has been scanned (step S704: YES), the registration and payment device 20 registers the product corresponding to the product code (step S705) and proceeds to step S712.

[0090] In step S704, if the product code is not scanned (step S704: NO), the registration and settlement device 20 determines whether the preset registration button 522e (Figure 5(B), (C)) has been pressed, that is, whether or not preset registration has begun (step S706). If it is the start of preset registration (step S706: YES), the registration and settlement device 20 displays the preset registration screen 540 (Figure 5(D)) (step S707). On the preset registration screen 540, the reading support image 523 and the guide image 525 are hidden.

[0091] Furthermore, the registration and settlement device 20 stores the display mode of the guide image 525 (the previous display mode) when the preset registration button 522e (Figures 5(B) and (C)) is pressed in a predetermined storage unit (step S708). Then, the registration and settlement device 20 accepts the pressing of the preset key 542 (step S709). Furthermore, the registration and settlement device 20 registers the product corresponding to the pressed preset key 542 (step S710). Then, the registration and settlement device 20 retrieves the previous display mode of the guide image 525 stored in step S708 (step S711) and returns to step S702.

[0092] As a result, the registration and settlement device 20 transitions from the preset registration screen 540 to the scan registration screen 530 (Figure 5(C)) without requiring the user to press the previous screen button 543 (Figure 5(D)). Furthermore, in the scan registration screen 530 (Figure 5(C)) after preset registration as shown in step S702, the registration and settlement device 20 can display the guide image 525 in the same display mode as before transitioning to the preset registration screen 540.

[0093] In step S706, if it is not the start of preset registration (step S706: NO), the registration settlement device 20 determines whether or not the settlement start button 533 (Figure 5(C)) has been pressed, that is, whether or not settlement has started (step S712).

[0094] If settlement has not started (step S712: NO), the registration settlement device 20 returns to step S702 and repeats the processing in steps S702 to S711. On the other hand, if settlement has started (step S712: YES), the registration settlement device 20 executes the settlement process (Figure 8) (step S713) and ends the series of processes.

[0095] (Settlement process performed by the registration settlement device 20) Figure 8 is a flowchart illustrating an example of the settlement process performed by the registration settlement device 20 according to this embodiment. As shown in Figure 8, the registration settlement device 20 displays a payment type selection screen 610 (Figure 6(A)) and accepts the selection of a payment type (step S801). The registration settlement device 20 then determines whether the accepted payment type is a code payment or not (step S802).

[0096] If the accepted payment type is not a code payment (step S802: NO), for example, if the accepted payment type is a cash payment or a credit card payment, the registered settlement device 20 performs the settlement process according to the accepted payment type (step S803) and proceeds to step S808.

[0097] On the other hand, if the accepted payment type is a code payment (step S802: YES), the registration and settlement device 20 displays a reading support image 623 and a guide image 625 on the code reading screen 620 (Figure 6(B)) (step S804). The registration and settlement device 20 then performs guide image display control (for example, control to change the color of the guide image 625) (step S805).

[0098] Next, the registration and settlement device 20 determines whether or not the payment code has been scanned by the customer-side scanner unit 206 (step S806). If the payment code has not been scanned (step S806: NO), the registration and settlement device 20 returns to step S804. On the other hand, if the payment code has been scanned (step S806: YES), the registration and settlement device 20 executes code payment based on the payment code (step S807). Then, it issues a receipt (step S808) and ends the series of processes.

[0099] (Effects of the embodiment) As described above, the registration and settlement device 20 according to this embodiment performs guide image display control. Specifically, the registration and settlement device 20 displays a guide image 525 that guides the reading area 524 on a reading support image 523 (Figures 5(B) and (C)) which is an image of the reading area 524 of the symbol code, and changes the display mode of the guide image 525. This prevents the visibility of the guide image 525 from being reduced by the background color of the reading support image 523. Therefore, the operator can present the symbol code at an appropriate position within the imaging area. Consequently, it can support the rapid and accurate reading of the symbol code.

[0100] In this embodiment, the symbol code is used as the product code, and the registration and settlement device 20 performs guide image display control related to the reading of the product code. This prevents the visibility of the guide image 525 from being reduced by the background color or product color in the reading support image 523. Therefore, the operator can present the product code in the appropriate position within the imaging area. Consequently, it can support quick and accurate product registration.

[0101] Furthermore, the registration and settlement device 20 according to this embodiment performs guide image display control when registering products according to product codes, but does not perform guide image display control when performing preset registration. This allows for the display area of ​​preset key 542 to be secured during preset registration, enabling more effective use of the screen and improving the operability of preset registration.

[0102] Furthermore, the registration and settlement device 20 according to this embodiment displays the reading support image 523 and the guide image 525 without requiring any operator intervention once the preset registration is complete. Specifically, once the preset registration is complete, the registration and settlement device 20 automatically transitions to the scan registration screen 530 (Figure 5(C)). This allows customers to quickly perform scan registration operations after completing preset registration, and also provides support for those scan registration operations.

[0103] Furthermore, the registration and settlement device 20 according to this embodiment displays the guide image 525 after preset registration in the same manner as before preset registration. Specifically, the guide image 525 displayed on the scan registration screen 530 after preset registration can be displayed in the same manner as the guide image 525 that was displayed on the scan registration screen 530 before preset registration. This makes it easier for the operator to see the guide image 525.

[0104] In this embodiment, the symbol code is used as the payment code, and the registration and settlement device 20 displays a guide image 625 that guides the user to a reading area 624 (Figure 6(B)) where the payment code can be read. This prevents the visibility of the guide image 625 from being reduced by the background color of the reading support image 623 or the display color of the mobile device. As a result, the operator can present the payment code in the appropriate position within the imaging area. Therefore, it is possible to support quick and accurate settlement.

[0105] Furthermore, the registration and settlement device 20 according to this embodiment changes at least one of the multiple colors representing the guide image 525 after a predetermined period of time has elapsed. This makes it possible to more effectively suppress the reduction in visibility of the guide image 525 due to the background color, etc., in the reading support image 523.

[0106] (Modified version of the embodiment) Next, modifications of the embodiments will be described. In the following modifications, explanations of the contents described in the embodiments described above will be omitted as appropriate. Furthermore, it is also possible to combine each of the following modifications and each of the components of the embodiments.

[0107] (Variation 1: An example of displaying guide image 525 in multiple colors) First, let's describe Modification 1. In the embodiment described above, the guide image display control was described as changing the display mode of the guide image 525. In Modification 1, the guide image display control is described as displaying the guide image 525 in multiple colors.

[0108] Figure 9 shows an example of a reading support image 523 and a guide image 525 according to Modification 1. As shown in Figure 9, the outer frame image 525a includes a first outer frame image 901 and a second outer frame image 902. The first outer frame image 901 and the second outer frame image 902 each consist of four images corresponding to the four vertices of the reading area 524.

[0109] The first outer frame image 901 is displayed inside the reading area 524, beyond the second outer frame image 902. The colors of the first outer frame image 901 and the second outer frame image 902 are different. The display colors of the four images (bracket images) that make up the first outer frame image 901 are controlled as a set of four bracket images. For example, the first outer frame image 901 is displayed in yellow, and the second outer frame image 902 is displayed in red.

[0110] (An example of controlling four bracketed images in multiple sets) However, the display color of the four bracket images is not limited to being controlled as a set of four bracket images, but may also be divided into multiple sets and controlled for each set. Multiple sets may include, for example, one set of two bracket images and another set of the other two bracket images. One set may be, for example, the set of the two upper bracket images. Another set may be, for example, the set of the two lower bracket images. This makes it possible, for example, to make the upper right and upper left bracket images yellow, and the lower right and lower left bracket images blue. Note that the set of two bracket images is not limited to the upper and lower sets; it may also be the set of two right-hand bracket images and the set of two left-hand bracket images, or two opposing bracket images located diagonally opposite each other. Furthermore, the number of sets is not limited to two; it may be three sets, for example.

[0111] (An example of controlling four bracket images separately) Furthermore, the four bracket images are not limited to being controlled as a set; they may also be controlled individually. This allows each of the top-right, top-left, bottom-right, and bottom-left bracket images to be controlled with a different color. In this case, it is sufficient that one bracket image (for example, the top-right) that constitutes the first outer frame image 901 and one bracket image (for example, the top-right) that corresponds to that bracket image in the second outer frame image 902 are displayed in different colors.

[0112] Furthermore, in Modification 1, the color of at least one of the first outer frame image 901 and the second outer frame image 902 is changed at predetermined intervals. For example, the color of the first outer frame image 901 changes in a pre-set transition pattern, such as "yellow" → "black" → "yellow" → "black" →..., at predetermined intervals (e.g., 5 seconds). Similarly, the color of the second outer frame image 902 is also changed at predetermined intervals. For example, the color of the second outer frame image 902 changes in a pre-set transition pattern, such as "red" → "white" → "red" → "white" →..., at predetermined intervals (e.g., 5 seconds). Note that the number of changeable colors is not limited to two, but may be three or more.

[0113] Furthermore, the message image 525b may also be displayed in multiple colors. For example, the text "Bring the product's barcode close to the scanner" in the message image 525b may be segmented into "Bring the product's barcode close to the scanner" and "Bring it close," and each segmented string may be displayed in a different color. In addition, the color of each segmented string may be changed after a predetermined time (for example, 5 seconds).

[0114] In the above explanation, we described the control of the display of guide images related to the reading of product codes, but the same method can be used for the display of guide images related to the reading of payment codes. Specifically, the display control unit 404 can display the first outer frame image 901 and the second outer frame image 902 for the outer frame image 625a (Figure 6(B)) related to the payment code, and display each in a different color.

[0115] (Effect of Modification 1) As described above, the registration and settlement device 20 according to Modification 1 displays guide images 525 (first outer frame image 901 and second outer frame image 902) in multiple colors on a reading support image 523 (Figure 9) which captures the operator's operation of presenting the symbol code, guiding the reading area 524 in which the symbol code can be read. As a result, even if the visibility of either the first outer frame image 901 or the second outer frame image 902 is poor due to the background color, etc., in the reading support image 523, the customer can still grasp the outer frame image 525a from the other. Therefore, the operator can present the symbol code in an appropriate position within the imaging area. Consequently, it is possible to support the rapid and accurate reading of the symbol code.

[0116] Furthermore, the registration and settlement device 20 according to the modified example 1 changes at least one of the multiple colors that represent the guide image 525 after a predetermined period of time has elapsed. This makes it possible to more effectively suppress the reduction in visibility of the guide image 525 due to the background color, etc., in the reading support image 523.

[0117] (Modification 2: Example without guide camera 216) Next, a modified example 2 will be described. In the embodiment described above, an example was described in which the registration and settlement device 20 is equipped with a guide camera 216. In modified example 2, an example will be described in which the registration and settlement device 20 is not equipped with a guide camera 216.

[0118] In Modification 2, the reading support image is captured by the customer-side scanner unit 206 instead of the guide camera 216. That is, the customer-side scanner unit 206 serves both the function related to the reading support image and the function related to reading the product code. The customer-side scanner unit 206 in Modification 2 is a camera with a higher resolution or a higher number of pixels than the customer-side scanner unit 206 in the embodiment. Specifically, the customer-side scanner unit 206 has performance sufficient to capture the reading support image.

[0119] The acquisition unit 403 (Figure 4) in the modified example 2 acquires the reading support image captured by the customer-side scanner unit 206. The display control unit 404 displays a guide image 525 that guides the reading area 524 on the reading support image 523 (Figure 5(B)) acquired by the acquisition unit 403, and also performs guide image display control.

[0120] (Effect of Modification 2) According to Modification 2, the registration and settlement device 20 does not have a guide camera 216, thus reducing the number of parts in the registration and settlement device 20. This simplifies the configuration of the registration and settlement device 20 while supporting the rapid and accurate reading of symbol codes.

[0121] (Variation 3: Another example of symbol code) Next, we will describe Modification 3. In the embodiments described above, we described an example in which the symbol code is a product code or a payment code. Modification 3 describes an example in which the symbol code is a different code.

[0122] In Modification 3, the symbol code is, for example, a coupon code, a membership code, or a store employee code. The display control unit 404 controls the display of a guide image when reading these codes.

[0123] (Effect of Modification 3) According to Modification 3, the scan registration operation can be supported when reading symbol codes such as coupon codes.

[0124] Furthermore, the registration and settlement device 20 may choose not to perform guide image display control when reading codes other than product codes and payment codes (such as coupon codes). In other words, the registration and settlement device 20 may choose to perform guide image display control only when reading product codes and payment codes.

[0125] (Modification 4: Another example of a device that controls the display of guide images) Next, we will describe Modification 4. In the embodiment described above, we described an example in which the device that controls the display of guide images is a registration and settlement device 20 in full self mode. In Modification 4, we will describe an example in which the device that controls the display of guide images is a different device.

[0126] Other devices relating to Modification 4 include, for example, the following devices. • Mobile devices such as smartphones. • A registration and settlement device 20 in a dedicated accounting mode.

[0127] The mobile terminal registers products (self-registration) through a scan operation performed by customers as they shop around the store. The payment-only registration and settlement device 20 performs payment (self-settlement) for the products registered on the mobile terminal.

[0128] (Configuration of the sales data processing system St related to the modified example 4) The sales data processing system St according to Modification 4 includes, in addition to the configuration of the embodiment, a mobile terminal and a cloud server. The mobile terminal is, for example, a smartphone or a tablet. The mobile terminal may be a customer terminal owned by the customer or a rental terminal provided by the store. The mobile terminal may also be mounted on a shopping cart or held by the customer. The cloud server communicates with the mobile terminal and the registration and payment device 20. The cloud server stores information that identifies the mobile terminal, customer information, and information about registered products. The shopping cart is also equipped with a weighing device that can detect the weight of the products placed in the cart.

[0129] In modified example 4, the mobile terminal comprises a reading unit 401, a registration unit 402a, an acquisition unit 403, and a display control unit 404. The registration and settlement device 20 according to modified example 4 comprises a reading unit 401, a settlement unit 402b, an acquisition unit 403, and a display control unit 404.

[0130] (Flow from product registration to settlement in modified example 4) The following describes the flow from product registration to settlement in the sales data processing system St related to Modification 4, as explained in (1) to (6) below. At the start of a transaction, the cloud server assigns cart identification information to each customer and transmits the cart identification information to the mobile terminal.

[0131] (1) The customer uses the imaging unit (camera) of the mobile terminal to read the product code attached to the product. Specifically, the reading unit 401 reads the product code in response to the customer's scan registration operation. Once the product code is read, the registration unit 402a registers the product to the cloud server. Specifically, the registration unit 402a transmits the product identification information indicated by the read product code and the cart identification information to the cloud server.

[0132] The timing of the transmission may be either when the product identification information is obtained (when the product code is read) or when the start of payment is accepted. If the product identification information is transmitted when the start of payment is accepted, the mobile terminal should sequentially store the product identification information indicated by the product code each time it reads the product code, and when the start of payment is accepted, it should send the stored product identification information to the cloud server all at once.

[0133] (Guide image display control related to product code reading) In Modification 4, the mobile terminal controls the display of guide images related to the reading of product codes. Specifically, the acquisition unit 403 of the mobile terminal acquires reading support images captured by the imaging unit of the mobile terminal. The reading support images include images related to the customer's scan registration operation. The mobile terminal does not have a dedicated camera (guide camera 216) for capturing images of the scan registration operation. In other words, the imaging unit of the mobile terminal serves both the function related to such capturing and the function related to reading product codes.

[0134] Furthermore, the display control unit 404 of the mobile terminal displays a reading support image 523 (Figures 5(B) and (C)) that includes a reading area for the product code. The display control unit 404 also performs guide image display control. The guide image display control may be the guide image display control shown in the embodiment, or the guide image display control shown in Modification 1.

[0135] (2) The cloud server stores registration information (cart information), including cart identification information. When the cloud server receives product identification information and cart identification information from a mobile terminal, it updates the registration information by adding the product indicated by the product identification information to the cart indicated by the cart identification information.

[0136] (3) Once the customer has finished registering the items to be purchased, they press the "Start Checkout" button displayed on the mobile terminal. Upon receiving confirmation that the "Start Checkout" button has been pressed, the mobile terminal displays a checkout code (e.g., a 2D code) containing cart identification information on the terminal's display unit (touch panel).

[0137] (4) The customer then has the customer-side scanner unit 206 of the registration and payment device 20 read the payment code. When the registration and payment device 20 reads the payment code, it obtains cart identification information from the read payment code. The registration and payment device 20 then requests the cloud server to transmit the registration information indicated by the cart identification information.

[0138] (Guide image display control related to reading the settlement code) In reading the settlement code, the registration settlement device 20 performs guide image display control. Specifically, the acquisition unit 403 of the registration settlement device 20 acquires a reading support image captured by the guide camera 216. The display control unit 404 of the registration settlement device 20 displays a guide image 625 that guides the reading area 624 on the reading support image 623 captured during the scan registration operation, and performs guide image display control.

[0139] (5) When the cloud server receives a request to send registration information from the registration and payment device 20, it identifies the registration information based on the cart identification information included in the request. The cloud server then sends the identified registration information to the registration and payment device 20.

[0140] (Guide image display control related to payment code reading) (6) When the registration and settlement device 20 receives registration information from the cloud server, it performs settlement processing based on the received registration information. When the registration and settlement device 20 performs code payment, it performs guide image display control when reading the payment code. Specifically, the acquisition unit 403 of the registration and settlement device 20 acquires a reading support image captured by the guide camera 216. In addition, the display control unit 404 of the registration and settlement device 20 performs guide image display control by displaying a guide image 625 that guides the reading area 624 on the reading support image 623 captured of the scan registration operation.

[0141] Furthermore, the payment terminal 20 in payment-only mode is not limited to settling payments for items registered by the mobile terminal. The payment terminal 20 in payment-only mode can also set up payments for items registered by the payment terminal 20 in employee registration mode. In this case as well, the payment terminal 20 in payment-only mode should perform guide image display control in the same manner as described above when using code payment.

[0142] (Effects of Modification 4) Thus, the mobile terminal according to Modification 4 performs guide image display control related to the reading of product codes. This prevents the visibility of the guide image 525 from being reduced by the background color or product color in the reading support image 523. As a result, customers can present the product code in the appropriate position within the imaging area. Therefore, it is possible to support quick and accurate product registration.

[0143] Furthermore, the registration and settlement device 20 according to Modification 4 performs guide image display control for reading settlement codes and guide image display control for reading payment codes. This prevents the visibility of the guide image 625 from being reduced by the background color of the reading support image 623 or the display color of the mobile terminal. As a result, customers can present the settlement code and payment code in the appropriate position within the reading support image 623. Therefore, it is possible to support quick and accurate settlement.

[0144] (Another example of variation 4) In addition, in Modification 4, the other device that controls the display of the guide image may be the following device. • Store controller 10. • Registered payment device 20 in employee registration mode. Ticket vending machine.

[0145] The store controller 10 may read product codes, for example, when managing product inventory, registering products in the product master, or registering sale items. The store controller 10 can control the display of guide images during the scan registration operation related to such reading.

[0146] In the employee registration mode, the registration and payment device 20 allows employees to register products. The employee registration mode allows the registration and payment device 20 to control the display of guide images during the scan registration operation related to the reading. Furthermore, the employee registration mode allows the registration and payment device 20 to control the display of guide images during code payments made by customers at face-to-face checkout.

[0147] The ticket vending machine can, for example, read coupon codes printed on coupon tickets or membership codes printed on membership cards. The ticket vending machine can also control the display of guide images during the scan registration operation related to such reading.

[0148] (Modification 5: Another example of guide image display control) Next, we will describe Modification 5. In the embodiment described above, as an example of guide image display control, we described an example in which the color of the guide image 525 is changed over time. Modification 5 describes another example of guide image display control.

[0149] (Variation 5-1: Displayed using colors based on the colors with the highest occupancy rate in the image for reading assistance) In modified example 5-1, the display control unit 404 controls the display mode of the guide image 525 using a color different from the color with the highest occupancy rate in the reading support image 523 (hereinafter referred to as the "different color"). The color with the highest occupancy rate in the reading support image 523 is the color with the highest occupancy rate in the background color of the symbol code. For example, if a customer wearing white clothing performs the scan registration operation, the color with the highest occupancy rate may be white. Also, if the packaging color of the product is red, the color with the highest occupancy rate may be red.

[0150] The contrasting color can be any color that stands out against the color with the highest occupancy rate. For example, the contrasting color may be determined based on at least one of the following: hue, saturation, and lightness. For example, the contrasting color may be a complementary color. A complementary color is the color opposite the color with the highest occupancy rate on the color wheel. Opposite colors on the color wheel are, for example, green to red, or purple to yellow. That is, if the color with the highest occupancy rate is red, the contrasting color is green, and if the color with the highest occupancy rate is yellow, the contrasting color is purple.

[0151] The display control unit 404 uses image recognition to determine the color with the highest occupancy rate in the reading support image 523. This determination result changes as needed, for example, depending on the color of the product shown in the reading support image 523. Therefore, the difference color also changes for each registered product. This makes it possible for the display control unit 404 to change the color (difference color) of the guide image 525 for each product presented in the reading support image 523 (reading area 524).

[0152] Furthermore, the above occupancy rate is not limited to the occupancy rate of the background color in the reading support image 523, but may also be the occupancy rate of the background color in the reading area 524. This allows the guide image 525 to be made a more conspicuous color (a contrasting color), that is, the visibility of the guide image 525 can be further improved.

[0153] Furthermore, the above occupancy rate may be the occupancy rate of the background color in the display area (and surrounding area) of the guide image 525. This makes the guide image 525 the most conspicuous contrasting color, that is, it can further improve the visibility of the guide image 525.

[0154] Furthermore, the display control unit 404 may perform image processing on the guide image 525 and its surroundings. For example, by binarizing the guide image 525 and its surroundings, the guide image 525 may be displayed in black and its surroundings in white. This makes the contrasting colors more easily visible.

[0155] (Control timing for different colors) The color (different color) of guide image 525 is controlled periodically (after a certain period of time has elapsed or when the background color changes), but it is also controlled at the following times in particular. • Timing of trade in full self-service mode (when the trade start button 511 in Figure 5 is pressed). • Timing after scan registration. • Timing of return from preset registration screen 540 to scan registration screen 530.

[0156] (Regarding the use of machine learning, etc.) Artificial intelligence (AI) and machine learning can be used to determine different colors. For example, a trained model for determining different colors can be used. A trained model is, for example, a model represented using a neural network. However, the trained model may also be, for example, a Deep Neural Network (DNN), a support vector machine, or a random forest. The trained parameters include, for example, the number of layers in the neural network, the number of neurons in each layer, the connectivity between neurons, the connection weights between neurons, and the threshold value for each neuron.

[0157] A trained model is a model generated by training the input layer so that when an captured image (for example, an image of the area around the guide image 525 captured by the guide camera 216) is input, the difference color output from the output layer matches the optimal color (for example, the complementary color) as closely as possible.

[0158] The trained model includes an input layer, one or more hidden layers, and an output layer. The input layer receives images from the guide image 525 within the reading support image 523 as input samples. The output layer 703 outputs output values ​​(their respective accuracy) for each of the different color 1 to N.

[0159] A trained model is a model generated by inputting input samples into the input layer and updating the parameters so that the difference between each output value obtained from the output layer and each output sample becomes smaller.

[0160] During training of the learning model, the input samples are the captured images (images captured by the guide camera 216) input to the input layer. The output samples are the correct information (ground truth labels) used to compare with the output values ​​from the output layer during training of the learning model. Specifically, the output samples represent, for example, one of the following: "Different Color 1", "Different Color 2", ... "Different Color N".

[0161] By utilizing the pre-trained model described above, the display control unit 404 can change the color of the guide image 525 to the differential color with the highest probability (likelihood) among the output samples. Therefore, the differential color can be set to the optimal color.

[0162] (Variation 5-2: The entire image of the reading assistance is displayed in a modified color.) Furthermore, the display control unit 404 may display the entire reading support image 523 in a processed color. The processed color is a dark color, such as monochrome or sepia. On the other hand, the guide image 525 is displayed in an unprocessed color (for example, yellow or red). It is also possible to keep the display of the guide image 525 unchanged. In this way, by processing the entire reading support image 523, the guide image 525 can be made more prominent.

[0163] (Variation 5-3: Displaying an image of the symbol code) Furthermore, the display control unit 404 may include a guide image 525 of the symbol code (virtual image) within the reading area 524. The image is used to guide the operator to the position where the symbol code should be displayed. This image is displayed approximately in the center of the reading area 524.

[0164] Furthermore, the display control unit 404 may be controlled to change the display mode of the image. For example, the color of the image may be changed over a predetermined period of time. Specifically, the color of the image may be changed in a preset transition pattern, such as "gray" → "white" → "gray" → "white" → ... every predetermined period of time (e.g., 5 seconds). Displaying the image can more efficiently support the scan registration operation.

[0165] (Variation 5-4: Example where the outer frame image 525a is not displayed) Furthermore, the display control unit 404 may choose not to display the outer frame image 525a as the guide image 525, but instead display a message image 525b. Specifically, the display control unit 404 displays only a message image 525b, such as "Please hold the barcode here," within the reading area 524. The display control unit 404 also displays the message image 525b by blinking it. This allows the message image 525b to serve as a substitute for the outer frame image 525a. In this way, it is possible to support the scan registration operation using only the message image 525b, without displaying the outer frame image 525a.

[0166] (Effect of variation 5) According to Modification 5, the scan registration operation can be supported more efficiently, thus enabling the symbol code to be read more quickly and accurately.

[0167] (Modification 6: Example of guide image display control in each operating mode) Next, we will describe Modification 6. In the embodiment described above, we explained the guide image display control in full self mode. In Modification 6, we will explain the guide image display control in each operating mode.

[0168] Generally, store clerks are familiar with the scan registration operation. For this reason, the registration and payment device 20 according to Modification 6 does not perform guide image display control in clerk registration mode. On the other hand, the registration and payment device 20 performs guide image display control in full self-service mode and payment-only mode.

[0169] (Effects of Modification 6) According to the registered payment device 20 of Modified Example 6, there is no need to provide a guide camera 216 on the employee's side, and the employee-side display unit 210 does not display the reading support image 523 which is unnecessary for the employee. As a result, other information can be displayed in the area of ​​the employee-side display unit 210 corresponding to the reading support image 523, thus making effective use of the employee-side display unit 210.

[0170] (Another example of variation 6) (Controlling the display of guide images in employee registration mode) As another example of Modification 6, related to Modification 4 above (another example of a device that controls the display of guide images), the registration and settlement device 20 may perform guide image display control in the employee registration mode. For example, in the case of a new employee, the registration and settlement device 20 performs guide image display control in the employee registration mode. The registration and settlement device 20 can determine whether or not the employee is a new employee based on the employee code.

[0171] Specifically, the registration and payment device 20 determines whether the employee's work period indicated by the employee code is, for example, less than a predetermined number of days in total. If the determination is positive, it determines that the employee is a new employee. In this case, the registration and payment device 20 performs guide image display control, similar to the full self-service mode. This supports the new employee's scan registration operation. On the other hand, if the registration and payment device 20 determines that the employee is not a new employee, it does not display the guide image 525 and does not perform guide image display control.

[0172] (Switching the display control of guide images in employee registration mode) Furthermore, in the employee registration mode, it may be possible to switch whether or not to perform guide image display control. For example, the registration and payment device 20 may accept a selection on a predetermined setting screen whether or not to perform guide image display control, and perform guide image display control according to that selection.

[0173] (Controlling the display of guide images on the maintenance screen) Furthermore, in full self-service mode, store staff may assist customers in registering their products. In this case, although the registration and payment device 20 is in full self-service mode, it displays a screen for store staff (maintenance screen) so that the staff can register the products. Guide image display control may be disabled on the maintenance screen. However, guide image display control may also be enabled on the maintenance screen depending on the settings.

[0174] (Variation 7: After registering a preset, the guide image 525 is displayed in the initial display mode.) Next, we will describe Modification 7. In the embodiment described above, we described an example in which the display mode of the guide image 525 after preset registration is the same as the display mode before preset registration. In Modification 7, we will describe an example in which the display mode of the guide image 525 after preset registration is reset and performed in the initial display mode.

[0175] In Modification 7, the color of the guide image 525 is changed, for example, every predetermined time (for example, 5 seconds), as follows: "black" → "white" → "black" → "white" →... And, in the scan registration screen 530 (Figure 5(C)), when the preset registration button 522e is pressed, the guide image is displayed in "white". Even in this case, regardless of the previous display mode, in the scan registration screen 530 that is accessed after preset registration, the display control unit 404 resets the display mode of the guide image 525 and restarts it in the initial display mode of "black".

[0176] (Effect of Modification 7) According to the registration and settlement device 20 of Modification 7, it is possible to reduce the processing load related to guide image display control while supporting the rapid and accurate reading of product codes.

[0177] (Variation 8: An example where guide image display control is not performed in code payment) Next, we will describe Modification 8. In the embodiments described above, we described an example in which guide image display control is performed in code payment. Modification 8 describes an example in which guide image display control is not performed in code payment.

[0178] In code-based payments, the background of the payment code displayed on the mobile device screen is generally white. Therefore, the display control unit 404 displays the guide image 625 in a pre-set display mode (for example, black) during code-based payments and does not change the display mode of the guide image 625. On the other hand, the display control unit 404 controls the display of the guide image during product registration.

[0179] (Effect of Modification 8) Thus, in Modification 8, since the background color of the payment code is generally fixed in code payments, the guide image 625 is displayed in a color corresponding to that background color. This allows customers to easily recognize the guide image 625 during the payment code scanning and registration operation.

[0180] (Variation 9: Controlling the display of guide images for customers unfamiliar with the scan registration operation) Next, Modification 9 will be described. Modification 9 describes the control of the display of guide images for customers who are unfamiliar with the scan registration operation. In Modification 9, the color of the guide image 525 is changed, for example, every predetermined time (for example, 5 seconds) as follows: "black" → "white" → "black" → "white" →... In the case of an unfamiliar customer, the registration and settlement device 20 changes the above predetermined time (the time related to the change in display mode) from 5 seconds to 3 seconds. Whether or not a customer is unfamiliar can be determined from the registration time per item. Specifically, the registration and settlement device 20 can determine that a customer is unfamiliar if the registration time per item is above a threshold.

[0181] (Specific examples of how to identify someone who is unfamiliar with something) To elaborate further, the registration and settlement device 20 starts timing after the customer-side scanner unit 206 recognizes the product or after the customer picks up the product during scan registration. The timing ends when the product code is read. If product registration is slow, specifically if the timing time exceeds a threshold (for example, 5 seconds), the display control unit 404 changes the display mode of the guide image 525. The timing is then started again in the same manner, and when the timing time exceeds the threshold, the display control unit 404 changes the display of the guide image 525. The threshold may be changeable (shortenable). For example, after changing the display mode of the guide image 525 because the timing time has exceeded the threshold, the threshold may be shortened (for example, to 4 seconds). Also, after changing the display mode of the guide image 525, the threshold may be shortened further.

[0182] Note that the start time for timing is not limited to the time after the product is recognized. For example, the start time may be the time when something resembling a barcode is detected. Something resembling a barcode is, for example, an image containing multiple black lines.

[0183] Furthermore, the timing of the start of the timing may include one of the following timings: The timing after scanning one item. The timing of returning from the preset registration screen 540 (Figure 5(D)) to the scan registration screen 530 (Figure 5(C)). • Timing of trade commencement (timing when the trade commencement button 511 is pressed). The timing of returning to the scan registration screen 530 (Figure 5(C)) from another screen (for example, the shopping bag purchase screen, not shown, which is accessed by pressing the shopping bag purchase button 522d).

[0184] (Example of not displaying guide image 525 from the beginning) Furthermore, although the above-described embodiment explains an example in which the guide image 525 is displayed from the beginning, it is not limited to this. The guide image 525 may not be displayed initially, but may be displayed as a predetermined amount of time elapses. Specifically, the registration and settlement device 20 performs timing as described above. When the timing time exceeds a threshold, the display control unit 404 displays the guide image 525. The timing of the start of timing may include the timing when an object (product) is detected, in addition to the start timing described above.

[0185] (Effect of Modification 9) According to Modification 9, for customers unfamiliar with the scan registration operation, the interval at which the display mode of the guide image 525 switches can be shortened. Therefore, the guide image 525 can be made more recognizable to customers unfamiliar with the scan registration operation.

[0186] (Variation 10: Controlling the display of guide images for specific customers) Next, Modification 10 will be described. Modification 10 will describe the guide image display control. In Modification 10, a specific customer is a customer who is familiar with the scan registration operation. In the case of a customer who is familiar with the scan registration operation, the registration and settlement device 20 does not perform guide image display control.

[0187] In this case, the registration and settlement device 20 may hide the guide image 525, or it may display the guide image 525 and perform guide image display control. Whether or not a customer is familiar with the scan registration operation can be determined from the registration time per item. Specifically, the registration and settlement device 20 can determine that a customer is familiar with the scan registration operation if the registration time per item is below a threshold.

[0188] Furthermore, it can be assumed that members are familiar with the scan registration process. Therefore, whether or not a customer is familiar with the scan registration process may be determined based on whether or not they are a member. Specifically, the registration and settlement device 20 should determine whether a customer is familiar with the scan registration process when it acquires member information.

[0189] (Effect of Modification 10) According to Modification 10, for customers familiar with the scan registration operation, the guide image display control can be disabled. This makes the guide image 525 less conspicuous for customers familiar with the scan registration operation, thereby improving the visibility of the reading support image 523. This allows for more efficient scan registration operations.

[0190] (Variation 11: Guide image display control for each customer) Next, Modification 11 will be described. Modification 11 describes an example in which the display of guide images is controlled for each customer. In Modification 11, the registration and settlement device 20 may accept whether or not to perform guide image display control when registering products or when settlement begins. This allows the display of guide images to be controlled according to the customer's selection. In addition, the device may accept the setting of the display mode (including transition mode) for the guide image display control at this reception. This allows the guide image 525 to be displayed in a display mode according to the customer's settings.

[0191] Furthermore, the system may store in advance whether or not to perform guide image display control in the member information. In this case, the display mode in the guide image display control may also be stored in association with the member information. For example, if a member customer is visually impaired, the display mode (including transition modes) that the customer can recognize may be stored in association with the customer's member information. When the registration and settlement device 20 acquires the member information, it should perform guide image display control using the display mode associated with the member information.

[0192] (Effect of Variation 11) According to Modification 11, the guide image display can be controlled in a display manner that suits the customer, thus enabling more efficient support for scan registration operations.

[0193] (Variation 12: Another example of message image 525b) Next, a modified example 12 will be described. In modified example 12, another example of the message image 525b will be described. In modified example 12, the message image 525b may be, for example, a notification indicating to bring the symbol code closer or move it away. Specifically, the registration and settlement device 20 determines the distance between the customer-side scanner unit 206 and the product to be read based on the image captured by the surveillance camera 217. If it is determined that the distance is outside a predetermined reading range, the registration and settlement device 20 displays a message image 525b indicating to bring the symbol code closer or move it away.

[0194] Furthermore, distance determination may be based on the size of the object when a barcode-like object is detected, or it may be based on the results of image recognition of the item held in the hand. Also, if the customer-side scanner unit 206 is equipped with a distance sensor, the distance obtained from the detection result of the distance sensor may be notified, or a notification may be made according to the distance. The distance sensor is not limited to being equipped in the customer-side scanner unit 206, but may be provided separately from the customer-side scanner unit 206.

[0195] (Effect of Modification 12) According to variation 12, the scan registration operation can be supported more effectively.

[0196] The following is a summary of the embodiments. [Title of Invention] Sales Data Processing Device and Program [Technical Field] The present invention relates to a sales data processing device and a program. [Background technology]

[0197] A sales data processing device (cash register) used in stores reads various symbol codes, such as barcodes, and performs processing according to the read symbol code. For example, a sales data processing device reads a product code attached to a product and registers the product according to the read product code. For example, a registration device includes an imaging unit. The registration device can register a product by reading a barcode presented within the imaging area by an operator (see, for example, Patent Document 1 below). [Prior art document] [Patent] [Patent Document 1] Japanese Unexamined Patent Publication No. 2019-207599 [Overview of the prefecture] [Problems the invention aims to solve] However, conventional technology had a problem in that operators sometimes could not present the symbol code at the appropriate reading position, which prevented the symbol code from being read quickly and accurately. This invention has been made in view of these circumstances, and its purpose is to provide a technology that can support the rapid and accurate reading of symbol codes.

[0198] [Means for solving the problem] (1) In order to solve the above-mentioned problems, a sales data processing device according to one aspect of the present invention comprises: a reading means for reading a symbol code in a reading area from which a symbol code can be read; an execution means for performing processing based on the symbol code read by the reading means; an acquisition means for acquiring an image including the reading area; and a display control means for displaying a guide image that guides the reading area on the image acquired by the acquisition means, wherein the display control means performs display control to change the display mode of the guide image. With the above configuration, it is possible to suppress the reduction in visibility of the guide image 525 due to the background color of the reading support image 523. Therefore, the operator can present the symbol code at an appropriate position within the imaging area. Consequently, it is possible to support the rapid and accurate reading of the symbol code.

[0199] (2) In order to solve the above-mentioned problems, a sales data processing device in another aspect of the present invention comprises: a reading means for reading a symbol code in a reading area from which a symbol code can be read; an execution means for performing processing based on the symbol code read by the reading means; an acquisition means for acquiring an image including the reading area; and a display control means for displaying a guide image for guiding the reading area on the image acquired by the acquisition means, wherein the display control means performs display control to display the guide image in multiple colors. With the above configuration, even if the visibility of either the first outer frame image 901 or the second outer frame image 902 is poor due to the background color, etc., in the reading support image 523, the customer can grasp the outer frame image 525a from the other. Therefore, the operator can present the symbol code at an appropriate position within the imaging area. Thus, it is possible to support the rapid and accurate reading of the symbol code.

[0200] (3) In the configuration of (1) or (2) above, the symbol code is a product code attached to a product, the reading means reads the product code, and the execution means, in addition to registering a product corresponding to the product code read by the reading means, is equipped with a registration means capable of registering a product corresponding to the operation of an operator corresponding to a product, and the display control means may perform the display control related to reading the product code when registering a product corresponding to the product code, but may not perform the display control when registering a product corresponding to the operation. With the above configuration, it is possible to suppress the reduction in visibility of the guide image 525 due to the background color or product color in the reading support image 523. Therefore, the operator can present the product code in the appropriate position within the imaging area. Consequently, it is possible to support quick and accurate product registration. Furthermore, by reserving the display area for preset key 542 during preset registration, the screen can be used more effectively, and the operability of preset registration can be improved.

[0201] (4) In the configuration of (1) or (2) above, the symbol code is a payment code used for code settlement, the reading means reads the payment code, the execution means is a settlement means that performs code settlement according to the payment code read by the reading means, and the display control means performs the display control related to the reading of the payment code. With the above configuration, even when leaving the store, the visibility of the guide image 625 can be suppressed due to the background color of the reading support image 623 and the display color of the mobile terminal. Therefore, the operator can present the payment code in the appropriate position within the imaging area. Thus, it is possible to support quick and accurate settlement.

[0202] (5) In the configuration of (1) above, the display control means may change at least one of the plurality of colors after a predetermined time has elapsed. According to the above configuration, the reduction in visibility of the guide image 525 due to the background color, etc., in the reading support image 523 can be suppressed more effectively.

[0203] (6) In the configuration of (1) or (2) above, the display control means may control the display manner of the guide image with a color different from the color that has a high occupancy rate in the captured image. The above configuration allows for more efficient support of scan registration operations, thereby facilitating the rapid and accurate reading of symbol codes.

[0204] (7) In order to solve the above-mentioned problems, another aspect of the present invention is a program which causes the computer of a sales data processing device to function as a reading means for reading a symbol code in a reading area from which a symbol code can be read, an execution means for performing processing based on the symbol code read by the reading means, an acquisition means for acquiring an image including the reading area, and a display control means for displaying a guide image that guides the reading area on the image acquired by the acquisition means, wherein the display control means performs display control to change the display manner of the guide image. With the above configuration, it is possible to suppress the reduction in visibility of the guide image 525 due to the background color of the reading support image 523. Therefore, the operator can present the symbol code at an appropriate position within the imaging area. Consequently, it is possible to support the rapid and accurate reading of the symbol code.

[0205] (8) In order to solve the above-mentioned problems, another aspect of the present invention is a program which causes the computer of a sales data processing device to function as a reading means for reading a symbol code in a reading area from which a symbol code can be read, an execution means for performing processing based on the symbol code read by the reading means, an acquisition means for acquiring an image including the reading area, and a display control means for displaying a guide image that guides the reading area on the image acquired by the acquisition means, wherein the display control means performs display control to display the guide image in multiple colors. With the above configuration, even if the visibility of either the first outer frame image 901 or the second outer frame image 902 is poor due to the background color, etc., in the reading support image 523, the customer can grasp the outer frame image 525a from the other. Therefore, the operator can present the symbol code at an appropriate position within the imaging area. Thus, it is possible to support the rapid and accurate reading of the symbol code.

[0206] Furthermore, all or part of the functions (input / output, storage, processing (including judgment)) of the registration and settlement device 20 described above may be implemented in a device other than the one described as the entity that executes the said function.

[0207] Specifically, the above description described a configuration in which the registration and settlement device 20 or mobile terminal comprises a reading unit 401, an execution unit 402, an acquisition unit 403, and a display control unit 404, as shown in Figure 4, etc. However, all or part of these functional units may be provided in other computer devices. For example, all or part of these functional units may be provided in the store controller 10, an external server device, or a computer device other than these. Furthermore, the computer device equipped with these functional units is not limited to multiple devices, but may be just one device.

[0208] Specifically, for example, instead of the registration and settlement device 20, the store controller 10 or an external server device may acquire the reading support image 523, display the guide image 525 on the acquired reading support image 523, and perform guide image display control.

[0209] In relation to the above, the registration and settlement device 20 and the mobile terminal may function as so-called thin clients specializing in the input / output interface portion for product registration and settlement. That is, the registration and settlement device 20 and the mobile terminal may receive various inputs (operation by the operator, detection by a device such as a scanner), transmit the input information (operation information, scan information, etc.) to the server device, receive the processing results of the server device based on the input information (updated screen information, device control information, etc.), and perform various outputs (display on the display unit, device control).

[0210] Furthermore, the program for realizing the sales data processing system St, the registration and settlement device 20, and the mobile terminal described above may be recorded on a computer-readable recording medium, and the program may be loaded into a computer system and executed. Here, "computer system" includes hardware such as the OS and peripheral devices. Furthermore, "computer-readable recording medium" refers to portable media such as USB (Universal Serial Bus) flash memory, SSD (Solid State Drive), flexible disk, magneto-optical disk, ROM, CD-ROM, and storage devices such as hard disks built into the computer system. In addition, "computer-readable recording medium" also includes volatile memory (RAM) inside a computer system that acts as a server or client when the program is transmitted via a network such as the Internet or a communication line such as a telephone line, which retains the program for a certain period of time. Furthermore, the above program may be transmitted from the computer system that stores the program in a storage device, etc., to another computer system via a transmission medium or by transmission waves in the transmission medium. Here, "transmission medium" for transmitting the program refers to a medium that has the function of transmitting information, such as a network such as the Internet or a communication line such as a telephone line. Furthermore, the above program may be intended to implement some of the functions described above. It may also be a so-called differential file (differential program) that can implement the aforementioned functions in combination with programs already recorded in the computer system. [Explanation of Symbols]

[0211] St...Sales data processing system, 10...Store controller, 20...Registration and settlement device, 201...CPU, 202...ROM, 203...RAM, 204...Hard disk, 205...Customer-side display unit, 206...Customer-side scanner unit, 216...Guide camera, 401...Reading unit, 402...Execution unit, 402a...Registration unit, 402b...Settlement unit, 403...Acquisition unit, 404...Display control unit

Claims

1. A reading means for reading the symbol code in a reading area where the symbol code can be read, An execution means that performs processing based on the symbol code read by the reading means, Acquisition means for acquiring an image containing the reading area, A display control means that displays a guide image for guiding the reading area on the captured image acquired by the acquisition means, Equipped with, The display control means performs display control to change the display mode of the guide image. A sales data processing device characterized by the following features.

2. A reading means for reading the symbol code in a reading area where the symbol code can be read, An execution means that performs processing based on the symbol code read by the reading means, Acquisition means for acquiring an image containing the reading area, A display control means that displays a guide image for guiding the reading area on the captured image acquired by the acquisition means, Equipped with, The display control means performs display control to display the guide image in multiple colors. A sales data processing device characterized by the following features.

3. The aforementioned symbol code is a product code assigned to the product. The reading means reads the product code, The execution means includes a registration means capable of registering a product corresponding to the product code read by the reading means, as well as registering a product corresponding to the operation of an operator corresponding to the product. The display control means performs the display control related to reading the product code when registering a product according to the product code, and does not perform the display control when registering a product according to the operation. The sales data processing device according to claim 1 or 2.

4. The aforementioned symbol code is a payment code used for code payments. The reading means reads the payment code, The execution means includes a payment means that performs code payment according to the payment code read by the reading means, The display control means performs the display control related to reading the payment code. The sales data processing device according to claim 1 or 2.

5. The display control means changes at least one of the plurality of colors after a predetermined time has elapsed. The sales data processing device according to feature 2.

6. The display control means displays the guide image in a color different from the color with a high occupancy rate in the captured image. The sales data processing device according to claim 1 or 2.

7. The computer for the sales data processing unit, A reading means for reading the symbol code in a reading area where the symbol code can be read, An execution means that performs processing based on the symbol code read by the reading means, Acquisition means for acquiring an image containing the reading area, A display control means that displays a guide image for guiding the reading area on the captured image acquired by the acquisition means, To make it function as, The display control means performs display control to change the display mode of the guide image. A program characterized by the following features.

8. The computer for the sales data processing unit, A reading means for reading the symbol code in a reading area where the symbol code can be read, An execution means that performs processing based on the symbol code read by the reading means, Acquisition means for acquiring an image containing the reading area, A display control means that displays a guide image for guiding the reading area on the captured image acquired by the acquisition means, To make it function as, The display control means performs display control to display the guide image in multiple colors. A program characterized by the following features.

Images