Sales data processing device, accounting device and program

Abstract

To prevent the occurrence of inconvenience to sales data processing when contents of captured camera images for detecting operational errors and malpractice are abnormal.SOLUTION: A sales data processor includes: a registration unit that performs registration processing to store information on articles to be transacted in a predetermined storage unit; a settlement unit that performs settlement processing for payment of the articles registered by the registration unit; an operation unit that accepts operations by an operator; an acquisition unit that acquires information obtained by analyzing an image taken by a camera of an area in which the operator is reflected, and indicating that the camera's image capturing direction is deviated from a reference; and a countermeasure unit that performs countermeasure processing to prevent unauthorized operation by the operator when the acquisition unit acquires the information.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] An embodiment of the present invention is a sales data processing device. 、 accounting equipment and programs Regarding. [Background technology]

[0002] Known conventional POS (Point of Sales) terminals include self-service terminals operated by shoppers to perform operations related to product registration and payment processing, and semi-self-service terminals operated by shoppers to perform operations related to payment processing after product registration. Some of these POS terminals are equipped with a camera that captures an image of the operator, making it possible to detect operational errors or fraudulent activity by the operator from the images output by the camera. When such a camera is not built into the main housing of the POS terminal, it is often positioned to capture images from above the main housing, for example. Furthermore, such a camera is configured so that the imaging direction can be adjusted as needed.

[0003] In stores using POS terminals with the above configuration, malicious customers may change the camera's orientation to avoid capturing fraudulent activity. Earthquakes can also cause the camera to become misoriented.

[0004] Patent Document 1 discloses a system that detects a change in the imaging position of a surveillance camera and notifies the user of an abnormality. However, the objects monitored by this system are not limited to operations on POS terminals. Summary of the Invention [Problem to be solved by the invention]

[0005] The problem to be solved by the present invention is a sales data processing device that can prevent problems from occurring in sales data processing when the image content of a camera for detecting operational errors or fraudulent acts is abnormal. 、 accounting equipment and programs The purpose is to provide [Means for solving the problem]

[0006] The sales data processing device of the embodiment includes a registration unit that performs a registration process to store information about a commodity to be traded in a predetermined storage unit, a settlement unit that performs a settlement process for the commodity registered by the registration unit, an operation unit that accepts operations by an operator, an acquisition unit that acquires information obtained by analyzing an image captured by a camera of a range in which the operator is reflected, the information indicating that the imaging direction of the camera is deviated from a standard, and when the acquisition unit acquires the information, performs a countermeasure process to prevent unauthorized operations by the operator. In the countermeasure processing, the progress of the registration processing or the payment processing is stopped. and a countermeasures unit. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is a perspective view showing an example of the appearance of a self-service POS terminal according to an embodiment as seen from the operator's side. [Figure 2] FIG. 2 is a diagram illustrating an example of a hardware configuration of the self-checkout POS terminal according to the embodiment. [Figure 3] FIG. 3 is a diagram illustrating an example of a functional configuration of the self-checkout POS terminal and the server according to the embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example of an image captured by the camera according to the embodiment. [Figure 5] FIG. 5 is a diagram illustrating an example of an image captured by the camera according to the embodiment. [Figure 6] FIG. 6 is a flowchart illustrating an example of processing executed in the self-checkout POS terminal according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0008] (First embodiment) An embodiment will be described with reference to the drawings. Fig. 1 is a perspective view showing an example of the appearance of a self-service POS terminal 10 according to the embodiment as seen from the operator's side. The self-service POS terminal 10 is a self-service type POS (Point Of Sales) terminal that is operated by a shopper to perform processes related to product registration and payment, and is an example of a sales data processing device.

[0009] The technology according to the embodiment can also be applied to a semi-self-service POS terminal (an example of a checkout device) in which a shopper operates the payment process after product registration. The registration process prior to the payment process here is performed, for example, by a store clerk operating a regular POS terminal. The registration process may also be performed by the shopper themselves. For example, a shopper registers products by using a POS application launched on their smartphone or by operating a cart POS (a terminal attached to a cart provided in the store).

[0010] The self-service POS terminal 10 has a main body 11, a basket stand 12, and a bagging stand 13. The main body 11 is provided between the basket stand 12 and the bagging stand 13. The basket stand 12 is a storage stand for placing baskets containing items to be transacted. The bagging stand 13 is a storage stand on which an open shopping bag can be hung. Registered items are placed in the shopping bag. In other words, registered items are placed on the bagging stand 13.

[0011] The bagging table 13 has a base 131, a bag hook 132, and a temporary storage table 133. The bag hook 132 and the temporary storage table 133 are supported by struts 134 attached to the base 131 and are provided above the base 131. The bag hook 132 is a hook for hanging a bag into which a registered product will be placed. The base 131 is a table that supports the bottom of the bag and on which products that are larger than the bag and unsuitable for being placed in a bag are placed, for example. The temporary storage table 133 is a table on which products that require care when bagging because they are fragile, for example, are temporarily placed.

[0012] The self-service POS terminal 10 further includes a weighing unit 14, a deposit / withdrawal unit 15, a scanner 16, a touch panel display 17, an indicator light 18, a card reader 19, a printer 20, and a camera 21.

[0013] The weighing unit 14 is provided on the bagging table 13. The weighing unit 14 weighs the weight of items such as commodities placed on the bagging table 13 based on the output of a built-in weight sensor. For example, the weighing unit 14 weighs the total weight of the bags set on the bagging table 13 and the commodities placed in the bags. The weight sensor is provided, for example, below the base 131 to support the base 131 and output a signal according to the load on the base 131.

[0014] The deposit / withdrawal unit 15 is provided, for example, in the vertical center of the main body 11. The deposit / withdrawal unit 15 accepts coins and bills inserted by shoppers and dispenses change, etc. Note that, for example, if the self-service POS terminal 10 is configured as a cashless terminal that does not handle cash, the deposit / withdrawal unit 15 may not be provided.

[0015] The scanner 16 is provided, for example, on the top of the main body 11. The scanner 16 has a reading window 161. The scanner 16 reads product information from a code symbol, such as a radio tag or barcode, attached to a product held over the reading window 161. The radio tag is an electronic tag such as an RF (Radio Frequency) tag. The radio tag has an IC (Integrated Circuit) chip that stores information and an antenna. The radio tag transmits tag information stored in the IC chip in response to radio waves received from a radio tag reader. For example, the radio tag stores product information about the product to which the radio tag is attached. The product information includes, for example, a product code that can identify the product.

[0016] The scanner 16 may also have a camera configured to capture an image of a commodity held over the reading window 161, for example. The camera of the scanner 16 includes an imaging element such as a CMOS (Complementary Metal-Oxide Semiconductor) or a CCD (Charge Coupled Device). The reading window 161 is capable of transmitting light captured by the camera of the scanner 16. Image data of the commodity captured by the camera of the scanner 16 is subjected to object recognition processing by an image processing device. As a result, the commodity included in the image data is identified and registered. The image processing device is an external device communicably connected to the self-service POS terminal 10 via, for example, a communication I / F (interface). The object recognition processing may be executed by the self-service POS terminal 10.

[0017] The touch panel display 17 is provided, for example, above the main body 11. The touch panel display 17 displays various information for the operator on the screen and accepts operations by the shopper.

[0018] The indicator light 18 is provided, for example, at the rear of the main body 11. The indicator light 18 is a light that notifies a store clerk that an abnormality has occurred in the self-service POS terminal 10.

[0019] The card reader 19 is provided, for example, on the side of the scanner 16 in the main body 11. The card reader 19 reads information stored on a card such as a credit card.

[0020] The printer 20 is provided, for example, inside the housing of the main body 11. The printer 20 is a printing device that prints receipts showing transaction details and coupons for product discounts and the like on receipt paper, etc. The printer 20 has a receipt discharge unit on the front of the main body 11. The receipt discharge unit is an outlet that discharges receipts and the like issued by the printer 20 to the outside of the self-service POS terminal 10. The receipt discharge unit is provided, for example, between the deposit / withdrawal unit 15 and the scanner 16 in the main body 11.

[0021] The camera 21 is configured to capture an image of the area in which the operator of the self-checkout POS terminal 10 is captured. The camera 21 includes an imaging element such as a CMOS or a CCD. Image data captured by the camera 21 is subjected to analysis processing (described later) by an image processing unit.

[0022] 2 is a diagram showing an example of a hardware configuration of the self-service POS terminal 10 according to the embodiment. The self-service POS terminal 10 further includes a motor 22, a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, a storage unit 104, and a communication I / F (interface) 105.

[0023] The weighing unit 14, deposit / withdrawal unit 15, scanner 16, touch panel display 17, indicator light 18, card reader 19, printer 20, camera 21, motor 22, CPU 101, ROM 102, RAM 103, memory unit 104 and communication I / F 105 are interconnected via a system bus 109 such as a data bus or address bus.

[0024] Motor 22 (an example of a drive unit that changes the imaging direction of camera 21) is powered by electricity to rotate, and this rotation is transmitted to a support unit that supports camera 21 so that the orientation of camera 21 can be adjusted. By controlling motor 22, the imaging angle of camera 21 can be automatically changed. Changing the orientation of camera 21 changes the imaging range.

[0025] The storage unit 104 is a storage device such as a hard disk drive (HDD), a solid state drive (SSD), or a flash memory. The storage unit 104 stores a control program, a product master, etc. The control program is an operating system and a program for implementing various functions of the self-checkout POS terminal 10.

[0026] The product master stores product information (product information) in association with a product code, which is identification information that can identify the product. The product information includes, for example, the product name, price, and product weight. When the object recognition process is performed in the self-service POS terminal 10, information on matching features may be associated with the product master as product information. The matching features are information for matching that indicate the appearance characteristics of the product. The matching features are parameterized appearance characteristics such as the standard shape, surface color, pattern, and unevenness of the product.

[0027] The CPU 101 is a processor. The ROM 102 is a storage medium that stores various programs and data. The RAM 103 is a storage medium that temporarily stores various programs and data. The CPU 101 uses the RAM 103 as a work area to execute various programs stored in the ROM 102 or the storage unit 104, etc., thereby realizing the control unit 110 (see FIG. 3, described later). The control unit 110 comprehensively controls each unit of the self-service POS terminal 10.

[0028] The processor of the control unit 110 is not limited to the CPU 101, and other processors such as a GPU (Graphics Processing Unit), ASIC (Application Specific Integrated Circuit), or FPGA (Field Programmable Gate Array) may also be used.

[0029] The communication I / F 105 is an interface for the self-checkout POS terminal 10 to communicate with an external device via a network.

[0030] An example of an external device is a server 300. The server 300 is a computer-configured device including a CPU, a ROM, a RAM, a storage unit, etc. The CPU of the server 300 executes programs stored in the ROM and storage unit to implement a control unit 310 (see FIG. 3, described below).

[0031] Another external device is, for example, an information processing device (hereinafter referred to as a management device) operated by an administrator such as a store clerk who manages the self-service POS terminal 10. The management device is, for example, a PC (Personal Computer), a tablet terminal, a smartphone, etc. The management device is connected to, for example, multiple self-service POS terminals 10. Note that any one of the multiple self-service POS terminals 10 connected to each other via a network can also be used as the management device. The management device notifies the store clerk of fraud detection based on notification information from the self-service POS terminal 10.

[0032] Still another external device may be an image processing device that performs image processing such as object recognition processing.

[0033] FIG. 3 is a diagram illustrating an example of the functional configuration of the self-checkout POS terminal 10 and the server 300 according to the embodiment.

[0034] The control unit 110 of the self-service POS terminal 10 functions as various functional units such as a reading unit 111, a registration unit 112, an operation unit 113, a payment unit 114, an imaging unit 115, an acquisition unit 116, and a countermeasure unit 117. The control unit 310 of the server 300 functions as an image processing unit 311.

[0035] In addition, in this embodiment, some or all of the functions realized by the control unit 110 of the self-service POS terminal 10 may be realized in cooperation with an external device of the self-service POS terminal 10, or may be realized by a hardware configuration such as a dedicated circuit installed in the self-service POS terminal 10.

[0036] The reading unit 111 reads and outputs a product code from a code symbol such as a wireless tag or a barcode attached to the product via the scanner 16. The reading unit 111 may also identify the product by object recognition based on image data captured by the camera of the scanner 16.

[0037] The registration unit 112 acquires information (product information) from the product master based on the product code output by the reading unit 111, and registers the acquired product information. Here, registration means storing the acquired product information as sales data in a predetermined storage area (for example, provided in the storage unit 104). Note that the registration unit 112 may register a product specified by an operation input to the touch panel display 17, regardless of the product information output by the reading unit 111.

[0038] The operation unit 113 receives an operation from an operator. More specifically, the operation unit 113 outputs a signal corresponding to the operation input received by the touch panel display 17.

[0039] The settlement unit 114 performs processing (settlement processing) related to the settlement of the products registered by the registration unit 112. For example, the settlement unit 114 calculates the total price of the products registered by the registration unit 112. The settlement unit 114 also calculates the change by subtracting the total amount from the amount inserted into the deposit / withdrawal unit 15. The settlement unit 114 then causes the deposit / withdrawal unit 15 to dispense the change.

[0040] The imaging unit 115 captures an image of the range in which the operator of the self-service POS terminal 10 is captured by the camera 21 and outputs the image. More specifically, the imaging unit 115 controls the camera 21 and outputs (transmits) the captured image output by the camera 21 to the server 300 or the like. The range in which the operator of the self-service POS terminal 10 is captured is a range that includes the position where the operator is expected to be located, which is approximately opposite the operation unit 113 and in front of the self-service POS terminal 10.

[0041] The image processing unit 311 of the server 300 executes a process (analysis process) of analyzing the image captured by the camera 21. In the analysis process, the image processing unit 311 analyzes the captured image using, for example, feature points, and determines from the result (analysis result) whether the imaging direction has deviated from the standard, and outputs (transmits) information indicating the result (determination result) to the self-checkout POS terminal 10.

[0042] Image analysis using feature points will be briefly described. Feature point extraction and comparison are performed using, for example, SIFT (Scale-Invariant Feature Transform). Note that feature point extraction and comparison may also be performed using other methods, such as template matching or deep learning.

[0043] In the analysis process, the image processing unit 311, for example, first selects a plurality of feature points from the captured image and records the coordinates and patterns of the feature points. The captured images to be analyzed are a reference image and an image captured during operation. The reference image is an image captured when the self-service POS terminal 10 is installed or when it is started up before opening. The image captured during operation is an image captured while registration processing or payment processing is being performed.

[0044] Next, the image processing unit 311 compares the coordinates and pattern of feature points extracted from the reference captured image with the coordinates and pattern of feature points extracted from the image captured during operation. Through this comparison, the image processing unit 311 performs matching of feature points. In matching, the image processing unit 311 converts the degree of similarity of the patterns into a numerical value (similarity) and determines that feature points with a high degree of similarity correspond to each other.

[0045] Next, the image processing unit 311 determines whether the coordinates of the feature points found to correspond in the above-mentioned matching process differ between the reference captured image and the image captured during operation, and if so, determines the degree of difference.

[0046] For example, the image processing unit 311 determines whether the difference in coordinate position exceeds a threshold value. The threshold value is a value appropriate as a limit value for allowing deviation, and is set in advance and stored in a predetermined storage area (for example, the storage unit 104). Next, if the difference in the coordinate position of the feature point exceeds the threshold value, the image processing unit 311 determines that the orientation of the camera 21 is misaligned.

[0047] The above processing will be described with reference to the drawings. Fig. 4 and Fig. 5 are diagrams showing examples of captured images by camera 21 according to the embodiment, with Fig. 4 being an example of a reference captured image 510 and Fig. 5 being an example of an image 520 captured during operation. The captured images 510 and 520 shown in Fig. 4 and Fig. 5 show the interior of the store. The captured image 520 during operation shows an area slightly to the left of the reference captured image 510. In other words, the orientation of camera 21 during operation is shifted slightly to the left compared to the reference time.

[0048] As shown in Fig. 4, feature points A to E are selected from a captured image 510 that is used as a reference. Furthermore, as shown in Fig. 5, feature points A, C, and D that correspond to those in the captured image 510 that is used as a reference are selected from a captured image 520 that is used in operation. In this way, the correspondence of feature points does not need to be such that all of the feature points contained in the captured image 510 that is used as a reference are also contained in the captured image 520 that is used in operation; it is sufficient if some of the feature points are included.

[0049] In this case, the difference in the coordinate positions of feature points A, C, and D in both captured images 510 and 520 is calculated and compared with a threshold. If the difference exceeds the threshold, it can be determined that the tolerance for deviation has been exceeded, and image processing unit 311 determines that the imaging direction of camera 21 has deviated from the reference. In this way, image processing unit 311 can detect deviation of camera 21 from the reference time by analyzing the captured images of camera 21.

[0050] After completing the determination, the image processing unit 311 transmits to the self-checkout POS terminal 10 information indicating whether or not the imaging direction of the camera 21 is deviated from the reference.

[0051] 3, the acquisition unit 116 acquires information indicating whether or not the imaging direction of the camera 21 deviates from the standard by receiving the above-mentioned determination result output by the image processing unit 311 from the server 300. If the determination result indicates that the imaging direction deviates from the standard, the acquisition unit 116 outputs information (a signal) to request the countermeasure unit 117 to take countermeasures.

[0052] When the acquisition unit 116 acquires information indicating that the imaging direction of the camera 21 is deviated from the standard, the countermeasure unit 117 performs countermeasure processing to prevent unauthorized operations by the operator. Specifically, in the countermeasure processing, the countermeasure unit 117 executes the following, for example.

[0053] Countermeasure unit 117 stops the progress of the registration process by registration unit 112 and the progress of the payment process by payment unit 114. More specifically, countermeasure unit 117 makes the registration process impossible to execute if the registration process by registration unit 112 has not been executed, and temporarily suspends or cancels the registration process if the registration process by registration unit 112 is being executed. Furthermore, countermeasure unit 117 makes the payment process impossible to execute if the payment process by payment unit 114 has not been executed, and temporarily suspends or cancels the payment process if the payment process by payment unit 114 is being executed.

[0054] Furthermore, the countermeasure unit 117 sends a notification to a device (management device) that can be referenced by the store clerk, informing the store clerk that the imaging direction of the camera 21 has deviated from the standard. The store clerk who receives this notification can take appropriate measures.

[0055] Furthermore, the countermeasure unit 117 may control the motor 22 to change the imaging direction of the camera 21 so as to bring it closer to the reference.

[0056] Hereinafter, the flow of processing executed by the self-service POS terminal 10 according to the embodiment will be described with reference to the drawings. Fig. 6 is a flowchart showing an example of processing executed by the self-service POS terminal 10 according to the embodiment.

[0057] When an image is captured by the camera 21 (step S1), the control unit 110 proceeds to image processing (step S2). In this embodiment, image processing is performed by the server 300, so the control unit 110 outputs the captured image to the server 300.

[0058] Next, the control unit 110 acquires the result of the image processing (step S3). In this embodiment, the image processing is performed by the server 300, so the control unit 110 receives the result of the image processing from the server 300. The result of the image processing is the result of analysis by the image processing, and as a specific example, is information indicating that the imaging direction of the camera 21 is deviated from the standard.

[0059] Next, based on the information acquired in step S3, control unit 110 determines whether or not there is a deviation in the imaging direction of camera 21 (step S4). If it is determined that there is no deviation (No in step S4), control unit 110 returns to the beginning of the process.

[0060] If it is determined in step S4 that there is a deviation in the imaging direction of camera 21 (Yes in step S4), control unit 110 performs countermeasure processing (step S5). In the countermeasure processing, control unit 110 (countermeasure unit 117) performs, for example, stopping the progress of the registration processing by registration unit 112, stopping the progress of the payment processing by payment unit 114, and further transmitting a notification to the management device.

[0061] The registration process and the payment process are resumed, for example, when a store clerk who has checked the self-service POS terminal 10 cancels the stop operation. In addition, if the control unit 110 (countermeasure unit 117) does not automatically correct the imaging direction of the camera 21 by controlling the motor 22, the store clerk who has come to check the self-service POS terminal 10 manually corrects the imaging direction of the camera 21 and then performs an operation to resume the registration process and the payment process.

[0062] According to the above-described embodiment, if the imaging direction of the camera 21 has changed from the standard direction, this can be detected and deemed to be an abnormality. Furthermore, according to the above-described embodiment, if the image captured by the camera 21 is abnormal, the progress of the registration process or the payment process can be stopped, thereby preventing problems from occurring in the sales data processing. This allows the camera 21 to appropriately detect operational errors and fraudulent activities.

[0063] In the above embodiment, the image processing unit 311 outputs information indicating the determination result as to whether or not the imaging direction deviates from the reference to the acquisition unit 116. However, in practice, the image processing unit 311 may output other information such as the following:

[0064] For example, the image processing unit 311 may output information indicating the result of analyzing the captured image (analysis result) itself, rather than the judgment result, to the self-service POS terminal 10. In this case, the acquisition unit 116 of the self-service POS terminal 10 determines whether or not the imaging direction has deviated from the standard based on the analysis result, and obtains (acquires) the judgment result.

[0065] Furthermore, image processing unit 311 may output information indicating that the imaging direction deviates from the standard only when it is determined that the imaging direction deviates from the standard. In other words, information indicating that the imaging direction of camera 21 has not deviated from the standard, among the determination results of image processing unit 311, may be excluded from information to be output to acquisition unit 116.

[0066] Furthermore, the self-checkout POS terminal 10 may be provided with the image processing unit 311 that performs the analysis process.

[0067] Furthermore, in the above embodiment, the self-service POS terminal 10 equipped with one camera 21 has been described as an example, but some sales data processing devices and accounting devices are equipped with two or more cameras 21. Therefore, in practice, the technology of the embodiment may be applied to a device equipped with two or more cameras 21. In that case, the technology of the above embodiment may be applied to all of the cameras 21, or may be applied to some of the cameras 21.

[0068] Furthermore, in a sales data processing device or accounting device equipped with two or more cameras 21, the imaging range of each camera 21 is considered to be set differently, for example, one camera images the operator's hands, another camera images the operator's face, and another camera images the inside of the store. Even in such a case, according to the above embodiment, by preparing a reference captured image 510 for each camera 21 and analyzing captured images 520 during operation, it is possible to determine whether or not the camera 21 is misaligned.

[0069] Furthermore, even if the camera 21, the imaging unit 115, and the motor 22 constitute a separate monitoring camera that is not included in the self-service POS terminal 10, the countermeasure processing by the countermeasure unit 117 may be performed in the same manner.

[0070] Although the self-service POS terminal 10 in the above embodiment is equipped with a cash deposit / withdrawal unit 15, for example, if the self-service POS terminal 10 is configured as a cashless terminal that does not handle cash, the cash deposit / withdrawal unit 15 may not be provided.

[0071] The above-described embodiment can be modified as needed by partially changing the configuration or functions of each of the above-described devices. Therefore, several modifications of the above-described embodiment will be described below as other embodiments. The following mainly describes differences from the above-described embodiment, and the same reference numerals will be used for common features with the content already described, and detailed description will be omitted. The modifications described below may be implemented individually or in appropriate combination.

[0072] (Second embodiment) In this embodiment, an example in which the technology of the above embodiment is applied to a semi-self-service type POS terminal (hereinafter referred to as a semi-self-service POS terminal) will be described. The semi-self-service POS terminal is an example of a checkout device, in which a shopper acts as an operator to perform operations related to payment processing after product registration.

[0073] In this embodiment, the registration process prior to the payment process is performed, for example, by a store clerk operating a regular POS terminal. However, the registration process may also be performed by the shopper themselves. For example, the shopper registers the product by operating a POS application (smartphone POS) launched on the shopper's smartphone or by operating a cart POS (a terminal attached to a cart provided in the store).

[0074] The semi-self-service POS terminal has a configuration in which the scanner 16, the reading unit 111, the registration unit 112, etc. are removed from the self-service POS terminal 10 in the above embodiment. Alternatively, the self-service POS terminal 10 may operate as a semi-self-service POS terminal by setting these units (the scanner 16, the reading unit 111, the registration unit 112, etc.) to an inoperative state.

[0075] In this embodiment, too, the control unit 110 functions as shown in the flowchart of Fig. 6. In the countermeasure processing (step S5) in this embodiment, the control unit 110 stops the progress of the payment processing by the payment unit 114, and also, if necessary, sends a notification to the management device and controls the motor 22 to automatically correct the imaging direction of the camera 21.

[0076] In this way, according to the semi-self-service POS terminal of the second embodiment, as in the first embodiment, it is possible to prevent inconveniences in sales data processing when the image captured by the camera 21, which is used to detect operational errors or fraudulent activities, is abnormal.

[0077] The program executed by each device in the above embodiment has a modular configuration including the above-mentioned units (reading unit 111, registration unit 112, operation unit 113, settlement unit 114, imaging unit 115, acquisition unit 116, countermeasure unit 117, and image processing unit 311) as needed. The CPU (processor) loads the above-mentioned units onto the main storage device by reading and executing the program from the storage medium. As a result, the reading unit 111, registration unit 112, operation unit 113, settlement unit 114, imaging unit 115, acquisition unit 116, countermeasure unit 117, and image processing unit 311 are generated on the main storage device.

[0078] The programs executed by each device in the above-described embodiments are provided in advance in a ROM, etc. The programs executed by each device in the above-described embodiments may be provided by being recorded in an installable or executable file format on a computer-readable recording medium such as a CD-ROM, a flexible disk (FD), a CD-R, or a digital versatile disk (DVD).

[0079] Furthermore, the programs executed by each device in the above-described embodiments may be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network. Also, the programs executed by each device in the above-described embodiments may be provided or distributed via a network such as the Internet.

[0080] Although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be embodied in various other forms, and various omissions, substitutions, modifications, and combinations can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope and spirit of the invention, and are also included in the scope of the invention and its equivalents as defined in the claims. [Explanation of symbols]

[0081] 10... Self-service POS terminals, 11...Main body, 12...Basket stand, 13...Bagging table, 131...base, 132...bag hook, 133...temporary stand, 134...support, 14...Measuring part, 15... Deposit and withdrawal section, 16...scanner, 161...reading window, 17...Touch panel display, 18...Indicator light, 19...Card reader, 20...printer, 21...camera, 22...motor, 101...CPU, 102...ROM, 103...RAM, 104...storage unit, 105...communication I / F, 109...system bus, 110...control unit, 111...reading unit, 112...registration unit, 113...operation unit, 114...payment unit, 115...imaging unit, 116...acquisition unit, 117...countermeasure unit, 300...server, 310...controller, 311...image processor, 510,520...Image capture. [Prior art documents] [Patent documents]

[0082] [Patent Document 1] Japanese Patent Application Laid-Open No. 2001-359086

Claims

1. a registration unit that performs a registration process to store information about the product to be traded in a predetermined storage unit; a payment unit that performs payment processing for the products registered by the registration unit; an operation unit that accepts operations by an operator; an acquisition unit that acquires information obtained by analyzing an image captured by a camera of a range in which the operator is captured, the information indicating that the imaging direction of the camera is deviated from a reference; a countermeasure unit that, when the acquisition unit acquires the information, performs a countermeasure process to prevent an unauthorized operation by an operator, and stops the progress of the registration process or the payment process in the countermeasure process; A sales data processing device comprising:

2. In the countermeasure processing, the countermeasure unit transmits a notification to a device that can be referenced by a store clerk, informing the store clerk that the imaging direction of the camera is deviated from the standard. The sales data processing device according to claim 1 .

3. In the countermeasure processing, the countermeasure unit controls a drive unit that changes the imaging direction of the camera to bring the imaging direction of the camera closer to a reference. The sales data processing device according to claim 1 .

4. a payment unit that performs payment processing for the products registered as trading targets; an operation unit that accepts operations by an operator; an acquisition unit that acquires information obtained by analyzing an image captured by a camera of a range in which the operator is captured, the information indicating that the imaging direction of the camera is deviated from a reference; a countermeasure unit that, when the acquisition unit acquires the information, performs a countermeasure process to prevent an unauthorized operation by an operator, and stops the progress of the settlement process in the countermeasure process; An accounting device comprising:

5. a computer of a device that has an operation unit that accepts operations by an operator, and that executes at least one of a registration process that stores information about a commodity to be traded in a predetermined storage unit, and a payment process for paying for the commodity stored in the storage unit; an acquisition unit that acquires information obtained by analyzing an image captured by a camera of a range in which the operator is captured, the information indicating that the imaging direction of the camera is deviated from a reference; a countermeasure unit that, when the acquisition unit acquires the information, performs a countermeasure process to prevent an unauthorized operation by an operator, and stops the progress of the registration process or the payment process in the countermeasure process; A program to function as a

6. In the countermeasure processing, the countermeasure unit transmits a notification to a device that can be referenced by a store clerk, informing the store clerk that the imaging direction of the camera deviates from the standard. The program according to claim 5.

Images