Information Processing Method, Information Processing Apparatus, Program, and Information Processing System

Abstract

To provide an information processing method, an information processing apparatus, a program, and an information processing system in which accounting processing can be carried out with lessor burden and labor.SOLUTION: The present invention is directed to an information processing method including: acquiring article image data including image data of specific information for specifying a certain article and image data of a price of the certain article; generating data of an order reception image including an operation button for use in reception of an order of the certain article on the basis of the article image data; generating article data represented by the operation button and in which the certain article is associated with the price of the certain article on the basis of the article image data; displaying the order reception image corresponding to the data of the generated order reception image on a display screen so that an operation on the operation button can be received; discriminating whether the operation on the operation button included in the order reception image displayed on the display screen is carried out; and, if it is determined that the operation on the operation button is carried out, generating sales data on the basis of the article data of the certain article.SELECTED DRAWING: Figure 7

Description

Technical Field

[0001] This invention relates to an information processing method, an information processing apparatus, a program, and an information processing system.

Background Art

[0002] In a register (cash register, commonly known as a "cashier") used for accounting in commercial facilities such as retail stores, generally, a product name and an amount are associated with each other, and sales are recorded by operating buttons corresponding to the ordered products. Patent Document 1 discloses a technique in which, in a store terminal such as a tablet terminal, a user designates a range for reading a product name, a price, etc. with respect to an image of a menu list, reads characters in the designated image range, generates data associating a product with a price, and registers this in a menu information database.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the prior art, the labor of user operations for receiving product orders and performing accounting processing at a register cannot be sufficiently reduced.

[0005] An object of this invention is to provide an information processing method, an information processing apparatus, a program, and an information processing system that enable accounting processing of products with less labor.

Means for Solving the Problems

[0006] To achieve the above object, this invention is Operated by the store clerk an information processing method executed by a computer, Obtain a menu image that includes a combination of a product name identifying a certain product and the price of the certain product, the menu image including the product name identifying the certain product extracted therefrom and the price of the certain product, and Generate an order reception image including an operation button for receiving an order for the certain product, based on the operation by the store clerk of associating the product name identifying the certain product extracted from the menu image with the price of the certain product, Generate product data associating the certain product with the price of the certain product, caused the generated order reception image to be displayed When an operation of the operation button included in the display screen is performed, based on the product data of the certain product Generate sales data for the certain product This is an information processing method.

Advantages of the Invention

[0007] According to the present invention, there is an effect that it becomes possible to perform accounting processing of products with less labor.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Embodiments for Carrying Out the Invention

[0009] Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram showing the configuration of the information processing system 100 of the present embodiment. The information processing system 100 includes an information processing apparatus 1 and a register 4 (external device).

[0010] The information processing apparatus 1 is a portable general-purpose terminal electronic device, for example, a smartphone. The information processing apparatus 1 includes a CPU 11 (Central Processing Unit) (processing unit), a storage unit 12, a display unit 13, an operation reception unit 14, a photographing unit 15, a communication unit 16 (first communication unit), and the like.

[0011] The CPU 11 is a hardware processor that performs arithmetic processing and controls the operation of the information processing apparatus 1 in an integrated manner. The CPU 11 may be a single processor, or may have a plurality of processors that perform common processing in parallel or perform different processing separately. At least this CPU 11 is included in the computer of the present embodiment.

[0012] The storage unit 12 has a memory for storing data. The storage unit 12 includes a RAM that provides a working memory space for the CPU 11 and stores temporary data, and a non-volatile memory that stores a program 121, setting data, and the like. The RAM is, for example, a DRAM, and the non-volatile memory is, for example, a flash memory. The program 121 includes a program related to a function (OCR) for identifying characters from image data and a register accounting support application described later. The setting data stored in the non-volatile memory includes order reception image data 122 for order input operations used in the register accounting support application, a product name selected by an operation received via the order reception image data 122, and a product list 123 that stores the sales amount corresponding to the product name.

[0013] The display unit 13 has a display screen and performs display on the display screen based on the control of the CPU 11. The display screen is, for example, a liquid crystal display (LCD), although it is not particularly limited. Further, the display unit 13 may have an LED lamp for notifying statuses such as the operating state and the charging state.

[0014] The operation reception unit 14 receives an input operation from the outside such as a user, generates an input signal, and outputs the input signal to the CPU 11. The operation reception unit 14 has, for example, a touch panel located overlapping the display screen. Further, the operation reception unit 14 may have a push button switch, a slide switch, or the like.

[0015] The imaging unit 15 is a digital camera that performs an imaging operation to generate and output image data. The imaging unit 15 has, for example, a lens (optical system) and a two-dimensionally arranged CMOS sensor, and performs imaging in each wavelength band of RGB to generate color image data.

[0016] The communication unit 16 performs wireless communication with an external device. The wireless communication that can be controlled by the communication unit 16 includes telephone communication, wireless LAN (Local Area Network) such as WiFi, and short-range wireless communication such as Bluetooth (registered trademark). The communication unit 16 has antennas according to the frequencies and polarization characteristics of the possible communications, respectively. Bluetooth is used here for communication with the register 4. The Bluetooth standard is not particularly limited. For example, by using the Low Energy standard, the power consumption can be suppressed to a small level even when the connection state is maintained during business hours.

[0017] The register 4 is a money register (cash register) located in a store or the like and used for accounting processing. The register 4 includes a CPU 41 (control unit), a storage unit 42, a display unit 43, an operation reception unit 44, a communication unit 46 (second communication unit), a printing unit 47, a paper conveyance unit 48, and the like.

[0018] The CPU 41 performs arithmetic processing and overall controls the operation of the register 4. The CPU 41 may have not only a general-purpose CPU but also a microcomputer or the like. Also, part of the arithmetic processing of the CPU 41 may be performed by a dedicated logic circuit or the like.

[0019] The storage unit 42 has a memory for storing data. The storage unit 42 may provide a working memory space for the CPU 41 and include a RAM for storing temporary data and a non-volatile memory for storing the program 421, setting data, sales information, etc. The non-volatile memory may be, for example, a flash memory. The setting data may include an input setting 422 indicating the relationship between the registered product name, the price of the product, and the positions of the reception buttons of the operation reception unit 44 corresponding thereto.

[0020] The display unit 43 has a display screen and performs a display such as an amount on the display screen based on the control of the CPU 41. The display screen is, for example, an LCD, but is not limited thereto.

[0021] The operation reception unit 44 receives an input operation from the outside such as a user and generates an operation signal, and outputs the operation signal to the CPU 41. The operation reception unit 44 can perform input operations such as the sales amount of a product and the amount received from a customer. Also, as described above, the operation reception unit 44 includes a registration button through which the sales of the product assigned by the input setting 422 can be directly input.

[0022] The communication unit 46 controls communication with an external device, here, the information processing apparatus 1. The communication unit 46 can communicate with the information processing apparatus 1 using a common communication standard, and here, controls Bluetooth communication via an antenna (not shown).

[0023] The printing unit 47 prints and records sales information on a receipt paper. The recording method of the printing unit 47 is not particularly limited, and may be, for example, a thermal transfer method or the like.

[0024] The paper conveyance unit 48 moves the receipt paper by an appropriate length at an appropriate timing, and supplies and discharges it to the position where printing and recording are performed. The paper conveyance unit 48 has, for example, a rotating roller and a motor, and rotates the rotating roller to which the roll-shaped receipt paper is attached by the motor to perform an operation of feeding out the receipt paper.

[0025] Next, the accounting process in the information processing system 100 of the present embodiment will be described. In the information processing system 100, the final accounting process is performed by the register 4. The register 4 can perform normal accounting processes, such as inputting and adding the sales amount of each product, calculating and adding the non-taxable portion of consumption tax as needed, or subtracting discounts. The price of the product may be associated with the product to be sold and registered in a specific key or the like. In the register 4, the user such as a store clerk operates (presses) the key corresponding to the product for which an order has been received, and the price of the product may be added as the sales amount. However, it is also possible to directly input the price itself by operating (pressing) the numeric keypad. Note that the product may be a service (service) in addition to or instead of an article.

[0026] In addition to this, the register 4 can acquire sales data from the information processing device 1 via the communication unit 46. In the information processing device 1, the sales amount of the ordered product (a certain product) and simple product information (specific information) are transmitted to the register 4 via the communication unit 16 by the operation of the program 121 related to the generation of sales data. The generation of sales data in the information processing device 1 is performed using the display screen on which the order reception image created by capturing (acquiring) the photographed data (product image data) of the menu table created for presentation to customers or the like is displayed.

[0027] Figure 2 is a diagram for explaining the menu table M. As shown in Fig. 2(a), the menu list M is a product image of the present embodiment. For example, an image of a food and beverage menu (including characters) in a restaurant and an image of its price (an image of alphanumeric characters) are shown in association with each other. The menu list M may be handwritten or a copy of a handwritten one, etc., or may be created by a restaurant staff member or the like in an arbitrary arrangement using an application program such as a drawing tool or a painting tool.

[0028] Here, in the menu list M, menus such as a plurality of sets and set meals are described block by block, and some menus are displayed together with photos or the like. That is, this menu list M is not necessarily created as text data in which the product name (display of specific information) and the display of its price are explicitly associated with each other in order to facilitate the customer to select the product to be ordered and register the product in the register 4.

[0029] After this menu list M is photographed by the photographing unit 15 (camera) of the information processing apparatus 1 or the like to obtain menu image data, characters and numbers (which may include symbols indicating prices) are identified using OCR software of the program 121 or the like, and as shown in Fig. 2(b), a character string or a number string can be extracted. These character strings and number strings are candidates for operation buttons indicating product names.

[0030] Fig. 3 is a diagram for explaining the setting of products and prices. Here, only the part of "Set A" located in the center of the upper row in the menu image data shown in Fig. 2(b) will be taken up for explanation, but the same setting process will be sequentially or collectively performed for other parts.

[0031] As shown in Fig. 3(a), the extracted character strings and number strings are each shown with a simple outer frame or as operation buttons on which the planar view shape of a push button switch is drawn. Among these, first, a screen for selecting a product name (menu name, specific information of a product) is displayed. When an operation of selecting an operation button indicating any product name (for example, an operation of overlapping the cursor on the display range of the operation button and clicking it with a pointing device such as a mouse, an operation of tapping the display range with a finger, etc. Hereinafter, this operation will be referred to as the operation of the operation button) is performed (here, for example, "Soy Sauce Ramen (Small)"), as shown in Fig. 3(b), a screen for selecting the amount corresponding to the product name (the amount of a product) is displayed. Here, by selecting the one located on the upper side among the two "950 yen", "950" is set in "yen" units as the amount of "Soy Sauce Ramen (Small)". That is, when a character indicating a currency unit or the like is included in the character / number string indicating the selected amount, the currency unit may be appropriately identified. In addition, when auxiliary units such as cents may be included for dollars or euros, these units (breaks) may be appropriately discriminated. Thereby, a certain product and the amount of the product are associated with each other. The character string (number string) shown as the amount may be excluded from the candidates of the operation button, but considering cases such as when a single amount is shown for a plurality of products, it may be left as a selectable candidate for the operation button as the amount again.

[0032] The process of accepting the operation of the operation button including the above product name (specific information) and the corresponding amount is repeatedly performed for all products. When all the products and the operation buttons for the amounts of the products are operated and the operation button E for selection end is operated on the screen with a pointing device or the like, as shown in Fig. 3(c), the character strings of the remaining operation buttons that have not been operated are excluded from the display setting as the operation button.

[0033] Fig. 4 is a diagram for explaining the discount setting. Here, the part of the menu related to the ramen located on the upper left side among the menu image data shown in Fig. 2(b) will be explained.

[0034] As shown in FIG. 4(a), in addition to ordinary products, the display of the amount of change (price fluctuation information) related to a temporary discount or surcharge of an amount such as "100 yen off!!" can also be included in the order target. Here, "100 yen off" is regarded as the product name (specific information) and is displayed as the operation button R1 (change button). At the same time, "-100" may be registered as the amount. Here, an example of a fixed discount is shown, but in the case of a discount, a ratio may be specified. The discount may be applied to the amount of the product ordered most recently. In addition to discounts, there may also be surcharges, etc. This can be displayed and used, for example, in the case of a late-night surcharge. In addition, similar to the setting of the register 4 described above, in the information processing apparatus 1, the product may include a service in addition to or instead of the article. When the confirmation button C is operated, the display content of the order reception image is confirmed.

[0035] Note that this "100 yen off" is time-limited from "AM11:00 - 11:30". In the information processing apparatus 1, this may be read or, based on a user operation, the operation button for "100 yen off" may be made operable only during the discount time period. As shown in FIG. 4(b), outside the target time, the operation button R2 may be displayed in a non-operable state, or alternatively, the operation button R2 itself may be erased outside the target time.

[0036] FIG. 5 is a diagram for explaining the application of the discount. In the above description, it was defined that the user would input an operation for a discount of 100 yen. However, based on the setting of the discounted items and time zone, it may be set so that the amount of the automatically applied discount can be set and displayed instead. With respect to the display (the second order reception image) in the normal time zone amount setting shown in Fig. 5(a), according to the date and time being measured by the information processing apparatus 1, the amounts Rd of "soy sauce ramen", "salt ramen", and "miso ramen" are automatically discounted by 100 yen for display (Fig. 5(b), the first order reception image). Multiple types of order reception image data corresponding to whether or not the application conditions are satisfied are defined. The display of the discounted amount may be such that the display color or background color is changed or it is surrounded by a frame or the like so that it can be understood that it is the discounted price. Alternatively, a specific mark or symbol indicating a discount / surcharge may be displayed attached to the amount.

[0037] The data of these multiple types (here, two types) of order reception images may be generated together when setting the products and amounts based on menu image data or the like. Also, when the image data is display data such as HTML, it may be defined so that a plurality of display patterns are integrally included in a single data file and selectively displayed. The amount setting of the product may be such that amounts corresponding to the presence or absence of a discount or surcharge are respectively associated and stored, or the original amount and the discount / surcharge amount may be respectively associated and stored.

[0038] Note that instead of the user specifying all the product names and corresponding amounts, the product name and the amount corresponding to the product name may be estimated first. In this case, a numerical string, particularly one including a currency unit, is first estimated as the amount, and the position corresponding to the estimated amount, for example, a character string positioned side by side horizontally, is estimated as the product name. Errors in the estimation can be corrected by an input operation by the user.

[0039] FIG. 6 is a flowchart showing the control procedure by the CPU 11 of the external device control process executed in the information processing apparatus 1. This external device control process including the information processing method of the present embodiment is performed, for example, in advance such as before the opening of a store. The external device control process is started when the cash register auxiliary application is activated in the information processing apparatus 1 and an operation to start setting within the application is received.

[0040] The CPU 11 acquires the photographed data of the menu list M (step S101; image acquisition step, image acquisition means). The photographed data may be selected from a file list or the like of photographed data that has been photographed in advance and stored and held in the storage unit 12 or a drive or folder on an external network, or guidance may be provided to cause the user to take a photograph with the photographing unit 15 within the process of step S101.

[0041] The CPU 11 identifies and extracts the characters (text part) of the acquired photographed data of the menu list M and generates text data having the position information of the characters (step S102). The CPU 11 divides the text data for each description part, buttonizes the operation within each position range, and displays it (step S103). Further, the CPU 11 also displays the product selection end button E.

[0042] The CPU 11 determines whether or not the selection end button E related to the end of product selection has been operated (step S104). If it is determined that the product selection end button E has not been operated (''NO'' in step S104), the CPU 11 determines whether or not the operation button generated in step S103 has been operated (step S105). If it is determined that the operation button has not been operated (''NO'' in step S105), the process of the CPU 11 returns to step S104.

[0043] When it is determined that an operation button has been operated (i.e., "YES" in step S105), the CPU 11 highlights (selects) and displays the selected button display portion as the product name (step S106). The CPU 11 determines whether an operation of an operation button indicating the price of the highlighted product has been received (step S107). When it is determined that an operation of an operation button has not been received (i.e., "NO" in step S107), the CPU 11 repeats the process of step S107.

[0044] When it is determined that an operation of an operation button has been received (i.e., "YES" in step S107), the CPU 11 reads a number from the text of the operation button for which the operation has been received, determines it as the price, and stores the price in association with the product name obtained previously (step S108). At this time, the CPU 11 may display the combination of the price and the product name in a modifiable state and wait for a modification operation and an approval operation. Also, when the product name and the price are not appropriately separated (for example, when "Large serving" and "110 yen" are determined to be a series of texts), for example, after registering the text as both the product name and the price, a modification process such as shortening the product name to only the "Large serving" part may be performed. Only the number "110" can be extracted as the price.

[0045] The CPU 11 makes the operation button on which the product is displayed be fixedly displayed, and also cancels the button display of the operation button on which the price is displayed (step S109). Then, the process of the CPU 11 returns to step S104.

[0046] In the determination process of step S104, when it is determined that the operation button E of the product selection end button has been operated ( "YES" in step S104), the CPU 11 cancels all the button displays of the remaining (unoperated operation buttons) (step S111). The CPU 11 generates the order reception image data 122 in a finalized manner, including the button display of the finalized product (step S112). Note that the CPU 11 may perform processes such as appropriately filling in blank spaces and rearranging them before finalizing the order reception image data 122. Also, it may be possible to accept an operation to delete unnecessary character strings and the like for the order operation. The processes of steps S102 to S112 constitute an image generation step (image generation means of the program).

[0047] The CPU 11 collectively sets and stores the pairs of product names (specific information) and amounts stored in association in the process of step S108 as a product list 123 (step S113; list data generation step, list data generation means). Then, the CPU 11 ends the external device control process.

[0048] FIG. 7 is a diagram showing an example of an order reception screen generated by the above external device control process. As shown in FIG. 7(a), an image (order reception image O) is displayed on the order reception screen (display screen) according to the order reception image data generated by the external setting control process of FIG. 6. In this order reception image O, the portions where the product names set in the external setting control process are displayed are included as selection operation buttons B1 to B3, and each selection operation button B1 to B3 can be operated at the time of ordering. When the information processing device 1 is a smartphone, if the order reception image O for all products cannot fit on the order reception screen at once due to the screen size, scroll display may be possible, or it may be possible to display in multiple pages. When displaying in multiple screens, operation buttons (for example, operation buttons B4 and B5 for "previous page" and "next page") for changing the displayed page may be additionally displayed. In addition, a subtotal button T (which may be displayed as "checkout", etc.) for receiving a subtotal operation indicating the end of the order operation is added to this order reception screen (order reception image O).

[0049] In the order reception image O, product images, etc. may be appropriately deleted as they are not necessary for the order operation. Accordingly, unnecessary spaces (blanks), etc. may be deleted as described above, or the positions of the operation buttons may be rearranged appropriately. Also, font types, sizes, etc. representing characters and numbers may be uniformly predetermined.

[0050] Some of the character strings that have no direct relation to the product name and are not set as the product name may be necessary for grouping products, etc., so they do not necessarily have to be uniformly deleted. Whether or not to delete these character strings may be determined according to the user's input operation. Here, the character string "Set A" representing the set menu group is information necessary for identifying the ordered product, so this character string is left in the order reception image data without being deleted. Also, the character string "gyoza" is information for identifying the contents of Set A, so this character string may also be left in the order reception image data without being deleted, or may be deleted if it is unnecessary information for the store clerk. Alternatively, on the other hand, even if the characters are unnecessary for space or accounting processing, the positional relationship in the original menu table M may be generally maintained without significant changes such as deletion. That is, images and the like included in the menu table M may be left as they are in the order reception image O. As a result, the sales setting operation can be performed with a positional relationship almost as in the menu table, so that the store clerk can be prevented from having difficulty in searching for the products subject to sales on the screen.

[0051] In the information processing apparatus 1, an order reception image O including operation buttons capable of receiving operations on the generated order reception screen is displayed, and by detecting operations of each operation button, an order can be received. Based on the product name of the ordered product and the information on the amount associated with the product name, sales data of the ordered product is generated. The generated sales data is transmitted to the register 4 by the communication unit 16. In addition, when orders can be placed from a plurality of seats or tables respectively, identification information for identifying the seat or table may be included in the sales data and transmitted.

[0052] Although not particularly limited, here, as shown in FIG. 7(b), the products and their amounts transmitted to the register 4 as sales data are displayed in the ordered column. In the register 4, information on the product name and the amount is received and added to the accounting details. When the operation of the subtotal button T is performed, it is assumed that the order has been completed, and the accounting process in the register 4 can be terminated. In addition, the accounting process in the register 4 may be made terminable regardless of the operation of the subtotal button T.

[0053] Note that the accounting details may include, in addition to the sales data received from the information processing apparatus 1, sales data directly received by the register 4. In the case of standard products and the like where there are products registered in the register 4, or when there are sales of non-standard menus that have not been set in the information processing apparatus 1 either, the sales amount and the like may be directly input to the register 4 in some cases. Accounting processing is performed based on the finally input sales amount, and a receipt is printed and output.

[0054] Also, when the register 4 holds the sales history for today, etc., the sales amount received from the information processing apparatus 1 may be processed collectively, or may be classified according to the product name (specific information) received together.

[0055] FIG. 8 is a diagram for explaining the flow of operations related to accounting processing. As shown in the sequence diagram of FIG. 8(a), when the information processing apparatus 1 receives a startup operation of the application by the user, the application is started, an order reception screen is displayed, and a communication connection is established with the register 4.

[0056] When the user operates the operation button corresponding to the product ordered on the order reception screen, the information processing apparatus 1 identifies the ordered product and its amount. Then, sales data is generated based on the identified product and the amount of the product, and the generated sales data is transmitted to the register 4.

[0057] The register 4 performs overall accounting processing based on the sales data received from the information processing apparatus 1. At this time, if a separate sales input operation has been made / is being made in the register 4, the sales amount related to the received sales data and the sales amount related to the input operation to the register 4 may be totaled (including a negative amount due to discounts, etc.). When the charge transaction with the customer is completed, a receipt is printed and output.

[0058] FIG. 8(b) is a flowchart showing the control procedure by the CPU 11 of the sales setting control process executed in the information processing apparatus 1. When the sales setting control process is started, the CPU 11 reads out the order reception image data 122 and displays the order reception image O on the display screen (step S141; display control step, display control means). The CPU 11 establishes a Bluetooth communication connection with the register 4 (step S142).

[0059] The CPU 11 determines whether an operation of the subtotal button T has been received (step S143). If it is determined that the operation of the subtotal button T has not been received (in step S143, "NO"), the CPU 11 determines whether an operation of an operation button for receiving an order of a product (menu) has been received (step S144; operation determination step, operation determination means). If it is determined that the operation of the operation button has not been received (in step S144, "NO"), the process of the CPU 11 returns to step S143.

[0060] When it is determined that the operation of the operation button has been received (in step S144, "YES"), the CPU 11 refers to the product list 123 to identify information such as the amount of the product corresponding to the operated operation button, and generates and stores sales data based on the identified content. (Step S145; sales data generation step, sales data generation means). The CPU 11 transmits the generated sales data to the register 4 via Bluetooth through the communication unit 16 (step S146). The CPU 11 causes the display unit 13 to display the set sales content on the display screen (step S147). Then, the process of the CPU 11 returns to step S143.

[0061] Also, in the determination process of step S143, if it is determined that the operation of the subtotal button T has been received (in step S143, "YES"), the CPU 11 transmits a message indicating the end of the order to the register 4 via Bluetooth through the communication unit 16 (step S151). The CPU 11 initializes the set sales content (step S152), and also erases the sales content displayed on the display screen (step S153). Then, the process of the CPU 11 returns to step S143.

[0062] Note that this process may be forcibly terminated by an interrupt process in response to an end command of the register accounting assistance application or the like.

[0063] As described above, in the information processing method of the present embodiment, product image data (such as the photographed data of the menu table M) including image data of specific information such as a product name for specifying a certain product and image data of the price of the certain product is acquired (step S101). Based on the product image data, data of an order reception image O including selection operation buttons (B1 to B3) for receiving an order for a certain product is generated (steps S102 to S112). Also, based on the data of the product image (menu table M), a product list 123 in which the products represented by the selection operation buttons B1 to B3 and the prices of the products are associated with each other is generated (step S113). An order reception image O corresponding to the generated data of the order reception image O is displayed on the display screen so as to be able to receive operations of the selection operation buttons B1 to B3 (step S141). It is determined whether or not operations of the selection operation buttons B1 to B3 included in the order reception image O displayed on the display screen have been performed (step S144). When it is determined that operations of the selection operation buttons B1 to B3 have been performed, product data of a certain product corresponding to the operated operation button is acquired from the product list 123, and based on the product data, sales data of a certain product is generated (step S145). In this way, by using photographed data such as the menu table M to enable the generation of sales data, accounting processing can be easily performed with less effort without registering each product and price in the register 4 one by one. In particular, in restaurants and the like where menu replacement or price change is performed daily, weekly, irregularly, etc., and on the other hand, it is difficult or troublesome to input products by setting and reading various identification codes, processing (accounting processing) can be made possible by using a general-purpose information processing device 1 such as a smartphone, so it becomes easier. Also, since an order reception image O corresponding to the menu table M can be obtained, the time and effort for a store clerk to search for the operation button of the ordered product can also be reduced.

[0064] Also, in this information processing method, in the order reception image O, the part where the specific information is displayed is used as the operation button. Since the text part including the specific information is displayed as the operation button almost as it is, the processing is easy, and a user such as a store clerk can also easily and accurately perform input settings for sales according to the original menu table.

[0065] Also, in this information processing method, the text portion in the product image data is extracted, and specific information and an amount are set from the extracted text portion. That is, since the text portion is recognized and extracted from the image data of the photographed menu list to set the product name and price, there is no need for the user to input these product names and prices one by one for operation settings, thus reducing the labor.

[0066] Also, in this information processing method, when it is determined that an operation has been performed on a displayed operation button, the sales data of the amount of the corresponding product is transmitted by the communication unit 16 to an external device (cash register 4) (step S151). In this way, since a sales input operation (sales setting) based on the menu image can be performed outside the cash register 4 and the sales input operation can be transmitted to the cash register 4, the labor of performing a registration operation of the product on the cash register 4 can be saved. Also, by enabling such a sales input operation with a general-purpose external device that can photograph the menu list M, the cash register 4 does not need to be equipped with a photographing mechanism, and an increase in the cost of the cash register 4 can be suppressed.

[0067] Also, the sales data to be transmitted to the external device (cash register 4) includes specific information of a certain product. That is, even if the product name is not accurately registered in the cash register 4, it is possible to obtain which product has generated sales. Therefore, even if the receipt is simple, the product name and the like can be displayed, improving the convenience for customers. Also, when the cash register 4 can record a sales history, it becomes easier to discriminate and organize which product the sales are from, thus reducing the labor of sales management.

[0068] Also, the data of the order reception image О includes an operation button R1 for receiving a surcharge or discount of the amount of a certain product. Based on the product image data, change data associating the surcharge or discount of the amount represented by the operation button R1 is generated. When it is determined that an operation has been performed on the operation button and the operation button R1, sales data of the certain product is generated based on the product data of the certain product and the change data. Thus, not only can items be simply added and amounts be totaled, but also processes such as discounts and surcharges can be handled, enabling more flexible order operations from the information processing apparatus 1.

[0069] Alternatively, the menu image data includes price fluctuation information (surcharge / discount amount, specific information of a certain item, and their application conditions) related to the surcharge or discount of a certain item, and data of a first order reception image reflecting the price fluctuation information and data of a second order reception image not reflecting the price fluctuation information are generated. Depending on whether the discount or discount application conditions indicated by the price fluctuation information are satisfied, an order reception image may be displayed on the display screen based on the data of the first order reception image or the data of the second order reception image. That is, for the set amounts such as discounts and surcharges, it may be automatically determined whether the application conditions are satisfied, and they may be displayed instead of the original amounts. This avoids omission or inappropriate application of discounts / surcharges by the user (store clerk), and also eliminates the need for the store clerk to perform multiple operations, simplifying the input operation during ordering.

[0070] Further, the information processing apparatus 1 of the present embodiment includes a CPU 11. The CPU 11 acquires product image (image of the menu table M) data including the display of specific information for specifying a certain product and the display of the price of the certain product (step S101), and based on the product image data, generates data of an order reception image O having selection operation buttons B1 to B3 for receiving an order for a certain product (order reception image data 122) (steps S102 to S112). Also, based on the product image data, the CPU 11 generates a product list 123 in which a certain product represented by the selection operation buttons B1 to B3 and the price of the certain product are associated with each other (step S113). Further, the CPU 11 causes the order reception image O corresponding to the generated order reception image data 122 to be displayed on the display screen so as to be able to receive operations of the selection operation buttons B1 to B3 (step S141), determines whether or not operations of the selection operation buttons B1 to B3 included in the order reception image O displayed on the display screen have been performed (step S144), and when it is determined that operations of the selection operation buttons B1 to B3 have been performed, acquires product data of the product corresponding to the operation button from the product list 123 (step S145). According to this information processing apparatus 1, by enabling an input operation for acquiring information such as the price of a sold product from shooting data such as the menu table M, it becomes possible to easily perform processing related to sales (such as accounting processing) with less effort without registering each product and its price in the register 4 (especially when there are many changes or replacements). Also, since an order reception image O corresponding to the menu table M can be obtained, in this information processing apparatus 1, the labor for the store clerk to search for the sold product is also reduced, and it becomes possible to easily perform operations on the operation buttons corresponding to the products.

[0071] Also, by installing and executing a program 121 that enables the above-described sales input operation on a computer, it becomes possible to more easily perform accounting processing.

[0072] Further, the information processing system 100 of the present embodiment includes the above-described information processing apparatus 1, a communication unit 46 that performs communication, and a register 4 that includes a CPU 41. When sales data is transmitted from the information processing apparatus 1 to the register 4 via the communication unit 16 (step S151), the CPU 41 of the register 4 performs accounting processing including the received sales data. In this way, in the information processing system 100, instead of registering all products in the register 4, based on the content easily and simply set based on the menu table M or the like in the external information processing apparatus 1, it is possible to easily perform input settings for sales and transmit this to the register 4. Therefore, it becomes possible to more easily perform accounting processing including sales of products (services) that are likely to have replacements or price changes and are difficult to manage with identification codes or the like. Also, along with this, since a significant increase in the functionality of the register 4 is not required, an increase in cost can be suppressed.

[0073] Note that the present invention is not limited to the above-described embodiment, and various modifications are possible. For example, in the above-described embodiment, it has been described as being used for generating data of an order reception image О related to a sales operation by photographing a menu table of a restaurant, but it is not limited to this. Internal documents used by store clerks or the like may be used. Also, the object to be photographed is not necessarily limited to one in which a plurality of product names are listed like a menu table. An object containing only one product may be included in the object to be photographed. Further, not limited to restaurants, when reflecting fine changes in service content or price changes in stores or the like that provide other services, a service list or the like may be used and a sales operation may be performed.

[0074] Also, in the above-described embodiment, it has been described that the final accounting processing is performed in the register 4, but it is not limited to this. Accounting processing may be performed only by the information processing apparatus 1. In this case, the information processing apparatus 1 may be connected to a normal printer or the like, and a receipt or the like may be printed and recorded instead of a receipt.

[0075] Also, in the above embodiment, it has been described that the sales operation is performed one by one for each order, but the sales quantity may be inputtable. That is, in the above embodiment, when there are multiple orders for the same product, it is necessary to repeat the order operation for the product multiple times. Instead, an operation of inputting the order quantity of the product once ordered may be acceptable, and the display of the order quantity may be made in parallel with the name of the product ordered. Alternatively, using the sales data transmitted to the register 4, the input operation of the sales quantity may be performed in the register 4. Similarly, processing such as consumption tax addition, discount, or surcharge for the sales content transmitted from the information processing apparatus 1 may be performed in the register 4.

[0076] Also, in the above embodiment, specific information is transmitted from the information processing apparatus 1 to the register 4 together with the sales amount, but the specific information does not necessarily have to be transmitted to the register 4. If the calculation of the fee can be done, the amount of information may be reduced and the processing may be simplified further.

[0077] Also, in the above embodiment, it has been described that the product name itself is made into a button, but the specific form of the order reception screen, such as adding an operation button separately beside the product name, may be appropriately different.

[0078] Also, in the above embodiment, it has been described that communication is performed by Bluetooth, but it is not limited to this. Communication may be performed by a wireless LAN such as WiFi, or infrared communication, etc. When it is desired to reduce the power consumption related to communication, the communication connection may be disconnected except during the processing related to sales.

[0079] Also, in the above embodiment, it has been described that when there is an order operation, each sales data is generated and the sales data is transmitted to the register 4, but it is not limited to the case where the sales data is immediately generated and transmitted. After the input operations of multiple orders are confirmed, the sales data may be generated collectively and transmitted to the register 4.

[0080] Also, the destination for transmitting the sales data related to the order may not be limited to the register 4. The sales data may be transmitted as order data in accordance with an order reception terminal device in the kitchen or the like. That is, the generated and output sales data may be used not only for accounting processing but also for preparing (cooking) and providing (serving) the goods. At this time, an input operation and a display operation indicating that the ordered goods have been provided to the customer may be possible, or alternatively, a paper order slip may be printed and output separately from the receipt. Conversely, when it is used only for accounting purposes without relation to the preparation of goods or the provision of food and beverages, at the time of accounting, the sales data of the ordered (sold) goods may be generated collectively, and the information on the goods and their amounts may be transmitted to the register 4.

[0081] Also, in the above embodiment, it has been described that the store clerk creates an order screen and actually performs an order operation for accounting processing, but it is not limited to this. The order operation may be executable by installing an app on an order reception terminal or the user's terminal. In this case, rather than making an unspecified terminal connectable via Bluetooth, it may be communicatively connected to the register 4 via WiFi, a 4G line, a 5G line, or the like. Also, in this case, since it is necessary to input information identifying the customer's position such as the seat number when operating each terminal, setting requirements such as inputting the seat number at the start of the order or photographing and reading the identification code attached to the seat with a camera or the like are made.

[0082] Also, in the above description, the storage unit 12 composed of a non-volatile memory such as a flash memory has been cited as an example of a computer-readable medium storing the program 121 related to the external device control and the sales setting control of the present invention, but it is not limited to these. As other computer-readable media, other non-volatile memories such as MRAM, a hard disk drive (HDD), and portable recording media such as a CD-ROM and a DVD disk can be applied. Also, a carrier wave is also applied to the present invention as a medium for providing the data of the program according to the present invention via a communication line. In addition, the specific configurations, details of processing operations, procedures, etc. shown in the above embodiments can be appropriately changed without departing from the spirit of the present invention.

[0083] Although some embodiments of the present invention have been described, the scope of the present invention is not limited to the above-described embodiments, but includes the scope of the invention described in the claims and the equivalent scope thereof. The invention described in the claims initially attached to the application form of this application is appended below. The claim numbers described in the appendix are as in the claims initially attached to the application form of this application.

[0084] [Appendix] <Claim 1> Obtain product image data including image data of specific information for identifying a certain product and image data of the price of the certain product, Based on the product image data, generate data of an order reception image including an operation button for receiving an order for the certain product, Based on the product image data, generate product data associating the certain product represented by the operation button with the price of the certain product, Display the order reception image corresponding to the generated data of the order reception image on a display screen so as to be able to receive an operation of the operation button, Determine whether an operation of the operation button included in the order reception image displayed on the display screen has been performed, When it is determined that the operation of the operation button has been performed, generate sales data of the certain product based on the product data of the certain product An information processing method. <Claim 2> The information processing method according to claim 1, wherein in the order reception image, a portion where the specific information is displayed is the operation button. <Claim 3> Extract a text portion in the product image data, Set the specific information and the price from the extracted text portion The information processing method according to claim 1 or 2. <Claim 4> When it is determined that the operation has been performed, cause the sales data of the certain product to be transmitted to an external device by the first communication unit The information processing method according to any one of claims 1 to 3. <Claim 5> The sales data of the certain product includes the specific information of the certain product. The information processing method according to any one of claims 1 to 4. <Claim 6> The data of the order reception image includes a change button for receiving an increment or discount of the price of the certain product, Based on the product image data, generate change data associating the certain product represented by the change button with the increment or discount of the price of the certain product, When it is determined that the operation buttons and the change button have been operated, generate sales data of the certain product based on the product data and the change data of the certain product. The information processing method according to any one of claims 1 to 5. <Claim 7> The product image data includes price fluctuation information related to the increment or discount of the certain product, Generate data of a first order reception image in which the price fluctuation information is reflected and data of a second order reception image in which the price fluctuation information is not reflected, Display the order reception image on the display screen based on the data of the first order reception image or the data of the second order reception image according to whether the discount or the application condition of the discount indicated by the price fluctuation information is satisfied. The information processing method according to any one of claims 1 to 5. <Claim 8> Obtain product image data including image data of specific information for specifying a certain product and image data of the price of the certain product, Based on the product image data, generate data of an order reception image including an operation button for receiving an order for the certain product, Generate product data associating the certain product represented by the operation button with the price of the certain product based on the product image data. Cause the order reception image corresponding to the generated data of the order reception image to be displayed on the display screen so as to be able to receive an operation of the operation button. Determine whether or not an operation of the operation button included in the order reception image displayed on the display screen has been performed. When it is determined that the operation of the operation button has been performed, generate sales data of the certain product based on the product data of the certain product. An information processing apparatus including a processing unit. <Claim 9> A computer, An image acquisition unit that acquires product image data including image data of specific information for specifying a certain product and image data of the price of the certain product, An image generation unit that generates data of an order reception image including an operation button for receiving an order of the certain product based on the product image data, A list data generation unit that generates product data associating the certain product represented by the operation button with the price of the certain product based on the product image data, A display control unit that causes the order reception image corresponding to the generated data of the order reception image to be displayed on the display screen so as to be able to receive an operation of the operation button, An operation determination unit that determines whether or not an operation of the operation button included in the order reception image displayed on the display screen has been performed, A sales data generation unit that generates sales data of the certain product based on the product data of the certain product when it is determined that the operation of the operation button has been performed, A program that causes it to function as such. <Claim 10> The information processing apparatus according to claim 8, A cash register including a second communication unit that communicates with the information processing apparatus and a control unit, An information processing system including: The processing unit of the information processing apparatus, When it is determined that the operation has been performed, the sales data of the certain product is transmitted to the cash register by the first communication unit, The control unit of the cash register Performs accounting processing including the sales data received via the second communication unit Information processing system.

Explanation of symbols

[0085] 1 Information processing device 11 CPU 12 Storage unit 121 Program 122 Order reception image data 123 Product list 13 Display unit 14 Operation reception unit 15 Photographing unit 16 Communication unit 4 Cash register 41 CPU 42 Storage unit 421 Program 422 Input settings 43 Display unit 44 Operation reception unit 46 Communication unit 47 Printing unit 48 Paper conveyance unit 100 Information processing system B1~B3 Selection operation buttons B4, B5 Operation buttons C Confirmation button E Selection end button M Menu list O Order reception image T Subtotal button

Claims

1. An information processing method executed by a computer operated by a store clerk, comprising: obtaining a menu image including a combination of a product name identifying a certain product and the price of the certain product; generating an order reception image including the product name identifying the certain product and the price of the certain product extracted from the menu image, and an operation button for receiving an order for the certain product; generating product data associating the certain product with the price of the certain product based on an operation by the store clerk for associating the product name identifying the certain product and the price of the certain product extracted from the menu image; generating sales data for the certain product based on the product data of the certain product when an operation of the operation button included in a display screen on which the generated order reception image is displayed is performed; An information processing method.

2. When it is determined that the operation button has been operated, causing the first communication unit to transmit the sales data of the certain product to an external device; The information processing method according to Claim 1.

3. The sales data of the certain product includes the product name of the certain product. The information processing method according to Claim 1 or 2.

4. The menu image includes price fluctuation information related to a bonus or discount of the certain product. generating data of a first order reception image in which the price fluctuation information is reflected and data of a second order reception image in which the price fluctuation information is not reflected; displaying the order reception image on the display screen based on the data of the first order reception image or the data of the second order reception image according to whether or not the discount or the application condition of the discount indicated by the price fluctuation information is satisfied; The information processing method according to any one of Claims 1 to 3.

5. The menu image includes a plurality of combinations of a product name identifying the certain product and the price of the certain product. The information processing method according to any one of Claims 1 to 4.

6. An information processing apparatus operated by a store clerk, comprising: obtaining a menu image including a combination of a product name identifying a certain product and the price of the certain product; generating an order reception image including the product name identifying the certain product and the price of the certain product extracted from the menu image, and an operation button for receiving an order for the certain product; Based on the operation by the store clerk of the store that associates the product name identifying the certain product extracted from the menu image with the price of the certain product, product data associating the certain product with the price of the certain product is generated. When an operation of the operation button included in the display screen on which the generated order reception image is displayed is performed, sales data of the certain product is generated based on the product data of the certain product. An information processing apparatus including a processing unit.

7. A computer operated by a store clerk of a store, Image acquisition means for acquiring a menu image including a combination of a product name identifying a certain product and the price of the certain product, Image generation means for generating an order reception image including the product name identifying the certain product extracted from the menu image, the price of the certain product, and an operation button for receiving an order for the certain product, Data generation means for generating product data associating the certain product with the price of the certain product based on the operation by the store clerk of the store that associates the product name identifying the certain product extracted from the menu image with the price of the certain product, Sales data generation means for generating sales data of the certain product when an operation of the operation button included in the display screen on which the generated order reception image is displayed is performed, A program that functions as.

8. The information processing apparatus according to claim 6, A cash register including a second communication unit that communicates with the information processing apparatus and a control unit, An information processing system including: The processing unit of the information processing apparatus, When it is determined that the operation has been performed, causes the first communication unit to transmit the sales data of the certain product to the cash register, The control unit of the cash register, Performs accounting processing including the sales data received via the second communication unit Information processing system.

Images