Information processing device, information processing method, and information processing program

Abstract

To provide a technique that can encourage the use of electronic devices for registering products while shopping. [Solution] The information processing device includes a display control unit, an acquisition unit, and a registration unit. The display control unit displays an object including incentive information for a product on the display unit based on an image related to the product captured by the photography unit. The acquisition unit acquires a product code based on a product code image captured by the photography unit. If an incentive is set for a product identified by the product code, the registration unit associates the incentive with the product identified by the product code and registers it.

Description

[Technical Field]

[0001] An embodiment of the present invention relates to an information processing device, an information processing method, and an information processing program. [Background technology]

[0002] Commercial facilities such as supermarkets are increasingly introducing self-scanning systems, which allow consumers to register products themselves using electronic devices such as smartphones. Such systems are effective for reducing manpower and enabling contactless shopping, and their adoption is likely to accelerate in the future.

[0003] However, many consumers prefer to use conventional cash registers, semi-self-service cash registers, self-service cash registers, etc., and there is a need for incentives to use such systems. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent Publication No. 2021-170395 Summary of the Invention [Problem to be solved by the invention]

[0005] The problem to be solved by the embodiments of the present invention is to provide a technology that can encourage the use of electronic devices to register products while shopping. [Means for solving the problem]

[0006] In one embodiment, the information processing device includes a display control unit, an acquisition unit, and a registration unit. The display control unit displays an object including incentive information for a product on the display unit based on an image related to the product captured by the image capture unit. The acquisition unit acquires a product code based on a product code image captured by the image capture unit. If an incentive is set for a product identified by the product code, the registration unit associates the incentive with the product identified by the product code and registers the product. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is a block diagram illustrating an information processing system according to the first embodiment. [Figure 2] FIG. 2 is a diagram schematically illustrating an example of an AR image according to the first embodiment. [Figure 3] FIG. 3 is a diagram schematically illustrating an example of a screen display of a user terminal according to the first embodiment. [Figure 4] FIG. 4 is a diagram schematically showing another example of a screen display of the user terminal according to the first embodiment. [Figure 5] FIG. 5 is a diagram schematically showing yet another example of a screen display of the user terminal according to the first embodiment. [Figure 6] FIG. 6 is a flowchart illustrating an example of a procedure for information processing by the user terminal according to the first embodiment. [Figure 7] FIG. 7 is a block diagram illustrating an information processing system according to the second embodiment. [Figure 8] FIG. 8 is a flowchart illustrating an information processing procedure by the server according to the second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0008] [First embodiment] Hereinafter, the embodiments will be described with reference to the drawings. In the drawings, the same components are denoted by the same reference numerals whenever possible, and duplicated explanations will be omitted.

[0009] (Configuration example) 1 is a block diagram illustrating an information processing system 100 according to a first embodiment. The information processing system 100 includes a server 1 and a user terminal 2. The server 1 and the user terminal 2 are connected to each other via a network so as to be able to communicate with each other freely. For example, the network is configured from one or more networks selected from various networks such as the Internet, a mobile communication network, and a LAN (Local Area Network). The one or more networks may include a wireless network or a wired network.

[0010] The server 1 is an electronic device that collects and processes data. The electronic device includes a computer. The server 1 is connected to a user terminal 2 via a network so as to be able to communicate freely. The server 1 receives various data from the user terminal 2 and outputs various data to the user terminal 2. The server 1 manages, for example, information about products in a store such as a supermarket. An example of the configuration of the server 1 will be described later.

[0011] The user terminal 2 is an electronic device capable of communicating with other electronic devices. The user terminal 2 is, for example, a device used by a customer of a store. For example, the user terminal 2 is a smartphone or a tablet terminal. The customer may be read as a user or a person. The user terminal 2 is an example of an information processing device. An example configuration of the user terminal 2 will be described later.

[0012] An example of the configuration of the server 1 will be described. The server 1 is an electronic device that includes a processor 11, a main memory 12, an auxiliary storage device 13, and a communication interface 14. The components that make up the server 1 are connected to each other so that signals can be input and output. In FIG. 1, the interface is indicated as "I / F."

[0013] The processor 11 corresponds to the central part of the server 1. The processor 11 is an element that constitutes the computer of the server 1. For example, the processor 11 is a CPU (Central Processing Unit), but is not limited to this. The processor 11 may be composed of various circuits. The processor 11 loads a program that is pre-stored in the main memory 12 or the auxiliary storage device 13 into the main memory 12. The program is a program that causes the processor 11 of the server 1 to realize each unit described below and execute the function of each unit. The processor 11 performs various operations by executing the program loaded into the main memory 12.

[0014] The main memory 12 corresponds to the main storage portion of the server 1. The main memory 12 is an element that constitutes the computer of the server 1. The main memory 12 includes a non-volatile memory area and a volatile memory area. The main memory 12 stores an operating system or a program in the non-volatile memory area. The main memory 12 uses the volatile memory area as a work area where data is rewritten by the processor 11 as appropriate. For example, the main memory 12 includes a ROM (Read Only Memory) as a non-volatile memory area. For example, the main memory 12 includes a RAM (Random Access Memory) as a volatile memory area.

[0015] The auxiliary storage device 13 corresponds to the auxiliary storage portion of the server 1. The auxiliary storage device 13 is an element that constitutes the computer of the server 1. The auxiliary storage device 13 is an EEPROM (registered trademark) (Electric Erasable Programmable Read-Only Memory), an HDD (Hard Disc Drive), an SSD (Solid State Drive), or the like. The auxiliary storage device 13 stores the above-mentioned programs, data used by the processor 11 when performing various processes, and data generated by the processes in the processor 11.

[0016] The auxiliary storage device 13 includes an object data storage area 130. The object data storage area 130 stores data of at least one object. The object data indicates object data associated with AR (Augmented Reality) marker image information. The object data includes basic incentive information of a product associated with the marker image information. The basic incentive information is information indicating a base incentive that is not dependent on a user's rank, which will be described later. The AR marker image information is information indicating an image that is registered in advance as an AR marker. The AR marker image information is information for displaying, for example, an object indicating an incentive applied to a product. The object indicates, for example, an object such as a discount sticker. A discount sticker is, for example, a sticker that displays a discount rate, such as "20% off." The AR marker image information may be set in advance, or may be set or updated as appropriate by an administrator, etc. Note that the object data may also be simply referred to as an object.

[0017] The auxiliary storage device 13 includes a product data storage area 131. The product data storage area 131 stores product data related to at least one product. The product data indicates data associated with a product code, set incentive information, etc. The product code is unique identification information assigned to each product to identify it individually. The set incentive information is set discount information for the product. The set incentive information includes basic incentive information as product discount information. The set incentive information may include additional incentive information as product discount information that varies depending on the user's rank. A user's rank is assigned by registering as a member of a store. For example, the user's rank includes multiple ranks, such as rank A, rank B, and rank C. Rank A, for example, indicates a cumulative annual purchase amount of 300,000 yen or more. Rank B, for example, indicates a cumulative annual purchase amount of 200,000 yen or more. Rank C, for example, indicates a cumulative annual purchase amount of 100,000 yen or more. Ranks may be arbitrarily set for each store or each affiliated store based on the cumulative purchase amount, points, frequency of store visits, etc. Additional incentive information indicates incentives granted in addition to the incentive indicated by the basic incentive information. For example, additional incentive information may be set such as "an additional 20% off" for users with rank A, "an additional 10% off" for users with rank B, and "an additional 5% off" for users with rank C. The basic incentive information and additional incentive information may be set in advance or may be set or updated as appropriate by a store manager or the like. Product data may be updated each time the basic incentive information or additional incentive information is set or updated. Note that if no incentive is set for a product, the product data includes a product code that is not associated with set incentive information. Here, for products with set incentives, the set incentive information is assumed to be the same regardless of the product. Therefore, the basic incentive information and the additional incentive information according to the rank are assumed to be the same regardless of the product.

[0018] The auxiliary storage device 13 includes a user data storage area 132. The user data storage area 132 stores user data. The user data indicates data in which user identification information, identification information of the user terminal 2, user rank, etc. are associated. The user identification information is unique identification information assigned to each user to identify the user individually. The user identification information includes a member ID. The identification information of the user terminal 2 is unique identification information assigned to each user terminal 2 to identify the user terminal 2 individually. The identification information of the user terminal 2 includes a terminal-specific identifier such as the IP address or serial number of the user terminal 2. The user rank is information indicating the rank assigned to each user. The user data can be updated each time the user's rank is set or updated.

[0019] The auxiliary storage device 13 includes a registered product data storage area 133. The registered product data storage area 133 stores registered product data. The registered product data includes information about purchased products registered by customers. Purchased products are also referred to as registered products. The registered product data indicates data that associates registered product codes, registered incentive information, and prices, etc. The registered product codes are unique identification information assigned to each registered product to identify each registered product registered by a customer. The registered incentive information indicates the incentive information registered for each registered product. The registered incentive information is basic incentive information or total incentive information. The total incentive information indicates the incentive obtained by adding together the incentive indicated by the basic incentive information and the incentive indicated by the additional incentive. For example, if a customer registers a product with product code "XXXXX," the registered product data storage area 133 stores registered incentive information "10% off" for the product with registered product code "XXXXX" in association with the registered product code "XXXXX." The price indicates the price before the incentive indicated by the registered incentive information registered for each registered product is applied. The price indicates the price managed for each product in a product master (not shown) using the registered product code as a key. The registered product data can be updated every time a product is registered by a customer.

[0020] The communication interface 14 includes various interfaces that connect the server 1 to other electronic devices via a network in accordance with a predetermined communication protocol so that they can communicate with each other.

[0021] The hardware configuration of the server 1 is not limited to the above configuration, and the server 1 allows the omission or modification of the above components and the addition of new components as appropriate.

[0022] An example of the configuration of the user terminal 2 will be described. The user terminal 2 is an electronic device including a processor 21, a main memory 22, an auxiliary storage device 23, a communication interface 24, a display device 25, a speaker 26, an input device 27, and a camera 28. The components constituting the user terminal 2 are connected to each other so that signals can be input and output.

[0023] The processor 21 corresponds to the central part of the user terminal 2. The processor 21 is an element that constitutes the computer of the user terminal 2. The processor 21 has the same hardware configuration as the above-mentioned processor 11. The processor 21 performs various operations by executing programs that are pre-stored in the main memory 22 or the auxiliary storage device 23. The programs are programs that cause the processor 21 of the user terminal 2 to realize each unit described below and execute the functions of each unit.

[0024] The main memory 22 corresponds to the main storage portion of the user terminal 2. The main memory 22 is an element that constitutes the computer of the user terminal 2. The main memory 22 has the same hardware configuration as the above-mentioned main memory 12. The main memory 22 stores programs.

[0025] The auxiliary storage device 23 corresponds to the auxiliary storage portion of the user terminal 2. The auxiliary storage device 23 is an element that constitutes the computer of the user terminal 2. The auxiliary storage device 23 has the same hardware configuration as the above-mentioned auxiliary storage device 13. The auxiliary storage device 23 stores the above-mentioned programs.

[0026] The communication interface 24 includes various interfaces that connect the user terminal 2 to other devices via a network in accordance with a predetermined communication protocol so that the user terminal 2 can communicate with other devices.

[0027] The display device 25 is a device capable of displaying various screens under the control of the processor 21. For example, the display device 25 is a liquid crystal display or an EL (Electroluminescence) display, etc. The display device 25 is an example of a display unit.

[0028] The speaker 26 is a device that can output sound under the control of the user terminal 2.

[0029] The input device 27 is a device that can input data or instructions to the user terminal 2. For example, the input device 27 includes a keyboard, a touch panel, or the like.

[0030] Camera 28 is a device capable of acquiring photographic data of a photographing range. Camera 28 is a device capable of reading various data. For example, camera 28 is a device capable of reading data from a photographed code symbol. The code symbol is a two-dimensional code symbol such as a barcode symbol or a QR code (registered trademark). For example, camera 28 reads a code symbol attached to a product and registers the product. Camera 28 is a device capable of reading data from an AR marker. For example, camera 28 reads an AR marker attached to a product and displays AR content. Camera 28 is an example of a photographing unit.

[0031] The hardware configuration of the user terminal 2 is not limited to the above configuration. The user terminal 2 allows the above components to be omitted or changed, and new components to be added, as appropriate.

[0032] Each unit implemented in the above-mentioned processor 21 will now be described.

[0033] The processor 21 realizes an acquisition unit 210, a display control unit 211, and a registration unit 212. The units realized by the processor 21 can also be referred to as functions. The units realized by the processor 21 can also be referred to as being implemented in a control unit including the processor 21 and the main memory 22.

[0034] The acquisition unit 210 acquires an object including incentive information for a product based on an image related to the product captured via the camera 28. The incentive information included in the object is basic incentive information or total incentive information. If the incentive information included in the object is total incentive information, the incentive information included in the object is information according to the user's rank. The image related to the product may be an AR marker image itself, or an image including an AR marker image, etc. The AR marker image is an image that has been registered in advance as an AR marker. The image related to the product is also called an AR image.

[0035] For example, the acquisition unit 210 acquires AR marker image information based on an image related to a product captured by the camera 28. In a typical example, the acquisition unit 210 acquires an AR marker image from an image related to a product based on the image related to the product being captured by the camera 28. The acquisition unit 210 performs image processing on the AR marker image to acquire the AR marker image information. The acquisition unit 210 outputs the AR marker image information to the server 1 via the network. In response to the output of the AR marker image information to the server 1, the acquisition unit 210 acquires an object including incentive information for the product from the server 1. In the following description, "acquire" may be read as "receive", and "output" may be read as "send".

[0036] The server 1 acquires AR marker image information from the user terminal 2 via the network. The server 1 acquires an object including basic incentive information associated with the acquired AR marker image information stored in the auxiliary storage device 13. The object including incentive information that the server 1 outputs to the user terminal 2 via the network will be described. First, a case will be described in which the user of the user terminal 2 has not registered as a member or checked in, or the user of the user terminal 2 does not belong to a rank that satisfies the requirements for applying additional incentive information. In this example, the server 1 outputs an object including basic incentive information to the user terminal 2 via the network as an object including incentive information. Next, a case will be described in which the user of the user terminal 2 belongs to a rank that satisfies the requirements for applying additional incentive information. In this example, the server 1 may change the incentive information included in the object depending on the user's rank. In this case, the server 1 acquires user data from the auxiliary storage device 13. The server 1 acquires total incentive information obtained by applying additional incentive information to the basic incentive information depending on the user's rank. The server 1 outputs the object including total incentive information to the user terminal 2 via the network as an object including incentive information.

[0037] The acquisition unit 210 acquires the product code based on the product code image captured by the camera 28. The acquisition unit 210 acquires the product code by performing image processing on the captured product code image.

[0038] The display control unit 211 displays an object including incentive information for a product on the display device 25 based on an image related to the product captured by the camera 28. For example, the display control unit 211 displays the object on the display device 25 based on acquisition of the object including incentive information based on the image related to the product captured by the acquisition unit 210. Note that the display control unit 211 may also display multiple objects including incentive information for multiple products on the display device 25 based on multiple images related to multiple products captured by the camera 28.

[0039] The display control unit 211 identifiably displays a selected object based on a user's instruction to select an object. The selection instruction indicates, for example, an instruction input via the input device 27 by a selection operation, such as a user touching an object displayed on the display device 25. For example, the user may select one object from at least one object displayed on the display device 25. The object selected by the user is also referred to as a selected object. The display control unit 211 acquires an object selection instruction. Acquiring an object selection instruction includes acquiring the object selected by the user as the selected object. The display control unit 211 identifiably displays the object selected by the user as the selected object. The display control unit 211 may display the selected object in a display mode different from that of the object displayed on the display device 25 before the user selected the selected object. The display mode may include character color, size, font, enclosed character, character decoration such as brightness or luminance, background color, background brightness or luminance, background pattern, frame color, blinking display, etc.

[0040] The display control unit 211 identifiably displays one selected object from the plurality of objects based on a user's instruction to select one object from the plurality of objects. The user may select one object from the plurality of objects displayed on the display device 25. Objects not selected by the user are also referred to as non-selected objects. The one or more non-selected objects are one or more objects excluding the selected object from the plurality of objects. In one example, the display control unit 211 displays the selected object in a display manner different from that of the one or more non-selected objects in order to identifiably display the selected object. In this example, the display control unit 211 displays the selected object in a display manner in which it is identifiable as the selected object. The display control unit 211 displays the one or more non-selected objects in a display manner in which it is identifiable as the non-selected objects. The display manner in which it is identifiable as the selected object and the display manner in which it is identifiable as the non-selected objects are different from each other. In another example, the display control unit 211 displays the selected object and hides one or more non-selected objects in order to identifiably display the selected object. In this example, the display control unit 211 continues to display the selected object and transitions the one or more non-selected objects from display to hide. Transitioning one or more non-selected objects from displayed to hidden includes erasing the display of one or more non-selected objects. Furthermore, as described above, the display control unit 211 may display the selected object in a display mode different from the object displayed on the display device 25 before the user selected the selected object.

[0041] The registration unit 212 executes a registration process for a product identified by a product code based on the acquisition of the product code by the acquisition unit 210. For example, the registration unit 212 executes a registration process for a product identified by a product code based on a user's instruction to select an object and the acquisition of the product code by the acquisition unit 210. If an incentive is set for the product identified by the product code acquired by the acquisition unit 210 based on the user's instruction to select an object, the registration unit 212 registers the product identified by the product code by associating the incentive with the product. If an incentive is not set for the product identified by the product code acquired by the acquisition unit 210 based on the user's instruction to select an object, the registration unit 212 registers the product identified by the product code without associating an incentive with the product. The registration unit 212 outputs the product code and object selection information to the server 1 via the network in association with the product registration instruction. The object selection information is information related to the user's instruction to select an object and indicates that the object has been selected. The product registration instruction indicates an instruction to register a product. The registration unit 212 may associate the product code and object selection information with the product registration instruction and output them to the server 1 simultaneously, or may output them at different times. The registration unit 212 may output the object selection information to the server 1 via a network based on an object selection instruction by a user. The registration unit 212 may output the product code to the server 1 via a network based on the product code acquired by the acquisition unit 210. The registration unit 212 registers a product identified by a product code in the server 1 based on the product registration instruction. If an incentive is set for the product associated with the product code, the registration unit 212 registers the product identified by the product code in the server 1 by associating the incentive. If an incentive is not set for the product associated with the product code, the registration unit 212 registers the product identified by the product code in the server 1 without associating an incentive.

[0042] The server 1 updates the registered product data based on a product registration instruction. The server 1 determines whether an incentive is set for a product associated with a product code acquired from the user terminal 2 based on the object selection information acquired from the user terminal 2. If the product data associated with a product code acquired from the user terminal 2 contains set incentive information, the server 1 determines that an incentive is set for the product associated with the product code. If the product data associated with a product code acquired from the user terminal 2 does not contain set incentive information, the server 1 determines that an incentive is not set for the product associated with the product code. If an incentive is set for the product associated with the product code, the server 1 adds a record including the product code, registered incentive information, and a price to the registered product data. The server 1 acquires the price from the product master based on the product code. If an incentive is not set for the product associated with the product code, the server 1 adds a record including the product code and a price to the registered product data. The server 1 acquires the price from the product master based on the product code. Note that the server 1 may not acquire object selection information from the user terminal 2 via the network. For example, if the acquisition unit 210 acquires a product code without the user inputting an object selection instruction, the registration unit 212 does not output the object selection information to the server 1. In this case, the server 1 registers the product identified by the product code without associating it with an incentive, regardless of whether or not an incentive is set for the product associated with the product code.

[0043] The registration unit 212 is not limited to executing the registration process for a product identified by a product code based on a user's instruction to select an object and the acquisition of a product code by the acquisition unit 210. The registration unit 212 may execute the registration process for a product identified by a product code based on the acquisition of a product code by the acquisition unit 210, without requiring a user's instruction to select an object. In this example, if an incentive is set for the product identified by the product code acquired by the acquisition unit 210, the registration unit 212 registers the product identified by the product code by associating the incentive with the product. If an incentive is not set for the product identified by the product code acquired by the acquisition unit 210, the registration unit 212 registers the product identified by the product code without associating an incentive with the product. The registration unit 212 associates the product code with the product registration instruction and outputs it to the server 1 via the network. The server 1 updates the registered product data based on the product registration instruction without requiring object selection information. The server 1 determines whether an incentive is set for the product associated with the product code acquired from the user terminal 2. If an incentive is set for the product associated with the product code, the server 1 adds a record including the product code, registered incentive information, and amount to the registered product data. If an incentive is not set for the product associated with the product code, the server 1 adds a record including the product code and amount to the registered product data.

[0044] An example of the configuration of an AR image will be described. FIG. 2 is a diagram schematically illustrating an example of an AR image according to the first embodiment.

[0045] The AR image A includes an AR marker image AA. The AR marker image AA is an image that has been registered in advance as an AR marker. In this case, the AR marker image AA is represented by a rectangular frame. The AR marker image AA may be an image that represents information such as a still image, a video, or a three-dimensional image.

[0046] The AR image A displayed on the display device 25 of the user terminal 2 will be described. FIG. 3 is a diagram schematically showing an example of a screen display of the user terminal 2 according to the first embodiment. While shopping around the store, the user of the user terminal 2 holds the AR image A attached to a desired product up to the camera 28. Fig. 3 shows the AR image A captured by the camera 28. The camera 28 can capture at least one AR image A included in the captureable area on the screen Sc.

[0047] The user holds the AR images Aa and Ab attached to the product Pa and product Pb up to the camera 28. The AR images Aa and Ab are displayed on the display device 25 so that they can be recognized.

[0048] The objects displayed on the display device 25 of the user terminal 2 will be described. FIG. 4 is a diagram schematically showing another example of a screen display of the user terminal 2 according to the first embodiment. 4 shows objects Ba and Bb generated based on AR images Aa and Ab captured by camera 28. Objects Ba and Bb represent objects including incentive information for products to which AR images Aa and Ab captured by camera 28 are attached. For example, object Ba is a discount sticker showing incentive information "20% off" for product Pa. Object Bb is a discount sticker showing incentive information "half price" for product Pb.

[0049] The objects displayed on the display device 25 of the user terminal 2 will be described. FIG. 5 is a diagram schematically showing yet another example of a screen display of the user terminal 2 according to the first embodiment. Fig. 5 shows a screen display when an object Ba is selected by a user on the display screen shown in Fig. 4. Fig. 5 shows an object Ca generated based on an AR image Aa, and an AR image Cb. The AR image Cb is the same image as the AR image Ab shown in Fig. 3. An object Bb not selected by the user is hidden. Since the object Bb is hidden, the display control unit 211 displays the AR image Cb.

[0050] (Example of operation) The processing procedure performed by the user terminal 2 will now be described. In the following description focusing on the server 1, the server 1 may be read as the processor 11. Similarly, in the following description focusing on the user terminal 2, the user terminal 2 may be read as the processor 21. The processing procedures described below are merely examples, and each process may be modified as much as possible. Furthermore, steps may be omitted, replaced, or added as appropriate depending on the embodiment.

[0051] Here, it is assumed that a user of user terminal 2 purchases products that may be discounted, such as prepared dishes or boxed lunches, at store T, such as a supermarket, that sells food. The user has completed membership registration using a dedicated application program. When the user registers as a member, a unique member ID is issued to the user. The member ID is set, for example, in the user terminal 2 owned by the user. The user terminal 2 may be a terminal owned by the user, or a terminal loaned to the user by store T. The user may register products via the user terminal 2 without registering as a member. In this case, the registration unit 212 may obtain the user's member ID at the time of payment. At the time of payment, the registration unit 212 may update the registered incentive information associated with the registered products to total incentive information, which applies additional incentive information according to the user's rank to basic incentive information.

[0052] The user checks in via a check-in device installed at the entrance of store T. For example, when the user starts a dedicated application program on user terminal 2, a barcode or two-dimensional code representing the member ID is displayed on display device 25. The user reads the member ID via the check-in device and checks in. The member ID may be recorded on an RFID (Radio Frequency Identification), an IC card, a magnetic card, or the like. Checking in using the member ID may be performed by a known process.

[0053] The user reads the AR markers attached to the products displayed in the store T via the camera 28, and causes the display device 25 to display AR content based on the AR markers. The user terminal 2 performs the following information processing based on the fact that the user has read the AR marker.

[0054] FIG. 6 is a flowchart illustrating an example of the procedure of information processing by the user terminal 2 according to the first embodiment.

[0055] The acquisition unit 210 acquires an object including incentive information for a product based on an image related to the product captured by the camera 28 (ACT 1). In ACT 1, for example, the acquisition unit 210 acquires an AR marker image based on an image related to the product captured by the camera 28. The acquisition unit 210 performs image processing on the AR marker image to acquire AR marker image information. The acquisition unit 210 outputs the AR marker image information to the server 1 via the network. In response to the output of the AR marker image information to the server 1, the acquisition unit 210 acquires an object including incentive information for the product from the server 1. Note that the server 1 may also acquire additional incentive information according to the user's rank based on the user data. In this case, the acquisition unit 210 acquires an object including total incentive information from the server 1 as an object including incentive information for the product.

[0056] The display control unit 211 displays an object including incentive information for a product on the display device 25 based on an image related to the product captured by the camera 28 (ACT 2). In ACT 2, for example, the display control unit 211 displays an object including incentive information for the product acquired by the acquisition unit 210 on the display device 25. The display control unit 211 may display a plurality of objects including incentive information for a plurality of products on the display device 25 based on a plurality of images related to a plurality of products captured by the camera 28. Note that the processor 21 may output a sound indicating the incentive information via the speaker 26 in addition to or instead of displaying the object.

[0057] The display control unit 211 acquires an instruction to select an object by the user (ACT3). In ACT3, for example, the display control unit 211 acquires the object selected by the user as a selected object based on the user's operation to select an object. The display control unit 211 may acquire one object selected by the user as a selected object based on the user's operation to select one object from multiple objects. The display control unit 211 displays the selected object in an identifiable manner.

[0058] The acquisition unit 210 acquires the product code based on the product code image captured by the camera 28 (ACT 4). In ACT 4, for example, the acquisition unit 210 acquires the product code by image processing of the captured product code image.

[0059] If an incentive is set for the product identified by the product code, the registration unit 212 registers the product identified by the product code by associating the incentive (ACT5). In ACT5, for example, the registration unit 212 acquires object selection information based on a selection instruction by the user. The registration unit 212 outputs the product code and object selection information to the server 1 via the network, associating them with the product registration instruction. The registration unit 212 causes the server 1 to register the product identified by the product code based on the product registration instruction. If an incentive is set for the product associated with the product code, the registration unit 212 causes the server 1 to register the product identified by the product code by associating the incentive. If an incentive is not set for the product associated with the product code, the registration unit 212 causes the server 1 to register the product identified by the product code without associating an incentive.

[0060] The registration unit 212 may execute the registration process for a product identified by a product code without requiring a user to select an object. In this example, the registration unit 212 outputs the product code to the server 1 via the network, but does not output the object selection information to the server 1.

[0061] Then, processor 21 calculates the discounted price by applying the registered incentive information to the price of the registered product based on the registered product data. Processor 21 performs known accounting processing based on the discounted price based on the accounting instructions from the user.

[0062] The auxiliary storage device 23 of the user terminal 2 may store data of at least one object. The auxiliary storage device 23 of the user terminal 2 may store product data related to at least one product. The auxiliary storage device 23 of the user terminal 2 may store user data. In this example, in ACT1, for example, the acquiring unit 210 acquires an object including basic incentive information associated with the acquired AR marker image information stored in the auxiliary storage device 23. A case will be described where the user of the user terminal 2 has not registered as a member or checked in, or where the user of the user terminal 2 does not belong to a rank that satisfies the requirements for applying additional incentive information. The acquiring unit 210 acquires an object including basic incentive information as an object including incentive information. Next, a case will be described where the user of the user terminal 2 belongs to a rank that satisfies the requirements for applying additional incentive information. The acquiring unit 210 may change the incentive information included in the object depending on the user's rank. In this case, the acquiring unit 210 acquires user data from the auxiliary storage device 23. The acquiring unit 210 acquires total incentive information by applying the additional incentive information to the basic incentive information depending on the user's rank. The acquisition unit 210 acquires an object including total incentive information as an object including incentive information.

[0063] The auxiliary storage device 23 of the user terminal 2 may store registered product data. In this example, in ACT5, for example, the registration unit 212 updates the registered product data stored in the auxiliary storage device 23 by executing a registration process for a product identified by a product code.

[0064] (effect) An information processing device according to an embodiment displays an object containing incentive information for a product on a display unit based on an image related to the product captured by a camera unit, acquires a product code based on a product code image captured by the camera unit, and, if an incentive is assigned to the product identified by the product code, registers the product identified by the product code by associating the incentive with the incentive. The information processing device thus displays incentive information for each product as an object, thereby providing incentive information to customers. Customers can easily recognize the incentive information for each product. Furthermore, by associating incentive information with each product, the information processing device allows the incentive information for each product to be easily and appropriately applied. Customers can appropriately obtain incentives for each product with simple operations. Therefore, the information processing device can encourage customers to use electronic devices to register products while shopping. Furthermore, the information processing device can provide incentive information to customers without requiring a store clerk to affix discount stickers. Therefore, the information processing device can improve the work efficiency of store clerks.

[0065] The information processing device according to the embodiment can display an object including incentive information corresponding to a customer's rank on a display unit. This allows the information processing device to provide different incentive information for each customer's rank. Customers can easily recognize the incentive information corresponding to their own rank. Furthermore, by associating incentive information with products and customer ranks, the information processing device can easily and appropriately apply incentive information corresponding to the customer's rank for each product. Customers can appropriately obtain incentives corresponding to their own rank for each product with simple operations. Therefore, the information processing device can encourage customers to use electronic devices to register products while shopping.

[0066] In accordance with an embodiment, an information processing device can register a product identified by a product code by associating the incentive with the product code when an incentive is set for the product identified by the product code based on a customer's selection of an object. This allows the information processing device to apply only the incentive selected by the customer to the product. Therefore, the information processing device can omit the process of applying incentives indicated by objects not selected by the customer to products, thereby simplifying the process. By requiring a customer to select an object as a condition, the information processing device can encourage customers to use an electronic device to register products while shopping, even if the product has an incentive set.

[0067] The information processing device according to the embodiment can distinguishably display a selected object based on a user's instruction to select the object, thereby allowing the user to easily understand that the object is in a selected state. The information processing device according to the embodiment displays on the display unit multiple objects containing incentive information for multiple products based on multiple images related to multiple products captured by a camera unit, and can identifiably display one selected object from the multiple objects based on a user's instruction to select one object from the multiple objects. This allows the user to easily understand the incentive for the product to be registered. The information processing device can easily and appropriately apply the incentive selected by the user to the product.

[0068] [Second embodiment] The second embodiment will be described below with reference to the drawings. The same components as those in the first embodiment are denoted by the same reference numerals, and the description thereof will be omitted. In the second embodiment, the differences from the first embodiment will be mainly described.

[0069] (Configuration example) 7 is a block diagram illustrating an information processing system 100 according to the second embodiment. The information processing system 100 includes a server 1 and a user terminal 2, similar to the first embodiment.

[0070] The server 1 is an electronic device that collects and processes data. The electronic device includes a computer. The server 1 is connected to a user terminal 2 via a network so as to be able to communicate freely. The server 1 receives various data from the user terminal 2 and outputs various data to the user terminal 2. The server 1 manages, for example, information about products in a store such as a supermarket. An example of the configuration of the server 1 will be described later. The server 1 is an example of an information processing device.

[0071] The user terminal 2 is an electronic device capable of communicating with other electronic devices. The user terminal 2 is, for example, a device used by a customer of a store. For example, the user terminal 2 is a smartphone or a tablet terminal. The customer may be read as a user or a person. An example of the configuration of the user terminal 2 will be described later.

[0072] An example of the configuration of the server 1 will be described. The hardware configuration of the server 1 is the same as that of the first embodiment.

[0073] The auxiliary storage device 13 includes an object data storage area 130. As described in the first embodiment, the object data storage area 130 stores data of at least one object.

[0074] The auxiliary storage device 13 includes a product data storage area 131. As described in the first embodiment, the product data storage area 131 stores product data relating to at least one product.

[0075] The auxiliary storage device 13 includes a user data storage area 132. The user data storage area 132 stores user data as described in the first embodiment.

[0076] The auxiliary storage device 13 includes a registered product data storage area 133. The registered product data storage area 133 stores registered product data as described in the first embodiment.

[0077] The hardware configuration of the server 1 is not limited to the above configuration, and the server 1 allows the omission or modification of the above components and the addition of new components as appropriate.

[0078] Each unit implemented in the processor 11 will be described.

[0079] The processor 11 realizes an acquisition unit 110, a display control unit 111, and a registration unit 112. The units realized by the processor 11 can also be referred to as functions. The units realized by the processor 11 can also be referred to as being implemented in a control unit including the processor 11 and the main memory 12.

[0080] The acquisition unit 110 acquires an object including incentive information for a product based on an image related to the product captured via the camera 28 of the user terminal 2. The incentive information included in the object is basic incentive information or total incentive information, as described in the first embodiment. The image related to the product may be an AR marker image itself, or an image including an AR marker image, as described in the first embodiment. For example, the acquisition unit 110 acquires AR marker image information from the user terminal 2 via a network based on an image related to the product captured via the camera 28. The user terminal 2 performs image processing on the AR marker image to acquire the AR marker image information. The user terminal 2 outputs the AR marker image information to the server 1 via the network.

[0081] The acquiring unit 110 acquires an object including basic incentive information associated with the acquired AR marker image information stored in the auxiliary storage device 13. First, a case will be described in which the user of the user terminal 2 has not registered as a member or checked in, or the user of the user terminal 2 does not belong to a rank that satisfies the requirements for applying additional incentive information. In this example, the acquiring unit 110 acquires an object including basic incentive information as an object including incentive information. Next, a case will be described in which the user of the user terminal 2 belongs to a rank that satisfies the requirements for applying additional incentive information. In this example, the acquiring unit 110 may change the incentive information included in the object depending on the user's rank. In this case, the acquiring unit 110 acquires user data from the auxiliary storage device 13. The acquiring unit 110 acquires total incentive information in which the additional incentive information is applied to the basic incentive information depending on the user's rank. The acquiring unit 110 acquires the object including total incentive information as an object including incentive information.

[0082] The acquisition unit 110 acquires, via a network, object selection information from the user terminal 2. The user terminal 2 outputs the object selection information to the server 1 via the network, based on an object selection instruction input by the user via the input device 27.

[0083] The acquiring unit 110 acquires a product code based on a product code image captured by the camera 28 of the user terminal 2. For example, the acquiring unit 110 acquires a product code from the user terminal 2 via a network based on the capture of the product code image by the camera 28 of the user terminal 2. The user terminal 2 performs image processing on the captured product code image to acquire the product code. The user terminal 2 outputs the product code to the server 1 via the network. Note that the user terminal 2 may transmit a product code image included in a captured image related to the product to the server, and the server 1 may acquire the product code of the product by performing image processing on the received product code image.

[0084] The acquisition unit 110 acquires the product code and object selection information in association with the product registration instruction from the user terminal 2 via a network. The acquisition unit 110 may acquire the product code and object selection information in association with the product registration instruction from the user terminal 2 simultaneously, or may acquire them at different times.

[0085] The display control unit 111 displays an object including incentive information for a product on the display device 25 based on an image related to the product captured by the camera 28. The display control unit 111 displays the object on the display device 25 based on the acquisition of the object by the acquisition unit 110 based on the image related to the product captured by the acquisition unit 110. For example, the display control unit 111 outputs the object to the user terminal 2 via a network based on the acquisition of the object including incentive information by the acquisition unit 110. The display control unit 111 displays the object on the display device 25 by outputting the object to the user terminal 2. Note that the display control unit 111 may display multiple objects including incentive information for multiple products on the display device 25 based on multiple images related to multiple products captured by the camera 28. The user terminal 2 displays one or more objects on the display device 25 based on the acquisition of one or more objects from the server 1 via the network.

[0086] As described in the first embodiment, the display control unit 111 identifiably displays a selected object based on an instruction to select an object by a user. The display control unit 111 identifiably displays the selected object based on object selection information acquired by the acquisition unit 110. The display control unit 111 identifiably displays that the object selected by the user is the selected object. The display control unit 111 may display the selected object in a display mode different from that of the object displayed on the display device 25 before the user selected the selected object.

[0087] As described in the first embodiment, the display control unit 111 displays one selected object selected from the plurality of objects in an identifiable manner based on a user's instruction to select one object from the plurality of objects. For example, the display control unit 111 displays one selected object selected from the plurality of objects in an identifiable manner based on object selection information acquired by the acquisition unit 110.

[0088] The registration unit 112 updates the registered product data based on a product registration instruction. The registration unit 112 executes registration processing for a product identified by a product code based on the acquisition of a product code by the acquisition unit 110. For example, the registration unit 112 executes registration processing for a product identified by a product code based on a user's instruction to select an object and the acquisition of a product code by the acquisition unit 110. If an incentive is set for the product identified by the product code acquired by the acquisition unit 110 based on the user's instruction to select an object, the registration unit 112 registers the product identified by the product code by associating the incentive with the product. If no incentive is set for the product identified by the product code acquired by the acquisition unit 110 based on the user's instruction to select an object, the registration unit 112 registers the product identified by the product code without associating an incentive with the product.

[0089] For example, the registration unit 112 determines whether an incentive is set for a product associated with a product code acquired by the acquisition unit 110, based on the acquisition of object selection information by the acquisition unit 110. If the product data associated with the product code acquired by the acquisition unit 110 contains set incentive information, the registration unit 112 determines that an incentive is set for the product associated with the product code. If the product data associated with the product code acquired by the acquisition unit 110 does not contain set incentive information, the registration unit 112 determines that no incentive is set for the product associated with the product code. If an incentive is set for the product associated with the product code, the registration unit 112 registers the product identified by the product code by associating the incentive. The registration unit 112 adds a record including the product code, registered incentive information, and a price to the registered product data. The registration unit 112 acquires a price based on the product code from the product master. If no incentive is set for the product associated with the product code, the registration unit 112 registers the product identified by the product code without associating an incentive. The registration unit 112 adds a record including the product code and a price to the registered product data. The registration unit 112 acquires the price based on the product code from the product master. Note that, as described in the first embodiment, the acquisition unit 110 may not acquire object selection information from the user terminal 2 via the network. In this case, the registration unit 112 registers the product identified by the product code without associating it with an incentive, regardless of whether an incentive is set for the product associated with the product code.

[0090] Note that the registration unit 112 is not limited to executing the registration process for a product identified by a product code based on an instruction to select an object by a user and the acquisition of a product code by the acquisition unit 110. As in the first embodiment, the registration unit 112 may execute the registration process for a product identified by a product code based on the acquisition of a product code by the acquisition unit 110, without requiring an instruction to select an object by a user. In this example, if an incentive is set for the product identified by the product code acquired by the acquisition unit 110, the registration unit 112 registers the product identified by the product code by associating the incentive with the product. If an incentive is not set for the product identified by the product code acquired by the acquisition unit 110, the registration unit 112 registers the product identified by the product code without associating an incentive with the product.

[0091] An example of the configuration of the user terminal 2 will be described. The hardware configuration of the user terminal 2 is the same as that in the first embodiment.

[0092] The hardware configuration of the user terminal 2 is not limited to the above configuration. The user terminal 2 allows the above components to be omitted or changed, and new components to be added, as appropriate.

[0093] (Example of operation) The processing procedure performed by the server 1 will now be described. In the following description focusing on the server 1, the server 1 may be read as the processor 11. Similarly, in the following description focusing on the user terminal 2, the user terminal 2 may be read as the processor 21. The processing procedures described below are merely examples, and each process may be modified as much as possible. Furthermore, steps may be omitted, replaced, or added as appropriate depending on the embodiment.

[0094] Here, as in the first embodiment, it is assumed that a user of a user terminal 2 purchases discounted products such as prepared dishes and boxed lunches at a store T that sells food, such as a supermarket. The user has completed membership registration using a dedicated application program. When the user registers as a member, a unique member ID is issued to the user. The member ID is set, for example, in the user terminal 2 owned by the user. The user terminal 2 may be a terminal owned by the user or a terminal loaned to the user by the store T. The user may register products via the user terminal 2 without registering as a member. In this case, the registration unit 112 may obtain the user's member ID at the time of payment. At the time of payment, the registration unit 112 may update the registered incentive information associated with the registered products to total incentive information in which additional incentive information according to the user's rank is applied to basic incentive information.

[0095] A user checks in via a check-in device installed at the entrance of store T. For example, when a user starts a dedicated application program on user terminal 2, a barcode or two-dimensional code representing the member ID is displayed on display device 25. The user reads the member ID via the check-in device and checks in. The member ID may be recorded on an RFID, IC card, magnetic card, or the like. Check-in using the member ID may be performed using a known process.

[0096] The user reads the AR markers attached to the products displayed in the store T via the camera 28, and causes the display device 25 to display AR content based on the AR markers. The server 1 performs the following information processing based on the fact that the user has read the AR marker.

[0097] FIG. 8 is a flowchart illustrating an example of the procedure of information processing by the server 1 according to the second embodiment.

[0098] The acquisition unit 110 acquires an object including incentive information for a product based on an image related to the product captured by the camera 28 of the user terminal 2 (ACT11). In ACT11, the acquisition unit 110 acquires AR marker image information output from the user terminal 2 via the network based on the image related to the product captured by the camera 28. The acquisition unit 110 acquires an object associated with the acquired AR marker image information stored in the auxiliary storage device 13. The acquisition unit 110 may change the incentive information included in the object depending on the user's rank. In this case, the acquisition unit 110 acquires user data from the auxiliary storage device 13 based on, for example, the member ID acquired at check-in. The acquisition unit 110 acquires total incentive information by applying additional incentive information to basic incentive information depending on the user's rank.

[0099] The display control unit 111 displays an object including incentive information for a product on the display device 25 based on an image related to the product captured by the camera 28 (ACT12). In ACT12, for example, the display control unit 111 outputs the object to the user terminal 2 based on the acquisition of the object including the incentive information by the acquisition unit 110. The display control unit 111 displays the object on the display device 25 by outputting the object to the user terminal 2. The display control unit 111 may acquire multiple images related to multiple products captured by the camera 28 from the user terminal 2, and display multiple objects including incentive information for the multiple products on the display device 25 based on the acquired multiple images. The processor 11 may output a sound indicating the incentive information via the speaker 26 in addition to or instead of displaying the object.

[0100] The acquisition unit 110 acquires an object selection instruction from the user (ACT13). In ACT13, for example, the acquisition unit 110 acquires object selection information from the user terminal 2 via a network. The acquisition unit 110 acquires the object selection instruction from the user based on the object selection information. The display control unit 111 acquires the object selected by the user as the selected object based on the user's object selection operation on the display device 25. The display control unit 111 may acquire one object selected by the user as the selected object based on the user's operation to select one object from multiple objects. The display control unit 111 displays the selected object in an identifiable manner based on the user's object selection instruction.

[0101] The acquisition unit 110 acquires a product code based on a product code image captured by the camera 28 of the user terminal 2 (ACT14). In ACT14, for example, the acquisition unit 110 acquires the product code from the user terminal 2 via a network. Alternatively, the acquisition unit 110 may acquire a product code image captured by the camera 28 of the user terminal 2, and acquire a product code based on the acquired product code image and a product master stored in advance in the server.

[0102] If an incentive is set for the product identified by the product code, the registration unit 112 associates the incentive with the product identified by the product code and registers the product identified by the product code (ACT15). In ACT15, for example, the registration unit 112 determines whether an incentive is set for the product identified by the product code acquired by the acquisition unit 110. If an incentive is set for the product associated with the product code, the registration unit 112 associates the incentive with the product identified by the product code and registers the product. If an incentive is not set for the product associated with the product code, the registration unit 112 registers the product identified by the product code without associating an incentive with it. Note that the registration unit 112 may execute the registration process for the product identified by the product code without requiring a user to select an object.

[0103] Then, processor 11 calculates the discounted price by applying the registered incentive information to the price of the registered product based on the registered product data. Processor 11 performs known accounting processing based on the discounted price based on the accounting instructions from the user.

[0104] In ACT11, the acquisition unit 110 acquires AR marker image information from the user terminal 2 via a network, but this is not limiting. The acquisition unit 110 may acquire an image related to a product from the user terminal 2 via a network based on an image related to the product being captured by the camera 28 of the user terminal 2. In this example, the acquisition unit 110 acquires an AR marker image based on the image related to the product acquired from the user terminal 2. The acquisition unit 110 performs image processing on the AR marker image to acquire the AR marker image information.

[0105] (effect) An information processing device according to an embodiment displays an object containing incentive information for a product on a display unit based on an image related to the product captured by a camera unit, acquires a product code based on a captured product code image, and, if an incentive is assigned to the product identified by the product code, registers the product identified by the product code by associating the incentive with the incentive. The information processing device thus displays incentive information for each product as an object, thereby providing incentive information to customers. Customers can easily recognize the incentive information for each product. Furthermore, by associating incentive information with each product, the information processing device allows the incentive information for each product to be easily and appropriately applied. Customers can appropriately obtain incentives for each product with simple operations. Therefore, the information processing device can encourage customers to use electronic devices to register products while shopping. Furthermore, the information processing device can provide incentive information to customers without requiring a store clerk to affix discount stickers. Therefore, the information processing device can improve the work efficiency of store clerks. Furthermore, even if the user terminal becomes unusable due to a dead battery or the like, the product registration information is stored in the auxiliary storage device of the information processing device, an example of which is a server, so that when the user terminal is used again, it can be resumed from the state in which the product registration was made before the battery ran out. Also, since the user terminal only needs to output the read information to the server and receive and display the information sent from the server, the load on the processing or memory capacity executed by the user terminal can be reduced.

[0106] The information processing device according to the embodiment can display an object including incentive information corresponding to a customer's rank on a display unit. This allows the information processing device to provide different incentive information for each customer's rank. Customers can easily recognize the incentive information corresponding to their own rank. Furthermore, by associating incentive information with products and customer ranks, the information processing device can easily and appropriately apply incentive information corresponding to the customer's rank for each product. Customers can appropriately obtain incentives corresponding to their own rank for each product with simple operations. Therefore, the information processing device can encourage customers to use electronic devices to register products while shopping.

[0107] In accordance with an embodiment, an information processing device can register a product identified by a product code by associating the incentive with the product code when an incentive is set for the product identified by the product code based on a customer's selection of an object. This allows the information processing device to apply only the incentive selected by the customer to the product. Therefore, the information processing device can omit the process of applying incentives indicated by objects not selected by the customer to products, thereby simplifying the process. By requiring a customer to select an object as a condition, the information processing device can encourage customers to use an electronic device to register products while shopping, even if the product has an incentive set.

[0108] The information processing device according to the embodiment can distinguishably display a selected object based on a user's instruction to select the object, thereby allowing the user to easily understand that the object is in a selected state. The information processing device according to the embodiment displays on the display unit multiple objects containing incentive information for multiple products based on multiple images related to multiple products captured by a camera unit, and can identifiably display one selected object from the multiple objects based on a user's instruction to select one object from the multiple objects. This allows the user to easily understand the incentive for the product to be registered. The information processing device can easily and appropriately apply the incentive selected by the user to the product.

[0109] [Other embodiments] Although an example has been described in which the set incentive information includes additional incentive information that varies depending on the user's rank, the present invention is not limited to this. The set incentive information may include incentive information set according to the rank instead of additional incentive information. The incentive information set according to the rank is information indicating an incentive that is granted instead of the incentive indicated by the basic incentive information. In this example, the incentive information included in the object is the basic incentive information or incentive information set according to the rank.

[0110] Although AR markers are used to display objects, the present invention is not limited to this. Instead of AR markers, codes that can display objects, such as QR codes, barcodes, chameleon codes, etc., may be used.

[0111] The incentive information is not limited to information on the discount rate, but may be information on the discount amount, information on the price, information on the points to be awarded, or information on the chargeback of electronic money.

[0112] The information processing device may be realized by one device such as the server 1 or the user terminal 2, or may be realized by a plurality of devices with distributed functions.

[0113] The program may be transferred in a state where it is stored in an electronic device, or in a state where it is not stored in an electronic device. In the latter case, the program may be transferred via a network, or in a state where it is recorded on a recording medium. The recording medium is a non-transitory tangible medium. The recording medium is a computer-readable medium. The form of the recording medium is not important as long as it is a medium that can store the program and is computer-readable, such as a CD-ROM or a memory card.

[0114] Although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be embodied in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope and spirit of the invention, and are also included in the scope of the invention and its equivalents as defined in the claims. [Explanation of symbols]

[0115] 1...server, 2...user terminal, 11...processor, 12...main memory, 13...auxiliary storage device, 14...communication interface, 21...processor, 22...main memory, 23...auxiliary storage device, 24...communication interface, 25...display device, 26...speaker, 27...input device, 28...camera, 100...information processing system, 110...acquisition unit, 111...display control unit, 112...registration unit, 130...object data storage area, 131...product data storage area, 132...user data storage area, 133...registered product data storage area, 210...acquisition unit, 211...display control unit, 212...registration unit, A...AR image, Aa-Ab...AR images, AA...AR marker image, Ba-Bb...object, Ca...object, Cb...AR image, Pa-Pb...product, Sc...screen.

Claims

1. a display control unit that displays, on a display unit, an object including incentive information for a product based on an image related to the product photographed by the photographing unit; an acquisition unit that acquires a product code based on the product code image captured by the imaging unit; a registration unit that, when an incentive is set for a product identified by the product code, registers the product identified by the product code in association with the incentive; An information processing device comprising:

2. The information processing device according to claim 1 , wherein the incentive information is information corresponding to a rank of the user.

3. 3. The information processing device according to claim 1, wherein, when the incentive is set for a product identified by the product code based on a user's instruction to select the object, the registration unit registers the product identified by the product code in association with the incentive.

4. 3. The information processing device according to claim 1, wherein the display control unit displays on the display unit a plurality of objects including incentive information for a plurality of products based on a plurality of images related to the plurality of products photographed by the photographing unit, and displays a selected object from the plurality of objects in an identifiable manner based on a user's instruction to select one object from the plurality of objects.

5. displaying, on a display unit, an object including incentive information for a product based on an image related to the product photographed by a photographing unit; acquiring a product code based on a product code image captured by the image capturing unit; and, if an incentive is set for the product identified by the product code, registering the product identified by the product code in association with the incentive. An information processing method comprising:

6. On the computer, a display control function for displaying on a display unit an object including incentive information for a product based on an image related to the product photographed by a photographing unit; an acquisition function for acquiring a product code based on a product code image captured by the photographing unit; a registration function for registering the product identified by the product code in association with the incentive if an incentive is set for the product identified by the product code; An information processing program for executing the above.

Images