Information processing device, information processing method, and program
Automated image examination using a model improves the speed and quality of image reviews, addressing the inefficiencies of manual methods and enhancing user satisfaction.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2025-10-22
- Publication Date
- 2026-03-16
AI Technical Summary
Manual image examination in image publishing is slow and may compromise examination quality, potentially affecting user satisfaction.
An information processing apparatus and method that utilizes a model to automate image examination by acquiring images and applying predetermined criteria, improving the speed and quality of the review process.
Enhances user satisfaction by expediting and ensuring the quality of image reviews through automated examination using a model.
Smart Images

Figure 0007830755000001_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to an information processing apparatus, an information processing method, and a program.
Background Art
[0002] Conventionally, an image provided by a predetermined image provider has been published in a predetermined publication medium. For example, Patent Document 1 discloses a technique for displaying an advertisement image provided by a party different from the operator of the application on the screen of the application.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] By the way, when publishing an image, there may be a case where it is examined whether the image meets a predetermined examination standard. When this examination is performed manually, it is difficult to speed up the examination and ensure the examination quality, and there is a possibility that the satisfaction of the users of the image examination may be impaired.
[0005] The present invention has been made in consideration of such circumstances, and one of its objects is to provide an information processing apparatus, an information processing method, and a program that can improve the satisfaction of users of image examination.
Means for Solving the Problems
[0006] One aspect of the present invention is an information processing apparatus including an acquisition unit that acquires an image, a prompt including the image, a predetermined examination standard, and a request for requesting output of an examination result of the image based on the examination standard, inputs the prompt into a model, and a processing unit that acquires the examination result output by the model. [Effects of the Invention]
[0007] According to one aspect of the present invention, it is possible to provide an information processing device, an information processing method, and a program that can improve user satisfaction in image review. [Brief explanation of the drawing]
[0008] [Figure 1] This diagram shows an example of a configuration for implementing an electronic payment service. [Figure 2] This is a sequence diagram (part 1) illustrating the general flow of electronic payments. [Figure 3] This is a sequence diagram (part 2) illustrating the general flow of electronic payments. [Figure 4] This is a diagram showing the configuration of payment server 100. [Figure 5] This figure shows an example of the contents of user information 172. [Figure 6] This figure shows an example of the contents of merchant / store information 176. [Figure 7] This figure shows an example of the contents of coupon management information 178. [Figure 8] This flowchart shows an example of the processing flow for using a coupon. [Figure 9] This figure shows an example of an interface screen provided by the information provision unit 150 to the payment application 20. [Figure 10] This figure shows an example of the content of display image information 180. [Figure 11] This figure shows an example of the functional configuration of the image review management unit 200. [Figure 12] This sequence diagram shows an example of image review processing performed by the second store terminal device 70, the payment server 100, and the model 300. [Figure 13] This figure shows an example of an interface screen provided to the merchant interface 72 when an image is provided. [Figure 14] This figure shows an example of a prompt. [Figure 15] This flowchart shows an example of the process performed in step S26 in the sequence diagram of Figure 12. [Figure 16] This figure shows an example of an interface screen provided to the merchant interface 72 from the time the image is submitted until the review results are displayed. [Figure 17] This figure shows an example of the interface screen provided to the merchant interface 72 when the masking button BT2-2 is operated. [Figure 18] This flowchart shows an example of the processing flow for image display requests. [Figure 19] This figure shows an example of an interface screen provided to the merchant interface 72 when an image display application is submitted. [Figure 20] This figure shows an example of the contents of application information 272. [Modes for carrying out the invention]
[0009] Hereinafter, embodiments of an information processing apparatus, an information processing method, and a program according to the present invention will be described with reference to the drawings. Various apparatuses such as those described below, which provide services to users or perform internal analysis, such as apparatuses and servers, may be realized by a decentralized group of apparatuses, and the operators of each apparatus may be different. Also, the holder of the hardware of the apparatus (provider of the cloud server) and the operator who performs the actual operation may be different. The application program and the settlement server cooperate to provide an electronic payment service. In the following description, the application program is referred to as a payment application. The electronic payment service is a service that supports the settlement related to the purchase of goods and services in a store. The store is, for example, a physical store (actual store) existing in the real space, but may include a virtual store for e-commerce. The virtual store may include those provided by a party different from the operator of the electronic payment service. In that case, when making a purchase settlement in the virtual store, it is controlled to transition to the interface screen of the electronic payment service. In the electronic payment service, the store is, for example, treated as belonging to a franchise (brand), and processing such as settlement when a purchase action is performed in the store is mainly carried out between the user and the franchise. Instead of this, processing such as settlement may be carried out between the user and the store. In the following description, the franchise and / or the store may sometimes be referred to as "franchises, etc.".
[0010] [Information Processing System] FIG. 1 is a diagram showing an example of the configuration of an information processing system in which an electronic payment service and an image review service are realized. The electronic payment service is realized centering around the payment server 100. The image review service is realized centering around the payment server 100 and the model 300. The information processing system that realizes the electronic payment service and the image review service includes, for example, one or more user terminal devices 10, one or more first store terminal devices 50, one or more second store terminal devices 70, a payment server 100, and a model 300. These devices communicate with each other via, for example, a network NW. The network NW includes, for example, the Internet, a LAN (Local Area Network), a wireless base station, a provider device, and the like. The payment server 100 is an example of an "information processing device". The second store terminal device 70 is an example of an "external device".
[0011] Some or all of the functional configurations included in the information processing system may be distributed among a plurality of devices in an arbitrary form or integrated into an arbitrary device. For example, some or all of the functional configurations of the payment server 100 may be included in a device different from the payment server 100, or some or all of the model 300 may be included in the payment server 100.
[0012] [Electronic Payment Service] Hereinafter, after mainly explaining the electronic payment service, the configuration and processing related to the image review service will be described in detail.
[0013] The user terminal device 10 is, for example, a portable terminal device such as a smartphone or tablet. The user terminal device 10 is a computer device having at least optical reading function, communication function, display function, input reception function, and program execution function. In the following description, the components for realizing these functions will be referred to as a camera, communication device, touch panel, CPU (Central Processing Unit), etc. In the user terminal device 10, the payment application 20 is executed by a processor such as the CPU, and it operates in cooperation with the payment server 100 to provide electronic payment services to the user. The payment application 20 is installed on the user terminal device 10, for example, from an application store, and controls the camera, communication device, touch panel, etc.
[0014] The first store terminal device 50 is installed, for example, in a store. The first store terminal device 50 is a computer device having at least a product price acquisition function, an optical reading function, a program execution function, and a communication function. The first store terminal device 50 may include a so-called POS (Point of Sale) device, and the product price acquisition function and optical reading function may be realized by the POS device. The store code image 60 is placed in the store and is a code image such as a QR code (registered trademark) printed on paper or plastic media. The store code image 60 may also be displayed on a display placed in the store (which may be the display of a terminal device such as a smartphone).
[0015] The second store terminal device 70 is used by the merchant (for example, the operator of the merchant). The second store terminal device 70 is a smartphone, tablet, personal computer, etc. The merchant interface 72 operates on the second store terminal device 70. The merchant interface 72 may be a merchant application or a browser. The merchant interface 72 accepts coupon settings etc. from the merchant operator and transmits them to the payment server 100. The second store terminal device 70, which is a smartphone, has the function of displaying a code image corresponding to a store code image by running the merchant application, and reading a code image displayed by the user terminal device 10. In addition, when the merchant interface 72 is executed on the second store terminal device 70, it operates in cooperation with the payment server 100 and model 300 to provide an image verification service to the merchant.
[0016] The payment server 100 implements electronic payment based on payment information received from the user terminal device 10 or the first store terminal device 50. The first store terminal device 50 may include a POS device and a merchant server, in which case payment information is transmitted from the POS device to the payment server 100 via the merchant server. In the following description, this distinction will not be made, and it will be assumed that payment information is transmitted from the first store terminal device 50.
[0017] Figures 2 and 3 are sequence diagrams illustrating the general flow of electronic payments. There may be two patterns for electronic payments: Pattern 1 and Pattern 2.
[0018] In the case of Pattern 1 shown in Figure 2 (hereinafter referred to as User Scan), the user terminal device 10, with the payment application 20 running, decodes the store code image 60 using its optical reading function (S1). The store code image 60 contains information about the store URL (Uniform Resource Locator). This store URL is an electronic payment service domain to which information that can identify the store has been added, and is associated with the merchant ID and store ID, etc., at the payment server 100 (described later). The payment application 20 sends the first payment information, including the store URL and account ID, to the payment server 100 (S2). The payment server 100 searches for store information (described later) from the merchant ID and store ID corresponding to the store URL, obtains the merchant name and store name information (S3), and sends it to the payment application 20 (S4). The user enters the payment amount into the user terminal device 10 on the screen where the merchant name and store name are displayed (S5). The user terminal device 10 then generates second payment information, including at least the payment amount, and sends it to the payment server 100 (S6). The payment server 100 performs electronic payment based on the received second payment information (S7). The payment server 100 then sends a payment completion notification (information for displaying the payment completion screen) to the payment application 20 (S8), and the payment application 20 displays the payment completion screen (S9). If the store code image 60 is displayed on a display placed in the store, the store code image 60 may include payment amount information as well as the store URL. In this case, the procedure for the user to enter the payment amount is omitted, and the payment amount information is included in the first payment information and sent to the payment server 100. Merchant name and store name information may be included and displayed on the payment completion screen.
[0019] In the case of Pattern 2 shown in Figure 3 (hereinafter referred to as Store Scan), when the payment app 20 is launched, when a payment operation is performed in the payment app 20, when it is time for an automatic update (for example, every minute), and at other times, the payment app 20 sends a request to the payment server 100 to issue a one-time code (S11). The payment server 100 generates a one-time code (S12) and sends it to the payment app 20 (S13). The payment app 20 displays a code image such as a QR code or barcode that was generated based on the one-time code (S14). The user holds the display surface of the user terminal device 10 over the first store terminal device 50 (presents it), and the first store terminal device 50 decodes the code image using its optical reading function and obtains the one-time code, etc. (S15). Then, the first store terminal device 50 generates payment information including the one-time code, payment amount, merchant ID, store ID, etc., and sends it to the payment server 100 (S16). The payment amount information is obtained in advance by barcode scanning or manual input. Based on the received information, the payment server 100 identifies the user corresponding to the one-time code and performs the electronic payment (S17). The payment server 100 then sends a payment completion notification to the payment app 20 (S18), and the payment app 20 displays a payment completion screen (S19).
[0020] Furthermore, electronic payment may be performed using only one of the above patterns. Also, the "account ID" explained in Figure 2 may be other information that can be used as user identification information (for example, a phone number). In addition, the issuance of a one-time code may be omitted during store scanning, and the payment app 20 may display a code image generated based on the user's account ID. In that case, the payment server 100 will identify the user corresponding to the account ID instead of identifying the user corresponding to the one-time code.
[0021] [Payment Server] Figure 4 is a diagram of the configuration of the payment server 100. The payment server 100 is used by entities (providers) that provide electronic payment services. The payment server 100 includes, for example, a communication unit 110, a payment content provision unit 120, a payment processing unit 130, an information management unit 140, an information provision unit 150 (details described later), a storage unit 170, and an image review management unit 200 (details described later). Components other than the communication unit 110 and the storage unit 170 are realized, for example, by a hardware processor such as a CPU executing a program (software). Some or all of these components may be realized by hardware (including circuitry) such as LSI (Large Scale Integration), ASIC (Application Specific Integrated Circuit), FPGA (Field-Programmable Gate Array), GPU (Graphics Processing Unit), and SOC (System On Chip), or by the cooperation of software and hardware. The program may be stored in advance on a storage device such as an HDD (Hard Disk Drive) or flash memory (a storage device equipped with a non-transient storage medium), or it may be stored on a removable storage medium such as a DVD or CD-ROM (a non-transient storage medium) and installed on the storage device when the storage medium is inserted into the drive device.
[0022] The storage unit 170 can be an HDD, flash memory, RAM (Random Access Memory), etc. The storage unit 170 may also be a NAS (Network Attached Storage) device that the payment server 100 can access via the network. The storage unit 170 stores information such as user information 172, payment content information 174, merchant / store information 176, coupon management information 178, and display image information 180 (details described later). Some of this information may also be stored in the storage unit of the user terminal device 10.
[0023] The communication unit 110 is a communication interface for connecting to a network NW. The communication unit 110 is, for example, a network interface card.
[0024] The payment content provision unit 120, for example, has the functionality of a web server and provides information (content) for displaying various screens of the electronic payment service to the user terminal device 10. The payment content provision unit 120 reads the necessary content from the payment content information 174 as appropriate and provides it to the user terminal device 10. The user terminal device 10 receives various inputs from the user while the content is being played by the payment application 20 and transmits the aforementioned payment information and other data to the payment server 100.
[0025] The payment processing unit 130 performs payment processing based on payment information transmitted by the user terminal device 10 or the first store terminal device 50. The payment processing unit 130 performs payment processing while referring to the user information 172.
[0026] Figure 5 shows an example of the contents of User Information 172. User Information 172 is an example of user registration information. User Information 172 includes, for example, user URL, account ID, telephone number, password, as well as information such as email address, user ID, name, address, date of birth, registration date, charge balance, credit payment settings, credit payment limit, credit payment amount, available credit payment amount, payment method settings, bank account, credit card number, charge history information, and payment history information. The user URL is used for money transfer processing between users. When registering for a new electronic payment service, registration of a telephone number and password is mandatory. The account ID is issued to the user by the payment server 100, and the user ID is an ID that the user can set at will (or does not have to set). Similarly, the email address and name, address, and date of birth are also information that the user can set at will (or does not have to set). The registration date is the date the user registered for the electronic payment service (the date the account was created). Hereafter, the user instance (electronic payment account) to which this information is associated will be referred to as an account.
[0027] The charge balance is information indicating the balance of electronic money set by the user by sending money to their account in advance. Methods of sending money include sending from an ATM (Automatic Teller Machine) of a designated provider (bank) and sending from a registered bank account. The credit payment setting indicates whether or not the user has completed the settings to enable electronic payments by credit card, and is set to either "Completed" or "Not Completed". The credit payment limit is the monthly limit for credit payments, the credit payment amount is the amount already used for credit payments in the current month, and the available credit payment amount is the amount available for credit payments in the current month, calculated by subtracting the credit payment amount from the credit payment limit. While the diagram shows only one credit payment limit, in reality there are also daily limits, and the lower of these may be set as the credit payment limit. Further details on credit payments will be described later. The payment method setting indicates whether the user will use electronic payment with the charge balance or payment by credit card at that time. The bank account and credit card number information, respectively, refers to the bank account or credit card number (account number, card number) to which funds can be deposited into the electronic payment service. The charge history information is a record of when the user has previously sent money to the electronic payment service to increase the charge balance. The payment history information shows the details of each payment made by the user (date and time, store ID of the store where the purchase was made, payment amount, payment method, etc.).
[0028] Furthermore, if a user possesses an electronic coupon, the coupon information is associated with the user URL, etc., in user information 172. A coupon is a coupon that can be used for payment at participating merchants, etc., in electronic payment services. Coupon information includes, for example, a coupon ID to identify the coupon.
[0029] Figure 6 shows an example of the contents of the merchant / store information 176. The merchant / store information 176 includes, for example, a first table 176A in which the merchant ID and store ID are associated with the store URL, a second table 176B in which the merchant name and sales amount (as described above) are associated with the merchant ID, and a third table 176C in which the store name is associated with the store ID. In addition to this information, the merchant / store information 176 may also include information such as the merchant or store category, the store's location, and payment patterns.
[0030] Figure 7 shows an example of the contents of coupon management information 178. Coupon management information 178 is, for example, a coupon ID associated with detailed information that shows the details of that coupon. The detailed information may include, for example, the content of the benefits that the user can receive with the coupon (e.g., discount rate or discount amount) and information that shows the conditions under which the coupon can be used. The information that shows the conditions for use may include, for example, a merchant ID, a store ID, and / or product ID that show the merchant, store, and / or product for which the coupon can be used. The detailed information may also include information such as the minimum payment amount (e.g., payment of XX yen or more), the period during which the coupon can be used, and the days of the week.
[0031] Returning to Figure 4, the Information Management Unit 140 manages user information 172 and affiliated store / store information 176 based on information obtained from the user terminal device 10 and the second store terminal device 70. The Information Management Unit 140 adds, edits, and deletes new records for user information 172 and affiliated store / store information 176. The Information Management Unit 140 also manages coupon management information 178 based on information obtained from the second store terminal device 70 and other sources. The Information Management Unit 140 adds, edits, and deletes new records for coupon management information 178 based on information obtained from the second store terminal device 70 and other sources.
[0032] [Electronic payment] When the payment processing unit 130 obtains payment information from the user terminal device 10 or the first store terminal device 50, it refers to the user information 172 to obtain the user's "payment method setting". For users whose "payment method setting" is set to "charge balance", the payment processing unit 130 performs electronic payment as follows. For example, the payment processing unit 130 performs electronic payment by decreasing the charge balance, which is managed in association with the user ID, and increasing the value of the merchant's sales proceeds item. The merchant's sales proceeds item value is not used as electronic money itself, for example, but rather the amount corresponding to the sales proceeds item value is sent to the bank account (recipient account) in a cycle according to the agreement between the merchant and the electronic payment service (i.e., on the regular remittance day). The merchant may also receive the sales proceeds as electronic money. In this case, the payment server 100 manages the account (wallet) corresponding to the merchant ID, the electronic money balance of the account, and the sales proceeds history for each payment method in association.
[0033] The payment processing unit 130 performs electronic payment as follows for users whose "settings information" is set to "credit payment". Credit payment is a payment method in cooperation with a credit card company, which is a separate entity from the operator of the electronic payment service, and allows electronic payment that does not depend on the charge balance within the credit limit. In order to use the credit payment service, it may be required to obtain a credit card provided by the operator of the electronic payment service. The payment processing unit 130 adds the payment amount to the credit payment usage amount in the user information 172 and subtracts the above payment amount from the available credit payment amount. If the payment amount exceeds the available credit payment amount, an error notification is sent back to the payment app. The amount used by credit payment is settled, for example, in a lump sum for one month on the payment date of the following month, for example, by direct debit from a bank account. This processing is performed by the operator of the credit card company.
[0034] [Using a coupon] The payment server 100 (payment processing unit 130) determines whether the coupon can be used based on the coupon management information 178 and the payment information obtained from the first store terminal device 50, and executes the payment according to the determination result. Figure 3 above illustrates the general flow of electronic payment processing. Please refer to Figure 8 for details on the processing related to coupon use.
[0035] Figure 8 is a flowchart illustrating an example of the processing flow related to coupon usage. The payment information in S16 of Figure 3, as mentioned above, may include a product ID in addition to the one-time code, payment amount, merchant ID, and store ID. Before processing S100, we will explain assuming that the payment server 100 has acquired the payment information.
[0036] First, the payment processing unit 130 determines whether the user possesses a gift certificate that can be used for payment (S100). For example, the payment processing unit 130 identifies a coupon ID in the coupon management information 178 that satisfies the usage conditions (e.g., merchant ID, store ID, and / or product ID, etc.) for that payment. The payment server 100 determines that the user possesses a coupon that can be used for payment if the identified coupon ID is associated with the user information 172.
[0037] If the user has a coupon that can be used for payment, the payment server 100 executes the payment using the coupon (S102). For example, the payment processing unit 130 reflects the benefits associated with the coupon ID (such as discounts based on a discount rate or discounts based on a discount amount) and executes the electronic payment (as described above) based on the user's payment method settings. If the user does not have a coupon that can be used for payment, the payment processing unit 130 executes the payment without using a coupon (S104). In other words, the payment processing unit 130 executes the electronic payment (as described above) based on the user's payment method settings without reflecting the benefits as described above.
[0038] [Provision of information on affiliated stores and coupons] Returning to Figure 4, the information provision unit 150 provides the payment app 20 with information on participating merchants of the electronic payment service and coupon information.
[0039] Figure 9 shows an example of an interface screen provided by the information provision unit 150 to the payment application 20. In the illustrated example, the information provision unit 150 provides, for example, a merchant information screen IF11 to the payment application 20. The merchant information screen IF11 is a screen that provides information about merchants to users in the electronic payment service, and includes text indicating information about the merchant (for example, the name of the merchant) and images indicating information about the merchant (merchant image IM1). In the merchant information screen IF11 of the illustrated example, the logo image IM1-1 and cover image IM1-2 are displayed as merchant image IM1. However, the images displayed as merchant image IM1 can be changed as appropriate, and for example, interior images or exterior images of the merchant may be displayed in addition to (or instead of) these images IM1-1 and IM1-2.
[0040] In the illustrated example, the merchant information screen IF11 includes a coupon display CP that displays information about coupons usable for payments at that merchant in the electronic payment service. The coupon display CP includes the details of the benefits obtained from the coupon, as well as a coupon image IM2.
[0041] The information provision unit 150 provides such information based on member store / shop information 176, coupon management information 178 and / or display image information 180, etc.
[0042] Figure 10 shows an example of the contents of the display image information 180. The display image information 180 includes, for example, a first table 180A in which the merchant image IM1 is associated with information that can identify a merchant (merchant identification information), and a second table 180B in which the coupon image IM2 is associated with the coupon ID. The merchant identification information is, for example, the merchant ID and / or store ID. In the first table 180A, images IM1-1, IM1-2, ... are stored in association with the image category (logo image, cover image, ...) in the merchant image IM1. "Category" can also be rephrased as "the semantic content that the image represents" or "the display position on the merchant information screen IF11".
[0043] For example, the information provision unit 150 identifies merchant identification information to be provided via the merchant information screen IF11 in response to a predetermined operation performed by the user in the payment application 20 (for example, selecting a merchant on a map displayed in the payment application 20). The information provision unit 150 appropriately extracts information associated with the identified identification information from the merchant / store information 176 (see also Figure 6), and extracts the merchant image IM1 associated with the identification information along with its category from the first table 180A. Furthermore, the information provision unit 150 identifies the coupon ID associated with the identified identification information in the coupon management information 178 (see also Figure 7). The information provision unit 150 extracts the coupon image IM2 associated with the identified coupon ID from the second table 180B. Then, based on the various information extracted as described above, the information provision unit 150 generates the merchant information screen IF11 including the coupon display CP and provides it to the payment application 20.
[0044] Furthermore, the merchant / store information 176 and the first table 180A may be at least partially common. In other words, some or all of the information contained in the merchant / store information 176 may be contained in the first table 180A, and some or all of the information contained in the first table 180A may be contained in the merchant / store information 176. Similarly, the coupon management information 178 and the second table 180B may be at least partially common. In other words, some or all of the information contained in the coupon management information 178 may be contained in the second table 180B, and some or all of the information contained in the second table 180B may be contained in the coupon management information 178. In addition, the information provision unit 150 may display a coupon display CP with a coupon image IM2 attached on a screen different from the merchant information screen IF11 in the payment application 20.
[0045] [Image Review Service] Images provided to the payment application 20 (for example, merchant image IM1 and coupon image IM2) are desirable to be images that meet the screening criteria specified by the electronic payment service from various perspectives such as public order and morality. In the information processing system of this embodiment, images that have been screened to meet the above screening criteria by the image screening service described below are stored in the storage unit 170 (display image information 180) and provided to the payment application 20. The configuration and processing related to the image screening service will be described in detail below.
[0046] [Image Review Management Department] Figure 11 shows an example of the functional configuration of the image review management unit 200. The image review management unit 200 includes, for example, a display control unit 210, an acquisition unit 220, a processing unit 230, an application acceptance unit 240, a reflection unit 250, and a storage unit 270. Components other than the storage unit 270 are realized, for example, by a hardware processor such as a CPU executing a program (software). Some or all of these components may be realized by hardware (including circuitry) such as LSIs, ASICs, FPGAs, GPUs, and SOCs, or by the cooperation of software and hardware. The program may be stored in advance in a storage device such as an HDD or flash memory (a storage device equipped with a non-transient storage medium), or it may be stored in a removable storage medium such as a DVD or CD-ROM (a non-transient storage medium) and installed in the storage device when the storage medium is mounted on a drive device.
[0047] The storage unit 270 may be an HDD, flash memory, RAM, etc. The storage unit 270 may also be a NAS device accessible by the image review management unit 200 via a network. Information such as application information 272 is stored in the storage unit 270. Some or all of the information stored in the storage unit 270 may be stored in the storage unit 170 described above, and some or all of the information stored in the storage unit 170 may be stored in the storage unit 270. The storage unit 170 and the storage unit 270 may be implemented with the same configuration.
[0048] [Model] Model 300 is a model that outputs a response to a request from the payment server 100. Model 300 is, for example, a Large Language Model (LLM) or a Generative AI (Artificial Intelligence). Model 300 is a model that has been trained to learn from a large amount of data and to output a response in response to a request.
[0049] [Overview of Image Review Service] In the image review service according to this embodiment, the payment server 100 acquires an image. The payment server 100 inputs a prompt to the model 300 that includes the image, predetermined review criteria, and a request to output the image review results based on the review criteria. The payment server 100 acquires the review results output by the model 300. As a result, the image review based on the predetermined review criteria is performed by the model 300, making it easier to expedite the review and ensure the quality of the review. Therefore, user satisfaction with the image review can be increased.
[0050] Model 300 is trained to output image review results based on review criteria in response to requests.
[0051] Furthermore, in this embodiment, the images acquired by the payment server 100 are images provided to be displayed in the electronic payment service as images showing information related to the merchants of the electronic payment service. Specifically, these are the images displayed on the merchant information screen IF11 described above, and / or attached to the coupons described above (i.e., merchant image IM1 and / or coupon image IM2). The review criteria are the criteria specified by the electronic payment service. This allows the operator of the electronic payment service to manage the content and quality of images displayed by the electronic payment service through the specification of review criteria. It also increases user satisfaction when viewing images displayed in the electronic payment service.
[0052] The following describes an example in which a merchant operates the second store terminal device 70 (merchant interface 72), providing an image from the second store terminal device 70 to the payment server 100, and the image is then reviewed. However, the device that provides the image to be reviewed to the payment server 100 is not limited to the second store terminal device 70, but may be other devices (for example, devices used by personnel who conduct sales to merchants of the electronic payment service, or devices used by the operator of the electronic payment service). In this case, such other devices correspond to "external devices," and "second store terminal device 70" and "merchant interface 72" in the following explanation should be read as such other devices.
[0053] [Details of the image review service] Figure 12 is a sequence diagram showing an example of image review processing performed by the second store terminal device 70, the payment server 100, and the model 300. The following will specifically describe the functional configurations and processes related to image review, following this sequence diagram. While the following description uses the example of a merchant image IM1 (more specifically, logo image IM1-1 and cover image IM1-2) as the image to be reviewed, similar processing may be performed for other images (e.g., coupon image IM2).
[0054] (Step S21) First, the display control unit 210 of the payment server 100 causes the second store terminal device 70, which provides the image to be reviewed to the payment server 100, to display a reception screen for accepting the image. For example, the display control unit 210 causes the reception screen to be displayed on the merchant interface 72 in response to a predetermined operation on the merchant interface 72.
[0055] (Step S22) Next, the operator of the second store terminal device 70 (merchant, etc.) provides the image to be reviewed to the payment server 100 from the reception screen. This provision is done, for example, by the operator of the second store terminal device 70 performing a predetermined operation on the reception screen (for example, selecting an image file or dragging and dropping an image file onto the reception screen). The acquisition unit 220 of the payment server 100 acquires the image provided from the reception screen.
[0056] Figure 13 shows an example of an interface screen provided to the merchant interface 72 when an image is provided. First, the display control unit 210 displays the previous screen IF21 on the merchant interface 72 in response to a predetermined operation on the merchant interface 72. The previous screen IF21 may include, for example, a display for the operator of the merchant interface 72 to confirm the screening criteria. In the illustrated example, such a display includes a link LK that displays the screening criteria in response to the operator's operation, but the screening criteria may also be directly displayed on the previous screen IF21. The previous screen IF21 also includes a button BT1 for proceeding to the reception screen IF22 in response to the operator's operation. Note that the display for confirming the screening criteria may also be included in the reception screen IF22.
[0057] When button BT1 is operated, the display control unit 210 displays the reception screen IF22 on the merchant interface 72. The reception screen IF22 includes a reception area AR2-1 for the operator to input (provide) an image. For example, the operator may provide an image by dragging and dropping an image file into the reception area AR2-1, or by selecting an image file on the interface that appears after selecting the reception area AR2-1. In the illustrated example, the reception screen IF22 accepts the provision of images (logo image IM1-1, cover image IM1-2) related to multiple (two in the illustrated example) categories, and one reception area AR2-1 is provided for each of these categories. However, the number of reception areas AR2-1 included in the reception screen IF22 (i.e., the number of image categories accepted by one reception screen IF22) can be changed as appropriate, and may be 1 or 3 or more. For example, the reception screen IF22 may include a reception area AR2-1 that accepts the provision of interior and exterior images of the merchant, etc.
[0058] Although detailed illustrations are omitted, the reception area AR2-1 may provide an interface for the operator to edit the image to a shape appropriate to its category after inputting the image (e.g., enlarge, reduce, and / or crop). After the image is input, the input image may be displayed in the reception area AR2-1. Furthermore, the reception area AR2-1 may be configured to allow image replacement and editing even after the image has been input or after the review process described later has been performed.
[0059] The reception screen IF22 includes at least one review button BT2-1 for initiating the review of images entered (provided) by the operator. In the illustrated example, one review button BT2-1 is provided for each of the multiple reception areas AR2-1. When each review button BT2-1 is operated, the provision and review of images entered in that category to the settlement server 100 are performed independently. In other words, depending on the operation of each review button BT2-1, the processes from steps S22 to S26 shown in Figure 12 are performed independently for each category. The information processing system may be configured to start the review of images in other categories (start the process of step S22) when the review of images in a certain category is not yet complete (the process of step S26 is not yet complete). For images in multiple categories, the processes of steps S22 to S26 may be performed in parallel, at least partially. Alternatively, one review button BT2-1 may be provided for multiple reception areas AR2-1, and the provision and review of images in multiple categories may be performed depending on the operation of that single review button BT2-1.
[0060] The acquisition unit 220 acquires the provided image as described above. If the reception area AR2-1 is configured to allow image editing (as described above), the acquisition unit 220 acquires the edited image.
[0061] (Step S23) Returning to Figure 12, the processing unit 230 of the payment server 100 generates a prompt based on the image acquired by the acquisition unit 220 and the review criteria specified in advance by the operator of the electronic payment service. The prompt includes the image, the review criteria, and a request. The review criteria may be stored in the storage unit 270 in advance, for example. The request includes at least a request to output the review result of the image based on the review criteria. The request may also include a request to output the basis for the review result in addition to the review result. In the following description, it will be assumed that the prompt includes a request to output the basis for the review result in addition to the review result.
[0062] Figure 14 shows an example of a prompt PP. Note that in this example, the image is omitted to show the prompt PP. The prompt PP in this example includes three parts: PP1, PP2, and PP3.
[0063] Part PP1 corresponds to the main instructions and addresses the requests mentioned above. Part PP1 may include information such as, for example, "You are a corporate image reviewer. Review the provided images according to the following strict rules and always provide accurate responses. Your responses must include the 'review result' and 'basis for review'."
[0064] Partial PP2 addresses constraints on Model 300's output in response to requests. Partial PP2 may include information such as, "The 'Review Result' must be set to one of the following: 'OK', 'NG', 'Requires Masking', or 'Cannot Determine'," and "The 'Basis' should clearly and specifically describe the basis for the judgment to the user." By including information like the former as a constraint, Model 300 will not output answers freely, but will instead select an answer from a set of answers prepared in advance by the administrator ("OK", "NG", "Requires Masking", "Cannot Determine"). This reduces the risk of hallucination.
[0065] Part PP3 corresponds to the information that Model 300 assumes when producing output in response to a request, and corresponds to the review criteria described above. Part PP3 may include, for example, the following information: ### Part 1: NG (Rejection) Criteria If any of the rejection criteria are met, the "review result" will be "NG". 1. **AI-generated image**: When an image clearly exhibits unnaturalness characteristic of AI generation (e.g., distortion of a person's fingers or limbs, text that looks like letters but isn't, unrealistic gloss or texture, asymmetrical eyes), and it can be strongly concluded that the image was generated by AI. 2. **Copyrighted Material / Famous Characters**: This refers to the unauthorized use of characters widely known from anime, manga, games, movies, etc., or the likeness of real-life famous people. Fan art, unauthorized character merchandise, book / magazine covers, and television screen recordings are prohibited. However, the following are exempt from this rule: - If the product has a high degree of direct relevance to the business, such as character goods sold by a toy store, it will be approved for review. 3. **Tobacco**: Tobacco is the main focus of the image. 4. **Exaggerated Advertising**: Superlative expressions such as "largest" and "No. 1" are used without justification. 5. **Exterior view of a commercial facility**: Exterior photos of a specific large commercial facility or the entire building of a train station are not acceptable. 6. **Outside of business hours**: We will not accept applications if the premises are clearly under construction or interior work. However, applications will be accepted if there is a "CLOSED" or "Preparing" sign, or if the door is closed. 7. **Image Condition**: -Screenshots of PC or smartphone screens, or screenshots of map apps. - Content that is clearly reprinted from another site (e.g., source attribution or (c) mark indicating another company's name). - The image is extremely small and blurry, making it impossible to recognize the content. -The image contains what appears to be graffiti. 8. **People appearing in the image**: - Excessive skin exposure or sexual expression (except in cases where there is a legitimate reason such as a procedure or swimwear). -The people shown in the background posters and on the television are copyrighted characters or celebrities. - When the image of a person, including the photographer, is clearly reflected on a reflective surface such as a logo plate or glass. - Wearing a mask is also not allowed. 9. **Image type mismatch**: -Regarding logo images, general product images or anything that is not the store's logo are "not acceptable." However, original store characters and stylized lettering (logotypes) are acceptable. ### Part 2: Masking Criteria Required If the image does not meet the rejection criteria, the following criteria will be checked. If any of these criteria are met, the "review result" will be "masking required." However, images that are already masked will be approved. 1. **Personal Information**: Photos include wooden tags on gift flowers or balloons, documents, invoices, and personal names. -However, phone numbers displayed on the sign will be approved. 2. **Faces of individuals**: The face of an individual who is not affiliated with the store can be identified, such as a passerby, customer, or reflected in a poster, mirror, or sign. Alternatively, the face must be clearly visible enough to identify the individual. However, images showing only the back, head, or body are acceptable. 3. **QR code for payment**: This applies when the QR code for payment is clearly visible and readable. For example, this includes cases where the text "Pay here" is included, or where the payment service logo is adjacent to the QR code. -However, images showing only a payment service logo sticker without a scannable QR code, images where the QR code is not the main focus, and QR codes intended for social media / websites will be approved. 4. **License Plate**: The vehicle's license plate must be visible in the image, allowing for identification of the number. However, images of the vehicle without a visible license plate are acceptable for review. ### Part 3: OK Criteria If none of the "NG" or "masking required" criteria apply, the "review result" will be "OK." ### Part 4: Criteria for Inconclusive Determination If an image does not clearly meet any of the above criteria, and you are unsure how to judge it, or if the image is ambiguous and difficult to evaluate, please set the "Judging Result" to "Undecidable." In particular, if an image **may have been generated by AI, but this cannot be confirmed**, please classify it in this category and describe the reason, such as "It is suspected to have been generated by AI, but this cannot be confirmed."
[0066] Here, the "NG criterion" in the prompt PP corresponds to the "first criterion," and the "masking required criterion" corresponds to the "second criterion." More specifically, failing to meet the NG criterion in the prompt PP corresponds to meeting the first criterion, and failing to meet the masking required criterion in the prompt PP corresponds to meeting the second criterion. The masking required criterion (second criterion) is a different criterion from the NG criterion (first criterion), and it relates to the existence of a problem in a part of the image. The "OK criterion" may also be called the "third criterion," and the "cannot be determined criterion" may also be called the "fourth criterion." Furthermore, "NG" as a review result corresponds to the "first result," "masking required" corresponds to the "second result," and "OK" corresponds to the "third result." OK (third result) indicates that the image meets both the first and second criteria (the image does not meet either the NG criterion or the masking required criterion). The review result "cannot be determined" may also be called the "fourth result." As will be described later, if the review result is "masking required," the operator of the second store terminal device 70 is given the opportunity to mask the problematic portion of the image and re-examine it. The first criterion (NG criterion) can also be defined as the criterion for problems that cannot be resolved by such masking of a portion of the image.
[0067] The above-mentioned prompt PP is just an example, and the content of the prompt PP can be changed as needed. For example, the prompt PP (e.g., part PP1 and / or part PP2) may include information specifying the data format of the output of model 300.
[0068] (Step S24) Returning to Figure 12, the processing unit 230 inputs the generated prompt to the model 300.
[0069] (Step S25) Next, the processing unit 230 obtains the output of the model 300. The output includes the image review result and the basis for that review result.
[0070] (Step S26) Next, the display control unit 210 displays information corresponding to the output of Model 300 on the second store terminal device 70. The information displayed on the second store terminal device 70 includes at least the image review results from Model 300. This display is performed on the reception screen shown on the second store terminal device 70. As a result, the operator of the second store terminal device 70 (the user of the image review) can find out the review results on the reception screen where they provided the image, improving the operator's satisfaction.
[0071] Furthermore, the display control unit 210 also displays the basis for the review result output by Model 300 on the reception screen along with the review result. This allows the operator of the second store terminal device 70 (the user of the image review) to know the basis for the review result by Model 300, thereby improving operator satisfaction. In addition, if the review result is anything other than "OK", the operator can edit or change the image and then restart the review. In other words, the operator can restart the process from steps S22 to S26 in Figure 12. Moreover, since the display of the review result and its basis, and the acceptance of the review image are performed on the same screen (reception screen), the operator can easily perform such a re-review.
[0072] Furthermore, depending on the review results, the reception screen may display additional information in addition to the review results and their rationale. This will be explained in detail below with reference to Figure 15. Figure 15 is a flowchart showing an example of the process performed in step S26 of the sequence diagram in Figure 12.
[0073] First, the display control unit 210 determines whether the inspection result output by the model 300 is "OK" or not (step S200). If the inspection result is "OK" (step S200; YES), the display control unit 210 displays the inspection result and the basis on the reception screen as described above (step S202). After that, the process in step S26 is completed.
[0074] If the review result is not "OK" (step S200; NO), the display control unit 210 determines whether the review result is "masking required" (step S204). If the review result is "masking required" (step S204; YES), the display control unit 210 further displays on the reception screen an interface for masking the problematic areas of the image (masking interface) in addition to the review result and justification (step S206). As a result, the operator of the second store terminal device 70, who learns through the reception screen that the review result is "masking required," can mask the image by operating the above interface from the same reception screen and restart the review. This allows for a smooth flow from the display of the review result "masking required" to the masking of the image and the start of the re-review, thereby increasing user satisfaction.
[0075] In step S206, the application reception unit 240 of the payment server 100 further displays a reason input display on the reception screen via the display control unit 210, where the user can input the reason why they believe the image meets the review criteria. If Model 300 outputs a negative review result ("Masking Required", "NG", etc.), the user of the image review may have doubts about the review result. Also, errors may occur in the image review by Model 300. In such cases, the user of the image review (the operator of the second store terminal device 70) inputs the reason why they believe the image meets the review criteria in the reason input display. After the processing of step S206, the processing of step S26 is completed.
[0076] If the review result is not "masking required" (i.e., the review result is "NG" or "cannot be determined") (step S204; NO), the application reception unit 240 displays the review result and its basis, along with the reason input display described above, on the reception screen via the display control unit 210 (step S208). Thus, in this embodiment, the reason input display is displayed on the reception screen at least when the processing unit 230 obtains a review result indicating that the image does not meet the review criteria ("masking required", "NG"). After the processing in step S208, the processing in step S26 is completed.
[0077] Figure 16 shows an example of the interface screen provided to the merchant interface 72 from the time of image provision to the display of the review results. Figure 16 shows an example where the processing unit 230 obtains a review result of "masking required" for the cover image IM1-2. In this embodiment, the review results and justifications are displayed on the same screen as the reception screen IF22, which is provided with a display for providing images to the payment server 100 (reception area AR2-1 and review button BT2-1). Specifically, below the review button BT2-1, there is a review result display area AR2-2 that displays the review results and a justification display area AR2-3 that displays the justifications for the review results. Furthermore, if the review result is "masking required," a masking button BT2-2 and an input field FM are also displayed on the reception screen IF22. The masking button BT2-2 corresponds to the "interface for applying masking," and the input field FM corresponds to the "reason input display." When the processing unit 230 receives output from the model 300, the display control unit 210 updates the reception screen IF22 to include the examination result display area AR2-2, the justification display area AR2-3, the masking button BT2-2 and / or the input field FM, according to the content of the output.
[0078] Figure 17 shows an example of an interface screen provided to the merchant interface 72 when the masking button BT2-2 is operated. When the masking button BT2-2 is operated, the display control unit 210 displays the masking screen IF23 on the merchant interface 72. The masking screen IF23 may be displayed, for example, as a pop-up on the reception screen IF22, or it may be displayed as a separate screen from the reception screen IF22. The operator of the second store terminal device 70 selects the area to be masked from the cover image IM1-2 by operating (enlarging, shrinking, and / or moving) the range selection frame SL displayed on the masking screen IF23 so as to overlap with the cover image IM1-2. The reception screen IF22 (basis display area AR2-3) displays the basis for the "masking required" result (e.g., a customer's face is visible), so the operator can consider the area to be masked based on the displayed basis.
[0079] After selecting the masking area, the operator operates button BT3. This masks the area of the cover image IM1-2 selected by the range selection frame SL. When the operator operates the review button BT2-1 again on the reception screen IF22, the masked image is provided to the payment server 100 as the subject of review. Masking may also be performed by the second store terminal device 70. Masking may involve applying a mosaic effect to the selected area, or filling the selected area with a predetermined color, etc. Masking of the image may also be performed by the payment server 100 after the image is provided to the payment server 100 and before the prompt is generated. In this case, the second store terminal device 70 may provide the payment server 100 with information indicating the masking area selected by the range selection frame SL along with the image.
[0080] [Request to display image] In the image review service according to this embodiment, an application acceptance display for accepting applications for displaying images in the electronic payment service is provided to the second store terminal device 70 according to the image review results, etc. This will be explained in detail below with reference to Figure 18. Figure 18 is a flowchart showing an example of the processing flow related to an application for displaying an image.
[0081] First, the application reception unit 240 of the payment server 100 determines whether the review result is "OK" for all categories for which image submissions are accepted via the reception screen (step S300). If all review results are "OK" (i.e., the processing unit 230 obtains a review result indicating that the image meets the review criteria) (step S300; YES), the application reception unit 240 provides an application acceptance display to the second store terminal device 70 that provided the image (step S302). Specifically, the application reception unit 240, through the display control unit 210, causes the application acceptance display to be shown on the reception screen displayed in the merchant interface 72.
[0082] When an operation is performed on the application acceptance display, the application acceptance unit 240 acquires application information 272 (see also Figure 20) which includes at least merchant identification information (e.g., merchant ID and / or store ID) and the image for which the review result was "OK" (step S304). This allows the payment server 100 to accept a display application for the image for which the review result was "OK" in the electronic payment service. Furthermore, since such an application acceptance display is shown on the reception screen for performing image review and viewing the results, users of the image review can smoothly perform everything from performing the image review to viewing the results and applying for image display. This improves user satisfaction.
[0083] If the review results are not all "OK" (if the processing unit 230 obtains a review result indicating that the image does not meet the review criteria) (Step S300; NO), the application reception unit 240 determines whether input has been made to the reason input display (described above) for all images whose review results are other than "OK" (Step S306). If input has been made to the reason input display (Step S306; YES), the application reception unit 240 enables operation of the application reception display on the second store terminal device 70 (Step S308). Specifically, the application reception unit 240 displays the application reception display on the reception screen displayed on the merchant interface 72 via the display control unit 210.
[0084] When an operation is performed on the application acceptance display, the application acceptance unit 240 acquires application information 272, which further includes input to the reason input display in addition to the merchant identification information and image (step S310). In other words, in this embodiment, even if the examination results are not all "OK", if a reason is entered for such an image that is considered to meet the examination criteria, the application acceptance display on the second store terminal device 70 is made operational and the image display application is accepted. This allows the application to proceed smoothly even if the user has doubts about the examination results by Model 300 or if there are errors in the examination results by Model 300. This improves user satisfaction. Furthermore, in such cases, by including the input to the reason input display in the application information 272 and acquiring it from the payment server 100, personnel such as the operator of the electronic payment service can perform an image examination by comparing the input (the reason that the image is considered to meet the examination criteria) with the image.
[0085] If one or more images have a review result other than "OK" and no reason has been entered in the reason input display (step S306; NO), the application reception unit 240 returns to the process in step S300. In other words, the application reception unit 240 waits until either the first condition, where the review result is "OK" for all images, or the second condition, where a reason has been entered in the reason input display for all images that do not have a review result of "OK," is met. During this time, the operator of the second store terminal device 70 performs one or more necessary operations on the reception screen, such as replacing or editing images, masking, re-examining, or entering a reason in the reason input display, so that the first or second condition is met. The operator can determine the necessary operation by referring to the information displayed on the reception screen (review results, justification, etc.). Once the first or second condition is met by the operator's operations, the application reception display becomes selectable on the reception screen, and the application to display images can proceed.
[0086] In the example shown in Figure 18, a reception screen without an application acceptance display was initially displayed on the merchant interface 72, and a (operable) application acceptance display was newly displayed on the reception screen by the processing in step S302 or step S308. However, this is not limited to this. For example, an inoperable application acceptance display may be initially displayed on the reception screen, and the application acceptance display may be switched to an operable state by the processing in step S302 or step S308. In this case, the display manner (color, size, etc.) of the application acceptance display may be switched between the inoperable state and the operable state.
[0087] Figure 19 shows an example of the interface screen provided to the merchant interface 72 when an image display application is submitted. In the example in Figure 19, the logo image IM1-1 is deemed "OK" and the cover image IM1-2 is deemed "masking required". Here, the input field FM, which is used to display the reason, contains the input, "The person whose face is visible is a store employee." Therefore, since the second condition described above is met, button BT2-3 is displayed on the reception screen IF22 as an operable application acceptance display.
[0088] When button BT2-3 is operated, the application reception unit 240, via the display control unit 210, displays an input screen for entering merchant identification information on the merchant interface 72. When a predetermined operation, including the input of the above information, is performed on the input screen, the application reception unit 240 acquires application information 272 based on the input content on the input screen and the input content on the reception screen IF22. This completes the image display application. If the payment server 100 holds correspondence information that associates the identification information of the second store terminal device 70 with the merchant identification information, the application reception unit 240 may acquire the merchant identification information based on the correspondence information and the identification information of the second store terminal device 70. In this case, the application reception unit 240 may omit the display of the input screen as described above and acquire the application information 272 by operating button BT2-3. The application reception unit 240 stores the acquired application information 272 in the storage unit 270. As a result, the memory unit 270 stores application information 272 each time an image display request is made.
[0089] Figure 20 shows an example of the contents of application information 272. Application information 272 is, for example, a collection of information that associates the following with the merchant identification information (merchant ID and store ID in the example shown): the image category, the image provided from the application screen, the review result by model 300, and the content entered in the reason input display.
[0090] [Application information reflected] Returning to Figure 11, the reflection unit 250 of the payment server 100 reflects the application information 272 in the display image information 180 at a predetermined timing (for example, a predetermined period determined by the operator of the electronic payment service, etc.) (see also Figures 4 and 10).
[0091] Specifically, the reflection unit 250 reflects images that have been reviewed by Model 300 as "OK" (logo image IM1-1 in the illustrated example) into the display image information 180. For example, the reflection unit 250 extracts the merchant identification information and image category associated with the image in the application information 272, and identifies the portion of the display image information 180 that corresponds to the extracted merchant identification information and category. The reflection unit 250 then stores the image in the identified portion of the display image information 180. This completes the reflection of the image into the display image information 180 and the reflection of the image into the display in the electronic payment service based on the display image information 180 (for example, the merchant information screen IF11 or the coupon display CP; see also Figure 9).
[0092] On the other hand, the reflection unit 250 suspends the reflection process described above for images whose review result by Model 300 is anything other than "OK" (in the illustrated example, cover image IM1-2; hereinafter referred to as "separate review image"). The reflection unit 250 then performs the reflection process to the display image information 180 of the separate review image according to the results of the review conducted by personnel of the electronic payment service operator, etc. (hereinafter referred to as "review personnel") (hereinafter referred to as "separate review").
[0093] For example, the reviewing personnel perform a separate review by referring to the separate review target image included in the application information 272 and the content entered in the corresponding reason input display. For example, at least the information related to the separate review target image in the application information 272 may be displayed on the display unit of the device used by the reviewing personnel (hereinafter referred to as the separate review device), and the reviewing personnel may perform the separate review while visually checking the display. The separate review device may be the settlement server 100, or it may be a different device from the settlement server 100 that is connected to the settlement server 100 via a network NW.
[0094] If, as a result of the separate review, the reviewing personnel determine that the image subject to separate review meets the review criteria, the reviewing personnel input information to the payment server 100 indicating that the image subject to separate review meets the review criteria by operating the separate reviewing device. The reflection unit 250 then performs the reflection process to the display image information 180 for the image subject to separate review for which this information has been input. On the other hand, if, as a result of the separate review, the reviewing personnel determine that the image subject to separate review still does not meet the review criteria, the reviewing personnel do not input the information as described above. In this case, the reflection unit 250 does not perform the reflection process to the display image information 180 for the image subject to separate review for which this information has been input. Alternatively, the reviewing personnel input information to indicate that the image subject to separate review does not meet the review criteria by operating the separate reviewing device. The reflection unit 250 then does not perform the reflection process to the display image information 180 for the image subject to separate review for which this information has been input. In this case, the payment server 100 and / or the separate reviewing device may send a notification to the second store terminal device 70 that provided the image indicating that the image subject to separate review does not meet the review criteria.
[0095] According to the above configuration, only images that Model 300 determines do not meet the review criteria, and for which a reason has been entered in the reason input display (i.e., the user of the image review believes the image meets the review criteria), will be subject to separate review by the review personnel. This reduces the burden on the review personnel. Furthermore, this streamlines and rationalizes the review process and increases user satisfaction with the image review.
[0096] [Differentiation] In the examples described above, the review results and their rationale were displayed on the reception screen, but this is not limited to that. The review results and their rationale may be provided to the second store terminal device 70 by means other than displaying them on the reception screen (for example, by sending an email or push notification). Similarly, the application acceptance display and reason input display may be provided by means other than displaying them on the reception screen (for example, by sending an email).
[0097] Furthermore, while the image review service was based on the premise that images provided for display in electronic payment services were reviewed by the operator of the electronic payment service based on specified review criteria, it is not limited to this. The image review service described above can be applied to any combination of images and review criteria.
[0098] [Summary] According to the embodiment described above, the payment server 100 (an example of an information processing device) includes an acquisition unit 220 that acquires an image, and a processing unit 230 that inputs a prompt to the model 300 including the image, predetermined review criteria, and a request to output the image review result based on the review criteria, and acquires the review result output by the model 300. This makes it possible to provide an information processing device, an information processing method, and a program that can increase user satisfaction with image review.
[0099] Although embodiments for carrying out the present invention have been described above using examples, the present invention is not limited in any way to these embodiments, and various modifications and substitutions can be made without departing from the spirit of the invention. Furthermore, the above embodiments may be combined as appropriate. [Explanation of Symbols]
[0100] 70...Second store terminal device 100... Payment Server 210...Display Control Unit 220…Acquisition Department 230... Processing Unit 240…Application Reception Department 272…Application information IM1…Image of member stores, etc. IM2... Coupon image
Claims
1. An acquisition unit that acquires an image provided to be displayed in the electronic payment service as an image showing information relating to a merchant, etc. that is a merchant and / or store of an electronic payment service, The model is input a prompt that includes the aforementioned image, predetermined review criteria specified by the operator of the electronic payment service, and a request to output the review results of the aforementioned image based on the review criteria. A processing unit that acquires the evaluation result output by the aforementioned model, When the processing unit obtains the review result indicating that the image meets the review criteria, it provides the external device that provided the image with an application acceptance display for accepting an application to display the image in the electronic payment service. The system includes an application reception unit that, when an operation is performed on the application reception display, acquires application information including information that can identify the affiliated store, etc., and the image, Information processing device.
2. The aforementioned image is, The information of the merchant, etc., is displayed on the screen that provides the information of the electronic payment service to the user of the electronic payment service, and / or An image attached to a coupon that can be used for payment at the aforementioned merchants in the aforementioned electronic payment service. The information processing apparatus according to claim 1.
3. The aforementioned evaluation criteria are: Criterion 1, A second criterion, which is different from the first criterion mentioned above, and which concerns the existence of a problem in a part of the image, The aforementioned review results are as follows: The first result shows that the aforementioned image does not meet the first criterion, A second result showing that the aforementioned image does not meet the second criterion, A third result showing that the image satisfies the first and second criteria, The information processing apparatus according to claim 1 or 2.
4. The external device that provides the aforementioned image to the information processing device further includes a display control unit that displays a reception screen for receiving the aforementioned image, The acquisition unit acquires the image provided from the reception screen, The display control unit, when the processing unit obtains the examination result, displays the examination result on the reception screen. The information processing apparatus according to claim 1 or 2.
5. The aforementioned processing unit, The request to further output the basis for the aforementioned review results is input to the model, Further obtaining the basis output by the aforementioned model, The display control unit displays the basis for the examination result on the reception screen. The information processing apparatus according to claim 4.
6. A display control unit that causes an external device to display a reception screen for receiving images, An acquisition unit that acquires the image provided from the reception screen, The model is input a prompt that includes the aforementioned image, predetermined review criteria, and a request to output the review results of the image based on the review criteria. The system includes a processing unit that acquires the evaluation result output by the aforementioned model, When the processing unit obtains the examination result, the display control unit will display the examination result on the reception screen. When the processing unit obtains the examination result indicating that a problem exists in a part of the image, the display control unit displays an interface on the reception screen for masking the problematic part of the image. Information processing device.
7. If the processing unit obtains the examination result indicating that the image does not meet the examination criteria, the application receiving unit The external device is provided with a reason input display for inputting the reason why the image is considered to meet the review criteria. When input is made to the reason input display, the system enables operation on the application acceptance display, and when operation is made on the application acceptance display, the system acquires the application information, which further includes the input to the reason input display. The information processing apparatus according to claim 1 or 2.
8. Computers Images provided to be displayed in the electronic payment service are acquired as images showing information relating to merchants and / or stores that are affiliated with the electronic payment service. The model is input a prompt that includes the aforementioned image, predetermined review criteria specified by the operator of the electronic payment service, and a request to output the review results of the aforementioned image based on the review criteria. The evaluation result output by the aforementioned model is obtained, When the examination result is obtained indicating that the image meets the examination criteria, the external device that provided the image is provided with an application acceptance display for accepting an application to display the image in the electronic payment service. When an operation is performed on the aforementioned application acceptance display, application information including information that can identify the aforementioned member store, etc., and the aforementioned image is obtained. Information processing methods.
9. On the computer, The system retrieves images provided to be displayed in the electronic payment service as images showing information related to merchants and / or stores that are affiliated with the electronic payment service. The model is given a prompt that includes the aforementioned image, predetermined review criteria specified by the operator of the electronic payment service, and a request to output the review results of the aforementioned image based on the review criteria. The model outputs the aforementioned evaluation result, When the examination result is obtained indicating that the image meets the examination criteria, the external device that provided the image is instructed to provide an application acceptance display for accepting applications for displaying the image in the electronic payment service. When an operation is performed on the aforementioned application acceptance display, the system will obtain application information including information that can identify the aforementioned member store, etc., and the aforementioned image. program.
10. A computer, The external device displays a reception screen for accepting image submissions. The image provided from the reception screen is obtained, The model is input a prompt that includes the aforementioned image, predetermined review criteria, and a request to output the review results of the image based on the review criteria. The evaluation result output by the aforementioned model is obtained, When the aforementioned review result is obtained, the review result is displayed on the reception screen. If the review result indicates that a problem exists in a part of the aforementioned image, the reception screen will display an interface for masking the problematic part of the image. Information processing methods.
11. A computer, The external device displays a reception screen for accepting image submissions. The image provided from the reception screen is retrieved, The model is given a prompt that includes the aforementioned image, predetermined review criteria, and a request to output the review results of the image based on the review criteria. The model outputs the aforementioned evaluation result, When the aforementioned review result is obtained, the review result is displayed on the reception screen. If the review result indicates that a problem exists in a part of the aforementioned image, the reception screen will display an interface for masking the problematic part of the image. program.
12. An acquisition unit that acquires an image provided by an external device, The model is input a prompt that includes the aforementioned image, predetermined review criteria, and a request to output the review results of the image based on the review criteria. A processing unit that acquires the evaluation result output by the aforementioned model, When the processing unit obtains the examination result, it includes a display control unit that causes the external device to display the examination result, When the processing unit obtains the examination result indicating that a problem exists in a part of the image, the display control unit causes the external device to display an interface for masking the problematic part of the image. Information processing device.
13. A computer, Acquire images provided by an external device, The model is input a prompt that includes the aforementioned image, predetermined review criteria, and a request to output the review results of the image based on the review criteria. The evaluation result output by the aforementioned model is obtained, When the aforementioned examination results are obtained, the external device is made to display the examination results. If the review result indicates that a problem exists in some part of the aforementioned image, the external device is instructed to display an interface for masking the problematic part of the image. Information processing methods.
14. A computer, Acquire images provided by an external device. The model is given a prompt that includes the aforementioned image, predetermined review criteria, and a request to output the review results of the image based on the review criteria. The model outputs the aforementioned evaluation result, When the aforementioned examination results are obtained, the external device is made to display the examination results. If the review result indicates that a problem exists in some part of the aforementioned image, the external device is instructed to display an interface for masking the problematic part of the image. program.
Citation Information
Patent Citations
Examination system, examination method, and examination program
JP2017050022A
Information processing device, information processing method, and information processing program
JP2020154685A
Advertisement reviewing system, advertisement reviewing method, and advertisement reviewing program
JP2023124762A
Image processing system
JP2024025156A
Information processing apparatus, information processing method, and program
JP2024041298A