System, program, payment server, terminal device control method, payment server control method, and printed matter

Abstract

This can increase the interest of users who use the user device or store staff who use the store terminal. [Solution] A system including a payment server that provides payment services and a terminal device that is communicatively connected to the payment server and executes an application used to provide the payment services, wherein the payment server has a code generation unit that generates a one-time code in response to a request from the application, and the terminal device has an acquisition unit that acquires a setting image that is set in accordance with an operation on the terminal device, an image generation unit that generates a decorative code image that is a two-dimensional code image that encodes the one-time code generated by the code generation unit in response to the request, and includes a two-dimensional code image in which the pixel values ​​of at least a portion of the two-dimensional code image have been changed based on the setting image, and a display control unit that controls the display of the decorative code image on the application.

Description

[Technical Field]

[0001] The present disclosure relates to a system, a program, a payment server, a control method for a terminal device, a control method for a payment server, and a printed matter. [Background technology]

[0002] In recent years, techniques for decorating images have become known from the viewpoint of interest. Patent Document 1 discloses a method for decorating the periphery of a one-dimensional code image by displaying an image with a design selected by a user around the one-dimensional code image. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2020-170442 A Summary of the Invention [Problem to be solved by the invention]

[0004] There is a need for a method that can increase the interest of users who use user devices or store staff who use store terminals. [Means for solving the problem]

[0005] A system according to one aspect of the present disclosure is a system including a payment server that provides payment services and a terminal device that is communicatively connected to the payment server and executes an application used to provide the payment service, wherein the payment server has a code generation unit that generates a one-time code in response to a request from the application, and the terminal device has an acquisition unit that acquires a setting image set in accordance with an operation on the terminal device, an image generation unit that generates a decorative code image that is a two-dimensional code image that encodes the one-time code generated by the code generation unit in response to the request, the image including a two-dimensional code image in which the pixel values ​​of at least a portion of the two-dimensional code image have been changed based on the setting image, and a display control unit that controls the display of the decorative code image on the application. [Effects of the Invention]

[0006] According to the present disclosure, it is possible to increase the interest of users who use user devices or store staff who use store terminals. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 2 is a diagram illustrating an example of a system configuration and processing details of each device. [Figure 2] FIG. 10 is a diagram illustrating an example of a home screen displayed on a payment application. [Figure 3] FIG. 10 is a diagram showing an example of a display screen that is displayed on the payment application and that displays a code image. [Figure 4] FIG. 10 is a diagram illustrating an example of a screen displayed on a payment application. [Figure 5] 10A and 10B are diagrams illustrating an example of a decoration code image and a user-defined image. [Figure 6] 10A and 10B are diagrams illustrating an example of a decoration code image and a user-defined image. [Figure 7] FIG. 1 illustrates an example of a system configuration. [Figure 8]FIG. 2 is a block diagram illustrating an example of a hardware configuration of an information processing device. [Figure 9] FIG. 2 is a diagram illustrating an example of a software configuration of a user terminal. [Figure 10] FIG. 2 is a diagram illustrating an example of a functional configuration of a payment server. [Figure 11] 10A and 10B are diagrams illustrating an example of information stored in a user DB and a store DB, respectively. [Figure 12] FIG. 10 is a sequence diagram showing an example of the flow of information processing among a user terminal, a payment server, and a store terminal. [Figure 13] 10 is a flowchart illustrating an example of processing by a user terminal. [Figure 14] FIG. 2 is a diagram illustrating an example of a system configuration and processing details of each device. [Figure 15] FIG. 10 is a diagram illustrating an example of a home screen of a management screen. [Figure 16] FIG. 10 is a diagram illustrating an example of a setting item display screen. [Figure 17] FIG. 10 is a diagram showing an example of a two-dimensional code image setting screen. [Figure 18] FIG. 10 is a diagram showing an example of a display screen of a two-dimensional code image. [Figure 19] FIG. 2 is a diagram illustrating an example of a software configuration of a store terminal. [Figure 20] FIG. 2 is a diagram illustrating an example of a functional configuration of a payment server. [Figure 21] FIG. 10 is a sequence diagram showing an example of the flow of information processing among a user terminal, a payment server, and a store terminal. [Figure 22] 10 is a flowchart illustrating an example of processing of a store terminal. [Figure 23] 10 is a flowchart illustrating an example of processing by a payment server. DETAILED DESCRIPTION OF THE INVENTION

[0008] Preferred embodiments of the system, program, payment server, terminal device control method, payment server control method, and printed matter according to the present disclosure will be described in detail below with reference to the drawings. Note that the system, program, payment server, terminal device control method, payment server control method, and printed matter according to the present disclosure are not limited to the following embodiments. Furthermore, the same components in the following embodiments will be assigned the same reference numerals, and duplicated descriptions will be omitted.

[0009] In recent years, payment using a terminal device used by a user has become widespread due to its high convenience. For example, payment can be made by scanning a code image displayed on the terminal device with a store terminal, or by scanning a code image placed in a store with a user terminal. Types of code images used for payment include one-dimensional code images and two-dimensional code images. In addition, from the viewpoint of entertainment value, techniques for decorating such code images are known.

[0010] For example, a method is known in which an image of a design selected by a user is displayed around a one-dimensional code image to decorate the periphery of the one-dimensional code image. However, decorating the code image itself can be difficult from the standpoint of readability, making it difficult to meet the needs of users or store clerks who want to decorate the code image. For two-dimensional code images such as QR (Quick Response) Code (registered trademark), readability can be ensured even if defects due to distortion or damage occur in the code image, so decorating the code image is not expected to be difficult.

[0011] Incidentally, there is a known technology for generating images not by human hands but by image generation AI. For example, there is a trained AI model (e.g., a Diffusion Model) that can input text and output an image containing the elements indicated by the input text. Specifically, when the text "cat" and "girl" are input, the trained AI model can generate and output an image depicting a scene of a girl holding a cat. This system, which outputs an image with a user's desired design by inputting text into a trained AI model, is called stable diffusion.

[0012] Furthermore, such systems can output images with a user-desired design in response to input images, not just text. For example, ControlNet is a well-known method for acquiring such design images. ControlNet infers a desired image design using image structural features such as line shapes, depth, contours, and landmarks (e.g., skeletal structure) within an image as additional conditions. For example, ControlNet can be used to infer a new design image based on the subject of a photograph taken by a user, using the features of the photograph as additional conditions. Furthermore, research is also underway to use ControlNet to output a new design image based on the subject of a given image, even when using a two-dimensional code image in which an arbitrary character string is coded.

[0013] The present disclosure applies stable diffusion to a two-dimensional code image used for payment, and by decorating the code image, it is possible to meet the needs of users or store clerks who want to decorate two-dimensional code images for payment. This can increase the interest of users who use user devices or store clerks who use store terminals. In the embodiments described below, when there is no need to distinguish between one-dimensional code images and two-dimensional code images, they will be collectively referred to as code images.

[0014] <<First embodiment>> 1 is a diagram showing an example of the system configuration and the processing contents of each device in this embodiment. The system 100 has a user terminal 101, a payment server 102, and a shop terminal 103.

[0015] (About user devices) The user terminal 101 is a terminal device owned by a user who uses a payment service described below. An application for using the payment service (hereinafter referred to as a payment application) is installed in the user terminal 101. By executing the payment application, the user terminal 101 can provide a payment service to the user who uses the user terminal 101. In this disclosure, the user terminal 101 will be described as a smartphone, for example. Note that the user terminal 101 may also be a laptop computer, a tablet terminal, or an information processing device capable of executing a payment application.

[0016] A payment service is a service that performs payment processing to transfer electronic money equivalent to the payment amount from the account of the user making the payment to the account of the store. Note that payment services also include a remittance service that performs remittance processing to transfer electronic money from a first account held by a first user, who is the sender of the remittance, to a second account held by a second user, who is the recipient of the remittance.

[0017] The payment application has the function of displaying code images used during payment and providing services related to payment services. The payment application also has an image generation system that generates two-dimensional code images based on one-time codes and images, which will be described later. A code image is an image generated by encoding (one-dimensionally or two-dimensionally) information such as a character string. The image generation system is, for example, a trained AI model that has trained using a large amount of existing images as training data. Note that the payment application does not necessarily have to have an image generation system. In other words, the payment application may use an image generation system that is provided separately from the payment application in the user terminal 101.

[0018] When such a trained AI model receives input of an instruction (hereinafter referred to as a prompt), it can generate an image that includes the decorative element indicated by the prompt. For example, when the trained AI model receives the prompts "rain" and "dog" and a one-time code as input, it can output a two-dimensional code image that encodes the one-time code and incorporates a dog standing in the rain as a decorative element.

[0019] In addition, when the trained AI model receives a photograph of a landscape with multiple buildings and a one-time code as input, it can output an image in which a two-dimensional code image that encodes the one-time code is decorated with the photograph (for example, an image in which the two-dimensional code image is superimposed on the photograph).

[0020] (About the payment server) The payment server 102 generates one-time codes in response to requests from the user terminal 101, and performs payment processing in response to requests from the store terminal 103 (described later). A one-time code is a code with an expiration date set, and is generated by the payment server 102 in response to a request from a payment application. The generated one-time code is linked to a user ID registered in the payment server 102 and managed by the payment server 102. When the expiration date of the one-time code has passed, the payment application can request the payment server 102 to generate a new one-time code.

[0021] (About store terminals) The store terminal 103 in this embodiment is a terminal device used by a store clerk. The store terminal 103 requests payment processing from the payment server 102, for example, by scanning a code image displayed on a payment application on the user terminal 101. Specifically, the store terminal 103 transmits a one-time code obtained by scanning the code image, as well as a store ID and payment amount, to the payment server 102 via a POS (Point Of Sales) system. The payment server 102 then performs payment processing by transferring electronic money equivalent to the payment amount from the user's account corresponding to the user ID linked to the one-time code to the store's account corresponding to the store ID. Details of the payment processing and remittance processing will now be described.

[0022] (Regarding payment processing) There are two steps to execute the payment process: the store scan step and the user scan step. Each step will be explained below.

[0023] [Store Scan Procedure] The user presents the code image displayed on the payment application of the user terminal 101 to a store clerk. The store clerk then scans the code image displayed on the payment application of the user terminal 101 with the store terminal 103, and the store terminal 103 makes the above-mentioned request to the payment server 102. Thereafter, the payment processing is performed by the payment server 102. In other words, payment using the store scan procedure is payment using a one-time code. Note that the payment in this embodiment will be described using an example in which payment is performed using the store scan procedure.

[0024] [User scan procedure] A store clerk places a printed material in the store, on which a code image is printed and in which store information for identifying the store is embedded. The user uses the scanning function of the payment application on the user terminal 101 to read the code image from the printed material placed in the store. After the user enters the payment amount, the user terminal 101 transmits the user ID, the acquired store information, the payment amount, and the like to the payment server 102. The payment server 102 then performs payment processing. In other words, payment using the user scanning procedure is payment that does not use a one-time code.

[0025] (Regarding remittance processing) A first user, who is the user sending the remittance, uses the scanning function of the payment application on the first user terminal used by the first user to read a code image displayed on a second user terminal used by a second user, who is the user receiving the remittance. The code image displayed on the second user terminal has embedded therein the second user's identification information linked to the second user's account. The first user then inputs the remittance amount, and the first user terminal transmits the acquired second user's identification information and remittance amount to the payment server 102. The payment server 102 then performs the remittance process.

[0026] (Processing performed by each device) Referring to Figures 1 to 6, the following describes the process of a payment service, in which a two-dimensional code image encoded with a one-time code is displayed on the user terminal 101, decorated with an image set by the user (hereinafter referred to as a decorated code image), and then payment processing is performed by the payment server 102.

[0027] In S1, the user terminal 101 requests a one-time code from the payment server 102. The following describes the operation on the payment application by the user that triggers the request for a one-time code.

[0028] Figure 2 shows an example of a home screen displayed on the payment application after the payment application has been launched. The home screen 200 shown in Figure 2 has a code image display area 210, a payment / remittance function display area 220, an icon display area 230, and a balance display area 240. The home screen 200 also has a home button 251, a pay button 252, and an account button 253.

[0029] A one-dimensional code image and a two-dimensional code image are displayed in the code image display area 210. A "Scan" button, a "Send" button, and a "Charge" button are displayed in the payment / remittance function display area 220. Each button displayed in the payment / remittance function display area 220 is used when using the payment service.

[0030] Icons corresponding to services that can be provided by the application are displayed in the icon display area 230. The balance display area 240 displays the balance of electronic money and the balance of points that can be used for payment services.

[0031] The home button 251 is a button that accepts a transition to the home screen 200. The pay button 252 is a button that accepts a transition to a display screen described later. The account button 253 is a button that accepts a transition to a user account screen described later.

[0032] When the user presses the pay button 252, the display screen shown in Fig. 3 is displayed. Fig. 3 is a diagram showing an example of a screen displayed on the payment application that displays a code image. That is, when the pay button 252 is pressed, the payment application requests the payment server 102 for a one-time code.

[0033] The display screen 300 shown in Figure 3 is a screen for making a payment using the store scan procedure. The display screen 300 has a code image display area 310 and a balance display area 320. The code image display area 310 displays a one-dimensional code image, a decorated code image 311, and a renewal deadline 312. The decorated code image 311 is an image that appears to be a composite of a photograph of a landscape with multiple buildings lined up and a two-dimensional code image in which a one-time code is encoded as a two-dimensional code.

[0034] The renewal deadline 312 indicates the expiration date of the one-time code. The renewal deadline 312 is displayed, for example, starting from the time indicated by a preset expiration date (e.g., 5 minutes) and counting down every second. When the renewal deadline 312 reaches 0, the payment application requests a one-time code from the payment server 102. When a one-time code is requested and a new code image is displayed, the display of the renewal deadline 312 is reset. In other words, the renewal deadline 312 is displayed again starting from 5 minutes and counting down every second.

[0035] Additionally, an update button 313 is provided in the code image display area 310. When the user presses the update button 313, the payment application can also request a one-time code from the payment server 102.

[0036] The display screen 300 is provided with a "Scan and pay" button 330 and a back button 340. The "Scan and pay" button 330 is a button that accepts display of a screen (not shown) for making a payment through a user scanning procedure. The back button 340 is a button that accepts transition from the display screen 300 to the home screen 200.

[0037] In the above description, the request for the one-time code in S1 is made after accepting an operation such as pressing the payment button 252, but the request in S1 may be made before accepting an operation such as pressing the payment button 252. For example, the request for the one-time code in S1 may be made when a payment application is launched in the user terminal 101 or when the top page of the payment application is updated. A decorative code image may also be displayed as the code image displayed on the top screen (home screen 200) of the payment application.

[0038] In other words, the trigger in S1 (the condition for requesting a one-time code) may be any of the following: receiving the operation of pressing the pay button 252, the renewal deadline reaching 0, receiving the operation of pressing the update button 313, the payment application being launched, and the top page of the payment application being updated.

[0039] Returning to Fig. 1, in S2, the payment server 102 generates a one-time code in response to the request from the user terminal 101 in S1. Also, in S2, the payment server 102 associates the generated one-time code with the user ID of the user who made the request in S1 and temporarily stores the code in a user database, which will be described later.

[0040] In S3, the payment server 102 transmits the one-time code generated in S2 to the user terminal 101 that originated the request in S1. In S4, the user terminal 101 performs processing to generate a decoration code image. Specifically, in S4, the user terminal 101 generates a decoration code image using the image generation system of the payment application, based on the image set by the user on the two-dimensional code image setting screen shown in FIG. 4(b) and the one-time code acquired in S3. Here, a method for setting the image will be described. Note that in this example, an example will be described in which the image is set by the user in advance, but the two-dimensional code image setting screen shown in FIG. 4(b) may also be displayed based on the reception of the one-time code. Furthermore, if the user has not set an image in advance, a default image may be used, or a guide encouraging the user to set an image may be displayed the first time.

[0041] 4(a) is a diagram showing an example of a user account screen that is displayed on the payment application. The user account screen 400 shown in FIG. 4(a) is a screen linked to a user account that has been registered with the payment server 102.

[0042] The user account screen 400 displays a user name 401 corresponding to the user's account. The user account screen 400 also displays setting items such as audio settings and character size changes. When the user presses the two-dimensional code image setting 402 displayed on the user account screen 400, the screen transitions from the user account screen 400 to the two-dimensional code image setting screen shown in FIG. 4(b).

[0043] Fig. 4(b) is a diagram showing an example of a two-dimensional code image setting screen that is displayed on the payment application. The two-dimensional code image setting screen 410 shown in Fig. 4(b) is a screen where an image for decorating the two-dimensional code image can be set.

[0044] An image setting area 411 is displayed on the two-dimensional code image setting screen 410. A reference button is provided on the right side of the image setting area 411. When the user presses the reference button, a list of images such as photographs saved in a folder in the user terminal 101 is displayed. The user can set an image for decorating the two-dimensional code image by selecting a desired image from the displayed list of images.

[0045] The two-dimensional code image setting screen 410 is provided with an OK button 412, a cancel button 413, and a back button 414. The OK button 412 is a button that accepts that the contents set on the two-dimensional code image setting screen 410 are reflected. When the OK button 412 is pressed, the contents set on the two-dimensional code image setting screen 410 are stored in the RAM or storage device of the user terminal 101. The cancel button 413 is a button that accepts that the contents set on the two-dimensional code image setting screen 410 are not reflected. The back button 414 is a button that accepts that the contents set on the two-dimensional code image setting screen 410 are not reflected.

[0046] Returning to Figure 1, in S4, the user terminal 101 generates a decorative code image using the image generation system of the payment application based on the one-time code received in S3 and the image set on the two-dimensional code image setting screen shown in Figure 4(b).

[0047] In S5, the user terminal 101 displays the decoration code image generated in S4 in the code image display area 310 shown in Fig. 3. An example of an image displayed as the decoration code image is shown in Fig. 5.

[0048] FIG. 5 is a diagram showing an example of a decoration code image displayed in the code image display area 310 and an image corresponding to the decoration code image (that is, an image that is the basis for generating the decoration code image).

[0049] FIG. 5(a) is a diagram showing a decoration code image in which a two-dimensional code image is decorated with a photo of "multiple buildings." FIG. 5(b) is a diagram showing an image corresponding to the decoration code image 500 shown in FIG. 5(a), which is set by a user (hereinafter referred to as a user-set image). The decoration code image 500 shown in FIG. 5(a) is a decoration code image generated in a state in which a photo 502 having an object 503 of "multiple buildings" is set as a user-set image. In addition, in the decoration code image 500, a two-dimensional code image 501 is embedded in a state in which it is placed on the photo 502.

[0050] The color of the two-dimensional code image 501 in the decoration code image 500 is a color that matches the color (e.g., hue, brightness, and saturation) of the area in the photograph 502 that overlaps with the area where the two-dimensional code image 501 is arranged. Specifically, the pixel value of the pixel of the two-dimensional code image 501 in the decoration code image 500 is the same as the pixel value of the pixel that corresponds to the color of the area in the photograph 502 that overlaps with the area where the two-dimensional code image 501 is arranged, or is a pixel value that is within a predetermined threshold from the pixel value.

[0051] Furthermore, to express the rugged texture of a building, the image generation system may deform at least a portion of the shape of the code pattern (sometimes referred to as a symbol pattern) of the 2D code image 501 according to the characteristics of the "multiple buildings" object 503. The object's characteristics refer to, for example, the object's material, texture, and appearance. For example, if the object is a "river," the object's characteristics may include water, cold, flowing, and the appearance of flowing water. In this case, the shape of at least a portion of the code pattern of the 2D code image (e.g., the outlines of some of the blocks in the code pattern) may be deformed into a distorted shape to express the undulations of the water surface. This deformation may also be applied to Figure 5(c) and Figures 6(a) and 6(c) described below. In this way, the image generation system can generate a decorative code image according to the user-defined image, rather than simply generating an image that combines a 2D code image and a user-defined image.

[0052] In this disclosure, we will use an example in which pixel values ​​are changed or the shape of the code pattern is deformed as described above in an area of ​​two-ninths (2 / 9) or more of the area of ​​a two-dimensional code image. Depending on the encoding level, two-dimensional codes may become unable to be corrected by error correction if another image, such as a logo, is superimposed over a certain area of ​​the two-dimensional code. In this disclosure, we will use an example in which error correction is unable to be performed if a logo image or other image is superimposed as is over approximately one-ninth of the area of ​​the two-dimensional code image. In the two-dimensional code image of this disclosure, pixel values ​​are changed or the shape of the code pattern is deformed based on a user-defined image in an area of ​​the two-dimensional code that is beyond the area that would be unreadable if a logo image or other image were superimposed on the two-dimensional code image. For example, the pixel values ​​of more than two-ninths of the area of ​​the decorative code image where the two-dimensional code image is located are colored to match the image values ​​of the pixels in the user-defined image. Note that the area in which the pixel values ​​are changed or the shape of the code pattern is deformed as described above may be less than two-ninths of the area of ​​the two-dimensional code image. In addition, the two-dimensional code image in the present disclosure may be superimposed with a logo image or the like in approximately 1 / 9 of the area of ​​the two-dimensional code image, or may be corrected by error correction. Furthermore, in the present disclosure, an example will be described in which the two-dimensional code image in the decorative code image is positioned in the center of the user-defined image.

[0053] Fig. 5(c) is a diagram showing a decoration code image 510 in which a two-dimensional code image is decorated with a photo of "winter mountains." Fig. 5(d) is a diagram showing a user-defined image corresponding to the decoration code image 510 shown in Fig. 5(c).

[0054] 5(b) is a decoration code image generated when a photo 512 having a "winter mountain" object 513 is set as a user-defined image. In addition, a two-dimensional code image 511 is embedded in the decoration code image 510 and placed on the photo 512.

[0055] Looking at the decorative code image 510, compared to the two-dimensional code image 501 of the decorative code image 500, the color of the part of the code pattern that should be expressed in black in the two-dimensional code image 511 is lighter to match the color of "winter mountains."

[0056] The user-defined images shown in Figures 5(b) and 5(d) are merely examples and do not have to be photographs. For example, the user-defined images may be images expressed as paintings, illustrations, or abstract patterns.

[0057] 6 is a diagram showing an example of a decoration code image displayed in the code image display area 310 and a user-defined image corresponding to the decoration code image. The user-defined image shown in FIG. 6 is an illustration, not a photograph, as an example.

[0058] Fig. 6(a) is a diagram showing a decoration code image 600 in which a two-dimensional code image is decorated with an illustration of "fruit." Fig. 6(b) is a diagram showing a user-defined image corresponding to the decoration code image 600 shown in Fig. 6(a).

[0059] 6(a) is a decoration code image generated in a state where an illustration 602 having a "fruit" object 603 is set as a user-defined image. In addition, in the decoration code image 600, a two-dimensional code image 601 is embedded in a state where it is positioned on the illustration 602.

[0060] Looking at the decorative code image 600, the color of the part of the code pattern that should be expressed in white in the two-dimensional code image 601 is the color of the "fruit" object 603. In this way, the image generation system can generate the decorative code image 600 as a result of strengthening the sense of unity between the "fruit" object 603 and the two-dimensional code image 601.

[0061] Fig. 6(c) is a diagram showing a decoration code image 610 in which a two-dimensional code image is decorated with an illustration of "multiple trees." Fig. 6(d) is a diagram showing a user-defined image corresponding to the decoration code image 610 shown in Fig. 6(c). The decoration code image 610 shown in Fig. 6(c) is a decoration code image generated in a state in which an illustration 613 having an object 614 of "multiple trees" is set as a user-defined image. In addition, in the decoration code image 610, a two-dimensional code image 611 is embedded in a state in which it is placed on the illustration 613.

[0062] Looking at the decorative code image 610, a frame 612 made of wood is decorated around the periphery of the two-dimensional code image 611. That is, a decoration related to a "plurality of trees" object 614 is applied. For example, if the object is "plurality of jewels," a frame modeled after the edge of the opening of a box containing the "plurality of jewels" is decorated around the periphery of the two-dimensional code image as a decoration related to the object.

[0063] 5 and 6, the two-dimensional code image is placed on the user-defined image and in the center of the user-defined image, but the position where the two-dimensional code image is placed is not limited to this. For example, the two-dimensional code image may be placed anywhere on the user-defined image in the decoration code image. Furthermore, the two-dimensional code image may be placed in a position where it overlaps with an object in the user-defined image in the decoration code image, or in a position where it does not overlap with the object.

[0064] In this way, the image generation system can generate a decorative code image according to a user-defined image. The color of the two-dimensional code image is not limited to achromatic colors such as white, black, and gray, but may also be a chromatic color. The color of the code pattern of the two-dimensional code image is also not limited to white and black, but may also be gray or a chromatic color.

[0065] As mentioned above, the image forming system generates a 2D code image using stable diffusion. This allows for the generation of a decorated code image incorporating a user-defined image without impairing the readability of the 2D code image based on a one-time code. 2D codes are known as a type of code that is highly resistant to dirt and noise. Even if the code (code pattern) appears to be damaged at first glance, image generation using stable diffusion results in an image that maintains the readability of the code.

[0066] Returning to FIG. 1, in S6, a store clerk uses the store terminal 103 to scan the decoration code image displayed on the payment application of the user terminal 101. As described above, payments in this disclosure are made using the store scan procedure, so in S6 the store terminal 103 obtains a one-time code by scanning the decoration code image. Also in S6, the store terminal 103 obtains the store ID, payment amount, etc. from the POS system.

[0067] In S7, the store terminal 103 transmits the acquired one-time code, store ID, payment amount, etc. to the payment server 102 via the POS system. In S8, the payment server 102 performs payment processing based on the one-time code, store ID, payment amount, etc. acquired in S7. Specifically, in S8, the payment server 102 identifies the user's account from which the payment is made based on the user ID linked to the one-time code acquired in S7, and identifies the store's account to which the payment is made based on the store ID. The payment server 102 then performs processing to transfer electronic money equivalent to the payment amount from the user's account to the store's account.

[0068] Note that the example in Figure 1 is an explanation using a payment service (payment processing) as an example, but the processing flow is basically the same in a remittance service (remittance processing). The main differences are that the store terminal 103 in the payment processing is replaced by a second user terminal used by a second user who receives electronic money in the remittance processing, and that scanning at the store terminal 103 used by the payment destination store is replaced by scanning at a first user terminal used by a first user who sends the remittance. Needless to say, the store information and store ID handled in the payment processing are different from the identification information of the second user who is the remittance destination handled in the remittance processing. In the remittance service, the user terminal 101 requests a one-time code from the payment server 102, and the user terminal 101 generates a decoration code image using the one-time code received in response to this request, just like in the example explained using the payment service.

[0069] (Example of a system) 7 is a diagram showing an example of the configuration of this system. This system 100 has a user terminal 101, a payment server 102, and a store terminal 103. These devices are connected to each other so that they can communicate with each other via a network 700. The network 700 is, for example, a network such as a LAN (Local Area Network) or a WAN (Wide Area Network).

[0070] In the present disclosure, an example will be described in which there is one user terminal 101 and one shop terminal 103, as shown in Fig. 7. Note that there may be a plurality of user terminals 101 and a plurality of shop terminals 103.

[0071] (Hardware configuration of information processing device) The above-described user terminal 101, payment server 102, store terminal 103, and store terminal 104 (described later) are realized, for example, by an information processing device 800 ("an example of a computer") configured as shown in FIG. 8. FIG. 8 is a block diagram showing an example of the hardware configuration of the information processing device 800. The information processing device 800 has a CPU 801, a ROM 802, a RAM 803, a storage device 804, an input / output I / F 805, and a network interface (I / F) 806. These components are connected to one another by a system bus. Furthermore, a display unit 807 and an input unit 808 are connected to the input / output I / F 805.

[0072] The CPU 801 reads programs stored in the ROM 802 and the storage device 804 into the RAM 803 and executes the read programs to perform various controls. The CPU 801 may be an MPU (Micro Processing Unit) or an ASIC (Application Specific Integrated Circuit). The CPU 801 may also be an FPGA (Field Programmable Gate Array) or the like.

[0073] The ROM 802 stores control programs such as a startup program for the information processing device 800. The RAM 803 is used as a work memory for temporarily storing control programs or data when the CPU 801 executes various controls.

[0074] The storage device 804 is a memory for storing applications, software, various data, and the like. Examples of the storage device 804 include a hard disk drive (HDD), a solid state drive (SDD), flash memory, and storage. If the storage device 804 is the user terminal 101, it stores a payment application, etc. If the storage device 804 is the payment server 102, it stores a user database (hereinafter, the database will be referred to as DB) and a store DB, which will be described later, and the like.

[0075] The input / output I / F 805 is an interface for transmitting output information to an output device such as a display unit 807. An example of the display unit 807 is a display. The display unit 807 may be provided in the information processing device 800 as shown in FIG. 8, or may be provided outside the information processing device 800.

[0076] The input / output I / F 805 is an interface for receiving input information from an input device such as an input unit 808. Examples of the input unit 808 include a keyboard, a button, a touch panel, and an operation key. The input unit 808 may be provided in the information processing device 800 as shown in FIG. 8, or may be provided outside the information processing device 800. The input / output I / F 805 may be configured as being divided into an input I / F and an output I / F.

[0077] The network I / F 806 is an interface for receiving data, etc. from other devices via the network 700, and for transmitting data generated or stored in the information processing device 800, etc. to other devices via the network 700.

[0078] The information processing device 800 is not limited to the configuration shown in Fig. 8. For example, the user terminal 101 may be provided with a camera unit for realizing a camera function, and the store terminal 103 may be provided with a scanning unit for scanning a code image.

[0079] The information processing device 800 may also include a media I / F (not shown). The media I / F reads programs and data stored in a storage device (not shown) connected by wire or wirelessly, and provides them to the CPU 801 via the RAM 803. The CPU 801 can read the provided programs from the storage device onto the RAM 803 via the media I / F and execute the read programs. The storage device is, for example, an optical recording medium such as a DVD (Digital Versatile Disc) or a PD (Phase Change Rewritable Disk), or a magneto-optical recording medium such as an MO (Magneto-Optical disk). The storage device may also be a tape medium, a magnetic recording medium, a semiconductor memory, or the like.

[0080] The CPU 801 of the information processing device 800 reads and executes these programs from a storage device, but as another example, these programs may be acquired from another device via a predetermined communication network. Furthermore, it goes without saying that the information processing device 800 is provided with a configuration necessary to realize the information processing in this embodiment.

[0081] (An example of the software configuration of a user device) 9 is a diagram showing an example of the software configuration of the user terminal 101 in this embodiment. The user terminal 101 has a payment application 900. The payment application 900 includes a receiving unit 901, a transmitting unit 902, a display control unit 903, a generating unit 904, and an image generation system 905. Note that the user terminal 101 may have applications other than the payment application 900.

[0082] The receiving unit 901 can receive a one-time code from the payment server 102 via the network 700, and can receive other information from an external device. The transmitting unit 902 can make a request for a one-time code and other requests to the payment server 102 via the network 700, and can transmit other information to an external device.

[0083] The display control unit 903 displays various screens of the payment application 900 and detects user operations on these screens. The display control unit 903 performs display control to display a code image on the payment application 900.

[0084] The generation unit 904 generates a code image based on the one-time code. The generation unit 904 can also generate a decoration code image using the image generation system 905. The image generation system 905 generates a decoration code image based on the user-defined image and the one-time code in response to an instruction from the generation unit 904.

[0085] (Example of payment server functional configuration) Fig. 10 is a diagram showing an example of the functional configuration of the payment server 102 in this embodiment. The configuration of the payment server 102 in this embodiment will be described with reference to Fig. 10. The payment server 102 has a communication unit 1000, a control unit 1010, and a storage unit 1020. The control unit 1010 includes a receiving unit 1011, a transmitting unit 1012, a generating unit 1013, and a payment processing unit 1014. The control unit 1010 controls the entire payment server 102. The storage unit 1020 includes a user DB 1021 and a store DB 1022.

[0086] First, the information stored in the user DB 1021 and the store DB 1022 will be described with reference to Fig. 11. Fig. 11 is a diagram showing an example of information stored in each of the user DB 1021 and the store DB 1022.

[0087] 11(a) is a diagram showing an example of user management information 1100 stored in the user DB 1021. The user management information 1100 is generated when a user registers an account, and is user information managed by the payment server 102.

[0088] In the user management information 1100, user information 1101, user ID 1102, name 1103, available balance 1104, and available points 1105 are linked to one another. Note that a one-time code 1106 is generated in response to a one-time code request, and is linked to the user ID etc. and temporarily managed by the payment server 102.

[0089] The user information 1101 is used to manage information about users who have registered accounts in the settlement server 102. The user information 1101 is information expressed, for example, as a URL (Uniform Resource Locator).

[0090] The user ID 1102 is an identifier for uniquely identifying a user. The name 1103 is a character string that can be set arbitrarily by the user and indicates the user's name or title. The available balance 1104 is the balance of electronic money. The available points 1105 are points that are granted by, for example, a service provider that operates a payment service and can be used by the user. The available balance 1104 and the available points 1105 correspond to the balance in the user's account.

[0091] 11(b) is a diagram showing an example of store management information 1110 stored in store DB 1022. Store management information 1110 is generated when a store owner enters into a contract (e.g., an affiliated store contract) with a service provider, and is store information managed by payment server 102. In store management information 1110, store information 1111, affiliated store ID 1112, store ID 1113, and sales amount 1114 are linked to one another.

[0092] Store information 1111 is used by the payment server 102 to manage information about stores belonging to the affiliated store. Store information 1111 is information expressed, for example, as a URL. Affiliated store ID 1112 is an identifier for uniquely identifying the brand of the affiliated store. The affiliated store ID 1112 is linked to the brand name of the affiliated store, for example, XX Coffee, XX Department Store, or △△ Electric. Store ID 1113 is an identifier for uniquely identifying a store belonging to the affiliated store. The store ID 1113 is linked to the store name of the affiliated store, for example, XX Ekimae Store, XX machi Store, or △〇 street Store. Sales amount 1114 indicates the amount of sales made at the store. For example, when payment processing is completed by the payment server 102, an amount equivalent to the payment amount is added to sales amount 1114. Note that explanations of consumption tax and the like are omitted for simplicity.

[0093] The communication unit 1000 communicates with the user terminal 101, the store terminal 103, and other devices via the network 700. The receiving unit 1011 receives a request for a one-time code from the user terminal 101 and a request for payment processing from the store terminal 103 via the communication unit 1000. The receiving unit 1011 can also receive various information from external devices via the communication unit 1000. The transmitting unit 1012 can transmit a one-time code to the user terminal 101 and other information to external devices via the communication unit 1000.

[0094] The generation unit 1013 generates a one-time code in response to a request from the user terminal 101. The payment processing unit 1014 performs payment processing in response to a request from the store terminal 103. The payment processing unit 1014 can also perform payment processing or remittance processing in response to a request from the user terminal 101.

[0095] (An example of the information processing flow of this system) 12 is a sequence diagram showing an example of the flow of information processing among the user terminal 101, the payment server 102, and the store terminal 103. The flow of information processing in this embodiment will be described with reference to FIG.

[0096] In S1201, the user terminal 101 requests a one-time code from the payment server 102. For example, the user operates the user terminal 101 to launch the payment application 900. Then, the user terminal 101 displays the home screen 200 shown in FIG. 2 on the display unit of the user terminal 101. When the user terminal 101 detects a user operation on the pay button 252 on the home screen 200, it requests a one-time code from the payment server 102. Note that, as described above, the request for a one-time code may be triggered by the launch of the payment application 900, pressing of the update button 313, the expiration of the one-time code, the launch of the payment application, or the like.

[0097] In S1202, the payment server 102 generates a one-time code in response to the request from the user terminal 101 in S1201. Also, as described above, in S1202 the payment server 102 associates the generated one-time code with the user ID of the user who made the request in S1201 and temporarily stores it (until the expiration date of the one-time code). In S1203, the payment server 102 transmits the one-time code generated in S1202 to the user terminal 101 who made the request in S1201.

[0098] In S1204, the user terminal 101 performs processing to generate a decoration code image based on the one-time code and user-defined image received in S1203. Specifically, in S1204, the user terminal 101 inputs the one-time code and user-defined image to the image generation system 905, and obtains, as the output result, a decoration code image in which a two-dimensional code image having a code pattern obtained by encoding the one-time code is decorated with the user-defined image. Here, it is assumed that the user terminal 101 generates the decoration code image 500 shown in FIG. 5(a) using the image generation system 905.

[0099] In S1205, the user terminal 101 displays the decoration code image 500 generated in S1204. For example, in S1205, the user terminal 101 displays the decoration code image 311 in the code image display area 310 of the display screen 300, as shown in Fig. 3. Then, the user presents the decoration code image 311 to a store clerk at the time of payment.

[0100] In S1206, a store clerk scans the decoration code image 311 presented by the user using the store terminal 103. In S1206, the store terminal 103 analyzes the decoration code image 311 and acquires a one-time code. The store terminal 103 also acquires the store ID and payment amount from the POS system.

[0101] In S1207, the store terminal 103 transmits the one-time code, store ID, payment amount, etc. acquired in S1206 to the payment server 102 via the POS system. In S1208, the payment server 102 performs payment processing based on the one-time code, store ID, payment amount, etc. acquired in S1207. Specifically, in S1208, the payment server 102 identifies the user ID from the one-time code acquired in S1207. Then, the payment server 102 performs processing to transfer electronic money equivalent to the payment amount from the user's account corresponding to the identified user ID to the store's account corresponding to the store ID.

[0102] (An example of the flow of information processing on a user terminal) Figure 13 is a flowchart showing an example of processing of the user terminal 101 in this embodiment. With reference to Figure 13, processing by the payment application 900 of the user terminal 101 to display a decoration code image will be described. The processing shown in Figure 13 is realized by the CPU 801 of the user terminal 101 reading the program of the payment application 900 stored in the storage device 804 into the RAM 803 and executing it. The processing shown in Figure 13 is started in response to, for example, the user pressing the pay button 252.

[0103] In S1301, the CPU 801 of the user terminal 101 sends a request for a one-time code to the payment server 102 via the transmission unit 902, and proceeds to S1302. In S1302, the CPU 801 of the user terminal 101 acquires the one-time code generated by the payment server 102 via the reception unit 901, and proceeds to S1303.

[0104] In S1303, the CPU 801 of the user terminal 101 acquires a user-defined image using the generation unit 904, and proceeds to S1304. In S1304, the CPU 801 of the user terminal 101 generates a decoration code image using the image generation system 905, and proceeds to S1305. Specifically, in S1304, the CPU 801 of the user terminal 101 generates a decoration code image using the image generation system 905 based on the input one-time code and the user-defined image.

[0105] In S1305, the CPU 801 of the user terminal 101 causes the display control unit 903 to display the decoration code image generated by the image generation system 905 in S1304, and the process proceeds to S1306.

[0106] In S1306, the CPU 801 of the user terminal 101 determines whether or not the update button 313 has been pressed by the display control unit 903. If the CPU 801 of the user terminal 101 determines in S1306 that the update button 313 has been pressed (Yes) by the display control unit 903, the process returns to S1303. In other words, if the determination in S1306 is Yes, the CPU 801 of the user terminal 101 causes the image generation system 905 to again perform the process of generating a decoration code image using the one-time code already acquired in S1302.

[0107] If the expiration date of the one-time code acquired in S1302 has passed and the determination in S1306 is "Yes", the CPU 801 of the user terminal 101 returns to S1301. Then, the CPU 801 of the user terminal 101 causes the transmission unit 902 to make a new request for a one-time code to the payment server 102. In this embodiment, the one-time code has a different value generated by the payment server 102 for each request from the user terminal 101. In other words, if the expiration date of the one-time code has passed and the update button 313 is pressed, a new decoration code image having a code pattern different from the code pattern corresponding to the decoration code image already displayed is displayed.

[0108] If the answer is "Yes" in S1306, the CPU 801 of the user terminal 101 may proceed to S1301 and send a request for a one-time code to the payment server 102 via the transmission unit 902 without waiting for the expiration date of the one-time code to pass.

[0109] If the CPU 801 of the user terminal 101 determines in S1306 via the display control unit 903 that the update button 313 has not been pressed (No), the process proceeds to S1307. In S1307, the CPU 801 of the user terminal 101 determines via the display control unit 903 whether or not the back button 340 has been pressed. If the CPU 801 of the user terminal 101 determines in S1307 via the display control unit 903 that the back button 340 has been pressed (Yes), the process ends. If the CPU 801 of the user terminal 101 determines in S1307 via the display control unit 903 that the back button 340 has not been pressed (No), the process returns to S1306.

[0110] According to this embodiment, it is possible to meet the needs of users who want to decorate two-dimensional code images for payment, thereby increasing the interest of users who use user devices.

[0111] <<Second embodiment>> Fig. 14 is a diagram showing an example of the system configuration and the processing content of each device in this embodiment. The system shown in Fig. 14 has a user terminal 101, a payment server 102, and a store terminal 104. The basic configuration of the user terminal 101 in this embodiment is the same as that of the user terminal 101 in the first embodiment, so a description thereof will be omitted. Below, differences from the first embodiment will be described.

[0112] (About the payment server) The payment server 102 in this embodiment can provide a management screen (described later) to a store of an affiliated store that has signed a contract (e.g., an affiliated store contract) with a service provider that provides a payment service (payment server 102), and can provide payment services to a user using a user terminal 101. The payment server 102 in this embodiment differs from the payment server 102 in the first embodiment in that it includes an image generation system that generates a decoration code image based on store information and a store setting image (described later). The image generation system of the payment server 102 in this embodiment and the image generation system 905 of the payment application 900 in the first embodiment have similar functions in that they generate a decoration code image by decorating a two-dimensional code image that has been converted into a two-dimensional code of an arbitrary character string (e.g., a code, a URL, etc.) with an arbitrary image. In other words, the image generation system in this embodiment can generate a decoration code image as described in FIGS. 5 and 6 in the first embodiment, based on the setting image.

[0113] (About store terminals) The store terminal 104 in this embodiment is a terminal device used by a store clerk. In this embodiment, the store terminal 104 is described as a portable tablet terminal by way of example. The store terminal 104 may be a notebook PC, a desktop PC, an information processing device equipped in a store and having a scanning function, or a smartphone.

[0114] The store terminal 104 has a management application. The management application can provide a management screen. The management screen is a screen on which transaction amounts at the store and the like can be viewed. The management screen may be provided by the payment server 102, or may be provided by an external server different from the payment server 102 (for example, a server that operates in cooperation with the payment server 102). The store terminal 104 may display the management screen using a general web browser. In the present disclosure, an example will be described in which the store terminal 104 displays the management screen using a management application.

[0115] Fig. 15 is a diagram showing an example of a home screen of the management screen. The home screen 1500 shown in Fig. 15 has a menu display area 1510, a store display area 1520, a transaction amount display area 1530, and a cumulative transaction amount display area 1540. The home screen 1500 also has a receive button 1550 that switches the screen to a display screen displaying a two-dimensional code image. Note that an operator (e.g., a button or a check box) that is displayed on the display unit of the terminal device and that accepts a predetermined instruction may be referred to as an item.

[0116] Menu display area 1510 is provided with a home bar 1511, a profile bar 1512, a settings bar 1513, and the like. When home bar 1511 is pressed, the screen switches to home screen 1500. When profile bar 1512 is pressed, the screen switches to a profile screen (not shown) on which information about affiliated stores and information about the store can be set. Information about the store includes, for example, information about the store's genre, the store's address, the types of payment methods available at the store, and the details of the contract between the store and the service provider. When settings bar 1513 is pressed, the screen switches to a settings item display screen, which will be described later.

[0117] Store display area 1520 displays the name of the affiliated store and the names of stores belonging to that affiliated store. Store display area 1520 also has a selection tab 1521 that allows a store to be selected. When selection tab 1521 is pressed, a list of store names, such as XX Station Store or △〇 Town Store, is displayed in a pull-down menu. When a store clerk selects the store to which he or she belongs from the displayed store names, home screen 1500 switches to a screen associated with the selected store.

[0118] The transaction amount display area 1530 displays the transaction amount for today for the store displayed in the store display area 1520. The transaction amount display area 1530 may also display the transaction amount for each transaction. The cumulative transaction amount display area 1540 displays the cumulative transaction amount for the store displayed in the store display area 1520. The cumulative transaction amount display area 1540 may also display the cumulative transaction amount for each day, month, or year.

[0119] When a store clerk wants to change information about the store, he or she presses setting bar 1513. Pressing setting bar 1513 switches home screen 1500 to a setting item display screen as shown in FIG. 16. FIG. 16 is a diagram showing an example of the setting item display screen that displays setting items for configurable information among the information about the store. Setting item display screen 1600 shown in FIG. 16 has a shortcut item display area 1610, a brand profile setting item 1620, a store profile setting item 1630, and a two-dimensional code image setting item 1640.

[0120] "Change email address," "Change bank account," etc. are displayed in shortcut item display area 1610. For example, when "Change email address" is pressed, the screen switches to a screen (not shown) where the email address set in "My profile" can be changed without having to press "My profile," which is one of the setting items displayed on setting item display screen 1600.

[0121] When the brand profile setting item 1620 is pressed, the screen can be switched to a screen (not shown) on which information about the affiliated store (for example, a brand such as XX Coffee or △X Department Store) can be set. When the store profile setting item 1630 is pressed, the screen can be switched to a screen (not shown) on which information about the store displayed in the store display area 1520 can be set. When the two-dimensional code image setting item 1640 is pressed, the screen can be switched to a two-dimensional code image setting screen on which information used to generate a decorative code image used for payment can be set, as shown in FIG. 17, for example.

[0122] FIG. 17 is a diagram showing an example of a two-dimensional code image setting screen on which an image used for generating a decorative code image (hereinafter referred to as a store setting image) can be set. The two-dimensional code image setting screen 1700 shown in FIG. 17 has a store setting image display area 1710. Images 1711 to 1716 that can be selected as store setting images are displayed in the store setting image display area 1710. A selection frame 1717 indicates that image 1713 is selected. In this embodiment, the images 1711 to 1716 are described as images stored in an external file of the management application and are prepared in advance. Note that the images 1711 to 1716 may be images such as photographs stored in a folder in the store terminal 104, or may be images provided by the payment server 102.

[0123] The two-dimensional code image setting screen 1700 is provided with an OK button 1718 and a cancel button 1719. The OK button 1718 is a button that accepts setting of the image selected in the selection frame 1717 as the store setting image. When the OK button 1718 is pressed with an image selected in the selection frame 1717, the selected image is stored in the RAM 803 or storage device 804 of the store terminal 104. The cancel button 1719 is a button that accepts not setting the image selected in the selection frame 1717 as the store setting image.

[0124] (Processing performed by each device) 14 to 18, the flow of the payment service in this embodiment from the display of the decoration code image on the store terminal 104 to the execution of the payment process on the payment server 102 will be described.

[0125] 14, the store terminal 104 requests a decoration code image from the payment server 102. At this time, the store terminal 104 includes in the request in S1 the store setting image set on the two-dimensional code image setting screen 1700. Here, an operation on the store terminal 104 by a store clerk that triggers a request for a decoration code image will be described.

[0126] Fig. 18 is a diagram showing an example of a display screen for a two-dimensional code image. The display screen 1800 shown in Fig. 18 is a screen displayed on the shop terminal 104 in response to pressing of the receive button 1550 shown in Fig. 15, and is a screen switched from the home screen 1500. That is, the trigger in S1 (the condition for requesting a decoration code image) is the acceptance of the operation of pressing the receive button 1550. Note that the management application may request a decoration code image immediately after the management application is started.

[0127] The display screen 1800 has a two-dimensional code image display area 1801. A decoration code image 1802 is displayed in the two-dimensional code image display area 1801. The display screen 1800 also has a print button 1803 and a download button 1804.

[0128] The print button 1803 is a button for receiving a print instruction for the decoration code image displayed on the display screen 1800 to a printer (not shown) communicably connected to the store terminal 104. The download button 1804 is a button for receiving an instruction to store the decoration code image displayed on the display screen 1800 in the storage device of the store terminal 104.

[0129] 14, in S1402, the payment server 102 acquires a store setting image from the request received in S1401. At this time, the payment server 102 acquires store information corresponding to the store that made the request in S1.

[0130] In S1403, the payment server 102 performs processing to generate a decoration code image. Specifically, in S1403, the payment server 102 generates a decoration code image using an image generation system based on the store setting image included in the request in S1401 and the store information acquired in S1402. That is, the image generation system generates a decoration code image by decorating a two-dimensional code image in which store information has been converted into a two-dimensional code with the store setting image. Note that, like the two-dimensional code image of the decoration code image in the first embodiment, the two-dimensional code image of the decoration code image in this embodiment may also be color-matched according to the store setting image, or the shape of the outline of part of the code pattern cell may be deformed.

[0131] In S1404, the payment server 102 transmits the decoration code image generated in S1403 to the store terminal 104 that made the request in S1. In S1405, the store terminal 104 displays the decoration code image received in S1404 on a display unit, as shown in Fig. 18. In this embodiment, display on a display unit is not limited to display on a display unit of a small terminal device such as the store terminal 104, but also includes signage display on a large display.

[0132] In S1406, the store clerk presses the print button 1803 displayed on the display screen 1800. Then, when the store terminal 104 detects that the print button 1803 has been pressed, it sends a print instruction to the printer to print the decoration code image displayed on the display screen 1800. When the printer receives the print instruction from the store terminal 104, it outputs a printed matter 105 on which the decoration code image is printed. The store clerk places the printed matter 105 output from the printer in the store.

[0133] In S1407, the user terminal 101 uses the scanning function of the payment application to read the decoration code image printed on the printed matter 105 output in S1406. In S1407, the user terminal 101 analyzes the read decoration code image and acquires store information.

[0134] In S1408, after the user inputs the payment amount, the user terminal 101 transmits the input payment amount to the payment server 102. It is assumed that the user terminal 101 transmits store information and a user ID for identifying the user to the payment server 102 in S1407 before transmitting the payment amount in S1408.

[0135] In S1409, the payment server 102 performs payment processing based on the store information, user ID, payment amount, etc. acquired from the user terminal 101. Specifically, in S1409, the payment server 102 identifies the store account to which payment is to be made from the store ID linked to the acquired store information, and identifies the user account from which payment is made from the user ID. Then, the payment server 102 performs processing to transfer electronic money equivalent to the payment amount from the user's account to the store's account.

[0136] (An example of the software configuration of a store terminal) 19 is a diagram showing an example of the software configuration of the store terminal 104 in this embodiment. The store terminal 104 has a management application 1900. Note that the store terminal 104 may have applications, software, and various programs other than the management application 1900. The management application 1900 includes a receiving unit 1901, a transmitting unit 1902, a display control unit 1903, and a setting unit 1904.

[0137] The receiving unit 1901 can receive a decoration code image from the payment server 102 via the network 700, and can receive various information from other devices. The transmitting unit 1902 can transmit a request for a decoration code image to the payment server 102 via the network 700, and can transmit a print instruction to a printer communicably connected to the store terminal 104. The transmitting unit 1902 can transmit various information to other devices via the network 700.

[0138] The display control unit 1903 can display a management screen on the management application 1900 and detect operations on the management screen. The setting unit 1904 acquires a store setting image and the like.

[0139] (Example of payment server functional configuration) 20 is a diagram showing an example of the functional configuration of the payment server 102 in this embodiment. The basic configuration of the payment server 102 in this embodiment is similar to the configuration of the payment server 102 in the first embodiment, but differs in that it has an image generation system 2000.

[0140] (An example of the information processing flow of this system) 21 is a sequence diagram showing an example of the flow of information processing among the user terminal 101, the payment server 102, and the store terminal 104. The flow of information processing in this embodiment will be described with reference to FIG.

[0141] In S2101, the store terminal 104 requests a decoration code image from the payment server 102. For example, a store clerk operates the store terminal 104 to start the management application 1900 and causes the home screen 1500 to be displayed on the display unit of the store terminal 104. When the store terminal 104 detects a user operation on the receive button 1550 on the home screen 1500 using the management application 1900, it requests a decoration code image from the payment server 102. At this time, the store terminal 104 includes a store setting image in the request in S2101 using the management application 1900.

[0142] In S2102, the payment server 102 acquires a store setting image from the request in S2101. Also, in S2102, the payment server 102 acquires store information linked to the store that made the request in S2101.

[0143] In S2103, the payment server 102 performs processing to generate a decoration code image based on the store setting image and store information acquired in S2102. Specifically, in S2103, the payment server 102 inputs the store setting image and store information to the image generation system 2000, and obtains, as an output result, a decoration code image in which a two-dimensional code image in which the store information is converted into a two-dimensional code is decorated with the store setting image.

[0144] Here, it is assumed that the payment server 102 generates the decoration code image 1802 shown in Fig. 18 using the image generation system 2000. In S2104, the payment server 102 transmits the decoration code image generated in S2103 to the store terminal 104 that sent the request in S2101.

[0145] In S2105, the store terminal 104 displays the decoration code image received in S2104 using the management application 1900. For example, in S2105, the store terminal 104 displays a decoration code image 1802 on a two-dimensional code image display area 1801 on a display screen 1800, as shown in FIG.

[0146] In S2106, when the store terminal 104 detects that the print button 1803 has been pressed using the management application 1900, it sends a print instruction to the printer to print the decoration code image 1802. Then, in response to the print instruction from the store terminal 104, the printer outputs a printed matter 105 as a result of printing the decoration code image 1802. The store clerk places the printed matter 105 output from the printer in the store.

[0147] In S2107, the user terminal 101 uses the scanning function of the payment application to read the decoration code image 1802 printed on the printed material 105 placed in the store. In S2107, the user terminal 101 analyzes the decoration code image 1802 using the payment application to acquire store information. Then, the user terminal 101 transmits the acquired store information and user ID to the payment server 102 using the payment application.

[0148] In S2108, after the user inputs the payment amount, the user terminal 101 transmits the input payment amount to the payment server 102 using the payment application. In S2109, the payment server 102 performs payment processing based on the store information, user ID, payment amount, etc. acquired from the user terminal 101. Specifically, in S2109, the payment server 102 identifies the store ID from the store information acquired in S2107. Then, the payment server 102 performs processing to transfer electronic money equivalent to the payment amount from the user's account corresponding to the acquired user ID to the store's account corresponding to the identified store ID.

[0149] (An example of the flow of information processing at a store terminal) Fig. 22 is a flowchart showing an example of processing of the store terminal 104 in this embodiment. With reference to Fig. 22, processing in which the management application 1900 of the store terminal 104 in this embodiment displays a two-dimensional code image will be described. The processing shown in Fig. 22 is realized by the CPU 801 of the store terminal 104 reading the program of the management application 1900 stored in the storage device 804 into the RAM 803 and executing it. The processing shown in Fig. 22 is started in response to, for example, the reception button 1550 being pressed by a store clerk.

[0150] In S2201, the CPU 801 of the store terminal 104 acquires a store setting image from the storage device 804 of the store terminal 104 via the setting unit 1904, and proceeds to S2202. In S2202, the CPU 801 of the store terminal 104 requests the payment server 102 for a decoration code image, including the store setting image acquired in S2201, via the transmission unit 1902, and proceeds to S2203.

[0151] In S2203, the CPU 801 of the store terminal 104 receives the decoration code image from the payment server 102 via the receiving unit 1901, and proceeds to S2204. In S2204, the CPU 801 of the store terminal 104 displays the decoration code image received in S2203 via the display control unit 1903, and proceeds to S2205.

[0152] In S2205, the CPU 801 of the store terminal 104 determines, via the display control unit 1903, whether or not the print button 1803 has been pressed. If, in S2205, the CPU 801 of the store terminal 104 determines via the display control unit 1903 that the print button 1803 has been pressed (Yes), the process proceeds to S2206. If, in S2206, the CPU 801 of the store terminal 104 determines via the display control unit 1903 that the print button 1803 has not been pressed (No), the process proceeds to S2207. In S2206, the CPU 801 of the store terminal 104 instructs the printer to print the decoration code image displayed in S2204 via the transmission unit 1902, and the process proceeds to S2207.

[0153] In S2207, the CPU 801 of the shop terminal 104 determines whether or not the display of the decoration code image has ended by the display control unit 1903. For example, in S2207, the CPU 801 of the shop terminal 104 determines whether or not the display of the decoration code image has ended by the display control unit 1903 switching the display screen 1800 to another screen due to a press on the home bar 1511, the profile bar 1512, the setting bar 1513, or the like.

[0154] In S2207, if the CPU 801 of the store terminal 104 determines via the display control unit 1903 that the display of the decoration code image has ended (Yes), the flow ends. In S2207, if the CPU 801 of the store terminal 104 determines via the display control unit 1903 that the display of the decoration code image has not ended (No), the flow returns to S2205.

[0155] (An example of the flow of information processing on a payment server) Fig. 23 is a flowchart showing an example of the processing of the payment server 102 in this embodiment. The processing executed by the payment server 102 will be described with reference to Fig. 23. The processing shown in Fig. 23 is started after the payment server 102 is started.

[0156] In S2301, the CPU 801 of the payment server 102 determines whether or not a request for a decoration code image has been received from the store terminal 104 via the receiving unit 1011. If the CPU 801 of the payment server 102 determines in S2301 that the request for a decoration code image has been received from the store terminal 104 via the receiving unit 1011 (Yes), the process proceeds to S2302. If the CPU 801 of the payment server 102 determines in S2301 that the request for a decoration code image has not been received from the store terminal 104 via the receiving unit 1011 (No), the process returns to S2301 and waits until the request is received.

[0157] In S2302, the CPU 801 of the payment server 102 acquires, via the generation unit 1013, a store setting image from the decoration code image request received in S2301, and the process proceeds to S2303.

[0158] In S2303, the CPU 801 of the payment server 102 causes the generation unit 1013 to perform processing to generate a decoration code image using the image generation system 2000, and proceeds to S2304. Specifically, in S2303, the CPU 801 of the payment server 102 causes the image generation system 2000 to generate a decoration code image based on the store information and the store setting image.

[0159] In S2304, the CPU 801 of the payment server 102 causes the transmission unit 1012 to transmit the decoration code image generated in S2303 to the store terminal 104 that is the requestor of the request received in S2301, and ends this flow.

[0160] According to this embodiment, the decoration code image generated by the payment server 102 is displayed on a store terminal used by a store clerk. When making a payment, the user scans the decoration code image printed as a printout to make the payment at the store. This meets the needs of store clerks who want to decorate the two-dimensional code image used for payment. Furthermore, it is possible to provide the user with the pleasure of viewing the decorated two-dimensional code image when making a payment.

[0161] <<Other embodiments>> In the first embodiment, the user-defined image is described as being stored in a folder in the user terminal 101, but the storage location of the user-defined image is not limited to this. For example, the user-defined image may be stored in a payment server and provided by the payment server when the user selects the user-defined image in the payment application. Alternatively, the user-defined image may be an image stored in an external file of the payment application and prepared in advance.

[0162] In the above-described embodiment, the position of the 2D code image in the user-defined image or the store-defined image is determined by the image generation system. Note that the position of the 2D code image relative to the user-defined image or the store-defined image may be set by the user or the store clerk.

[0163] For example, an input form (not shown) may be provided on the 2D code image setting screen 410 of FIG. 4(b) in the first embodiment, or on the 2D code image setting screen 1700 of FIG. 17 in the second embodiment, to enable setting of the position of the 2D code image relative to the setting image. In this case, in the first embodiment, the payment application 900 inputs position information indicating the position of the 2D code image relative to the acquired user-set image, together with the user-set image and the one-time code, to the image generation system. In the second embodiment, the payment server 102 inputs position information indicating the position of the 2D code image relative to the store-set image acquired from the store terminal 104, together with the store-set image and store information, to the image generation system. Then, a decorative code image may be generated in which the 2D code image is on the setting image and is positioned at the position indicated by the input position information.

[0164] In this way, the user or a store clerk, rather than the image generation system, can freely set the position of the two-dimensional code image relative to the set image, which further increases the interest.

[0165] The method for setting the position of the 2D code image relative to the setting image is not limited to the input form. For example, a virtual 2D code image and the setting image may be displayed on the screen of a payment application or a management application, and the position of the 2D code image relative to the setting image may be determined by an operation (e.g., tapping or dragging) by the user or a store clerk.

[0166] Furthermore, the position information indicating the position of the 2D code image relative to the set image may be set in advance. That is, the user or the store clerk selects the placement position of the 2D code image relative to the set image from among the placement positions indicated by the preset position information. Then, the image generation system may generate a decorative code image in which the 2D code image is located on the set image and is placed at the position indicated by the position information of the selected placement position.

[0167] In the first embodiment, an example has been described in which the user terminal 101 has the image generation system 905, but the payment server 102 or an external device different from these devices may have the image generation system. That is, the payment server 102 or the external device may generate a decoration code image using the image generation system 905.

[0168] In the second embodiment, the payment server 102 has the image generation system 2000. However, the store terminal 104 or an external device different from these devices may have the image generation system. That is, the store terminal 104 or the external device may generate a decoration code image using the image generation system 2000.

[0169] In the above embodiment, an example has been described in which the image generation system generates a decorative code image based on a one-time code or store information that is the basis of the 2D code image and a setting image, but the method of generating a decorative code image is not limited to this. For example, in addition to the one-time code or store information and the setting image, a text prompt, a negative text prompt, a guide scale value, an intensity value, a seed value, etc. may be used to generate a decorative code image.

[0170] A text prompt is a character string that indicates a decorative element. Examples of character strings that indicate decorative elements include animals such as cats and dogs, topography such as mountains, rivers, and oceans, seasons such as spring and summer, weather such as sunny and rainy, emotions such as happy and sad, and character strings that restrict gender and age such as girl and young man. Note that the character strings shown here are merely examples, and the text prompt may be other character strings. Furthermore, the text prompt is not limited to Japanese, and may be in English or other languages.

[0171] When a text prompt is input to the image generation system together with a setting image, a decoration code image is generated based on the setting image and incorporating the decoration elements indicated by the text prompt.

[0172] A negative text prompt is a character string that indicates an element that you want to exclude from the decoration of a 2D code image. For example, elements that you want to exclude include "window," "crossed legs," and "daytime." In this way, a character string that indicates an object, a state, or a time period that you want to exclude can be applied as a negative text prompt.

[0173] Elements that may be desired to be excluded include "ugly," "low quality," and "blurry." In this way, a character string that indicates a meaning that is not appropriate for the quality of the 2D code image to be generated can be applied as a negative text prompt. The character string shown here is an example, and the negative text prompt may be another character string. Furthermore, the negative text prompt is not limited to English, and may be Japanese or another language.

[0174] When a negative text prompt is input to the image generation system together with a setting image, a decorative code image is generated based on the setting image, excluding the decorative elements indicated by the negative text prompt. Hereinafter, the text prompt and the negative text prompt will be collectively referred to as "both text prompts."

[0175] The guide scale value indicates the extent to which the image generation system follows both text prompts when generating a decorated code image. A higher guide scale value causes the decorated code image to be generated in accordance with both text prompts, whereas a lower guide scale value causes the decorated code image to be generated in accordance with neither text prompt.

[0176] The intensity value indicates the degree to which the image generation system complements elements different from those indicated by the text prompt when generating a decorative code image according to the guide scale value. In other words, the intensity value is a value for setting the weight of the elements indicated by the text prompt for the image generation system. The higher the intensity value, the more elements different from those indicated by the text prompt are incorporated into the generated decorative code image, and the lower the intensity value, the more elements the decorative code image is limited to those indicated by the text prompt.

[0177] The seed value is a value used to determine the decoration configuration of a decoration code image. For example, if the seed value is the same, a 2D code image with the same decoration configuration is generated.

[0178] Specifically, suppose that the text prompt is set to "Sitting Dog" and the seed value is set to "123456789," and a 2D code image incorporating a dog sitting on a chair as a decorative element is output. Then, when a decorative code image is output again with the same text prompt and the same seed value set, a 2D code image incorporating a dog sitting on a chair as a decorative element is output.

[0179] Let's consider a case where the same text prompt ("Sitting Dog") is set, but a different seed value ("123456788") is set. In this case, for example, a 2D code image is output that incorporates a dog in a "sitting" pose as a decorative element. Alternatively, a 2D code image is output that incorporates two dogs sitting on a chair as decorative elements. The "sitting" pose refers to a pose in which the front legs are stretched out in a direction intersecting the ground and rest on the ground, and the hind legs are bent and rest on the ground. In this way, different seed values ​​result in the output of 2D code images with decorative elements that differ in pose and configuration.

[0180] When the guide scale value, intensity value, and seed value are input to the image generating system along with the setting image, a decoration code image is generated based on the setting image and incorporating decoration elements based on these values.

[0181] In this way, in order to decorate a two-dimensional code image, in addition to the setting image, a text prompt, a negative text prompt, a guide scale value, an intensity value, and a seed value may be used. That is, when generating a decorated code image, in addition to the setting image, a text prompt, a negative text prompt, a guide scale value, an intensity value, and a seed value may be input into the image generation system. In addition to these, other values ​​necessary for generating a decorated code image may also be used in the present disclosure.

[0182] In the above embodiment, an example has been described in which the image generation system generates a decorative code image based on a one-time code or store information and a setting image, but the method for generating a decorative code image is not limited to this. For example, the image generation system may generate a two-dimensional code image that encodes a one-time code or store information. Then, the image generation system may generate a decorative code image as a result of decorating the generated two-dimensional code image with the acquired setting image.

[0183] Furthermore, a program for tuning a trained AI model (for example, LoRA (Low-Rank Adaptation)) may be applied to the image generation system of the present disclosure.

[0184] The configuration of the information processing device 800 described above can be flexibly changed, for example, by calling an external platform or the like via API or network computing depending on the function.

[0185] Furthermore, the above-described embodiments can be combined as appropriate within the scope of not causing any contradiction in the processing content. [Explanation of symbols]

[0186] 101: User terminal 102: Payment server 103: Store terminal

Claims

1. A system including a payment server that provides a payment service, and a terminal device that is communicably connected to the payment server and that executes an application used to provide the payment service, The payment server a code generating unit that generates a one-time code in response to a request from the application; The terminal device an acquisition unit that acquires a setting image set in accordance with an operation on the application; an image generating unit that generates, in response to the request, a decorative code image, which is an image including a two-dimensional code image obtained by encoding the one-time code generated by the code generating unit, and in which pixel values ​​of at least a part of the two-dimensional code image have been changed based on the setting image; a display control unit that controls displaying the decoration code image on the application; A system comprising:

2. The system according to claim 1 , wherein the decorative code image is an image in which the changed two-dimensional code image is superimposed on the set image.

3. the terminal device holds an image acquired in response to an operation on the terminal device; the acquisition unit acquires an image selected from the images held by the terminal device as the setting image; The system according to claim 1 , wherein the image generation unit performs the generation based on the selected image.

4. the payment server stores an image that can be set as the setting image, the acquisition unit acquires an image selected from the images held by the payment server as the setting image; The system according to claim 1 , wherein the image generation unit performs the generation based on the selected image.

5. The system of claim 1 , wherein the modified two-dimensional code image in the decorative code image is positioned at the center of the setting image.

6. the setting image has an object, The system according to claim 5 , wherein the modified two-dimensional code image in the decorative code image is positioned so as to overlap the object.

7. the acquiring unit further acquires position information indicating a position of the changed two-dimensional code image relative to the setting image, The system described in claim 1, characterized in that the image generation unit generates a decorative code image in which the changed two-dimensional code image is located on the setting image and is positioned at the position indicated by the position information.

8. The system according to claim 7 , wherein the location information can be set by an operation on the application.

9. the location information is preset information, the acquisition unit acquires the location information selected from the preset location information, The system according to claim 7 , wherein the image generating unit performs the generation based on the selected position information.

10. The system according to claim 1 , wherein the shape of the code pattern of the modified two-dimensional code image in the decoration code image is a shape corresponding to the characteristics of the object of the setting image.

11. 2. The system according to claim 1, wherein a decoration relating to an object of the setting image is applied to the periphery of the changed two-dimensional code image in the decoration code image.

12. The system according to claim 1 , wherein the image generation unit performs the generation using a diffusion model, which is a trained AI model.

13. The system according to claim 1 , wherein the decorative code image is a code image used in the payment service.

14. The system according to claim 1 , wherein the partial area is 2 / 9 or more of the area of ​​the two-dimensional code image.

15. A system including a payment server that provides a payment service, and a terminal device that is communicably connected to the payment server and used by a store clerk, The payment server a first acquisition unit that acquires a setting image that is set in accordance with an operation on the terminal device; a second acquisition unit that acquires identification information for identifying the store; a generating unit that generates a decorative code image, which is a two-dimensional code image obtained by encoding the identification information and includes a two-dimensional code image in which pixel values ​​of at least a part of the two-dimensional code image have been changed based on the setting image; and The system is characterized in that the terminal device has a display control unit that controls the display of the decoration code image transmitted from the payment server on a display unit.

16. The system according to claim 15, wherein the decorative code image is an image in which the changed two-dimensional code image is superimposed on the set image.

17. The terminal device stores a prepared image, the first acquisition unit acquires, as the setting image, an image selected from the images held by the terminal device; The system according to claim 15 , wherein the generating unit performs the generating based on the selected image.

18. the payment server stores an image that can be set as the setting image, The first acquisition unit acquires, as the setting image, an image selected from the images held by the payment server, The system according to claim 15 , wherein the generating unit performs the generating based on the selected image.

19. The system of claim 15 , wherein the modified two-dimensional code image in the decorative code image is positioned at the center of the setting image.

20. the setting image has an object, The system of claim 19, wherein the modified two-dimensional code image in the decorative code image is positioned so as to overlap the object.

21. the first acquisition unit further acquires position information indicating a position of the changed two-dimensional code image relative to the setting image; The system described in claim 15, characterized in that the generation unit generates a decorative code image in which the changed two-dimensional code image is on the setting image and is placed at a position indicated by the position information.

22. The system according to claim 21, wherein the location information can be set by operating the terminal device.

23. the location information is preset information, the first acquisition unit acquires the location information selected from the preset location information, The system according to claim 21 , wherein the generating unit performs the generation based on the selected location information.

24. The system according to claim 15, wherein the shape of the code pattern of the modified two-dimensional code image in the decoration code image is a shape according to the characteristics of the object of the setting image.

25. The system according to claim 15, wherein a decoration relating to an object of the setting image is applied to the periphery of the changed two-dimensional code image in the decoration code image.

26. The system according to claim 15, wherein the generation unit performs the generation using a Diffusion Model, which is a trained AI model.

27. The system according to claim 15, wherein the decorated code image is a code image used in the payment service.

28. The system according to claim 15, wherein the partial area is 2 / 9 or more of the area of ​​the two-dimensional code image.

29. An application executed by a terminal device communicably connected to a payment server that provides a payment service, the application program being used to provide the payment service, The terminal device, a first acquisition unit that acquires a one-time code generated by the payment server in response to a request from the application; a second acquisition unit that acquires a setting image that is set in accordance with an operation on the terminal device; a generating unit that generates a decorative code image, which is a two-dimensional code image obtained by encoding the one-time code and includes a two-dimensional code image in which pixel values ​​of at least a part of the two-dimensional code image have been changed based on the setting image; a display control unit that controls displaying the decoration code image on the application; A program that makes it work.

30. A payment server that provides a payment service and is communicably connected to a terminal device used by a store clerk, a first acquisition unit that acquires a setting image that is set in accordance with an operation on the terminal device; a second acquisition unit that acquires identification information for identifying the store; a generating unit that generates a decorative code image, which is a two-dimensional code image obtained by encoding the identification information and includes a two-dimensional code image in which pixel values ​​of at least a part of the two-dimensional code image have been changed based on the setting image; a transmission unit that transmits the decoration code image to the terminal device; A payment server comprising:

31. A method for controlling a terminal device that is communicably connected to a payment server that provides a payment service and that executes an application used to provide the payment service, comprising: a first acquisition step of acquiring a one-time code generated by the payment server in response to a request from the application; a second acquisition step of acquiring a setting image set in accordance with an operation on the terminal device; a generating step of generating a decorative code image, which is a two-dimensional code image obtained by encoding the one-time code and includes a two-dimensional code image in which pixel values ​​of at least a part of the two-dimensional code image have been changed based on the setting image; a display control step of controlling the display of the decoration code image on the application; A control method comprising:

32. A method for controlling a payment server that provides a payment service and is communicably connected to a terminal device used by a store clerk, comprising: a first acquisition step of acquiring a setting image set in accordance with an operation on the terminal device; a second acquisition step of acquiring identification information for identifying the store; a generating step of generating a decorative code image, which is a two-dimensional code image obtained by encoding the identification information and includes a two-dimensional code image in which pixel values ​​of at least a part of the two-dimensional code image have been changed based on the setting image; a transmission step of transmitting the decoration code image to the terminal device; A control method comprising:

33. A printed matter on which a decorative code image used for a payment service in a system including a payment server that provides a payment service and a user terminal used by a user who receives the payment service for payment at a store, A printed material on which a decorative code image is printed, the decorative code image being a two-dimensional code image in which identification information for identifying the store is encoded, and the image includes a two-dimensional code image in which the pixel values ​​of at least a portion of the two-dimensional code image have been changed based on a setting image set in accordance with operations on a store terminal at the store.

Images