System, program, payment server, terminal device control method, and payment server control method
A system utilizing a trained AI model generates decorated two-dimensional code images on terminal devices, addressing readability challenges and enhancing user engagement by personalizing payment experiences.
Patent Information
- Application Number
- JP2025042794
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2025-03-17
- Publication Date
- 2025-09-03
- Estimated Expiration
- 2045-03-17
AI Technical Summary
Existing methods for decorating two-dimensional code images on terminal devices are challenging due to readability issues, particularly when the images are distorted or damaged, failing to meet user interest in personalizing payment experiences.
Implementing a system that uses a trained AI model, such as a stable diffusion model, to generate decorated two-dimensional code images based on user input, ensuring both aesthetic appeal and readability by incorporating decorative elements into the code images.
Enhances user interest by allowing personalized and visually appealing two-dimensional code images without compromising readability, thus improving the user experience on terminal devices.
Smart Images

Figure 0007733846000001_ABST
Abstract
Description
[Technical Field]
[0001] The present disclosure relates to a system, a program, a payment server, a control method for a terminal device, and a control method for a payment server. [Background technology]
[0002] In recent years, techniques for decorating images have become known from the viewpoint of interest. Patent Document 1 discloses a method for decorating the periphery of a one-dimensional code image by displaying an image with a design selected by a user around the one-dimensional code image. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2020-170442 A Summary of the Invention [Problem to be solved by the invention]
[0004] There is a need for a method to improve the interest of users of terminal devices. [Means for solving the problem]
[0005] A system according to one aspect of the present disclosure is a system including a payment server that provides payment services and a terminal device communicatively connected to the payment server and executing an application used to provide the payment service, the system having a first acquisition unit that acquires a one-time code generated by the payment server in response to a request from the application, a second acquisition unit that acquires a prompt that instructs decoration of a two-dimensional code image used in the payment service, and a generation control unit that controls the generation of a decorated code image that is a two-dimensional code image in which the one-time code is encoded and that has been decorated as indicated by the prompt, and the terminal device is characterized by having a display control unit that controls the display of the decorated code image on the application. [Effects of the Invention]
[0006] According to the present disclosure, it is possible to increase the interest of users who use terminal devices. [Brief explanation of the drawings]
[0007] [Figure 1] FIG. 2 is a diagram illustrating an example of a system configuration and processing details of each device. [Figure 2] FIG. 10 is a diagram illustrating an example of a home screen displayed on a payment application. [Figure 3] FIG. 10 is a diagram showing an example of a display screen that is displayed on the payment application and that displays a code image. [Figure 4] FIG. 10 is a diagram illustrating an example of a screen displayed on a payment application. [Figure 5] FIG. 10 is a diagram showing an example of a decorative code image and a text prompt. [Figure 6] 10A and 10B are diagrams illustrating examples of decoration of a decoration code image. [Figure 7] 10A and 10B are diagrams illustrating examples of decoration of a decoration code image. [Figure 8] FIG. 1 illustrates an example of a system configuration. [Figure 9]FIG. 2 is a block diagram illustrating an example of a hardware configuration of an information processing device. [Figure 10] FIG. 2 is a diagram illustrating an example of a software configuration of a user terminal. [Figure 11] FIG. 2 is a diagram illustrating an example of a functional configuration of a payment server. [Figure 12] 10A and 10B are diagrams illustrating an example of information stored in a user DB and a store DB, respectively. [Figure 13] FIG. 10 is a sequence diagram showing an example of the flow of information processing among a user terminal, a payment server, and a store terminal. [Figure 14] 10 is a flowchart illustrating an example of processing by a user terminal. [Figure 15] FIG. 2 is a diagram illustrating an example of a system configuration and processing details of each device. [Figure 16] FIG. 2 is a diagram illustrating an example of a functional configuration of a payment server. [Figure 17] FIG. 10 is a sequence diagram showing an example of the flow of information processing among a user terminal, a payment server, and a store terminal. [Figure 18] 10 is a flowchart illustrating an example of processing by a user terminal and a payment server. [Figure 19] FIG. 10 is a diagram showing an example of a two-dimensional code image setting screen. [Figure 20] FIG. 10 is a diagram showing an example of a two-dimensional code image setting screen. [Figure 21] FIG. 10 illustrates an example of both pre-defined text prompts and prompt parameters. DETAILED DESCRIPTION OF THE INVENTION
[0008] Preferred embodiments of the system, program, payment server, terminal device control method, and payment server control method according to the present disclosure will be described in detail below with reference to the drawings. Note that the following embodiments do not limit the system, program, payment server, terminal device control method, and payment server control method according to the present disclosure. Furthermore, the same components in the following embodiments will be assigned the same reference numerals, and duplicated descriptions will be omitted.
[0009] In recent years, payment using a terminal device used by a user has become widespread due to its high convenience. For example, payment can be made by scanning a code image displayed on the terminal device with a store terminal, or by scanning a code image placed in a store with a user terminal. Types of code images used for payment include one-dimensional code images and two-dimensional code images. In addition, from the viewpoint of entertainment value, techniques for decorating such code images are known.
[0010] For example, a method is known in which an image of a design selected by a user is displayed around a one-dimensional code image to decorate the periphery of the one-dimensional code image. However, decorating the code image itself can be difficult from the standpoint of readability, making it difficult to meet the needs of users who want to decorate the code image. For two-dimensional code images such as QR (Quick Response) Code (registered trademark), readability can be ensured even if defects due to distortion or damage occur in the code image, so it is expected that decorating the code image will not be difficult.
[0011] Incidentally, there is a known technology for generating images not by human hands but by image generation AI. For example, there is a trained AI model (e.g., a Diffusion Model) that can input text and output an image containing the elements indicated by the input text. Specifically, when the text "cat" and "girl" are input, the trained AI model can generate and output an image depicting a scene of a girl holding a cat. This system, which outputs an image with a user's desired design by inputting text into a trained AI model, is called stable diffusion.
[0012] The present disclosure applies stable diffusion to a two-dimensional code image used for payment, thereby decorating the code image, thereby meeting the needs of users who want to decorate two-dimensional code images for payment. This can increase the interest of users who use terminal devices. In the embodiments described below, when there is no need to distinguish between one-dimensional code images and two-dimensional code images, they will be collectively referred to as code images.
[0013] <<First embodiment>> 1 is a diagram showing an example of the system configuration and the processing contents of each device in this embodiment. The system 100 has a user terminal 101, a payment server 102, and a shop terminal 103.
[0014] (About user devices) The user terminal 101 is a terminal device owned by a user who uses a payment service described below. An application for using the payment service (hereinafter referred to as a payment application) is installed in the user terminal 101. By executing the payment application, the user terminal 101 can provide a payment service to the user who uses the user terminal 101. In this disclosure, the user terminal 101 will be described as a smartphone, for example. Note that the user terminal 101 may also be a laptop computer, a tablet terminal, or an information processing device capable of executing a payment application.
[0015] A payment service is a service that performs payment processing to transfer electronic money equivalent to the payment amount from the account of the user making the payment to the account of the store. Note that payment services also include a remittance service that performs remittance processing to transfer electronic money from a first account held by a first user, who is the sender of the remittance, to a second account held by a second user, who is the recipient of the remittance.
[0016] The payment application has the function of displaying code images used during payment and providing services related to payment services. The payment application also has an image generation system that generates two-dimensional code images based on one-time codes and text prompts (described below). A code image is an image generated by encoding (one-dimensionally or two-dimensionally) information such as a character string. The image generation system is, for example, a trained AI model that has trained using a large amount of existing images as training data. Note that the payment application does not necessarily have to have an image generation system. In other words, the payment application may use an image generation system that is provided separately from the payment application in the user terminal 101.
[0017] When such a trained AI model receives input of an instruction (hereinafter referred to as a prompt), it can generate an image that includes the decorative element indicated by the prompt. For example, when the trained AI model receives the prompts "rain" and "dog" and a one-time code as input, it can output a two-dimensional code image that encodes the one-time code and incorporates a dog standing in the rain as a decorative element.
[0018] (About the payment server) The payment server 102 generates one-time codes in response to requests from the user terminal 101, and performs payment processing in response to requests from the store terminal 103 (described later). A one-time code is a code with an expiration date set, and is generated by the payment server 102 in response to a request from a payment application. The generated one-time code is linked to a user ID registered in the payment server 102 and managed by the payment server 102. When the expiration date of the one-time code has passed, the payment application can request the payment server 102 to generate a new one-time code.
[0019] (About store terminals) The store terminal 103 requests payment processing from the payment server 102, for example, by scanning a code image displayed on a payment application on the user terminal 101. Specifically, the store terminal 103 transmits a one-time code obtained by scanning the code image, as well as a store ID and payment amount, to the payment server 102 via a POS (Point Of Sales) system. The payment server 102 then performs payment processing by transferring electronic money equivalent to the payment amount from the user's account corresponding to the user ID linked to the one-time code to the store's account corresponding to the store ID. Details of the payment processing and remittance processing will now be described.
[0020] (Regarding payment processing) There are two procedures for executing the payment process: the store scan procedure and the user scan procedure. Each procedure will be explained below.
[0021] [Store Scan Procedure] The user presents the code image displayed on the payment application of the user terminal 101 to a store clerk. The store clerk then scans the code image displayed on the payment application of the user terminal 101 with the store terminal 103, and the store terminal 103 makes the above-mentioned request to the payment server 102. Thereafter, the payment server 102 performs payment processing. In other words, payment using the store scan procedure is payment using a one-time code. Note that the payment in this disclosure will be described using an example in which payment is performed using the store scan procedure.
[0022] [User scan procedure] A store clerk places a printed material in the store, on which a code image is printed and in which store information for identifying the store is embedded. The user uses the scanning function of the payment application on the user terminal 101 to read the code image from the printed material placed in the store. After the user enters the payment amount, the user terminal 101 transmits the user ID, the acquired store information, the payment amount, and the like to the payment server 102. The payment server 102 then performs payment processing. In other words, payment using the user scanning procedure is payment that does not use a one-time code.
[0023] (Regarding remittance processing) A first user, who is the user sending the money, uses the scanning function of the payment application of the first user terminal used by the first user to read a code image displayed on a second user terminal used by a second user, who is the user receiving the money. The code image displayed on the second user terminal has embedded therein the second user's identification information linked to the second user's account. The first user then inputs the amount to be sent, and the first user terminal transmits the acquired identification information of the second user and the amount to be sent to the payment server 102. The payment server 102 then performs the money transfer process. A code image in which a code with an expiration date, such as a one-time code, is encoded as a two-dimensional code is used for money transfers between the first and second users. In other words, the two-dimensional code image decorated as indicated by the text prompt in the present disclosure may also be applied to money transfers between the first and second users.
[0024] (Processing performed by each device) Referring to Figures 1 to 7, we will explain the flow of a payment service from displaying a decorated two-dimensional code image (hereinafter referred to as a decorated code image) indicated by a text prompt on the user terminal 101 to performing payment processing on the payment server 102.
[0025] In S1, the user terminal 101 requests a one-time code from the payment server 102. The following describes the operation on the payment application by the user that triggers the request for a one-time code.
[0026] Figure 2 shows an example of a home screen displayed on the payment application after the payment application has been launched. The home screen 200 shown in Figure 2 has a code image display area 210, a payment / remittance function display area 220, an icon display area 230, and a balance display area 240. The home screen 200 also has a home button 251, a pay button 252, and an account button 253.
[0027] A one-dimensional code image and a two-dimensional code image are displayed in the code image display area 210. A "Scan" button, a "Send" button, and a "Charge" button are displayed in the payment / remittance function display area 220. Each button displayed in the payment / remittance function display area 220 is used when using the payment service.
[0028] Icons corresponding to services that can be provided by the application are displayed in the icon display area 230. The balance display area 240 displays the balance of electronic money and the balance of points that can be used for payment services.
[0029] The home button 251 is a button that accepts transition to the home screen 200. The pay button 252 is a button that accepts transition to a display screen described later. The account button 253 is a button that accepts transition to a user account screen described later. Furthermore, buttons displayed on the payment application may be referred to as items that accept predetermined instructions.
[0030] When the user presses the pay button 252, the display screen shown in Fig. 3 is displayed. Fig. 3 is a diagram showing an example of a screen displayed on the payment application that displays a code image. That is, when the pay button 252 is pressed, the payment application requests the payment server 102 for a one-time code.
[0031] The display screen 300 shown in Fig. 3 is a screen for making a payment using the store scan procedure. The display screen 300 has a code image display area 310 and a balance display area 320. The code image display area 310 displays a one-dimensional code image, a decorated code image 311, and a renewal deadline 312. The decorated code image 311 displays a two-dimensional code image decorated with a cherry blossom pattern.
[0032] The renewal deadline 312 indicates the expiration date of the one-time code. The renewal deadline 312 is displayed, for example, starting from the time indicated by a preset expiration date (e.g., 5 minutes) and counting down every second. When the renewal deadline 312 reaches 0, the payment application requests a one-time code from the payment server 102. When a one-time code is requested and a new code image is displayed, the display of the renewal deadline 312 is reset. In other words, the renewal deadline 312 is displayed again starting from 5 minutes and counting down every second.
[0033] Additionally, an update button 313 is provided in the code image display area 310. When the user presses the update button 313, the payment application can also request a one-time code from the payment server 102.
[0034] The display screen 300 is provided with a "Scan and pay" button 330 and a back button 340. The "Scan and pay" button 330 is a button that accepts display of a screen (not shown) for making a payment through a user scanning procedure. The back button 340 is a button that accepts transition from the display screen 300 to the home screen 200.
[0035] The request in S1 may be made before accepting the pressing operation of the payment button 252. For example, the request for a one-time code in S1 may be triggered by the start of a payment application on the user terminal 101 or the update of the top page of the payment application. A decorative code image may be displayed as the code image displayed on the top screen (home screen 200) of the payment application.
[0036] In other words, the trigger in S1 (the condition for requesting a one-time code) may be any of the following: receiving the operation of pressing the pay button 252, the renewal deadline reaching 0, receiving the operation of pressing the update button 313, the payment application being launched, and the top page of the payment application being updated.
[0037] Returning to Fig. 1, in S2, the payment server 102 generates a one-time code in response to the request from the user terminal 101 in S1. Also, in S2, the payment server 102 associates the generated one-time code with the user ID of the user who made the request in S1 and temporarily stores the code in a user database, which will be described later.
[0038] In S3, the payment server 102 transmits the one-time code generated in S2 to the user terminal 101 that originated the request in S1. In S4, the user terminal 101 performs processing to generate a decoration code image. Specifically, in S4, the user terminal 101 generates a decoration code image using the image generation system of the payment application based on the text prompt set by the user on the two-dimensional code image setting screen shown in FIG. 4(b) and the one-time code acquired in S3. Here, a method for setting the text prompt will be described. Note that in this example, an example will be described in which the text prompt is set by the user in advance, but the two-dimensional code image setting screen shown in FIG. 4(b) may also be displayed based on the reception of the one-time code. Furthermore, if the user has not set a text prompt or the like in advance, a default value may be used, or a guide encouraging the user to set it may be displayed the first time.
[0039] 4(a) is a diagram showing an example of a user account screen that is displayed on the payment application. The user account screen 400 shown in FIG. 4(a) is a screen linked to a user account that has been registered with the payment server 102.
[0040] The user account screen 400 displays a user name 401 corresponding to the user's account. The user account screen 400 also displays setting items such as audio settings and character size changes. When the user presses the two-dimensional code image setting 402 displayed on the user account screen 400, the screen transitions from the user account screen 400 to the two-dimensional code image setting screen shown in FIG. 4(b).
[0041] Fig. 4(b) is a diagram showing an example of a two-dimensional code image setting screen that is displayed on the payment application. The two-dimensional code image setting screen 410 shown in Fig. 4(b) is a screen where a text prompt for decorating the two-dimensional code image can be set.
[0042] A text prompt input area 411 is displayed on the two-dimensional code image setting screen 410. In the text prompt input area 411, character strings (text prompts) indicating decorative elements of the two-dimensional code image can be input. For example, character strings indicating decorative elements include characters for animals such as cats and dogs, topography such as mountains, rivers and oceans, seasons such as spring and summer, weather such as sunny and rainy, emotions such as happy and sad, and character strings restricting gender and age such as girl and young man. Note that the character strings shown here are merely examples, and it goes without saying that other character strings can be set as decorative elements. Decorative elements can be set in English and other languages, not just Japanese.
[0043] The two-dimensional code image setting screen 410 is provided with an OK button 412, a cancel button 413, and a back button 414. The OK button 412 is a button that accepts that the contents set on the two-dimensional code image setting screen 410 are reflected. When the OK button 412 is pressed, the contents set on the two-dimensional code image setting screen 410 are stored in the RAM or storage device of the user terminal 101. The cancel button 413 is a button that accepts that the contents set on the two-dimensional code image setting screen 410 are not reflected. The back button 414 is a button that accepts that the contents set on the two-dimensional code image setting screen 410 are not reflected.
[0044] Here, an example will be given in which the image generation system generates a decorative code image using a negative text prompt, a guide scale value, an intensity value, a seed value, and the like in addition to a one-time code and a text prompt. These will be described below.
[0045] A negative text prompt is a character string that indicates an element that you want to exclude from the decoration of a 2D code image. For example, elements that you want to exclude include "window," "crossed legs," and "daytime." In this way, a character string that indicates an object, a state, or a time period that you want to exclude can be applied as a negative text prompt.
[0046] Elements that may be desired to be excluded include "ugly," "low quality," and "blurry." In this way, character strings that indicate meanings that are unsuitable for the quality of the 2D code image to be generated can be applied as negative text prompts. The character strings shown here are just examples, and it goes without saying that other character strings can be applied as elements that may be desired to be excluded. When there is no need to distinguish between text prompts and negative text prompts, they will be collectively referred to as "both text prompts."
[0047] The guide scale value indicates the extent to which the image generation system follows both text prompts when generating a decorated code image. A higher guide scale value causes the decorated code image to be generated in accordance with both text prompts, whereas a lower guide scale value causes the decorated code image to be generated in accordance with neither text prompt.
[0048] The intensity value indicates the degree to which the image generation system complements elements different from those indicated by the text prompt when generating a decorative code image according to the guide scale value. In other words, the intensity value is a value for setting the weight of the elements indicated by the text prompt for the image generation system. The higher the intensity value, the more elements different from those indicated by the text prompt are incorporated into the generated decorative code image, and the lower the intensity value, the more elements the decorative code image is limited to those indicated by the text prompt.
[0049] The seed value is a value used to determine the decoration configuration of a decoration code image. For example, if the seed value is the same, a 2D code image with the same decoration configuration is generated.
[0050] Specifically, suppose that the text prompt is set to "Sitting Dog" and the seed value is set to "123456789," and a 2D code image incorporating a dog sitting on a chair as a decorative element is output. Then, when a decorative code image is output again with the same text prompt and the same seed value set, a 2D code image incorporating a dog sitting on a chair as a decorative element is output.
[0051] Let's consider a case where the same text prompt ("Sitting Dog") is set, but a different seed value ("123456788") is set. In this case, for example, a 2D code image is output that incorporates a dog in a "sitting" pose as a decorative element. Alternatively, a 2D code image is output that incorporates two dogs sitting on a chair as decorative elements. The "sitting" pose refers to a pose in which the front legs are stretched out in a direction intersecting the ground and rest on the ground, and the hind legs are bent and rest on the ground. In this way, different seed values result in the output of 2D code images with decorative elements that differ in pose and configuration.
[0052] In this embodiment, the negative text prompt, the guide scale value, and the intensity value are preset values, and the seed value is a randomly determined value.
[0053] In addition to the negative text prompt, guide scale value, intensity value, and seed value, other values necessary for generating a decorative code image may be used in the present disclosure. The negative text prompt, guide scale value, intensity value, and seed value may be fixed values or may be set for each text prompt. These values may be written in the payment application's internal program, saved in an external file of the payment application, or stored in the payment server 102.
[0054] Returning to Figure 1, in S4, the user terminal 101 generates a decoration code image using the image generation system of the payment application based on the one-time code received in S3 and the text prompt set on the two-dimensional code image setting screen shown in Figure 4(b). When generating the decoration code image, in addition to the one-time code and text prompt, a negative text prompt, a guide scale value, an intensity value, and a seed value are also input to the image generation system.
[0055] In S5, the user terminal 101 displays the decoration code image generated in S4 in the code image display area 310 shown in Fig. 3. An example of an image displayed as the decoration code image is shown in Fig. 5.
[0056] FIG. 5 is a diagram showing an example of a decoration code image displayed in the code image display area 310 and a text prompt corresponding to the decoration code image (i.e., the text prompt that is the basis for generating the decoration code image). FIG. 5(a) is a diagram showing a decoration code image, which is a two-dimensional code image incorporating "cherry blossoms" as a decoration element, and the corresponding text prompt. The decoration code image 500 shown in FIG. 5(a) is a two-dimensional code image generated with the decoration element "Cherry Blossoms" 502, which means "cherry blossoms," set as the text prompt. Furthermore, the decoration code image 500 incorporates a "cherry blossoms" pattern 501 as a decoration element.
[0057] Fig. 5(b) is a diagram showing a decorative code image, which is a two-dimensional code image incorporating "Japanese Winter Landscape" as a decorative element, and a corresponding text prompt. The decorative code image 510 shown in Fig. 5(b) is a two-dimensional code image generated with the decorative element "Japanese Winter Landscape" 512, which means "Japanese Winter Landscape," set as the text prompt. In addition, the decorative code image 510 incorporates a winter mountain pattern 511 as a decorative element.
[0058] 5(a) and 5(b) are merely examples, and various decorations may be applied to the two-dimensional code image. For example, the two-dimensional code image may be decorated with a painting, a photograph, an illustration, or an abstract pattern.
[0059] Here, details of decoration of a decoration code image generated by an image generation system will be described with reference to Fig. 6 and Fig. 7, taking the decoration code image 510 shown in Fig. 5(b) as an example. Fig. 6 is a diagram showing an example of decoration of the decoration code image 510. Note that Figs. 6(a) to 6(d) are enlarged views of the area 513 shown in Fig. 5(b).
[0060] Figure 6(a) is a diagram showing an example of a two-dimensional code image decorated with emphasis on a winter mountain and its outline. Looking at the area 600 shown in Figure 6(a), the color of the part that should be expressed in white as the code pattern (sometimes expressed as a symbol pattern) of the two-dimensional code image has been changed to gray, the color of winter mountains, in the part that overlaps with the winter mountain. This change is also the case in Figures 6(b) to 6(d) and Figures 7(a) and 7(c) described below. Furthermore, as a result of emphasizing the outline 601 of the winter mountain, the color of part that should be expressed in black as the code pattern of the two-dimensional code image has been changed to white.
[0061] Figure 6(b) is a diagram showing an example of a decorated 2D code image that emphasizes winter mountains. Looking at area 610 shown in Figure 6(b), the color of a part 611 of the code pattern of the 2D code image that should be expressed in black has been changed to gray, the color of winter mountains. In addition, a white circle has been added to a part 612 of the code pattern of the 2D code image that should be expressed in black, to represent snow falling on the winter mountains.
[0062] Figure 6(c) is a diagram showing an example of a two-dimensional code image decorated with emphasis on winter mountains. Looking at area 620 shown in Figure 6(c), the shape of the outline of part 621 of the code pattern of the two-dimensional code image that should be expressed in black has been modified to represent the rock surface of a winter mountain. Also, the color of part 622 of the code pattern of the two-dimensional code image that should be expressed in black has been changed to gray to represent the rock surface of a winter mountain.
[0063] Fig. 6(d) is a diagram showing an example of a two-dimensional code image decorated with an emphasis on winter mountains. In the area 630 shown in Fig. 6(d), a blurring effect is applied to a part 631 of the area 630 to express a fantastical winter mountain. Blurring refers to changing the brightness of the pixels of the two-dimensional code image so as to reduce the visibility of the two-dimensional code image, for example.
[0064] Furthermore, as shown in Fig. 7, the two-dimensional code image may be decorated to improve the readability of the code pattern of the two-dimensional code image. Fig. 7 is a diagram showing an example of decoration of a decorated code image 510. The diagrams shown in Fig. 7(a) to (c) are enlarged views of the area 513 shown in Fig. 5(b).
[0065] Fig. 7(a) is a diagram showing an example of decoration of a two-dimensional code image that improves the readability of the code pattern of the two-dimensional code image. Looking at the area 700 shown in Fig. 7(a), compared to the area 600 shown in Fig. 6(a), a part 701 of the part that should be expressed in white as the code pattern of the two-dimensional code image is expressed in white, not in gray, which indicates the color of winter mountains.
[0066] Figure 7(b) is a diagram showing an example of decoration of a 2D code image in which the outline of a winter mountain is emphasized while the readability of the code pattern of the 2D code image is improved. Looking at the area 710 shown in Figure 7(b), all of the color of the parts that should be expressed in white as the code pattern of the 2D code image is expressed in white, not gray, which indicates the color of winter mountains. Also, as a result of emphasizing the outline of the winter mountain, a part of the color 711 of the parts that should be expressed in white or black as the code pattern of the 2D code image has been changed to gray, which indicates the color of winter mountains.
[0067] Fig. 7(c) is a diagram showing an example of decoration of a 2D code image that emphasizes the winter mountains while improving the readability of the code pattern of the 2D code image. Looking at the area 720 shown in Fig. 7(c), a part 721 of the part that should be expressed in black as the code pattern of the 2D code image is expressed in a black color close to the color of the winter mountains. Also, a part 722 of the part that should be expressed in white as the code pattern of the 2D code image is expressed in a gray color close to white.
[0068] In this way, the image generation system can generate a decorative code image so as to emphasize the decorative elements in the decoration of the two-dimensional code image, or generate a decorative code image so as to increase the readability of the code pattern of the two-dimensional code image. Note that the color of the decoration applied to the two-dimensional code image is not limited to achromatic colors such as white, black, and gray, but may also be a chromatic color. Furthermore, the color of the code pattern of the two-dimensional code image is not limited to white and black, but may also be gray or a chromatic color.
[0069] As mentioned above, the image forming system generates 2D code images using stable diffusion. This makes it possible to generate decorative code images incorporating decorative elements without impairing the readability of the 2D code image based on the one-time code. 2D codes are known as a type of code that is highly resistant to dirt and noise. Even if the code (code pattern) appears to be damaged at first glance, image generation using stable diffusion results in an image that maintains the readability of the code.
[0070] Returning to FIG. 1, in S6, a store clerk uses the store terminal 103 to scan the decoration code image displayed on the payment application of the user terminal 101. As described above, payments in this disclosure are made using the store scan procedure, so in S6 the store terminal 103 obtains a one-time code by scanning the decoration code image. Also in S6, the store terminal 103 obtains the store ID, payment amount, etc. from the POS system.
[0071] In S7, the store terminal 103 transmits the acquired one-time code, store ID, payment amount, etc. to the payment server 102 via the POS system. In S8, the payment server 102 performs payment processing based on the one-time code, store ID, payment amount, etc. acquired in S7. Specifically, in S8, the payment server 102 identifies the user's account from which the payment is made based on the user ID linked to the one-time code acquired in S7, and identifies the store's account to which the payment is made based on the store ID. The payment server 102 then performs processing to transfer electronic money equivalent to the payment amount from the user's account to the store's account.
[0072] Note that the example in Figure 1 is an explanation using a payment service (payment processing) as an example, but the processing flow is basically the same in a remittance service (remittance processing). The main differences are that the store terminal 103 in the payment processing is replaced by a second user terminal used by a second user who receives electronic money in the remittance processing, and that scanning at the store terminal 103 used by the payment destination store is replaced by scanning at a first user terminal used by a first user who sends the remittance. Needless to say, the store information and store ID handled in the payment processing are different from the identification information of the second user who is the remittance destination handled in the remittance processing. In the remittance service, the user terminal 101 requests a one-time code from the payment server 102, and the user terminal 101 generates a decoration code image using the one-time code received in response to this request, just like in the example explained using the payment service.
[0073] (Example of a system) 8 is a diagram showing an example of the configuration of this system. This system 100 has a user terminal 101, a payment server 102, and a store terminal 103. These devices are connected to each other so that they can communicate with each other via a network 800. The network 800 is, for example, a network such as a LAN (Local Area Network) or a WAN (Wide Area Network).
[0074] In the present disclosure, an example will be described in which there is one user terminal 101 and one shop terminal 103, as shown in Fig. 8. Note that there may be a plurality of user terminals 101 and a plurality of shop terminals 103.
[0075] (Hardware configuration of information processing device) The above-described user terminal 101, payment server 102, and store terminal 103 are realized, for example, by an information processing device 900 ("an example of a computer") configured as shown in FIG. 9. FIG. 9 is a block diagram showing an example of the hardware configuration of the information processing device 900. The information processing device 900 has a CPU 901, a ROM 902, a RAM 903, a storage device 904, an input / output I / F 905, and a network interface (I / F) 906. These components are connected to one another by a system bus. In addition, a display unit 907 and an input unit 908 are connected to the input / output I / F 905.
[0076] The CPU 901 reads programs stored in the ROM 902 and the storage device 904 into the RAM 903 and executes the read programs to perform various controls. The CPU 901 may be an MPU (Micro Processing Unit) or an ASIC (Application Specific Integrated Circuit). The CPU 901 may also be an FPGA (Field Programmable Gate Array) or the like.
[0077] The ROM 902 stores control programs such as a startup program for the information processing device 900. The RAM 903 is used as a work memory for temporarily storing control programs or data when the CPU 901 executes various controls.
[0078] The storage device 904 is a memory for storing applications, software, various data, and the like. Examples of the storage device 904 include a hard disk drive (HDD), a solid state drive (SDD), flash memory, and storage. If the storage device 904 is the user terminal 101, it stores a payment application, etc. If the storage device 904 is the payment server 102, it stores a user database (hereinafter, the database will be referred to as DB) and a store DB, which will be described later, and the like.
[0079] The input / output I / F 905 is an interface for transmitting output information to an output device such as a display unit 907. An example of the display unit 907 is a display. The display unit 907 may be provided in the information processing device 900 as shown in FIG. 9, or may be provided outside the information processing device 900.
[0080] The input / output I / F 905 is an interface for receiving input information from an input device such as an input unit 908. Examples of the input unit 908 include a keyboard, a button, a touch panel, and an operation key. The input unit 908 may be provided in the information processing device 900 as shown in FIG. 9, or may be provided outside the information processing device 900. The input / output I / F 905 may be configured as being divided into an input I / F and an output I / F.
[0081] The network I / F 906 is an interface for receiving data, etc. from other devices via the network 800, and for transmitting data, etc. generated by or stored in the information processing device 900, to other devices via the network 800.
[0082] The information processing device 900 is not limited to the configuration shown in Fig. 9. For example, the user terminal 101 may be provided with a camera unit for realizing a camera function, and the store terminal 103 may be provided with a scanning unit for scanning a code image.
[0083] The information processing device 900 may also include a media I / F (not shown). The media I / F reads programs and data stored in a storage device (not shown) connected by wire or wirelessly, and provides them to the CPU 901 via RAM 903. The CPU 901 can read the provided programs from the storage device onto RAM 903 via the media I / F and execute the read programs. The storage device is, for example, an optical recording medium such as a DVD (Digital Versatile Disc) or a PD (Phase Change Rewritable Disk), or a magneto-optical recording medium such as an MO (Magneto-Optical disk). The storage device may also be a tape medium, a magnetic recording medium, a semiconductor memory, or the like.
[0084] The CPU 901 of the information processing device 900 reads and executes these programs from a storage device, but as another example, these programs may be acquired from another device via a predetermined communication network. Furthermore, it goes without saying that the information processing device 900 is provided with a configuration necessary to realize the information processing in this embodiment.
[0085] (An example of the software configuration of a user device) 10 is a diagram showing an example of the software configuration of the user terminal 101 in this embodiment. The user terminal 101 has a payment application 1000. The payment application 1000 includes a receiving unit 1001, a transmitting unit 1002, a display control unit 1003, a generating unit 1004, and an image generation system 1005. Note that the user terminal 101 may have applications other than the payment application 1000.
[0086] The receiving unit 1001 can receive a one-time code from the payment server 102 via the network 800, and can receive other information from an external device. The transmitting unit 1002 can make a request for a one-time code and other requests to the payment server 102 via the network 800, and can transmit other information to an external device.
[0087] The display control unit 1003 displays various screens of the payment application 1000 and detects user operations on these screens. The display control unit 1003 performs display control to display a code image on the payment application 1000.
[0088] The generation unit 1004 generates a code image based on the one-time code. The generation unit 1004 can also generate a decorated code image using the image generation system 1005. The image generation system 1005 generates a decorated code image based on a text prompt and one-time code set by the user in response to an instruction from the generation unit 1004.
[0089] (Example of payment server functional configuration) Fig. 11 is a diagram showing an example of the functional configuration of the payment server 102 in this embodiment. The configuration of the payment server 102 in this embodiment will be described with reference to Fig. 11. The payment server 102 has a communication unit 1100, a control unit 1110, and a storage unit 1120. The control unit 1110 includes a receiving unit 1111, a transmitting unit 1112, a generating unit 1113, and a payment processing unit 1114. The control unit 1110 controls the entire payment server 102. The storage unit 1120 includes a user DB 1121 and a store DB 1122.
[0090] First, the information stored in the user DB 1121 and the store DB 1122 will be described with reference to Fig. 12. Fig. 12 is a diagram showing an example of information stored in each of the user DB 1121 and the store DB 1122.
[0091] 12(a) is a diagram showing an example of user management information 1200 stored in the user DB 1121. The user management information 1200 is generated when a user registers an account, and is user information managed by the payment server 102.
[0092] In the user management information 1200, user information 1201, user ID 1202, name 1203, available balance 1204, and available points 1205 are linked to one another. Note that a one-time code 1206 is generated in response to a one-time code request, and is linked to the user ID etc. and temporarily managed by the payment server 102.
[0093] The user information 1201 is used to manage information about users who have registered accounts in the settlement server 102. The user information 1201 is information expressed, for example, as a URL (Uniform Resource Locator).
[0094] The user ID 1202 is an identifier for uniquely identifying a user. The name 1203 is a character string that can be set arbitrarily by the user and indicates the user's name or title. The available balance 1204 is the balance of electronic money. The available points 1205 are points that are granted by, for example, a service provider that operates a payment service and can be used by the user. The available balance 1204 and the available points 1205 correspond to the balance of the user's account.
[0095] 12(b) is a diagram showing an example of store management information 1210 stored in store DB 1122. Store management information 1210 is generated when a store owner enters into a contract (e.g., an affiliated store contract) with a service provider, and is store information managed by payment server 102. In store management information 1210, store information 1211, affiliated store ID 1212, store ID 1213, and sales amount 1214 are linked to one another.
[0096] Store information 1211 is used by the payment server 102 to manage information about stores belonging to the affiliated store. Store information 1211 is information expressed, for example, as a URL. Affiliated store ID 1212 is an identifier for uniquely identifying the brand of the affiliated store. The affiliated store ID 1212 is linked to the brand name of the affiliated store, for example, XX Coffee, XX Department Store, or △△ Electrical Appliances. Store ID 1213 is an identifier for uniquely identifying a store belonging to the affiliated store. The store ID 1213 is linked to the store name of the affiliated store, for example, XX Ekimae Store, XX machi Store, or △〇 street Store. Sales amount 1214 indicates the amount of sales made at the store. For example, when payment processing is completed by the payment server 102, an amount equivalent to the payment amount is added to sales amount 1214. Note that explanations of consumption tax and the like are omitted for simplicity.
[0097] The communication unit 1100 communicates with the user terminal 101, the store terminal 103, and other devices via the network 800. The receiving unit 1111 receives a request for a one-time code from the user terminal 101 and a request for payment processing from the store terminal 103 via the communication unit 1100. The receiving unit 1111 can also receive various information from external devices via the communication unit 1100. The transmitting unit 1112 can transmit a one-time code to the user terminal 101 and other information to external devices via the communication unit 1100.
[0098] The generation unit 1113 generates a one-time code in response to a request from the user terminal 101. The payment processing unit 1114 performs payment processing in response to a request from the store terminal 103. The payment processing unit 1114 can also perform payment processing or remittance processing in response to a request from the user terminal 101.
[0099] (An example of the information processing flow of this system) 13 is a sequence diagram showing an example of the flow of information processing among the user terminal 101, the payment server 102, and the store terminal 103. The flow of information processing in this embodiment will be described with reference to FIG.
[0100] In S1301, the user terminal 101 requests a one-time code from the payment server 102. For example, the user operates the user terminal 101 to launch the payment application 1000. Then, the user terminal 101 displays the home screen 200 shown in FIG. 2 on the display unit of the user terminal 101. When the user terminal 101 detects a user operation on the pay button 252 on the home screen 200, it requests a one-time code from the payment server 102. Note that the request for the one-time code may be triggered by the launch of the payment application 1000, pressing of the update button 313, the expiration of the one-time code, or the like, as described above.
[0101] In S1302, the payment server 102 generates a one-time code in response to the request from the user terminal 101 in S1301. Also, as described above, in S1302 the payment server 102 associates the generated one-time code with the user ID of the user who made the request in S1301 and temporarily stores it (until the expiration date of the one-time code). In S1303, the payment server 102 transmits the one-time code generated in S1302 to the user terminal 101 who made the request in S1301.
[0102] In S1304, the user terminal 101 performs a process for generating a decorated code image based on the one-time code received in S1303 and the text prompt set by the user. Specifically, in S1304, the user terminal 101 inputs the one-time code and the text prompt into the image generation system 1005, and obtains a two-dimensional code image in which the code pattern obtained by encoding the one-time code is decorated with elements indicated by the text prompt. In this embodiment, an example will be described in which a preset negative prompt, guide scale value, and intensity value are stored in an external file of the payment application 1000. The payment application 1000 uses a random seed value when generating a decorated code image using the image generation system 1005. That is, a different seed value is used each time a decorated code image is generated. Here, it is assumed that the user terminal 101 generates the decorated code image 500 shown in FIG. 5(a) using the image generation system 1005.
[0103] In S1305, the user terminal 101 displays the decoration code image 500 generated in S1304. For example, in S1305, the user terminal 101 displays the decoration code image 311 in the code image display area 310 on the display screen 300, as shown in Fig. 3. Then, the user presents the decoration code image 311 to a store clerk at the time of payment.
[0104] In S1306, a store clerk scans the decoration code image 311 presented by the user using the store terminal 103. In S1306, the store terminal 103 analyzes the decoration code image 311 and acquires a one-time code. The store terminal 103 also acquires a store ID and payment amount from the POS system.
[0105] In S1307, the store terminal 103 transmits the one-time code, store ID, payment amount, etc. acquired in S1306 to the payment server 102 via the POS system. In S1308, the payment server 102 performs payment processing based on the one-time code, store ID, payment amount, etc. acquired in S1307. Specifically, in S1308, the payment server 102 identifies the user ID from the one-time code acquired in S1307. Then, the payment server 102 performs processing to transfer electronic money equivalent to the payment amount from the user's account corresponding to the identified user ID to the store's account corresponding to the store ID.
[0106] (An example of the flow of information processing on a user terminal) Figure 14 is a flowchart showing an example of processing by the user terminal 101 in this embodiment. With reference to Figure 14, processing by the payment application 1000 of the user terminal 101 to display a decoration code image will be described. The processing shown in Figure 14 is realized by the CPU 901 of the user terminal 101 reading the program of the payment application 1000 stored in the storage device 904 into the RAM 903 and executing it. The processing shown in Figure 14 is started in response to, for example, the user pressing the pay button 252.
[0107] In S1401, the CPU 901 of the user terminal 101 requests a one-time code from the payment server 102 via the transmission unit 1002, and proceeds to S1402. In S1402, the CPU 901 of the user terminal 101 acquires the one-time code generated by the payment server 102 via the reception unit 1001, and proceeds to S1403.
[0108] In S1403, the CPU 901 of the user terminal 101 obtains a text prompt set by the user from the generation unit 1004. At this time, in S1403, the CPU 901 of the user terminal 101 obtains a negative text prompt, a guide scale value, and an intensity value in addition to the text prompt from the generation unit 1004, determines a random seed value, and proceeds to S1404. Hereinafter, the guide scale value, intensity value, and seed value will be collectively referred to as prompt parameters.
[0109] In S1404, the CPU 901 of the user terminal 101 generates a decoration code image using the image generation system 1005, and the process proceeds to S1405. Specifically, in S1404, the CPU 901 of the user terminal 101 generates a decoration code image using the image generation system 1005 based on the input one-time code, both text prompts, and prompt parameters.
[0110] The image generation system 1005 in the present disclosure will be described by taking as an example that, for example, when the one-time code, both text prompts, and prompt parameters are all the same, it generates two-dimensional code images with the same design. In other words, when the value of at least one of the one-time code, both text prompts, and prompt parameters is different, the image generation system 1005 generates two-dimensional code images with different designs.
[0111] For example, consider a case where the image generation system 1005 generates a first decoration code image and a second decoration code image. In this case, if the one-time codes are different between the first setting information corresponding to the first decoration code image and the second setting information corresponding to the second decoration code image, and if the values of at least one of the text prompts and prompt parameters are different, the image generation system 1005 generates the first decoration code image and a second decoration code image having a design different from that of the first decoration code image. Specifically, the image generation system 1005 generates the first decoration code image, which is a two-dimensional code image having a first code pattern and to which a first decoration is applied, and the second decoration code image, which is a two-dimensional code image having a second code pattern that is a code pattern different from the first code pattern and to which a second decoration that is a decoration different from the first decoration is applied.
[0112] In this embodiment, the one-time code is generated by the payment server 102, and the value of the one-time code is different for each request from the user terminal 101. The negative text prompt, guide scale value, and intensity value are set in advance, but a random value is used for the seed value. As described above, the seed value is different each time a decorative code image is generated. In other words, the design of each generated decorative code image can be made different, providing the user with a more fresh experience. Furthermore, since an expiration date is set for the one-time code, it is highly compatible with updating the decorative code image.
[0113] In S1405, the CPU 901 of the user terminal 101 causes the display control unit 1003 to display the decoration code image generated by the image generation system 1005 in S1404, and the process proceeds to S1406.
[0114] In S1406, the CPU 901 of the user terminal 101 determines whether or not the update button 313 has been pressed by the display control unit 1003. If the CPU 901 of the user terminal 101 determines in S1406 that the update button 313 has been pressed (Yes) by the display control unit 1003, the process returns to S1403. In other words, if the determination in S1406 is Yes, the CPU 901 of the user terminal 101 causes the image generation system 1005 to again perform processing to generate a decoration code image using the one-time code acquired in S1402.
[0115] Here, as shown in FIG. 3, assume a case where the update button 313 is pressed when a decoration code image is already displayed in the code image display area 310. In this case, the design of the second decoration code image, which is the newly displayed decoration code image, is different from the design of the first decoration code image, which is the previously displayed decoration code image, in that the code pattern and decoration applied to the two-dimensional code image are different. If the decoration and code pattern applied to the two-dimensional code image are different, the readability of the two-dimensional code image will also differ. In this way, by pressing the update button 313, the user can display a second decoration code image in the code image display area 310 that is more readable than the first decoration code image already displayed.
[0116] If the expiration date of the one-time code acquired in S1402 has passed and if the result of S1406 is "Yes", the CPU 901 of the user terminal 101 returns to S1401. That is, the CPU 901 of the user terminal 101 makes a new request for a one-time code to the payment server 102 via the transmission unit 1002. Note that if the result of S1406 is "Yes", the CPU 901 of the user terminal 101 may return to S1401 and make a request for a one-time code to the payment server 102 via the transmission unit 1002 without waiting for the expiration date of the one-time code to pass.
[0117] If the CPU 901 of the user terminal 101 determines in S1406 by the display control unit 1003 that the update button 313 has not been pressed (No), the process proceeds to S1407. In S1407, the CPU 901 of the user terminal 101 determines by the display control unit 1003 whether or not the back button 340 has been pressed. If the CPU 901 of the user terminal 101 determines in S1407 by the display control unit 1003 that the back button 340 has been pressed (Yes), the process ends. If the CPU 901 of the user terminal 101 determines in S1407 by the display control unit 1003 that the back button 340 has not been pressed (No), the process returns to S1406.
[0118] According to this embodiment, it is possible to meet the needs of users who want to decorate two-dimensional code images for payment, thereby increasing the interest of users who use terminal devices.
[0119] <<Second embodiment>> In the first embodiment, an example was described in which the image generation system 1005 included in the payment application 1000 executed by the user terminal 101 generates a decoration code image. In this embodiment, an example will be described in which the payment server 102 generates a decoration code image. This allows a decoration code image to be quickly generated and displayed when using a user terminal with low information processing capabilities.
[0120] The basic configurations of the user terminal 101, payment server 102, and store terminal 103 in this embodiment are the same as those of the devices in the first embodiment, so detailed explanations of the basic configurations will be omitted. Below, differences from the first embodiment will be explained.
[0121] (Processing performed by each device) Fig. 15 is a diagram showing an example of the system configuration and the processing content of each device in this embodiment. With reference to Fig. 15, a flow of the payment service from when a decoration code image generated by the payment server 102 is displayed on the user terminal 101 to when payment processing is performed by the payment server 102 will be described.
[0122] In S1501, the user terminal 101 requests a decoration code image from the payment server 102. At this time, the user terminal 101 includes a text prompt set by the user in the request. In this embodiment, an example will be described in which the pre-set negative text prompt, guide scale value, and intensity value are stored in the payment server 102. In addition, the payment server 102 determines a random seed value and uses it to generate a decoration code image.
[0123] In S1502, the payment server 102 performs processing to generate a decoration code image in response to the request in S1501. For example, in S1502, when the payment server 102 receives the request in S1501, it generates a one-time code. Then, the payment server 102 associates the generated one-time code with the user ID corresponding to the user who made the request in S1501 and temporarily stores it. The payment server 102 generates a decoration code image based on the generated one-time code and the text prompt included in the request in S1501. Also, similar to the first embodiment, a negative text prompt, a guide scale value, an intensity value, and a seed value are used when generating the decoration code image.
[0124] In S1503, the payment server 102 transmits the decoration code image generated in S1502 to the user terminal 101 that made the request in S1501. In S1504, the user terminal 101 displays the decoration code image received in S1503 on the payment application 1000. Note that the processes shown in S1505 to S1507 are the same as the processes in S6 to S8 shown in Figure 1, and therefore their description will be omitted.
[0125] (Example of payment server functional configuration) FIG. 16 is a diagram showing an example of the functional configuration of the payment server 102 in this embodiment. The basic configuration of the payment server in this embodiment shown in FIG. 16 is similar to the configuration of the payment server in the first embodiment shown in FIG. 11, but differs in that it includes an image generation system 1600. The image generation system 1600 in this embodiment has the same functions as the image generation system 1005 in the first embodiment. The generation unit 1113 in this embodiment performs a process of generating a decoration code image using the image generation system 1600, in addition to a process of generating a one-time code. Note that this embodiment will be described taking as an example a case where the payment application of the user terminal 101 does not have the image generation system 1005.
[0126] (An example of the information processing flow of this system) 17 is a sequence diagram showing an example of the flow of information processing among the user terminal 101, the payment server 102, and the store terminal 103. The flow of information processing in this embodiment will be described with reference to FIG.
[0127] In S1701, the user terminal 101 requests a decoration code image from the payment server 102. As described above, the request in S1701 includes a text prompt set by the user. As in the first embodiment, the request for the decoration code image is made when the user terminal 101 detects a user operation on the pay button 252 on the home screen 200. Note that in this embodiment, the user terminal 101 can also make a request for a decoration code image to the payment server 102 when a condition is satisfied, such as a pressing operation of the update button 313, not limited to a pressing operation of the pay button 252.
[0128] In S1702, the payment server 102 performs processing to generate a decoration code image in response to the request in S1701. The specific method for generating a decoration code image is the same as that described in the first embodiment, and therefore will not be described here. In this way, since the decoration code image is generated by the payment server, the processing load on the user terminal can be reduced.
[0129] In S1703, the payment server 102 transmits the decoration code image generated in S1702 to the user terminal 101 that made the request in S1701. In S1704, the user terminal 101 displays the decoration code image received in S1703 on the payment application 1000. Note that the processing from S1705 to S1707 shown in FIG. 17 is the same as the processing from S1306 to S1308 shown in FIG. 13, and therefore description thereof will be omitted.
[0130] (An example of the flow of information processing between the user terminal and the payment server) Fig. 18(a) is a flowchart showing an example of processing by the user terminal 101 in this embodiment. Fig. 18(b) is a flowchart showing an example of processing by the payment server 102 in this embodiment. The processing executed by the payment application 1000 of the user terminal 101 and the payment server 102 will be described with reference to Fig. 18.
[0131] The process shown in Figure 18(a) is realized by the CPU 901 of the user terminal 101 reading the program of the payment application 1000 stored in the storage device 904 into the RAM 903 and executing it. The process shown in Figure 18(a) is started in response to, for example, the user pressing the pay button 252.
[0132] In S1801, the CPU 901 of the user terminal 101 requests a decoration code image from the payment server 102 via the transmission unit 1002, and proceeds to S1802. At this time, the CPU 901 of the user terminal 101 includes the text prompt set on the two-dimensional code image setting screen 410 of the payment application 1000 in the request for the decoration code image.
[0133] In S1802, the CPU 901 of the user terminal 101 receives, via the receiving unit 1001, the decoration code image generated by the payment server 102 in response to the request in S1801, and the process proceeds to S1803.
[0134] In S1803, the CPU 901 of the user terminal 101 causes the display control unit 1003 to display the decoration code image received in S1802 on the payment application 1000, and the process proceeds to S1804.
[0135] In S1804, the CPU 901 of the user terminal 101 determines whether the update button 313 has been pressed. If the CPU 901 of the user terminal 101 determines in S1804 that the update button 313 has been pressed (Yes), the process returns to S1801. That is, if the determination is Yes in S1804, the CPU 901 of the user terminal 101 again requests a decoration code image from the payment server 102. If the CPU 901 of the user terminal 101 determines in S1804 that the update button 313 has not been pressed (No), the process proceeds to S1805.
[0136] In S1805, the CPU 901 of the user terminal 101 determines whether or not the back button 340 has been pressed. If the CPU 901 of the user terminal 101 determines in S1805 that the back button 340 has been pressed (Yes), the flow ends. If the CPU 901 of the user terminal 101 determines in S1805 that the back button 340 has not been pressed (No), the flow returns to S1804.
[0137] Next, Fig. 18(b) will be described. The process shown in Fig. 18(b) is realized by the CPU 901 of the payment server 102 reading out the program stored in the ROM 902 and the program of the image generation system 1600 stored in the storage device 904 into the RAM 903 and executing them. The process shown in Fig. 18(b) is started after the payment server 102 is started.
[0138] In S1811, the CPU 901 of the payment server 102 determines whether or not a request for a decoration code image has been received by the receiving unit 1111. If the CPU 901 of the payment server 102 determines in S1811 that a request for a decoration code image has been received by the receiving unit 1111 (Yes), the process proceeds to S1812. If the CPU 901 of the payment server 102 determines in S1811 that a request for a decoration code image has not been received by the receiving unit 1111 (No), the process waits until a request for a decoration code image is received.
[0139] In S1812, the CPU 901 of the payment server 102 generates a one-time code in response to the request for the decoration code image in S1811 using the generation unit 1113, and proceeds to S1813. In S1812, the CPU 901 of the payment server 102 temporarily stores the generated one-time code in association with the user ID of the user who made the request in S1811, as shown in Fig. 12(a).
[0140] In S1813, the CPU 901 of the payment server 102 uses the generation unit 1113 to obtain a text prompt from the request received in S1811, and proceeds to S1814. That is, in S1813, the CPU 901 of the payment server 102 uses the generation unit 1113 to obtain the text prompt set on the two-dimensional code image setting screen 410 of the payment application 1000.
[0141] In S1814, the CPU 901 of the payment server 102 generates a decoration code image using the image generation system 1600 with the generation unit 1113, and proceeds to S1815. At this time, the CPU 901 of the payment server 102 determines a random seed value with the generation unit 1113. Then, when a one-time code and a text prompt, etc. are input, the image generation system 1600 generates and outputs a two-dimensional code image in which a code pattern obtained by encoding the one-time code is decorated with elements indicated by the text prompt.
[0142] In S1815, the CPU 901 of the payment server 102 causes the transmission unit 1112 to transmit the decoration code image generated in S1814 to the user terminal 101 that made the request in S1811, and ends this flow.
[0143] According to this embodiment, it is possible to reduce the processing load on the user terminal 101 while obtaining the same effects as those of the first embodiment.
[0144] <<Other embodiments>> In the second embodiment, an example was described in which the user terminal 101 requests a decoration code image from the payment server 102, and the payment server 102 generates a decoration code image based on a text prompt included in the request. The payment server 102 may store text prompts, etc., preset for each user, and generate a decoration code image based on the stored text prompts. For example, in S1801 of this embodiment, the CPU 901 of the user terminal 101 requests a one-time code from the payment server 102. In this embodiment, the CPU 901 of the payment server 102 acquires setting information, including both text prompts, a guide scale value, and an intensity value, associated with the user who requested the one-time code in S1814, without performing the process of S1813. Then, the CPU 901 of the payment server 102 in this embodiment may generate a decoration code image based on the acquired setting information and one-time code.
[0145] Alternatively, as a variation of this, when the payment server 102 receives a request for a one-time code from the user terminal 101, the payment server 102 may switch the content to be sent to the user terminal 101 depending on whether or not it holds a text prompt or the like that is preset for each user. Specifically, when the CPU 901 of the payment server 102 in this embodiment determines that it holds setting information linked to the user who has requested the one-time code, it sends a decoration code image generated based on the setting information and the one-time code to the user terminal 101 that has made the request in S1815. When the CPU 901 of the payment server 102 in this embodiment determines that it does not hold setting information linked to the user who has requested the one-time code, it sends the generated one-time code to the user terminal 101 that has made the request in S1815.
[0146] In the above embodiment, an example has been described in which the user terminal 101 or the payment server 102 has an image generation system, but an external device other than these devices may have the image generation system. That is, an external device other than the user terminal 101 and the payment server 102 may generate a decoration code image using the image generation system.
[0147] In the above embodiment, the image generation system generates a decorated code image based on a one-time code and a text prompt, but the method for generating a decorated code image is not limited to this. For example, the image generation system generates a two-dimensional code image that encodes a one-time code. The image generation system may then generate a decorated code image by applying a decoration indicated by the acquired text prompt to the generated two-dimensional code image.
[0148] In the above embodiment, the user determines the text prompt. However, the user may also determine the negative text prompt, the guide scale value, the intensity value, and the seed value in addition to the text prompt.
[0149] Fig. 19 is a diagram showing an example of a two-dimensional code image setting screen in this embodiment. The two-dimensional code image setting screen 1900 shown in Fig. 19 differs from the two-dimensional code image setting screen 410 shown in Fig. 4(b) in that it includes a negative text prompt input area 1901, a guide scale value setting control 1902, an intensity value setting control 1903, and a seed value setting control 1904.
[0150] A negative text prompt can be input in a negative text prompt input area 1901. A guide scale value, an intensity value, and a seed value can be input in a guide scale value setting control 1902, an intensity value setting control 1903, and a seed value setting control 1904, respectively.
[0151] This allows users to set both text prompts and prompt parameters themselves, providing greater freedom in setting the decoration of 2D code images for payment.
[0152] Alternatively, the payment application 1000 of the user terminal 101 or the payment server 102 may automatically determine both the text prompt and the prompt parameters in response to the user's selection.
[0153] For example, the user first selects a decorative element, i.e., whether to emphasize the design of the two-dimensional code image or to increase the readability of the code pattern of the two-dimensional code image. Then, the payment application 1000 or the payment server 102 determines both the text prompt and the prompt parameters according to the user's selection. Such a determination can be realized by using a language model (hereinafter referred to as a large-scale language model) constructed using a large amount of data and deep learning technology.
[0154] In this embodiment, the large-scale language model is stored in a dedicated server (not shown) separate from the payment server. The large-scale language model may also be stored in the payment server. When the dedicated server receives a request to use the functions of the large-scale language model, it can input the prompt indicated by the request into the large-scale language model and transmit the output result to the requestor. The following description shows an example in which the payment application 1000 of the user terminal 101 automatically determines both text prompts and prompt parameters in response to the user's selection.
[0155] 4(b), the two-dimensional code image setting screen 1900 differs in that it is provided with a check box 1905 for emphasizing the design and a check box 1906 for increasing the readability of the code pattern of the two-dimensional code image. The two-dimensional code image setting screen 1900 shows a state in which the check box 1906 is checked.
[0156] A check box 1906 is a box for receiving instructions to change both the text prompt and the prompt parameters so as to increase the readability of the code pattern of the two-dimensional code image.
[0157] Here, assume that "dog" has been entered in the text prompt input field 411, and "ugly, disfigured, low quality" has been entered in the negative text prompt input field 1901. The prompt parameters are as shown in FIG. 19. In this case, when the checkbox 1906 is checked and the OK button 412 is pressed, the payment application 1000 makes a request to the dedicated server to adjust both text prompts and the prompt parameters. At this time, the payment application 1000 includes in the request to the dedicated server both text prompts and prompt parameters set by the user, as well as a character string indicating an instruction to improve the readability of the code pattern of the two-dimensional code image.
[0158] When the dedicated server receives a request from the payment application 1000, it inputs, for example, the following prompt into the large-scale language model:
[0159] "Output prompts and parameters that will improve the readability of the code pattern in the 2D code image. Also, output prompts separately into text prompts and negative text prompts. Output parameters separately into guide scale values, intensity values, and seed values."
[0160] When such a prompt is input to a large-scale language model, the following output results are obtained, for example:
[0161] Text prompt: dog, high contrast, high-detailed 2D code Negative text prompts: ugly, disfigured, low quality, blurry Guide scale value: 7.0 Strength value: 0.1 Seed value: 123456789".
[0162] The output shows that the text prompt has been added as "high contrast, high-detailed 2D code", the negative text prompt has been added as "blurry", and the intensity value has been changed from 0.2 to 0.1.
[0163] The dedicated server then transmits the output result output from the large-scale language model to the requesting user terminal 101. When the user terminal 101 receives the output result, the payment application 1000 reflects and displays the output result on the two-dimensional code image setting screen 1900 in FIG.
[0164] In the above case, it is assumed that check box 1905 is checked. Check box 1905 is a box that accepts an instruction to emphasize the decoration applied to the two-dimensional code image. In this case, when OK button 412 is pressed, payment application 1000 makes a request to the dedicated server to adjust both the text prompt and the prompt parameters.
[0165] When the dedicated server receives a request from the payment application 1000, it inputs, for example, the following prompt into the large-scale language model:
[0166] "Output prompts and parameters that emphasize the design of the 2D code image. Also, output prompts separately into text prompts and negative text prompts. Output parameters separately into guide scale values, intensity values, and seed values." When such a prompt is input to a large-scale language model, the following output results are obtained, for example:
[0167] Text prompt: a big dog, impressive design, three-dimensional face Negative text prompts: ugly, disfigured, low quality Guide scale value: 9.0 Strength value: 0.4 Seed value: 123456789".
[0168] The output shows that the text prompt has changed from "dog" to "a big dog, impressive design, three-dimensional face", the guide scale value has changed from 7.0 to 9.0, and the strength value has changed from 0.2 to 0.4.
[0169] The dedicated server transmits the output result output from the large-scale language model to the requesting user terminal 101. Then, similar to the process described above, the payment application 1000 reflects and displays the output result on the two-dimensional code image setting screen 1900 in FIG.
[0170] In this manner, the payment application 1000 of the user terminal 101 can use a large-scale language model to determine both the text prompt and the prompt parameters in response to the user's selection. In a similar manner, the payment server 102 can use a large-scale language model to determine both the text prompt and the prompt parameters in response to the user's selection.
[0171] Furthermore, the method for determining both the text prompt and the prompt parameters is not limited to this. For example, the payment application 1000 of the user terminal 101 or the payment server 102 may determine the prompt parameters based on a table linking a text prompt selected by the user and set in advance with pre-adjusted prompt parameters. For example, the user can select a pre-set prompt from the two-dimensional code image setting screen 2000 shown in FIG. 20.
[0172] Fig. 20 is a diagram showing an example of a two-dimensional code image setting screen in this embodiment. A two-dimensional code image setting screen 2000 shown in Fig. 20 has a selection tab 2001 at the right end of the text prompt input area. When the selection tab 2001 is pressed by the user, a list 2010 of decorative elements is displayed in a pull-down menu, as shown in Fig. 20. Fig. 20 shows a state in which "dog," "cat," "robot," and "mountain" are displayed as decorative elements.
[0173] When the user selects "dog" 2011, a list of sub-elements 2020 indicating elements that describe "dog" 2011 is displayed in a pull-down menu, as shown in FIG. 20. FIG. 20 shows a state in which "angry" and "smiling" are displayed as sub-elements. In this case, when the user selects "sitting" 2021 as a sub-element, "sitting dog" is set in the text prompt input area, as shown in FIG. 20. Values corresponding to "sitting dog" are set in the negative text prompt input area, the guide scale value setting control, the strength value setting control, and the seed value setting control.
[0174] FIG. 21 is a diagram showing an example of preset text prompts and prompt parameters. In table 2100, a text prompt 2101, a negative text prompt 2102, a guide scale value 2103, an intensity value 2104, and a seed value 2105 are linked. The negative text prompt and prompt parameters shown in FIG. 21 are information that is adjusted and set in advance to emphasize the decorative element indicated by the corresponding text prompt and to ensure the readability of the decorative code image generated based on the text prompt and the prompt parameters. The user terminal 101 or the payment server 102 can realize the processing described in FIG. 20 by storing table 2100. Note that if a user sets a setting that does not exist in table 2100, the setting information for the text prompt and prompt parameters set by the user may be added to table 2100.
[0175] Furthermore, a program for tuning a trained AI model (for example, LoRA (Low-Rank Adaptation)) may be applied to the image generation system of the present disclosure.
[0176] The configuration of the information processing device 900 described above can be flexibly changed, for example, by calling an external platform or the like via API or network computing depending on the function.
[0177] Furthermore, the above-described embodiments can be combined as appropriate within the scope of not causing any contradiction in the processing content. [Explanation of symbols]
[0178] 101: User terminal 102: Payment server 1000: Payment application
Claims
1. A system including a payment server that provides a payment service, and a terminal device that is communicably connected to the payment server and that executes an application used to provide the payment service, a first acquisition unit that acquires a one-time code generated by the payment server in response to a request from the application; a second acquisition unit that acquires a prompt that instructs decoration of the two-dimensional code image used in the payment service; a generation control unit that controls generation of a decorated code image, which is a two-dimensional code image in which the one-time code is encoded and is a two-dimensional code image to which the decoration indicated by the prompt is applied; The system is characterized in that the terminal device has a display control unit that controls displaying the decoration code image on the application.
2. the terminal device includes the first acquisition unit, the second acquisition unit, and the generation control unit; The first acquisition unit acquires the one-time code from the payment server, the second acquisition unit acquires the prompt set by the user in the application; The system according to claim 1 , wherein the generation control unit performs the control based on the one-time code acquired by the first acquisition unit and the prompt acquired by the second acquisition unit.
3. the payment server includes the first acquisition unit, the second acquisition unit, and the generation control unit, the request includes the prompt; The first acquisition unit acquires the generated one-time code, the second acquisition unit acquires the prompt from the request; The system according to claim 1 , wherein the generation control unit performs the control based on the one-time code acquired by the first acquisition unit and the prompt acquired by the second acquisition unit.
4. the payment server includes the first acquisition unit, the second acquisition unit, and the generation control unit, and stores the prompt; The first acquisition unit acquires the generated one-time code, The second acquisition unit acquires the retained prompt, The system according to claim 1 , wherein the generation control unit performs the control based on the one-time code acquired by the first acquisition unit and the prompt acquired by the second acquisition unit.
5. The generation control unit Further, a control is performed to randomly determine a seed value, which is a parameter for determining the configuration of the decoration; The system of any one of claims 2 to 4, further comprising: generating the decorated code image with decoration based on the seed value and the prompt.
6. The system described in claim 5, characterized in that when a predetermined condition is met, the display control unit controls the display of the first decorative code image, which is the decorative code image being displayed, to be updated to a second decorative code image, which is the decorative code image different from the first decorative code image.
7. The code pattern of the two-dimensional code image corresponding to the second decorative code image is different from the code pattern of the two-dimensional code image corresponding to the first decorative code image, 7. The system of claim 6, wherein the decoration of the second decoration code image is different from the decoration of the first decoration code image.
8. The one-time code has an expiration date, 7. The system of claim 6, wherein the predetermined condition is that the expiration date of the one-time code has passed.
9. an item for accepting updating of the first decoration code image to the second decoration code image is provided on the screen of the application; 7. The system of claim 6, wherein the predetermined condition is that the item has been manipulated.
10. The system according to claim 1, wherein the decoration includes at least one of changing the shape of the outline of a portion of the code pattern of the two-dimensional code image, changing the color of the portion, and changing the brightness of the portion.
11. The system described in claim 1, characterized in that the second acquisition unit acquires the prompt as an output result output from a large-scale language model in accordance with an instruction to emphasize the decoration or increase the readability of the code pattern of the two-dimensional code image.
12. A program of an application used to provide a payment service, executed on a terminal device communicably connected to a payment server that provides the payment service, the program comprising: a first acquisition unit that acquires a one-time code generated by the payment server in response to a request from the application; a second acquisition unit that acquires a prompt that instructs decoration of the two-dimensional code image used in the payment service; a generation control unit that controls generation of a decorated code image, which is a two-dimensional code image in which the one-time code is encoded and is decorated with the decoration indicated by the prompt; a display control unit that controls displaying the decoration code image on the application; A program characterized by functioning as
13. The program described in claim 12, characterized in that the generation control unit controls a generation unit configured to generate the decorative code image, which is a function of the application, to generate the decorative code image.
14. The program according to claim 12, characterized in that the generation control unit controls a generation unit provided in the payment server and configured to generate the decorative code image to generate the decorative code image.
15. A payment server communicably connected to a terminal device that executes an application used to provide a payment service, a first acquisition unit that acquires a one-time code generated in response to a request from the application; a second acquisition unit that acquires a prompt that instructs decoration of the two-dimensional code image used in the payment service; a generation control unit that controls generation of a decorated code image, which is a two-dimensional code image in which the one-time code is encoded and is decorated with the decoration indicated by the prompt; a transmission unit that transmits the decoration code image to be displayed on the application to the terminal device; A payment server comprising:
16. A method for controlling a terminal device that is communicably connected to a payment server that provides a payment service and that executes an application used to provide the payment service, comprising: a first acquisition step of acquiring a one-time code generated by the payment server in response to a request from the application; a second acquisition step of acquiring a prompt instructing decoration of the two-dimensional code image used in the payment service; a generation control step of controlling generation of a decorated code image, which is a two-dimensional code image in which the one-time code is encoded and which is a two-dimensional code image to which the decoration indicated by the prompt has been applied; a display control step of controlling the display of the decoration code image on the application; A control method comprising:
17. A method for controlling a payment server communicably connected to a terminal device that executes an application used to provide a payment service, comprising: a first acquisition step of acquiring a one-time code generated in response to a request from the application; a second acquisition step of acquiring a prompt instructing decoration of the two-dimensional code image used in the payment service; a generation control step of controlling generation of a decorated code image, which is a two-dimensional code image in which the one-time code is encoded and which is a two-dimensional code image to which the decoration indicated by the prompt has been applied; a transmission step of transmitting the decoration code image to be displayed on the application to the terminal device; A control method comprising:
Citation Information
Patent Citations
Two-dimensional bar code
JP2006302050A
Two-dimensional code processing method and device
JP2019500670A
First settlement server, second settlement server, settlement system, and application program
JP2024140587A
JP170442A