System, program, payment server, terminal device control method, payment server control method, and printed matter
The system generates and displays decorated two-dimensional code images using a payment server and terminal device, addressing the need for enhanced interest in payment processes by ensuring readability and aesthetic appeal through decorative elements.
Patent Information
- Application Number
- JP2025042799
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2025-03-17
- Publication Date
- 2025-09-24
- Estimated Expiration
- 2045-03-17
AI Technical Summary
There is a need to enhance the interest of store clerks and users in payment processes using code images, particularly in decorating two-dimensional code images to improve readability and aesthetic appeal while maintaining functionality.
A system and method that utilizes a payment server and terminal device to generate and display decorated two-dimensional code images based on user input and store information, incorporating decorative elements using an image generation system like stable diffusion, ensuring readability and aesthetic appeal.
Increases the interest of store clerks and users in payment processes by providing visually appealing and readable decorated code images, enhancing the overall payment experience.
Smart Images

Figure 0007743657000001_ABST
Abstract
Description
[Technical Field]
[0001] The present disclosure relates to a system, a program, a payment server, a control method for a terminal device, a control method for a payment server, and a printed matter. [Background technology]
[0002] In recent years, techniques for decorating images have become known from the viewpoint of interest. Patent Document 1 discloses a method for decorating the periphery of a one-dimensional code image by displaying an image with a design selected by a user around the one-dimensional code image. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2020-170442 A Summary of the Invention [Problem to be solved by the invention]
[0004] There is a need for a method to improve the interest of store clerks and users in payment using code images. [Means for solving the problem]
[0005] A system according to one aspect of the present disclosure is a system including a payment server that provides payment services and a terminal device that is communicatively connected to the payment server and used by a store clerk, wherein the payment server has a first acquisition unit that acquires setting information, which is information included in a request for a 2D code image from the terminal device and indicates decoration for the 2D code image, a second acquisition unit that acquires identification information for identifying the store, and a generation unit that generates a decoration code image, which is the 2D code image encoded with the identification information and is the 2D code image decorated with the decoration indicated by the setting information, and the terminal device has a display control unit that controls the display of the decoration code image sent from the payment server in response to the request for the 2D code image on a display unit. [Effects of the Invention]
[0006] According to the present disclosure, it is possible to increase the interest of store staff and users in making payments using code images. [Brief explanation of the drawings]
[0007] [Figure 1] FIG. 2 is a diagram illustrating an example of a system configuration and processing details of each device. [Figure 2] FIG. 10 is a diagram illustrating an example of a home screen of a management screen. [Figure 3] FIG. 10 is a diagram illustrating an example of a setting item display screen. [Figure 4] FIG. 10 is a diagram showing an example of a two-dimensional code image setting screen. [Figure 5] FIG. 10 is a diagram showing an example of a display screen of a two-dimensional code image. [Figure 6] 10 is a diagram showing an example of a decoration code image and two-dimensional code image setting information corresponding to the decoration code image. FIG. [Figure 7] 10A and 10B are diagrams illustrating examples of decoration of a decoration code image. [Figure 8] 10A and 10B are diagrams illustrating examples of decoration of a decoration code image. [Figure 9] FIG. 1 illustrates an example of a system configuration. [Figure 10] FIG. 2 is a block diagram illustrating an example of a hardware configuration of an information processing device. [Figure 11] FIG. 2 is a diagram illustrating an example of a software configuration of a store terminal. [Figure 12] FIG. 2 is a diagram illustrating an example of a functional configuration of a payment server. [Figure 13] 10A and 10B are diagrams illustrating an example of information stored in a user DB and a store DB, respectively. [Figure 14] FIG. 10 is a sequence diagram showing an example of the flow of information processing among a store terminal, a payment server, and a user terminal. [Figure 15] 10 is a flowchart illustrating an example of processing of a store terminal. [Figure 16] 10 is a flowchart illustrating an example of processing by a payment server. [Figure 17] FIG. 10 is a diagram showing an example of a two-dimensional code image setting screen. [Figure 18] FIG. 10 is a diagram showing an example of a two-dimensional code image setting screen. [Figure 19] FIG. 10 illustrates an example of a pre-set text prompt. DETAILED DESCRIPTION OF THE INVENTION
[0008] Preferred embodiments of the system, program, payment server, terminal device control method, payment server control method, and printed matter according to the present disclosure will be described in detail below with reference to the drawings. Note that the system, program, payment server, terminal device control method, payment server control method, and printed matter according to the present disclosure are not limited to the following embodiments. Furthermore, the same components in the following embodiments will be assigned the same reference numerals, and duplicated descriptions will be omitted.
[0009] In recent years, payment using code images has become widespread due to its high convenience. For example, payment can be made by scanning a code image displayed on a terminal device with a store terminal, or by scanning a code image placed in a store with a user terminal. Types of code images used for payment include one-dimensional code images and two-dimensional code images. In addition, from the viewpoint of entertainment value, techniques for decorating such code images are known.
[0010] For example, a method is known in which an image of a design selected by a user is displayed around a one-dimensional code image to decorate the periphery of the one-dimensional code image. However, decorating the code image itself can be difficult in terms of readability of the code image, making it difficult to meet the needs of store clerks who want to decorate the code image during payment via the user scanning procedure described below. For two-dimensional code images such as QR (Quick Response) Code (registered trademark), readability can be ensured even if defects such as distortion or damage occur in the code image, so it is expected that decorating the code image will not be difficult.
[0011] There is a known technology for generating images not by hand but by image generation AI. For example, there is a trained AI model (e.g., a Diffusion Model) that can input text and output an image containing the elements indicated by the input text. Specifically, when the text "cat" and "girl" are input, the trained AI model can generate and output an image depicting a girl holding a cat. This system, which outputs a user's desired image by inputting text into a trained AI model, is called stable diffusion.
[0012] The present disclosure applies stable diffusion to a two-dimensional code image used for in-store payments, decorating the code image, thereby meeting the needs of store clerks who want to decorate two-dimensional code images for payments. It also provides users with the enjoyment of viewing the decorated two-dimensional code image when making payments. This increases the interest of store clerks and users in payments using code images.
[0013] <<First embodiment>> 1 is a diagram showing an example of the system configuration and the processing contents of each device in this embodiment. The system 100 has a store terminal 101, a payment server 102, and a user terminal 103.
[0014] (About store terminals) The store terminal 101 is a terminal device used by a store clerk. In this embodiment, the store terminal 101 is described as a portable tablet terminal. The store terminal 101 may be a notebook PC, a desktop PC, an information processing device equipped in a store and having a scanning function, or a smartphone.
[0015] The store terminal 101 has a management application. The management application can provide a management screen. The management screen is a screen on which transaction amounts at the store and the like can be viewed. The management screen may be provided by the payment server 102, or may be provided by an external server different from the payment server 102 (for example, a server that operates in cooperation with the payment server 102). The store terminal 101 may display the management screen using a general web browser. In the present disclosure, an example will be described in which the store terminal 101 displays the management screen using a management application.
[0016] Fig. 2 is a diagram showing an example of a home screen of the management screen. The home screen 200 shown in Fig. 2 has a menu display area 210, a store display area 220, a transaction amount display area 230, and a cumulative transaction amount display area 240. The home screen 200 also has a receive button 250 that switches the screen to a display screen displaying a two-dimensional code image. Note that an operator (e.g., a button or a check box) that is displayed on the display unit of the store terminal 101 and that accepts a predetermined instruction may be referred to as an item.
[0017] The menu display area 210 is provided with a home bar 211, a profile bar 212, a settings bar 213, and the like. When the home bar 211 is pressed, the screen switches to the home screen 200. When the profile bar 212 is pressed, the screen switches to a profile screen (not shown) on which information about affiliated stores and information about the store can be set. Information about the store includes, for example, information about the store's genre, the store's address, the types of payment methods available at the store, and the details of the contract between the store and the service provider. When the settings bar 213 is pressed, the screen switches to a settings item display screen, which will be described later.
[0018] The store display area 220 displays the name of the affiliated store and the names of the stores that belong to that affiliated store. The store display area 220 also has a selection tab 221 that allows a store to be selected. When the selection tab 221 is pressed, a list of store names, such as the XX Station Store or the △XX Town Store, is displayed in a pull-down menu. When a store clerk selects the store that he or she belongs to from the displayed store names, the home screen 200 switches to a screen linked to the selected store.
[0019] The transaction amount display area 230 displays the transaction amount for today for the store displayed in the store display area 220. The transaction amount display area 230 may also display the transaction amount for each transaction. The cumulative transaction amount display area 240 displays the cumulative transaction amount for the store displayed in the store display area 220. The cumulative transaction amount display area 240 may also display the cumulative transaction amount for each day, month, or year.
[0020] When a store clerk wants to change information about the store, he or she presses the setting bar 213. Pressing the setting bar 213 switches the home screen 200 to a setting item display screen as shown in FIG. 3. FIG. 3 is a diagram showing an example of the setting item display screen that displays setting items for configurable information among the information about the store. The setting item display screen 300 shown in FIG. 3 has a shortcut item display area 310, a brand profile setting item 320, a store profile setting item 330, and a two-dimensional code image setting item 340.
[0021] "Change email address," "Change bank account," etc. are displayed in shortcut item display area 310. For example, when "Change email address" is pressed, the screen switches to a screen (not shown) where the email address set in "My profile" can be changed without having to press "My profile," which is one of the setting items displayed on setting item display screen 300.
[0022] When the brand profile setting item 320 is pressed, the screen can be switched to a screen (not shown) on which information about the affiliated store (for example, a brand such as XX Coffee or △X Department Store) can be set. When the store profile setting item 330 is pressed, the screen can be switched to a screen (not shown) on which information about the store displayed in the store display area 220 can be set. When the 2D code image setting item 340 is pressed, the screen can be switched to a 2D code image setting screen on which information used to generate a 2D code image used for payment can be set, as shown in FIG. 4, for example.
[0023] 4 is a diagram showing an example of a two-dimensional code image setting screen on which information used to generate a decorated two-dimensional code image (hereinafter referred to as a decorated code image) can be set. A two-dimensional code image setting screen 400 displays a store genre input area 401 and a season information input area 402. In these input areas, character strings indicating decorative elements of the two-dimensional code image can be input.
[0024] In the store genre input area 401, a character string indicating the store genre can be entered. The store genre refers to the type of products sold in the store, the type of services provided in the store, or the field of these products or services. For example, store genres include coffee, curry, flowers, clothes, bags, beauty, finance, and education. Note that the character strings shown here are merely examples, and it goes without saying that other character strings can be set as decorative elements. Decorative elements can be set in English and other languages, not just Japanese.
[0025] Furthermore, when a store clerk presses the reference button provided to the right of the store genre input area 401, the management application acquires the store genre from the store category information set on the screen to which the user can transition from the store profile setting item 330 shown in FIG. 3. The management application can then reflect the acquired store genre in the store genre input area 401. For example, if "cafe" is set as the store category information, pressing the reference button in the store genre input area 401 automatically inputs "cafe" into the store genre input area 401.
[0026] Character strings indicating the season can be input into the season information input area 402. Character strings related to the seasons, such as New Year's Day, Setsubun, Shichi-Go-San, Tanabata, moon viewing, autumn leaves, and athletic meets, can also be input into the season information input area 402 as information indicating the season, and are not limited to spring, summer, autumn, and winter. The character strings shown here are merely examples, and it goes without saying that other character strings can be set as decorative elements. Decorative elements can be set in English and other languages, not just Japanese.
[0027] Furthermore, when a store clerk presses the reference button provided to the right of the seasonal information input area 402, the management application acquires calendar information and seasonal information related to the acquired date and time. The management application can then reflect the acquired seasonal information in the seasonal information input area 402. For example, when the reference button in the seasonal information input area 402 is pressed on January 1, "New Year's" is automatically entered in the seasonal information input area 402. The calendar information and related seasonal information may be written in an internal program of the management application or saved in an external file of the management application. The calendar information and related seasonal information may also be stored in an external device (e.g., a server).
[0028] In this way, the store clerk can input any character string into each of the input areas, store category input area 401 and seasonal information input area 402. In addition, the store clerk can automatically input the character string corresponding to each input area by pressing the reference button in each of the store category input area 401 and seasonal information input area 402.
[0029] 4 are used as text prompts indicating decorative elements of the two-dimensional code image when generating a decorative code image. Hereinafter, the character strings entered in these input areas will be referred to as two-dimensional code image setting information.
[0030] The two-dimensional code image setting screen 400 is provided with an OK button 403 and a cancel button 404. The OK button 403 is a button that accepts that the contents set on the two-dimensional code image setting screen 400 are to be reflected. When the OK button 403 is pressed, the contents set on the two-dimensional code image setting screen 400 are stored in the RAM or storage device of the store terminal 101. The cancel button 404 is a button that accepts that the contents set on the two-dimensional code image setting screen 400 are not to be reflected.
[0031] Here, we will explain by taking an example that in order to generate a decorative code image by the image generation system described later, in addition to the two-dimensional code image setting information, which is a text prompt, a negative text prompt, a guide scale value, an intensity value, a seed value, etc. are used. These will be explained below.
[0032] A negative text prompt is a character string that indicates an element that you want to exclude from the decoration of a 2D code image. For example, elements that you want to exclude include "window," "crossed legs," and "daytime." In this way, a character string that indicates an object, a state, or a time period that you want to exclude can be applied as a negative text prompt.
[0033] Elements that may be desired to be excluded include "ugly," "low quality," and "blurry." In this way, character strings that indicate meanings that are unsuitable for the quality of the 2D code image to be generated can be applied as negative text prompts. The character strings shown here are just examples, and it goes without saying that other character strings can be applied as elements that may be desired to be excluded. When there is no need to distinguish between text prompts and negative text prompts, they will be collectively referred to as "both text prompts."
[0034] The guide scale value indicates the extent to which the image generation system follows both text prompts when generating a decorated code image. A higher guide scale value causes the decorated code image to be generated in accordance with both text prompts, whereas a lower guide scale value causes the decorated code image to be generated in accordance with neither text prompt.
[0035] The intensity value indicates the degree to which the image generation system complements elements different from those indicated by the text prompt when generating a decorative code image according to the guide scale value. In other words, the intensity value is a value for setting the weight of the elements indicated by the text prompt for the image generation system. The higher the intensity value, the more elements different from those indicated by the text prompt are incorporated into the generated decorative code image, and the lower the intensity value, the more elements the decorative code image is limited to those indicated by the text prompt.
[0036] The seed value is a value used to determine the decoration configuration of a decoration code image. For example, if the seed value is the same, a 2D code image with the same decoration configuration is generated.
[0037] Specifically, suppose that the text prompt is set to "Sitting Dog" and the seed value is set to "123456789," and a 2D code image incorporating a dog sitting on a chair as a decorative element is output. Then, when a decorative code image is output again with the same text prompt and the same seed value set, a 2D code image incorporating a dog sitting on a chair as a decorative element is output.
[0038] Let's consider a case where the same text prompt ("Sitting Dog") is set, but a different seed value ("123456788") is set. In this case, for example, a 2D code image is output that incorporates a dog in a "sitting" pose as a decorative element. Alternatively, a 2D code image is output that incorporates two dogs sitting on a chair as decorative elements. The "sitting" pose refers to a pose in which the front legs are stretched out in a direction intersecting the ground and rest on the ground, and the hind legs are bent and rest on the ground. In this way, different seed values result in the output of 2D code images with decorative elements that differ in pose and configuration.
[0039] In this embodiment, the negative text prompt, the guide scale value, and the intensity value are preset values, and the seed value is a randomly determined value.
[0040] In addition to the negative text prompt, guide scale value, intensity value, and seed value, other values necessary for generating a decorative code image may be used in the present disclosure. The negative text prompt, guide scale value, intensity value, and seed value may be fixed values or may be set for each text prompt. These values may be written in the internal program of the management application, saved in an external file of the management application, or stored in the payment server 102.
[0041] (About the payment server) The payment server 102 can provide the above-mentioned management screen to stores of affiliated stores that have entered into a contract (for example, an affiliated store contract) with a service provider that provides a payment service (payment server 102), and can also provide payment services to users who use the user terminal 103. The payment service is a service that performs payment processing to transfer electronic money equivalent to the payment amount from the account of the user making the payment to the account of the store. The payment service also includes a remittance service that performs remittance processing to transfer electronic money from a first account held by a first user who is a remitter to a second account held by a second user who is a recipient.
[0042] The payment server 102 also has an image generation system that generates a two-dimensional code image based on store information and two-dimensional code image setting information, which will be described later. A code image is an image generated by encoding (one-dimensionally or two-dimensionally encoding) information such as a character string. The image generation system is, for example, a trained AI model that has trained using a large amount of existing images as training data.
[0043] When such a trained AI model receives input of an instruction (hereinafter referred to as a prompt), it can generate an image including a decorative element indicated by the prompt. For example, when the trained AI model receives input of "rain" and "dog" as prompts and store information, it can output a two-dimensional code image that encodes the store information and incorporates a dog standing in the rain as a decorative element. As described above, two-dimensional code image setting information is used as the prompt in this embodiment.
[0044] (About user devices) The user terminal 103 is a terminal device owned by a user who uses a payment service. An application for using the payment service (hereinafter referred to as a payment application) is installed in the user terminal 103. By executing the payment application, the user terminal 103 can provide a payment service to the user who uses the user terminal 103.
[0045] The payment application has the function of displaying a code image used during payment and providing services related to the payment service. A user can make a payment at a store by using the payment application's scanning function to read a code image placed at the store. At this time, the payment server 102 performs payment processing in response to a request from the user terminal 103. Details of the payment processing and remittance processing will now be described.
[0046] (Regarding payment processing) There are two procedures for executing the payment process: the store scan procedure and the user scan procedure. Each procedure will be explained below.
[0047] [Store Scan Procedure] The user presents the code image displayed on the payment application of the user terminal 103 to a store clerk. The store clerk then scans the code image displayed on the payment application of the user terminal 103 with the store terminal 101, and the user terminal 103 makes a payment request to the payment server 102. The payment server 102 then performs payment processing.
[0048] [User scan procedure] A store clerk places a printed material in the store, on which a code image is printed and in which store information for identifying the store is embedded. The user reads the code image from the printed material placed in the store using the scanning function of the payment application on the user terminal 103. After the user enters the payment amount, the user terminal 103 transmits the user ID, the acquired store information, the payment amount, and the like to the payment server 102. Thereafter, the payment server 102 performs payment processing. Note that the payment in this disclosure will be described using an example in which payment is performed by a user scanning procedure.
[0049] (Regarding remittance processing) A first user, who is the user sending the remittance, uses the scanning function of the payment application on the first user terminal used by the first user to read a code image displayed on a second user terminal used by a second user, who is the user receiving the remittance. The code image displayed on the second user terminal has embedded therein the second user's identification information linked to the second user's account. The first user then inputs the remittance amount, and the first user terminal transmits the acquired second user's identification information and remittance amount to the payment server 102. The payment server 102 then performs the remittance process.
[0050] (Processing performed by each device) 1 to 8, a flow of the payment service from when a decoration code image is displayed on the store terminal 101 to when payment processing is performed on the payment server 102 will be described.
[0051] In S1, the store terminal 101 requests a decoration code image from the payment server 102. At this time, the store terminal 101 includes in the request in S1 the two-dimensional code image setting information set on the two-dimensional code image setting screen 400. Here, an operation on the store terminal 101 by a store clerk that triggers a request for a decoration code image will be described.
[0052] Fig. 5 is a diagram showing an example of a display screen for a two-dimensional code image. The display screen 500 shown in Fig. 5 is a screen displayed on the store terminal 101 in response to pressing of the receive button 250 shown in Fig. 2, and is a screen switched from the home screen 200 to be displayed.
[0053] The display screen 500 has a two-dimensional code image display area 501. A decorative code image 502 is displayed in the two-dimensional code image display area 501. The display screen 500 also has an update button 503, a print button 504, and a download button 505.
[0054] The update button 503 is a button that accepts updating of the decoration code image. For example, when the update button 503 is pressed, the first decoration code image that is already displayed is updated to a second decoration code image that is different from the first decoration code image and is displayed.
[0055] The management application may request the decoration code image immediately after the management application is started. That is, the trigger in S1 (the condition for requesting the decoration code image) may be the acceptance of the pressing of the receive button 250, the acceptance of the pressing of the update button 503, or the start of the management application.
[0056] The print button 504 is a button for receiving a print instruction for the decoration code image displayed on the display screen 500 to a printer (not shown) communicably connected to the store terminal 101. The download button 505 is a button for receiving an instruction to store the decoration code image displayed on the display screen 500 in the storage device of the store terminal 101.
[0057] Returning to FIG. 1, in S2, the payment server 102 acquires two-dimensional code image setting information from the request received in S1. At this time, the payment server 102 acquires store information corresponding to the store that made the request in S1. Store information is information used by the payment server 102 to manage information about stores belonging to affiliated stores. Store information is information expressed, for example, as a URL (Uniform Resource Locator).
[0058] In S3, the payment server 102 performs processing to generate a decoration code image. Specifically, in S3, the payment server 102 generates a decoration code image using an image generation system based on the two-dimensional code image setting information included in the request in S1 and the store information acquired in S2. At this time, the two-dimensional code image setting information is input to the image generation system as a text prompt by the payment server 102. Then, the image generation system generates and outputs a decoration code image as an output result for the input text prompt.
[0059] In S4, the payment server 102 transmits the decoration code image generated in S3 to the store terminal 101 that originated the request in S1. In S5, the store terminal 101 displays the decoration code image received in S4 on a display unit, as shown in Fig. 5. In this disclosure, display on a display unit is not limited to display on a display unit of a small terminal device such as the store terminal 101, but also includes signage display on a large display. An example of an image displayed as a decoration code image is shown in Fig. 6.
[0060] 6A and 6B are diagrams showing an example of a decoration code image displayed in the two-dimensional code image display area 501 and two-dimensional code image setting information corresponding to the decoration code image (i.e., a text prompt that is the basis for generating the decoration code image). FIG. 6A shows a decoration code image, which is a two-dimensional code image incorporating "steaming coffee" as a decoration element, and the corresponding two-dimensional code image setting information. The decoration code image 600 shown in FIG. 6A is a two-dimensional code image generated when "coffee" is set in the store genre input area and "winter" is set in the season information input area as the two-dimensional code image setting information 603. The decoration code image 600 also incorporates a "steaming coffee" pattern 601 as a decoration element. In this way, the store terminal 101 can display a two-dimensional code image generated by the payment server 102 using at least one of the genre information indicating the store genre and the seasonal information indicating the season, and which is decorated with the decoration indicated by the information.
[0061] Fig. 6(b) is a diagram showing a decorative code image, which is a two-dimensional code image incorporating "cherry blossoms" as a decorative element, and the corresponding two-dimensional code image setting information. The decorative code image 610 shown in Fig. 6(b) is a two-dimensional code image generated with "flowers" set in the store genre input area and "spring" set in the season information input area as the two-dimensional code image setting information 612. Furthermore, the decorative code image 610 incorporates a "cherry blossom" pattern 611 as a decorative element.
[0062] 6(a) and 6(b) are merely examples, and various decorations may be applied to the 2D code image. For example, the 2D code image may be decorated with a painting, a photograph, an illustration, a store logo or trademark, an acceptance mark, or an abstract pattern.
[0063] Here, details of decoration of a decoration code image generated by an image generation system will be described with reference to Fig. 7 and Fig. 8, taking the decoration code image 600 shown in Fig. 6(a) as an example. Fig. 7 is a diagram showing an example of decoration of the decoration code image 600. Note that Figs. 7(a) to 7(d) are enlarged views of the area 604 shown in Fig. 6(a).
[0064] Figure 7(a) is a diagram showing an example of a two-dimensional code image decorated by emphasizing the outline of coffee steam. Looking at area 700 shown in Figure 7(a), the color of the part that should be expressed in white as the code pattern (sometimes expressed as a symbol pattern) of the two-dimensional code image has been changed to gray, the color of the steam, in the area that overlaps with the steam. This change is also true for Figures 7(b) to 7(d) and Figures 8(a) and 8(c). Furthermore, as a result of emphasizing the outline of the steam, a part 701 of the color of the part that should be expressed in black as the code pattern of the two-dimensional code image has been changed to white.
[0065] Figure 7(b) is a diagram showing an example of a two-dimensional code image decorated with emphasis on the steam from coffee. Looking at area 710 shown in Figure 7(b), the color of a part 711 of the two-dimensional code image that should be expressed in black as a code pattern has been changed to gray, the color of steam. Also, white circles have been added to represent steam droplets in part 712 of the two-dimensional code image that should be expressed in black as a code pattern.
[0066] Figure 7(c) is a diagram showing an example of a two-dimensional code image decorated with emphasis on coffee steam. Looking at area 720 shown in Figure 7(c), the shape of the outline of part 721 of the part that should be expressed in white or black as the code pattern of the two-dimensional code image has been modified to emphasize the outline of the steam. Also, the color of part 622 of the part that should be expressed in black as the code pattern of the two-dimensional code image has been changed to gray to express the flickering of steam.
[0067] Fig. 7(d) is a diagram showing an example of a two-dimensional code image decorated with emphasis on the steam from the coffee. In the area 730 shown in Fig. 7(d), a blurring effect is applied to a part 731 of the area 730 to express the warmth of the steam. Bluring refers to changing the brightness of the pixels of the two-dimensional code image so as to reduce the visibility of the two-dimensional code image, for example.
[0068] Furthermore, as shown in Fig. 8, the two-dimensional code image may be decorated to improve the readability of the code pattern of the two-dimensional code image. Fig. 8 is a diagram showing an example of decoration of a decorated code image 600. Note that Figs. 8(a) to (c) are enlarged views of the area 604 shown in Fig. 6(a).
[0069] Fig. 8(a) is a diagram showing an example of decoration of a two-dimensional code image that improves the readability of the code pattern of the two-dimensional code image. Looking at an area 800 shown in Fig. 8(a), compared to the area 700 shown in Fig. 7(a), a part 801 of the part that should be expressed in white as the code pattern of the two-dimensional code image is expressed in white, not in gray, which indicates the color of steam.
[0070] Figure 8(b) is a diagram showing an example of a decoration of a 2D code image that enhances the readability of the code pattern of the 2D code image while emphasizing the outline of the steam from the coffee. Looking at the area 810 shown in Figure 8(b), all of the color of the parts that should be expressed in white as the code pattern of the 2D code image are expressed in white, not gray, which indicates the color of the steam. Also, as a result of emphasizing the outline of the steam, a part 811 of the color of the parts that should be expressed in white as the code pattern of the 2D code image has been changed to gray, which indicates the color of the steam.
[0071] Fig. 8(c) is a diagram showing an example of decoration of a two-dimensional code image that enhances the readability of the code pattern of the two-dimensional code image while emphasizing the steam of coffee. Looking at an area 820 shown in Fig. 8(c), a part 821 of the part that should be expressed in white as the code pattern of the two-dimensional code image is expressed in a gray color that is close to white. Also, a part 822 of the part that should be expressed in black as the code pattern of the two-dimensional code image is expressed in a black color that is close to the color of the steam.
[0072] In this way, the image generation system can generate a decorative code image so as to emphasize the decorative elements in the decoration of the two-dimensional code image, or generate a decorative code image so as to increase the readability of the code pattern of the two-dimensional code image. Note that the color of the decoration applied to the two-dimensional code image is not limited to achromatic colors such as white, black, and gray, but may also be a chromatic color. Furthermore, the color of the code pattern of the two-dimensional code image is not limited to white and black, but may also be gray or a chromatic color.
[0073] As mentioned above, the image forming system generates 2D code images using stable diffusion. This allows for the generation of decorative code images that incorporate decorative elements without impairing the readability of the 2D code image based on store information. 2D codes are known as a type of code that is highly resistant to dirt and noise. Even if the code (code pattern) appears to be damaged at first glance, image generation using stable diffusion results in an image that maintains the readability of the code.
[0074] Returning to FIG. 1, in S6, the store clerk presses the print button 504 displayed on the display screen 500 of the store terminal 101. Then, when the store terminal 101 detects that the print button 504 has been pressed, it sends a print instruction to the printer to print the decoration code image displayed on the display screen 500. When the printer receives the print instruction from the store terminal 101, it outputs a printed matter 104 on which the decoration code image is printed. The store clerk places the printed matter 104 output from the printer in the store.
[0075] In S7, the user terminal 103 uses the scanning function of the payment application to read the decoration code image printed on the printed matter 104 output in S6. In S7, the user terminal 103 analyzes the read decoration code image and acquires store information.
[0076] In S8, after the user inputs the payment amount, the user terminal 103 transmits the input payment amount to the payment server 102. It is assumed that the user terminal 103 has transmitted store information and a user ID for identifying the user to the payment server 102 in S7 before transmitting the payment amount in S8.
[0077] In S9, the payment server 102 performs payment processing based on the store information, user ID, payment amount, etc. acquired from the user terminal 103. Specifically, in S9, the payment server 102 identifies the store account to which payment is to be made from the store ID linked to the acquired store information, and identifies the user account from which payment is made from the user ID. Then, the payment server 102 performs processing to transfer electronic money equivalent to the payment amount from the user's account to the store's account.
[0078] (Example of a system) 9 is a diagram showing an example of the configuration of this system. This system has a store terminal 101, a payment server 102, and a user terminal 103. These devices are connected to each other so that they can communicate with each other via a network 900. The network 900 is, for example, a network such as a LAN (Local Area Network) or a WAN (Wide Area Network).
[0079] In this disclosure, as shown in FIG. 9, an example will be described in which there is one store terminal 101 and one user terminal 103. Note that there may be multiple store terminals 101 and multiple user terminals 103. Note that, as described above, it is assumed that a printer is communicatively connected to the store terminal 101. In addition to these devices, a server or external device different from the payment server 102 may also be included in this system and communicatively connected to the store terminal 101, payment server 102, and user terminal 103 via the network 900.
[0080] (Hardware configuration of information processing device) The above-described store terminal 101, payment server 102, and user terminal 103 are realized, for example, by an information processing device 1000 ("an example of a computer") configured as shown in FIG. 10. FIG. 10 is a block diagram showing an example of the hardware configuration of the information processing device 1000. The information processing device 1000 has a CPU 1001, a ROM 1002, a RAM 1003, a storage device 1004, an input / output I / F 1005, and a network interface (I / F) 1006. These components are connected to one another by a system bus. In addition, a display unit 1007 and an input unit 1008 are connected to the input / output I / F 1005.
[0081] The CPU 1001 reads programs stored in the ROM 1002 and the storage device 1004 into the RAM 1003 and executes the read programs to perform various controls. The CPU 1001 may be an MPU (Micro Processing Unit) or an ASIC (Application Specific Integrated Circuit). The CPU 1001 may also be an FPGA (Field Programmable Gate Array) or the like.
[0082] The ROM 1002 stores control programs such as a startup program for the information processing device 1000. The RAM 1003 is used as a work memory for temporarily storing control programs, data, and the like when the CPU 1001 executes various controls.
[0083] The storage device 1004 is a memory for storing applications, software, various data, and the like. Examples of the storage device 1004 include a hard disk drive (HDD), a solid state drive (SDD), flash memory, and storage. If the storage device 1004 is a store terminal 101, it stores a management application, a web browser, and the like. If the storage device 1004 is a payment server 102, it stores an image generation system, a user database (hereinafter, the database will be referred to as DB) and a store DB, which will be described later. If the storage device 1004 is a user terminal 103, it stores a payment application, and the like.
[0084] The input / output I / F 1005 is an interface for transmitting output information to an output device such as a display unit 1007. An example of the display unit 1007 is a display. The display unit 1007 may be provided in the information processing device 1000 as shown in FIG. 10 or may be provided outside the information processing device 1000.
[0085] The input / output I / F 1005 is an interface for receiving input information from an input device such as an input unit 1008. Examples of the input unit 1008 include a keyboard, a button, a touch panel, and an operation key. The input unit 1008 may be provided in the information processing device 1000 as shown in FIG. 10, or may be provided outside the information processing device 1000. The input / output I / F 1005 may be configured as being divided into an input I / F and an output I / F.
[0086] The network I / F 1006 is an interface for receiving data, etc. from other devices via the network 900, and for transmitting data generated or stored in the information processing device 1000, etc. to other devices via the network 900.
[0087] It should be noted that the information processing device 1000 is not limited to the configuration shown in Fig. 10. For example, the user terminal 103 may be provided with a camera unit for realizing a camera function.
[0088] The information processing device 1000 may also include a media I / F (not shown). The media I / F reads programs and data stored in a storage device (not shown) connected by wire or wirelessly, and provides them to the CPU 1001 via the RAM 1003. The CPU 1001 can read the provided programs from the storage device onto the RAM 1003 via the media I / F and execute the read programs. The storage device may be, for example, an optical recording medium such as a DVD (Digital Versatile Disc) or a PD (Phase Change Rewritable Disk), or a magneto-optical recording medium such as an MO (Magneto-Optical disk). The storage device may also be a tape medium, a magnetic recording medium, a semiconductor memory, or the like.
[0089] The CPU 1001 of the information processing device 1000 reads and executes these programs from a storage device, but as another example, these programs may be acquired from another device via a predetermined communication network. Furthermore, it goes without saying that the information processing device 1000 is provided with a configuration necessary to realize the information processing in this embodiment.
[0090] (An example of the software configuration of a store terminal) 11 is a diagram showing an example of the software configuration of the store terminal 101 in this embodiment. The store terminal 101 has a management application 1100. Note that the store terminal 101 may have applications, software, and various programs other than the management application 1100. The management application 1100 includes a receiving unit 1101, a transmitting unit 1102, a display control unit 1103, and a setting unit 1104.
[0091] The receiving unit 1101 can receive a decoration code image from the payment server 102 via the network 900, and can receive various information from other devices. The transmitting unit 1102 can transmit a request for a decoration code image to the payment server 102 via the network 900, and can transmit a print instruction to a printer communicably connected to the store terminal 101. The transmitting unit 1102 can transmit various information to other devices via the network 900.
[0092] The display control unit 1103 can display a management screen on the management application 1100 and detect operations on the management screen. The setting unit 1104 acquires calendar information, two-dimensional code image setting information, and the like.
[0093] (Example of payment server functional configuration) Fig. 12 is a diagram showing an example of the functional configuration of the payment server 102 in this embodiment. The configuration of the payment server 102 in this embodiment will be described with reference to Fig. 12. The payment server 102 has a communication unit 1200, a control unit 1210, a storage unit 1220, and an image generation system 1230. The control unit 1210 includes a receiving unit 1211, a transmitting unit 1212, a generating unit 1213, and a payment processing unit 1214. The control unit 1210 controls the entire payment server 102. The storage unit 1220 includes a user DB 1221 and a store DB 1222.
[0094] First, the information stored in the user DB 1221 and the store DB 1222 will be described with reference to Fig. 13. Fig. 13 is a diagram showing an example of information stored in each of the user DB 1221 and the store DB 1222.
[0095] 13(a) is a diagram showing an example of user management information 1300 stored in the user DB 1221. The user management information 1300 is generated when a user registers an account, and is user information managed by the payment server 102.
[0096] In the user management information 1300, user information 1301, user ID 1302, name 1303, available balance 1304, and available points 1305 are linked to one another. The user information 1301 is used to manage information about users who have registered accounts in the payment server 102. The user information 1301 is information expressed, for example, as a URL.
[0097] The user ID 1302 is an identifier for uniquely identifying a user. The name 1303 is a character string that can be set arbitrarily by the user and indicates the user's name or title. The available balance 1304 is the balance of electronic money. The available points 1305 are points that are granted by, for example, a service provider that operates a payment service and can be used by the user. The available balance 1304 and the available points 1305 correspond to the balance of the user's account.
[0098] 13(b) is a diagram showing an example of store management information 1310 stored in store DB 1222. Store management information 1310 is generated when a store owner enters into a contract (e.g., an affiliated store contract) with a service provider, and is store information managed by payment server 102. In store management information 1310, store information 1311, affiliated store ID 1312, store ID 1313, and sales amount 1314 are linked to one another.
[0099] The store information 1311 is used to manage information about stores belonging to member stores in the payment server 102. In other words, the store information 1311 is identification information used to identify stores. The store information 1311 is information to be embedded in a decoration code image generated by the payment server 102.
[0100] The affiliated store ID 1312 is an identifier for uniquely identifying the brand of the affiliated store. The affiliated store ID 1312 is linked to the brand name of the affiliated store, for example, XX Coffee, XX Department Store, or △△ Electric. The store ID 1313 is an identifier for uniquely identifying a store belonging to the affiliated store. The store ID 1313 is linked to the store name of the affiliated store, for example, XX Ekimae Store, XX △machi Store, or △〇 Street Store. The sales amount 1314 indicates the amount of sales made at the store. For example, when the payment process is completed by the payment server 102, an amount equivalent to the payment amount is added to the sales amount 1314. Note that an explanation of consumption tax and the like will be omitted for simplicity.
[0101] 12, the communication unit 1200 communicates with the store terminal 101, the user terminal 103, and other devices via the network 900. The receiving unit 1211 receives a request for a two-dimensional code image from the store terminal 101 via the communication unit 1200, and receives store information, a user ID, a payment amount, and the like from the user terminal 103. The receiving unit 1211 can also receive various information from other devices via the communication unit 1200. The transmitting unit 1212 can transmit a decoration code image to the store terminal 101 via the communication unit 1200, and transmit other information to other devices.
[0102] The generation unit 1213 generates a decoration code image using the image generation system 1230 in response to a request from the store terminal 101. The payment processing unit 1214 performs payment processing or remittance processing in response to a request from the user terminal 103. The payment processing unit 1114 can also perform payment processing in response to a request from the store terminal 101.
[0103] The image generation system 1230 generates a decoration code image based on the two-dimensional code image setting information set by the store clerk in response to an instruction from the generation unit 1213. Specifically, the image generation system 1230 can generate and output an image in which the store information 1311 is converted into a two-dimensional code and the decoration indicated by the two-dimensional code image setting information is applied to the image.
[0104] (An example of the information processing flow of this system) 14 is a sequence diagram showing an example of the flow of information processing among the store terminal 101, the payment server 102, and the user terminal 103. The flow of information processing in this embodiment will be described with reference to FIG.
[0105] In S1401, the store terminal 101 requests a decoration code image from the payment server 102. For example, a store clerk operates the store terminal 101 to launch the management application 1100 and display the home screen 200 on the display unit of the store terminal 101. When the store terminal 101 detects a user operation on the receive button 250 on the home screen 200 via the management application 1100, the store terminal 101 requests a decoration code image from the payment server 102. At this time, the store terminal 101 includes two-dimensional code image setting information in the request in S1401 via the management application 1100. Note that the request for the decoration code image may be triggered by pressing the update button 503 or launching the management application 1100, as described above.
[0106] In S1402, the payment server 102 acquires two-dimensional code image setting information from the request in S1401. Also, in S1402, the payment server 102 acquires store information linked to the store that made the request in S1401.
[0107] In S1403, the payment server 102 performs processing for generating a decoration code image based on the two-dimensional code image setting information and store information acquired in S1402. Specifically, in S1403, the payment server 102 inputs the two-dimensional code image setting information and store information as text prompts to the image generation system 1230, and obtains, as an output result, a two-dimensional code image in which a code pattern obtained by converting the store information into a two-dimensional code is decorated with elements indicated by the two-dimensional code image setting information. Note that in this embodiment, an example will be described in which preset negative prompts, guide scale values, and intensity values are stored in the payment server 102. The payment server 102 uses a random seed value when generating a decoration code image using the image generation system 1230. That is, a different seed value is used each time a decoration code image is generated (each time a request is made from the store terminal 101).
[0108] Here, it is assumed that the payment server 102 generates the decoration code image 600 shown in Fig. 6(a) using the image generation system 1230. In S1404, the payment server 102 transmits the decoration code image generated in S1403 to the store terminal 101 that made the request in S1401.
[0109] In S1405, the store terminal 101 displays the decoration code image 600 received in S1404 using the management application 1100. For example, in S1405, the store terminal 101 displays a decoration code image 502 on a two-dimensional code image display area 501 on the display screen 500, as shown in FIG.
[0110] In S1406, when the store terminal 101 detects that the print button 504 has been pressed using the management application 1100, it sends a print instruction to the printer to print the decoration code image 502. Then, in response to the print instruction from the store terminal 101, the printer outputs a printed matter 104 as a result of printing the decoration code image 502. A store clerk places the printed matter 104 output from the printer in the store.
[0111] In S1407, the user terminal 103 uses the scanning function of the payment application to read the decoration code image 502 printed on the printed material 104 placed in the store. In S1407, the user terminal 103 analyzes the decoration code image 502 using the payment application to acquire store information. Then, the user terminal 103 transmits the acquired store information and user ID to the payment server 102 using the payment application.
[0112] In S1408, after the user inputs the payment amount, the user terminal 103 uses the payment application to transmit the input payment amount to the payment server 102. In S1409, the payment server 102 performs payment processing based on the store information, user ID, payment amount, etc. acquired from the user terminal 103. Specifically, in S1409, the payment server 102 identifies the store ID from the store information acquired in S1407. Then, the payment server 102 performs processing to transfer electronic money equivalent to the payment amount from the user's account corresponding to the acquired user ID to the store's account corresponding to the identified store ID.
[0113] (An example of the flow of information processing at a store terminal) Fig. 15 is a flowchart showing an example of processing of the store terminal 101 in this embodiment. With reference to Fig. 15, processing in which the management application 1100 of the store terminal 101 displays a two-dimensional code image will be described. The processing shown in Fig. 15 is realized by the CPU 1001 of the store terminal 101 reading the program of the management application 1100 stored in the storage device 1004 into the RAM 1003 and executing it. The processing shown in Fig. 15 is started in response to, for example, the reception button 250 being pressed by a store clerk.
[0114] In S1501, the CPU 1001 of the store terminal 101 acquires two-dimensional code image setting information from the storage device 1004 of the store terminal 101 by the setting unit 1104, and the process proceeds to S1502.
[0115] In S1502, the CPU 1001 of the store terminal 101 sends a request for a decoration code image to the payment server 102, including the two-dimensional code image setting information acquired in S1501, via the transmission unit 1102, and the process proceeds to S1503.
[0116] In S1503, the CPU 1001 of the store terminal 101 receives the decoration code image from the payment server 102 via the receiving unit 1101, and proceeds to S1504. In S1504, the CPU 1001 of the store terminal 101 displays the decoration code image received in S1503 via the display control unit 1103, and proceeds to S1505.
[0117] In S1505, the CPU 1001 of the store terminal 101 determines whether or not the update button 503 has been pressed by the display control unit 1103. If the CPU 1001 of the store terminal 101 determines in S1505 by the display control unit 1103 that the update button 503 has been pressed (Yes), the process returns to S1501. In this case, the CPU 1001 of the store terminal 101 again requests the payment server 102 for a decoration code image, including the two-dimensional code image setting information acquired by the setting unit 1104.
[0118] In this way, when the update button 503 is pressed, the first decoration code image, which is the decoration code image already displayed, is updated to the second decoration code image, which is a decoration code image different from the first decoration code image, and displayed. Specifically, the first decoration code image, which is a two-dimensional code image having the first code pattern and to which the first decoration is applied, is updated to the second decoration code image, which is a two-dimensional code image having the first code pattern and to which the second decoration, which is a decoration different from the first decoration, and displayed.
[0119] If the CPU 1001 of the shop terminal 101 determines in S1505 that the update button 503 has not been pressed (No) through the display control unit 1103, the process proceeds to S1506.
[0120] In S1506, the CPU 1001 of the store terminal 101 determines whether or not the print button 504 has been pressed by the display control unit 1103. If the CPU 1001 of the store terminal 101 determines in S1506 by the display control unit 1103 that the print button 504 has been pressed (Yes), the process proceeds to S1507. If the CPU 1001 of the store terminal 101 determines in S1506 by the display control unit 1103 that the print button 504 has not been pressed (No), the process proceeds to S1508.
[0121] In S1507, the CPU 1001 of the store terminal 101 issues a print instruction to the printer to print the decoration code image displayed in S1504 via the transmission unit 1102, and the process proceeds to S1508.
[0122] In S1508, the CPU 1001 of the store terminal 101 determines whether or not the display of the decoration code image has ended by the display control unit 1103. For example, in S1508, the CPU 1001 of the store terminal 101 determines whether or not the display of the decoration code image has ended by the display control unit 1103 switching the display screen 500 to another screen due to a press on the home bar 211, the profile bar 212, the setting bar 213, or the like.
[0123] In S1508, if the CPU 1001 of the store terminal 101 determines through the display control unit 1103 that the display of the decoration code image has ended (Yes), the flow ends. In S1508, if the CPU 1001 of the store terminal 101 determines through the display control unit 1103 that the display of the decoration code image has not ended (No), the flow returns to S1505.
[0124] (An example of the flow of information processing on a payment server) Fig. 16 is a flowchart showing an example of processing by the payment server 102 in this embodiment. The processing executed by the payment server 102 will be described with reference to Fig. 16. The processing shown in Fig. 16 is realized by the CPU 1001 of the payment server 102 reading out the program stored in the ROM 1002 and the program of the image generation system 1230 stored in the storage device 1004 into the RAM 1003 and executing them. The processing shown in Fig. 16 is started after the payment server 102 is started.
[0125] In S1601, the CPU 1001 of the payment server 102 determines whether or not a request for a decoration code image has been received from the store terminal 101 via the receiving unit 1211. If the CPU 1001 of the payment server 102 determines in S1601 via the receiving unit 1211 that a request for a decoration code image has been received from the store terminal 101 (Yes), the process proceeds to S1602. If the CPU 1001 of the payment server 102 determines in S1601 via the receiving unit 1211 that a request for a decoration code image has not been received from the store terminal 101 (No), the process returns to S1601 and waits until the request is received.
[0126] In S1602, the CPU 1001 of the payment server 102 acquires, by the generation unit 1213, two-dimensional code image setting information from the decoration code image request received in S1601, and proceeds to S1603. At this time, in S1602, the CPU 1001 of the payment server 102 acquires, by the generation unit 1213, a negative text prompt, a guide scale value, an intensity value, and a seed value in addition to the two-dimensional code image setting information, determines a random seed value, and proceeds to S1603.
[0127] In S1603, the CPU 1001 of the payment server 102 causes the generation unit 1213 to perform processing to generate a decoration code image using the image generation system 1230, and proceeds to S1604. Specifically, in S1603, the CPU 1001 of the payment server 102 causes the image generation system 1230 to generate a decoration code image based on the store information, both text prompts, and prompt parameters.
[0128] Here, the image generation system 1230 in the present disclosure will be described by taking as an example that, for example, when the store information, both text prompts, and prompt parameters are all the same, the image generation system 1230 generates decorative code images with the same design. In other words, when the value of at least one of the store information, both text prompts, and prompt parameters is different, the image generation system 1230 generates decorative code images with different designs.
[0129] For example, consider a case where the image generation system 1230 generates a first decoration code image and a second decoration code image. In this case, if the store information is the same between the first setting information corresponding to the first decoration code image and the second setting information corresponding to the second decoration code image, and at least one value among the text prompts and prompt parameters is different, the image generation system 1230 generates the first decoration code image and a second decoration code image having a different design from that of the first decoration code image. Specifically, the image generation system 1230 generates the first decoration code image, which is a two-dimensional code image having a first code pattern and a first decoration applied thereto, and the second decoration code image, which is a two-dimensional code image having the first code pattern and a second decoration applied thereto that is a decoration different from the first decoration.
[0130] In this embodiment, the negative text prompt, guide scale value, and intensity value are preset, but a random value is used for the seed value. As described above, the seed value is different for each generated decorative code image. That is, the design of each generated decorative code image can be different, providing a more fresh experience for store clerks.
[0131] In S1604, the CPU 1001 of the payment server 102 causes the transmission unit 1212 to transmit the decoration code image generated in S1603 to the store terminal 101 that is the request source of the request received in S1601, and ends this flow.
[0132] According to this embodiment, the decorative code image generated by the payment server 102 is displayed on a store terminal used by a store clerk. Furthermore, when a user makes a payment at a store, the user scans the decorative code image printed as a printout to make the payment. This meets the needs of store clerks who want to decorate the two-dimensional code image used for payment. Furthermore, it is possible to provide users with the enjoyment of viewing the decorated two-dimensional code image when making a payment. Therefore, it is possible to increase the interest of store clerks and users in making a payment using a code image.
[0133] <<Other embodiments>> In the first embodiment, an example has been described in which the payment server 102 has an image generation system, but the image generation system may be provided by an external device different from the store terminal 101 or the payment server 102. That is, an external device different from the store terminal 101 or the payment server 102 may generate a decoration code image using the image generation system 1230.
[0134] In the first embodiment, an example has been described in which the payment server 102 generates a decoration code image based on information indicating the store genre and seasonal information input by a store clerk. The payment server 102 may also generate a decoration code image based on the affiliated store ID 1312 or the store ID 1313.
[0135] Specifically, the payment server 102 generates a two-dimensional code image decorated with information related to the brand name linked to the affiliated store ID 1312. For example, if the brand name "△△ Denki" is linked to the affiliated store ID 1312, the payment server 102 can generate a two-dimensional code image decorated with decoration representing the products or services provided by "△△ Denki" (for example, illustrations representing washing machines and vacuum cleaners, or machine repair services), or decoration showing the "△△ Denki" logo.
[0136] Furthermore, the payment server 102 generates a two-dimensional code image decorated with information related to the store name linked to the store ID 1313. For example, if the store name "X△ Town Store" is linked to the store ID 1313, the payment server 102 can generate a two-dimensional code image decorated with a decoration representing the area of "X△ Town" (for example, a local character of "X△ Town" or an illustration representing a specialty of "X△ Town").
[0137] In the first embodiment, an example was described in which a store clerk sets information indicating the store genre and seasonal information, and a decorative code image is generated based on this information by the payment server 102. In this embodiment, an example will be described in which a store clerk sets store location information or a text prompt, etc., and the payment server 102 generates a decorative code image based on information indicating the store genre, seasonal information, and store information or a text prompt, etc.
[0138] Fig. 17 is a diagram showing an example of a two-dimensional code image setting screen in this embodiment. The two-dimensional code image setting screen 1700 shown in Fig. 17 differs from the two-dimensional code image setting screen 400 in the first embodiment in that it has a position information input area 1701.
[0139] In the location information input area 1701, a character string indicating the location information of the store can be input. For example, the location information of the store can be the store's address, such as prefecture, city, or area. The character string shown here is an example, and it goes without saying that other character strings can be set as decoration elements. Decoration elements can be set in English and other languages, not just Japanese.
[0140] Furthermore, when a store clerk presses the reference button provided to the right of location information input area 1701, the management application acquires the location information of the store from the address information set on the screen to which the user can transition from store profile setting item 330 shown in FIG. 3. The management application can then reflect the acquired location information of the store in location information input area 1701. For example, if "XX prefecture" is set as the address information, pressing the reference button in location information input area 1701 automatically enters "XX prefecture" in location information input area 1701.
[0141] Then, when character strings corresponding to the store genre input area 401, the season information input area 402, and the location information input area 1701 are input and set, the store terminal 101 requests the payment server 102 for a decoration code image, and the payment server 102 generates a decoration code image based on these character strings.The decoration code image generated by the payment server 102 is then displayed on the display unit of the store terminal 101.
[0142] The two-dimensional code image setting screen 1700 also has a text prompt input area 1702 and a negative text prompt input area 1703. A character string (text prompt) indicating a decorative element of the two-dimensional code image can be input into the text prompt input area 1702. That is, the character string input into the text prompt input area 1702 corresponds to information indicating the store genre, seasonal information, and location information.
[0143] For example, character strings indicating decorative elements may include, but are not limited to, information indicating the store's genre, seasonal information, and location information, as well as characters indicating animals such as cats and dogs, topography such as mountains, rivers, and oceans, seasons such as spring and summer, weather such as sunny and rainy, emotions such as happy and sad, and character strings restricting gender and age such as girl and young man. The character strings shown here are merely examples, and it goes without saying that other character strings can be set as decorative elements. Decorative elements can be set in English and other languages, not just Japanese. Negative text prompts, etc., can be entered in the negative text prompt input field 1703.
[0144] The two-dimensional code image setting screen 1700 is provided with a guide scale value setting control 1704, an intensity value setting control 1705, and a seed value setting control 1706. The guide scale value setting control 1704 is an operator that can set the guide scale value. The intensity value setting control 1705 is an operator that can set the intensity value. The seed value setting control 1706 is an operator that can set the seed value.
[0145] The two-dimensional code image setting screen 1700 is provided with a check box 1707 that accepts an instruction as to whether or not to validate the information set in the text prompt input area 1702 through the seed value setting control 1706. When the check box 1707 is checked, the information set in the text prompt input area 1702 through the seed value setting control 1706 is used as information to be input to the image generation system 1230. In other words, in this case, the character strings set in the store genre input area 401, the seasonal information input area 402, and the location information input area 1701 are not used as prompts to be input to the image generation system 1230.
[0146] On the other hand, if the check box 1707 is not checked, the character strings set in the store genre input area 401, the season information input area 402, and the location information input area 1701 are used as the prompts to be input to the image generation system 1230. In other words, in this case, the information set in the text prompt input area 1702 through the seed value setting control 1706 is not used as the information to be input to the image generation system 1230. In this way, the store clerk can freely set the negative text prompt and prompt parameters in addition to the text prompt, which allows for more flexible settings for the decoration of the two-dimensional code image for payment.
[0147] Alternatively, the management application 1100 of the store terminal 101 or the payment server 102 may automatically determine both the text prompt and the prompt parameters in response to the user's selection.
[0148] For example, a store clerk first selects a decorative element, i.e., whether to emphasize the design of the two-dimensional code image or to increase the readability of the code pattern of the two-dimensional code image. Then, the management application 1100 or the payment server 102 determines both the text prompt and the prompt parameters according to this user selection. Such a determination can be realized by using a language model (hereinafter referred to as a large-scale language model) constructed using a large amount of data and deep learning technology.
[0149] In this embodiment, an example will be described in which the large-scale language model is stored in a dedicated server (not shown) separate from the payment server. The large-scale language model may also be stored in the payment server. When the dedicated server receives a request to use the functions of the large-scale language model, it can input the prompt indicated by the request into the large-scale language model and transmit the output result obtained to the requestor. The following description will show an example in which the management application 1100 of the store terminal 101 automatically determines both text prompts and prompt parameters in response to a user selection.
[0150] For example, the two-dimensional code image setting screen 1700 may be provided with a check box for emphasizing the design and a check box (not shown) for increasing the readability of the code pattern of the two-dimensional code image.
[0151] Here, assume that "dog" has been entered in the text prompt input field 1702 and "ugly, disfigured, low quality" has been entered in the negative text prompt input field 1703. The prompt parameters are as shown in FIG. 17. In this case, when the checkbox for improving the readability of the code pattern of the two-dimensional code image is checked and the OK button 403 is pressed, the management application 1100 makes a request to the dedicated server to adjust both text prompts and the prompt parameters. At this time, the management application 1100 includes in the request to the dedicated server both text prompts and prompt parameters set by the store clerk, as well as a character string indicating an instruction to improve the readability of the code pattern of the two-dimensional code image.
[0152] Then, when the dedicated server receives a request from the management application 1100, it inputs, for example, the following prompt into the large-scale language model:
[0153] "Output prompts and parameters that will improve the readability of the code pattern in the 2D code image. Also, output prompts separately into text prompts and negative text prompts. Output parameters separately into guide scale values, intensity values, and seed values."
[0154] When such a prompt is input to a large-scale language model, the following output results are obtained, for example:
[0155] Text prompt: dog, high contrast, high-detailed 2D code Negative text prompts: ugly, disfigured, low quality, blurry Guide scale value: 7.0 Strength value: 0.1 Seed value: 123456789".
[0156] The output shows that the text prompt has been added as "high contrast, high-detailed 2D code", the negative text prompt has been added as "blurry", and the intensity value has been changed from 0.2 to 0.1.
[0157] Then, the dedicated server transmits the output result output from the large-scale language model to the requesting store terminal 101. When the store terminal 101 receives the output result, the management application 1100 reflects and displays the output result on the two-dimensional code image setting screen 1700 of FIG.
[0158] In the above case, it is assumed that the checkbox for emphasizing the design is checked. In this case, when the OK button 403 is pressed, the management application 1100 makes a request to the dedicated server to adjust both the text prompt and the prompt parameters.
[0159] Then, when the dedicated server receives a request from the management application 1100, it inputs, for example, the following prompt into the large-scale language model:
[0160] "Output prompts and parameters that emphasize the design of the 2D code image. Also, output prompts separately into text prompts and negative text prompts. Output parameters separately into guide scale values, intensity values, and seed values." When such a prompt is input to a large-scale language model, the following output results are obtained, for example:
[0161] Text prompt: a big dog, impressive design, three-dimensional face Negative text prompts: ugly, disfigured, low quality Guide scale value: 9.0 Strength value: 0.4 Seed value: 123456789".
[0162] The output shows that the text prompt has changed from "dog" to "a big dog, impressive design, three-dimensional face", the guide scale value has changed from 7.0 to 9.0, and the strength value has changed from 0.2 to 0.4.
[0163] The dedicated server transmits the output result output from the large-scale language model to the requesting store terminal 101. Then, similar to the above-described process, the management application 1100 reflects and displays the output result on the two-dimensional code image setting screen 1700 in FIG.
[0164] In this way, the management application 1100 of the store terminal 101 can use a large-scale language model to determine both the text prompt and the prompt parameters in response to the selection of the store clerk. In a similar manner, the payment server 102 can use a large-scale language model to determine both the text prompt and the prompt parameters in response to the selection of the store clerk.
[0165] In the above embodiment, an example has been described in which a store clerk inputs information indicating the store's genre, but the information indicating the store's genre may be set in advance. For example, as shown in Fig. 18, input candidates may be displayed in each input area.
[0166] Fig. 18 is a diagram showing an example of a two-dimensional code image setting screen in this embodiment. The two-dimensional code image setting screen 1800 shown in Fig. 18 is provided with a store genre input area 1801, a season information input area 1803, and a location information input area 1805. Note that the two-dimensional code image setting screen 1800 differs in that it is provided with a pull-down button instead of a reference button.
[0167] When pull-down button 1802 corresponding to store genre input area 1801 is pressed, a list of store genre candidates is displayed in a pull-down menu, as shown in FIG. 18 . Pull-down button 1804 corresponding to season information input area 1803 and pull-down button 1806 corresponding to location information input area 1805 have the same function as pull-down button 1802. For example, pull-down button 1804 displays a list of input candidates related to the season, and pull-down button 1806 displays a list of input candidates related to the store address. Note that the input candidates displayed in the pull-down menu in each input area may be information related to the store, or may include information unrelated to the store. In this way, by presetting information indicating the store genre, etc., it is possible to obtain the same effect as in the first embodiment while reducing the input burden on the user.
[0168] As a variation of this, a text prompt corresponding to an input candidate such as information indicating the genre of the store, and a negative text prompt and prompt parameters adjusted in advance for the text prompt may be set.
[0169] Here, even if a store clerk inputs information indicating the store genre so that the desired decoration is applied to the two-dimensional code image, a situation may occur in which the pattern or shape of the decoration of the decorative code image is distorted as a result of generation by the payment server 102. Therefore, by setting in advance text prompts corresponding to input candidates such as information indicating the store genre, as well as negative text prompts and prompt parameters adjusted for the text prompts, it is possible to prevent such situations from occurring.
[0170] Fig. 19 is a diagram showing an example of a preset text prompt that corresponds to an input candidate such as information indicating the genre of a store, etc. Fig. 19(a) is a diagram showing an example of a correspondence table that associates input candidates such as information indicating the genre of a store with text prompts.
[0171] 19(a), store genre 1901, seasonal information 1902, location information 1903, and prompt 1904 are linked together. Store genre 1901 indicates one of the input candidates for store genre input area 1801 in FIG. 18. Similarly, seasonal information 1902 and location information 1903 indicate one of the input candidates for seasonal information input area 1803 and location information input area 1805, respectively. Prompt 1904 indicates a text prompt to be input to image generation system 1230.
[0172] Looking at the correspondence table 1900, if the store's genre 1901 is "curry," the seasonal information 1902 is "summer," and the location information 1903 is "△△ region," it can be seen that the prompt 1904 is "curry with summer vegetables from the △△ region."
[0173] That is, in FIG. 18, if "curry" is set in the store genre input area 1801, "summer" is set in the seasonal information 1902, and "△△ region" is set in the location information 1903, "curry with summer vegetables from the △△ region" is input to the image generation system 1230 as a text prompt.
[0174] 19(a), a prompt 1904 corresponding to at least one of store genre 1901, seasonal information 1902, and location information 1903 is set in correspondence table 1900. Note that, without being limited to the aspect shown in FIG. 19(a), one or more prompts 1904 may be set for a predetermined combination of store genre 1901, seasonal information 1902, and location information 1903.
[0175] 19B is a diagram showing an example of a correspondence table 1910 that associates text prompts with negative text prompts and prompt parameters. In the correspondence table 1910 shown in FIG. 19B, a prompt 1904, a negative prompt 1911, a guide scale value 1912, an intensity value 1913, and a seed value 1914 are linked.
[0176] The negative prompt 1911, guide scale value 1912, intensity value 1913, and seed value 1914 in FIG. 19(b) are values that have been adjusted in advance so that the two-dimensional code image is appropriately decorated.
[0177] Similarly to the prompt 1904, a negative prompt 1911, a guide scale value 1912, an intensity value 1913, and a seed value 1914 are also input to the image generation system 1230 when generating the decorated code image.
[0178] The correspondence table shown in Fig. 19 may be held by the store terminal 101 or may be held by the payment server 102. For example, when the store terminal 101 holds the correspondence table shown in Fig. 19 and makes a request for a decoration code image to the payment server 102, the store terminal 101 includes in the request both text prompts and prompt parameters corresponding to the code image setting information set in each input area shown in Fig. 18. Then, the payment server 102 inputs both text prompts and prompt parameters included in the request received from the store terminal 101 into the image generation system 1230, acquires a two-dimensional code image that has been appropriately decorated as a result, and transmits the two-dimensional code image to the store terminal 101. After that, such a two-dimensional code image is displayed on the store terminal 101.
[0179] Furthermore, a program for tuning a trained AI model (for example, LoRA (Low-Rank Adaptation)) may be applied to the image generation system of the present disclosure.
[0180] The configuration of the information processing device 1000 described above can be flexibly changed, for example, by calling an external platform or the like via API or network computing depending on the function.
[0181] Furthermore, the above-described embodiments can be combined as appropriate within the scope of not causing any contradiction in the processing content. [Explanation of symbols]
[0182] 101: Store terminal 102: Payment server 1100: Management application
Claims
1. A system including a payment server that provides a payment service, and a terminal device that is communicably connected to the payment server and used by a store clerk, The payment server a first acquisition unit that acquires setting information, which is information included in a request for a two-dimensional code image from the terminal device and is information indicating decoration for the two-dimensional code image; a second acquisition unit that acquires identification information for identifying the store; a generating unit that generates a decoration code image, which is the two-dimensional code image in which the identification information is encoded and is the two-dimensional code image to which the decoration indicated by the setting information is applied; and The system is characterized in that the terminal device has a display control unit that controls the display of the decorative code image transmitted from the payment server in response to a request for the two-dimensional code image on a display unit.
2. the setting information includes at least one of genre information indicating a genre of the store, seasonal information indicating a season, and location information indicating a location of the store; The system according to claim 1, characterized in that the generation unit generates the decorative code image with decoration indicated by at least one of the genre information, the seasonal information, and the location information.
3. the payment server has information about the affiliated store to which the store belongs and information about the store; The system described in claim 1, characterized in that the generation unit generates the decorative code image, which is the two-dimensional code image in which the identification information is encoded and which is decorated with decoration representing the products or services provided by the affiliated store or the area in which the store is located.
4. The generation unit further generating a seed value that is a parameter for determining the configuration of the decoration, the seed value being a random value; The system according to claim 1 , wherein the decorated code image is generated by applying decoration based on the seed value and the setting information.
5. The display control unit performing control to further display on the display unit an item that accepts updating of the first decoration code image, which is the decoration code image already displayed, to a second decoration code image, which is the decoration code image different from the first decoration code image; The system according to claim 4 , wherein the first decoration code image is updated to the second decoration code image and displayed in response to an operation on the item.
6. The code pattern of the two-dimensional code image corresponding to the second decorative code image is the same as the code pattern of the two-dimensional code image corresponding to the first decorative code image, 6. The system of claim 5, wherein the decoration of the second decoration code image is different from the decoration of the first decoration code image.
7. The system according to claim 1, wherein the decoration includes at least one of changing the shape of the outline of a portion of the code pattern of the two-dimensional code image, changing the color of the portion, and changing the brightness of the portion.
8. a printer connected to the terminal device so as to be able to communicate with the terminal device; 2. The system according to claim 1, wherein the terminal device further comprises a transmission unit that transmits a print instruction for the decoration code image displayed on the display unit to the printer.
9. The system according to claim 1 , wherein the decorative code image is used for payment by a user who uses the payment service.
10. A program executed by a terminal device that is communicably connected to a payment server that provides a payment service and that is used by a store clerk, The terminal device, a transmitting unit that transmits a request for a two-dimensional code image to the payment server, the request including setting information that is information indicating decoration for the two-dimensional code image; a display control unit that controls displaying on a display unit a decoration code image, which is the two-dimensional code image in which identification information for identifying the store is encoded and which is the two-dimensional code image to which the decoration indicated by the setting information has been applied and which is generated by the payment server; A program characterized by functioning as follows.
11. A payment server that provides a payment service and is communicably connected to a terminal device used by a store clerk, a first acquisition unit that acquires setting information, which is information included in a request for a two-dimensional code image from the terminal device and is information indicating decoration for the two-dimensional code image; a second acquisition unit that acquires identification information for identifying the store; a generating unit that generates a decoration code image, which is the two-dimensional code image in which the identification information is encoded and is the two-dimensional code image to which the decoration indicated by the setting information is applied; a transmitting unit that transmits the decoration code image to the terminal device in response to a request for the two-dimensional code image; A payment server comprising:
12. A method for controlling a terminal device that is communicably connected to a payment server that provides a payment service and that is used by a store clerk, comprising: a sending step of sending a request for a two-dimensional code image to the payment server, the request including setting information that is information indicating decoration for the two-dimensional code image; a display control step of controlling the display on a display unit of a decoration code image, which is the two-dimensional code image in which identification information for identifying the store is encoded and which is the two-dimensional code image to which the decoration indicated by the setting information is applied and which is generated by the payment server; A control method comprising:
13. A method for controlling a payment server that provides a payment service and is communicably connected to a terminal device used by a store clerk, a first acquisition step of acquiring setting information, which is information included in a request for a two-dimensional code image from the terminal device and is information indicating decoration for the two-dimensional code image; a second acquisition step of acquiring identification information for identifying the store; a generating step of generating a decoration code image, which is the two-dimensional code image in which the identification information is encoded and is the two-dimensional code image to which the decoration indicated by the setting information is applied; a transmitting step of transmitting the decoration code image to the terminal device in response to a request for the two-dimensional code image; A control method comprising:
14. A printed matter on which a two-dimensional code image used for a payment service in a system including a payment server that provides a payment service and a user terminal used by a user who receives the payment service for payment at a store, A printed matter on which a decorative code image is printed, the decorative code image being the two-dimensional code image in which identification information for identifying the store is encoded, and the two-dimensional code image decorated based on at least one of a character string indicating the genre of the store, a character string indicating the season, and a character string indicating the location of the store.
Citation Information
Patent Citations
Two-dimensional bar code
JP2006302050A
Sheet having two-dimensional code, server device, and information providing system
JP2007304574A
System and method for generating combined barcode images
JP2008511059A
Optical reading code generation device
JP2014526109A
Settlement support system, settlement support method, and settlement support program
JP2017102886A