Image Generation Device

Abstract

To enable a virtual object superimposed on a base image to be designed depending on a user.SOLUTION: An image generation device 1 includes: a first user information obtaining unit 11 that obtains first user information on a first user who is a shop staff serving a customer; a second user information obtaining unit 12 that obtains second user information on a second user who is the customer receiving service by the first user; and an image obtaining unit 14 that obtains a virtual object J to be superimposed on a base image B for generating a superimposed image S. Upon a request given from the second user, the image obtaining unit 14 obtains a first virtual object J1 that is the virtual object J having a design decided on the basis of input information containing the first user information and the second user information.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to image generation devices. [Background technology]

[0002] For example, a technique is known in which a superimposed image in which various virtual objects are superimposed on a base image such as a landscape is displayed on a display or the like, allowing a user to visually recognize virtual objects that do not exist in reality as if they exist on the base image. Examples of means for realizing such a technique include AR (Augmented Reality) and VR (Virtual Reality). Patent Document 1 discloses a technique that enables virtual objects associated with two users to communicate with each other in a virtual space using VR.

[0003] Here, "AR" refers to a method of allowing a user to experience a world in which reality is augmented by having the user view an image (superimposed image) in which a virtual image (virtual object) is superimposed on an image (base image) representing real space. "VR" refers to a method of allowing a user to experience a world in which the user perceives a virtual space as if it were real space by having the user view an image representing the virtual space. In VR, too, the user may be allowed to view an image (superimposed image) in which another virtual image (virtual object) is superimposed on a base image (base image). [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent Publication No. 2021-2145 Summary of the Invention [Problem to be solved by the invention]

[0005] In the above-described technology, the design of the virtual object to be superimposed on the base image is generally determined in advance. However, there are cases where it is desired to change the design of the virtual object depending on the user. For example, in a case where there are two users, a store clerk and a customer who is served or entertained by the store clerk, it is conceivable to indicate that the relationship between the two users is special by changing the design of the virtual object according to the relationship between the two users.

[0006] Therefore, an object of the image generation device according to the present disclosure is to design a virtual object to be superimposed on a base image in accordance with the user. [Means for solving the problem]

[0007] An image generation device (1) according to one embodiment of the present disclosure includes a first user information acquisition unit (11) that acquires first user information about a first user who is a store clerk who serves or entertains customers, a second user information acquisition unit (12) that acquires second user information about a second user who is a customer who is served or entertained by the first user, and an image acquisition unit (14) that acquires a virtual object (J) to be superimposed on a base image (B) to generate a superimposed image (S), and the image acquisition unit (14) acquires a first virtual object (J1), which is a virtual object (J) whose design is determined based on input information including the first user information and the second user information, in response to a request from the second user.

[0008] According to this image generating device (1), a virtual object (J) is acquired to generate a superimposed image (S) by superimposing it on a base image (B) in response to a request from a second user. This superimposed image (S) is used in AR or VR, for example, by displaying it on a display or the like, to allow a user to visually recognize a virtual object (J) that does not exist in reality as if it were present on the base image (B). Here, according to the image generating device (1), the design of the virtual object (J) is determined according to information about a first user and a second user who are in a relationship between a waiter and a customer at a restaurant where customer service is provided or a restaurant where entertainment is provided. Therefore, according to the image generating device (1), the virtual object (J) to be superimposed on the base image (B) can be designed according to the user.

[0009] In the image generating device (1) according to one aspect of the present disclosure, the base image (B) may be an image of a store where a first user serves or entertains a second user. This allows the act of displaying a gift given to the first user by the second user in the store to be reproduced using AR or VR.

[0010] In the image generating device (1) according to an aspect of the present disclosure, the virtual object (J) may be an image of a flower stand, which allows the act of giving the flower stand as a gift from the second user to the first user to be reproduced using AR or VR.

[0011] In the image generating device (1) according to one aspect of the present disclosure, the input information may include flower information regarding characteristics of flowers included in the stand flower. In this way, the stand flower including flowers having characteristics suitable for the first and second users can be given as a gift from the second user to the first user.

[0012] An image generating device (1) according to one embodiment of the present disclosure includes a communication history information acquiring unit (13) that acquires communication history information relating to a history of communications performed between a first user terminal (T1) used by a first user and a second user terminal (T2) used by a second user, and the input information may include the communication history information. This allows a virtual object (J) designed according to the past communication history between the first user and the second user to be a gift from the second user to the first user.

[0013] The image generating device (1) according to an embodiment of the present disclosure may include a billing unit (15) that bills the second user when the image acquiring unit (14) acquires the first virtual object (J1) in response to a request from the second user. This allows the first user to receive a fee for a gift from the second user.

[0014] In the image generating device (1) according to one aspect of the present disclosure, the input information may include amount information regarding the amount of money charged to the second user by the charging unit (15). In this way, the second user can give the first user a virtual object (J) designed according to the amount of money received from the second user as a gift.

[0015] The image generating device (1) according to an aspect of the present disclosure may include a placement position setting unit (17) that sets a placement position of the virtual object (J) in the superimposed image (S). This makes it possible to suitably set the position of the virtual object (J) on the base image (B).

[0016] In an image generation device (1) according to one aspect of the present disclosure, an image acquisition unit (14) acquires a first virtual object (J1) and a second virtual object (J2) that is a virtual object (J) different from the first virtual object (J1), and a placement position setting unit (17) acquires a priority associated with the first virtual object (J1) for a placement position at which the first virtual object (J1) is to be placed, and may set the placement position in accordance with the acquired priority so that either the first virtual object (J1) or the second virtual object (J2) is more emphasized in the superimposed image (S). This allows the virtual object J to be displayed with appropriate emphasis in accordance with the priority determined based on various conditions.

[0017] In an image generating device (1) according to one aspect of the present disclosure, the base image (B) is an image captured by an imaging device (T11, T21) and displayed on an image display device (T12, T22) attached to the imaging device (T11, T21), and the image acquiring unit (14) may output a virtual object (J) to the image display device (T12, T22) to cause the image display device (T12, T22) to display a superimposed image (S) in which the virtual object (J) is superimposed on the base image (B). In this way, by displaying the superimposed image (S) on an AR display or the like, AR is specifically realized, which allows a user to visually recognize a virtual object (J) that does not exist in reality as if it were present on the base image (B).

[0018] An image generating device (1) according to an embodiment of the present disclosure may include a marker setting unit (16) that sets a marker (M) to serve as a reference for a placement position in a base image (B) captured by an imaging device (T11, T21). By setting the marker (M) for setting a placement position where a virtual object (J) is to be placed in AR, AR that allows a user to visually recognize a virtual object (J) that does not exist in reality as if it were present on the base image (B) is specifically realized.

[0019] In an image generating device (1A) according to one embodiment of the present disclosure, the base image (B) is an image configured as a virtual image, and the image acquiring unit (14A) may acquire the base image (B), superimpose a virtual object (J) on the acquired base image (B) to generate a superimposed image (S), and output the generated superimposed image (S) to the image display device (T12, T22), thereby displaying the superimposed image (S) on the image display device (T12, T22). In this way, by displaying the superimposed image (S) on a VR display or the like, VR is specifically realized, which allows a user to visually recognize a virtual object (J) that does not exist in reality as if it were present on the base image (B).

[0020] Note that the reference numerals in the parentheses above indicate the reference numerals of components in the embodiments described below as an example of the present disclosure, and do not limit the present disclosure to the aspects of the embodiments. [Effects of the Invention]

[0021] In this way, the image generation device according to the present disclosure can design the virtual object superimposed on the base image according to the user. [Brief explanation of the drawings]

[0022] [Figure 1] FIG. 1 is a block diagram showing an image generating apparatus according to the first embodiment. [Figure 2] FIG. 2 is a flowchart showing the first image generation process executed by the image generation device. [Figure 3] FIG. 3 is a diagram showing an image of a login screen displayed on the image display device on the sender side. [Figure 4] FIG. 4 is a diagram showing an image of a top page screen displayed on the image display device. [Figure 5] FIG. 5 is a diagram showing an image of a birthday list screen displayed on the image display device. [Figure 6] FIG. 6 is a diagram showing an image of a sender list screen displayed on the image display device. [Figure 7]FIG. 7 is a diagram showing an image of a message input screen displayed on the image display device. [Figure 8] FIG. 8 is a diagram showing an image of a virtual object selection screen displayed on the image display device. [Figure 9] FIG. 9 is a diagram showing an image of the virtual object confirmation screen displayed on the image display device. [Figure 10] FIG. 10 is a diagram showing an image of the layout position setting screen displayed on the image display device. [Figure 11] FIG. 11 is a diagram showing an image of the gift sending screen displayed on the image display device. [Figure 12] FIG. 12 is a diagram showing an image of a transmission completion screen displayed on the image display device. [Figure 13] FIG. 13 is a diagram showing an image of the My Page screen displayed on the image display device on the recipient side. [Figure 14] FIG. 14 is a diagram showing an image of a message display screen displayed on the image display device. [Figure 15] FIG. 15 is a diagram showing a superimposed image displayed on an image display device. [Figure 16] FIG. 16 is a diagram showing an image of a management screen displayed on the image display device on the administrator side. [Figure 17] FIG. 17 is a block diagram showing an image generating apparatus according to the second embodiment. [Figure 18] FIG. 18 is a flowchart showing the second image generation process executed by the image generation device. [Figure 19] FIG. 19 is a diagram showing an image of a management screen displayed on the image display device on the administrator side. DETAILED DESCRIPTION OF THE INVENTION

[0023] Hereinafter, exemplary embodiments will be described with reference to the drawings. Note that the same or corresponding parts in each drawing are designated by the same reference numerals, and redundant explanations will be omitted.

[0024] [First embodiment] FIG. 1 is a block diagram showing an image generation device 1 according to a first embodiment. The image generation device 1 shown in FIG. 1 is a device that acquires a virtual object J to be superimposed on a base image B to generate a superimposed image S (see FIG. 15), and the generated superimposed image S is displayed on a display or the like and viewed by a user. This allows the user to visually recognize a virtual object J that does not actually exist as if it were present on the base image B. In this embodiment, the base image B is based on, for example, a captured image capturing the user's field of vision. In other words, the image generation device 1 is a device that generates a virtual object J of a superimposed image S to be displayed on a display or the like in AR. Any technology can be applied as a specific AR technique.

[0025] Here, the "base image" is an image that serves as the background of the superimposed image S viewed by the user, and is, for example, an image of real space (real space image) captured by a camera or the like. In other words, the base image B is a background image in AR. The base image B is an image captured by the imaging devices T11, T21 and displayed on the image display devices T12, T22 (details will be described later). Furthermore, the "virtual object" is an image that is superimposed on the base image B to generate the superimposed image S. The virtual object J is, for example, a virtual image of an object or the like that does not exist in reality. "Does not exist in reality" means that it does not exist in the current location, and for example, a captured image of an object or the like that actually exists in another location may be used as the virtual object J.

[0026] The image generating device 1 generates a superimposed image S that is visible to at least one of a waiter and a customer in a restaurant where waiters entertain customers (a so-called restaurant with entertainment). "Entertainment" refers to a waiter entertaining a customer by communicating with the customer, and may, for example, be entertaining the customer in a way that creates a recreational atmosphere. A restaurant with entertainment may specifically be a cabaret or a nightclub.

[0027] Generally, in restaurants that provide entertainment, customers may give gifts (presents) to staff. For example, to celebrate some event (such as the arrival of a staff member's birthday), a customer may give the staff member a gift such as flowers to decorate the outside or inside of the restaurant. Image generating device 1 acquires a virtual object J representing the flowers as such a gift, which is to be superimposed on a base image B representing the restaurant to generate a superimposed image S. Then, by using AR, a user can view the superimposed image S in which the virtual object J is superimposed on the base image B, and the user, such as a staff member or a customer, will recognize that the gift such as flowers is actually displayed in the restaurant.

[0028] In the following description, a first user and a second user are exemplified as users. The "first user" is a store clerk who entertains a customer, and the "second user" is a customer who is entertained by the first user. A gift is given to the first user by the second user. Furthermore, the base image B is, for example, an image of a store where the first user entertains the second user, and the virtual object J is an image of a flower stand displayed in the store. A "flower stand" is a floral decoration consisting of one or more flowers (bouquets) arranged on a stand, and is also called a flower stand. The flower stand may include a nameplate placed near or inside the stand. The nameplate may display, for example, the name of the first user.

[0029] The image generation device 1 is composed of a computer 10 (server) capable of communicating with a first user terminal T1 and a second user terminal T2 (described later) via a network N. The image generation device 1 is physically configured with a control and arithmetic unit, a storage device, and an input / output device. The control and arithmetic unit is composed of a controller such as a CPU (Central Processing Unit), and executes arithmetic processing and controls the storage device and the input / output device. The storage device has, for example, a main storage device and an auxiliary storage device. The main storage device is composed of, for example, RAM (Random Access Memory). The auxiliary storage device is composed of, for example, ROM (Read Only Memory). The input / output device has, for example, an input device that receives data from the outside and transmits it to the storage device, and an output device that outputs, to the outside, the results of calculations performed by the control and arithmetic unit and stored in the storage device.

[0030] For example, the image generating device 1 executes predetermined processing by loading a program stored in a ROM into a RAM and executing the program loaded into the RAM by a CPU. Note that the computer 10 constituting the image generating device 1 may have a physical configuration different from that described above.

[0031] The first user terminal T1 is a terminal used by a first user, and the second user terminal T2 is a terminal used by a second user. Each of the first user terminal T1 and the second user terminal T2 has a physical configuration including a control and arithmetic unit, a storage device, and an input / output device. The control and arithmetic unit is composed of a controller such as a CPU, and executes arithmetic processing and controls the storage device and the input / output device. The storage device includes, for example, a main storage device and an auxiliary storage device. The main storage device is composed of, for example, RAM. The auxiliary storage device is composed of, for example, ROM. The input / output device includes, for example, an input device that inputs data from outside and transmits it to the storage device, and an output device that outputs to the outside the calculation results calculated by the control and arithmetic unit and stored in the storage device.

[0032] Each of the first user terminal T1 and the second user terminal T2 performs predetermined processing by, for example, loading a program stored in a ROM into a RAM and executing the program loaded into the RAM using a CPU. Each of the first user terminal T1 and the second user terminal T2 is configured to be able to communicate with another device, such as the image generation device 1, via a network N. Each of the first user terminal T1 and the second user terminal T2 may be, for example, a smartphone, a tablet, a laptop computer, a desktop computer, etc. Here, a smartphone is exemplified as each of the first user terminal T1 and the second user terminal T2.

[0033] The first user terminal T1 has an imaging device T11 such as a camera as an input device, and an image display device T12 such as a display as an output device. Similarly, the second user terminal T2 has an imaging device T21 such as a camera as an input device, and an image display device T22 such as a display as an output device.

[0034] The image display device T12 is provided adjacent to the imaging device T11 (located near the imaging device T11). Specifically, in the first user terminal T1, the imaging device T11 and the image display device T12 are provided so as to be located behind each other (back to back). In other words, the direction in which an image is captured by the imaging device T11 based on the position of the first user terminal T1 and the direction in which the image display device T12 is visible based on the position of the first user terminal T1 are opposite to each other. In this example, the first user terminal T1 captures (acquires) a base image B using the imaging device T11, and the captured base image B is displayed on the image display device T12.

[0035] Similarly, the image display device T22 is provided adjacent to the imaging device T21 (located near the imaging device T21). Specifically, in the second user terminal T2, the imaging device T21 and the image display device T22 are provided so as to be located behind each other (back to back). In other words, the direction in which an image is captured by the imaging device T21 based on the position of the second user terminal T2 and the direction in which the image display device T22 is visible based on the position of the second user terminal T2 are opposite to each other. In this case, the second user terminal T2 captures (acquires) a base image B using the imaging device T21, and the captured base image B is displayed on the image display device T22.

[0036] The following describes the functional configuration of the image generating device 1. The computer 10 of the image generating device 1 functionally includes a first user information acquiring unit 11, a second user information acquiring unit 12, a communication history information acquiring unit 13, an image acquiring unit 14, a billing unit 15, a marker setting unit 16, and an arrangement position setting unit 17.

[0037] The first user information acquisition unit 11 acquires the first user information. The first user information acquisition unit 11 may acquire the first user information by receiving the first user information from a terminal such as the first user terminal T1. "First user information" is information about the first user. For example, the first user information may be information that identifies the first user (personal identification information). Examples of the personal identification information may include name, address, hometown, age, and birthday. The first user information may also be information about the preferences of the first user (preference information). Examples of the preference information may include hobbies, favorite words, favorite music, favorite food and drink, and favorite colors.

[0038] The second user information acquisition unit 12 acquires second user information. The second user information acquisition unit 12 may acquire the second user information by receiving the second user information from a terminal such as the second user terminal T2. "Second user information" is information related to the second user. For example, the second user information may be information that identifies the second user (personal identification information), or information related to the preferences of the second user (preference information).

[0039] The communication history information acquisition unit 13 acquires communication history information. "Communication history information" refers to information relating to the history of communications performed between the first user terminal T1 and the second user terminal T2. For example, the communication history information may be information relating to the history of telephone conversations between the first user terminal T1 and the second user terminal T2 (call history information), information relating to the history of email transmissions and receptions between the first user terminal T1 and the second user terminal T2 (email history information), or information relating to the history of comments exchanged between the first user terminal T1 and the second user terminal T2 using a chat tool (chat history information). Alternatively, the communication history information may be information relating to the history of communication using a social networking service (SNS) between the account of a first user linked to the first user terminal T1 and the account of a second user linked to the second user terminal T2 (communication history information).

[0040] The communication history information acquisition unit 13 may acquire the communication history information by receiving the communication history information from, for example, the first user terminal T1 or the second user terminal T2. Alternatively, the communication history information acquisition unit 13 may acquire the communication history information by receiving the communication history information from an external device such as an external server (for example, an SNS server) that stores the communication history information.

[0041] The image acquisition unit 14 acquires a virtual object J. Specifically, the image acquisition unit 14 acquires a virtual object J (for example, a first virtual object J1 described later) in response to a request from the second user. Specifically, the image acquisition unit 14 may acquire the first virtual object J1 when receiving a virtual object generation request from the second user terminal T2 requesting that a first virtual object J1 be newly generated. The image acquisition unit 14 may acquire virtual objects J corresponding to a plurality of base images B. For example, the image acquisition unit 14 may acquire a virtual object J corresponding to a base image B that is an image of a store, and a virtual object J corresponding to a base image B that is an image of the home of the first user or the second user.

[0042] The image acquisition unit 14 may acquire the virtual object J by generating the virtual object J based on, for example, input information. The "input information" is information based on which the design of the virtual object J is determined. For example, the input information includes first user information and second user information. That is, the image acquisition unit 14 determines the design of the virtual object J based on the compatibility between the first user and the second user. The input information also includes communication history information, amount information, flower information, and fortune information.

[0043] The "amount information" is information about the amount of a charge to be made to the second user by the billing unit 15, which will be described later. Specifically, the amount information may be information about the amount required to acquire the virtual object J as a gift. The "flower information" may be information about the characteristics of the flower, and in particular, information about the characteristics of the flowers included in the stand flower of the virtual object J. Specifically, the flower information may be information about the flower language set for each type of flower, information about the color, shape, and size of each type of flower, or information about the place of origin of each type of flower. The "flower information" may also be information about the type of flower to be included in the stand flower. In this case, the type of flower related to the flower information may be specified by the first user or the second user. The "fortune information" is information about the fortune of the first user or the second user. The image acquisition unit 14 may store fortune information determined based on information about the first user and the second user in a database in advance.

[0044] The image acquisition unit 14 acquires first user information from the first user information acquisition unit 11, acquires second user information from the second user information acquisition unit 12, acquires communication history information from the communication history information acquisition unit 13, and acquires amount information from the billing unit 15. The image acquisition unit 14 may also store flower information in advance, or may acquire flower information from an external device such as an external server via the network N.

[0045] The image acquisition unit 14 may generate the virtual object J by any means based on the acquired input information. For example, the image acquisition unit 14 may refer to a correspondence map that associates the input information with the virtual object J, and generate the virtual object J based on the acquired input information. In this case, the image acquisition unit 14 may refer to a correspondence map that is stored in advance, or may access an external device such as an external server via the network N and refer to a correspondence map stored in the external device.

[0046] Alternatively, the image acquisition unit 14 may generate the virtual object J based on the acquired input information using so-called AI (Artificial Intelligence). As the AI, deep learning using a neural network may be adopted. Specifically, the image acquisition unit 14 may generate the virtual object J based on the acquired input information using a trained model in which a neural network is trained so that the input information is used as input data and the virtual object J is used as output data.

[0047] In the following description, the virtual object J includes a first virtual object J1 and a second virtual object J2. The "first virtual object" refers to a virtual object J whose design is determined based on input information including first user information and second user information. In this case, the second user information refers to second user information related to a second user who is the user of interest in that context. The "second virtual object" refers to a virtual object J different from the first virtual object J1. For example, the first virtual object J1 may be a virtual object J associated with the second user, whereas the second virtual object J2 may be a virtual object J associated with a user other than the second user. The second virtual object may be, for example, an image of a flower stand or an image (two-dimensional or three-dimensional) of the first user.

[0048] The image acquisition unit 14 outputs the virtual object J to the image display device T12 of the first user terminal T1 or the image display device T22 of the second user terminal T2. At this time, since the first user terminal T1 or the second user terminal T2 has acquired the base image B, the image acquisition unit 14 can cause the image display devices T12, T22 to display a superimposed image S in which the virtual object J is superimposed on the base image B. In this way, the image generation device 1 realizes the AR function in cooperation with the first user terminal T1 or the second user terminal T2.

[0049] The charging unit 15 charges the second user when the image acquisition unit 14 acquires the first virtual object J1 in response to a request from the second user. The charging unit 15 may charge the second user an amount input by the second user via the second user terminal T2. In this case, the charging unit 15 may present a plurality of amount options to the second user terminal T2 and charge the second user an amount related to the option selected by the second user. The charging unit 15 may grant points to the second user according to the amount charged. The points may be usable for payment at a store, for example.

[0050] The billing unit 15 may bill the second user as follows. That is, the billing unit 15 may execute a process of debiting a pre-registered bank account, may execute a process of sending information instructing the debit from the bank account to an external server (for example, a bank server), or may execute a process of sending information instructing the billing to a server of a credit card company (a company that handles billing) or the like. In this way, the timing at which the billing unit 15 executes the billing may or may not coincide with the timing at which the payment is actually made.

[0051] The marker setting unit 16 sets a marker M to serve as a reference for the placement position of a virtual object J in a base image B captured by the imaging device T11 of the first user terminal T1 or the imaging device T21 of the second user terminal T2 (see FIG. 16 ). A “marker” is a mark with a predetermined shape or the like that serves as a reference when AR content is displayed on an image. When a superimposed image S is generated by superimposing the virtual object J on the base image B, the marker M serves as a reference for the position at which the virtual object J is displayed on the base image B. In this case, since the base image B is an image of a store, the marker M may be, for example, an image of a mark (such as the store's logo) displayed in or near the store, an image of the store's signboard (such as a signboard posted on the facade), or an image of a structure (such as a door) that constitutes the store.

[0052] Information about the markers set by the marker setting unit 16 is transmitted from the marker setting unit 16 to the first user terminal T1 or the second user terminal T2. The first user terminal T1 performs image processing on the base image B captured by the imaging device T11 to detect (extract) image portions corresponding to the markers M from the base image B. For example, the first user terminal T1 may perform image processing using pattern matching. Specifically, the first user terminal T1 may perform edge detection on the base image B, and then perform template matching on the image after edge detection using a template image stored in advance. These processes are also similar to those performed by the second user terminal T2.

[0053] The placement position setting unit 17 sets a placement position where the virtual object J is to be placed in the superimposed image S. Specifically, the placement position setting unit 17 sets a placement position where the virtual object J is to be placed in accordance with predetermined conditions, based on the position of the marker M set by the marker setting unit 16. Furthermore, the placement position setting unit 17 may change (set) the placement position of the virtual object J based on information received from, for example, the first user terminal T1 or the second user terminal T2.

[0054] The placement position setting unit 17 may acquire a priority associated with the first virtual object J1 with respect to the placement position at which the first virtual object J1 is placed in the base image B. The "priority" is an index representing the degree to which each of the multiple virtual objects J should be displayed with a higher priority than other virtual objects J. The priority may be determined, for example, according to the amount of a charge executed by the charging unit 15. Furthermore, when the superimposed image S is displayed on the second user terminal T2 of the second user, the priority of the first virtual object J1 associated with the second user may be determined to be higher than the priority of virtual objects J associated with other users. In other words, for the second user, the priority of his / her virtual object J may be determined to be higher than the priority of virtual objects J of other users.

[0055] Then, the placement position setting unit 17 determines the placement positions of the first virtual object J1 and the second virtual object J2 according to the acquired priority so that either the first virtual object J1 or another virtual object J (i.e., the second virtual object J2) is more emphasized in the superimposed image S. "Emphasis on one of the virtual objects J" means that the one of the virtual objects J is displayed in a state in which it is more easily visible in the superimposed image S than the other virtual objects J. For example, when one of the virtual objects J is emphasized more than the other virtual objects J, the one of the virtual objects J may be displayed closer to the center of the superimposed image S (closer to the image of the store) than the other virtual objects J, may be displayed in front of the other virtual objects J, may be displayed larger than the other virtual objects J, or may be displayed in a color that is more easily visible than the other virtual objects J. For example, the placement positions are determined so that the higher the priority of the virtual object J, the more emphasized it is. Note that the placement position setting unit 17 may determine the placement position so that the first virtual object J1 is superimposed on a real flower stand displayed in the store. For example, the placement position setting unit 17 may determine the placement position so that the first virtual object J1 is superimposed on a stand flower that has been given by another user, among the actual stand flowers displayed in a store.

[0056] [First image generation process] The following describes the first image generation process executed by the image generation device 1. Fig. 2 is a flowchart showing the first image generation process executed by the image generation device 1. The first image generation process is a process in which the image generation device 1 acquires a virtual object J. The virtual object J acquired by the image generation device 1 through the first image generation process is superimposed on the base image B in the second user terminal T2 to generate a superimposed image S. In other words, the first image generation process is a process in which the virtual object J used in the superimposed image S for AR is generated.

[0057] 2, examples of screen images displayed on the image display device of the sender (customer giving a gift to a store clerk), the image display device of the recipient (store clerk receiving a gift from the customer), and the image display device of the administrator (person in charge of managing the exchange of gifts) are given below. Here, as an example, the sender is a second user, and the image display device of the sender is image display device T22 of the second user terminal T2. Also, as an example, the receiver and the administrator are the same first user, and the image display device of the receiver and the image display device of the administrator are image display device T12 of the same first user terminal T1.

[0058] In step S10, the first user information acquisition unit 11 of the image generation device 1 acquires the first user information. The first user information acquisition unit 11 may acquire the first user information by receiving the first user information from the first user terminal T1, for example. Thereafter, the first image generation process proceeds to step S12.

[0059] In step S12, the second user information acquisition unit 12 of the image generation device 1 acquires the second user information. The second user information acquisition unit 12 may acquire the second user information by receiving the second user information from the second user terminal T2, for example. Thereafter, the first image generation process proceeds to step S14.

[0060] In step S14, the communication history information acquisition unit 13 of the image generation device 1 acquires the communication history information. The communication history information acquisition unit 13 may acquire the communication history information by receiving the communication history information from, for example, the first user terminal T1 or the second user terminal T2. Alternatively, the communication history information acquisition unit 13 may acquire the communication history information by receiving the communication history information from an external device, such as an external server, that stores the communication history information. Thereafter, the first image generation process proceeds to step S16.

[0061] Now, leaving the flowchart of Fig. 2, an explanation will be given of the image displayed on the image display device T22 of the second user terminal T2. Fig. 3 is a diagram showing an image of a login screen displayed on the image display device T22 on the sender side. When the second user terminal T2 accesses the image generation device 1, the login screen is displayed on the image display device T22. When a user ID and password are entered on the login screen, the login process is executed.

[0062] 4 is a diagram showing an image of the top page screen displayed on the image display device T22. When the second user terminal T2 logs in, the top page screen is displayed on the image display device T22. When the button labeled "BIRTHDAY" on the top page screen is touched, the birthday gifting process starts. "Birthday gifting" is a process in which a sender (second user) gives a gift to a recipient (first user).

[0063] 5 is a diagram showing an image of the birthday list screen displayed on the image display device T22. When the birthday gifting process is started, the birthday list screen is displayed on the image display device T22. The birthday list screen displays, for example, the employees of the target store who have birthdays or whose birthdays are coming up soon. When the image of one of these employees is touched, the screen transitions to a screen related to that employee.

[0064] 6 is a diagram showing an image of the sender list screen displayed on the image display device T22. The sender list screen lists the gifts given to the store clerk and the customers (senders) who gave the gifts. Specifically, the sender list screen displays the name of the customer who gave the gift, the content of the message attached to the gift, and the amount charged when giving the gift. When the button labeled "+Birthday card" on the sender list screen is touched, a message input screen for creating a new birthday card is displayed.

[0065] 7 is a diagram showing an image of a message input screen displayed on the image display device T22. An image of a birthday card is displayed on the message input screen, and a message is input to the birthday card via the second user terminal T2.

[0066] 8 is a diagram showing an image of a virtual object selection screen displayed on the image display device T22. When input of a message to be written on the birthday card is completed, a virtual object selection screen for selecting a virtual object J (i.e., a first virtual object J1) as a gift is displayed. Images of multiple virtual objects J are displayed on the virtual object selection screen, and a touched virtual object J is selected. Here, a charge amount is set for each of the multiple virtual objects J as compensation for generating that virtual object J.

[0067] 9 is a diagram showing an image of a virtual object confirmation screen displayed on the image display device T22. The virtual object confirmation screen is a screen for confirming that a new virtual object J (first virtual object J1) selected on the virtual object selection screen is to be generated. When the button labeled "OK" on the virtual object confirmation screen is touched, a virtual object generation request is sent to the image generation device 1.

[0068] 2, in step S16, the image acquisition unit 14 of the image generation device 1 receives a virtual object generation request for newly generating a first virtual object J1 from the second user terminal T2. Thereafter, the first image generation process proceeds to step S18.

[0069] In step S18, the billing unit 15 of the image generating device 1 bills the second user. Specifically, the billing unit 15 bills the second user for the amount of virtual object J selected by the second user on the virtual object selection screen. The billing unit 15 may execute a process of debiting a pre-registered bank account, or may execute a process of sending information instructing the debit from the bank account to an external server (e.g., a bank server), or may execute a process of sending information instructing the billing to a server of a credit card company (a company that handles billing) or the like. Thereafter, the first image generation process proceeds to step S20.

[0070] In step S20, image acquisition unit 14 of image generation device 1 acquires amount information regarding the amount of the charge to be made to the second user based on information regarding the charge made by charging unit 15. As a result, the input information includes amount information. Thereafter, the first image generation process proceeds to step S22.

[0071] In step S22, the image acquisition unit 14 of the image generation device 1 acquires a first virtual object J1. Specifically, the image acquisition unit 14 acquires the virtual object J by generating the virtual object J based on input information. The input information includes first user information, second user information, communication history information, price information, and flower information. The image acquisition unit 14 may generate the virtual object J based on the acquired input information by referring to a correspondence map that associates the input information with the virtual object J, or may generate the virtual object J based on the acquired input information using so-called AI. Thereafter, the first image generation process proceeds to step S24.

[0072] In step S24, the marker setting unit 16 of the image generation device 1 sets a marker to be used as a reference for the placement position of the virtual object J in the base image B captured by the imaging device T21 of the second user terminal T2. Here, since the base image B is an image of a store, the marker may be, for example, an image of a mark (such as the store's logo) displayed in or near the store, an image of the store's signboard (such as a signboard posted on the facade), or an image of a structure (such as a door) that constitutes the store (see FIG. 16). Information about the marker set by the marker setting unit 16 is transmitted from the marker setting unit 16 to the second user terminal T2. Thereafter, the first image generation process proceeds to step S26.

[0073] In step S26, the placement position setting unit 17 of the image generation device 1 acquires a priority associated with the first virtual object J1 with respect to the placement position at which the first virtual object J1 is placed in the base image B. The priority may be determined, for example, according to the amount of the charge executed by the charging unit 15, or may be determined so that the priority of the first virtual object J1 associated with the second user is higher than the priority of the virtual object J1 associated with the other user. Then, the first image generation process proceeds to step S28.

[0074] In step S28, the placement position setting unit 17 of the image generation device 1 sets a placement position where the virtual object J is to be placed in the superimposed image S. Specifically, the placement position setting unit 17 sets a placement position where the virtual object J is to be placed in accordance with predetermined conditions, using the position of the marker M set by the marker setting unit 16 as a reference. Here, the placement position setting unit 17 determines the placement positions of the first virtual object J1 and the second virtual object J2 in accordance with the acquired priority so that either the first virtual object J1 or the second virtual object J2 is more emphasized in the superimposed image S. Thereafter, the first image generation process proceeds to step S30.

[0075] Now, leaving the flowchart of Fig. 2, an image displayed on the image display device T22 of the second user terminal T2 will be described. Fig. 10 is a diagram showing an image of the placement position setting screen displayed on the image display device T22. As shown in Fig. 10, the placement position setting unit 17 may set the position specified by the second user as the placement position of the virtual object J. Furthermore, the placement position setting unit 17 may change the placement position of the virtual object J based on information received from, for example, the first user terminal T1 or the second user terminal T2.

[0076] 11 is a diagram showing an image of the gift sending screen displayed on the image display device T22. When the placement position of the virtual object J in the superimposed image S is set, the gift sending screen for sending a gift with a message linked to the virtual object J is displayed.

[0077] 12 is a diagram showing an image of a transmission completion screen displayed on an image display device. As shown in FIG. 12, when the second user approves sending (giving) the gift, the gift sending process is executed and the transmission completion screen is displayed.

[0078] Next, we will explain the images displayed on the image display device T12 of the first user terminal T1. Fig. 13 is a diagram showing an image of the My Page screen displayed on the image display device T12 on the recipient's side. The My Page screen displays a list of gifts sent by multiple senders, including the second user. Specifically, the My Page screen displays the name of the customer who sent the gift, the content of the message attached to the gift, and the amount charged for the gift.

[0079] 14 is a diagram showing an image of a message display screen displayed on the image display device T12. When a screen area related to any gift displayed on the My Page screen is touched, a message associated with that gift is displayed on the message display screen.

[0080] 2, in step S30, the image acquisition unit 14 of the image generation device 1 outputs the first virtual object J1 to at least one of the first user terminal T1 (the image display device T12 of the first user terminal T1) and the second user terminal T2 (the image display device T22 of the second user terminal T2). This completes the first image generation process.

[0081] The first user terminal T1 or the second user terminal T2 to which the first virtual object J1 has been input performs image processing on the base image B captured by the imaging devices T11 and T21, thereby detecting (extracting) an image portion corresponding to the marker M from the base image B. For example, the first user terminal T1 or the second user terminal T2 may perform image processing by pattern matching. Specifically, the first user terminal T1 or the second user terminal T2 may perform edge detection on the base image B, and then perform template matching on the image after edge detection using a template image stored in advance.

[0082] 15 is a diagram showing a superimposed image S displayed on the image display devices T12 and T22. As shown in FIG. 15, the image acquisition unit 14 causes the image display devices T12 and T22 to display a superimposed image S in which a virtual object J is superimposed on a base image B. More specifically, when a base image B is acquired by capturing an image of a store using the imaging device T11 of the first user terminal T1 or the imaging device T21 of the second user terminal T2, if a marker M is detected in the base image B, a superimposed image S in which a virtual object J is superimposed at a predetermined position based on the marker M is displayed on the image display device T12 of the first user terminal T1 or the image display device T22 of the second user terminal T2. In this way, the image generation device 1 realizes the AR function in cooperation with the first user terminal T1 or the second user terminal T2.

[0083] Note that the superimposed image S may be displayed on the image display device T12 or the image display device T22 when the imaging device T11 of the first user terminal T1 or the imaging device T21 of the second user terminal T2 reads a code such as a QR code (registered trademark) posted in a store. Alternatively, the superimposed image S may be displayed on the image display device T12 or the image display device T22 when the first user terminal T1 or the second user terminal T2 comes within a predetermined distance of a device in the store. The distance between the first user terminal T1 or the second user terminal T2 and the device in the store may be determined based on communication via Bluetooth (registered trademark), for example. An image such as the superimposed image S displayed on the image display device T12 or the image display device T22 may be stored in the terminal by a screenshot or the like, or may be automatically transmitted (or made public) to a server of a social networking service (SNS) or a video sharing service upon being displayed on the image display device T22.

[0084] Here, the AR management screen displayed on the image display device T12 of the first user terminal T1 will be described. FIG. 16 is a diagram showing an image of the management screen displayed on the image display device T12 on the administrator side. In addition to an image of the store, the management screen displays the settings of the marker M and a list of gifts previously given by the second user. On the management screen, for example, it is possible to change the image used as the marker M or obtain information about second users to whom the first user has given gifts in the past. Furthermore, on the management screen, comments, music, images, videos, etc. may be set in advance by the first user. In this case, when the superimposed image S is displayed on the image display device T22 of the second user terminal T2, the set comments, music, images, videos, etc. may be played back (or displayed by push notification, etc.) on the second user terminal T2.

[0085] [Action and effect] As described above, the image generation device 1 includes a first user information acquisition unit 11 that acquires first user information about a first user who is a store clerk who entertains customers, a second user information acquisition unit 12 that acquires second user information about a second user who is a customer who is entertained by the first user, and an image acquisition unit 14 that acquires a virtual object J to be superimposed on a base image B to generate a superimposed image S, and the image acquisition unit 14 acquires a first virtual object J1, which is a virtual object J whose design is determined based on input information including the first user information and the second user information, in response to a request from the second user.

[0086] According to this image generating device 1, in response to a request from a second user, a virtual object J is acquired to be superimposed on a base image B to generate a superimposed image S. This superimposed image S is used in AR or VR, for example, by being displayed on a display or the like, to allow a user to visually recognize a virtual object J that does not actually exist as if it were present on the base image B. Here, according to the image generating device 1, the design of the virtual object J is determined according to information about a first user and a second user who are in a relationship between a waiter and a customer at a restaurant that involves entertainment, for example. Thus, according to the image generating device 1, the virtual object J to be superimposed on the base image B can be designed according to the user.

[0087] In the image generating device 1, the base image B is an image of a store where a first user entertains a second user. This makes it possible to reproduce, using AR or VR, the act of displaying a gift given to the first user by the second user in the store.

[0088] In the image generating device 1, the virtual object J is an image of a flower stand. This makes it possible to reproduce the act of giving a flower stand as a gift from the second user to the first user using AR or VR.

[0089] In the image generating device 1, the input information includes flower information regarding the characteristics of the flowers included in the stand flower. This allows the stand flower including flowers with characteristics suitable for the first and second users to be a gift from the second user to the first user.

[0090] The image generating device 1 includes a communication history information acquiring unit 13 that acquires communication history information relating to the history of communications between a first user terminal T1 used by a first user and a second user terminal T2 used by a second user, and the input information includes the communication history information. This allows a virtual object J designed according to the past communication history between the first user and the second user to be a gift from the second user to the first user.

[0091] The image generating device 1 includes a billing unit 15 that bills the second user when the image acquiring unit 14 acquires the first virtual object J1 in response to a request from the second user. This allows the first user to receive a fee for a gift from the second user.

[0092] In the image generating device 1, the input information includes amount information regarding the amount of money to be charged to the second user by the charging unit 15. This allows the second user to give the first user a gift of a virtual object J designed according to the amount received from the second user.

[0093] The image generating device 1 includes a placement position setting unit 17 that sets the placement position of the virtual object J in the superimposed image S. This makes it possible to suitably set the position of the virtual object J on the base image B.

[0094] In the image generation device 1, the image acquisition unit 14 acquires a first virtual object J1 and a second virtual object J2, which is a virtual object J different from the first virtual object J1, and the placement position setting unit 17 acquires a priority associated with the first virtual object J1 regarding the placement position at which the first virtual object J1 is to be placed, and sets the placement position according to the acquired priority so that either the first virtual object J1 or the second virtual object J2 is more emphasized in the superimposed image S. This allows the virtual object J to be displayed with appropriate emphasis according to the priority determined by various conditions.

[0095] In the image generation device 1, the base image B is an image captured by the imaging devices T11, T21 and displayed on the image display devices T12, T22 attached to the imaging devices T11, T21, and the image acquisition unit 14 outputs the virtual object J to the image display devices T12, T22, thereby causing the image display devices T12, T22 to display a superimposed image S in which the virtual object J is superimposed on the base image B. In this way, by displaying the superimposed image S on an AR display or the like, AR is specifically realized, which allows the user to visually recognize the virtual object J, which does not exist in reality, as if it were present on the base image B.

[0096] The image generating device 1 includes a marker setting unit 16 that sets a marker M to be used as a reference for a placement position in a base image B captured by the imaging devices T11 and T21. By setting the marker M to set a placement position where a virtual object J is to be placed in AR, AR that allows a user to visually recognize a virtual object J that does not exist in reality as if it were present on the base image B is specifically realized.

[0097] [Second embodiment] An image generating device 1A according to the second embodiment will be described. FIG. 17 is a block diagram showing the image generating device 1A according to the second embodiment. Similar to the image generating device 1 according to the first embodiment, the image generating device 1A shown in FIG. 17 is a device that acquires a virtual object J to be superimposed on a base image B to generate a superimposed image S. The generated superimposed image S is displayed on a display or the like and viewed by a user. This allows the user to visually recognize the virtual object J, which does not actually exist, as if it were present on the base image B. Meanwhile, in this embodiment, the base image B is an image configured as a virtual image (in other words, an image representing an artificially generated virtual space). In other words, the base image B is a background image in VR, and the image generating device 1A is a device that generates the virtual object J of the superimposed image S to be displayed on a display or the like in VR. Any technology can be applied as a specific VR technique. The base image B may be an image representing a virtual space that imitates real space.

[0098] The computer 10A of the image generation device 1A functionally includes a first user information acquisition unit 11A, a second user information acquisition unit 12A, a communication history information acquisition unit 13A, an image acquisition unit 14A, a billing unit 15A, and an arrangement position setting unit 17A. The functional configuration of the image generation device 1A is different from the functional configuration of the image generation device 1 in that the image generation device 1A does not include a marker setting unit 16 and the image acquisition unit 14A has a function for VR rather than a function for AR, but is otherwise equivalent. In other words, the first user information acquisition unit 11A, the second user information acquisition unit 12A, the communication history information acquisition unit 13A, the billing unit 15A, and the arrangement position setting unit 17A of the image generation device 1A each have the same functions as the first user information acquisition unit 11, the second user information acquisition unit 12, the communication history information acquisition unit 13, the billing unit 15, and the arrangement position setting unit 17 of the image generation device 1, respectively. The image generating device 1A will be described below, focusing on the main differences from the image generating device 1.

[0099] The image acquisition unit 14A acquires a base image B. The base image B is a virtual image generated by the image generation device 1 or an external computer or the like. When the base image B is generated by an external computer or the like, the image acquisition unit 14A may acquire the base image B by, for example, accessing the computer or the like via the network N, or may acquire the base image B via a predetermined storage medium.

[0100] The image acquisition unit 14A generates a superimposed image S by superimposing a virtual object J on the acquired base image B. Then, the image acquisition unit 14A outputs the generated superimposed image S to the first user terminal T1 (the imaging device T11 of the first user terminal T1) or the second user terminal T2 (the image display device T22 of the second user terminal T2), thereby causing the superimposed image S in which the virtual object J is superimposed on the base image B to be displayed on the image display devices T12, T22. In this way, the image generation device 1A realizes the function of VR in cooperation with the first user terminal T1 or the second user terminal T2.

[0101] [Second image generation process] The second image generation process executed by the image generation device 1A will be described. Fig. 18 is a flowchart showing the second image generation process executed by the image generation device 1A. The second image generation process is a process in which the image generation device 1A acquires a base image B and a virtual object J, generates a superimposed image S, and outputs the generated superimposed image S. In other words, the second image generation process is a process in which a superimposed image S for VR is generated.

[0102] The flowchart in Fig. 18 will be described below. The second image generation process shown in Fig. 18 is substantially equivalent to the first image generation process shown in Fig. 2 in the following respects. That is, steps S40 to S52 in the second image generation process are substantially equivalent to steps S10 to S22 in the first image generation process. Also, steps S56 and S58 in the second image generation process are substantially equivalent to steps S26 and S28 in the first image generation process. The second image generation process will be described below, focusing on the main differences from the first image generation process.

[0103] In step S54, the image acquisition unit 14A of the image generating device 1A acquires the base image B. If the base image B is generated by an external computer or the like, the image acquisition unit 14A may acquire the base image B by, for example, accessing the computer or the like via the network N, or may acquire the base image B via a predetermined storage medium.

[0104] Furthermore, once the placement position of the virtual object J in the base image B is determined in step S58, in S60 the image acquisition unit 14A of the image generation device 1A superimposes the virtual object J on the base image B to generate a superimposed image S. Thereafter, the second image generation process proceeds to step S62.

[0105] In step S62, the image acquisition unit 14A of the image generation device 1A outputs the generated superimposed image S to at least one of the first user terminal T1 (the image display device T12 of the first user terminal T1) and the second user terminal T2 (the image display device T22 of the second user terminal T2). This completes the first image generation process.

[0106] The superimposed image S is input from the image acquisition unit 14A and displayed on the image display device T12 of the first user terminal T1 or the image display device T22 of the second user terminal T2. In this way, the image generation device 1A realizes the VR function in cooperation with the first user terminal T1 or the second user terminal T2.

[0107] Here, the VR management screen displayed on the image display device T12 of the first user terminal T1 will be described. Fig. 19 is a diagram showing an image of the management screen displayed on the image display device T12 on the administrator side. The management screen displays an image of the store as well as a list of gifts that the second user has given in the past. On the management screen, for example, it is possible to obtain information about second users who have given gifts in the past.

[0108] [Action and effect] As described above, in the image generating device 1A, the base image B is an image configured as a virtual image, and the image acquiring unit 14A acquires the base image B, superimposes a virtual object J on the acquired base image B to generate a superimposed image S, and outputs the generated superimposed image S to the image display devices T12, T22, thereby displaying the superimposed image S on the image display devices T12, T22. In this way, by displaying the superimposed image S on a VR display or the like, VR is specifically realized, which allows the user to visually recognize the virtual object J, which does not exist in reality, as if it were present on the base image B.

[0109] [Transformation] The above-described embodiment can be implemented in various forms with modifications or improvements made based on the knowledge of those skilled in the art.

[0110] For example, matters described as "entertainment" in the first and second embodiments described above may also be described as "customer service." "Customer service" refers to a waiter providing a customer with a standardized response to facilitate the customer's meal and payment. Compared to entertainment, customer service does not involve close communication between the waiter and the customer, and does not create a particularly leisurely atmosphere. The eating and drinking establishment where customer service is provided may specifically be a restaurant. In this case, the first user is a waiter who serves the customer, the second user is a customer who is served by the first user, and base image B is an image of the store where the first user serves the second user. Furthermore, in the definitions and explanations of terms other than those described above, matters described as "entertainment" in the first and second embodiments may also be read as "customer service."

[0111] For example, in the first embodiment described above, the image acquisition unit 14 of the image generation device 1 may acquire a base image B and generate a superimposed image S by superimposing a virtual object J on the acquired base image B. Furthermore, the image acquisition unit 14 may output the generated superimposed image S to at least one of the first user terminal T1 (the image display device T12 of the first user terminal T1) and the second user terminal T2 (the image display device T22 of the second user terminal T2). In this way, the image generation device 1 may realize the AR function in cooperation with the first user terminal T1 or the second user terminal T2.

[0112] Furthermore, the image generation device 1 may also have the functions of the image generation device 1A. That is, the image generation device 1 may have a function of generating a virtual object J for AR and displaying a superimposed image S in which the virtual object J is superimposed on a base image B on the image display devices T12 and T22, and a function of acquiring a base image B and generating a virtual object J for VR, generating a superimposed image S from the base image B and the virtual object J, and displaying the generated superimposed image S on the image display devices T12 and T22. That is, the image generation device 1 may be a device that generates (acquires) a virtual object J for generating a superimposed image S by superimposing it on a base image B that serves as a background image in at least one of AR and VR.

[0113] Furthermore, the image generation device 1 in the first embodiment is a device that generates a superimposed image S for AR, and the image generation device 1A in the second embodiment is a device that generates a superimposed image S for VR. However, the image generation device is not limited to a device that generates a superimposed image S for AR or VR. For example, the image generation device may be a device that generates a superimposed image S for MR (Mixed Reality).

[0114] The design of the first virtual object J1 does not have to be determined for each stand flower, but may be determined for each individual flower, for example. The image acquisition unit 14 may also randomly determine the type of flower included in the virtual object J, which is an image of a stand flower. [Explanation of symbols]

[0115] 1,1A Image generating device 10,10A Computer 11, 11A First user information acquisition unit 12, 12A Second user information acquisition unit 13, 13A Communication history information acquisition unit 14,14A Image acquisition unit 15,15A Charging section 16 Marker setting section 17,17A Placement position setting section B Base image J Virtual Object J1 First virtual object J2 Second virtual object M marker N Network S Superimposed image T1 First user terminal T2 Second user terminal T21 imaging device T22 Image display device

Claims

1. a first user information acquisition unit that acquires first user information related to a first user who is a store clerk who serves or entertains customers; a second user information acquisition unit that acquires second user information regarding each of one or more second users who are customers who are served or entertained by the first user; an image acquisition unit that acquires a virtual object to be superimposed on a base image to generate a superimposed image; a placement position setting unit that sets a placement position at which the virtual object is to be placed in the superimposed image; a charging unit for charging the second user; Equipped with In response to a request from the second user, the image acquisition unit acquires the virtual object associated with the second user who made the request, the design of which is determined based on input information including the first user information and the second user information who made the request; the billing unit executes billing for the second user who has made the request; When the image acquisition unit has acquired the plurality of virtual objects associated with each of the plurality of second users in response to requests from the plurality of second users, the arrangement position setting unit: acquiring a priority associated with each of the plurality of virtual objects, the priority being determined according to the amount of the charge executed by the charging unit for each of the plurality of second users who have made the request; setting the placement positions of the plurality of virtual objects simultaneously displayed in the superimposed image such that the higher the priority associated with each virtual object, the more easily the virtual object is displayed in the superimposed image; Image generating device.

2. The image generating device according to claim 1 , wherein the base image is an image of a store where the first user serves or entertains the second user.

3. The image generating device according to claim 1 or 2, wherein the virtual object is an image of a flower stand.

4. The image generating device according to claim 3 , wherein the input information includes flower information relating to characteristics of the flowers included in the stand flower.

5. a communication history information acquisition unit that acquires communication history information regarding a history of communication performed between a first user terminal used by the first user and a second user terminal used by the second user; 5. The image generating device according to claim 1, wherein the input information includes the communication history information.

6. An image generating device as described in any one of claims 1 to 5, wherein the input information includes amount information regarding the amount of the charge made to the second user by the charging unit.

7. The base image is an image captured by an imaging device and displayed on an image display device attached to the imaging device, The image generating device according to any one of claims 1 to 6, wherein the image acquisition unit outputs the virtual object to the image display device, thereby causing the image display device to display the superimposed image in which the virtual object is superimposed on the base image.

8. An image generating device as described in Claim 7, comprising a marker setting unit that sets a marker to serve as a reference for the placement position in the base image captured by the imaging device.

9. The base image is an image constructed as a virtual image, The image generating device according to any one of claims 1 to 6, wherein the image acquisition unit acquires the base image, superimposes the virtual object on the acquired base image to generate the superimposed image, and outputs the generated superimposed image to an image display device, thereby displaying the superimposed image on the image display device.

Images