Image generation system

Abstract

To capture images of users located in different places separately and generate a synthesized image by synthesizing the images of the users.SOLUTION: An image generation system includes a first printed matter making apparatus, a second printed matter making apparatus, and a server device. The first printed matter making apparatus includes: a first imaging unit which captures an image of a first user to generate a first captured image; a first communication unit which transmits the first captured image to the server device and receives first identification information corresponding to the first captured image from the server device; and a first printer which print-outs the first identification information. The second printed matter making apparatus includes: a second imaging unit which captures an image of a second user to generate a second captured image; a second communication unit which transmits the input first identification information to the server device and receives the first captured image corresponding to the first identification information from the server device; and an image processing unit which generates a synthesized image by synthesizing the first captured image with the second captured image.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to an image generation system.

Background Art

[0002] In recent years, an image printing device (e.g., Princlat (registered trademark)) that takes a user's photo and prints and outputs it on a medium such as a dedicated photo paper or sticker has been installed in game centers and the like. A conventional image printing device takes a picture of a person posing in a shooting box with a camera, performs a process of removing the background from the obtained image and extracting only the photographed person, and synthesizes and prints out the background image or character image such as a mascot prepared in advance as image data and the extracted person image.

[0003] Also, a system has been proposed that uses two communicably connected image printing devices to photograph users A and B located in remote locations respectively, synthesizes a person image cut out from the photographed image of user A and a person image cut out from the photographed image of user B, and prints the synthesized image (see, for example, Patent Document 1). Each image printing device is provided with a display, a microphone, and a speaker. Users A and B confirm the synthesized image displayed on the display while talking, adjust their positions with each other, and perform shooting.

[0004] Such a conventional system uses two image printing devices simultaneously. In the case of a proof photo shooting box in which image printing devices are installed in the city, it was necessary to wait until two devices could be used simultaneously. Also, since shooting was performed simultaneously with two image printing devices, it was necessary for users A and B to adjust their schedules and match their times.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

[0006] The present invention aims to provide an image generation system that separately photographs users at different locations and generates a composite image by combining the images of each user. [Means for solving the problem]

[0007] The image generation system according to the present invention comprises a first printmaking apparatus, a second printmaking apparatus, and a server device that is communicatively connected to the first printmaking apparatus and the second printmaking apparatus, wherein the first printmaking apparatus has a first shooting unit that photographs a first user and generates a first captured image, a first communication unit that transmits the first captured image to the server device and receives first identification information corresponding to the first captured image from the server device, and a first printer that prints out the first identification information, and the second printmaking apparatus has a second shooting unit that photographs a second user and generates a second captured image, a second communication unit that transmits the input first identification information to the server device and receives the first captured image corresponding to the first identification information from the server device, and an image processing unit that generates a composite image by combining the first captured image and the second captured image. [Effects of the Invention]

[0008] According to the present invention, it is possible to separately photograph users at different locations and generate a composite image by combining the images of each user. [Brief explanation of the drawing]

[0009] [Figure 1] This is a schematic diagram of an image generation system according to an embodiment of the present invention. [Figure 2] Figure 2A shows the first image, Figure 2B shows an image of a hand-drawn picture, Figure 2C shows the second image, and Figure 2D shows a composite image. [Figure 3] This is a diagram showing an example of a print. [Figure 4] This is a functional block diagram of the server device. [Figure 5] This is a schematic diagram of the print production apparatus. [Figure 6] This is a functional block diagram of the arithmetic control unit. [Figure 7] This is a flowchart explaining the processing in a printmaking device. [Modes for carrying out the invention]

[0010] Embodiments of the present invention will be described below with reference to Figures 1 to 7. Figure 1 is a schematic diagram of an image generation system according to an embodiment of the present invention. The image generation system comprises a server device 1 and a plurality of print production devices 2A and 2B, and the server device 1 and the print production devices 2A and 2B are connected in a communicative manner. The print production devices 2A and 2B are, for example, shooting boxes having a shooting device and a printer, and are installed at separate locations. The number of print production devices is not limited to two, but may be three or more.

[0011] User A takes a photograph using the print manufacturing device 2A. The print manufacturing device 2A generates a first captured image and sends it to the server device 1. Figure 2A shows an example of the first captured image G1. The server device 1 assigns first identification information to the first captured image received from the print manufacturing device 2A and stores the first captured image and the first identification information linked together. The server device 1 also generates a two-dimensional code (first code) representing the first identification information and sends it to the print manufacturing device 2A.

[0012] The print-making device 2A prints the first code received from the server device 1 onto paper and outputs it. User A sends the first code to User B. For example, User A can take a picture of the first code with a smartphone and send the image of the first code via a messaging app or email. Alternatively, User A may send the printed document with the first code printed on it to User B by mail or other means.

[0013] User B uses User Terminal 3 to photograph the hand-drawn picture P to generate a hand-drawn picture image, and then sends the hand-drawn picture image from User Terminal 3 to Server Device 1. Figure 2B shows an example of a hand-drawn picture image G2. User Terminal 3 is, for example, a smartphone or tablet device with a dedicated application installed. User B is the person who drew the hand-drawn picture P, or the parent or guardian of the child who drew the hand-drawn picture P. User A is, for example, the grandparents of the child who drew the hand-drawn picture P.

[0014] Server device 1 assigns a second identification information to the hand-drawn image received from user terminal 3, and stores the hand-drawn image and the second identification information linked together. Server device 1 also generates a two-dimensional code (second code) representing the second identification information and sends it to user terminal 3. User B's user terminal 3 stores both the first code received from user A and the second code received from server device 1.

[0015] User B moves to the print production device 2B, displays the second code received from the server device 1 on the user terminal 3, and holds it over the reader of the print production device 2B to have the second identification information read. The print production device 2B transmits the read second identification information to the server device 1 and obtains the hand-drawn image corresponding to the second identification information from the server device 1.

[0016] The print production device 2B photographs user B to generate a second image, performs chroma keying on the second image, and extracts a second person image. Figure 2C shows an example of the second image G3. The user being photographed is the person who drew the hand-drawn picture P, or a parent or guardian of the child who drew the hand-drawn picture P may be present.

[0017] User B displays the first code received from User A on User Terminal 3 and holds it over the reader of Print Production Device 2B to have the first identification information read. Print Production Device 2B transmits the read first identification information to Server Device 1 and obtains the first captured image corresponding to the first identification information from Server Device 1. Print Production Device 2B performs chroma key processing on the first captured image to extract the first person image.

[0018] The print product manufacturing device 2B uses the hand-drawn picture image acquired from the server device 1 as a background image (or foreground image), and synthesizes the first person image and the second person image to generate a synthesized image.

[0019] As a result, a synthesized image G4 as shown in FIG. 2D, in which the user A and the user B are synthesized with a hand-drawn picture, is generated.

[0020] The print product manufacturing device 2B transmits the synthesized image to the server device 1. The server device 1 generates a URL (Uniform Resource Locator) of a website for downloading the image data of the synthesized image received from the print product manufacturing device 2B, and transmits a two-dimensional code (third code) indicating this URL to the print product manufacturing device 2B.

[0021] The print product manufacturing device 2B prints the synthesized image and the two-dimensional code received from the server device 1 on paper, and outputs a print product M as shown in FIG. 3. The paper is, for example, sublimation transfer paper. The user B uses the user terminal 3 to read the two-dimensional code Q printed on the print product M, access the download site provided by the server device 1, and download the image data of the synthesized image.

[0022] The user B can obtain, for example, a print product or image data of a synthesized image in which a picture drawn by a child is used as a background, and a person image of the child and a person image of the child's grandparents (user A) are synthesized.

[0023] The user A and the user B may perform photographing separately (at different times and in different places). It is not necessary to use the print product manufacturing devices 2A and 2B at the same time, and no schedule adjustment is required.

[0024] Furthermore, by photographing drawings on large-sized drawing paper, such as quarto size, and using them as background images, hand-drawn pictures can be saved as small-sized prints (L-size or 2L-size) or as digital data, eliminating concerns about storage space and image quality degradation. Also, since the child who drew the picture is included in the composite image, it is easy to determine when the background drawing was created based on the child's height and build when reviewing the composite image later.

[0025] Next, the configuration of server device 1 will be described. Server device 1 is a computer with communication capabilities, and as shown in Figure 4, it is equipped with a storage unit 10, as well as the functions of an image receiving unit 11, an identification information assignment unit 12, a code transmission unit 13, an image selection unit 14, and an image transmission unit 15.

[0026] The image receiving unit 11 receives a first captured image (an image of user A) from the print production device 2A. The image receiving unit 11 also receives a hand-drawn image (an image of a hand-drawn picture, etc.) from the user terminal 3. The image receiving unit 11 also receives a composite image from the print production device 2B.

[0027] The identification information assignment unit 12 generates and assigns first identification information to the first captured image received by the image receiving unit 11. The first captured image is then stored in the storage unit 10, with the first identification information associated with it.

[0028] The identification information assignment unit 12 generates and assigns second identification information to the hand-drawn image received by the image receiving unit 11. The hand-drawn image is then stored in the storage unit 10, with the second identification information associated with it.

[0029] Furthermore, the identification information assignment unit 12 generates and assigns third identification information to the composite image received by the image receiving unit 11. The composite image is stored in the storage unit 10, with the third identification information associated with it. In addition, the identification information assignment unit 12 generates a URL for a website to download the composite image. This URL is configured to include the third identification information.

[0030] The first, second, and third identification information uniquely identifies the image and consists of, for example, multiple alphanumeric characters.

[0031] The code transmission unit 13 converts the first identification information into a two-dimensional code (first code) and transmits it to the printmaking device 2A, the source of the first captured image. The code transmission unit 13 converts the second identification information into a two-dimensional code (second code) and transmits it to the user terminal 3, the source of the hand-drawn image. The code transmission unit 13 also converts the download site URL into a two-dimensional code (third code) and transmits it to the printmaking device 2B, the source of the composite image.

[0032] When the image selection unit 14 receives first identification information from the print manufacturing device 2B, it selects the corresponding first captured image from the image data in the storage unit 10. When the image selection unit 14 receives second identification information from the print manufacturing device 2B, it selects the corresponding hand-drawn image from the image data in the storage unit 10. Furthermore, when the user terminal 3 accesses the download site, the image selection unit 14 selects a composite image from the image data in the storage unit 10 that corresponds to the third identification information contained in the URL at the time of access.

[0033] The image transmission unit 15 transmits the first captured image selected by the image selection unit 14 to the print manufacturing device 2B. The image transmission unit 15 also transmits the hand-drawn image selected by the image selection unit 14 to the print manufacturing device 2B. In addition, the image transmission unit 15 transmits the composite image selected by the image selection unit 14 to the user terminal 3.

[0034] Next, the print production devices 2A and 2B will be described. The print production devices 2A and 2B have the same configuration. As shown in Figure 5, the print production devices 2A and 2B include a calculation control unit 20, a shooting unit 21 that photographs the user and generates a captured image, a touch panel 22, a reading unit 23, an illumination unit 24, a printer 25, and a communication unit 26. In the print production devices 2A and 2B, the wall on the user's back side is a color suitable for chroma key compositing, such as blue or yellow-green.

[0035] The print production devices 2A and 2B can switch between a shooting mode, which photographs the user, sends the captured image (first captured image) to the server device 1, and prints a two-dimensional code (first code) indicating first identification information corresponding to the first captured image, and a composite image generation mode, which acquires the first captured image and a hand-drawn image from the server device 1, photographs the user, extracts a person image from the captured image (second captured image) and the first captured image acquired from the server device 1, and generates a composite image of the hand-drawn image and the person image.

[0036] The imaging unit 21 is, for example, a digital camera and includes a lens, shutter, CMOS sensor, A / D converter, etc. The image generated when the imaging unit 21 photographs the user is transferred to the arithmetic control unit 20.

[0037] The touch panel 22 displays an operation screen, and when a button on the operation screen is pressed, it accepts an instruction corresponding to that button. Instead of the touch panel 22, a display without touch functionality and physical buttons may be provided.

[0038] The reading unit 23 reads identification information from the two-dimensional code presented by the user.

[0039] The lighting unit 24 illuminates the user when the shooting unit 21 is taking a picture of the user.

[0040] The printer 25 prints the print image received from the arithmetic control unit 20 onto paper and outputs it. The printing method of the printer 25 is not particularly limited, and inkjet, dye-sublimation thermal transfer, fused thermal transfer, etc., can be used.

[0041] The calculation control unit 20 is connected to the imaging unit 21, touch panel 22, reading unit 23, illumination unit 24, printer 25, etc., and controls each unit and handles data transfer. The calculation control unit 20 also uses the communication unit 26 to send and receive data with the server device 1.

[0042] The arithmetic control unit 20 is a computer equipped with a CPU (Central Processing Unit) and memory. The CPU executes a composite image generation program, thereby realizing the functions of the image acquisition unit 201, the shooting processing unit 202, the image processing unit 203, the image transmission unit 204, the code information receiving unit 205, and the print processing unit 206, as shown in Figure 6.

[0043] The image acquisition unit 201 transmits the first identification information read by the reading unit 23 to the server device 1 and acquires the first captured image corresponding to the first identification information. The image acquisition unit 201 also transmits the second identification information read by the reading unit 23 to the server device 1 and acquires the hand-drawn image corresponding to the second identification information.

[0044] The imaging processing unit 202 controls the imaging unit 21 to perform imaging and receives the captured image of the user from the imaging unit 21.

[0045] The image processing unit 203 uses chroma keying to combine the person image in the second captured image generated by the shooting unit 21, the person image in the first captured image received from the server device 1, and the hand-drawn image received from the server device 1 to generate composite image data. Specifically, the image processing unit 203 determines the color difference between the person in the first captured image and the background color (wallpaper color) and cuts out the person image from the first captured image. The color difference determined here is the difference in hue, the difference in saturation, or a combination of the difference in hue and saturation. The same process is used to cut out the person image from the second captured image. Then, the image processing unit 203 uses the hand-drawn image received from the server device 1 as the background image and overlays the cut-out person image to perform image synthesis.

[0046] In shooting mode, the image transmission unit 204 transmits the first captured image to the server device 1. In composite image generation mode, the image transmission unit 204 transmits the composite image data to the server device 1.

[0047] In shooting mode, the code information receiving unit 205 receives a two-dimensional code (first code) indicating first identification information from the server device 1.

[0048] In the composite image generation mode, the code information receiving unit 205 receives URL information for a website to download the composite image data from the server device 1. The URL information received from the server device 1 is, for example, a two-dimensional code (third code) that represents the URL.

[0049] In shooting mode, the print processing unit 206 generates a printable image containing the first captured image and the first code obtained from the server device 1, and sends the printable image to the printer 25 to execute the print process.

[0050] Furthermore, in the composite image generation mode, the print processing unit 206 generates a printable image that includes the composite image and the third code received from the server device 1, and sends the printable image to the printer 25 to execute the print process.

[0051] Next, the method for producing a print using the print production device 2B by user B will be explained according to the flowchart shown in Figure 7. User A has previously taken a photograph with the print production device 2A, uploaded the first captured image to the server device 1, and provided user B with an image of a two-dimensional code (first code) indicating the first identification information corresponding to the first captured image. In addition, user B has previously taken a photograph of a hand-drawn picture with the user terminal 3 and sent the hand-drawn picture image to the server device 1, and received a two-dimensional code (second code) indicating the second identification information corresponding to the hand-drawn picture image from the server device 1.

[0052] User B displays the second code on user terminal 3 and holds it over the reader unit 23. The reader unit 23 reads the two-dimensional code and extracts the second identification information (step S1).

[0053] The image acquisition unit 201 transmits the second identification information extracted in step S1 to the server device 1 and acquires a hand-drawn image corresponding to the second identification information (step S2).

[0054] The imaging unit 21 captures the user and generates a second image (step S3).

[0055] User B displays the first code on user terminal 3 and holds it over the reader unit 23. The reader unit 23 reads the two-dimensional code and extracts the first identification information (step S4).

[0056] The image acquisition unit 201 transmits the first identification information extracted in step S4 to the server device 1 and acquires the first captured image corresponding to the first identification information (step S5).

[0057] The image processing unit 203 extracts a second person image (user B) from the second captured image generated in step S3, and extracts a first person image (user A) from the first captured image acquired in step S5 (step S6).

[0058] The image processing unit 203 combines the hand-drawn image acquired in step S2 with the person images of user A and user B extracted in step S6 to generate a composite image (step S7).

[0059] The image processing unit 203 displays the composite image on the touch panel 22. At this time, a directional pad and zoom in / out keys for adjusting the position and size of the person images in the composite image are also displayed on the touch panel 22. The user operates the touch panel 22 to adjust the composite position and size of the person images for users A and B (step S8).

[0060] The image transmission unit 204 transmits the composite image to the server device 1 (step S9).

[0061] The code information receiving unit 205 receives a two-dimensional code from the server device 1 that indicates the URL information of the download site from which the composite image will be downloaded (step S10).

[0062] The image processing unit 203 generates a printable image by combining the composite image with the two-dimensional code acquired in step S10. The print processing unit 206 transfers the printable image to the printer 25 and prints it (step S11).

[0063] As described above, this embodiment allows for the capture of composite images of users A and B, who are in different locations, at separate times. Furthermore, images provided by the user, such as a photograph of a hand-drawn picture, can be used as background images. For example, a composite image can be generated by combining a photograph of a hand-drawn picture, a photograph of the artist, and a photograph of a relative of the artist who is located far away. Drawings on large sheets of paper, such as drawing paper, can be saved as image data, eliminating concerns about storage space and deterioration. Additionally, the approximate date of the drawing can be easily determined from the composite image of the artist.

[0064] Before the user takes a photograph with the print production device 2B, the user may be able to choose whether or not to cut out the person image from the first and second captured images. If cutting is not performed, the first and second captured images are composited directly into the hand-drawn image.

[0065] Furthermore, the user may be allowed to select the (rough) composite position of the person images before taking the picture. For example, the user can select one of several placement patterns, such as arranging the first and second person images vertically on the left, arranging them vertically in the center, arranging them vertically on the right, arranging them in the upper left and lower right, or arranging them in the upper right and lower left. In step S7 of Figure 7, a composite image is generated with the person images placed in the selected positions. In step S8, the user can fine-tune the position of the person images within a certain area including the selected positions.

[0066] In the above embodiment, an example was described in which the server device 1 transmits a two-dimensional code indicating the first identification information to the printmaking device 2A. However, the first identification information itself (multiple alphanumeric characters) may also be transmitted along with the two-dimensional code. The printmaking device 2A prints out the two-dimensional code and the first identification information. The method for inputting the first identification information to the printmaking device 2B in step S4 of Figure 7 may be manual input by operating the touch panel 22, in addition to reading the two-dimensional code.

[0067] In the above embodiment, an example was described in which a hand-drawn image captured by the user terminal 3 is used as the background of the composite image. However, a hand-drawn image may also be generated by capturing a hand-drawn artwork or other artwork with the print manufacturing device 2B. In this case, the print manufacturing device 2B captures the artwork in the first shot to generate a hand-drawn image, and captures user B in the second shot to generate a second captured image.

[0068] If the image processing unit 203 extracts multiple people from a single captured image in step S6 of Figure 7, the composite position and size may be adjusted for each person.

[0069] The user image provided from user terminal 3 to server device 1 may be a photograph of a drawing, craft, or other artwork, or a photograph of a landscape. Furthermore, the user image is not limited to an image taken by user terminal 3, but may also be an image of a character or other image stored on user terminal 3.

[0070] In the above embodiment, an example was described in which a user image provided by the user is used as the background of the composite image, but a template stored in the print manufacturing apparatus 2B may also be used as the background.

[0071] A website where a composite image is downloaded may include a third-party identification information (or a two-dimensional code indicating the third-party identification information) associated with the composite image. User B sends this third-party identification information to User A. For example, User B copies the string of the third-party identification information from the website or captures the image of the two-dimensional code and sends it to User A via a messaging app or email. User A selects the composite image output mode on the print-making device 2A (or another print-making device) and inputs this third-party identification information. The print-making device 2A notifies the server device 1 of the third-party identification information, retrieves the composite image corresponding to the third-party identification information from the server device 1, and prints it. As a result, User A can also obtain a printed copy of the composite image.

[0072] The present invention is not limited to the embodiments described above, and in the implementation stage, the components can be modified and implemented without departing from the spirit of the invention. Furthermore, various inventions can be formed by appropriately combining the multiple components disclosed in the above embodiments. For example, some components may be deleted from all the components shown in the embodiments. Moreover, components from different embodiments may be appropriately combined. [Explanation of Symbols]

[0073] 1 Server device 2A, 2B Printing apparatus 3. User terminals

Claims

1. An image generation system comprising a first printmaking apparatus, a second printmaking apparatus, and a server device that is communicatively connected to the first printmaking apparatus and the second printmaking apparatus, The first print-making apparatus includes a first imaging unit that photographs a first user and generates a first image, a first communication unit that transmits the first image to the server device and receives first identification information corresponding to the first image from the server device, and a first printer that prints out the first identification information. The second print production apparatus is an image generation system comprising: a second shooting unit that photographs a second user and generates a second photographed image; a second communication unit that transmits the input first identification information to the server device and receives the first photographed image corresponding to the first identification information from the server device; and an image processing unit that generates a composite image by combining the first photographed image and the second photographed image.

2. The image generation system according to claim 1, wherein the image processing unit cuts out a first person image from the first captured image, cuts out a second person image from the second captured image, and combines the first person image and the second person image to generate the composite image.

3. The server device assigns a second identification information to the user image received from the user terminal, and transmits the second identification information to the user terminal. When the second communication unit receives input of the second identification information, it transmits the second identification information to the server device and obtains the user image corresponding to the second identification information from the server device. The image generation system according to claim 1, wherein the image processing unit generates the composite image by combining the user image, the first captured image, and the second captured image.

4. The second communication unit transmits the composite image to the server device and receives URL information of a website from which to download the composite image from the server device. The image generation system according to claim 1, wherein the second print production apparatus further comprises a second printer that prints the URL information and the composite image.

5. The image generation system according to claim 4, wherein the server device, upon receiving the composite image from the second printmaking apparatus, assigns a third identification information to the composite image, generates the URL information using the third identification information, and transmits the URL information to the second printmaking apparatus.

6. The image generation system according to claim 5, wherein the server device transmits the composite image to a user terminal that has accessed it based on the URL information.

7. The second shooting unit generates user images by photographing works owned by the user. The image generation system according to claim 1, wherein the image processing unit generates the composite image by combining the user image, the first captured image, and the second captured image.

Images