Image processing apparatus, image processing method, program, and imaging method

Abstract

To allow an image to be added with text desired by a user and to suppress deterioration of response following addition of the text.SOLUTION: An image processing apparatus connected through a communication network to an imaging device for capturing an image comprises: a display information acquiring unit for acquiring display information displayed in a display screen of the imaging device; a photo frame display unit for displaying a photo frame corresponding to the display information acquired by the display information acquiring unit by superimposing the same onto the image displayed in the display screen; a text input column display unit for displaying a text input column where a text can be input, in the display screen; and a rendering unit for rendering the text input into the text input column on the basis of a font corresponding to the photo frame.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present disclosure relates to an image processing apparatus, an image processing method, a program, and an imaging method.

Background Art

[0002] There is known an Augmented Reality (AR) technology for superimposing data such as still images, video texts, or voices on an image captured by a smartphone or a tablet terminal having an imaging function. For example, in Patent Document 1, when a user captures a product purchased by the user with the user's terminal, the captured image is received via an application pre-installed on the user's terminal, and one piece of information (for example, a photo frame image) is randomly selected from a plurality of types of information and transmitted to the user's terminal.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the technology described in Patent Document 1, it is not possible to add text desired by the user to the image displayed on the user's terminal, and there is a possibility that the user's demands cannot be satisfied. Further, in order to add text desired by the user to an image, it is necessary to perform rendering, but there is a possibility that the responsiveness deteriorates due to this rendering.

[0005] The present disclosure has been made in view of the above problems, and an object thereof is to provide an image processing apparatus, an image processing method, and a program capable of adding text desired by a user to an image and suppressing deterioration of responsiveness accompanying text addition.

Means for Solving the Problems

[0006] To achieve the above object, an image processing apparatus according to the present disclosure is an image processing apparatus connected via a communication network to an imaging device that captures an image, a display information acquisition unit that acquires display information displayed on a display screen of the imaging device, a photo frame display unit that overlays and displays a photo frame corresponding to the display information acquired by the display information acquisition unit on the image displayed on the display screen, a text input field display unit that displays a text input field in which text can be input on the display screen, and a rendering unit that renders the text input in the text input field based on a font corresponding to the photo frame.

[0007] To achieve the above object, an image processing method according to the present disclosure is an image processing method executed by an image processing apparatus connected via a communication network to an imaging device that captures an image, a display information acquisition step of acquiring display information displayed on a display screen of the imaging device, a photo frame display step of overlaying and displaying a photo frame corresponding to the display information acquired in the display information acquisition step on the image displayed on the display screen, a text input field display step of displaying a text input field in which text can be input on the display screen, and a rendering step of rendering the text input in the text input field based on a font corresponding to the photo frame.

[0008] To achieve the above object, a program according to the present disclosure causes a cloud server or a computer connected via a communication network to an imaging device that captures an image, to execute a display information acquisition process of acquiring display information displayed on a display screen of the imaging device, A photo frame corresponding to the display information acquired in the display information acquisition process is superimposed on and displayed on the image displayed on the display screen, which is a photo frame display process. A text input field display process for displaying a text input field capable of inputting text on the display screen. Rendering processing for rendering the text input in the text input field based on the font corresponding to the photo frame is executed.

Advantages of the Invention

[0009] According to the image processing apparatus, image processing method, and program of the present disclosure, it is possible to add text desired by the user to an image and suppress deterioration in responsiveness accompanying the addition of text.

Brief Description of the Drawings

[0010]

Figure 1

Figure 2

Figure 3A

Figure 3B

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Mode for Carrying Out the Invention

[0011] Hereinafter, an image processing apparatus, an image processing method, a program, and an imaging method according to an embodiment of the present disclosure will be described with reference to the drawings. Such an embodiment shows one aspect of the present disclosure, does not limit this disclosure, and can be arbitrarily changed within the scope of the technical idea of the present disclosure.

[0012] <First Embodiment> FIG. 1 is a diagram schematically showing the configuration of an image processing system 100 including an image processing apparatus 1 according to the first embodiment. In the first embodiment, as illustrated in FIG. 1, the image processing system 100 includes an image processing apparatus 1 configured to be connectable to the Internet 101, which is one of communication networks. A user connects an imaging apparatus 102 that captures an image I, such as a smartphone, to the image processing apparatus 1 via the Internet 101. That is, the image processing apparatus 1 and the imaging apparatus 102 can exchange information with each other via the Internet 101. Note that the communication network is not limited to the Internet 101 as long as the image processing apparatus 1 and the imaging apparatus 102 can exchange information with each other. Hereinafter, the case where the imaging apparatus 102 is a smartphone will be described as an example, but the imaging apparatus 102 is not limited to a smartphone.

[0013] (Configuration) In the first embodiment, the image processing apparatus 1 is a computer such as an electronic control device, and includes a processor such as a CPU or a GPU (not shown), a memory such as a ROM or a RAM, and an I / O interface. The image processing apparatus 1 realizes each functional unit included in the image processing apparatus 1 by the processor operating (performing calculations, etc.) according to the instructions of a program loaded into the memory. With reference to FIG. 2, each functional unit of the image processing apparatus 1 will be described. In some embodiments, the image processing apparatus 1 is a cloud server provided in a cloud environment.

[0014] FIG. 2 is a schematic functional block diagram of the image processing apparatus 1 according to the first embodiment. As illustrated in FIG. 2, the image processing apparatus 1 includes a display information acquisition unit 2, a photo frame display unit 4, a text input field display unit 6, and a rendering unit 8.

[0015] The display information acquisition unit 2 acquires the display information A displayed on the display screen 104 of the imaging device 102. In the first embodiment, as illustrated in FIG. 2, when the display information acquisition unit 2 acquires the display information A, it transmits an instruction B for transmitting the photo frame 10 corresponding to the display information A to the imaging device 102 to the photo frame display unit 4.

[0016] Each of FIGS. 3A and 3B is a diagram for explaining the card 120 having the display information A according to the first embodiment. FIG. 3A shows the front surface 122 of the card 120, and FIG. 3B shows the back surface 124 of the card 120. The card 120 according to the first embodiment is a fortune-telling card for predicting the future of a target person (baby) on the first birthday of the target person. The fortune-telling card predicts the future of the baby by allowing the baby to randomly select one card from a plurality of fortune-telling cards. This fortune-telling may be performed not only on the day of the baby's birthday but also on the day before or the day after the birthday. Note that the present disclosure is not limited to the object having the display information A being the card 120, nor is it limited to the card 120 being a fortune-telling card.

[0017] In the first embodiment, as illustrated in FIG. 3B, the display information A is a QR code (registered trademark). The QR code that is the display information A is printed on one surface (back surface 124) of the card 120. On the back surface 124 of the card 120, in addition to the display information A, a sentence that verbalizes the fortune-telling content of the card 120 is printed. The user operates the imaging device 102 so that the QR code is displayed on the display screen 104 of the imaging device 102, causing the imaging device 102 to read the QR code. Then, the display information acquisition unit 2 acquires the QR code read by the imaging device 102 via the Internet 101. Note that the present disclosure is not limited to the display information A being a QR code.

[0018] In the first embodiment, as illustrated in FIG. 3A, on the opposite surface (surface 122) of the card 120 opposite to one surface, a pattern 123 is printed. The pattern 123 means fortune-telling content. In the form illustrated in FIG. 3A, on the surface 122 of the card 120, a pattern 123 of a balloon is printed. In some embodiments, the pattern 123 printed on the surface 122 of the card 120 includes one of a group of patterns including at least a pencil, a musical instrument, a balloon, a book, a sports equipment, a banknote, and an abacus. In this case, on the surface 122 of each of the plurality of cards 120, different patterns 123 (fortune-telling content) are printed.

[0019] The photo frame display unit 4 superimposes and displays the photo frame 10 corresponding to the display information A acquired by the display information acquisition unit 2 on the image I displayed on the display screen 104. In the first embodiment, as illustrated in FIG. 2, when receiving the instruction B, the photo frame display unit 4 transmits the photo frame 10 corresponding to the display information A to the imaging device 102.

[0020] The photo frame 10 transmitted to the imaging device 102 is superimposed and displayed on the image I displayed on the display screen 104 of the imaging device 102. FIG. 4 is a diagram showing the photo frame 10 displayed by the photo frame display unit 4 according to the first embodiment. In the first embodiment, the photo frame 10 includes a frame 13A extending along the boundary of the display screen 104, a balloon 13B, and a message 13C. Such a photo frame 10 is superimposed and displayed on the image I. Further, in the form illustrated in FIG. 2, a baby is displayed together with the photo frame 10 in the image I by operating the imaging device 102.

[0021] The balloon 13B has the same pattern as the balloon pattern 123 printed on the front surface 122 of the card 120. That is, the photo frame 10 includes the pattern 123 printed on the front surface 122 of the card 120. The message 13C has the same content as the text printed on the back surface 124 of the card 120. Each of the balloon 13B and the message 13C is displayed superimposed on the lower part of the image I displayed on the display screen 104.

[0022] Note that the present disclosure is not limited to including the pattern 123 in the photo frame 10. Although not shown, in some embodiments, the photo frame 10 includes an associated pattern related to the pattern 123 printed on the front surface 122 of the card 120. The associated pattern is a pattern different from the pattern 123 printed on the front surface 122 of the card 120, but is adapted to the fortune-telling content of the pattern 123. For example, the associated pattern is something that reminds one of the fortune-telling content of the pattern 123. For example, the associated pattern is a frame colored with a color suitable for the fortune-telling content of the pattern 123.

[0023] In the first embodiment, the photo frame display unit 4 is configured to display one of the plurality of photo frames 10 corresponding to the display information A superimposed on the image I displayed on the display screen 104. Specifically, the photo frame display unit 4 transmits the plurality of photo frames 10 corresponding to the display information A to the imaging device 102. One of the plurality of photo frames 10 is displayed superimposed on the image I of the display screen 104. Further, the photo frame display unit 4 displays a photo frame selection button 12 on the display screen 104 for selecting the photo frame 10 to be superimposed on the image I of the display screen 104. Although not shown, when the photo frame selection button 12 is pressed, a list of the plurality of photo frames 10 transmitted from the photo frame display unit 4 is displayed on the display screen 104. When the user selects (presses) an arbitrary photo frame 10 from this list, the selected photo frame 10 is displayed superimposed on the image I of the display screen 104.

[0024] Also, in the first embodiment, as illustrated in FIG. 4, the image processing apparatus 1 is configured to display an imaging button 110, a horizontal flip button 112, a switching button 114, and an explanation button 116 on the display screen 104 together with the photo frame 10. When the imaging button 110 is pressed by the user, the image I displayed on the display screen 104 is captured together with the photo frame 10. When the horizontal flip button 112 is pressed by the user, the image I displayed on the display screen 104 is horizontally flipped (the photo frame 10 does not flip). When the switching button 114 is pressed by the user, the imaging device 102 is switched to either an in-camera that captures an object facing the display screen 104 or an out-camera that captures an object facing the opposite side of the display screen 104. When the explanation button 116 is pressed by the user, the functions of the above-described imaging button 110, horizontal flip button 112, and switching button 114 are explained.

[0025] The text input field display unit 6 displays a text input field 14 that allows text input on the display screen 104. In the first embodiment, as illustrated in FIG. 2, the text input field display unit 6 transmits the text input field 14 to the imaging device 102. The text input field display unit 6 transmits the text input field 14 to the imaging device 102 at the timing when the photo frame 10 is transmitted to the imaging device 102. Then, as illustrated in FIG. 4, a text button 16 for displaying the text input field 14 transmitted to the imaging device 102 on the display screen 104 is displayed on the display screen 104.

[0026] FIG. 5 is a diagram showing a text input field 14 displayed by the text input field display unit 6 according to the first embodiment. In the first embodiment, as illustrated in FIG. 5, the text button 16 is pressed by the user to display the text input field 14 on the display screen 104. In the first embodiment, the text input field 14 includes a text box 17A, a cancel button 17B, and a determination button 17C. The text box 17A enables the user to input text. The cancel button 17B is pressed by the user to delete the text input field 14 from the display screen 104. The determination button 17C is pressed by the user to transmit the text input into the text box 17A (hereinafter referred to as the input text 18) to the rendering unit 8. Then, a text image 20 described later is displayed superimposed on the image I of the display screen 104 together with the photo frame 10.

[0027] The rendering unit 8 renders the input text 18 transmitted from the imaging device 102 based on the font F corresponding to the photo frame 10. The font F corresponding to the photo frame 10 may be any font, for example, a font that follows the design of the photo frame 10.

[0028] The rendering unit 8 will be specifically described. As illustrated in FIG. 2, the rendering unit 8 generates an image (hereinafter referred to as the text image 20) obtained by converting the input text 18 into the font F corresponding to the photo frame 10, and transmits the generated text image 20 to the imaging device 102. Then, as illustrated in FIG. 5, the text image 20 transmitted to the imaging device 102 is displayed superimposed on the image I displayed on the display screen 104 of the imaging device 102. The text image 20 is displayed superimposed on the image I of the display screen 104 together with the photo frame 10.

[0029] (Operation and Effect) The operation and effects of the image processing apparatus 1 according to the first embodiment will be described. According to the first embodiment, the desired text of the user can be displayed as the text image 20 on the image I of the display screen 104 via the text input field 14. Therefore, the user can capture an image I with the desired text added thereto.

[0030] Also, according to the first embodiment, when the text image 20 is displayed on the image I of the display screen 104, the rendering unit 8 of the image processing apparatus 1 performs rendering, so that quick responsiveness can be realized as compared with the case where the imaging device 102 performs rendering. Further, since the rendering unit 8 displays the text image 20 converted into the font F corresponding to the photo frame 10 on the image I of the display screen 104, the text image 20 in the font F suitable for the photo frame 10 can be displayed on the image I of the display screen 104.

[0031] Also, according to the first embodiment, since the picture 123 of the balloon printed on the front surface 122 of the card 120 is included in the photo frame 10, an image I associated with the picture 123 of the balloon can be captured.

[0032] Also, according to the first embodiment, the card 120 is a fortune-telling card for predicting the future of a baby on the occasion of the baby's first birthday. Therefore, by causing the imaging device 102 to read the display information A printed on the back surface 124 of the card 120 selected by the baby, the photo frame 10 corresponding to the future (fortune-telling result) of the baby is displayed on the image I of the display screen 104 of the imaging device 102. Therefore, by capturing an image of the baby with the image I in a state where this photo frame 10 is displayed, it is possible to commemorate the baby's first birthday.

[0033] <Second Embodiment> The image processing apparatus 1 according to the second embodiment of the present disclosure will be described. The image processing apparatus 1 according to the second embodiment is obtained by adding a font storage unit 22, a photo frame storage unit 24, a font setting unit 26, and a font upload unit 28 to the image processing apparatus 1 according to the first embodiment. In the second embodiment, the same components as those in the first embodiment are denoted by the same reference numerals, and detailed descriptions thereof are omitted.

[0034] (Configuration) FIG. 6 is a schematic functional block diagram of the image processing apparatus 1 according to the second embodiment. In the second embodiment, as illustrated in FIG. 6, the image processing apparatus 1 further includes a font storage unit 22, a photo frame storage unit 24, a font setting unit 26, and a font upload unit 28.

[0035] The font storage unit 22 stores a plurality of fonts F, and the photo frame storage unit 24 stores a plurality of photo frames 10. In some embodiments, the font storage unit 22 stores one font F. In some embodiments, the photo frame storage unit 24 stores one photo frame 10.

[0036] The font setting unit 26 associates one of the plurality of fonts F stored in the font storage unit 22 with one of the plurality of photo frames 10 stored in the photo frame storage unit 24. Then, the font setting unit 26 generates font setting information X, which is information on the photo frame 10 associated with the font F. Such a font setting unit 26 is configured to be able to output, for example, a management screen for associating the font F with the photo frame 10 to an arbitrary terminal.

[0037] In the second embodiment, the rendering unit 8 acquires the photo frame 10 transmitted by the photo frame display unit 4 to the imaging device 102 and the font setting information X generated by the font setting unit 26. Then, when the input text 18 is transmitted from the imaging device 102, the rendering unit 8 refers to the font setting information X and generates a text image 20 obtained by converting the input text 18 into the font F corresponding to the photo frame 10. Note that the photo frame display unit 4 is configured to transmit one of the plurality of photo frames 10 stored in the photo frame storage unit 24 to the imaging device 102.

[0038] The font upload unit 28 causes a new font Fa, which is a new font not stored in the font storage unit 22, to be uploaded. Such a font upload unit 28 is configured to be able to output, to an arbitrary terminal, an upload screen for uploading the new font Fa to the font storage unit 22 via, for example, the Internet 101.

[0039] (Operation and Effect) According to the second embodiment, the font F of the text to be displayed in the image I on the display screen 104 can be set by selecting an arbitrary font F from the fonts F stored in the font storage unit 22. Therefore, a text image 20 converted into a font F suitable for the design of the photo frame 10 can be displayed in the image I on the display screen 104.

[0040] According to the second embodiment, since the image processing apparatus 1 includes the font upload unit 28, the types of fonts F of the text to be displayed in the image I on the display screen 104 can be increased.

[0041] <Image Processing Method> FIG. 7 is a flowchart of an image processing method according to an embodiment. The image processing method according to the present disclosure is a method executed by an image processing apparatus 1 connected via an imaging apparatus 102 and the Internet 101. As illustrated in FIG. 7, the image processing method includes a display information acquisition step S1, a photo frame display step S2, a text input field display step S3, and a rendering step S4.

[0042] In the display information acquisition step S1, display information A displayed on the display screen 104 of the imaging apparatus 102 is acquired. In the photo frame display step S2, a photo frame 10 corresponding to the display information A acquired in the display information acquisition step S1 is superimposed and displayed on the image I displayed on the display screen 104. In the text input field display step S3, a text input field 14 capable of inputting text is displayed on the display screen 104. In the rendering step S4, the text input into the text input field 14 displayed on the display screen 104 in the text input field display step S3 is rendered based on the font F corresponding to the photo frame 10.

[0043] <Program> The program according to the present disclosure causes a cloud server or a computer connected via the imaging apparatus 102 and the Internet 101 to execute a display information acquisition process for acquiring the display information A displayed on the display screen 104 of the imaging apparatus 102, a photo frame display process for superimposing and displaying a photo frame 10 corresponding to the display information A acquired in the display information acquisition process on the image I displayed on the display screen 104, a text input field display process for displaying a text input field 14 capable of inputting text on the display screen 104, and a rendering process for rendering the text input into the text input field 14 based on the font F corresponding to the photo frame 10.

[0044] <Imaging Method> FIG. 8 is a flowchart of an imaging method according to an embodiment. The imaging method illustrated in FIG. 8 is an imaging method using the image processing apparatus 1 according to the second embodiment. As illustrated in FIG. 8, the imaging method includes a preparation step S101, a selection step S102, a reading step S103, and an imaging step S104. Note that the imaging method may be an imaging method using the image processing apparatus 1 according to the first embodiment instead of the image processing apparatus 1 according to the second embodiment.

[0045] In the preparation step S101, a plurality of cards 120 (fortune-telling cards) are prepared. For example, the parents of a baby prepare the fortune-telling cards. Each of the plurality of cards 120 has a different pattern 123 printed on the surface 122. In the selection step S102, the baby is made to select one of the plurality of prepared cards 120. In the reading step S103, at least one of the mother and the father reads the display information A printed on the back surface 124 of the card 120 selected by the baby into the imaging device 102. Then, in the imaging step S104, when the photo frame 10 is displayed in the image I on the display screen 104 of the imaging device 102, at least one of the mother and the father images the baby together with this photo frame 10.

[0046] The content described in each of the above embodiments is understood as follows, for example.

[0047] [1] The image processing apparatus according to the present disclosure is an image processing apparatus connected to an imaging apparatus that images an image via a communication network, a display information acquisition unit that acquires display information displayed on the display screen of the imaging apparatus, a photo frame display unit that overlays and displays a photo frame corresponding to the display information acquired by the display information acquisition unit on the image displayed on the display screen, a text input field display unit that displays a text input field in which text can be input on the display screen, A rendering unit that renders the text entered in the text input field based on the font corresponding to the photo frame.

[0048] According to the configuration described in [1] above, it is possible to display the text (augmented reality) desired by the user on the image of the display screen via the text input field. Also, when displaying text on the image of the display screen, since the rendering unit of the image processing apparatus performs the rendering, quick responsiveness can be realized as compared with the case where the imaging apparatus performs the rendering. Further, since the rendering unit performs the rendering based on the font corresponding to the photo frame, it is possible to display text in a font suitable for the photo frame on the image of the display screen.

[0049] [2] In some embodiments, in the configuration described in [1] above, A font storage unit that stores at least one font, A photo frame storage unit that stores at least one photo frame, A font setting unit that associates one of the at least one font with one of the at least one photo frame.

[0050] According to the configuration described in [2] above, it is possible to select and set an arbitrary font from the fonts stored in the font storage unit as the font of the text to be displayed on the image of the display screen. Therefore, it is possible to display text in a font suitable for the design of the photo frame on the image of the display screen.

[0051] [3] In some embodiments, in the configuration described in [2] above, A font upload unit that uploads at least one new font to the font storage unit.

[0052] According to the configuration described in [3] above, it is possible to increase the types of fonts of the text to be displayed on the image of the display screen.

[0053] [4] In some embodiments, in the configuration according to any one of [1] to [3] above, the display information is printed on one side of the card, and the photo frame includes a pattern printed on the opposite side of the card from the one side or an associated pattern related to the pattern.

[0054] According to the configuration described in [4] above, an image in which a pattern or an associated pattern is displayed can be captured.

[0055] [5] In some embodiments, in the configuration according to [4] above, the pattern printed on the opposite side of the card includes at least one of a group of patterns including a pencil, musical instrument, balloon, book, sports equipment, banknote, and abacus.

[0056] According to the configuration described in [5] above, an image in which a pattern of a pencil, musical instrument, balloon, book, sports equipment, banknote, abacus, or an associated pattern thereof is displayed can be captured.

[0057] [6] In some embodiments, in the configuration according to [5] above, the card is a fortune-telling card for predicting the future of the subject on the occasion of the subject's first birthday.

[0058] According to the configuration described in [6] above, a photo frame corresponding to the future (fortune-telling result) of the subject predicted on the subject's first birthday is displayed in the image on the display screen. Therefore, by capturing an image of the subject in a state where this photo frame is displayed, it is possible to commemorate the subject's first birthday.

[0059] [7] The image processing method according to the present disclosure is an image processing method executed by an image processing device connected via a communication network to an imaging device that captures an image, a display information acquisition step of acquiring display information displayed on a display screen of the imaging device, A photo frame display step of displaying, on the image displayed on the display screen, the photo frame corresponding to the display information acquired in the display information acquisition step; A text input field display step of displaying, on the display screen, a text input field in which text can be input; A rendering step of rendering the text input into the text input field based on the font corresponding to the photo frame. The method comprises the above steps.

[0060] According to the method described in [7] above, it is possible to display the text (augmented reality) desired by the user on the image of the display screen via the text input field. Also, when displaying text on the image of the display screen, since the image processing device performs rendering, quick responsiveness can be achieved as compared with the case where the imaging device performs rendering. Furthermore, since it is rendered based on the font corresponding to the photo frame, it is possible to display text in a font suitable for the photo frame on the image of the display screen.

[0061] [8] The program according to the present disclosure is installed on a cloud server or a computer connected via a communication network to an imaging device that captures an image, and causes the execution of a display information acquisition process of acquiring the display information displayed on the display screen of the imaging device, a photo frame display process of displaying, on the image displayed on the display screen, the photo frame corresponding to the display information acquired in the display information acquisition process, a text input field display process of displaying, on the display screen, a text input field in which text can be input, and a rendering process of rendering the text input into the text input field based on the font corresponding to the photo frame.

[0062] According to the program described in [8] above, it is possible to add text (augmented reality) desired by the user to the image on the display screen via the text input field. Also, when displaying text on the image of the display screen, since the image processing device performs rendering, it is possible to achieve prompt responsiveness as compared with the case where the imaging device performs rendering. Furthermore, since rendering is performed based on the font corresponding to the photo frame, it is possible to display text in a font suitable for the photo frame on the image of the display screen.

[0063] [9] An imaging method using the image processing device described in [6] above, A preparation step of preparing a plurality of fortune-telling cards in which the patterns printed on the opposite sides of the fortune-telling cards are different from each other, A selection step of having the subject select one of the plurality of fortune-telling cards prepared in the preparation step, A reading step of reading the display information printed on one side of the fortune-telling card selected in the selection step into the imaging device, An imaging step of imaging the subject together with the photo frame corresponding to the display information read in the reading step, and including.

[0064] According to the method described in [9] above, since the photo frame corresponding to the future (fortune-telling content) of the baby who had a fortune told on the first birthday of the subject (baby) is displayed on the image of the display screen, by imaging the baby together with the photo frame, it is possible to commemorate the baby's first birthday.

Explanation of Signs

[0065] 1 Image processing device 2 Display information acquisition unit 4 Photo frame display unit 6 Text input field display unit 8 Rendering unit 10 Photo frame 14 Text input field 22 Font storage unit 24 Photo Frame Memory Unit 26 Font Setting Unit 28 Font Upload Unit 101 Internet (Communication Network) 102 Imaging Device 104 Display Screen 120 Card 122 Front Surface of Card 124 Back Surface of Card A Display Information F Font S1 Display Information Acquisition Step S2 Photo Frame Display Step S3 Text Input Field Display Step S4 Rendering Step

Claims

1. An image processing apparatus connected via a communication network to an imaging device that captures an image, comprising: a display information acquisition unit that acquires display information displayed on a display screen of the imaging device; a photo frame display unit that overlays and displays a photo frame corresponding to the display information acquired by the display information acquisition unit on the image displayed on the display screen; a text input field display unit that displays a text input field on the display screen where text can be input; a rendering unit that renders the text input in the text input field based on a font corresponding to the photo frame; [[ / END]] An image processing apparatus.

2. a font storage unit that stores at least one font; a photo frame storage unit that stores at least one photo frame; a font setting unit that associates one of the at least one font with one of the at least one photo frame; The image processing apparatus according to claim 1.

3. further comprising a font upload unit that uploads at least one new font to the font storage unit; The image processing apparatus according to claim 2.

4. The display information is printed on one side of a card, The photo frame includes a pattern printed on the opposite side of the card from the one side or a related pattern related to the pattern; The image processing apparatus according to any one of claims 1 to 3.

5. The pattern printed on the opposite side of the card includes one of a group of patterns including at least a pencil, musical instrument, balloon, book, sports equipment, banknote, and abacus; The image processing apparatus according to claim 4.

6. The card is a fortune-telling card for predicting the future of a subject on the occasion of the subject's first birthday; The image processing apparatus according to claim 5.

7. An image processing method executed by an image processing apparatus connected via a communication network to an imaging device that captures an image, comprising: a display information acquisition step of acquiring display information displayed on a display screen of the imaging device; a photo frame display step of overlaying and displaying a photo frame corresponding to the display information acquired in the display information acquisition step on the image displayed on the display screen; a text input field display step of displaying a text input field on the display screen where text can be input; A rendering step of rendering the text input in the text input field based on a font corresponding to the photo frame. An image processing method. **Claim 8** A cloud server or a computer connected via a communication network to an imaging device that captures an image. A display information acquisition process of acquiring display information displayed on the display screen of the imaging device. A photo frame display process of displaying a photo frame corresponding to the display information acquired in the display information acquisition process overlaid on the image displayed on the display screen. A text input field display process of displaying a text input field in which text can be input on the display screen. Causing the computer to execute a rendering process of rendering the text input in the text input field based on a font corresponding to the photo frame. A program. **Claim 9** An imaging method using the image processing apparatus according to claim 6, A preparation step of preparing a plurality of fortune-telling cards in which the patterns printed on the opposite sides of the fortune-telling cards are different from each other. A selection step of causing the subject to select one of the plurality of fortune-telling cards prepared in the preparation step. A reading step of reading the display information printed on one side of the fortune-telling card selected in the selection step into the imaging device. An imaging step of imaging the subject together with the photo frame corresponding to the display information read in the reading step. An imaging method.

Images