Information processing device, information processing method, and information processing program

Abstract

To provide an information processing device capable of performing display so as to freely move a character drawn on a transparent stand in a captured image in a screen.SOLUTION: The information processing device includes: an imaging unit; a detection unit for detecting a transparent stand in a captured image captured by the imaging unit; a generation unit for generating the display image of a character included in the transparent stand detected by the detection unit; and a display control unit for displaying the movement of the character on a display unit according to a predetermined algorithm in an image based on the display image.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an information processing device, a method, and a program for displaying a character drawn on a transparent stand. [Background technology]

[0002] In recent years, digital content has been provided that utilizes virtual reality spaces known as VR, AR, etc. Non-Patent Document 1 discloses an acrylic stand from which a 3D hologram pops out. [Prior art documents] [Non-patent literature]

[0003] [Non-Patent Document 1] "Sales of 'AR Acrylic Stands' with 3D holograms popping out, and announcement of the launch date of the new feature 'ONE'S AR' in the 'ONE'S ROOM' app," [online], December 26, 2023, [Retrieved May 14, 2024]<URL: https: / / www.nikkei.com / nkd / disclosure / tdnr / 20231226509050 / > Summary of the Invention [Problem to be solved by the invention]

[0004] Incidentally, in the above-mentioned Non-Patent Document 1, the pop-up 3D hologram is basically a video playback, and there is a problem that users get bored of it after viewing it for a certain period of time.

[0005] SUMMARY OF THE INVENTION The present invention has been made in view of the above problems, and has as its object to provide an information processing device that displays a character on a transparent stand that users will not tire of. [Means for solving the problem]

[0006] In order to solve the above problem, an information processing device according to one aspect of the present invention includes an imaging unit, a detection unit that detects a transparent stand in an image captured by the imaging unit, a generation unit that generates a display image of a character included in the transparent stand detected by the detection unit, and a display control unit that displays an image based on the display image on a display unit, showing the character moving in accordance with a predetermined movement algorithm.

[0007] In order to solve the above problem, an information processing method according to one aspect of the present invention includes a detection step in which a computer detects a transparent stand in a captured image, a generation step in which a display image of a character included in the transparent stand detected in the detection step is generated, and a display control step in which an image based on the display image is displayed on a display unit showing the character moving in accordance with a predetermined movement algorithm.

[0008] In order to solve the above problem, an information processing program according to one aspect of the present invention enables a computer to realize a detection function for detecting a transparent stand in a captured image, a generation function for generating a display image of a character included in the transparent stand detected by the detection function, and a display control function for displaying an image based on the display image on a display unit showing the character moving in accordance with a predetermined movement algorithm.

[0009] The information processing device may further include a receiving unit that receives input from a user, and the display control unit may change the display mode of the display image in accordance with the content of the input received by the receiving unit.

[0010] In the information processing device, the input from the user may be an input indicating enlargement, and the display control unit may enlarge the display image and display it on the display unit.

[0011] In the information processing device, the input from the user may be an input indicating reduction, and the display control unit may reduce the display image and display it on the display unit.

[0012] In the information processing device, the display control unit may be configured such that the image based on the display image is an image of a character moving within the display unit.

[0013] In the information processing device, the detection section may further detect an object included in the captured image, and the display control section may display an image in which the character moves along the object.

[0014] Furthermore, in the above-mentioned information processing device, when the detection unit detects multiple transparent stands, the generation unit generates a display image of each character included in each of the multiple transparent stands, and the display control unit may display the display image of each character on the display unit in a display mode different from when the character is displayed alone.

[0015] In the information processing device, the display control unit may mask the area on the transparent stand where the character is depicted. [Effects of the Invention]

[0016] An information processing device according to one aspect of the present invention detects a transparent stand such as an acrylic stand, and the character drawn on the transparent stand moves freely around the screen, thereby displaying characters that the user will not get bored of. [Brief explanation of the drawings]

[0017] [Figure 1] FIG. 1 is a schematic diagram showing an outline of the invention. [Figure 2] FIG. 1 is a block diagram illustrating an example of the configuration of an information processing device. [Figure 3] 1 is a first flowchart illustrating an example of the operation of the information processing device. [Figure 4] 10A is a diagram showing an example of a captured image before the application is launched, and FIG. 10B is a diagram showing an example of an image when a character appears. [Figure 5] 10A and 10B are diagrams showing example images of character movements. [Figure 6] 10 is a second flowchart illustrating an example of the operation of the information processing device. [Figure 7] 10A is a diagram showing an example of accepting a user operation on a character, and FIG. 10B is a diagram showing an example of an image when the user operation is accepted. [Figure 8] 10 is a third flowchart illustrating an example of the operation of the information processing device. [Figure 9] 10A is a diagram showing an example of a single image, and FIG. 10B is a diagram showing an example of multiple images. DETAILED DESCRIPTION OF THE INVENTION

[0018] An information processing device according to an embodiment of the present invention will be described in detail below with reference to the drawings.

[0019] <Embodiment> <Summary> FIG. 1 is a schematic diagram showing an overview of an information processing device 100 according to the present invention.

[0020] 1, the information processing device 100 is a computer system having an imaging function and a display function, and may be a so-called smartphone, but is not limited to this. The information processing device 100 may be any other device having an imaging function and a display function, and may be realized, for example, by a tablet terminal, a mobile phone, a wearable terminal such as a head mounted display (HMD), or the like.

[0021] As shown in FIG. 1 , the information processing device 100 captures an image of its surroundings using its imaging function. If a transparent stand 10 is included in the captured image, the character 11 depicted on the transparent stand 10 is identified, and the character 11 is displayed as if it is moving freely on the information processing device 100. This allows the information processing device 100 to enhance the user's attachment to the character 11. The transparent stand 10 may be a so-called acrylic stand, which is a transparent acrylic plate on which an image of a person, character, or the like is printed and which can stand on a base or the like. It is sometimes abbreviated as "akusta" or "acrylic figure." The transparent stand is not limited to an acrylic stand, and may be made of other materials, such as plastic or glass, as long as the character image is depicted on the transparent plate. Hereinafter, the transparent stand will be referred to as an acrylic stand. The information processing device 100 will be described in detail below.

[0022] <Configuration> FIG. 2 is a block diagram showing an example of the configuration of the information processing device 100.

[0023] 2, the information processing device 100 includes a communication unit 110, an input unit 120, a storage unit 130, an imaging unit 140, a control unit 150, and an output unit 160. The communication unit 110, the input unit 120, the storage unit 130, the imaging unit 140, the control unit 150, and the output unit 160 are connected to each other via a connection line 170 so as to be able to communicate with each other. The communication may be wired or wireless.

[0024] The communication unit 110 is a communication interface having a function of communicating with an external device. The communication unit 110 may, for example, transmit an image generated by the control unit 150 to the external device. The communication unit 110 may also, for example, receive an operation program for operating a character drawn on an acrylic stand from the external device and transmit the operation program to the control unit 150.

[0025] The input unit 120 is an input interface that accepts input from a user of the information processing device 100. The input unit 120 may be realized by a touch panel. Alternatively, the input unit 120 may be realized by an input device such as a hard key provided on the information processing device 100 or a mouse connected to the information processing device 100. The input unit 120 may be a microphone that accepts voice input. The input unit 120 transmits the received input content to the control unit 150. For example, the input unit 120 may accept input related to the display mode of the character 11 on the acrylic stand 10 and transmit the input to the control unit 150. The input related to the display mode may be, but is not limited to, an input instructing the movement direction of the displayed character, an input instructing an enlarged display of the displayed character, or an input instructing a reduced display of the displayed character.

[0026] The storage unit 130 is a storage medium having a function of storing various programs and data required for the operation of the information processing device 100. The storage unit 130 can be realized, for example, by a hard disk drive (HDD), a solid state drive (SSD), a flash memory, or the like. The storage unit 130 may also be realized by cloud storage. The storage unit 130 may store, for example, a display application 131 that determines whether or not an acrylic stand 10 is present in a captured image, and if present, identifies a character 11 depicted on the acrylic stand 10, and moves a 3D image of the character 11 within the display screen of the generated information processing device 100.

[0027] The imaging unit 140 is an imaging device, i.e., a camera, provided in the information processing device 100. The imaging unit 140 may capture still images or may capture moving images. The imaging unit 140 captures images in accordance with instructions from the user of the information processing device 100. The imaging unit 140 then transmits the captured images to the control unit 150.

[0028] The output unit 160 outputs designated information in accordance with instructions from the control unit 150. The output unit 160 may be realized by a display unit (monitor or touch panel) provided in or connected to the information processing device 100, or may be realized by a speaker. The output unit 160 may output text information, image information, and audio information. For example, the output unit 160 may display an image in which a character 11 drawn on the acrylic stand 10 moves freely within a screen in accordance with instructions from the control unit 150.

[0029] The control unit 150 is a processor having a function of controlling each unit of the information processing device 100. The control unit 150 executes various programs stored in the storage unit 130 to fulfill the functions of the information processing device 100. By executing the various programs, the control unit 150 realizes the functions of a detection unit 151, a generation unit 152, a display control unit 153, and a reception unit 154.

[0030] The detection unit 151 detects the acrylic stand 10 in the captured image transmitted from the imaging unit 140. The detection unit 151 may detect the acrylic stand 10 from the transmitted captured image by pattern matching, for example. That is, example images of the acrylic stand 10 may be stored in advance, and the detection unit 151 may detect the acrylic stand 10 when the correlation with the example images exceeds a predetermined threshold. In this case, the captured image in which the range of the captured image in which the correlation exceeds the predetermined threshold is designated (annotated) is transmitted to the generation unit 152. The detection unit 151 may also detect the acrylic stand 10 from the captured image using a learning model. The learning model is a model trained using data that associates the captured image with information annotating the area where the acrylic stand 10 is present in the captured image as training data. Note that if the acrylic stand 10 is not included in the captured image, training data in which unannotated information is associated with the captured image is used. By learning a large amount of this training data, the learning model can input a captured image and determine whether or not the captured image includes an acrylic stand 10, and if the captured image includes an acrylic stand, output a captured image in which the area of ​​the acrylic stand 10 has been annotated. When the detection unit 151 detects the acrylic stand 10 in the captured image, it transmits the captured image in which the area of ​​the acrylic stand 10 has been annotated to the generation unit 152. The captured image in which the area of ​​the acrylic stand 10 has been annotated may be a captured image to which information indicating where the acrylic stand 10 is located in the captured image has been added. Note that the method for detecting the acrylic stand 10 in the captured image is not limited to these.

[0031] If there are multiple acrylic stands 10 in the captured image, the detection unit 151 may detect each of the multiple acrylic stands 10 and transmit the captured image in which the range of each of the multiple acrylic stands 10 has been annotated to the generation unit 152.

[0032] The generation unit 152 generates a display image of the character 11 included in the acrylic stand 10 detected by the detection unit 151. The generation unit 152 identifies the character 11 in the captured image in which the range of the acrylic stand 10 transmitted from the detection unit 151 is annotated. The generation unit 152 identifies which character 11 is by performing pattern matching between a plurality of character images previously stored in the storage unit 130 and the character 11 in the acrylic stand 10 in the captured image. Then, the generation unit 152 generates a 3D image 12 as a display image of the character 11 using a display image stored in correspondence with the identified character. As an example, the generation unit 152 may generate a 3D image 12 in which a display texture for the character 11 is applied to pseudo-skeleton data of the character 11 as a display image stored in correspondence with the character. The generation unit 152 transmits the generated 3D image 12 to the display control unit 153.

[0033] Furthermore, when the detection unit 151 detects multiple acrylic stands 10 in the captured image, the generation unit 152 identifies the characters 11 depicted on each of the multiple acrylic stands 10 and generates a 3D image 12 of the identified characters 11. Furthermore, the generation unit 152 may determine whether a specific combination is set among the multiple identified characters 11, and if a specific combination is set, generate a display image corresponding to the specific combination for the characters 11 with which the specific combination is set. Note that in this specification, the generation unit 152 may generate the 3D image 12 of the character 11 by reading out the 3D image 12 stored in advance in the storage unit 130 and writing it to a frame buffer as display data.

[0034] The display control unit 153 displays an image based on the display image generated by the generation unit 152 on the display unit of the information processing device 100. That is, the display control unit 153 causes the output unit 160 to display the 3D image 12 of the character 11 generated by the generation unit 152. More specifically, the display control unit 153 performs AR (Augmented Reality) display, in which the 3D image 12 generated by the generation unit 152 is superimposed on the captured image captured by the imaging unit 140 in accordance with a predetermined algorithm to display an image of the character 11 moving or performing some action within the display screen of the information processing device 100. That is, it is possible to display the character 11 depicted on the acrylic stand 10 moving freely within the display screen of the information processing device 100. The predetermined algorithm may be subdivided into algorithms representing multiple actions to display the character 11 moving, and the display control unit 153 selects one of the algorithms representing the multiple actions and displays the 3D image 12 of the character 11 according to the selected action algorithm. The algorithm representing a plurality of movements may be, for example, an algorithm for making the character 11 run, an algorithm for making the character 11 jump, an algorithm for making the character 11 walk, an algorithm for making the character 11 climb an object, an algorithm for making the character 11 fly into the air, or the like, but is not limited to these. The algorithm representing a plurality of movements may be set individually for each character 11, or may be set as a common algorithm regardless of the type of character 11. The display control unit 153 randomly selects and sequentially executes these plurality of movement algorithms, thereby displaying and providing to the user the appearance of the 3D image 12 of the character 11 moving freely within the display screen of the information processing device 100. Note that the plurality of movement algorithms may include a movement program for seamlessly connecting the movements of the algorithms when the character 11 successively executes them.

[0035] Furthermore, when information regarding the display mode of the 3D image 12 of the character 11 is transmitted from the reception unit 154 (described later), the display control unit 153 may change the display mode of the 3D image 12 of the character 11 based on the display mode and output the changed image to the output unit 160. For example, when enlarged display is transmitted as information regarding the display mode, the display control unit 153 may display the displayed 3D image 12 in a state where it is relatively larger than its current state. For example, when reduced display is transmitted as information regarding the display mode, the display control unit 153 may display the displayed 3D image 12 in a state where it is relatively smaller than its current state. For example, when a specific position within the image is designated as information regarding the display mode, the display control unit 153 may display the 3D image 12 of the character 11 moving toward the designated position.

[0036] The display control unit 153 may also detect objects other than the acrylic stand 10 included in the captured image and display the 3D image 12 according to the detected object. The other objects may be, for example, inorganic objects such as floors, walls, desks, chairs, and televisions, or living things such as people and pets. Displaying the 3D image 12 according to the detected object may involve displaying the 3D image 12 of the character 11 in a manner that assumes the presence of the object. For example, the character 11 may walk on a desk, bump into a wall and fall, or climb on a person's feet. This improves the realism of the display of the 3D image 12 of the character 11.

[0037] The receiving unit 154 receives information about the display mode of the 3D image 12 of the character 11 from the user of the information processing device 100 via the input unit 120.

[0038] The information regarding the display mode may be, but is not limited to, information instructing the movement direction of the 3D image 12 of the displayed character 11, information instructing an enlarged display of the 3D image 12 of the displayed character 11, or information instructing a reduced display of the 3D image 12 of the displayed character 11. The information regarding the display mode may be any information that indicates a display method for the 3D image 12, and may be information that specifies the color of the 3D image 12, information that indicates the color tone of the entire image, information that indicates an instruction to blend the 3D image 12 into the captured image, or information that indicates an instruction to display the 3D image 12 more prominently. The reception unit 154 transmits the received information regarding the display mode to the display control unit 153.

[0039] The above is an example of the configuration of the information processing device 100.

[0040] <Example of operation and display> Next, a description will be given of the operation of the information processing device 100. FIG.

[0041] The control unit 150 of the information processing device 100 executes the display application 131 stored in the storage unit 130 .

[0042] The imaging unit 140 of the information processing device 100 starts imaging in accordance with a user's instruction, and transmits the captured image (video) to the control unit 150 (step S301).

[0043] The detection unit 151 of the control unit 150 detects whether the acrylic stand 10 is present in the transferred captured image (step S302). If the detection unit 151 cannot detect the acrylic stand 10 (NO in step S302), the process ends.

[0044] When the detection unit 151 detects the acrylic stand 10 in the captured image (YES in step S302), it transmits an image in which the area of ​​the acrylic stand 10 is annotated to the captured image to the generation unit 152. The generation unit 152 extracts an image of the character 11 drawn on the acrylic stand 10 from the annotated portion of the captured image. Then, the generation unit 152 identifies which character the extracted character 11 is (step S303).

[0045] The generation unit 142 generates a 3D image 12 of the identified character 11 (step S304). The generation unit 142 transmits the generated 3D image 12 to the display control unit 153.

[0046] Based on the transmitted 3D image 12, the display control unit 153 displays, on the output unit 160 of the information processing device 100, an AR (Augmented Reality) image in which the 3D image 12 of the character 11 pops up from the position where the character 11 of the acrylic stand 10 is displayed in the captured image (step S305). Then, the display control unit 153 displays the 3D image 12 of the character 11 so that it moves according to a processing algorithm on the display screen, as if the character 11 has appeared from the acrylic stand 10 (step S306).

[0047] The control unit 150 determines whether or not an end input has been received from the user via the input unit 120 (step S307). The end input may be an input to end the execution of the display application 131, or an input to end the display of the 3D image 12 of the character 11 on the display application 131. If the end input has not been received (NO in step S307), the process proceeds to step S306, and the display control unit 153 continues displaying the 3D image 12. If the end input has been received (YES in step S307), the process ends.

[0048] The above is the basic operation of the information processing device 100 when the display application 131 is executed.

[0049] 3 will now be described using specific display examples. FIGS. 4 and 5 are diagrams showing display examples on the information processing device 100.

[0050] Fig. 4(a) is a diagram showing a display example at the start of execution of the display application 131. As shown in Fig. 4(a), a captured image including an acrylic stand 10 on which a character 11 is drawn is displayed on the touch panel (output unit 160) of the information processing device 100 as a captured image captured by the imaging unit 140. Fig. 4(a) shows an example in which a cat character is drawn as the character 11.

[0051] When the information processing device 100 detects the acrylic stand 10 in the captured image, it pops up a 3D image 12 of the character 11 included in the acrylic stand 10, as if it were coming out of the acrylic stand 10, as shown in FIG. 4(b). At this time, the information processing device 100 blanks out the area in the captured image where the character 11 was originally displayed, as shown in FIG. 4(b), thereby providing the user of the information processing device 100 with a display image that makes it appear as if the character 11 has come out of the acrylic stand 10. In other words, when the display control unit 153 displays the 3D image 12 of the character 11 coming out of the acrylic stand 10, it displays an image on the display unit in which the character 11 originally drawn on the acrylic stand 10 is masked.

[0052] The information processing device 100 then displays the 3D image 12 to perform various actions on the display screen of the information processing device 100 according to a predetermined algorithm. For example, the information processing device 100 may move the 3D image 12, and may, for example, display the 3D image 12 to jump from a desk as shown in FIG. 5(a) or to climb the legs of a desk as shown in FIG. 5(b). Alternatively, the information processing device 100 may cause the 3D image 12 to perform an action such as calling out to the user from within the display screen. Note that the action to be performed by the 3D image 12 is determined in advance in the display application 131, and may be determined by selecting one of a plurality of executable actions with a predetermined probability depending on the situation of the displayed 3D image 12 (such as where the 3D image 12 is standing).

[0053] In this way, the information processing device 100 can display the character 11 coming out of the acrylic stand 10 and performing various actions, which can make the user feel attached to the character 11. Furthermore, a display screen that the user will never tire of can be provided, and the user of the information processing device 100 can enjoy the character 11 as if it were a pet.

[0054] Next, an example of the operation of the information processing device 100 when a user input to the 3D image 12 of the character 11 is received will be described with reference to FIG.

[0055] The flowchart shown in Fig. 6 is a flowchart in which processing for when a user input is received is further added to the flowchart shown in Fig. 3. The flowchart shown in Fig. 6 differs from the flowchart shown in Fig. 3 in that processing of steps S601 and S602 is added between the processing of step S306 and the processing of step S307, and therefore, the processing of steps S601 and S602 will be described here.

[0056] In step S306, the display control unit 153 of the information processing device 100 displays a 3D image of the character 11 appearing from the acrylic stand 10 on the display screen of the information processing device 100.

[0057] Here, the accepting unit 154 determines whether or not an input regarding the display mode has been accepted from the user via the input unit 120 (step S601). If no input has been accepted (YES in step S601), the process proceeds to step S307.

[0058] The reception unit 154 transmits the information on the display mode received from the user via the input unit 120 to the display control unit 153. Then, the display control unit 153 changes the display mode of the 3D image 12 based on the transmitted information on the display mode, and displays the changed 3D image 12 of the character 11 (step S602). As described above, the change in the display mode may be an enlarged or reduced display of the 3D image 12 of the character 11, or a designation of a movement direction, etc.

[0059] The processing in steps S601 and S602 in FIG. 6 will be described using a specific example shown in FIG.

[0060] 7(a) shows an example in which a user performs an operation with his / her finger 70 on a display image of the information processing device 100. In FIG. 7(a), an example in which a pinch-out operation, that is, an instruction input for enlarging the display, is shown.

[0061] As a result, the information processing device 100 enlarges and displays the 3D image 12 of the character 11, as shown in FIG. 7(b). Note that, although an example of an enlarged display is shown in FIG. 7, the input related to the display mode is not limited to an enlarged display, as described above. The user may input various commands, such as narrowing the distance between their fingers 70 to reduce the display, touching a location on the screen where the 3D image 12 of the character 11 is not displayed to instruct movement to the touched position, or swiping their finger 70 in one direction on the screen to instruct the movement direction of the 3D image 12 of the character 11 along that direction, and the information processing device 100 may display the 3D image 12 according to the input content.

[0062] Next, an example of operation when extracting multiple acrylic stands will be described with reference to Figures 8 and 9. The flowchart shown in Figure 8 differs from the flowchart shown in Figure 3 in the processing from step S302 onwards. Here, a description of the contents common to the flowchart shown in Figure 3 will be omitted.

[0063] In step S302, when the detection unit 151 detects that an acrylic stand is present in the captured image (YES in step S302), the detection unit 151 further determines whether or not multiple acrylic stands can be detected (step S801). For example, when multiple ranges can be annotated as ranges in which the acrylic stand is present in the captured image, the detection unit 151 may determine that multiple acrylic stands are present in the captured image.

[0064] If multiple acrylic stands cannot be detected (NO in step S801), the information processing device 100 proceeds to the process of step S303 in FIG.

[0065] On the other hand, if the detection unit 151 detects multiple acrylic stands from the captured image (YES in step S801), the captured image in which the ranges of the multiple acrylic stands have been annotated is transmitted to the generation unit 152. The generation unit 152 identifies characters within each acrylic stand (step S802). That is, characters are extracted from each annotated range in the captured image, and pattern matching is performed with the images of each character stored in the storage unit 130 to identify the characters.

[0066] The generation unit 152 generates a display image for each of the specified characters. At this time, the generation unit 152 determines whether the specified characters are a specific combination. Information on the specific combination of characters is set in advance and stored in the storage unit 130.

[0067] If the identified multiple characters are a specific combination, the generation unit 152 generates a display image corresponding to the combination (step S803). The display image corresponding to the combination may be a special effect executed when displaying multiple characters of a specific combination, or may be an image effect that is not displayed individually. The type of display to be performed as the special effect is set in advance for each specific combination of characters and stored in the storage unit 130. Note that the same special effect may be set for multiple specific combinations of characters. In other words, when multiple acrylic stands are detected, the display control unit 153 performs a display that is different from when a single acrylic stand is detected and the 3D image 12 of the character 11 is displayed.

[0068] Then, the display control unit 153 displays the 3D images 12 of the multiple characters 11 on the display unit (output unit 160) together with special effects (step S804). Note that if the characters 11 of the multiple acrylic stands 10 are not a specific combination, the generation unit 152 may generate the respective 3D images 12, and the display control unit 153 may individually control the display of the generated 3D images 12.

[0069] Fig. 9 is a diagram showing a specific example of the operation shown in Fig. 8. Fig. 9(a) is a diagram showing an example in which the imaging unit 140 of the information processing device 100 displays a captured image. As shown in Fig. 9(a), it is assumed that the information processing device 100 has acquired a captured image including an acrylic stand 10 and an acrylic stand 90. A cat character 11 is drawn on the acrylic stand 10. Furthermore, a pig character 91 is drawn on the acrylic stand 90.

[0070] Upon detecting a plurality of acrylic stands 10, 90, the information processing device 100 identifies the character 11 and the character 91 and displays a special effect according to the combination. FIG. 9(b) is a diagram showing an example of the special effect display. As shown in FIG. 9(b), the information processing device 100 displays a 3D image 12 of the character 11 and a 3D image 92 of the character 91 flying on a balloon as a special effect. Note that the balloon as a special effect shown in FIG. 9(b) is merely an example, and any special effect may be used. For example, the special effect may be a display of an amusement park, a swimming pool, a fireworks display, or various other effects.

[0071] In this way, the information processing device 100 can detect multiple acrylic stands and display their characters. Furthermore, if the characters are a specific combination, the user can see a special effect, and the information processing device 100 can perform a display effect that the user will not tire of. In particular, if the acrylic stand is a collectible item or the like that is on sale, the user's desire to purchase it can be increased in order to see the special effect.

[0072] <Summary> The information processing device 100 described in the above embodiment can detect an acrylic stand in a captured image, identify the character 11 depicted on the acrylic stand, and freely move and display the image of the character 11. This allows the user to develop a deeper attachment to the character 11. Furthermore, since the information processing device 100 freely moves and displays the character 11, it is possible to display the character 11 in a way that the user will not tire of, rather than simply displaying the same movements over and over again. Furthermore, the information processing device 100 can change the display mode of the image of the character 11 in response to input from the user, thereby improving the degree of freedom in displaying the character 11 and, as a result, improving user satisfaction. Furthermore, when the information processing device 100 detects multiple acrylic stands 10 in a captured image, it can identify and display as many characters 11 as the number of acrylic stands 10. Furthermore, if a specific combination exists, it can display characters 11 according to the combination. Therefore, it is possible to perform special effects according to the combination of characters 11, thereby enhancing the user's interest in the characters 11.

[0073] <Supplementary information> The information processing device according to the above embodiment is not limited to the above embodiment, and may be realized by other methods. Various modifications will be described below.

[0074] (1) In the above embodiment, when the information processing device detects an acrylic stand in a captured image, it generates and displays a 3D image of a character drawn on the acrylic stand, allowing the character to move freely within the screen. In this case, the information processing device may continue to display the 3D image of the character only if the acrylic stand is present in the captured image, or, after displaying the 3D image of the character once, may continue to display it until the application is terminated or until the user receives an input instructing the end of the character display, even if the acrylic stand is not included in the captured image.

[0075] (2) In the above embodiment, the generation unit 152 generates the 3D image 12 of the character 11, but this does not have to be a 3D image and may be a 2D image.

[0076] (3) In the above embodiment, an example of operation when multiple acrylic stands are detected during the initial image capture has been described using Figures 8 and 9, but acrylic stand detection may be performed at any time. That is, if an acrylic stand is detected once and then another acrylic stand is newly detected, the character depicted on the other acrylic stand may be identified and an additional 3D image of the identified character may be displayed. Then, if a character depicted on another acrylic stand and the character originally displayed are identified as a specific combination, a display according to that combination may be performed.

[0077] (4) In the above embodiment, the display application 131 (storage unit 130) stores image data for pattern matching to identify a character, and data and operating programs for generating data for displaying the character. However, these may be stored in a server device on the web with which the information processing device 100 can communicate, and the information processing device 100 may be configured to sequentially download and acquire data and operating programs for generating data for displaying the character from the server device after identifying the character.

[0078] (5) In the above embodiment, after the information processing device 100 has performed the effect of the character 11 emerging from the acrylic stand 10, it masks the character 11 on the acrylic stand 10 by blanking out the character 11 so that the character 11 on the acrylic stand 10 is not displayed. However, this is not limited to blanking out the character 11. Instead of blanking out the character 11 on the acrylic stand 10, the information processing device 100 may be configured to generate and display an image in which the acrylic stand 10 is completely transparent, for example, by using an image generation AI.

[0079] (6) In the above embodiment, the method of detecting an acrylic stand in a captured image and displaying its character in the information processing device 100 is realized by the processor of the information processing device executing an information processing program or the like. However, this may also be realized by a logic circuit (hardware) or dedicated circuit formed in an integrated circuit (IC (Integrated Circuit) chip, LSI (Large Scale Integration)) or the like in the device. Furthermore, these circuits may be realized by one or more integrated circuits, and the functions of the multiple functional units described in the above embodiment may be realized by a single integrated circuit. LSIs are sometimes referred to as VLSIs, super LSIs, ultra LSIs, etc., depending on the degree of integration.

[0080] The information processing program may be recorded on a processor-readable recording medium, and the recording medium may be a "non-transitory tangible medium," such as a tape, disk, card, semiconductor memory, or programmable logic circuit. The information processing program may be supplied to the processor via any transmission medium (such as a communication network or broadcast waves) capable of transmitting the information processing program. The present invention may also be realized in the form of a data signal embedded in a carrier wave, in which the information processing program is embodied by electronic transmission.

[0081] The information processing program can be implemented using, for example, a scripting language such as ActionScript or JavaScript (registered trademark), an object-oriented programming language such as Objective-C, Java (registered trademark), or Python (registered trademark), or a markup language such as HTML5.

[0082] (7) The above-described embodiment and the various modifications shown in the supplementary notes may be combined as appropriate. [Explanation of symbols]

[0083] 10 Acrylic Stand 100 Information processing device 110 Communications Department 120 Input section 130 Storage section 140 Imaging unit 150 control section 160 Output section

Claims

1. An imaging unit; a detection unit that detects a transparent stand in a captured image captured by the imaging unit; a generation unit that generates a display image of a character included in the transparent stand detected by the detection unit; a display control unit that displays an image based on the display image on a display unit showing how the character moves in accordance with a predetermined movement algorithm; An information processing device comprising:

2. a reception unit that receives input from a user, The display control unit changes the display mode of the display image in accordance with the input content received by the receiving unit.

2. The information processing apparatus according to claim 1, wherein:

3. the input from the user is an input indicating enlargement; The display control unit enlarges the display image and displays it on the display unit.

3. The information processing apparatus according to claim 2, wherein:

4. the input from the user is an input indicating reduction; The display control unit reduces the display image and displays it on the display unit.

3. The information processing apparatus according to claim 2, wherein:

5. The display control unit displays the image based on the display image as an image of the character moving within the display unit, in accordance with an algorithm selected from a plurality of algorithms that define the movement of the character as the predetermined movement algorithm.

2. The information processing apparatus according to claim 1, wherein:

6. The detection unit further detects an object included in the captured image, The display control unit displays an image in which the character moves along the object.

6. The information processing apparatus according to claim 5,

7. When the detection unit detects a plurality of transparent stands, the generation unit generates a display image of each character included in each of the plurality of transparent stands; The display control unit displays the display image of each of the characters on the display unit in a display mode different from when the character is displayed alone.

2. The information processing apparatus according to claim 1, wherein:

8. The display control unit masks the portion of the transparent stand where the character is drawn.

2. The information processing apparatus according to claim 1, wherein:

9. The computer a detection step of detecting a transparent stand in a captured image; a generating step of generating a display image of the character included in the transparent stand detected in the detecting step; a display control step of displaying on a display unit an image based on the display image, the image showing how the character moves in accordance with a predetermined movement algorithm; An information processing method that performs the above.

10. On the computer, A detection function for detecting a transparent stand in a captured image; a generation function for generating a display image of the character included in the transparent stand detected by the detection function; a display control function that displays an image based on the display image on a display unit, showing how the character moves in accordance with a predetermined movement algorithm; An information processing program that makes this possible.

Images