Digital space display system, digital space display method, and program

Abstract

To enable users who use a digital space to easily feel a sense of unity. [Solution] A digital space display system comprising an image acquisition unit that acquires images taken by a user using a photographing device in real space via a network and stores the acquired images in a memory unit as exhibit objects in a digital space, and a digital space control unit that presents the images stored in the memory unit in a predetermined manner as exhibits in the digital space.

Description

[Technical field]

[0001] The present invention relates to a digital space display system, a digital space display method, and a program. [Background technology]

[0002] There is known a technique that enables a user as an individual member to browse a virtual exhibition hall using a terminal and request a catalog of exhibits or products that interest him or her (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2002-207922 A Summary of the Invention [Problem to be solved by the invention]

[0004] In the virtual exhibition hall of Patent Document 1, companies act as exhibitors and display products, etc., and individual users act as customers and view the exhibits. In the case of such virtual exhibition halls, since the exhibits are presented unilaterally by the exhibitors (companies) to the individual users, it is difficult to create a sense of unity among users participating in an event such as an exhibition held in a digital space.

[0005] In consideration of the above-mentioned problems, the present invention has an object to make it easier for users who use a digital space to feel a sense of unity. [Means for solving the problem]

[0006] One aspect of the present invention that solves the above-mentioned problems is a digital space display system that includes an image acquisition unit that acquires, via a network, images captured by a user using an imaging device in real space and stores the acquired images in a memory unit as exhibit objects in a digital space, and a digital space control unit that presents the images stored in the memory unit in a predetermined manner as exhibits in the digital space.

[0007] One aspect of the present invention is a digital space display method in a digital space display system, the digital space display method including an image acquisition step in which an image acquisition unit acquires, via a network, a captured image taken by a user with an imaging device in real space and stores the acquired captured image in a memory unit as an object of an exhibit in a digital space, and a digital space control step in which a digital space control unit presents the captured image stored in the memory unit in a predetermined manner as an exhibit in the digital space.

[0008] One aspect of the present invention is a program for causing a computer in a digital space display system to function as an image acquisition unit that acquires, via a network, images taken by a user using an imaging device in real space and stores the acquired images in a memory unit as exhibit objects in a digital space, and a digital space control unit that presents the images stored in the memory unit in a predetermined manner as exhibits within the digital space. Effect of the Invention

[0009] According to the present invention, an effect is obtained in that users who use a digital space can easily feel a sense of unity. [Brief description of the drawings]

[0010] [Figure 1] 1 is a diagram showing an example of the overall configuration of a digital space display system according to an embodiment of the present invention; [Diagram 2] FIG. 2 is a diagram showing an example of the appearance of an imaging facility according to the present embodiment. [Diagram 3] FIG. 2 is a diagram illustrating an example of a metaverse in the present embodiment. [Figure 4] 1A to 1C are diagrams illustrating examples of the arrangement of cosplay image panels in this embodiment. [Diagram 5] FIG. 2 is a diagram illustrating an example of a hardware configuration of a digital spatial control device according to the present embodiment. [Figure 6] FIG. 2 is a diagram illustrating an example of a functional configuration of a digital space control device according to the present embodiment. [Figure 7] FIG. 4 is a diagram showing an example of captured image related information in the present embodiment. [Figure 8] FIG. 4 is a diagram showing an example of avatar information according to the present embodiment. [Figure 9] 2 is a diagram illustrating an example of a functional configuration of an image transmitting device according to the present embodiment. [Figure 10] FIG. 2 is a diagram illustrating an example of a functional configuration of a user terminal according to the present embodiment. [Figure 11] 11 is a diagram showing an example of a processing procedure executed by the digital space display system in this embodiment in relation to the display of cosplay images in the metaverse. FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Fig. 1 shows an example of the overall configuration of a digital space display system in this embodiment. The digital space display system in this embodiment displays images (cosplay images) taken by costume players (hereinafter, cosplayers) in real space, in the metaverse (an example of a digital space) where cosplay images are exhibited as exhibits.

[0012] In this embodiment, the captured image may be a still image or a moving image captured over a predetermined period of time. In the following description, the captured image is a still image.

[0013] When a user who is a cosplayer takes a cosplay image of himself / herself, he / she goes to a photographing facility 200 installed in real space, for example, at an event venue or a satellite of the event venue. Although one photographing facility 200 is shown in the figure, one or more photographing facilities 200 may be installed at each of a number of predetermined locations.

[0014] Fig. 2 shows a specific example of the exterior of the photography facility 200. In Fig. 2, the same parts as in Fig. 1 are given the same reference numerals. As shown in Fig. 2, the photography facility 200 has a photography booth 201 and a photography device support 202. The photography booth 201 is a place where a cosplayer who is to be a subject enters to be photographed. The photographing device support 202 includes a photographing device 210 (camera), an image transmitting device 220, and an operation unit 230. The operation unit 230 may be a touch panel that allows an operation to be performed on the image display surface with an operating object such as a finger. The photographing device 210 is provided to photograph the photographing booth 201. A cosplayer who is to be the subject of the photographing operation operates, for example, an operation unit 230 provided in the photographing booth 201 to cause the photographing device 210 to take an image. The photographing device 210 outputs the photographed image obtained by photographing to the image transmitting device 220.

[0015] The image transmission device 220 transmits the captured image output from the photographing device 210 to the digital space control device 100 via the network. Every time a captured image is transmitted from the image transmission device 220, the digital space control device 100 stores the transmitted captured image and displays the stored captured image as a cosplay image in the metaverse. Although not shown in the figure, the image transmission device 220 also transmits the captured image output from the photographing device 210 to a download web server corresponding to the captured image download function of this embodiment. The download web server has a function of providing the user terminal 300 with an image download page used for downloading the transmitted captured image. The user terminal 300 can download the captured image by accessing the image download page. The digital space control device 100 and the download web server may be provided in a single server. Alternatively, the server serving as the digital space control device 100 may be configured to include a function as the download web server.

[0016] A user who is a cosplayer and has photographed himself / herself with the photographing facility 200 can access the digital space control device 100 with his / her own user terminal 300 to display the metaverse as an exhibition hall on the user terminal 300. The metaverse displayed on the user terminal 300 provides a virtual space as an exhibition hall where cosplay images are exhibited as exhibits. By viewing the metaverse displayed in this way, the user can enjoy the exhibition of cosplay images photographed of cosplayers, including himself / herself. The digital space control device 100 may be provided as a server on a network or a cloud server.

[0017] The user terminal 300 may be, for example, a smartphone, a tablet terminal, a personal computer, or the like.

[0018] In this embodiment, the photographed image is immediately transmitted to the digital space control device 100 in response to photographing performed by the photographing facility 200. The digital space control device 100 stores the photographed image in response to receiving the transmitted photographed image, and immediately displays the corresponding photographed image as a cosplay image in the metaverse at the timing of storage. In other words, the cosplay image is displayed in the metaverse with immediacy (real-time) in response to a user photographing with the photographing facility 200.

[0019] In addition, users other than the cosplayers who took the photos at the photography equipment 200 can also view the metaverse as an exhibition venue for cosplay images by accessing the digital space control device 100 with their own user terminals 300.

[0020] 3 shows an example of a metaverse as an exhibition venue for cosplay images displayed on a user terminal 300. In the metaverse shown in the figure, a lane LN is provided on the floor, and a plurality of cosplay image panels PN are arranged on the lane LN. Each cosplay image panel PN is a panel that exhibits a cosplay image based on one captured image.

[0021] The cosplay image panel PN includes an image area AR1 and an image related information area AR2. Cosplay images are arranged in the image area AR1. If the captured images that are the basis of the cosplay images are moving images for a predetermined period of time, the cosplay images may be presented in the image area AR1 by repeatedly displaying the moving images for a predetermined period of time.

[0022] In the image-related information area AR2, information (image-related information) about the corresponding cosplay image is presented. In the figure, the user name (nickname) of the corresponding cosplayer, the number of votes, etc. are shown as the image-related information. The user name presented in the image related information area AR2 may be input by the cosplayer when taking a photo with the photography facility 200. In addition, the image related information presented in the image related information area AR2 may include the date and time when the photo was taken.

[0023] In addition, a voting button BT is arranged under each cosplay image panel PN. In the metaverse, users can vote for cosplay images. Users may view the cosplay image panels PN on display and vote for their favorite cosplay image. Users can cast their vote by operating the voting button BT arranged under the cosplay image panel PN that is the subject of the vote.

[0024] 4 is a plan view of an example of the arrangement of the cosplay image panels PN. As shown in the figure, the cosplay image panels PN are arranged on the lane LN, and then, as shown by the dashed arrow, they appear from the right side of the back and move toward the front, then move toward the back after facing forward at the front, and then move further to the left at the back.

[0025] In addition, in the metaverse as an exhibition venue, avatar AVTs exist as shown in Fig. 3. The avatar AVTs correspond to the respective users who access the digital space control device 100 via the user terminal 300 and view the metaverse. In other words, the users can view the metaverse via the user terminal 300 by having their corresponding avatars exist in the metaverse. The user can move the avatar AVT corresponding to the user or give a gesture by operating the user terminal 300. The user terminal 300 displays the metaverse so that the user can observe the metaverse from a field of view according to the position and direction of the avatar corresponding to the user.

[0026] In response to the user as a cosplayer taking a photograph with the photographing facility 200, for example, a code symbol is displayed on the display unit of the image transmitting device 220. The code symbol may be a two-dimensional code or a one-dimensional barcode. The code symbol thus displayed describes the address (for example, URL (Uniform Resource Locator)) of an image download page for the cosplay image taken by the cosplayer.

[0027] When a cosplayer wishes to obtain a cosplay image taken by the photography facility 200, the cosplayer has the user terminal 300 read the displayed code symbol. The user terminal that reads the code symbol can download the cosplay image by accessing an image download page located at the address (URL) indicated by the read code symbol.

[0028] In this way, in the digital space display system of this embodiment, if a cosplayer user photographs himself / herself with the photography facility 200, the photographed image is displayed as a cosplay image in the metaverse together with cosplay images of other cosplayers. In this way, in this embodiment, a cosplay image exhibition is held using photographed images obtained by each cosplayer user photographing himself / herself, thereby creating a sense of unity among the cosplay users.

[0029] In addition, in this embodiment, if a cosplayer takes a picture of themselves, the corresponding cosplay image is immediately exhibited in the metaverse. In this case, the cosplayer user can participate in the exhibition in the metaverse in the same excited mood as when they took the picture of themselves, which can enhance the sense of unity. In addition, the ability to vote will help liven up the exhibition held in the metaverse.

[0030] An example of the hardware configuration of the digital space control device 100 will be described with reference to Fig. 5. The digital space control device 100 in the figure includes a communication device 1001, a read only memory (ROM) 1002, a random access memory (RAM) 1003, a storage 1004, a central processing unit (CPU) 1005, and a graphics processing unit (GPU) 1006. The communication device 1001, the ROM 1002, the RAM 1003, the storage 1004, the CPU 1005, and the GPU 1006 are connected by a bus 1007.

[0031] The communication device 1001 is a device that supports communication via a network. The ROM 1002 stores non-rewritable data. The RAM 1003 temporarily stores data used in the calculations executed by the CPU 1005 . The storage 1004 is, for example, a hard disk drive (HDD) or a solid state drive (SSD), and stores various types of data including, for example, program data. The CPU 1005 executes programs stored in the storage 1004 to perform calculations according to various controls, processes, and the like. The GPU 1006 executes processes related to image processing. In addition, functions equivalent to the digital space control device 100 may be obtained by multiple network terminals that are distributed so that transactions can be performed in accordance with the blockchain.

[0032] Fig. 6 shows an example of the functional configuration of the digital space control device 100. The functions of the digital space control device 100 shown in the figure are realized by a CPU (Central Processing Unit) included in the digital space control device 100 executing a program. The digital space control device 100 in the figure includes a communication unit 101, a control unit 102, and a storage unit 103. The communication unit 101 communicates with the image transmitting device 220 and the user terminal 300 via the network.

[0033] The control unit 102 executes various controls in the digital space control device 100. The control unit 102 in the figure includes an image acquisition unit 121 and a digital space control unit 122.

[0034] The image acquisition unit 121 acquires a captured image captured by the image capturing device 210. In this embodiment, in response to a captured image being captured by the image capturing device 210, the image transmission device 220 transmits captured image related information including the captured image and metadata (additional information) related to the captured image to the digital space control device 100. The metadata may include a user name input by the user when capturing an image, a capture date and time when the corresponding captured image was captured by the image capturing device, and the like. The image acquisition unit 121 acquires captured image related information transmitted from the image transmission device 220, thereby acquiring metadata along with the captured image.

[0035] The digital space control unit 122 executes control related to the metaverse (digital space). The digital space control unit 122 uses the digital space configuration information stored in the digital space configuration information storage unit 131 to create a metaverse environment as an exhibition venue for cosplay images. The digital space control unit 122 also uses the captured image related information stored in the captured image related information storage unit 132 to create a cosplay image panel PN, and places the created cosplay image panel PN on a lane LN in the metaverse. The digital space control unit 122 also moves the cosplay image panel PN placed on the lane LN in the metaverse. The digital space control unit 122 reflects the voting result in the metaverse in response to a voting operation performed on the user terminal 300.

[0036] The storage unit 103 stores various types of information compatible with the digital space control device 100. The storage unit 103 includes a digital space configuration information storage unit 131, a captured image related information storage unit 132, and an avatar information storage unit 133.

[0037] The digital space configuration information storage unit 131 stores digital space configuration information. In this case, the digital space configuration information may include data for reproducing backgrounds, objects, special effects, sounds, and the like that constitute a metaverse environment as an exhibition venue for cosplay images.

[0038] The photographed image related information storage unit 132 stores the photographed image related information. The photographed image related information is transmitted from the image transmitting device 220 in response to photography being performed by the photography facility 200.

[0039] 7 shows an example of photographed image related information corresponding to one photographed image. The photographed image related information in this figure includes fields for an image ID, a photographed image, a user name, a photographed date and time, a presentation order, and points (number of votes). The image ID field stores an image ID that is assigned to uniquely identify a captured image included in the corresponding image-related information. The photographed image field stores data of the photographed image. The user name field stores a user name. The user name is input by the user, who is a cosplayer, when taking a photo at the photography facility 200. The shooting date and time field stores the shooting date and time of the corresponding photographed image. The presentation order field stores the presentation order in the metaverse of the cosplay image panels PN using the corresponding photographed images. The cosplay image panels PN may be arranged on the lane LN according to the presentation order as shown in FIG. The presentation order may be set by the digital space control unit 122. The digital space control unit 122 may set the presentation order of the corresponding cosplay image panels PN based on, for example, the order in which the corresponding image-related information was received.

[0040] The point field stores a point value indicating the number of votes acquired by the corresponding cosplay image panel PN. As described above, a user viewing the metaverse displayed on the user terminal 300 can cast a vote for a cosplay image that he or she likes by operating the voting button BT (FIG. 3) located below the cosplay image panel PN. In response to the operation of the voting button BT, the digital space control unit 122 increases the point value stored in the image related information corresponding to the operated cosplay image panel PN.

[0041] The avatar information storage unit 133 stores avatar information for each user. The avatar information corresponding to one user is information about an avatar that the user uses as his or her avatar in the metaverse.

[0042] FIG. 8 shows an example of avatar information corresponding to one user. As shown in the figure, the avatar information corresponding to one user has a structure in which a combination of an avatar ID of a corresponding avatar and avatar configuration data is associated with a user ID. The avatar configuration data may be, for example, data indicating a combination of parts that constitute an object as the corresponding avatar. Furthermore, the avatar information may also include a user name of a user identified by the user ID. The user name is input, for example, when the user logs in to the metaverse of this embodiment.

[0043] In addition, multiple avatars may be set for one user, and the user may select one of the multiple avatars to exist in the metaverse. In this case, the avatar information for one user may store a combination of the avatar ID and avatar configuration data for each of the multiple avatars set.

[0044] An example of the functional configuration of the image transmitting device 220 will be described with reference to Fig. 9. Note that the hardware configuration of the image transmitting device 220 may include a communication device, a ROM, a RAM, a storage, a CPU, and a GPU, similar to that of Fig. 5, and may further include input devices such as a button, a keyboard, and a touch panel, and output devices such as a display and sound output.

[0045] The image transmitting device 220 in the figure includes a communication unit 221 , an operation unit 222 , a display unit 223 , a control unit 224 , and a storage unit 225 . The communication unit 221 is communicatively connected, by wire or wirelessly, to the image capturing device 210 in the same image capturing facility 200. The communication unit 221 is also communicatively connected to the digital space control device 100 via a network.

[0046] The operation unit 222 includes, for example, hardware devices such as keys and buttons, receives user operations, and outputs operation information corresponding to the received operations to the control unit 224. The operation unit 222 may also be capable of voice operations corresponding to voice uttered by the user.

[0047] The display unit 223 includes, for example, a display device as hardware, and displays images according to the control of the control unit 224 . A touch panel may be provided as hardware corresponding to the operation unit 222 and the display unit 223. Such a touch panel corresponds to the operation unit 230 in FIG.

[0048] The control unit 224 executes various controls in the image transmission device 220 .

[0049] The storage unit 225 stores information related to the image transmission device 220, including programs executed by the CPU, GPU, and the like included in the image transmission device 220, for example.

[0050] 2 shows an example in which the image transmission device 220 is provided on the photographing device support 202 side of the photographing facility 200. In this case, the parts corresponding to the operation unit 222 and the display unit 223 in the image transmission device 220 may be provided on the photographing booth 201 side so that the user in the photographing booth 201 can operate them. Alternatively, the image transmission device 220 itself may be provided on the photographing booth 201 side.

[0051] An example of the functional configuration of the user terminal 300 will be described with reference to Fig. 10. The hardware configuration of the user terminal 300 may include a communication device, ROM, RAM, storage, and a CPU (and GPU) in accordance with Fig. 5, and may also include input devices such as buttons, a keyboard, and a touch panel, and output devices such as a display and sound output. Furthermore, the user terminal 300 may include a camera corresponding to a code reader function that reads code symbols such as two-dimensional codes.

[0052] The user terminal 300 shown in FIG. 10 includes a communication unit 301 , an operation unit 302 , a display unit 303 , a code reader 304 , a control unit 305 , and a storage unit 306 . The communication unit 301 is communicably connected to the digital space control device 100 via a network. Also, the user terminal 300 and the image transmission device 220 may be communicable. In this case, the communication unit 301 may be communicably connected to the image transmission device 220 via a network or by short-distance wireless communication, for example.

[0053] The operation unit 302 includes, for example, a touch panel, keys, buttons, and other hardware devices, receives user operations, and outputs operation information corresponding to the received operations to the control unit 305. The operation unit 302 may also be capable of performing voice operations corresponding to voice uttered by the user.

[0054] The display unit 303 includes a display device such as a touch panel as hardware, and displays images under the control of the control unit 305 .

[0055] The control unit 305 executes various controls in the user terminal 300 .

[0056] The storage unit 306 stores information related to the user terminal 300, including programs executed by the CPU, GPU, etc., of the user terminal 300. Data of cosplay images downloaded by the user terminal 300 from an image download page in response to reading of a code symbol may be stored in the storage unit 306. The cosplay image data downloaded from the image download page may be stored in cloud storage via a network.

[0057] An example of a processing procedure executed by the digital space display system of this embodiment in relation to the exhibition of cosplay images in the metaverse will be described with reference to the sequence diagram of FIG.

[0058] Step S100: When a user as a cosplayer wants to display his / her cosplay image in the metaverse, he / she enters the photography booth 201 of the photography facility 200 and performs an operation corresponding to the cosplay image photography on the image transmission device 220. As an operation corresponding to the cosplay image photography, for example, the user first performs a language selection operation on the operation unit 222 to select the language to be displayed on the display unit 223.

[0059] Step S102: In response to a language selection operation by the user, the control unit 224 of the image transmitting device 220 sets the language to be displayed.

[0060] Step S104: The control unit 224 displays the shooting operation screen in the language set in step S102.

[0061] Step S106: A user name can be input on the displayed shooting operation screen. The user performs an operation to input the user name. The operation to input the user name may be, for example, a character input operation on a keyboard (which may be a software keyboard).

[0062] Step S108: The control unit 224 acquires information about the character string as the user name input in step S106.

[0063] Step S110: The image currently being captured by the image capturing device 210 is displayed on the image capturing operation screen. The user decides a pose for when he or she is photographed while watching the displayed image, and then performs an image capturing instruction operation on the operation unit 222.

[0064] Step S112: In response to the photographing instruction operation, the control unit 224 of the image transmission device 220 outputs a photographing instruction to the photographing device 210.

[0065] Step S114: The photographing device 210 performs photographing and recording in response to the photographing instruction.

[0066] Step S116: The photographing device 210 outputs the photographed image obtained by photographing and recording to the image transmitting device 220.

[0067] Here, the captured image may be allowed to be retaken within a predetermined upper limit of, for example, about three times. Note that the image capturing at the imaging facility 200 may be on a fee basis, and the upper limit of the number of times may be changed according to the amount of the fee paid by the user. The image transmitting device 220 may display the captured image input from the photographing device 210 in step S116 on the photographing operation screen, and may ask the user to confirm whether or not the currently captured image may be used as a cosplay image for exhibition. If the user wishes to retake the image, the user performs an operation to instruct the user to retake the image. In response to the operation to instruct the user to retake the image, the processes of steps S112 to S116 are executed, and the captured image is displayed again for confirmation on the shooting operation screen.

[0068] Step S118: If the user determines that the photographed image displayed on the photographing operation screen may be used as a cosplay image for exhibition, the user performs an image confirmation operation on the photographing operation screen. In addition, when the user retakes an image, multiple captured images taken so far may be presented as options on the shooting operation screen, and the user may select the captured image to be used as a cosplay image from the multiple captured images presented and then perform an image confirmation operation.

[0069] Step S120: In response to the image confirmation operation, the control unit 224 of the image transmission device 220 transmits the captured image confirmed by the image confirmation operation to be a cosplay image for exhibition, and captured image related information including the user name and the capture date and time acquired in step S108, to the digital space control device 100. For example, an image ID generated by the control unit 224 may be assigned to the captured image.

[0070] Step S122: In the digital space control device 100, the image acquisition unit 121 acquires the captured image related information transmitted in step S120. The image acquisition unit 121 sets the presentation order for the captured images included in the acquired captured image related information when they are displayed as cosplay image panels PN. The image acquisition unit 121 includes the presentation order in the captured image related information acquired from the image transmission device 220 and stores it in the captured image related information storage unit 132.

[0071] Step S124: In the digital space control device 100, the digital space control unit 122 creates a cosplay image panel PN using the photographed image related information stored in the photographed image related information storage unit 132 in step S122. The digital space control unit 122 places the created cosplay image panel PN in a position on the lane LN corresponding to the presentation order stored in the corresponding photographed image related information. In this way, the display of the cosplay image panel PN using the newly captured photographed image begins in the metaverse.

[0072] Step S126: Furthermore, the control unit 224 of the image transmitting device 220 also transmits the photographed image that has been confirmed as the cosplay image for exhibition by the image confirmation operation in step S118 to the download web server.

[0073] Step S128: In response to the upload of the photographed image in step S126, the download web server creates a web page (image download page) for downloading the uploaded photographed image, and saves the created image download web page at a predetermined URL. The download web server notifies the image transmitting device 220 of the URL of the image download web page. The control unit 224 of the image transmitting device 220 causes the display unit 223 to display a code symbol screen including a code symbol obtained by encoding the notified URL. At this time, the display unit 223 may display a message or the like informing the user that the captured image (cosplay image) can be downloaded from an image download page displayed on the user terminal in response to reading the code symbol.

[0074] Step S130: If the user wishes to download the cosplay image shot this time to his / her own user terminal 300, the user performs an operation to have the code reader 304 of the user terminal 300 read the displayed code symbol (code reading operation).

[0075] Step S132: In response to the code reading operation, the code reader 304 of the user terminal 300 reads the code symbol displayed on the display unit 223.

[0076] Step S134: The control unit 305 of the user terminal 300 accesses the URL indicated by the code symbol read by the code reader 304, and causes the display unit 303 to display an image download page. The displayed image download page may include, for example, the corresponding photographed image and a download button that allows an operation to instruct downloading. The image download page may also include an exhibition refusal declaration button that declares refusal of the photographed image (cosplay image) from being exhibited at an exhibition venue in the metaverse.

[0077] Step S136: If the user wishes to download his / her own captured image, he / she operates the download button on the image download page. In response to the operation of the download button, the control unit 305 downloads the captured image from the image download page. The control unit 305 may store the downloaded captured image in the storage unit 306. Alternatively, the control unit 305 may store the captured image in a storage allocated to the user's account in the cloud.

[0078] Step S138: If the user takes a cosplay image but does not want to exhibit the cosplay image at the exhibition venue in the metaverse, the user operates the exhibition refusal declaration button on the image download page (exhibition refusal operation). The exhibition refusal declaration button may be operable regardless of whether the download button is operated or not.

[0079] Step S140: In response to the display rejection operation, the control unit 305 of the user terminal 300 transmits a display rejection notice to the digital space control device 100 via the image download page. The display rejection notice may include, for example, an image ID that identifies the cosplay image (photographed image) that is subject to display rejection. The image ID is assigned to the cosplay image (photographed image) arranged on the image download page, for example.

[0080] Step S142: In the digital space control unit 122, the digital space control unit 122 excludes the cosplay image panel PN of the photographed image indicated by the image ID included in the transmitted exhibition refusal notice from exhibition at the exhibition venue in the metaverse. Even if the cosplay image panel PN is removed from the exhibition hall in the metaverse, the corresponding photographed image itself may be kept stored, for example, in the photographed image related information storage unit 132 without being deleted.

[0081] In response to excluding the target cosplay image panel PN in step S142, the image acquisition unit 121 may transmit an exclusion completion notification to the image transmission device 220. In response to receiving the exclusion completion notification, the image transmission device 220 may notify the user by displaying or outputting a sound that the target cosplay image panel PN has been excluded from the exhibition.

[0082] A modification of this embodiment will now be described.

[0083] In addition, photographing a user who is a cosplayer and uploading information related to the photographed image, including the photographed image obtained by the photographing, to the digital space control device 100 may be possible not only by the photographing equipment 200, but also by, for example, a user terminal 300 carried by the user. In this case, a user who is a cosplayer takes a selfie using, for example, the user terminal 300 that the user owns, and stores the captured image in the user terminal 300. The user then accesses, for example, a cosplay image exhibition metaverse with the user terminal 300, enters a user name, etc., and performs an operation to upload captured image related information including the stored captured image. The captured image related information uploaded in this manner is stored in the digital space control device 100, and a cosplay image panel PN based on the captured image included in the stored captured image related information is displayed in the metaverse.

[0084] In the present embodiment, the photographed images exhibited in the metaverse are required to be of real users dressed up as characters from animations, games, etc. as costume play. From this viewpoint, for example, if a user who is not dressed up as part of a costume play takes photographs using the photographing equipment 200 due to a mistake or the like and uploads photographed image related information, it may be preferable to prevent the cosplay image panel PN based on the uploaded photographed image related information from being displayed.

[0085] In response to the transmission of the captured image related information in step S120 of FIG. 11, the image acquisition unit 121 of the digital space control device 100 may analyze the captured image included in the transmitted captured image related information to determine whether or not the user as the subject is disguised as a cosplayer. In this case, the image acquisition unit 121 may use a trained model obtained by machine learning to determine whether or not the subject in the captured image is disguised as a cosplayer. In this case, the trained model may be constructed by inputting a data set in which images of a person disguised as a cosplayer are labeled as a cosplayer and a data set in which images of a person not disguised as a cosplayer are labeled as a non-cosplayer into a learning device and causing the learning device to learn the data set.

[0086] In addition, the exhibits displayed in the digital space by the digital space display system of this embodiment are not limited to cosplay images. The exhibits corresponding to this embodiment may be based on images taken by a user of a model, a figure, a doll, or the like as a subject.

[0087] The digital space that the digital space display system of the present embodiment supports is not limited to the metaverse. For example, the digital space that the present embodiment supports may be, for example, a two-dimensional virtual space, a digital twin, or the like.

[0088] In addition, a program for realizing the functions of the above-mentioned digital space control device 100, the photography facility 200 (photographing device 210, image transmission device 220), and the user terminal 300 may be recorded on a computer-readable recording medium, and the program recorded on the recording medium may be read into a computer system and executed to perform processing as the above-mentioned digital space control device 100, the photography facility 200 (photographing device 210, image transmission device 220), and the user terminal 300. Here, "reading a program recorded on a recording medium into a computer system and executing it" includes installing the program into a computer system. The "computer system" here includes hardware such as an OS and peripheral devices. In addition, the "computer system" may include multiple computer devices connected via a network including a communication line such as the Internet, a WAN, a LAN, or a dedicated line. In addition, the "computer-readable recording medium" refers to a portable medium such as a flexible disk, an optical magnetic disk, a ROM, or a CD-ROM, and a storage device such as an HDD or an SDD built into a computer system. In this way, the recording medium storing the program may be a non-transient recording medium such as a CD-ROM. The recording medium also includes a recording medium provided inside or outside the distribution server and accessible to distribute the program. The code of the program stored in the distribution server's recording medium may be different from the code of the program in a format executable by the terminal device. In other words, the format in which the program is stored in the distribution server does not matter as long as it can be downloaded from the distribution server and installed in a format executable by the terminal device. The program may be divided into multiple parts, downloaded at different times, and then combined in the terminal device, or each of the divided programs may be distributed by a different distribution server. Furthermore, the "computer-readable recording medium" includes a memory that holds the program for a certain period of time, such as a volatile memory (RAM) in a computer system that becomes a server or a client when the program is transmitted via a network. The program may be for realizing part of the above-mentioned functions.Furthermore, the above-mentioned functions may be realized in combination with a program already recorded in the computer system, that is, a so-called differential file (differential program).

[0089] <Additional Notes> (1) One aspect of this embodiment is a digital space display system that includes an image acquisition unit that acquires, via a network, images captured by a user using an imaging device in real space and stores the acquired images in a memory unit as exhibit objects in a digital space, and a digital space control unit that presents the images stored in the memory unit in a predetermined manner as exhibits in the digital space.

[0090] (2) One aspect of this embodiment is the digital space display system described in (1), wherein the digital space control unit may cause a captured image to be presented in the digital space depending on the timing at which the captured image is stored in the memory unit.

[0091] (3) One aspect of this embodiment is a digital space display system as described in (1) or (2), wherein the digital space control unit may present the captured image as an exhibit to be displayed in a digital space as a three-dimensional metaverse.

[0092] (4) One aspect of this embodiment is a digital space display system as described in any one of (1) to (3), wherein the digital space control unit may present photographed images of one or more exhibits as they move along a predetermined trajectory within the digital space.

[0093] (5) One aspect of this embodiment is a digital space display system according to any one of (1) to (4), wherein the memory unit stores a captured image in association with additional information relating to the captured image that was obtained together with the captured image, and the digital space control unit may present the captured image together with the additional information in the digital space.

[0094] (6) One aspect of this embodiment is a digital space display system as described in any one of (1) to (5), which may include an image capturing device in the real space that is installed at a predetermined shooting location, and an image transmitting device that is capable of performing operations to capture images using the image capturing device at the shooting location and transmit the captured images obtained by the image capturing device via a network so that the captured images are acquired by the image acquisition unit.

[0095] (7) One aspect of this embodiment is the digital spatial display system described in (6), wherein the image transmitting device may output address information indicating the address of a web page where the transmitted captured image is downloaded.

[0096] (8) One aspect of this embodiment is a digital space display system as described in any one of (1) to (7), wherein the digital space control unit may accept votes for a captured image exhibited as an exhibit in the digital space in response to an operation on a user terminal corresponding to an avatar present in the digital space, and present the accepted voting results in a predetermined manner in the digital space.

[0097] (9) One aspect of this embodiment may be a digital space display method in a digital space display system, the digital space display method including an image acquisition step in which an image acquisition unit acquires, via a network, a captured image taken by a user with an imaging device in real space and stores the acquired captured image in a memory unit as an object of an exhibit in a digital space, and a digital space control step in which a digital space control unit presents the captured image stored in the memory unit in a predetermined manner as an exhibit in the digital space.

[0098] (10) One aspect of this embodiment is a program for causing a computer in a digital space display system to function as an image acquisition unit that acquires, via a network, images captured by a user using an imaging device in real space and stores the acquired images in a memory unit as exhibit objects in digital space, and a digital space control unit that presents the images stored in the memory unit in a predetermined manner as exhibits in the digital space. [Explanation of symbols]

[0099] 100 Digital space control device, 101 Communication unit, 102 Control unit, 103 Memory unit, 121 Image acquisition unit, 122 Digital space control unit, 131 Digital space configuration information memory unit, 132 Photographed image related information memory unit, 133 Avatar information memory unit, 201 Photographing booth, 202 Photographing device support, 210 Photographing device, 220 Image transmission device, 221 Communication unit, 222 Operation unit, 223 Display unit, 224 Control unit, 225 Memory unit, 300 User terminal, 301 Communication unit, 302 Operation unit, 303 Display unit, 304 Code reader, 305 Control unit, 306 Memory unit

Claims

1. an image acquisition unit that acquires, via a network, an image captured by a user using an image capture device in real space and stores the acquired image in a storage unit as an object of an exhibit in a digital space; a digital space control unit that, when presenting the photographed images stored in the storage unit in a predetermined manner as exhibits in the digital space, presents a plurality of photographed images as the exhibits in a state in which the photographed images are arranged in a presentation order and moved within the digital space; A digital spatial display system comprising:

2. The captured image obtained by the photographing device is transmitted by an image transmitting device so as to be acquired by the image acquiring unit in response to a user's operation, The image acquisition unit immediately stores the received photographed image in the storage unit, The digital space control unit causes the captured image to be immediately presented in the digital space in response to the captured image being stored in the storage unit. The digital spatial display system according to claim 1 .

3. The digital space control unit presents the captured image as an exhibit to be exhibited in a digital space as a three-dimensional metaverse. The digital spatial display system according to claim 1 .

4. The digital space control unit presents one or more photographed images as the exhibits so as to move along a predetermined trajectory within the digital space. The digital spatial display system according to claim 1 .

5. the storage unit stores the photographed image in association with additional information related to the photographed image acquired together with the photographed image; The digital space control unit presents the captured image together with the additional information in the digital space. A digital spatial display system according to any one of claims 1 to 4.

6. the imaging device in the real space is installed at a predetermined imaging location; and an image transmission device operable to transmit the photographed image obtained by the photographing device via a network so that the photographed image is acquired by the image acquisition unit at the photographing location. A digital spatial display system according to any one of claims 1 to 4.

7. The image transmitting device outputs address information indicating an address of a web page where the transmitted captured image is downloaded. The digital spatial display system according to claim 6.

8. The digital space control unit receives votes for the photographed images exhibited as exhibits in the digital space in response to operations on user terminals corresponding to avatars present in the digital space, and presents the received voting results in a predetermined manner in the digital space. A digital spatial display system according to any one of claims 1 to 4.

9. A digital space display method in a digital space display system, comprising: an image acquisition step in which an image acquisition unit acquires, via a network, an image captured by a user using an image capture device in real space, and stores the acquired captured image in a storage unit as an object of an exhibit in a digital space; a digital space control step of presenting a plurality of photographed images as exhibits arranged in a presentation order so as to move within the digital space when the photographed images stored in the storage unit are presented in a predetermined manner within the digital space by a digital space control unit; A digital space display method comprising:

10. Computers in digital spatial display systems, an image acquisition unit that acquires, via a network, an image captured by a user using an imaging device in real space and stores the acquired image in a storage unit as an object of an exhibit in a digital space; a digital space control unit that, when presenting the photographed images stored in the storage unit in a predetermined manner as exhibits in the digital space, presents a plurality of photographed images as exhibits in a state in which the photographed images are arranged in a presentation order and moved within the digital space; A program to function as a

Images