Digital space display system, digital space display method, and program

Abstract

To allow a user using a digital space to easily feel a sense of unity.SOLUTION: The digital space display system includes an image acquisition unit that acquires a photographed image obtained by photographing a user by a photographing device in a real space via a network and stores the acquired photographed image in a storage unit as an object of an exhibit in a digital space, and a digital space control unit that presents the photographed image stored in the storage unit as the exhibit in the digital space in a predetermined mode.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to a digital space display system, a digital space display method, and a program. [Background technology]

[0002] There is known a technology that enables a user as an individual member to browse a virtual exhibition hall using a terminal and request a catalog of exhibits or products that interest him or her (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2002-207922 Summary of the Invention [Problem to be solved by the invention]

[0004] In the virtual exhibition hall of Patent Document 1, companies act as exhibitors and display products, etc., and individual users act as customers and view the exhibits. In the case of such a virtual exhibition hall, the exhibits are presented unilaterally by the corporate exhibitors to the individual users, making it difficult to create a sense of unity among users participating in an event such as an exhibition held in a digital space.

[0005] In consideration of the above-mentioned problems, the present invention aims to make it easier for users who use a digital space to feel a sense of unity. [Means for solving the problem]

[0006] One aspect of the present invention that solves the above-mentioned problems is a digital space display system that includes an image acquisition unit that acquires, via a network, images taken by a user using an imaging device in real space and stores the acquired images in a memory unit as exhibit objects in a digital space, and a digital space control unit that presents the images stored in the memory unit in a predetermined manner as exhibits in the digital space.

[0007] One aspect of the present invention is a digital space display method in a digital space display system, which includes an image acquisition step in which an image acquisition unit acquires, via a network, a captured image taken by a user using an imaging device in real space and stores the acquired captured image in a memory unit as an exhibit object in a digital space, and a digital space control step in which a digital space control unit presents the captured image stored in the memory unit in a predetermined manner as an exhibit within the digital space.

[0008] One aspect of the present invention is a program that causes a computer in a digital space display system to function as an image acquisition unit that acquires, via a network, images taken by a user using a camera in real space, and stores the acquired images in a memory unit as exhibit objects in a digital space, and a digital space control unit that presents the images stored in the memory unit in a predetermined manner as exhibits in the digital space. [Effects of the Invention]

[0009] According to the present invention, an effect is obtained in that users who use a digital space can easily feel a sense of unity. [Brief explanation of the drawings]

[0010] [Figure 1] 1 is a diagram showing an example of the overall configuration of a digital spatial display system according to an embodiment of the present invention; [Figure 2] FIG. 2 is a diagram showing an example of the appearance of the imaging equipment in the present embodiment. [Figure 3] FIG. 1 is a diagram illustrating an example of a metaverse according to an embodiment of the present invention. [Figure 4] 10A and 10B are diagrams illustrating an example of the arrangement of cosplay image panels in this embodiment. [Figure 5] FIG. 2 is a diagram illustrating an example of the hardware configuration of a digital space control device according to the present embodiment. [Figure 6] FIG. 2 is a diagram illustrating an example of a functional configuration of a digital space control device according to the present embodiment. [Figure 7] FIG. 4 is a diagram showing an example of captured image related information in the present embodiment. [Figure 8] FIG. 2 is a diagram showing an example of avatar information according to the present embodiment. [Figure 9] FIG. 2 is a diagram illustrating an example of a functional configuration of an image transmitting device according to the present embodiment. [Figure 10] FIG. 2 is a diagram illustrating an example of a functional configuration of a user terminal according to the present embodiment. [Figure 11] FIG. 10 is a diagram illustrating an example of a processing procedure executed by the digital space display system in this embodiment in relation to the display of cosplay images in the metaverse. DETAILED DESCRIPTION OF THE INVENTION

[0011] Figure 1 shows an example of the overall configuration of a digital space display system according to this embodiment. The digital space display system according to this embodiment displays images (cosplay images) taken by costume players (hereafter referred to as cosplayers) in real space in the metaverse (an example of a digital space) where cosplay images are exhibited as exhibits.

[0012] In this embodiment, the captured image may be a still image or a moving image of a predetermined duration. In the following description, the case where the captured image is a still image will be taken as an example.

[0013] When a cosplayer takes a cosplay image of themselves, they go to a photography facility 200 installed in real space, for example, at an event venue or a satellite of the event venue. Although one photography facility 200 is shown in the figure, one or more photography facilities 200 may be installed at each of a plurality of predetermined locations.

[0014] Fig. 2 shows a specific example of the exterior of the photography facility 200. In Fig. 2, the same parts as in Fig. 1 are given the same reference numerals. As shown in Fig. 2, the photography facility 200 has a photography booth 201 and a photography device support 202. The photography booth 201 is a place where cosplayers, who are to be photographed, enter to be photographed. The photographing device support 202 includes a photographing device 210 (camera), an image transmission device 220, and an operation unit 230. The operation unit 230 may be a touch panel that allows operations to be performed on the image display surface with an operating object such as a finger. The photographing device 210 is set up to photograph the photographing booth 201. The cosplayer, who is the subject, operates, for example, an operation unit 230 provided in the photographing booth 201 to cause the photographing device 210 to take an image. The photographing device 210 outputs the photographed image to the image transmitting device 220.

[0015] The image transmitting device 220 transmits the captured images output from the image capturing device 210 to the digital space control device 100 via the network. Each time a captured image is transmitted from the image transmitting device 220, the digital space control device 100 stores the transmitted captured image and displays the stored captured image as a cosplay image in the metaverse. Although not shown in the figure, the image transmitting device 220 also transmits the captured images output from the image capturing device 210 to a download web server that supports the captured image download function of this embodiment. The download web server has a function of providing the user terminal 300 with an image download page used to download the transmitted captured images. The user terminal 300 can download the captured images by accessing the image download page. The digital space control device 100 and the download web server may be provided in a single server, or the server serving as the digital space control device 100 may be configured to include the functionality of the download web server.

[0016] A user who is a cosplayer and has photographed themselves with the photography equipment 200 can access the digital space control device 100 with their own user terminal 300 to display the metaverse as an exhibition venue on the user terminal 300. The metaverse displayed on the user terminal 300 provides a virtual space as an exhibition venue where cosplay images are exhibited as exhibits. By viewing the metaverse displayed in this way, users can enjoy the exhibition of cosplay images of themselves and other cosplayers. The digital space control device 100 may be provided as a server on a network or a cloud server.

[0017] The user terminal 300 may be, for example, a smartphone, a tablet terminal, or a personal computer.

[0018] In this embodiment, when a photograph is taken by the photography facility 200, the photographed image is immediately transmitted to the digital space control device 100. When the transmitted photographed image is received, the digital space control device 100 stores the photographed image, and immediately displays the corresponding photographed image as a cosplay image in the metaverse at the time of storage. In other words, the cosplay image is displayed in the metaverse immediately (in real time) when a user takes a photograph with the photography facility 200.

[0019] In addition, users other than the cosplayers who took photos at the photography equipment 200 can also view the metaverse as an exhibition venue for cosplay images by accessing the digital space control device 100 with their own user terminals 300.

[0020] 3 shows an example of a metaverse as an exhibition venue for cosplay images displayed on a user terminal 300. In the metaverse shown in the figure, lanes LN are set up on the floor, and multiple cosplay image panels PN are arranged on the lanes LN. Each cosplay image panel PN is a panel that displays a cosplay image based on one captured image.

[0021] The cosplay image panel PN includes an image area AR1 and an image-related information area AR2. Cosplay images are arranged in the image area AR1. If the captured images that form the basis of the cosplay images are moving images over a predetermined period of time, the cosplay images may be presented in the image area AR1 by repeatedly displaying the moving images over a predetermined period of time.

[0022] The image-related information area AR2 displays information about the corresponding cosplay image (image-related information). In the figure, the image-related information includes the username (nickname) of the corresponding cosplayer, the number of votes, and so on. The user name presented in the image-related information area AR2 may be entered by the cosplayer when taking a photo using the photography equipment 200. The image-related information presented in the image-related information area AR2 may also include the date and time when the photo was taken.

[0023] In addition, a voting button BT is placed below each cosplay image panel PN. In the metaverse, users can vote for cosplay images. Users can view the cosplay image panels PN on display and vote for their favorite cosplay image. Users can cast their vote by operating the voting button BT placed below the cosplay image panel PN for which they are voting.

[0024] 4 is a plan view of an example of the arrangement of the cosplay image panels PN. As shown in the figure, the cosplay image panels PN are arranged on the lane LN, and then, as indicated by the dashed arrow, appear from the right of the back side, move toward the front, face forward at the front side, move toward the back side, and then move further toward the left at the back side.

[0025] Furthermore, in the metaverse, which serves as an exhibition venue, avatar AVTs exist as shown in Fig. 3. The avatar AVTs correspond to the respective users who access the digital space control device 100 via the user terminal 300 and view the metaverse. In other words, users can view the metaverse via the user terminal 300 by having their corresponding avatars exist in the metaverse. The user can move the avatar AVT corresponding to the user or give gestures to the avatar AVT by operating the user terminal 300. The user terminal 300 displays the metaverse so that the user can observe it from a field of view that corresponds to the position and direction of the avatar corresponding to the user.

[0026] Furthermore, in response to a user as a cosplayer taking a photo using the photography equipment 200, a code symbol, for example, is displayed on the display unit of the image transmission device 220. The code symbol may be a two-dimensional code or a one-dimensional barcode. The code symbol thus displayed contains the address (for example, a URL (Uniform Resource Locator)) of an image download page for the cosplay image taken by the cosplayer.

[0027] When a cosplayer wants to obtain a cosplay image taken by the cosplayer with the photography equipment 200, the cosplayer has the displayed code symbol read by the user terminal 300. The user terminal that reads the code symbol can download the cosplay image by accessing the image download page located at the address (URL) indicated by the read code symbol.

[0028] In this way, in the digital space display system of this embodiment, when a cosplayer user takes a photo of themselves using the photography facility 200, the photographed image is displayed as a cosplay image in the metaverse together with cosplay images of other cosplayers. In this way, in this embodiment, an exhibition of cosplay images is held using photographed images obtained by each cosplayer user photographing themselves, thereby creating a sense of unity among the cosplayer users.

[0029] In addition, in this embodiment, when a cosplayer takes a photo of themselves, the corresponding cosplay image is immediately exhibited in the Metaverse. In this case, the cosplayer user can participate in the Metaverse exhibition in the same excited mood as when they took the photo of themselves, which can further enhance the sense of unity. In addition, the ability to vote will help liven up the exhibition held in the Metaverse.

[0030] An example of the hardware configuration of the digital space control device 100 will be described with reference to Fig. 5. The digital space control device 100 in Fig. 5 includes a communication device 1001, a read only memory (ROM) 1002, a random access memory (RAM) 1003, a storage 1004, a central processing unit (CPU) 1005, and a graphics processing unit (GPU) 1006. The communication device 1001, the ROM 1002, the RAM 1003, the storage 1004, the CPU 1005, and the GPU 1006 are connected by a bus 1007.

[0031] The communication device 1001 is a device that supports communication via a network. The ROM 1002 stores non-rewritable data. The RAM 1003 temporarily stores data used in the calculations executed by the CPU 1005 . The storage 1004 is, for example, a hard disk drive (HDD) or a solid state drive (SSD), and stores various types of data, including program data. The CPU 1005 executes programs stored in the storage 1004 to perform calculations according to various controls and processes. The GPU 1006 executes processes related to image processing. In addition, functions equivalent to those of the digital space control device 100 may be obtained by multiple network terminals that are distributed so that transactions can be executed in accordance with the blockchain.

[0032] 6 shows an example of the functional configuration of the digital space control device 100. The functions of the digital space control device 100 shown in the figure are realized by a CPU (Central Processing Unit) included in the digital space control device 100 executing a program. The digital space control device 100 in the figure includes a communication unit 101, a control unit 102, and a storage unit 103. The communication unit 101 communicates with the image transmission device 220 and the user terminal 300 via the network.

[0033] The control unit 102 executes various controls in the digital space control device 100. The control unit 102 in the figure includes an image acquisition unit 121 and a digital space control unit 122.

[0034] The image acquisition unit 121 acquires a captured image captured by the image capturing device 210. In this embodiment, in response to a captured image being acquired by the image capturing device 210, the image transmission device 220 transmits the captured image and captured image related information including metadata (additional information) related to the captured image to the digital space control device 100. The metadata may include a user name entered by the user when capturing an image, the date and time when the corresponding captured image was captured by the image capturing device, and the like. The image acquisition unit 121 acquires the captured image related information transmitted from the image transmission device 220, thereby acquiring metadata along with the captured image.

[0035] The digital space control unit 122 executes control related to the metaverse (digital space). The digital space control unit 122 uses the digital space configuration information stored in the digital space configuration information storage unit 131 to create a metaverse environment as an exhibition venue for cosplay images. The digital space control unit 122 also uses the captured image related information stored in the captured image related information storage unit 132 to create cosplay image panels PN and arrange the created cosplay image panels PN on lanes LN in the metaverse. The digital space control unit 122 also moves the cosplay image panels PN arranged on lanes LN in the metaverse. The digital space control unit 122 reflects voting results in the metaverse in response to voting operations performed on the user terminal 300.

[0036] The storage unit 103 stores various types of information supported by the digital space control device 100. The storage unit 103 includes a digital space configuration information storage unit 131, a captured image related information storage unit 132, and an avatar information storage unit 133.

[0037] The digital space configuration information storage unit 131 stores digital space configuration information. In this case, the digital space configuration information may include data for reproducing backgrounds, objects, special effects, sounds, and the like that constitute the Metaverse environment as an exhibition venue for cosplay images.

[0038] The photographed image related information storage unit 132 stores the photographed image related information. The photographed image related information is transmitted from the image transmission device 220 in response to photography being performed by the photography equipment 200.

[0039] 7 shows an example of captured image related information corresponding to one captured image. The captured image related information in this figure includes fields for image ID, captured image, user name, capture date and time, presentation order, and points (number of votes). The image ID field stores an image ID that is assigned to uniquely identify the captured image included in the corresponding image-related information. The photographed image field stores photographed image data. The user name field stores the user name, which is input by the cosplayer user when taking a photo at the photography facility 200. The photographing date and time field stores the photographing date and time of the corresponding photographed image. The presentation order field stores the presentation order in the metaverse of cosplay image panels PN using the corresponding photographed images. The cosplay image panels PN may be arranged on the lane LN according to the presentation order as shown in FIG. The presentation order may be set by the digital space control unit 122. The digital space control unit 122 may set the presentation order of the corresponding cosplay image panels PN based on, for example, the order in which the corresponding image-related information was received.

[0040] The point field stores a point value indicating the number of votes acquired by the corresponding cosplay image panel PN. As described above, users viewing the Metaverse displayed on the user terminal 300 can cast their votes for their favorite cosplay images by operating the voting buttons BT (FIG. 3) located below the cosplay image panels PN. In response to the operation of the voting buttons BT, the digital space control unit 122 increases the value of points stored in the image-related information corresponding to the operated cosplay image panel PN.

[0041] The avatar information storage unit 133 stores avatar information for each user. The avatar information corresponding to one user is information about an avatar that the user uses as his or her alter ego in the metaverse.

[0042] FIG. 8 shows an example of avatar information corresponding to one user. As shown in the figure, the avatar information corresponding to one user has a structure in which a user ID is associated with a combination of the avatar ID of the corresponding avatar and avatar configuration data. The avatar configuration data may be, for example, data indicating a combination of parts that make up an object as the corresponding avatar. Furthermore, the avatar information may also include the username of the user identified by the user ID. The username is, for example, input when the user logs in to the metaverse of this embodiment.

[0043] It is possible to set multiple avatars for one user, and allow the user to select an avatar from the multiple avatars and have it exist in the metaverse. In this case, the avatar information for one user may store a combination of the avatar ID and avatar configuration data for each of the multiple avatars set.

[0044] An example of the functional configuration of the image transmitting device 220 will be described with reference to Fig. 9. Note that the hardware configuration of the image transmitting device 220 may include a communication device, ROM, RAM, storage, a CPU, and a GPU, similar to Fig. 5, and may further include input devices such as buttons, a keyboard, and a touch panel, and output devices such as a display and sound output.

[0045] The image transmitting device 220 in the figure includes a communication unit 221 , an operation unit 222 , a display unit 223 , a control unit 224 , and a storage unit 225 . The communication unit 221 is communicably connected by wire or wirelessly to the image capturing device 210 in the same image capturing facility 200. The communication unit 221 is also communicably connected to the digital space control device 100 via a network.

[0046] The operation unit 222 includes, for example, hardware devices such as keys and buttons, receives user operations, and outputs operation information corresponding to the received operations to the control unit 224. The operation unit 222 may also be capable of voice operation corresponding to the voice uttered by the user.

[0047] The display unit 223 includes, for example, a display device as hardware, and displays images under the control of the control unit 224 . A touch panel may be provided as hardware corresponding to the operation unit 222 and the display unit 223. Such a touch panel corresponds to the operation unit 230 in FIG.

[0048] The control unit 224 executes various controls in the image transmission device 220 .

[0049] The storage unit 225 stores information related to the image transmission device 220, including programs executed by the CPU, GPU, etc. provided in the image transmission device 220, for example.

[0050] 2 shows an example in which the image transmission device 220 is provided on the photographing device support 202 side of the photographing facility 200. In this case, parts corresponding to the operation unit 222 and the display unit 223 of the image transmission device 220 may be provided on the photographing booth 201 side so that they can be operated by a user in the photographing booth 201. Alternatively, the image transmission device 220 itself may be provided on the photographing booth 201 side.

[0051] An example of the functional configuration of the user terminal 300 will be described with reference to Fig. 10. The hardware configuration of the user terminal 300 may include a communication device, ROM, RAM, storage, a CPU (and GPU), input devices such as buttons, a keyboard, and a touch panel, and output devices such as a display and sound output, in accordance with Fig. 5. Furthermore, the user terminal 300 may include a camera corresponding to a code reader function that reads code symbols such as two-dimensional codes.

[0052] The user terminal 300 shown in FIG. 10 includes a communication unit 301 , an operation unit 302 , a display unit 303 , a code reader 304 , a control unit 305 , and a storage unit 306 . The communication unit 301 is communicably connected to the digital space control device 100 via a network. The user terminal 300 may be communicable with the image transmission device 220. In this case, the communication unit 301 may be communicably connected to the image transmission device 220 via a network or by short-range wireless communication, for example.

[0053] The operation unit 302 includes, for example, hardware devices such as a touch panel, keys, and buttons, receives user operations, and outputs operation information corresponding to the received operations to the control unit 305. The operation unit 302 may also be capable of voice operation corresponding to the voice uttered by the user.

[0054] The display unit 303 includes a display device such as a touch panel as hardware, and displays images under the control of the control unit 305 .

[0055] The control unit 305 executes various controls in the user terminal 300 .

[0056] The storage unit 306 stores information related to the user terminal 300, including programs executed by the CPU, GPU, etc. provided in the user terminal 300. Data of cosplay images downloaded by the user terminal 300 from an image download page in response to reading of a code symbol may be stored in the storage unit 306. The cosplay image data downloaded from the image download page may be stored in cloud storage via a network.

[0057] An example of a processing procedure executed by the digital space display system of this embodiment in relation to the exhibition of cosplay images in the Metaverse will be described with reference to the sequence diagram of FIG.

[0058] Step S100: To display his / her cosplay image in the Metaverse, the user as a cosplayer enters the photography booth 201 of the photography facility 200 and performs an operation corresponding to the cosplay image photography on the image transmission device 220. As an operation corresponding to the cosplay image photography, for example, the user first performs a language selection operation on the operation unit 222 to select the language to be displayed on the display unit 223.

[0059] Step S102: In response to a language selection operation by the user, the control unit 224 of the image transmission device 220 sets the language to be displayed.

[0060] Step S104: The control unit 224 displays the shooting operation screen in the language set in step S102.

[0061] Step S106: A user name can be input on the displayed shooting operation screen. The user performs an operation to input the user name. The operation to input the user name may be, for example, a character input operation on a keyboard (which may be a software keyboard).

[0062] Step S108: The control unit 224 acquires information about the character string as the user name input in step S106.

[0063] Step S110: The shooting operation screen displays the image currently being shot by the camera 210. While viewing the displayed image, the user decides on a pose for when the user is photographed, and then performs a shooting instruction operation on the operation unit 222.

[0064] Step S112: In response to the photographing instruction operation, the control unit 224 of the image transmission device 220 outputs a photographing instruction to the photographing device 210.

[0065] Step S114: In response to the instruction to take a photograph, the photographing device 210 performs photographing and recording.

[0066] Step S116: The photographing device 210 outputs the photographed image obtained by photographing and recording to the image transmitting device 220.

[0067] Here, the photographed image may be allowed to be retaken within a predetermined upper limit of, for example, about three times. Note that photography at the photographing facility 200 may be charged, and the upper limit of the number of times may be changed depending on the amount of the charge paid by the user. The image transmitting device 220 may display the captured image input from the photographing device 210 in step S116 on the photographing operation screen, and may ask the user to confirm whether or not the captured image may be used as a cosplay image for exhibition. If the user wishes to take a new photograph, the user performs an operation to instruct the user to take a new photograph. In response to the operation to instruct the user to take a new photograph, the processes of steps S112 to S116 are executed, and the photographed image is again displayed on the photographing operation screen for confirmation.

[0068] Step S118: If the user determines that the photographed image displayed on the photographing operation screen may be used as a cosplay image for exhibition, the user performs an image confirmation operation on the photographing operation screen. In addition, when the user retakes a photographed image, the photographed images taken so far may be presented as options on the photographing operation screen, and the user may select the photographed image to be used as a cosplay image from among the presented photographed images and then perform the image confirmation operation.

[0069] Step S120: In response to the image confirmation operation, the control unit 224 of the image transmission device 220 transmits the captured image that has been confirmed as a cosplay image for exhibition by the image confirmation operation, as well as captured image related information including the user name and the date and time of capture acquired in step S108, to the digital space control device 100. The captured image may be assigned an image ID generated by the control unit 224, for example.

[0070] Step S122: In the digital space control device 100, the image acquisition unit 121 acquires the captured image related information transmitted in step S120. The image acquisition unit 121 sets the presentation order for the captured images included in the acquired captured image related information when they are displayed as cosplay image panels PN. The image acquisition unit 121 includes the presentation order in the captured image related information acquired from the image transmission device 220 and stores the information in the captured image related information storage unit 132.

[0071] Step S124: In the digital space control device 100, the digital space control unit 122 creates a cosplay image panel PN using the captured image related information stored in the captured image related information storage unit 132 in step S122. The digital space control unit 122 places the created cosplay image panel PN in a position on the lane LN corresponding to the presentation order stored in the corresponding captured image related information. In this way, the display of cosplay image panels PN using newly captured captured images begins in the metaverse.

[0072] Step S126: Furthermore, the control unit 224 of the image transmission device 220 also transmits the photographed image, which has been confirmed as a cosplay image for exhibition by the image confirmation operation in step S118, to the download web server.

[0073] Step S128: In response to the upload of the photographed image in step S126, the download web server creates a web page (image download page) for downloading the uploaded photographed image, saves the created image download web page at a predetermined URL, and notifies the image transmitting device 220 of the URL of the image download web page. The control unit 224 of the image transmitting device 220 causes the display unit 223 to display a code symbol screen including a code symbol obtained by encoding the notified URL. At this time, the display unit 223 may display a message or the like informing the user that the captured image (cosplay image) can be downloaded from an image download page displayed on the user terminal in response to reading the code symbol.

[0074] Step S130: If the user wishes to download the cosplay image taken this time to his / her own user terminal 300, the user performs an operation to have the code reader 304 of the user terminal 300 read the displayed code symbol (code reading operation).

[0075] Step S132: In response to the code reading operation, the code reader 304 of the user terminal 300 reads the code symbol displayed on the display unit 223.

[0076] Step S134: The control unit 305 of the user terminal 300 accesses the URL indicated by the code symbol read by the code reader 304, and causes the display unit 303 to display an image download page. The displayed image download page may include, for example, the corresponding photographed image and a download button that can be used to instruct the download. The image download page may also include an exhibition refusal declaration button that can be used to declare refusal of the photographed image (cosplay image) from being exhibited at the exhibition venue in the metaverse.

[0077] Step S136: If the user wishes to download their own captured images, they operate the download button on the image download page. In response to the operation of the download button, the control unit 305 downloads the captured images from the image download page. The downloaded captured images may be stored in the storage unit 306. Alternatively, the control unit 305 may store the captured images in storage allocated to the user's account in the cloud.

[0078] Step S138: If the user has taken a cosplay image but does not want to exhibit the cosplay image at the exhibition venue in the metaverse, the user operates the exhibition refusal declaration button on the image download page (exhibition refusal operation). The exhibition refusal declaration button may be operable regardless of whether the download button has been operated or not.

[0079] Step S140: In response to the display rejection operation, the control unit 305 of the user terminal 300 transmits a display rejection notice to the digital space control device 100 via the image download page. The display rejection notice may include, for example, an image ID that identifies the cosplay image (photographed image) that is subject to display rejection. The image ID is assigned to the cosplay image (photographed image) that is arranged on the image download page, for example.

[0080] Step S142: In the digital space control unit 122, the digital space control unit 122 excludes the cosplay image panel PN of the photographed image indicated by the image ID included in the transmitted exhibition refusal notice from exhibition at the exhibition venue in the metaverse. Even if a cosplay image panel PN is removed from the exhibition site in the metaverse, the corresponding photographed image itself may remain stored in, for example, the photographed image related information storage unit 132 without being deleted.

[0081] In response to excluding the target cosplay image panel PN in step S142, the image acquisition unit 121 may transmit an exclusion completion notification to the image transmission device 220. In response to receiving the exclusion completion notification, the image transmission device 220 may notify the user by displaying or outputting sound that the target cosplay image panel PN has been excluded from the exhibition.

[0082] A modification of this embodiment will now be described.

[0083] In addition, photographing a cosplayer user and uploading the photographed image-related information, including the photographed images obtained by the photographing, to the digital space control device 100 may be possible not only by the photographing equipment 200 but also by, for example, a user terminal 300 carried by the user. In this case, a cosplayer user, for example, takes a selfie using their own user terminal 300 and stores the captured image in the user terminal 300. The user then accesses the cosplay image exhibition metaverse using the user terminal 300, enters a username, etc., and performs an operation to upload captured image-related information including the stored captured image. The uploaded captured image-related information is stored in the digital space control device 100, and a cosplay image panel PN based on the captured image included in the stored captured image-related information is displayed in the metaverse.

[0084] In this embodiment, the photographed images exhibited in the Metaverse are required to be of real users dressed up as characters from animations, games, etc. as part of costume play. From this perspective, if, for example, a user who is not dressed up as part of costume play accidentally takes a photograph using the photography equipment 200 and uploads photographed image related information, it may be preferable to prevent the cosplay image panel PN based on the uploaded photographed image related information from being displayed.

[0085] 11 , the image acquisition unit 121 of the digital space control device 100 may analyze the captured image included in the transmitted captured image-related information to determine whether the user as the subject is disguised as a cosplayer. In this case, the image acquisition unit 121 may use a trained model obtained by machine learning to determine whether the subject in the captured image is disguised as a cosplayer. In this case, the trained model may be constructed by inputting a dataset in which images of people disguised as cosplayers are labeled as cosplayers and a dataset in which images of people not disguised as cosplayers are labeled as non-cosplayers into a learner and causing the learner to learn.

[0086] It should be noted that the exhibits displayed in the digital space by the digital space display system of this embodiment are not limited to cosplay images. The exhibits corresponding to this embodiment may be based on images taken by a user of models, figurines, dolls, or the like.

[0087] The digital space supported by the digital space display system of this embodiment is not limited to the Metaverse. For example, the digital space supported by this embodiment may be a two-dimensional virtual space, a digital twin, or the like.

[0088] Note that programs for implementing the functions of the digital space control device 100, the photographing facility 200 (photographing device 210, image transmission device 220), and the user terminal 300 may be recorded on a computer-readable recording medium, and the programs may be loaded into a computer system and executed to perform the functions of the digital space control device 100, the photographing facility 200 (photographing device 210, image transmission device 220), and the user terminal 300. Here, "loading a program recorded on a recording medium into a computer system and executing it" includes installing the program on a computer system. The term "computer system" here includes hardware such as an OS and peripheral devices. The term "computer system" may also include multiple computers connected via a network, including communication lines such as the Internet, a WAN, a LAN, and a dedicated line. The term "computer-readable recording medium" refers to portable media such as a floppy disk, a magneto-optical disk, a ROM, or a CD-ROM, as well as storage devices such as a hard disk drive (HDD) or solid-state drive (SSD) built into a computer system. In this way, the recording medium storing the program may be a non-transitory recording medium such as a CD-ROM. The term "recording medium" also includes internal or external recording media accessible from a distribution server for distributing the program. The program code stored on the distribution server's recording medium may be different from the program code in a format executable by a terminal device. In other words, the format in which the program is stored on the distribution server is not important as long as it can be downloaded from the distribution server and installed in a format executable by a terminal device. The program may be divided into multiple parts, downloaded at different times, and then combined on a terminal device, or each of the divided programs may be distributed by a different distribution server. Furthermore, the term "computer-readable recording medium" also includes a medium that stores a program for a certain period of time, such as volatile memory (RAM) within a computer system that serves as a server or client when a program is transmitted over a network. The program may also be for implementing part of the functions described above.Furthermore, the above-mentioned functions may be realized in combination with a program already recorded in the computer system, that is, a so-called differential file (differential program).

[0089] <Additional Notes> (1) One aspect of this embodiment is a digital space display system that includes an image acquisition unit that acquires, via a network, images captured by a user using a camera in real space and stores the acquired images in a memory unit as exhibit objects in a digital space, and a digital space control unit that presents the images stored in the memory unit in a predetermined manner as exhibits in the digital space.

[0090] (2) One aspect of this embodiment is the digital space display system described in (1), wherein the digital space control unit may cause a captured image to be presented in the digital space depending on the timing at which the captured image is stored in the memory unit.

[0091] (3) One aspect of this embodiment is a digital space display system described in (1) or (2), in which the digital space control unit may present the captured image as an exhibit to be displayed in a digital space as a three-dimensional metaverse.

[0092] (4) One aspect of this embodiment is a digital space display system described in any one of (1) to (3), wherein the digital space control unit may present photographed images of one or more exhibits as they move along a predetermined trajectory within the digital space.

[0093] (5) One aspect of this embodiment is a digital space display system described in any one of (1) to (4), wherein the memory unit stores the captured image in association with additional information about the captured image that was acquired together with the captured image, and the digital space control unit may present the captured image together with the additional information in the digital space.

[0094] (6) One aspect of this embodiment is a digital space display system described in any one of (1) to (5), which may include an image capturing device in the real space that is installed at a predetermined capturing location, and an image transmitting device that can be operated to capture images using the capturing device at the capturing location and transmit the captured images obtained by the capturing device via a network so that the captured images are acquired by the image acquisition unit.

[0095] (7) One aspect of this embodiment is the digital spatial display system described in (6), wherein the image transmitting device may output address information indicating the address of a web page where the transmitted captured image is downloaded.

[0096] (8) One aspect of this embodiment is a digital space display system described in any one of (1) to (7), wherein the digital space control unit may accept votes for a photographed image displayed as an exhibit in the digital space in response to an operation on a user terminal corresponding to an avatar existing in the digital space, and may present the accepted voting results in a predetermined manner in the digital space.

[0097] (9) One aspect of this embodiment may be a digital space display method in a digital space display system, which includes an image acquisition step in which an image acquisition unit acquires, via a network, a captured image taken by a user using an imaging device in real space and stores the acquired captured image in a memory unit as an object of an exhibit in a digital space, and a digital space control step in which a digital space control unit presents the captured image stored in the memory unit in a predetermined manner as an exhibit in the digital space.

[0098] (10) One aspect of this embodiment is a program that causes a computer in a digital space display system to function as an image acquisition unit that acquires, via a network, images taken by a user using a photographing device in real space and stores the acquired images in a memory unit as exhibit objects in a digital space, and a digital space control unit that presents the images stored in the memory unit in a predetermined manner as exhibits in the digital space. [Explanation of symbols]

[0099] 100 Digital space control device, 101 Communication unit, 102 Control unit, 103 Memory unit, 121 Image acquisition unit, 122 Digital space control unit, 131 Digital space configuration information memory unit, 132 Captured image related information memory unit, 133 Avatar information memory unit, 201 Photography booth, 202 Photography device support, 210 Photography device, 220 Image transmission device, 221 Communication unit, 222 Operation unit, 223 Display unit, 224 Control unit, 225 Memory unit, 300 User terminal, 301 Communication unit, 302 Operation unit, 303 Display unit, 304 Code reader, 305 Control unit, 306 Memory unit

Claims

1. an image acquisition unit that acquires, via a network, an image captured by a user using an image capture device in real space and stores the acquired image in a storage unit as an exhibit object in the digital space; a digital space control unit that presents the photographed images stored in the storage unit in a predetermined manner as exhibits in the digital space; A digital spatial display system comprising:

2. The digital space control unit causes the captured image to be presented in the digital space in accordance with a timing at which the captured image is stored in the storage unit. The digital spatial display system of claim 1 .

3. The digital space control unit presents the captured image as an exhibit to be exhibited in a digital space as a three-dimensional metaverse. The digital spatial display system of claim 1 .

4. The digital space control unit presents one or more photographed images as the exhibits so as to move along a predetermined trajectory within the digital space. The digital spatial display system of claim 1 .

5. the storage unit stores the photographed image in association with additional information related to the photographed image that is acquired together with the photographed image; The digital space control unit presents the captured image together with the additional information in the digital space.

5. A digital spatial display system according to any one of claims 1 to 4.

6. The photographing device in the real space is installed at a predetermined photographing location, and an image transmitting device is provided which can perform operations to photograph with the photographing device at the photographing location and transmit the photographed image obtained by the photographing device via a network so that the photographed image is acquired by the image acquiring unit.

5. A digital spatial display system according to any one of claims 1 to 4.

7. The image transmitting device outputs address information indicating the address of a web page from which the transmitted captured image is downloaded. The digital spatial display system according to claim 6.

8. The digital space control unit receives votes for the photographed image exhibited as an exhibit in the digital space in response to an operation on a user terminal corresponding to an avatar present in the digital space, and presents the received voting results in a predetermined manner in the digital space.

5. A digital spatial display system according to any one of claims 1 to 4.

9. A digital space display method in a digital space display system, comprising: an image acquisition step in which an image acquisition unit acquires, via a network, an image captured by a user using an image capture device in real space, and stores the acquired image in a storage unit as an object of an exhibit in a digital space; a digital space control step in which a digital space control unit presents the photographed images stored in the storage unit as exhibits in a predetermined manner within the digital space; A digital space display method including:

10. Computers in digital spatial display systems, an image acquisition unit that acquires, via a network, an image captured by a user using an image capture device in real space and stores the acquired image in a storage unit as an object of an exhibit in the digital space; a digital space control unit that displays the photographed images stored in the storage unit as exhibits in the digital space in a predetermined manner; A program to function as a

Images