Virtual space control system, virtual space control method, and computer program

Abstract

To improve user satisfaction in services that utilize virtual space. [Solution] A virtual space control system comprising a plurality of unit devices including an imaging device and an image display device, and further comprising a virtual space control device for controlling a virtual space, wherein the imaging device captures at least the front of an image display device included in the same unit device, and the image display device displays an image including the virtual space and an image captured by an imaging device included in another unit device.

Description

Technical Field

[0001] The present invention relates to a virtual space control system, a virtual space control method, and a computer program.

Background Art

[0002] In recent years, with the improvement of network technology, virtual spaces have begun to be utilized in various scenarios. For example, in the technology disclosed in Patent Document 1, a virtual space cooperation system that enables communication using an event area in a virtual space has been realized.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, the service provided to event attendees is still in the development stage, and further improvement of the service is desired. Such problems are not limited to events only but are common to all service provision using virtual spaces.

[0005] The present invention has been made in view of the above circumstances, and provides a technology that enables improvement of user satisfaction in services using virtual spaces.

Means for Solving the Problems

[0006] One aspect of the present invention is a virtual space control system comprising one or more unit devices including an imaging device and an image display device, and further comprising a virtual space control device for controlling a virtual space, wherein the imaging device captures at least the front of an image display device included in the same unit device, and the image display device displays an image including the virtual space and an image captured by an imaging device included in another unit device.

[0007] One aspect of the present invention is the virtual space control system described above, wherein the virtual space control device generates a virtual image image that includes an avatar located in the virtual space and an image captured by the imaging device, as an image captured from a viewpoint located in the virtual space.

[0008] The virtual space control system according to claim 1, wherein the virtual space control device generates a virtual image image that includes an image in the virtual space and an image captured by the imaging device, as an image captured from a viewpoint located in the virtual space.

[0009] One aspect of the present invention is the virtual space control system described above, further comprising a printing device for printing an image onto a sheet, wherein the printing device prints at least the virtual image onto the sheet and outputs the sheet.

[0010] One aspect of the present invention is the above-described virtual space control system, wherein the virtual space control device provides the user with the data of the virtual image.

[0011] One aspect of the present invention is a virtual space control method performed by a virtual space control system comprising a plurality of unit devices including an imaging device and an image display device, and further comprising a virtual space control device for controlling a virtual space, the method comprising the steps of: the imaging device imaging at least the front of an image display device included in the same unit device; and the image display device displaying an image including the virtual space and an image captured by an imaging device included in another unit device.

[0012] One aspect of the present invention is a computer program for causing a computer to function as a virtual space control system, comprising a plurality of unit devices including an imaging device and an image display device, and further comprising a virtual space control device for controlling a virtual space, wherein the imaging device captures at least the front of an image display device included in the same unit device, and the image display device displays an image including the virtual space and an image captured by an imaging device included in another unit device. [Effects of the Invention]

[0013] This invention makes it possible to improve user satisfaction in services that utilize virtual space. [Brief explanation of the drawing]

[0014] [Figure 1] This is a schematic block diagram showing the system configuration of the virtual space control system 100 of the present invention. [Figure 2] This figure shows a specific example of unit equipment 200. [Figure 3] This figure shows a specific example of a virtual space provided to the user via a unit device 10 by a virtual space control system 100. [Figure 4] This figure shows a specific example of a unit equipment 200 in operation. [Figure 5] This figure shows a specific example of a virtual space controlled by the virtual space control device 80 during operation. [Figure 6] This figure shows a schematic of imaging in a virtual space. [Figure 7] This figure shows a specific example of a virtual image captured by the virtual imaging device 403 in the state shown in Figure 6. [Figure 8] This figure shows a specific example of the output of the printing device 50. [Figure 9] This is a schematic block diagram showing a specific example of the functional configuration of the avatar control device 600. [Figure 10] This is a schematic block diagram showing a specific example of the functional configuration of the virtual space control device 80. [Figure 11]It is a diagram showing an outline of the hardware configuration example of the information processing apparatus 90 applied to the present embodiment.

Embodiment for Carrying Out the Invention

[0015] FIG. 1 is a schematic block diagram showing the system configuration of the virtual space control system 100 of the present invention. The virtual space control system 100 includes a plurality of unit facilities 200, an avatar operation device 600, and a virtual space control device 80. The unit facilities 200, the avatar operation device 600, and the virtual space control device 80 are communicably connected via a network 70. The network 70 may be a network using wireless communication or a network using wired communication. The network 70 may be configured using, for example, the Internet or a local area network (LAN). The network 70 may be configured by combining a plurality of networks.

[0016] The unit facility 200 includes one or more unit devices 10. The unit device 10 includes an imaging device 20, an audio input / output device 30, an image display device 40, a printing device 50, and a control device 60. Note that, in a plurality of unit devices 10, a part of the imaging device 20, the audio input / output device 30, the image display device 40, the printing device 50, and the control device 60 may be shared. For example, the control device 60 may be shared among a plurality of unit devices 10.

[0017] Next, an overview of the virtual space control system 100 of the present invention will be described. FIG. 2 is a diagram showing a specific example of the unit facility 200. The unit facility 200 includes one or more unit structures 300. The unit structure 300 is a physical structure, for example, it is composed of one wall surface. One unit facility 200 may be constituted by connecting a plurality of unit structures 300. In the example of FIG. 2, three unit structures 300 each have a structure corresponding to the wall surface of a hexagonal prism, thereby forming half of the structure of the hexagonal prism. Note that the shape in FIG. 2 is merely a specific example of the unit facility 200. For example, one unit facility 200 may be composed of one unit structure 300. In this case, one unit facility 200 may be configured as any housing, for example, it may be configured in a shape such as a vending machine or a digital signage.

[0018] The devices included in the unit facility 200 are provided for the unit structure 300. For example, in the example of FIG. 2, for the unit structure 300 configured as a wall surface, an imaging device 20, an audio input / output device 30, an image display device 40, a printing device 50, and a control device 60 are provided. The imaging device 20 is installed with its position and orientation adjusted so that it can image, for example, the face of a person standing in front of the image display device 40 with an angle of view. In the example of FIG. 2, the imaging device 20 is installed at a position higher than the image display device 40 and directed obliquely downward. The image data of the image captured by the imaging device 20 is input to the control device 60.

[0019] The audio input / output device 30 is installed at a position where it can acquire, for example, the voice signal of a person standing in front of the image display device 40. In the example of FIG. 2, the audio input / output device 30 is installed at a position below the image display device 40. The audio data of the audio acquired by the audio input / output device 30 is input to the control device 60. The audio input / output device 30 further outputs audio. For example, the audio input / output device 30 outputs audio at a volume recognizable by a person standing in front of the image display device 40.

[0020] The image display device 40 is positioned and oriented so that, for example, a person standing in front of the unit structure 300 can easily view the displayed content. The image display device 40 displays an image in accordance with the control of the control device 60. For example, the image display device 40 displays an image representing a scene in a virtual space provided by the virtual space control device 80. Such a scene image may include the figure of an avatar being operated by the avatar operation device 600. Such a scene image may also include an image captured by the imaging device 20 of another unit equipment 200.

[0021] The printing device 50 prints on a predetermined sheet and discharges the printed sheet from the discharge unit 51. The printing device 50 may also print and discharge a receipt, for example, for a person who has made a payment using the unit equipment 200. The printing device 50 is installed in a position where a person standing in front of the image display device 40 can easily pick up the discharged sheet. In the example in Figure 2, the printing device 50 is installed below the image display device 40.

[0022] Furthermore, the character profiles of the individuals described above may be set considering the age of the person using the unit equipment 200. For example, if children are assumed to be the users of the unit equipment 200, the imaging device 20, audio input / output device 30, image display device 40, and printing device 50 (especially the output unit 51) described above will be installed considering the average height of a child.

[0023] The control device 60 is configured using a communication-enabled information processing device. For example, the control device 60 communicates with the virtual space control device 80 via the network 70. The control device 60 controls each device included in the same unit device 10. For example, the control device 60 transmits image data generated by imaging by the imaging device 20 to the virtual space control device 80. The control device 60 transmits audio data generated by the audio input / output device 30 to the virtual space control device 80. The control device 60 receives image data generated by the virtual space control device 80 and displays it on the image display device 40. The control device 60 receives the print image generated by the virtual space control device 80 and causes the printing device 50 to print the received print image. If the image display device 40 is configured as a touch panel, the control device 60 acquires operation information regarding operations performed on the touch panel and transmits the acquired operation information to the virtual space control device 80. In the example in Figure 2, the control device 60 is installed on the back side of the unit structure 300 (the side opposite to the direction in which the screen of the image display device 40 faces), but it is not necessarily required to be attached to the unit structure 300.

[0024] In the example shown in Figure 2, three unit structures 300 are installed with their faces facing in different directions. Each unit structure 300 is provided with at least one unit device 10. The imaging device 20 of a unit device 10 installed in one unit structure 300 may be installed so as not to image a person looking at the image display device 40 installed in another unit structure 300 from the front. In the example shown in Figure 2, a combination of three unit structures 300 and unit devices 10 is shown in one unit facility 200. However, one unit facility 200 may be provided with two or fewer unit structures 300 and unit devices 10, or four or more unit facilities 200 may be provided with four or fewer unit structures 300 and unit devices 10.

[0025] Figure 3 shows a specific example of a virtual space provided to the user via the unit device 10 by the virtual space control system 100. The provided virtual space is a space that exists inside the screen of the image display device 40 of the unit device 10, with the screen being the boundary. For example, in the example shown in Figure 3, one or more virtual unit structures 400 and a virtual boundary frame 401 are arranged in the virtual space. The virtual unit structure 400 is provided with a virtual boundary frame 401.

[0026] Each unit structure 300, which is equipped with a unit device 10 included in the virtual space control system 100, corresponds to a virtual unit structure 400 in the virtual space. The side of the unit structure 300 on which the screen of the image display device 40 is located and the side of the virtual unit structure 400 in the virtual space are in a front-and-back relationship. The virtual boundary frame 401 displays an image of the real space that is assumed to exist beyond it. That is, the virtual boundary frame 401 is embedded and displayed with an image of the real world captured by the imaging device 20 provided on the unit structure 300 corresponding to the virtual unit structure 400. The virtual boundary frame 401 may be represented by an image such as a window frame.

[0027] Figure 4 shows a specific example of a unit equipment 200 in operation. The image display device 40 of each unit device 10 displays an image of the virtual space. Furthermore, images captured by other imaging devices 20 are displayed inside the virtual boundary frame 401 placed within the virtual space. For example, in front of the unit device 10 on the left side of Figure 4, a real-world user 302a is standing. The image display device 40 of this unit device 10 displays an avatar 402a with which user 302a is conversing. The audio input / output device 30 of this unit device 10 outputs the speech of avatar 402a and acquires the speech of user 302a.

[0028] The image display device 40 of the unit device 10 on the left side of Figure 4 displays images representing the situation in the virtual space, including an image of another avatar 402b and an image of another user 302b conversing with avatar 402b. User 302b is conversing with avatar 402b using another unit device 10 and is viewing the image of avatar 402b. The other unit device 10 may be located in the same unit facility 200 as the unit device 10 on the left side of Figure 4, or it may be a unit device 10 located in a physically separate facility. Each avatar 402 located in the virtual space is operated by an avatar operation device 600. The speech of avatar 402 may be the speech of the operator of the avatar operation device 600.

[0029] In Figure 4, the user 302a in the real space is not standing in front of the central unit device 10. The image display device 40 of this unit device 10 displays images of other avatars 402b and images of other users 302b conversing with avatar 402b, as images showing the situation in the virtual space. The virtual space displayed in the unit device 10 on the left side of Figure 4 and the virtual space displayed in the unit device 10 in the center of Figure 4 are the same virtual space. Therefore, although the viewpoint positions are different, the unit device 10 on the left side of Figure 4 and the unit device 10 in the center of Figure 4 display the same avatars 402 and objects in the same virtual space. Furthermore, these multiple unit devices 10 may display images of the real space that are common to them via a virtual boundary frame 401. In the example in Figure 4, the user 302b in the real space is displayed in the unit device 10 on the left side of Figure 4 and the unit device 10 in the center of Figure 4. Furthermore, if no person is detected in front of the unit device 10 (for example, if no person is detected in the image captured by the imaging device 20), or if no avatar 402 facing the unit device 10 is detected in the virtual space displayed by the unit device 10, the control device 60 may control the image display device 40 to display in a manner different from the normal state. For example, an obstruction such as a shutter or curtain may be displayed on all or part of the image display device 40 to show an image indicating that the avatar 402 is absent from the virtual space.

[0030] In Figure 4, a real-world user 302c is standing in front of the unit device 10 on the right side. The image display device 40 of this unit device 10 displays an avatar 402c with which the user 302c is conversing. The audio input / output device 30 of this unit device 10 outputs the speech of the avatar 402c and acquires the speech of the user 302c.

[0031] The size of the avatar 402 displayed on the image display device 40 may be controlled to be approximately life-size. Such control may be achieved, for example, by appropriately controlling the size of the screen of the image display device 40 and the size of the avatar 402 in the image displayed on the screen. More specifically, in the virtual space control device 80, which will be described later, when generating an image to be displayed on the image display device 40, the image of the avatar 402 is generated at a size corresponding to the size of the screen of the image display device 40.

[0032] Let's explain using the example of the unit device 10 on the left side of Figure 4. The image of avatar 402a is displayed on the screen of the image display device 40, which is located in front of user 302a. At this time, avatar 402a is displayed on the screen of the image display device 40 at a size close to life-size. For example, if avatar 402a is a humanoid avatar, the image of avatar 402a is displayed according to the size and body type of a typical human of the age and gender assumed by avatar 402a.

[0033] Figure 5 shows a specific example of a virtual space controlled by a virtual space control device 80 in operation. The virtual space shown in Figure 5 includes multiple virtual unit structures 400 and a virtual boundary frame 401. Although five virtual unit structures 400 are shown in Figure 5, the virtual unit structures 400 present in this virtual space are not limited to these five. For example, multiple virtual unit structures 400 may be connected to form a polygonal prism by arranging them in a ring shape. For example, if a unit equipment 200 forms a semi-hexagonal prism, the polygonal prism in the virtual space may be configured as a hexagonal prism. For example, if a unit equipment 200 forms a hexagonal prism, the polygonal prism in the virtual space may also be configured as a hexagonal prism.

[0034] In the example shown in Figure 5, avatar 402c is positioned directly in front of the virtual boundary frame 401 of the leftmost virtual unit structure 400. On the opposite side of this virtual boundary frame 401 (opposite avatar 402c), an image of the virtual space is generated as if the real-world user 302c were located. In other words, the virtual boundary frame 401 displays an image of the space in which user 302c is located.

[0035] In the example shown in Figure 5, avatar 402a is positioned directly in front of the virtual boundary frame 401 of the central virtual unit structure 400. On the opposite side of this virtual boundary frame 401 (opposite avatar 402a), an image of the virtual space is generated as if user 302a in real space were located. In other words, the virtual boundary frame 401 displays an image of the space in which user 302a is located.

[0036] Figure 6 is a schematic diagram of imaging in a virtual space. In the virtual space, a scene including an avatar 402 located within the virtual space and an image of the real space displayed inside the virtual boundary frame 401 may be imaged. For example, in Figure 6, a virtual imaging device 403 is provided in the virtual space. The avatar 402d or user 302d may image the scene in the virtual space by operating the virtual imaging device 403. Hereinafter, an image captured by the virtual imaging device 403 in this manner will be referred to as a virtual image.

[0037] Figure 7 shows a specific example of a virtual image captured by the virtual imaging device 403 in the state shown in Figure 6. The virtual image shown in Figure 7 includes the figure of avatar 402d located in the virtual space, the virtual boundary frame 401, and an image of the real space displayed inside the virtual boundary frame 401 (an image including the figure of user 302d). Such a virtual image may be captured, for example, by avatar 402d taking a selfie. In this case, the virtual imaging device 403 may be held by avatar 402d and may perform imaging in response to the operation of avatar 402d. Note that the virtual image captured by the virtual imaging device 403 does not necessarily need to include the figure of avatar 402. For example, the virtual image only needs to include an image of the virtual space and an image of the real space displayed inside the virtual boundary frame 401 (an image including the figure of user 302d).

[0038] Figure 8 shows a specific example of output from the printing device 50. In the example in Figure 8, the printing device 50 prints a receipt in response to a user's payment. Such a payment may be made using, for example, a unit equipment 200. More specifically, the unit equipment 200 may be equipped with a payment terminal, and the user may make the payment using that payment terminal. Payment using the unit equipment 200 is not limited to payment using a payment terminal as described above. For example, information used for payment (e.g., a two-dimensional encoded image) may be displayed on the screen of the image display device 40, and the user may make the payment by reading the two-dimensional encoded image using a mobile terminal. The printing device 50 may print a receipt in response to the user making a payment using the unit equipment 200. In this case, a virtual image captured by the virtual imaging device 403 may be printed on the receipt along with the avatar 402 displayed on the screen of the image display device 40. In this case, for example, a virtual space image may be transmitted from the virtual space control device 80 to the control device 60, and the printing device 50 may print in response to the control of the control device 60. Furthermore, the signature of avatar 402 (the word "Hana" in the example in Figure 8) may be printed on the receipt. Such a receipt may be output when a user purchases and pays for goods or services related to avatar 402 named "Hana". Note that the output method of the virtual image is not limited to printing on a sheet such as a receipt. For example, the virtual image may be provided to the user as electronic data. For example, an email with the virtual image data attached may be sent to an address registered by the user, or an email containing a URL to a site where the virtual image data can be downloaded may be sent. For example, the receipt printed by the printing device 50 may have a string of the URL to a site where the virtual image data can be downloaded or an encoded image (such as a barcode) printed on it. In this case, the virtual space control device 80 processes the virtual image data so that the above output is possible.

[0039] Next, we will describe an example configuration of the virtual space control system 100 as described above. As the unit equipment 200 has already been described, the following description will focus on the avatar operation device 600 and the virtual space control device 80.

[0040] Figure 9 is a schematic block diagram showing a specific example of the functional configuration of the avatar control device 600. The avatar control device 600 is configured using information devices such as a smartphone, tablet, personal computer, or dedicated equipment. The avatar control device 600 includes a communication unit 61, an input unit 62, an output unit 63, a storage unit 64, and a control unit 65.

[0041] The communication unit 61 is a communication device. The communication unit 61 may be configured, for example, as a network interface. The communication unit 61 communicates data with other devices via the network 70 in accordance with the control of the control unit 65. The communication unit 61 may be a device that performs wireless communication or a device that performs wired communication.

[0042] The input unit 62 is configured using existing input devices such as a keyboard, pointing device (mouse, tablet, etc.), buttons, or touch panel. The input unit 62 is operated by the user when inputting instructions from the user (operator of the avatar) to the avatar control device 600. The input unit 62 may also be an interface for connecting the input device to the avatar control device 600. In this case, the input unit 62 inputs the input signal generated in the input device in response to the user's input to the avatar control device 600. The input unit 62 may also be configured using a microphone and a speech recognition device. In this case, the input unit 62 acquires an acoustic signal generated by the user's speech, performs speech recognition on the words spoken by the user, and inputs the recognized string information to the avatar control device 600. The speech recognition processing may be performed by the control unit 65. The input unit 62 may be configured in any way that allows user instructions to be input to the avatar control device 600. When the input unit 62 is configured using a microphone, it may generate speech data corresponding to the user's speech.

[0043] The output unit 63 outputs information in a format that the user can recognize. The output unit 63 may be an image display device such as a liquid crystal display or an organic EL (Electro-Luminescence) display. The output unit 63 may also be an interface for connecting an image display device to the avatar control device 600. In this case, the output unit 63 generates a video signal for displaying image data and outputs the video signal to the image display device connected to it. The output unit 63 may also be a device that outputs sound, such as a speaker. The output unit 63 may also be an interface for connecting an audio output device such as a speaker or headphones to the avatar control device 600. In this case, the output unit 63 generates an audio signal for playing audio data and outputs the audio signal to the audio output device connected to it. The output unit 13 may be configured as a touch panel integrated with the input unit 62.

[0044] The storage unit 64 is configured using a storage device such as a magnetic hard disk drive or a semiconductor storage device. The storage unit 64 stores data used by the control unit 65. The storage unit 64 stores data necessary when the control unit 65 performs processing.

[0045] The control unit 65 is composed of a processor such as a CPU (Central Processing Unit) and memory (main memory). The control unit 65 functions when the processor executes a program. Note that all or part of the functions of the control unit 65 may be implemented using hardware such as an ASIC (Application Specific Integrated Circuit), PLD (Programmable Logic Device), or FPGA (Field Programmable Gate Array). The above program may be recorded on a computer-readable recording medium. Computer-readable recording media include, for example, portable media such as flexible disks, magneto-optical disks, ROMs, CD-ROMs, and semiconductor memory devices (e.g., SSDs: Solid State Drives), as well as storage devices such as hard disks and semiconductor memory devices built into computer systems. The above program may be transmitted via a telecommunications line.

[0046] The control unit 65 may, for example, execute an application installed on its own device (avatar control device 600). A specific example of such an application is an application provided to the avatar control device 600 as a dedicated application for the virtual space control system 100. Another specific example of such an application is a web browser application. Such an application may be pre-installed on the avatar control device 600, or it may be downloaded each time the virtual space is accessed. For example, if it is implemented as a web browser application, the avatar control device 600 may download and execute the application from a device specified by the web server (for example, the web server itself or another server) when the avatar control device 600 connects to a specific web server. The control unit 65 operates according to the program of the application being executed.

[0047] The control unit 65 controls the avatar operation device 600 in response to user operations and information received from the virtual space control device 80. For example, the control unit 65 transmits information input by the user through the operation of the input unit 62 (e.g., avatar operation information and voice data) to the virtual space control device 80 using the communication unit 61. Avatar operation information includes, for example, information indicating the movement, position change, or setting change of the avatar. For example, when the control unit 65 receives information transmitted from the virtual space control device 80 via the network 70 to the communication unit 61, it generates screen data based on the received information and displays the screen data on the output unit 63. Such screen data includes images and characters that represent the information transmitted from the virtual space control device 80. For example, the control unit 65 may display an image representing the virtual space on the output unit 63, which is configured using an image display device. A concrete example of such a virtual space is the virtual space displayed on the image display device 40 of the unit device 10. The avatar that is operated by the avatar operation device 600 is, for example, an avatar 402 located in the virtual space displayed on the image display device 40 of the unit device 10.

[0048] Figure 10 is a schematic block diagram showing a specific example of the functional configuration of the virtual space control device 80. The virtual space control device 80 is configured using information processing equipment such as a personal computer or a server device. The virtual space control device 80 includes a communication unit 81, a storage unit 82, and a control unit 83.

[0049] The communication unit 81 is a communication device. The communication unit 81 may be configured, for example, as a network interface. The communication unit 81 communicates data with other devices via the network 70 in accordance with the control of the control unit 83. The communication unit 81 may be a device that performs wireless communication or a device that performs wired communication.

[0050] The storage unit 82 is configured using a storage device such as a magnetic hard disk drive or a semiconductor storage device. The storage unit 82 stores data used by the control unit 83. The storage unit 82 may also function as, for example, a virtual space information storage unit 821 and an avatar information storage unit 822.

[0051] The virtual space information storage unit 821 stores information about the virtual space provided to multiple unit devices 10 by the virtual space control device 80. The virtual space information storage unit 821 stores, for example, information about objects placed in the virtual space. Information about objects includes, for example, the position coordinates of the object in the virtual space where it is placed, and information about the color and texture of the object's surface.

[0052] The avatar information storage unit 822 stores information about each avatar operated within the virtual space provided by the virtual space control device 80. The avatar information may include, for example, information about the appearance of the avatar operated by each user (information indicating size, pattern, shape, etc.) and information about the user of the avatar, in association with each other.

[0053] The control unit 83 is configured using a processor such as a CPU and memory. The control unit 83 functions as an information control unit 831, a virtual space control unit 832, and a virtual image generation unit 833 when the processor executes a program. Note that all or part of the functions of the control unit 83 may be implemented using hardware such as an ASIC, PLD, or FPGA. The above program may be recorded on a computer-readable recording medium. Computer-readable recording media include, for example, portable media such as flexible disks, magneto-optical disks, ROMs, CD-ROMs, and semiconductor storage devices (e.g., SSDs), as well as storage devices such as hard disks and semiconductor storage devices built into computer systems. The above program may also be transmitted via a telecommunications line.

[0054] The information control unit 831 acquires data from the unit devices 10 and the avatar operation devices 600, etc. For example, it receives motion image data captured by the imaging device 20 of the unit device 10 and audio data acquired by the audio input / output device 30. At this time, the information control unit 831 may receive this data in association with identification information indicating the unit devices 10 and the unit equipment 200. The information control unit 831 transmits information regarding the virtual space image generated by the virtual space control unit 832 to the unit devices 10 and the avatar operation devices 600. At this time, the information control unit 831 transmits the virtual space image generated at the viewpoint position corresponding to each unit device 10 to each unit device 10. The information control unit 831 also transmits the virtual space image generated at the viewpoint position corresponding to each avatar operation device 600 to each avatar operation device 600. The information control unit 831 may transmit the virtual image data generated by the control unit 83 to the unit device 10. The information control unit 831 may transmit the receipt image data generated by the control unit 83 to the unit device 10.

[0055] The virtual space control unit 832 performs processing related to the virtual space provided by the virtual space control device 80. For example, when it receives operation information regarding the movement of an avatar from the avatar operation device 600, the virtual space control unit 832 moves the avatar's position in the virtual space according to the received operation information. The virtual space control unit 832 generates an image in the virtual space at a viewpoint position specified by the user of the avatar operation device 600. For example, it generates an image in the virtual space at a viewpoint position defined for each unit device 10.

[0056] The virtual image generation unit 833 generates virtual images. The virtual image generation unit 833 generates virtual images in response to, for example, user operations in the unit device 10 or user (operator) operations in the avatar operation device 600.

[0057] The virtual space control system 100 configured in this way makes it possible to improve user satisfaction in services using virtual space. Specifically, this is as follows: Users can interact with avatars in the virtual space using the unit device 10. In addition, within the virtual space, the appearances of other avatars interacting with other users in other unit devices 10 and the appearances of other users are also displayed, so users can get a sense of sharing the space not only with their own avatar but also with other users and other avatars, which makes it possible to have a different experience from when operating the virtual space on a smartphone or a regular PC and improves satisfaction.

[0058] Furthermore, the virtual imaging device 403 captures images of the user displayed on the virtual boundary frame 401 along with the avatar located in the virtual space, generating a virtual image. As a result, it becomes possible to obtain an image that makes it appear as if the user is sharing the space with the avatar.

[0059] Furthermore, the virtual space control system 100 configured in this way makes it possible to suppress the increase in human resources required for customer service. In conventional methods such as video conferencing, customer service could not be provided to customers at multiple locations by a single service provider. Therefore, it was necessary to have at least one service provider at each location. In contrast, the virtual space control system 100 connects multiple locations to the virtual space, enabling a single service provider to handle customer service at multiple locations. Therefore, especially when customer service is required at multiple locations, it becomes possible to provide customer service with fewer service providers.

[0060] Figure 11 is a schematic diagram of an example hardware configuration of an information processing device 90 applied to this embodiment. The information processing device 90 comprises a processor 91, main memory 92, communication interface 93, auxiliary storage device 94, input / output interface 95, and internal bus 96. The processor 91, main memory 92, communication interface 93, auxiliary storage device 94, and input / output interface 95 are connected to each other via the internal bus 96 so as to be able to communicate with each other. The information processing device 90 may be applied to, for example, a virtual space control device 80. In this case, for example, the communication unit 81 may be configured using the communication interface 93. For example, the storage unit 82 may be configured using the auxiliary storage device 94. Also, the control unit 83 may be configured using the processor 91 and the main memory 92.

[0061] (modified version) The virtual space control device 80 may be implemented using multiple information processing devices. For example, the virtual space control device 80 may be implemented using a cloud or other similar device. For example, in the virtual space control device 80, the storage unit 82 and the control unit 83 may be implemented in different information processing devices.

[0062] While embodiments of this invention have been described in detail above with reference to the drawings, the specific configuration is not limited to these embodiments and includes designs and the like that do not depart from the spirit of this invention. [Explanation of Symbols]

[0063] 100…Virtual Space Control System, 10…Unit Device, 20…Imaging Device, 200…Unit Equipment, 30…Audio Input / Output Device, 300…Unit Structure, 302…User, 40…Image Display Device, 400…Virtual Unit Structure, 401…Virtual Boundary Frame, 402…Avatar, 403…Virtual Imaging Device, 50…Printing Device, 51…Ejection Unit, 60…Control Device, 61…Communication Unit, 62…Input Unit, 63…Output Unit, 64…Storage Unit, 65…Control Unit, 600…Avatar Operation Device, 70…Network, 80…Virtual Space Control Device, 81…Communication Unit, 82…Storage Unit, 821…Virtual Space Information Storage Unit, 822…Avatar Information Storage Unit, 83…Control Unit, 831…Information Control Unit, 832…Virtual Space Control Unit, 833…Virtual Image Generation Unit

Claims

1. The system comprises multiple unit devices, including an imaging device and an image display device. It is further equipped with a virtual space control device that controls the virtual space, The imaging device captures at least the front of the image display device included in the same unit device, The image display device is a virtual space control system that displays an image including the virtual space and an image captured by an imaging device included in another unit device.

2. The virtual space control system according to claim 1, wherein the virtual space control device generates a virtual image image that includes an image in the virtual space and an image captured by the imaging device, as an image captured from a viewpoint located in the virtual space.

3. The virtual space control system according to claim 1, wherein the virtual space control device generates a virtual image image that includes an avatar located in the virtual space and an image captured by the imaging device, as an image captured from a viewpoint located in the virtual space.

4. It further includes a printing device for printing images onto a sheet, The virtual space control system according to claim 2 or 3, wherein the printing device prints at least the virtual image onto a sheet to output the sheet.

5. The virtual space control system according to claim 2 or 3, wherein the virtual space control device provides the user with the data of the virtual image captured.

6. The system comprises multiple unit devices, including an imaging device and an image display device. A virtual space control method performed by a virtual space control system further comprising a virtual space control device for controlling a virtual space, The imaging device takes at least one image of the front of an image display device included in the same unit device, A virtual space control method comprising the steps of displaying an image on the image display device, which includes the virtual space and an image captured by an imaging device included in another unit device.

7. The system comprises multiple unit devices, including an imaging device and an image display device. It is further equipped with a virtual space control device that controls the virtual space, The imaging device captures at least the front of the image display device included in the same unit device, The image display device is a computer program that causes a computer to function as a virtual space control system, which displays an image including the virtual space and an image captured by an imaging device included in another unit device.

Images