Virtual space control program, virtual space control system, and virtual space control method

Abstract

To provide a virtual space control program, a virtual space control system, and a virtual space control method, capable of enhancing a user's immersion feeling into a virtual space.SOLUTION: A content capable of being reproduced by a WEB browser and the like (for example, a LIVE-distributed moving image) and a comment thereof are made to be capable of being reproduced on a monitor 60 in a virtual space 50. Also, a user (player object PO) in the virtual space 50 can contribute a comment to the content. The comment contributed by the user in the virtual space 50 is also displayed on the monitor 60.SELECTED DRAWING: Figure 8

Description

[Technical Field]

[0001] At least one embodiment of the present invention relates to a virtual space control program, a virtual space control system, and a virtual space control method. [Background technology]

[0002] In recent years, a virtual space called the metaverse, which is constructed on a network in which many participants can act freely, has been provided (see, for example, Non-Patent Document 1).

[0003] In the virtual space, users can operate avatars (virtual objects) to perform various actions, such as interacting with other users. Non-Patent Document 1 also describes that a talk show filmed in a virtual studio was broadcast on a monitor in the virtual space (VR space). [Prior art documents] [Non-patent literature]

[0004] [Non-Patent Document 1] "VR Event "Sword Art Online Synthesis -The Period of Alicization Project-"," [online], Kayac Inc., [Retrieved October 12, 2021], Internet<URL:https: / / www.kayac.com / service / client / 1773> DISCLOSURE OF THE INVENTION [Problem to be solved by the invention]

[0005] In the virtual space described above, it is desirable to further enhance the range of actions that a user (avatar) can perform and to further enhance the user's sense of immersion in the virtual space.

[0006] It is an object of at least one embodiment of the present invention to address the deficiencies in the related art. [Means for solving the problem]

[0007] From a non-limiting perspective, a virtual space control program according to one embodiment of the present invention is a virtual space control program for causing a virtual space server device, which is connected via a communication network to a distribution system that allows viewers to post comments on content from their terminal devices and distributes content and comments to the viewers' terminal devices, and to terminal devices of users of the virtual space, to control the progress of the virtual space, and causes the virtual space server device to realize a playback control function that receives information for playing content and comments from the distribution system and plays the content and comments within the virtual space, and a comment acceptance function that accepts comments posted from users' terminal devices in the virtual space and transmits the comment information to the distribution system.

[0008] From a non-limiting perspective, a virtual space control system according to one embodiment of the present invention comprises a distribution system that allows viewers to post comments on content from their terminal devices and distributes the content and comments to the viewers' terminal devices, a terminal device of a user of the virtual space, and a virtual space server device connected to the distribution system and the user's terminal device via a communication network, and controls the progress of the virtual space, and includes a playback control means that receives information for playing the content and comments from the distribution system and plays the content and comments in the virtual space, and a comment acceptance means that accepts comments posted from the user's terminal device in the virtual space and transmits the comment information to the distribution system.

[0009] From a non-limiting perspective, a virtual space control method according to one embodiment of the present invention is a virtual space control method in which a virtual space server device connected via a communication network to a distribution system that allows viewers to post comments on content from their terminal devices and distributes content and comments to the viewers' terminal devices and to terminal devices of users in the virtual space controls the progress of the virtual space, and includes a playback control process that receives information for playing the content and comments from the distribution system and plays the content and comments in the virtual space, and a comment acceptance process that accepts comments posted from users' terminal devices in the virtual space and transmits the comment information to the distribution system. [Effects of the Invention]

[0010] Each embodiment of the present application addresses one or more of the deficiencies. [Brief explanation of the drawings]

[0011] [Figure 1] 1 is a block diagram illustrating an example of the configuration of a virtual space control system corresponding to at least one of the embodiments of the present invention. [Figure 2] 1 is a functional block diagram showing a configuration of a virtual space server device corresponding to at least one of the embodiments of the present invention. [Figure 3] 10 is a flowchart illustrating an example of a reproduction process according to at least one of the embodiments of the present invention. [Figure 4] 1 is a functional block diagram showing a configuration of a virtual space server device corresponding to at least one of the embodiments of the present invention. [Figure 5] 10 is a flowchart illustrating an example of a reproduction process according to at least one of the embodiments of the present invention. [Figure 6] 1 is a block diagram illustrating an example of the configuration of a virtual space control system corresponding to at least one of the embodiments of the present invention. [Figure 7] FIG. 1 is a diagram showing an example of a game image according to at least one embodiment of the present invention. [Figure 8]FIG. 1 is a diagram showing an example of a game image according to at least one embodiment of the present invention. [Figure 9] FIG. 1 is a diagram showing a portion of a game image corresponding to at least one embodiment of the present invention. [Figure 10] FIG. 1 is a diagram showing an example of a still image according to at least one embodiment of the present invention. [Figure 11] 1 is a functional block diagram showing a configuration of a virtual space server device corresponding to at least one of the embodiments of the present invention. [Figure 12] FIG. 2 is a diagram illustrating an example of user data according to at least one embodiment of the present invention. [Figure 13] 10 is a flowchart illustrating an example of a reproduction process according to at least one of the embodiments of the present invention. [Figure 14] 10 is a flowchart illustrating an example of a photographing process according to at least one of the embodiments of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0012] Hereinafter, examples of embodiments of the present invention will be described with reference to the drawings. Note that the various components in the examples of the embodiments described below can be combined as appropriate to the extent that no inconsistencies or the like arise. Furthermore, the content described as an example of one embodiment may be omitted in other embodiments. Furthermore, the content of operations and processes unrelated to the characteristic parts of each embodiment may be omitted. Furthermore, the order of the various processes constituting the various flows described below may be in any order to the extent that no inconsistencies or the like arise in the processing content.

[0013] [First embodiment] Fig. 1 is a block diagram showing an example of the configuration of a virtual space control system 100 according to an embodiment of the present invention. As shown in Fig. 1, the virtual space control system 100 includes a distribution system 500, a virtual space server device 10, and a plurality of terminal devices 20, 201 to 20N (N is an arbitrary integer). The distribution system 500 includes, for example, a distribution server device 510.

[0014] The distribution system 500 (distribution server device 510), the virtual space server device 10, and the multiple terminal devices 20, 201 to 20N are each connected to a communication network 15 such as the Internet. Note that the configuration of the virtual space control system 100 is not limited to this, and for example, the functions of each server device may be combined into a single server device, or the functions of each server device may be further subdivided to provide three or more server devices.

[0015] The virtual space control system 100 has various functions for reproducing content and comments posted on this content in a virtual space.

[0016] Content includes creative works such as movies, music, video games, etc. Also, for example, live streaming videos with a set broadcast (distribution) time fall under the category of content. Comments include critiques, opinions, and impressions of content. Posted comments are played along with the content.

[0017] The distribution system 500 corresponds to a video platform such as YouTube (registered trademark) or Niconico (registered trademark), for example.

[0018] The content and comments can be directly distributed from the distribution system 500 to the viewer's terminal device (not shown) via the communication network 15. In the viewer's terminal device, for example, the distributed content and comments are played back on a web browser or the like. Also, the viewer can post comments while viewing the content on a web browser or the like.

[0019] Comments are displayed overlaid on the video of the content. In the case of live streaming videos, comments posted by viewers watching the live streaming video are also displayed in real time on the web browsers of other viewers.

[0020] Hereinafter, a user of the virtual space will be referred to as a user, and a person viewing content etc. on a web browser etc. will be referred to as a viewer.

[0021] In this embodiment, the content that can be played back on the above-mentioned web browser is also played back in the virtual space. For example, the content is played back (displayed) on a large virtual monitor (virtual object) placed in the three-dimensional virtual space. Therefore, for example, each user of the terminal devices 20, 201 to 20N can view the content and comments in the virtual space by moving their own avatar near the monitor in the virtual space.

[0022] That is, the users of the terminal devices 20, 201 to 20N can view the content and comments without using a web browser or the like, while continuing their activities in the virtual space.

[0023] Furthermore, each user of the terminal devices 20, 201 to 20N can continue their activities in the virtual space while posting comments on the content without using a web browser, etc. Comments posted in the virtual space are also played back together with the content in the web browser, etc.

[0024] Comments posted via a web browser or the like are also played in the virtual space. That is, comments posted via a web browser or the like and comments posted in the virtual space are played together with the content.

[0025] In this embodiment, for example, a live streaming video is played as content. Also, for example, during the live streaming, posted comments are displayed superimposed on the video of the live streaming video (see, for example, FIG. 8(B)).

[0026] The distribution system 500 has various functions for providing information about content and comments to the viewer's terminal device and the virtual space server device 10. The distribution system 500 includes a distribution server device 510.

[0027] The distribution server device 510 is managed by a content administrator and has various functions for distributing content and comments on the content to viewers' terminal devices and the virtual space server device 10. The distribution server device 510 distributes (transmits), for example, information for playing back the content and comments. The distribution server device 510 is configured by an information processing device such as a WWW server, and includes one or more storage media (storage units) for storing information on each content and comment. The distribution server device 510 also includes a control unit, etc., configured by a CPU, etc. The above configuration is a typical configuration, so a detailed description will be omitted.

[0028] The storage unit may be a configuration built into distribution server device 510 or may be a configuration of a storage device such as a database device separate from distribution server device 510.

[0029] Virtual space server device 10 is managed by an administrator of virtual space control system 100, and has various functions for providing information related to the control of progress in the virtual space to terminal devices 20, 201-20N. Virtual space server device 10 provides, for example, information for generating images of the virtual space. In this embodiment, virtual space server device 10 is configured by an information processing device such as a WWW server to provide information related to the control of progress in the virtual space, and includes one or more storage media (storage units) for storing various information. Virtual space server device 10 also includes a control unit configured by a CPU or the like. Note that the above configuration is a typical configuration, so detailed description will be omitted.

[0030] The storage unit may be a configuration built into the virtual space server device 10, or may be a configuration of a storage device such as a database device separate from the virtual space server device 10.

[0031] 2 is a functional block diagram showing the configuration of virtual space server device 10A, which is an example of the configuration of virtual space server device 10. Virtual space server device 10A is provided with at least a playback control unit 11 and a comment receiving unit 12, with the control unit executing software for controlling the progress of the virtual space (a virtual space control program) stored in the storage unit. The virtual space control program also includes control data used to control the virtual space.

[0032] The playback control unit (playback control function, playback control means) 11 receives information for playing back content and comments from the distribution system 500, and plays back the content and comments in the virtual space.

[0033] The playback control unit 11 receives and plays back content data and comments (text data) via streaming distribution, for example. For example, upon receiving a comment, the playback control unit 11 displays the comment superimposed on the video of the content. Furthermore, for example, the playback control unit 11 erases a comment after a predetermined time has elapsed since the start of display.

[0034] The information for reproducing the content and comments distributed from the distribution system 500 is the same as the information distributed to the viewer's terminal device.

[0035] The reproduction control unit 11 may, for example, make a request to the distribution system 500 to distribute one piece of content (including the corresponding comment), and receive information for reproducing the content and the comment from the distribution system 500.

[0036] The comment receiving unit (comment receiving function, comment receiving means) 12 receives comments posted from the terminal devices 20, 201 to 20N of each user in the virtual space. The comment receiving unit 12 receives comments (e.g., text data) from the terminal devices 20, 201 to 20N of each user, generates comment information, and transmits it to the distribution system 500.

[0037] The comment information includes, for example, identification information of the corresponding content, the comment (text data), the comment posting time, etc. The comment posting time is, for example, the playback time of the content at the time the comment is input (posted) relative to the start time of playback of the content. The comment receiving unit 12 may, for example, use the playback time when the comment is received as the posting time.

[0038] Next, the terminal devices 20, 201 to 20N will be described. Each of the multiple game terminal devices 20, 201 to 20N is managed by a user who uses the virtual space, and is configured by a communication-enabled terminal device such as a stationary game device, a personal computer, a mobile phone terminal, a PDA (Personal Digital Assistant), or a portable game device.

[0039] Each of the terminal devices 20, 201 to 20N includes an operation device (operation unit), a storage medium (storage unit), a control unit configured with a CPU or the like, a display unit, an audio output unit (speaker, etc.), a communication control unit, etc. The above-described configuration is a general configuration, so detailed description will be omitted. In addition, the storage unit of the terminal devices 20, 201 to 20N stores software (application programs) and the like for various communications with the server device 10 regarding progress in the virtual space.

[0040] The terminal devices 20, 201 to 20N generate images of the virtual space based on, for example, image information received from the virtual space server device 10. Furthermore, the terminal devices 20, 201 to 20N transmit, for example, comments input by the user using the operation unit to the virtual space server device 10.

[0041] Next, as an example of the configuration of the virtual space control system 100, the operation of the virtual space control system 100A including the virtual space server device 10A and the plurality of terminal devices 20, 201 to 20N will be described.

[0042] 3 is a flowchart showing an example of content playback processing executed by the virtual space control system 100A. In the playback processing in this embodiment, processing for playing content and comments in the virtual space and processing for accepting comment posting are performed. Note that FIG. 3 mainly describes the processing for playing content and comments and the processing for accepting comment posting, and some other processing may be omitted. Below, an example will be described in which the playback processing is executed by the virtual space server device 10A and the user's terminal device 20.

[0043] The playback process of this embodiment is executed, for example, at the start time of the live broadcast or a predetermined time before the start time.

[0044] Virtual space server device 10A transmits a content distribution request to distribution server device 510 (step S10). The distribution request is transmitted including, for example, content identification information.

[0045] Next, virtual space server device 10A starts playing content, etc. (step S11). Specifically, virtual space server 10A receives data of the live streaming video and comment information transmitted from distribution server device 510, and plays back the content and comments. Through the playback, for example, the video of the live streaming video and comments are displayed on the screen (video display area) of a monitor in the virtual space.

[0046] Next, the virtual space server device 10A determines whether or not a comment has been posted (step S12). When the virtual space server device 10A receives a comment (for example, text data) from the terminal device 20, it may determine that a post has been made.

[0047] If no comment has been posted (step S12: NO), the virtual space server device 10A proceeds to the processing of step S15.

[0048] On the other hand, if a comment has been posted (step S12: YES), virtual space server device 10A transmits the comment to distribution server device 510 (step S13). Specifically, virtual space server device 10A generates comment information including the received comment and transmits it to distribution server device 510.

[0049] The distribution server device 510 receives comment information from the terminal devices of viewers who are watching the live-distributed video and from the virtual space server device 10A.

[0050] Next, virtual space server device 10A determines whether or not the reproduction of the content etc. has ended (step S15). Virtual space server device 10A may determine that the reproduction has ended when the end time of the live distribution has arrived, for example.

[0051] If the playback has not ended (step S15: NO), the virtual space server device 10A returns to the processing of step S11 and continues playing the content, etc. Therefore, during the live distribution, comments posted by viewers and users watching this video are also displayed in real time.

[0052] On the other hand, if the playback has ended (step S15: YES), the virtual space server device 10B ends the playback process.

[0053] Although not shown, the server device 10A repeatedly generates image information for generating one frame of an image including the updated virtual space, including the above-mentioned reproduction process, and transmits the image information to the terminal device 20.

[0054] For example, image information is generated for generating an image of the virtual space taken by a virtual camera controlled based on the position of a player object (avatar) operated by a user (FIGS. 7 and 8, afterglow).

[0055] Meanwhile, the terminal device 20 displays on the display unit an image of the virtual space based on the image information etc. received from the virtual space server device 10A (step S40) (see FIGS. 7 and 8). In this case, if the image includes the monitor described above, the content etc. will also be displayed on the display unit.

[0056] Furthermore, if a comment posting operation is performed during live distribution, the terminal device 20 transmits the comment to the virtual space server device 10 (step S41).

[0057] Next, the terminal device 20 determines whether or not to exit the virtual space (step S42). For example, if an exit (end) request from the user is received (step S42: YES), the terminal device 20 ends the display of the virtual space.

[0058] Although the process shown in FIG. 3 has been described with respect to the terminal device 20, the same process is performed for the terminal devices of the users in the same (common) virtual space.

[0059] As described above, in one aspect of the first embodiment, virtual space server device 10A is configured to include playback control unit 11 and comment receiving unit 12, so that content and comments that can be viewed on a web browser or the like can be viewed in the virtual space. Therefore, users can view content and comments while continuing their activities in the virtual space. Furthermore, each user can also post comments on content while continuing their activities in the virtual space.

[0060] This allows the actions that the user can perform in the virtual space to be enriched, further increasing the user's sense of immersion in the virtual space.

[0061] Furthermore, by playing content in a virtual space, it is possible to apply the present invention to virtual public viewing events, where many users gather around a monitor in the virtual space to watch the same content.

[0062] The above-described virtual space can also be applied to virtual spaces in video games and the like.

[0063] The above-mentioned "comments posted in a virtual space" are comments posted using a function provided in the virtual space.

[0064] The above-mentioned configuration in which comments are superimposed on the video of the content may be configured such that the comments are superimposed on one end of the video of the content and move at a constant speed from one end to the other end, and the comments that reach the other end are deleted.

[0065] The display format of the content and comments in the virtual space described above does not need to be exactly the same as the display format in a web browser, etc. For example, the character font of the comments may be different.

[0066] In the above embodiment, characters and symbols (text data) are used as comments, but images such as stamps may also be used as comments.

[0067] In the above-described embodiment, the virtual space server device executes a virtual space control program to control the playback of content, etc. However, this is not limited to this. A part of the processing executed by the virtual space server device illustrated in FIG. 3 may be executed by a user's terminal device.

[0068] [Second embodiment] In this embodiment, a description will be given of a virtual space control system 100B, which is an example of the virtual space control system 100. The virtual space control system 100B includes a distribution system 500, a virtual space server device 10B, and a plurality of terminal devices 20, 201 to 20N.

[0069] In this embodiment, a player object of a user performs actions such as movement in a virtual space (e.g., a three-dimensional virtual space). The player object is an object (avatar) that acts in the virtual space as the user's avatar, and is an object that is operated by the user. For example, player objects include characters such as people, robots, and animals, vehicles such as automobiles, spheres such as balls, and cards.

[0070] For example, a user controls his / her player object via an operation unit. The actions include, for example, movement (walking, running), jumping, attacking, and talking. This allows the user (player object) to visit various places in the virtual space, participate in events held in the virtual space, and talk with other users (other player objects).

[0071] An example of the event is a public viewing in which a live streaming video (content) and comments displayed on a virtual monitor are viewed together with other users (other player objects).

[0072] An image of the virtual space captured by the virtual camera is displayed on the display unit of the terminal devices 20, 201 to 20N (see FIGS. 7 and 8). For example, the virtual camera moves following the movement of the player object, and captures images so that the player object is always included.

[0073] Therefore, for example, when the user's player object moves near the monitor, an image of the virtual space including the monitor is displayed on the display unit.

[0074] That is, while content or the like is being played back, the user can view the content displayed on the monitor by moving the player object near the monitor.

[0075] In addition, in this embodiment, a comment posted by a user on content is output to the virtual space as a statement from the user's own player object. For example, a speech bubble object containing the comment is placed near (e.g., above) the player object (see FIG. 8(B)).

[0076] That is, a comment posted in the virtual space is displayed not only as a comment on the content but also as a statement made by the player object. Therefore, for example, the content of a posted comment is displayed in two places in the virtual space.

[0077] Therefore, the statements of the player object are expressed as if they were posted as comments.

[0078] 4 is a block diagram showing the configuration of a virtual space server device 10B, which is an example of virtual space server device 10. In this embodiment, virtual space server device 10B includes at least a playback control unit 11, a comment receiving unit 12, and an object control unit 13B.

[0079] The playback control unit 11 receives information for playing back content and comments from the distribution system 500, and plays back the content and comments in the virtual space. For example, upon receiving a comment, the playback control unit 11 displays the comment superimposed on the video of the content. Furthermore, for example, the playback control unit 11 erases a comment after a predetermined time has elapsed since the start of display.

[0080] The reproduction control unit 11 may, for example, make a request to the distribution system 500 to distribute one piece of content (including the corresponding comment), and receive information for reproducing the content and the comment from the distribution system 500.

[0081] The comment accepting unit 12 accepts comments posted in the virtual space from the terminal devices 20, 201 to 20N of each user. The comment accepting unit 12, for example, receives comments (e.g., text data) from the terminal devices 20, 201 to 20N of each user, generates comment information, and transmits it to the distribution system 500.

[0082] The object control unit (object control function, object control means) 13B controls the movement of the user's player object in the virtual space. As described above, the object control unit 13B moves the player object based on operation information from the operation unit operated by the user.

[0083] The object control unit 13B may operate the player object while referring to the status of the player object, such as its position and orientation in the virtual space. The status may be included in user data and stored in the storage unit of the virtual space server device 10B. The user data is information related to the user's activities in the virtual space (see FIG. 12). The storage unit of the virtual space server device 10B stores user data for each user. The user data may also be referred to, for example, when resuming an activity in the virtual space after it has ended.

[0084] Furthermore, the object control unit 13B outputs a comment posted by a user to the virtual space as a statement of the player object of the user. As described above, the object control unit 13B places a speech bubble object including the comment near the player object of the user who posted the comment.

[0085] The placement position of the balloon object may be calculated by referring to the position of the player object, for example.

[0086] Furthermore, the object control unit 13B erases (removes) the placed speech bubble object. For example, the speech bubble object is erased when a predetermined time has elapsed since the start of placement so that the object is erased in the same way as the corresponding comment.

[0087] Next, the operation of the virtual space control system 100B will be described.

[0088] FIG. 5 is a flowchart showing an example of content playback processing executed by virtual space control system 100B. In the playback processing in this embodiment, processing for playing content and comments in the virtual space and processing for accepting comment posting are performed. Note that FIG. 5 mainly describes the processing for playing content and comments and the processing for accepting comment posting, and some other processing may be omitted. Below, an example will be described in which the playback processing is executed by virtual space server device 10B and a user's terminal device 20.

[0089] The playback process of this embodiment is executed, for example, at the start time of the live broadcast or a predetermined time before the start time.

[0090] Although not described in detail, terminal device 20 periodically transmits information about the operation of the player object by the user to virtual space server device 10B. In parallel with the playback process, virtual space server device 10B controls the movement of the player object based on the operation information, etc., and updates user data, etc.

[0091] Virtual space server device 10B transmits a content distribution request to distribution server device 510 (step S10). The distribution request is transmitted including, for example, content identification information.

[0092] Next, virtual space server device 10B starts playing content, etc. (step S11). Specifically, virtual space server 10B receives data of the live-streamed video and comment information transmitted from distribution server device 510, and plays back the live-streamed video and comments. Through playback, the video of the live-streamed video and comments are displayed on the screen (video display area) of the monitor in the virtual space.

[0093] Next, the virtual space server device 10B determines whether or not a comment has been posted (step S12). When the virtual space server device 10B receives a comment (for example, text data) from the terminal device 20, it may determine that a post has been made.

[0094] If no comment has been posted (step S12: NO), the virtual space server device 10B proceeds to the processing of step S14-11B.

[0095] On the other hand, if a comment has been posted (step S12: YES), virtual space server device 10B transmits the comment to distribution server device 510 (step S13). Specifically, virtual space server device 10B generates comment information including the received comment and transmits it to distribution server device 510.

[0096] Next, virtual space server device 10B executes a process to output a comment (step S14-10B). Specifically, as described above, virtual space server device 10B places a balloon object containing the content of the comment transmitted in the process of step S13 in the virtual space. In addition, virtual space server device 10B starts measuring the placement time of the placed balloon object.

[0097] As a result, comments posted by the user of the terminal device 20 are also displayed (output) as comments made by the user's own player object on the display unit of the terminal device 20. Comments posted by other users are also displayed as comments made by the player objects of the other users.

[0098] Next, virtual space server device 10B executes a process to delete the output comment (step S14-11B). Specifically, virtual space server device 10B deletes (removes) from the virtual space, among the speech bubble objects that have already been placed, any object that has been placed for a predetermined time. Virtual space server device 10B may identify the speech bubble object to delete by, for example, referring to the placement time.

[0099] Next, virtual space server device 10B determines whether or not the playback of content, etc. has ended (step S15). If the playback has not ended (step S15: NO), virtual space server device 10B returns to the processing of step S11 and continues the playback of content, etc. Therefore, during the live distribution, comments posted by viewers and users watching this video are also displayed in real time.

[0100] On the other hand, if the playback has ended (step S15: YES), the virtual space server device 10B ends the playback process.

[0101] Although not shown, virtual space server device 10B repeatedly generates image information for generating one frame of an image including the updated virtual space, including the above-mentioned playback process, and transmits the image information to terminal device 20.

[0102] For example, image information is generated for generating an image of the virtual space captured by a virtual camera controlled based on the position of a player object (avatar) operated by a user.

[0103] Meanwhile, the terminal device 20 displays on the display unit an image of the virtual space based on the image information etc. received from the virtual space server device 10B (step S40) (see FIGS. 7 and 8). In this case, if the image includes the monitor described above, the content etc. will also be displayed on the display unit.

[0104] Furthermore, if a comment posting operation is performed during live distribution, the terminal device 20 transmits the comment to the virtual space server device 10B (step S41).

[0105] Next, the terminal device 20 determines whether or not to exit the virtual space (step S42). For example, if an exit (end) request from the user is received (step S42: YES), the terminal device 20 ends the display of the virtual space.

[0106] 5 has been described with respect to the terminal device 20, the same process is performed for the terminal devices of each user in the same (common) virtual space. For example, comments posted by each user are also displayed as statements made by the player object of each user.

[0107] As described above, in one aspect of the second embodiment, virtual space server device 10B is configured to include playback control unit 11, comment receiving unit 12, and object control unit 13B, so that content and comments that can be viewed using a web browser or the like can be viewed within the virtual space. Therefore, users can view content and comments while continuing their activities in the virtual space. Furthermore, each user can also post comments on content while continuing their activities in the virtual space.

[0108] This allows for a greater variety of actions that the user can take in the virtual space, further enhancing the user's sense of immersion in the virtual space.

[0109] Furthermore, by playing content in a virtual space, it is possible to apply this to virtual public viewing events, where many users gather in a virtual space around a monitor to watch the same content.

[0110] Furthermore, since the posted comments are also output as statements from the user's player object, the statements from the player object are expressed as if they were posted as comments, further enhancing the user's sense of immersion in the virtual space.

[0111] The above-described virtual space can also be applied to virtual spaces in video games and the like.

[0112] The above-mentioned "comments posted in a virtual space" are comments posted using a function provided in the virtual space.

[0113] The above-mentioned output into the virtual space as a utterance of the user's own player object means that the utterance is output so as to be recognized by at least some of the other users (player objects) in the virtual space. Furthermore, the output into the virtual space may be displayed on a display unit or, for example, may be output by sound.

[0114] Furthermore, although a configuration in which a speech bubble object is placed as a comment from a player object is shown as an example of a configuration in which a comment is output to the virtual space, the present invention is not limited to this. For example, an image of the comment may be superimposed near the player object in the image of the virtual space.

[0115] The above-mentioned configuration in which comments are superimposed on the video of the content may be configured such that the comments are superimposed on one end of the video of the content, and the comments move at a constant speed from one end to the other end, and the comments that reach the other end are deleted.

[0116] The display format of the content and comments in the virtual space described above does not need to be exactly the same as the display format in a web browser, etc. For example, the character font of the comments may be different.

[0117] In the above embodiment, characters and symbols (text data) are used as comments, but images such as stamps may also be used as comments.

[0118] In the above-described embodiment, one monitor is placed in the virtual space, but multiple monitors may be placed. The multiple monitors may display the same content and comments, or different content and comments.

[0119] Furthermore, viewing of content on a monitor may be restricted for each user. For example, a monitor may be placed in an area in the virtual space that only specific users (player objects) can enter. In this case, the specific user's house placed in the virtual space corresponds to the area.

[0120] In the above-described embodiment, the virtual space server device executes a virtual space control program to control the playback of content, etc. However, this is not limited to this. A part of the processing executed by the virtual space server device illustrated in FIG. 6 may be executed by a user's terminal device.

[0121] [Third embodiment] 6 is a block diagram showing the configuration of a virtual space control system 100C, which is an example of the configuration of the virtual space control system 100. The virtual space control system 100C of this embodiment is applied to a video game in which a three-dimensional virtual space is used as the game space. The virtual space control system 100C includes a distribution system 500, a virtual space server device 10C, and multiple user terminal devices 20-C, 201-C to 20N-C.

[0122] The virtual space control system 100C has various functions for executing a game in which a user operates a player object to defeat enemies and grow the player object in a three-dimensional virtual space (virtual space) that is a game space.

[0123] In a video game, multiple users' player objects exist in the same (common) virtual space, and the users (player objects) can cooperate to accomplish the same mission, etc.

[0124] As shown in Fig. 7, the player object PO is an object (avatar) that acts as the user's avatar in the virtual space 50 and is an object that is operated by the user. Fig. 7 is an example of a game image including a player object PO-1 displayed on the display unit of the terminal device 20C.

[0125] The user controls his / her player object PO via the operation unit. Actions include, for example, movement (walking, running), jumping, attacking, and talking. This allows the user (player object PO) to visit various places in the virtual space 50, participate in events held in the virtual space, and talk with other users (other player objects PO).

[0126] The virtual space control system 100C also has various functions for reproducing, within the virtual space 50, comments posted on the content and the comments.

[0127] In this embodiment, the content played back in the virtual space 50 includes live streaming videos and comments. These live streaming videos and comments can be played back (viewed) not only in the virtual space 50 but also in a web browser or the like. Comments can also be posted in a web browser or the like. The live streaming videos start streaming at the real start time. Therefore, playback also starts in the virtual space 50 from the specified real time.

[0128] In this embodiment, as shown in FIG. 8(B), a live streaming video (content) and comments are displayed on a large monitor 60 as a public viewing event where multiple users (player objects PO) can watch together.

[0129] An image of the virtual space 50 captured by a virtual camera is displayed as a game image on the display units of the terminal devices 20C, 201C to 20NC. The virtual camera moves to follow the movement of the player object PO, capturing images so as to always include the player object PO. As shown in FIG. 7, a game image including at least a part of the player object PO-1 of the user of the terminal device 20C is displayed on the display unit of the terminal device 20C.

[0130] Furthermore, when the player object PO-1 of the user of the terminal device 20C moves near the monitor, a game image including the monitor 60 is displayed on the display unit of the terminal device 20C.

[0131] That is, while content or the like is being played back, the user can view the content displayed on the monitor 60 by moving the player object PO near the monitor 60.

[0132] 8(A) and 8(B) show an example of a game image displayed on the display unit of the terminal device 20 C. In FIGS. 8(A) and 8(B), the player object PO is positioned in front of the monitor 60.

[0133] In this embodiment, the monitor 60 appears (is placed) in the virtual space 50 a predetermined time (e.g., 10 minutes) before the actual start time of the live streaming. Until the live streaming starts, the monitor 60 displays a predetermined still image instead of displaying any video of the live streaming, as shown in FIG. 8(A). Furthermore, the monitor 60 is erased (removed) from the virtual space 50 when the live streaming ends. For example, the monitor 60 is erased when the end time of the live streaming arrives.

[0134] When the actual start time arrives and the live broadcast begins, playback of the live broadcast video begins as shown in Fig. 8(B). Specifically, the live broadcast video image and comments superimposed on this image are displayed on the screen of monitor 60. Fig. 8(B) shows the state in which comments CM1 to CM5 are superimposed on the video image of the horse racing being live broadcast as shown in Fig. 9(B).

[0135] The comments are first displayed superimposed on one end of the live streaming video image (the right end in FIG. 9(A)). After that, the comments move at a constant speed from one end to the other end (from the right end to the left end in FIG. 9(A)). Once the comments reach the other end, they are deleted. In other words, they are deleted after a predetermined time has passed since they were displayed.

[0136] For example, the comment CM1 "YEAH" in Fig. 9(A) is first displayed at the position shown in Fig. 9(A), moves at a constant speed in the direction of the arrow shown in Fig. 9(A), and is finally erased. The other comments CM2 to CM5 also move in the same direction.

[0137] Each time a comment is posted, it is superimposed on one end of the video of the live streaming video. The position on the one end of the video of the live streaming video at which the comment is superimposed is determined, for example, randomly.

[0138] In this embodiment, comments posted by viewers and comments posted (spoken) by users (player objects PO) in the virtual space 50 are displayed in real time together with the video of the live streaming video.

[0139] The above-mentioned configuration for superimposing and moving comments on the video of a live-streamed video on the monitor 60 is the same as the configuration for superimposing and moving comments on the video of a live-streamed video on a web browser, etc. Furthermore, the above-mentioned configuration for superimposing and moving comments on the video of a live-streamed video is a common configuration, so a detailed description thereof will be omitted.

[0140] A user can use the operation unit to input and post a comment in the virtual space 50. In the example of this embodiment, a user can post a comment by using a chat function in the virtual space 50.

[0141] The chat function in this embodiment is a function that enables users (player objects PO) to exchange text messages. The chat function also allows users to select the destination of the chat message.

[0142] For example, there are five types of destinations: "friends," "neighbors," "team," "room," and "neighbors and broadcasting station."

[0143] In the "Friend" destination, a message is sent to other users (player objects PO) who have been set as friends. In the "Around" destination, for example, a message is sent to other users (player objects PO) who are currently in the vicinity (predetermined range) of the player object PO. In the "Team" destination, a message is sent to members of the team to which the user belongs. Note that in a team, only the leader can edit the members. In the "Room" destination, a user has a dedicated message range, and a message is sent to members within this message range. Note that in a room, the user can edit any members who are within the message range. A user can also join other users' rooms, and can participate in up to three rooms, including their own.

[0144] The chat message is contained in a speech bubble object placed above the head of the player object PO of the user who sent the message. In other words, it is output to the virtual space 50 as a statement from the player object PO. This speech bubble object is displayed only on the display unit of the terminal device of the user who sent the message and on the display unit of the terminal device of another user (player object PO) designated as the destination.

[0145] In addition, chat messages are posted (sent) as comments to the destination "Around and Broadcast Station." This means that chat messages are displayed as comments overlaid on the video of the live broadcast.

[0146] Furthermore, in the case of the destination "Around and Broadcast Station", similar to the above-mentioned destination "Around", the message is also sent to other users (player objects PO) who are currently in the vicinity (predetermined range) of the player object PO. As described above, the speech bubble object is displayed only on the display unit of the terminal device of the user who is the sender and on the display units of the terminal devices of the other users (player objects PO) who are in the vicinity.

[0147] For example, a case will be described in which a user (player object PO-2) sends a chat message "YEAH" to the destination "surroundings and broadcast station." In this case, as shown in FIG. 8(B), the comment CM1 "YEAH" is displayed on the monitor 60, and an object 95 in a speech bubble with "YEAH" is placed above the head of the player object PO-2. Note that this object 95 is only displayed to other users (player objects PO) who are in the vicinity (predetermined range) of the player object PO-2.

[0148] Also, for example, the comment CM4 "GOOD" in FIG. 8(B) corresponds to the balloon object 96 of the player object PO-1.

[0149] For example, a user can input (input text) using a software keyboard displayed on the display unit of their own terminal device, select a destination, and then select the OK button to chat (send a message).

[0150] Furthermore, in the example of this embodiment, when the player object PO approaches the monitor 60 during live streaming, the audio of the video of the live streaming is also output. Specifically, when the distance between the player object PO and the monitor 60 in the virtual space 50 becomes equal to or shorter than a predetermined distance, the audio of the video of the live streaming is output. For example, as shown in FIG. 8(B), when the distance between the player object PO-1 and the monitor 60 becomes equal to or shorter than the predetermined distance, the audio of the video of the live streaming is output from the speaker (audio output unit) of the terminal device 20C.

[0151] If the distance between the player object PO and the monitor 60 is greater than a predetermined distance, BGM (background music) is output as the sound for the game. That is, depending on the distance between the player object PO and the monitor 60, the sound output is switched between the sound of the live streaming video and the BGM for the game (virtual space 50).

[0152] Furthermore, in this embodiment, among the comments to be played along with the content (live streaming video), comments that match prohibited words associated with the virtual space 50 are hidden. That is, comments that include prohibited words are not displayed on the monitor 60. However, even if a comment matches prohibited words associated with the virtual space 50, it may still be displayed in a web browser or the like.

[0153] Furthermore, the game in this embodiment has a photography function that captures and saves a game image displayed on the display unit of the terminal device of a user who has requested photography as a still image (photographed image) file (data).

[0154] In this embodiment, when a still image file is saved using the shooting function, if the still image includes at least a portion of the screen of the monitor 60 during live streaming, the file is saved with the screen of the monitor 60 as a black screen. In other words, an image with the content and comments included in the still image hidden is saved as a captured image. This makes it possible to prevent video footage from the live streaming from being saved as a still image.

[0155] For example, when the game image shown in FIG. 8B is saved as a still image in a file using the shooting function, the still image will be as shown in FIG.

[0156] 11 is a block diagram showing the configuration of virtual space server device 10C, an example of virtual space server device 10. Virtual space server device 10C controls the progress of the game, thereby controlling the progress of the virtual space. In this embodiment, virtual space server device 10C includes at least a playback control unit 11C, a comment receiving unit 12C, an object control unit 13C, and a shooting unit 14C.

[0157] The playback control unit 11C receives information for playing back the content and comments from the distribution system 500 from the start to the end of the live distribution, and plays back the content and comments in the virtual space 50. Specifically, the playback control unit 11C displays the video of the content and comments on the screen of the monitor 60.

[0158] When the playback control unit 11C receives a comment, it displays the comment superimposed on the video of the live streaming video. As described above, the playback control unit 11C also moves the displayed comment at a constant speed and erases it when it reaches the other end.

[0159] The configuration for superimposing and moving comments on the video of a live-streamed video on the monitor 60 is the same as the configuration for superimposing and moving comments on the video of a live-streamed video on a web browser, etc. Also, since the configuration for superimposing and moving comments on the video of a live-streamed video is a common configuration, a detailed description thereof will be omitted.

[0160] The information for reproducing the content and comments distributed from distribution system 500 is the same as the information distributed to the viewer's terminal device.

[0161] The playback control unit 11C, for example, requests the delivery system 500 to deliver a video of live streaming (including corresponding comments), and receives information for playing back the video of live streaming and comments from the delivery system 500.

[0162] Furthermore, the playback control unit 11C hides any comments that match any prohibited words associated with the virtual space 50. The prohibited words are stored in advance in a storage unit of the virtual space server device 10C. Specifically, the playback control unit 11C does not superimpose any comments that include prohibited words on the video of the live streaming video.

[0163] Furthermore, when it is a predetermined time before the start time of the live distribution, the playback control unit 11C places the object on the monitor 60 at a predetermined position in the virtual space 50. Then, when it is the end time of the live distribution, the playback control unit 11C erases the object on the monitor 60.

[0164] In addition, the playback control unit 11C switches between the audio of the live streaming video and the audio for the virtual space 50 (audio for the game) based on the distance between a predetermined object (monitor 60) and each user's player object PO, and outputs it to each user's terminal device.

[0165] The comment receiving unit 12C receives comments posted from the terminal devices 20C, 201C to 20NC of each user in the virtual space 50. The comment receiving unit 12C receives comments (text data) from the terminal devices 20C, 201C to 20NC of each user, generates comment information for this, and transmits it to the distribution system 500. As described above, the chat message to the chat destination "To those around and the broadcast station" is treated as a comment (text data), and comment information is generated and transmitted to the distribution system 500.

[0166] The comment information includes, for example, identification information of the video of the live broadcast, the comment (chat message), the comment posting time, etc. The comment receiving unit 12C sets the playback time when the comment (chat message) is received as the posting time.

[0167] The object control unit 13C controls the movement of the user's player object PO in the virtual space 50. As described above, the object control unit 13C causes the player object PO to move based on operation information from the operation unit operated by the user.

[0168] The object control unit 13C controls the player object PO to operate while referring to the status of the player object PO, such as the position and orientation in the virtual space 50. The status is included in the user data as shown in FIG.

[0169] User data is information related to a user's game play (activities in the virtual space). The storage unit of the virtual space server device 10C stores user data for each user. The user data is also referenced, for example, when resuming activities after completing activities in the virtual space 50. The user data is updated by the virtual space server device 10C as the game progresses. The user data consists of fields such as a user ID and status.

[0170] In the user ID field, user identification information (user ID) is set. In the status field, various information about the player object PO is set. The status field is made up of fields for name, parameters, current position, etc. In the name field, text data for the name of the player object is set. In the parameter field, various parameters (numerical information) of the player object PO, such as the maximum and current value of vitality (HP), attack power, etc., are set.

[0171] The current position of the player object PO is set in the current position field. For example, the coordinates of the world coordinate system in the virtual space are set. In addition, the current orientation of the player object PO, information on the action being performed, etc. are set in the status field.

[0172] Furthermore, the object control unit 13C outputs a comment posted by a user as a statement of the player object PO of this user to the virtual space 50. That is, the object control unit 13C places a speech bubble object containing the message above the head of the player object PO of the user who sent the chat message.

[0173] The placement position of the balloon object may be calculated by referring to the position of the player object PO, for example.

[0174] Furthermore, the object control unit 13C erases (removes) the placed speech bubble object. For example, the speech bubble object is erased when a predetermined time has elapsed since the start of placement so that it is erased in the same way as the corresponding comment.

[0175] The photographing unit (photographing function) 14C photographs the virtual space 50 and stores the photographed image in the storage unit. As described above, the photographing unit 14C captures and saves the game image displayed on the display unit of the terminal device of the user who requested the photographing as a still image (photographed image) file (data).

[0176] The still image may be stored in either the storage unit of the virtual space server device 10C or the storage unit of the terminal device of the user who made the shooting request. In the case of the storage unit of the virtual space server device 10C, the still image may be stored in association with the user's identification information.

[0177] Furthermore, when an image is captured that includes at least a portion of the content and comments, the image capturing unit 14C captures an image in which the content and comments are not displayed. As described above, when the game image shown in Fig. 8(B) is saved as a file as a still image using the capturing function, a still image such as that shown in Fig. 10 is saved.

[0178] Next, the operation of the virtual space control system 100C will be described.

[0179] FIG. 13 is a flowchart showing an example of content playback processing executed by the virtual space control system 100C. In the playback processing in this embodiment, processing for playing content and comments in the virtual space and processing for accepting comment posting are performed. Note that FIG. 13 mainly describes the processing for playing content and comments and the processing for accepting comment posting, and some other processing may be omitted. Below, an example will be described in which the playback processing is executed by the virtual space server device 10C and the user's terminal device 20C.

[0180] The playback process of this embodiment is executed, for example, a predetermined time before the start time of the live broadcast.

[0181] Although not described in detail, the terminal device 20C periodically transmits operation information of the player object PO by the user to the virtual space server device 10C. In parallel with the playback process, the virtual space server device 10C controls the movement of the player object PO based on the operation information, etc., and updates user data, etc.

[0182] The virtual space server device 10C places the monitor 60 at a predetermined position in the virtual space 50 (step S5-C). As shown in FIG. 8(A), the virtual space server device 10C displays a predetermined image on the screen of the monitor 60 until the live broadcast starts.

[0183] Next, virtual space server device 10C determines whether the start time of the live distribution has arrived (step S6-C). If the start time has arrived (step S6-C: YES), virtual space server device 10C transmits a content distribution request to distribution server device 510 (step S10C). The distribution request is transmitted together with content identification information.

[0184] Next, virtual space server device 10C starts playing content, etc. (step S11-C). Specifically, virtual space server 10C receives data of the live streaming video (including audio data) and comment information transmitted from distribution server device 510, and plays back the live streaming video and comments. Through playback, a video is displayed on the screen (video display area) of monitor 60 in virtual space 50, as shown in FIG. 8(B).

[0185] As described above, the virtual space server device 10C plays back the comments so that they move at a constant speed. As described above, the virtual space server device 10C does not superimpose (hide) comments that include prohibited words on the video of the live streaming video.

[0186] Furthermore, the virtual space server device 10C switches the audio output between the audio of the live streaming video and the background music for the game (virtual space 50) depending on the distance between the player object PO and the monitor 60, as described above.

[0187] Next, the virtual space server device 10C determines whether or not a comment has been posted (step S12-C). If the virtual space server device 10C receives a chat message with the destination "surroundings and broadcast station", it may determine that a post has been made.

[0188] If no comment has been posted (step S12-C: NO), the virtual space server device 10C proceeds to the processing of step S14-11C.

[0189] On the other hand, if a comment has been posted (step S12-C: YES), virtual space server device 10C transmits the comment to distribution server device 510 (step S13-C). Specifically, virtual space server device 10C generates comment information using the chat message with the destination "To those around and the broadcast station" as a comment, and transmits the comment information to distribution server device 510.

[0190] Next, virtual space server device 10C executes processing to output a comment (step S14-10C). Specifically, as described above, virtual space server device 10C places a speech bubble object containing the content of the comment transmitted in the processing of step S13-C in virtual space 50. In the example of this embodiment, a speech bubble object containing a chat message with the destination "To those around and the broadcast station" is placed in virtual space 50 so as to be visible to other users (other player objects PO) around player object PO-1. In addition, virtual space server device 10C starts measuring the placement time of the placed speech bubble object.

[0191] As a result, the comment posted by the user of the terminal device 20 is also displayed (output) on the display unit of the terminal device 20C as a statement made by the user's own player object PO-1. Note that comments posted by other users are also displayed as statements made by the player objects PO of the other users.

[0192] Next, virtual space server device 10C executes a process to delete the output comment (step S14-11B). Specifically, virtual space server device 10C deletes (removes) from virtual space 50, among the speech bubble objects that have already been placed, objects for which a predetermined time has passed since placement. Virtual space server device 10C may identify the speech bubble objects to delete by, for example, referring to the placement time.

[0193] Next, virtual space server device 10C determines whether playback of content, etc. has ended (step S15-C). If the end time has arrived, it is determined that playback of the video has ended. If playback has not ended (step S15-C: NO), virtual space server device 10C returns to the processing of step S11-C and continues playback of content, etc. Therefore, during the live distribution, comments posted by viewers and users watching this video are also displayed in real time.

[0194] On the other hand, if the playback has ended (step S15-C: YES), the virtual space server device 10C turns off the monitor 60 (step S16-C) and ends the playback process.

[0195] Although not shown, virtual space server device 10C repeatedly generates image information for generating one frame of an image including the updated virtual space, including the above-mentioned playback process, and transmits the image information to terminal device 20C.

[0196] For example, image information is generated for generating an image of the virtual space 50 taken by a virtual camera controlled based on the position of the player object PO-1 operated by the user.

[0197] Meanwhile, terminal device 20C displays on the display unit an image of virtual space 50 based on the image information etc. received from virtual space server device 10C (step S40-C). In this case, as illustrated in Fig. 8(B), if the image includes monitor 60, the content etc. is also displayed on the display unit.

[0198] Furthermore, if a comment posting operation is performed during live distribution, terminal device 20C transmits the comment (step S41-C). In the example of this embodiment, if a chat message sending operation (selection of the confirm button) is performed, destination information and the chat message are transmitted to virtual space server device 10C. Therefore, in the processing of step S41-C, the chat message and the like are transmitted to virtual space server device 10C.

[0199] Next, the terminal device 20 determines whether or not to exit the virtual space 50 (step S42-C). For example, if an exit (end) request from the user is received (step S42-C: YES), the terminal device 20C ends the display of the virtual space 50.

[0200] 13 has been described with respect to the terminal device 20C, similar processing is performed for the terminal devices of each user in the same (common) virtual space 50. Comments posted by each user are also displayed as statements made by the player object PO of each user.

[0201] FIG. 14 is a flowchart showing an example of still image capture processing executed by the virtual space control system 100C. In the capture processing in this embodiment, the game image displayed on the display unit of the terminal device of the user who issued the capture request is captured and saved as a still image file. Note that FIG. 14 mainly describes the capture processing when the game image includes the monitor 60, and some other processing may be omitted. Below, an example will be described in which the capture processing is executed by the virtual space server device 10C and the user's terminal device 20C.

[0202] The photographing process of this embodiment is executed when the virtual space server device 10C receives a photographing request from a user (terminal device), for example.

[0203] Virtual space server device 10C determines whether or not the content is being played back (step S20-C). For example, if the processing from step S11-C to step S15-C of the above-mentioned playback processing is being executed, it is determined that the content is being played back.

[0204] If playback is in progress (step S20-C: YES), the virtual space server device 10C determines whether the game image to be saved includes at least a part of the screen of the monitor 60 (step S21-C). For example, it may determine that the screen of the monitor 60 is included based on image information to be displayed on the display unit of the user's terminal device 20C.

[0205] If the screen of monitor 60 is not included (step S21-C: NO), virtual space server device 10C proceeds to the processing of step S23-C. On the other hand, if the screen of monitor 60 is included (step S21-C: YES), virtual space server device 10C executes photographing and saving processing A (step S22-C). In photographing and saving processing A, as illustrated in FIG. 10, the screen of monitor 60 is turned black, and a still image file of the game image on the display unit of user terminal device 20C is saved in the memory unit of virtual space server device 10C. Thereafter, virtual space server device 10C ends the photographing processing.

[0206] Returning to the processing of step S20-C, if playback is not in progress, virtual space server device 10C executes photographing and saving process B (step S23-C). Photographing and saving process B does not include the process of turning the screen of monitor 60 black, and a still image file of the game image on the display unit of user terminal device 20C is saved in the memory unit of virtual space server device 10C. Virtual space server device 10C then ends the photographing process.

[0207] Although the process shown in FIG. 14 has been described with respect to the terminal device 20C, the same process is performed for the terminal devices of the users in the same (common) virtual space 50.

[0208] As described above, in one aspect of the third embodiment, virtual space server device 10C is configured to include playback control unit 11C, comment receiving unit 12C, object control unit 13C, and shooting unit 14C, so that content and comments that can be viewed on a web browser or the like can be viewed within the virtual space. Therefore, users can view content and comments while continuing their activities in the virtual space. Furthermore, each user can also post comments on content while continuing their activities in the virtual space.

[0209] This allows the actions that the user can perform in the virtual space to be enriched, further increasing the user's sense of immersion in the virtual space.

[0210] Furthermore, by playing content in a virtual space, it is possible to apply the present invention to virtual public viewing events, where many users gather around a monitor in the virtual space to watch the same content.

[0211] Furthermore, in the photography function, the photographed image is saved so that the content and comments are not reflected in the image, so that it is possible to prevent the content and comment images from being saved in a situation unintended by the content author or the like.

[0212] The "video game" mentioned above may be any type of game, such as a role-playing game, a training game, or a simulation game.

[0213] The above-described virtual space can also be applied to virtual spaces other than video games.

[0214] The above-mentioned "comments posted in a virtual space" are comments posted using a function provided in the virtual space.

[0215] The above-mentioned output into the virtual space as a utterance of the user's own player object means that the utterance is output so as to be recognized by at least some of the other users (player objects) in the virtual space. Furthermore, the output into the virtual space may be displayed on a display unit or may be, for example, output by sound.

[0216] Furthermore, although a configuration in which a speech bubble object is placed as a comment from a player object is shown as an example of a configuration in which a comment is output to the virtual space, the present invention is not limited to this. For example, an image of the comment may be superimposed near the player object in the image of the virtual space.

[0217] The display format of the content and comments in the virtual space described above does not need to be exactly the same as the display format in a web browser, etc. For example, the character font of the comments may be different.

[0218] In the above-described embodiment, one monitor is placed in the virtual space, but multiple monitors may be placed. The multiple monitors may display the same content and comments, or different content and comments.

[0219] Furthermore, restrictions may be placed on viewing content etc. on a user-by-user basis. For example, a monitor may be placed in a space (area) in the virtual space that only specific users (player objects) can enter. In this case, the specific user's house placed in the virtual space corresponds to the area.

[0220] In the above embodiment, characters and symbols (text data) are used as comments, but images such as stamps may also be used as comments.

[0221] In the example of the embodiment described above, the shooting function saves a still image file, but a video file may also be saved. In addition to the content and comments on the monitor screen, speech bubbles corresponding to comments may also be hidden.

[0222] In the above-described embodiment, comments containing prohibited words are not displayed on the monitor, but the prohibited words may be replaced with other characters and not displayed.

[0223] In the above-described embodiment, the content and comments are displayed except for comments that include prohibited words, but the display may be switched depending on the user's display settings.

[0224] For example, if a certain user's display setting is to hide comments, image information may be generated so that only the content is displayed on the terminal device of this user, and transmitted to the terminal device of this user.

[0225] Also, for example, if a certain user's display setting is to hide content, image information can be generated in the user's terminal device so that the content and comments are not displayed, and the image information can be transmitted to the user's terminal device. In this case, for example, the monitor can display the image shown in Figure 8(A) while the content is being played.

[0226] The above-mentioned display settings may be included in the user data, for example.

[0227] In the above-described embodiment, the virtual space server device executes a virtual space control program to control the playback of content, etc., but this is not particularly limited. A user's terminal device may execute part of the processing executed by the virtual space server device illustrated in Figures 13 and 14. For example, only the shooting processing of Figure 14 may be executed by the user's terminal device.

[0228] In addition, in the examples of each of the above-described embodiments, if a user has identification information for viewing content, the identification information for viewing content of the user may be linked to the identification information of the user in the video game (virtual space). The identification information for viewing content is, for example, the user's identification information used in the above-described content platform.

[0229] For example, the storage unit of the virtual space server device stores the user's identification information for viewing content and the user's identification information in the video game (virtual space) in association with each other.

[0230] When a user views a certain content in a virtual space, the viewing information including the user's content viewing identification information is transmitted to a distribution system. The distribution system receives the viewing information and updates the user's viewing history based on the content viewing identification information.

[0231] As a result, for example, in the case of an event in which a special benefit is given to a user by the distribution system for viewing specific content, the special benefit is also given to a user who views the specific content in the virtual space.

[0232] For example, it may be determined that the user has viewed the content if the user's player object is within a predetermined range based on the monitor for a certain period of time or more while the content is being played back.

[0233] Furthermore, in each of the above-described embodiments, an evaluation function for receiving evaluations of content may be provided.

[0234] In the above-described embodiments, the comments do not have to be displayed superimposed on the video of the content. For example, the comments may be displayed in an area adjacent to the video of the content.

[0235] In the examples of each of the above-described embodiments, the content may not be a live video but may be a video filmed in the past. Furthermore, comments posted in the past are also played back in time with the video being played back. The posted comments in the past are associated with a posting time based on the playback time of the video. Therefore, when the video is played back, the posted comments in the past can be played back in time with the posting time.

[0236] In each of the above-described embodiments, the virtual space may be three-dimensional or two-dimensional.

[0237] [Note] The above-described embodiments have been described so that at least the following invention can be implemented by a person having ordinary skill in the art to which the invention pertains.

[0238] [1] A virtual space control program for causing a virtual space server device, in which a distribution system that allows viewers to post comments on content from their terminal devices and distributes the content and the comments to the viewers' terminal devices and terminal devices of users of the virtual space are connected by a communication network, to control the progress of the virtual space, comprising: The virtual space server device a playback control function of receiving information for playing the content and the comments from the distribution system and playing the content and the comments in the virtual space; a comment acceptance function that accepts the posting of the comment from the terminal device of the user in the virtual space and transmits comment information to the distribution system; A virtual space control program that makes this possible.

[0239] [2] The virtual space server device further includes: an object control function for controlling the actions of the user's player object in the virtual space; To achieve this, the object control function includes a function of outputting a comment posted by the user to the virtual space as a statement of the player object of the user; The virtual space control program described in [1] is implemented.

[0240] [3] The virtual space server device further includes: an object control function for controlling the actions of the user's player object in the virtual space; To achieve this, In the playback control function, a function of displaying the content and the comments on a predetermined object placed in the virtual space; a function of switching between the sound of the content and the sound for the virtual space and outputting the switched sound to the terminal device of the user based on the distance between the predetermined object and the player object of the user; The virtual space control program according to [1] or [2] above.

[0241] [4] The playback control function includes a function of hiding, among the comments to be played back together with the content, comments that correspond to prohibited words associated with the virtual space; The virtual space control program according to any one of [1] to [3], which realizes the above.

[0242] [5] The virtual space server device further includes: a photographing function for photographing the virtual space and storing the photographed image in a storage unit; To achieve this, In the photographing function, when photographing is performed in a state in which at least a part of the content and the comment is included, a function of taking an image in which the content and the comment are not displayed as a photographed image; The virtual space control program according to any one of [1] to [4], which realizes the above.

[0243] [6] the playback control function is a function of hiding the comment in the virtual space for the user when the comment is set to be hidden by the user's operation; The virtual space control program according to any one of [1] to [5], which realizes the above.

[0244] [7] the playback control function is a function of hiding the content and comments in the virtual space for the user when the content is set to be hidden by the user's operation; The virtual space control program according to any one of [1] to [6], which realizes the above.

[0245] [8] The virtual space server device further includes: a transmission function of transmitting, to the distribution system, viewing information including identification information for viewing the content of the user stored in a storage unit when the user views the content in the virtual space; The virtual space control program according to any one of [1] to [7], which realizes the above.

[0246] [9] A virtual space server device in which the virtual space control program according to any one of [1] to [8] is installed.

[0247]

[10] A virtual space control system that controls the progress of the virtual space, comprising: a distribution system that allows viewers to post comments on content from their terminal devices and distributes the content and the comments to the viewers' terminal devices; a terminal device of a virtual space user; and a virtual space server device that is connected to the distribution system and the user's terminal device via a communication network, a playback control means for receiving information for playing back the content and the comments from the distribution system and playing back the content and the comments in the virtual space; a comment accepting means for accepting the comment posted from the terminal device of the user in the virtual space and transmitting comment information to the distribution system; A virtual space control system including:

[0248]

[11] A virtual space control program for realizing a function of communicating with a virtual space server device connected via a communication network to a distribution system that allows viewers to post comments on content from their terminal devices and distributes the content and the comments to the viewers' terminal devices, the virtual space server device having a function of controlling the progress of the virtual space, in a terminal device of a user of the virtual space, The terminal device a playback control function for receiving information for playing the content and the comments from the distribution system and playing the content and the comments in the virtual space; and a function for receiving information for displaying an image of the virtual space on a display unit from a virtual space server device having a comment acceptance function for accepting comments posted from the user's terminal device in the virtual space and transmitting comment information to the distribution system; A virtual space control program to realize this.

[0249]

[12]

[11] A user terminal device on which the program described in

[11] is installed.

[0250]

[13] A virtual space control method in which a virtual space server device connected via a communication network to a distribution system that allows viewers to post comments on content from their terminal devices and distributes the content and the comments to the viewers' terminal devices and to terminal devices of users of the virtual space controls the progress of the virtual space, comprising: a playback control process of receiving information for playing the content and the comments from the distribution system and playing the content and the comments in the virtual space; a comment acceptance process for accepting the comment posted from the terminal device of the user in the virtual space and transmitting comment information to the distribution system; A virtual space control method comprising: [Industrial Applicability]

[0251] One embodiment of the present invention is useful for enhancing a user's sense of immersion in a virtual space. [Explanation of symbols]

[0252] 10 Virtual space server device 20,201~20N Terminal equipment 11 Playback control section 12 Comment Reception Section 13 Object Control Unit 14 Photography Department 50 Game Space 60 monitors 100 Virtual Space Control System 500 Distribution System PO Player Object

Claims

1. A virtual space control program for causing a virtual space server device connected by a communication network to a distribution system that allows viewers to post comments on content from their terminal devices and distributes the content and the comments to the viewers' terminal devices, and a user's terminal device that displays an image of a virtual space, to control the progress of the virtual space, The virtual space server device a playback control function of receiving information for playing the content and the comments from the distribution system and playing the content and the comments in the virtual space; an object control function for controlling the actions of the user's player object in the virtual space; a comment acceptance function that accepts the posting of the comment from the terminal device of the user in the virtual space and transmits comment information to the distribution system; To achieve this, the playback control function includes a function of displaying the content and the comments on a predetermined object arranged in the virtual space; A virtual space control program that makes this possible.

2. The object control function includes a function of outputting comments posted by the user to the virtual space as utterances of the user's player object; 2. The virtual space control program according to claim 1, which realizes the above.

3. the playback control function includes a function of switching between the sound of the content and the sound for the virtual space and outputting the switched sound to the terminal device of the user based on the distance between the predetermined object and the player object of the user; 3. The virtual space control program according to claim 1, wherein the virtual space control program is configured to realize the above.

4. The playback control function includes a function of hiding, among the comments to be played back together with the content, comments that correspond to prohibited words associated with the virtual space; 4. The virtual space control program according to claim 1, which realizes the above.

5. The virtual space server device further includes: a photographing function for photographing the virtual space and storing the photographed image in a storage unit; To achieve this, In the photographing function, when photographing is performed in a state in which at least a part of the content and the comment is included, a function of taking an image in which the content and the comment are not displayed as a photographed image; 5. The virtual space control program according to claim 1, which realizes the above.

6. the playback control function is a function of hiding the comment in the virtual space for the user when the comment is set to be hidden by the user's operation; 6. The virtual space control program according to claim 1, which realizes the above.

7. A virtual space control system that controls the progress of the virtual space, comprising: a distribution system that allows viewers to post comments on content from their terminal devices and distributes the content and the comments to the viewers' terminal devices; a user's terminal device that displays an image of a virtual space; and a virtual space server device that is connected to the distribution system and the user's terminal device via a communication network, a playback control means for receiving information for playing back the content and the comments from the distribution system and playing back the content and the comments in the virtual space; an object control means for controlling an action of the user's player object in the virtual space; a comment accepting means for accepting the comment posted from the terminal device of the user in the virtual space and transmitting comment information to the distribution system; Including, the playback control means displays the content and the comment on a predetermined object arranged in the virtual space; Virtual space control system.

8. A virtual space control method in which a virtual space server device connected via a communication network to a distribution system that allows viewers to post comments on content from their terminal devices and distributes the content and the comments to the viewers' terminal devices and a user's terminal device that displays an image of the virtual space controls the progress of the virtual space, comprising: a playback control process of receiving information for playing the content and the comments from the distribution system and playing the content and the comments in the virtual space; an object control process for controlling an action of the user's player object in the virtual space; a comment acceptance process for accepting the comment posted from the terminal device of the user in the virtual space and transmitting comment information to the distribution system; Including, the playback control process includes a process of displaying the content and the comment on a predetermined object arranged in the virtual space; A virtual space control method comprising:

Images