Information processing device, information processing method, and program

Abstract

The present technology relates to an information processing device, an information processing method, and a program which make it possible to obtain the advantages of being in a virtual world without the sense of reality being impaired. With regard to at least one of a plurality of viewers viewing content being distributed from a distributor placed virtually in a prescribed distribution position in a virtual space or a real space, the viewing position at which said at least one viewer views the content, as a participant, and the distribution position of the content, are set such that the relative positional relationship between the viewing position of the participant and the distribution position is a positional relationship determined with respect to the participant.

Description

[Technical Field]

[0001] The present technology relates to an information processing device, an information processing method, and a program, and more particularly to an information processing device, an information processing method, and a program that enable the advantages of a virtual world to be obtained without losing the sense of reality. [Background technology]

[0002] Patent Document 1 discloses a technology for distributing images of various events currently being held to head-mounted displays worn by multiple users. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2019-139673 Summary of the Invention [Problem to be solved by the invention]

[0004] When real-world events such as concerts and recitals are held in a virtual world, faithful reproduction of the real world may not fully realize the benefits of the virtual world.

[0005] This technology was developed in light of these circumstances, and allows the advantages of a virtual world to be obtained without compromising the sense of reality. [Means for solving the problem]

[0006] The information processing device or program of the present technology is an information processing device having a processing unit that sets the viewing position of at least one viewer among a plurality of viewers who watch content distributed from a distributor who is virtually placed at a predetermined distribution position in a virtual space or a real space, and the distribution position so that the relative positional relationship between the viewing position where the viewer watches the content and the distribution position is determined for the viewer, or a program for causing a computer to function as such an information processing device.

[0007] The information processing method of the present technology is an information processing method in which the processing unit of an information processing device having a processing unit sets, for at least one viewer out of a plurality of viewers who watch content distributed from a distributor who is virtually located at a predetermined distribution position in a virtual space or a real space, the viewing position of the viewer and the distribution position so that the relative positional relationship between the viewing position where the viewer watches the content and the distribution position is a predetermined positional relationship for the viewer.

[0008] In this technology, for at least one of a plurality of viewers who watch content distributed by a distributor virtually located at a predetermined distribution location in a virtual space or a real space, the viewing location of the viewer and the distribution location are set so that the relative positional relationship between the viewing location where the viewer watches the content and the distribution location is a predetermined positional relationship for the viewer. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a block diagram illustrating an example of an outline of the overall configuration of an entertainment system to which the present technology is applied. [Figure 2] 2 is a block diagram illustrating a functional configuration related to setting of venue layout in the server system and client system of FIG. 1. FIG. [Figure 3] FIG. 10 is a diagram illustrating an example of the placement of broadcasters (live-action avatars) and viewers (avatars) in a virtual space that creates an event venue. [Figure 4] FIG. 10 is a diagram illustrating Example 1 of a first setting form of venue layout. [Figure 5] FIG. 10 is a diagram illustrating Example 2 of the first setting form of the venue layout. [Figure 6] FIG. 10 is a diagram illustrating Example 1 of a second setting form of venue layout. [Figure 7] FIG. 10 is a diagram illustrating Example 2 of the second setting form of the venue layout. [Figure 8] FIG. 10 is a diagram illustrating Example 3 of the second setting form of the venue layout. [Figure 9] FIG. 10 is a diagram illustrating Example 4 of the second setting form of the venue layout. [Figure 10] FIG. 10 is a diagram illustrating Example 5 of the second setting form of the venue layout. [Figure 11] FIG. 10 is a diagram illustrating Example 1 of the third setting form of the venue layout. [Figure 12] FIG. 10 is a diagram illustrating Example 2 of the third setting form of the venue layout. [Figure 13] FIG. 10 is a diagram illustrating Example 1 of a fourth setting form of venue layout. [Figure 14] FIG. 26 is a diagram illustrating the configuration of the venue layout used in the fifth to ninth setting forms described in FIGS. 15 to 25. [Figure 15] FIG. 10 is a diagram illustrating Example 1 of the fifth setting form of the venue layout. [Figure 16] FIG. 10 is a diagram illustrating Example 2 of the fifth setting form of the venue layout. [Figure 17] FIG. 10 is a diagram illustrating Example 1 of the sixth setting form of the venue layout. [Figure 18] FIG. 10 is a diagram illustrating Example 2 of the sixth setting form of the venue layout. [Figure 19] FIG. 10 is a diagram illustrating Example 3 of the sixth setting form of the venue layout. [Figure 20] FIG. 10 is a diagram illustrating Example 4 of the sixth setting form of the venue layout. [Figure 21] FIG. 10 is a diagram illustrating Example 1 of the seventh setting form of the venue layout. [Figure 22] FIG. 10 is a diagram illustrating Example 1 of the eighth setting form of the venue layout. [Figure 23]FIG. 10 is a diagram illustrating Example 2 of the eighth setting form of the venue layout. [Figure 24] FIG. 10 is a diagram illustrating Example 1 of the ninth setting form of the venue layout. [Figure 25] FIG. 10 is a diagram illustrating Example 2 of the ninth setting form of the venue layout. [Figure 26] 2 is a block diagram illustrating a functional configuration related to content distribution of the server system of FIG. 1. FIG. [Figure 27] FIG. 2 is a diagram illustrating a multi-view camera and a sensor. [Figure 28] FIG. 10 is a diagram showing a broadcaster being filmed in a studio. [Figure 29] 2 is a block diagram illustrating a functional configuration related to content reception and the like of the client system of FIG. 1. FIG. [Figure 30] FIG. 2 is a diagram illustrating a first mode of object control by a 3D object control unit. [Figure 31] FIG. 2 is a diagram illustrating a first mode of object control by a 3D object control unit. [Figure 32] 10 is a flowchart showing the processing procedure of a first mode of object control by a 3D object control unit. [Figure 33] FIG. 10 is a diagram illustrating a second mode of object control by the 3D object control unit. [Figure 34] FIG. 10 is a diagram illustrating a second mode of object control by the 3D object control unit. [Figure 35] FIG. 10 is a diagram illustrating a second mode of object control by the 3D object control unit. [Figure 36] FIG. 36 shows a modified example of the avatar arrangements of FIGS. 33 to 35. [Figure 37] 10 is a flowchart showing the processing procedure of a second mode of object control by a 3D object control unit. [Figure 38] FIG. 1 is a block diagram showing an example of the hardware configuration of a computer that executes a series of processes by a program. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, embodiments of the present technology will be described with reference to the drawings.

[0011] <<Entertainment system 11 to which this technology is applied>> <Summary overall structure> FIG. 1 is a block diagram illustrating an outline of the overall configuration of an entertainment system 11 to which the present technology is applied.

[0012] 1 is a system for holding events (live events, etc.) such as concerts and recitals using virtual reality (VR) technology. The entertainment system 11 includes a server system 21, multiple client systems 22, and a network 23.

[0013] The server system 21 generates distribution data including content (the distributor's own video and audio) to be distributed by the distributor to a large number of viewers who have participated in a specified event, and supplies the data to a client system 22 that is communicatively connected via a network 23. Note that in this specification, the term "viewing" is used to refer to either only viewing or only listening.

[0014] The client systems 22 are systems used by each viewer participating in an event held by the server system 21. Although one client system 22 can be used by multiple viewers, in this embodiment one client system 22 is used by one viewer. Therefore, the number of client systems 22 corresponds to the number of viewers. The number of client systems 22 is not limited to a specific number.

[0015] Based on the distribution data supplied from the client system 22, the client system 22 generates video and audio in a virtual space that creates an event venue, with various objects (3D objects) such as a stage, live-action video of the broadcaster (for example, a live-action avatar using live-action video), and avatars that represent the viewers, and presents these to the viewers.

[0016] Furthermore, a client system 22 supplies data relating to the position, posture, movement and avatar of a viewer using its own client system 22 to other client systems 22. Furthermore, a client system 22 acquires data relating to the position, posture, movement and avatar of other viewers using other client systems 22 via the network 23. Note that various data may be exchanged between client systems 22 via the server system 21 or via another server.

[0017] The client system 22 controls the positions, postures, and movements of the avatars of other viewers placed in the virtual space based on data relating to the positions, postures, movements, and avatars of other viewers acquired from other client systems 22.

[0018] Furthermore, when viewers engage in voice chat or text chat with each other, the client system 22 supplies the voice of the viewer using its own client system 22 or the text entered by the viewer to the other client system 22 with whom the voice chat or text chat is being conducted via the network 23. The client system 22 also acquires the viewer's voice or the text entered by the viewer from the other client system 22 via the network 23 and presents it to the viewer using its own client system 22.

[0019] The network 23 is a communication network that connects the server system 21 and the information processing device 61 so that they can communicate with each other. The network 23 may include any communication network, such as a Wide Area Network (WAN) (including the Internet), a Local Area Network (LAN), a public line network, or a mobile communication network.

[0020] (Server System 21) In FIG. 1, the server system 21 includes, for example, a distribution server 41 and a multi-view camera 42.

[0021] The distribution server 41 controls communication with the client system 22 via the network 23. The distribution server 41 establishes a communication connection with, for example, a client system 22 that has properly applied to participate in an event, and supplies distribution data to the client system 22.

[0022] The distribution server 41 also generates live-action video and audio of the distributor to be distributed to the client system 22 as transmission data (video stream data and audio stream data) and supplies the data to the client system 22.

[0023] For example, distribution server 41 acquires video of a broadcaster shot from multiple viewpoints against a green screen using multi-view camera 42. Multi-view camera 42 has multiple cameras arranged around the broadcaster, and these cameras shoot the broadcaster from different positions.

[0024] The distribution server 41 generates a multi-view video by removing images of unnecessary objects other than the distributor from the multi-view video acquired from the multi-view camera 42. The distribution server 41 then supplies the encoded data of the multi-view video to the client system 22 as video stream data included in the distribution data.

[0025] The distribution server 41 also acquires the voice of the distributor, which is picked up in three dimensions by a plurality of microphones or Ambisonics microphones (not shown) arranged around the distributor. The distribution server 41 encodes the acquired voice and supplies the encoded data to the client system 22 as audio stream data included in the distribution data.

[0026] In addition, the distribution server 41 supplies the client system 22 with object data representing the shape, texture, position, etc. of various objects to be placed in the virtual space that constitutes the event venue as metadata included in the distribution data. The metadata includes venue layout data indicating the position where a live-action avatar using live-action video that represents the distributor will be placed in the virtual space, and the position where avatars (avatars of arbitrarily created characters) that represent the distributor's avatar will be placed. The position where the distributor's live-action avatar will be placed in the virtual space is the distribution position where the distributor will distribute content, and the position where the viewer's avatar will be placed is the viewing position where the viewer will watch the content distributed by the distributor.

[0027] (Client System 22) The client system 22 includes, for example, an information processing device 61, a head mounted display 62 (hereinafter referred to as HMD (Head Mounted Display) 62), and a hand controller 63.

[0028] An HMD 62 and a hand controller 63 are connected to the information processing device 61 via a communication interface that connects peripheral devices.

[0029] The information processing device 61 is, for example, a stationary game console that controls the display and sound of the HMD 62. However, the information processing device 61 may also be a personal computer, a tablet terminal, a smartphone, a portable game console, etc. Furthermore, the information processing device 61 may also be incorporated into the HMD 62.

[0030] The information processing device 61 controls communication with the distribution server 41 of the server system 21 and the information processing devices 61 of other client systems 22 via the network 23 .

[0031] The information processing device 61 logs in to the distribution server 41 of the server system 21 based on a user operation detected by, for example, the hand controller 63, and applies to participate in an event held by the server system 21. When participation in the event is approved, distribution data related to the event is supplied to the information processing device 61 from the distribution server 41.

[0032] The hand controller 63 has, for example, operation buttons and a motion sensor. The motion sensor detects translation of the hand controller 63 in three orthogonal axis directions and rotation of the hand controller 63 around the three orthogonal axes, and detects the 6DoF (six degrees of freedom) position, posture, and movement of the hand controller 63. The hand controller 63 detects operation of the operation buttons or the position, posture, and movement of the hand controller 63 as user operation, and supplies this to the information processing device 61.

[0033] Furthermore, the information processing device 61 generates images to be displayed on the HMD 62 and sounds to be output from headphones detachable from the HMD 62 , and supplies these images and sounds to the HMD 62 .

[0034] The information processing device 61 creates 3D models of various objects in the virtual space that constructs the event venue based on the distribution data etc. from the distribution server 41, and generates a video by photographing (rendering) the virtual space (various objects in it) from a predetermined viewpoint in a predetermined line of sight direction. The creation and rendering of various objects are repeatedly executed at a predetermined cycle.

[0035] The viewpoint during rendering is the viewing position from which a viewer using an HMD 62 connected to the information processing device 61 views the content of the distributor. The line of sight direction during rendering is the line of sight direction of the HMD 62. The information processing device 61 supplies the image generated by rendering to the HMD 62 for display. Note that the image generated by rendering is, for example, an image for the right eye and an image for the left eye having parallax, and is a 3D image. However, the image may be a 2D image, and the display device that displays the image does not have to be the HMD 62.

[0036] In addition, the information processing device 61 generates stereo audio when the audio distributed from the distribution location of the distributor's content in the virtual space is listened to at the viewing position of a viewer using the HMD 62, based on audio stream data which is the distributor's audio included in the distribution data from the distribution server 41, and supplies this to the HMD 62.

[0037] The HMD 62 is worn on the head of the user (viewer) and includes a display unit for displaying images, detachable headphones for outputting audio, etc. The HMD 62 is not limited to a specific shape.

[0038] The HMD 62 also has a motion sensor that detects translation of the HMD 62 in three orthogonal axis directions and rotation of the HMD 62 around three orthogonal axes, and detects the 6DoF position, orientation, and movement of the HMD 62.

[0039] The information processing device 61 performs rendering of the virtual space, using a direction in the virtual space corresponding to the front direction of the HMD 62 in real space as the line of sight during rendering, based on the position, orientation, and movement of the HMD 62 detected by a motion sensor of the HMD 62. The information processing device 61 also generates an image of the field of view displayable on the display unit of the HMD 62 (hereinafter referred to as the field of view of the HMD 62) by rendering the virtual space.

[0040] <Object placement> Here, the various objects placed in the virtual space include fixed objects whose state does not change, such as the stage and seats at the event venue, and movable objects whose state (position, posture, movement) changes, such as the broadcaster's live-action avatar (e.g., volumetric video) and the viewer's avatar.

[0041] For fixed objects, the information processing device 61 obtains object data indicating their shape, texture, position, etc. from metadata included in the distribution data from the distribution server 41, creates a 3D model of the fixed object in the virtual space, and maps the texture to the 3D model during rendering.

[0042] For each viewer's avatar, which is a movable object, the information processing device 61 acquires the viewing position of each viewer from metadata (venue layout data) included in the distribution data from the distribution server 41, and acquires the shape, texture, position, posture, and movement from the information processing device 61 of the other client systems 22. The information processing device 61 of each client system 22 supplies avatar data indicating the basic shape and texture of the avatar of the viewer using it, and 6DoF data indicating the viewer's position, posture, and movement (head and hand position, posture, and movement) as metadata to the information processing device 61 of the other client systems 22. The 6DoF data indicating the viewer's head and hand position, posture, and movement is detected by the motion sensors of the HMD 62 and hand controller 63, respectively.

[0043] The information processing device 61 acquires the shape, texture, position, posture, and movement of each viewer's avatar from metadata (avatar data and 6DoF data) from the information processing device 61 of the client system 22 used by each viewer.

[0044] The information processing device 61 creates a 3D model of each viewer's avatar in a virtual space based on the position (viewing position) of each viewer's avatar acquired from the metadata from the distribution server 41 and the shape, texture, position, posture, and movement of each viewer's avatar acquired from the metadata (avatar data and 6DoF data) from the information processing device 61 of each client system 22, and maps the texture onto the 3D model during rendering. This generates a video in which each viewer's avatar moves in accordance with the live-action movements of each viewer.

[0045] For the live-action avatar of the broadcaster, which is a movable object, the information processing device 61 acquires the position (broadcast position) from metadata (venue layout data) included in the broadcast data from the broadcast server 41. The information processing device 61 also acquires multi-viewpoint video of the broadcaster from video stream data included in the broadcast data from the broadcast server 41, and generates 3D shape data and texture of the broadcaster from the multi-viewpoint video. The information processing device 61 then creates a 3D model of the broadcaster in virtual space using the position and 3D shape data of the live-action avatar, and maps the texture generated from the live-action video onto the 3D model of the broadcaster during rendering. As a result, a video including the live-action video of the broadcaster is generated at the broadcast position of the broadcaster as the broadcaster's avatar.

[0046] The information processing device 61 is not limited to a method for generating a live-action avatar of the broadcaster, and may, for example, generate live-action video of the broadcaster as viewed at the broadcast location from the viewpoint position at the time of rendering from multi-viewpoint video acquired from the broadcast server 41 and place the video at the broadcast location. The method for placing the live-action video of the broadcaster at the broadcast location as the broadcaster's alter ego is not limited to a specific method. The broadcaster's alter ego may also be an avatar that does not use live-action video.

[0047] In addition, in this embodiment, the distribution position of the distributor where the live-action avatar is placed and the viewing position of each viewer where each viewer's avatar is placed are fixed at predetermined positions. However, for example, if the parallel movement of the viewer's head is equal to or greater than a certain amount, it may be determined that the viewer has moved as a whole, and the viewing position of the viewer's avatar may be moved.

[0048] In addition, when a viewer using his / her own client system 22 engages in voice chat or text chat with a viewer using another client system 22 while participating in an event, the information processing device 61 specifies to the distribution server 41 the viewer or group with whom to chat (converse) based on user operation of the hand controller 63, etc., when participating in the event, etc.

[0049] Based on the designation of the chat partner from the information processing device 61, the distribution server 41 sets the information processing device 61 of the client system 22 used by the viewers who will chat with each other to a chat mode, and establishes a communication connection between those information processing devices 61.

[0050] The information processing device 61 in the chat mode acquires the viewer's voice using a microphone installed in the HMD 62 or the like connected to its own information processing device 61, or acquires text input by user operation of the hand controller 63 or the like connected to its own information processing device 61. Then, the information processing device 61 in the chat mode encodes the acquired voice or text and supplies it to the information processing device 61 of the chat partner as audio stream data or text data.

[0051] The information processing device 61 in chat mode decodes the audio stream data or text data supplied from the information processing device 61 of the chat partner, outputs the decoded audio from the headphones of the HMD 62, and displays the decoded text on the display unit of the HMD 62. At this time, in order to clearly indicate which viewer in the virtual space sent the audio or text, the information processing device 61 may display a speech bubble image at the position of the avatar of the viewer who sent the chat, and in the case of text chat, may display the text sent in the chat in the speech bubble image.

[0052] <Venue layout settings> Next, the setting of the venue layout, which indicates the viewing positions of each viewer (viewing positions where content is viewed) and the distribution positions of distributors (distribution positions of content) in the virtual space that constitutes the event venue, will be described.

[0053] Fig. 2 is a block diagram illustrating the functional configuration related to the setting of venue layout in the server system 21 and client system 22 of Fig. 1. In the figure, parts corresponding to those in the entertainment system 11 of Fig. 1 are given the same reference numerals, and their explanation will be omitted. Fig. 2 also shows an information processing device 61 of any one of the multiple client systems 22 of Fig. 1.

[0054] Furthermore, the venue layout is set for each viewer, and the venue layout may differ for each viewer. Hereinafter, a viewer to whom the set venue layout is applied is referred to as an experiencer. Therefore, the viewing position of the experiencer set by the venue layout for that viewer is the viewing position that the experiencer actually experiences using the HMD 62. On the other hand, the viewing position of a predetermined viewer (experiencer) other than the predetermined viewer set by the venue layout for that viewer may differ from the viewing position that the viewer actually experiences. Furthermore, the explanation of FIG. 2 is based on the assumption that the venue layout is set for a viewer using the information processing device 61 shown in FIG. 2, and therefore the viewer using the information processing device 61 in FIG. 2 is referred to as an experiencer.

[0055] 2, the distribution server 41 of the server system 21 includes a communication unit 81, a venue information transmission unit 82, a user information acquisition unit 83, a venue layout setting unit 84, a layout information transmission unit 85, and a user status storage unit 86.

[0056] The communication unit 81 controls communication with the information processing device 61 via the network 23 .

[0057] The venue information transmission unit 82 transmits information about the event venue of the event to be held (event venue information) to the information processing device 61 via the communication unit 81.

[0058] FIG. 3 is a diagram illustrating an example of the placement of broadcasters (live-action avatars) and viewers (avatars) in a virtual space that creates an event venue.

[0059] In the virtual space of FIG. 3, a live-action avatar of broadcaster T1 is placed facing forward toward the front of the page, and avatars of many viewers U are placed facing forward toward broadcaster T1.

[0060] The event venue information transmitted by the venue information transmission unit 82 to the information processing device 61 is information representing positions that can be set (selected) as the distribution position of the distributor T1 and the viewing position of the viewer U in the virtual space where the event venue is constructed as shown in Figure 3.

[0061] 2, a user information acquisition unit 83 acquires user information relating to a user (viewer) from the information processing device 61. The user information includes best viewing position information, peer group information, and user status information.

[0062] The best viewing position information represents the relative positional relationship between the viewing position of the user and the distribution position of the distributor T1, and indicates the positional relationship designated (determined) as the optimal viewing position (best viewing position) when the user views content. For example, among the viewer positions that can be set, the viewer position that is the shortest distance from the distributor's distribution position is generally directly in front of the distributor, and is considered to be the optimal viewing position. When the user designates such a viewer position, the viewer designates the positional relationship (viewing position) that results in the shortest relative positional relationship between the viewing position of the user and the distribution position of the distributor T1.

[0063] Furthermore, the user may be allowed to specify any positional relationship between the viewing position of the user and the distribution position of the distributor T1, such as a positional relationship (viewing position) where the viewing position is a predetermined distance away from the distribution position of the distributor T1 at a predetermined angle. Alternatively, multiple types of positional relationships that the user can specify may be prepared in advance, and the user may be allowed to select the optimal positional relationship from among them. Alternatively, the user may directly specify one of the settable (selectable) viewing positions. This also corresponds to a case where the user specifies the relative positional relationship between the viewing position of the user and the distribution position of the distributor T1.

[0064] In addition, the relative positional relationship between the viewing position of the experiencer and the distribution position of distributor T1 may be automatically set to, for example, a positional relationship that results in the shortest distance between them, or a positional relationship that has been determined in advance as the optimal viewing position that provides the optimal viewing environment for the distribution position.

[0065] In the following, specifying the relative positional relationship between the viewing position of the experiencer and the distribution position of distributor T1 so that the viewing position of the experiencer is the optimal viewing position will also be simply referred to as specifying the optimal viewing position of the experiencer (viewer).

[0066] The peer group information is information about the peer group (members) to which the experiencer belongs. For example, a viewer or group who chats while participating in an event is automatically set as a peer group. However, it may be possible to specify a peer group separately from the chat group. Furthermore, the information processing device 61 of a viewer who is specified as a peer group may be automatically set to a chat mode that allows chat.

[0067] The user state information is information such as the position, posture, and movement of the person experiencing the experience (position, posture, and movement of the head and hands). In this embodiment, the viewing position of the viewer is assumed to be fixed, but if the viewing position changes as the viewer moves, information on the position of the person experiencing the experience is included in the user state information.

[0068] The user information acquisition unit 83 supplies the user information acquired from the information processing device 61 to the venue layout setting unit 84 , and also supplies the user status information to the user status storage unit 86 .

[0069] The venue layout setting unit 84 sets the venue layout for the experiencer based on the user information from the information processing device 61. There are several ways to set the venue layout, which will be described in detail later. The venue layout setting unit 84 supplies information about the set venue layout (layout information) to the layout information transmission unit 85.

[0070] The layout information transmitting unit 85 supplies the venue layout information from the venue layout setting unit 84 to the communication unit 81, and transmits it to the information processing device 61 via the communication unit 81 as the venue layout data described above.

[0071] The user status storage unit 86 stores the latest information among the user status information from the user information acquisition unit 83. The user status information stored in the user status storage unit 86 is referenced to maintain the status (position, posture, movement, and viewing position) of the avatar of each viewer U in the virtual space before and after the scene change, even if communication is temporarily interrupted, for example, at the time of scene change between a waiting scene before the distributor T1 starts distributing content (before the live broadcast), a content distribution scene while the content is being distributed (during the live broadcast), and a lingering scene after the content distribution has ended (after the live broadcast).

[0072] In FIG. 2, the client system 22 includes a communication unit 101, a venue information acquisition unit 102, a best viewing position designation unit 103, a peer group designation unit 104, a user status acquisition unit 105, a user information transmission unit 106, and a placement information acquisition unit 107.

[0073] The communication unit 101 controls communication between the information processing device 61 and the distribution server 41 via the network 23 .

[0074] In the information processing device 61, the venue information acquisition unit 102 acquires the event venue information transmitted from the venue information transmission unit 82 of the distribution server 41 via the communication unit 101. The event venue information is information that represents positions that can be set (selected) as the distribution position of the distributor T1 and the viewing position of the viewer U in the virtual space that constructs the event venue as shown in FIG.

[0075] The event venue information acquired by the venue information acquisition unit 102 is displayed, for example, on the display unit of the HMD 62 and is referenced when the participant specifies the viewing position (the relative positional relationship between the participant's viewing position and the broadcasting position of the broadcaster T1).

[0076] The best viewing position designation unit 103 is configured, for example, with the information processing device 61 and the hand controller 63. The best viewing position designation unit 103 is designated by the user using the hand controller 63 or the like. The designation of the user's optimal viewing position is as explained in the user information acquisition unit 83 of the distribution server 41, and therefore will not be explained here.

[0077] The relative positional relationship between the viewing position of the user specified by the best viewing position specifying unit 103 and the distribution position of the distributor T1 is supplied to the user information transmitting unit 106 as best viewing position information.

[0078] The peer group designation unit 104 is composed of, for example, an information processing device 61 and a hand controller 63. The peer group designation unit 104 designates a peer group that the experiencer wishes to join as a member using the hand controller 63. The method for creating a peer group is not limited to a specific method. For example, information about a peer group created by an arbitrary viewer may be provided from the distribution server 41 to each client system 22, and the peer group designation unit 104 may be configured to designate a peer group to join as a member. Also, for example, a viewer or group who chats while participating in an event may be automatically set as a peer group. Information about the peer group designated by the peer group designation unit 104 is supplied to the user information transmission unit 106 as peer group information.

[0079] The user state acquisition unit 105 is configured by, for example, the information processing device 61 and the HMD 62. The user state acquisition unit 105 acquires the position, posture, movement, etc. of the user (position, posture, movement of the head and hands) using a motion sensor of the HMD 62. The information on the position, posture, movement, etc. of the user acquired by the user state acquisition unit 105 is supplied to the user information transmission unit 106.

[0080] The user information transmission unit 106 supplies the best viewing position information, peer group information, and user status information supplied from the best viewing position designation unit 103, peer group designation unit 104, and user status acquisition unit 105, respectively, to the communication unit 101 as user information, and supplies it to the distribution server 41 via the communication unit 101.

[0081] The placement information acquisition unit 107 acquires venue placement data transmitted from the placement information transmission unit 85 of the distribution server 41 via the communication unit 101. The venue placement data represents the venue placement relative to the experiencer set by the venue placement setting unit 84 of the distribution server 41, and represents the distribution position of the distributor T1 in the virtual space, the viewing position of the experiencer, and the viewing positions of viewers other than the experiencer.

[0082] The information processing device 61 places a live-action avatar (3D model) at the distribution position of the distributor T1 and places an avatar (3D model) of each viewer at the viewing position of each viewer in the virtual space constructing the event venue, according to the venue layout data acquired by the layout information acquisition unit 107. Note that the avatar of the experiencer does not need to be placed at the viewing position of the experiencer, or an avatar of only the torso part below the head may be placed.

[0083] Furthermore, the information processing device 61 sets the viewpoint when rendering the virtual space to the viewpoint position of the user.

[0084] The setting of the venue layout by the processing units (communication unit 81, venue information transmission unit 82, user information acquisition unit 83, venue layout setting unit 84, layout information transmission unit 85, and user state storage unit 86) of the distribution server 41 is performed for each viewer who participates in the event and watches the content at the same time, and the venue layout for each viewer is set assuming that each viewer is an experiencer. Then, the venue layout data for each viewer is supplied to the information processing device 61 of the client system 22 used by each viewer. However, the setting of the venue layout for each viewer may not be performed by the distribution server 41, but may be set in the information processing device 61 of the client system 22 used by each viewer. Also, the setting of the venue layout may be performed by a server other than the distribution server 41.

[0085] <Venue Layout Setting (Processing of Venue Layout Setting Unit 84)> Next, the venue layout setting modes performed by the venue layout setting unit 84 in Fig. 2 will be described. Examples of venue layout setting modes include first to ninth setting modes. The first to ninth setting modes are modes in which the viewing position of the participant and the distribution position of the distributor are set so that the relative positional relationship between the viewing position of the participant and the distribution position of the distributor is determined by, for example, specifying the optimal viewing position of the participant. The first to fourth setting modes are modes in which the distribution position of the distributor is given priority over the viewing position of the participant and the distribution position of the distributor, and the fifth to eighth setting modes are modes in which the viewing position of the participant is given priority over the distribution position of the distributor. The ninth setting mode is different from any of the first to eighth setting modes.

[0086] <First venue layout configuration> (Example 1) Fig. 4 is a diagram illustrating Example 1 of the first setting form of the venue layout. Fig. 4 shows a virtual space in which an event venue is constructed, with the height direction being perpendicular to the plane of the paper.

[0087] The first setting form of venue arrangement is an example in which the broadcasting position of the broadcaster is fixed to a predetermined position.

[0088] FIG. 4 shows a case where the venue arrangement is set for a predetermined viewer U1, and the viewer U1 is set as an experiencer V.

[0089] Furthermore, viewer U1 is assumed to have designated the viewing position where the distance between the viewer's viewing position and the broadcaster's broadcast position is the shortest as the optimal viewing position using the best viewing position designation unit 103 (see FIG. 2) of the client system 22 that he or she uses. Unless otherwise specified below, the viewing position (or broadcast position) where the distance between the viewer's viewing position and the broadcaster's broadcast position is the shortest is assumed to have been designated as the optimal viewing position. Furthermore, the optimal viewing position may not only be the shortest distance between the viewer's viewing position and the broadcaster's broadcast position, but may also be in front of the broadcaster's live-action avatar that is placed at the broadcast position.

[0090] In the virtual space of Figure 4, viewing positions DP(m, n), DP(m, n+1), DP(m, n-1), DP(m+1, n), ... represent positions that can be set as the viewer's viewing positions (hereinafter, the entire viewing position will be represented as DP).

[0091] In the first setting form of the venue arrangement, the distribution position P(T1) of the distributor T1 is set to a predetermined position P0.

[0092] Furthermore, the viewing position P(U1) of viewer U1, who is the experiencer V, is set to viewable position DP(m, n) that is the shortest distance in front of the distribution position P(T1) of distributor T1. That is, when the viewing position P(U1) of viewer U1 is changed to each position of the viewable position DP, the viewing position P(U1) of viewer U1 is set to viewable position DP(m, n), which is the viewing position P(U1) when the vector BP(U1, T1) pointing from the distribution position P(T1) to the viewing position P(U1) of viewer U1 is the vector BP0 of the smallest magnitude.

[0093] (Processing in Example 1 of the First Setting Form) 2 acquires best viewing position information of viewer U1, who is the experiencer V, from user information acquisition unit 83. The best viewing position information of viewer U1 is information about the optimal viewing position specified by best viewing position designation unit 103 of client system 22 used by viewer U1. Then, venue layout setting unit 84 sets distribution position P(T1) of distributor T1 and viewing position P(U1) of viewer U1, who is the experiencer V, so as to meet the conditions specified by the best viewing position information of viewer U1.

[0094] Therefore, the venue layout setting unit 84 sets the distribution position P(T1) of the distributor T1 to, for example, a position P0 corresponding to the center of the stage. The distribution position P(T1) of the distributor T1 may be a position designated by the party providing the content to the viewers, or may be a position designated by the participant V. When the participant V designates the distribution position P(T1), the distribution position P(T1) may be different for each distributor (each viewer). Furthermore, when there are multiple distributors, the participant V may be allowed to select the optimal viewing position for which distributor he or she wishes to view content. In this case, the distributor selected by the participant V and the distribution position of that distributor are designated as distributor T1 and distribution position P(T1) in FIG. 4. The same applies to the distribution position P(T1) of the distributor T1 in the first to third setting forms described below.

[0095] In addition, the venue layout setting unit 84 sets the viewing position P(U1) of the viewer U1, who is the experiencer V, as the optimal viewing position at the viewing position DP(m, n) that is the shortest distance from the distribution position P(T1) of the distributor T1 among the viewing positions DP.

[0096] In the first setting form of the venue layout, the viewing positions of the viewers other than the experiencer V are set in an arbitrary manner.

[0097] Here, the vector BP(U1, T1) pointing from the distribution position P(T1) of distributor T1 to the viewing position P(U1) of viewer U1 represents the relative positional relationship between the viewing position P(U1) and the distribution position P(T1).

[0098] In this first setting form, it is assumed that the best viewing position designation unit 103 (see FIG. 2) designates as the optimal viewing position the viewing position where the distance between the viewer's (viewer's) viewing position and the distributor's distribution position is the shortest (the relative positional relationship (condition) between the optimal viewing position and the distribution position is designated to be the shortest). This is not limited to this case, and the venue layout setting unit 84 performs the following processing for any condition (positional relationship) designated by the best viewing position designation unit 103. When the viewing position P(U1) of viewer U1 is changed within the range of settable positions (viewable positions DP), the venue layout setting unit 84 detects, as the optimal viewing position, the viewing position P(U1) where the vector BP(U1, T1) from the distribution position P(T1) of distributor T1 to the viewing position P(U1) of viewer U1 best matches the positional relationship designated by the best viewing position designation unit 103 (best viewing position information). Then, the venue layout setting unit 84 sets the viewing position P(U1) of the viewer U1 to the detected optimum viewing position.

[0099] In Figure 4, when the viewing position P(U1) of viewer U1 is changed to each of the viewing positions DP, the viewing position P(U1) of viewer U1 is set to the viewing position DP(m, n), which is the viewing position P(U1) when the vector from the distribution position P(T1) to the viewing position P(U1) is the vector BP0 of the smallest magnitude.

[0100] In addition, the optimal viewing position refers to the viewing position that provides the optimal viewing environment, but since the optimal viewing environment also depends on the viewer's preferences, it can also be rephrased as a viewing position determined by the viewer's (experiencer's) specifications or the system, etc.

[0101] As a method for specifying the optimum viewing position, specifically, there is a first specification method in which the optimum viewing position is directly specified from among viewable positions, and a second specification method in which the relative positional relationship (itself) between the optimum viewing position and the distribution position P(T1) of the distributor T1 is specified.

[0102] On the other hand, one advantage of the virtual world, which is different from the real world, is that the distribution position P(T1) of the distributor T1 can be changed for each viewer. That is, by changing the distribution position P(T1) of the distributor T1, a fixed viewing position can be made the optimal viewing position, or by changing both the viewing position and the distribution position P(T1) of the distributor T1, the viewing position can be made the optimal viewing position.

[0103] In addition to the second designation method, there is a third designation method for specifying the optimal viewing position when the distribution position P(T1) of distributor T1 is not fixed in this way, in which the distribution position P(T1) of distributor T1 is directly designated for a fixed viewing position.

[0104] In this specification, when specifying an optimum viewing position (or viewing position), whether directly or indirectly, when specifying the relative positional relationship between the optimum viewing position (or viewing position) and the distribution position P(T1) of distributor T1, when specifying the distribution position P(T1) of distributor T1, or when describing something equivalent to these, any of the first to third designation methods may be adopted as a specific designation method. Furthermore, the same applies not only to the designation of the optimum viewing position (viewing position), the relative positional relationship, and the distribution position P(T1), but also to their determination, setting, etc.

[0105] (Example 2) Fig. 5 is a diagram illustrating Example 2 of the first setting form of the venue layout. Fig. 5 shows a virtual space in which the same event venue as Fig. 4 is constructed, and the height direction is perpendicular to the plane of the paper.

[0106] FIG. 5 shows a case where the venue arrangement is set for a viewer U2 different from the viewer U1 in FIG.

[0107] In the first setting form of the venue arrangement, in the virtual space of FIG. 5, the distribution position P(T1) of the distributor T1 is set to a predetermined position P0, similarly to the case of FIG.

[0108] In addition, the viewing position P(U2) of viewer U2, who is the experiencer V, is set to the viewing position DP(m, n) that is the shortest distance in front of the distribution position P(T1) of distributor T1, similar to the viewing position P(U1) of viewer U1 in Figure 4 when viewer U1 is experiencer V.

[0109] In other words, when the viewing position P(U2) of viewer U2 is changed to each of the viewing positions DP, the viewing position P(U2) of viewer U2 is set to the viewing position DP(m, n), which is the viewing position P(U2) when the vector BP(U2, T1) pointing from the distribution position P(T1) of distributor T1 to the viewing position P(U2) of viewer U2 becomes the vector BP0 of the smallest magnitude.

[0110] (Processing in Example 2 of the First Setting Form) 2 acquires best viewing position information of viewer U2, who is the experiencer V, from user information acquisition unit 83. The best viewing position information of viewer U2 is information about the optimal viewing position specified by best viewing position designation unit 103 of client system 22 used by viewer U2. Then, venue layout setting unit 84 sets distribution position P(T1) of distributor T1 and viewing position P(U2) of viewer U2, who is the experiencer V, so as to meet the conditions specified by the best viewing position information of viewer U2.

[0111] The process of setting the distribution position P(T1) of the distributor T1 and the viewing position P(U2) of the viewer U2 who is the experiencer V in the venue layout setting unit 84 is the same as in the case of FIG. 4, and therefore the description thereof will be omitted.

[0112] According to the first setting form of the venue arrangement described above, even if a large number of viewers watch the content distributed by distributor T1 simultaneously and in the same space, each viewer can watch the content distributed by distributor T1 at their own optimal viewing position.

[0113] <Second venue layout configuration> (Example 1) Figure 6 is a diagram illustrating Example 1 of the second setting form of venue layout. Note that Figure 6 shows a virtual space in which the same event venue as Figure 4 is constructed, with the height direction being perpendicular to the paper surface. The distribution position P(T1) of distributor T1 and the viewable position DP in the virtual space of Figure 6 are the same as those in Figure 4, and only some of the symbols for the viewable position DP are shown.

[0114] The second setting form of venue layout is an example in which the broadcasting position of the broadcaster is fixed to a predetermined position.

[0115] FIG. 6 shows a case where a venue arrangement is set for a predetermined viewer G1-U1 of a peer group G1, and the viewer G1-U1 is set as an experiencer V. In FIG.

[0116] Also, it is assumed that viewer G1-U1 has designated that he or she belongs to the peer group G1 using the peer group designation unit 104 (see FIG. 2) of the client system 22 that he or she uses. It is also assumed that viewers G1-U1 to G1-U6 belong to the peer group G1.

[0117] In the second setting form of the venue arrangement, in the virtual space of FIG. 6, the distribution position P(T1) of the distributor T1 is set to a predetermined position P0, similar to the case of FIG.

[0118] The viewing position P(G1-U1) of the viewer G1-U1 who is the experiencer V is set to a viewable position DP(m, n) that is the shortest distance in front of the distribution position P(T1) of the distributor T1.

[0119] In other words, when the viewing position P(G1-U1) of viewer G1-U1 is changed to each of the viewing positions DP, the viewing position P(G1-U1) of viewer G1-U1 is set to the viewing position DP(m, n), which is the viewing position P(G1-U1) when the vector BP(G1-U1, T1) pointing from the distribution position P(T1) of distributor T1 to the viewing position P(G1-U1) of viewer G1-U1 becomes the vector BP0 of the smallest magnitude.

[0120] Also, the viewing positions of viewers G1-U2 to G1-U6, who are members of the peer group G1 to which viewer G1-U1 belongs, are set near the viewing position P(G1-U1) of viewer G1-U1. The viewing positions of viewers G1-U1 to G1-U6 are viewing positions DP(m,n), DP(m,n+1), DP(m,n-1), DP(m+1,n), DP(m+1,n+1), and DP(m+1,n-1), respectively (see FIG. 4).

[0121] (Processing in Example 1 of the Second Setting Form) 2 acquires best viewing position information of viewer G1-U1, who is experiencer V, from user information acquisition unit 83. The best viewing position information of viewer G1-U1 is information about the optimal viewing position specified by best viewing position designation unit 103 of client system 22 used by viewer G1-U1. Then, venue layout setting unit 84 sets distribution position P(T1) of distributor T1 and viewing position P(G1-U1) of viewer G1-U1, who is experiencer V, so as to meet the conditions specified by the best viewing position information of viewer G1-U1.

[0122] Therefore, the venue layout setting unit 84 sets the distribution position P(T1) of the distributor T1 to, for example, a position P0 corresponding to the center of the stage.

[0123] In addition, the venue layout setting unit 84 sets the viewing position P(G1-U1) of the viewer G1-U1, who is the experiencer V, as the optimal viewing position at the viewing position DP(m, n) that is the shortest distance from the distribution position P(T1) of the distributor T1 among the viewing positions DP.

[0124] That is, when the viewing position P(G1-U1) of viewer G1-U1 is changed to each of the viewing positions DP, the venue layout setting unit 84 detects, as the optimal viewing position, the viewing position P(G1-U1) when the vector BP(G1-U1,T1) pointing from the distribution position P(T1) to the viewing position P(G1-U1) best matches the positional relationship specified by the best viewing position designation unit 103 (best viewing position information).The venue layout setting unit 84 then sets the viewing position P(G1-U1) of viewer G1-U1 to the detected optimal viewing position.

[0125] Furthermore, the venue layout setting unit 84 acquires peer group information of the viewer G1-U1, who is the experiencer V, from the user information acquisition unit 83 (see FIG. 2). The peer group information of the viewer G1-U1 is information about the peer group specified by the peer group designation unit 104 (see FIG. 2) of the client system 22 used by the viewer G1-U1. The venue layout setting unit 84 detects the peer group to which the viewer G1-U1, who is the experiencer V, belongs and its members, based on the acquired peer group information of the viewer G1-U1. Then, the venue layout setting unit 84 sets the viewing positions of the members of the detected peer group other than the experiencer V.

[0126] At this time, the viewing positions of each of the detected peer group members are set to be adjacent to one of the viewing positions.Furthermore, the viewing positions of each of the members may be set so that the distance between the most distant viewing positions of the peer group members is the shortest.

[0127] The arrangement (positional relationship) of the viewing positions among the members of the peer group is determined in advance to satisfy the above-mentioned conditions. The arrangement of the viewing positions among the members of the peer group may be determined by the members of the peer group, may be determined randomly, or may be determined so that the viewing positions are arranged in the order in which the members log in to the distribution server 41 (in the order in which they apply to participate in the event), starting from the position closest to the distribution position of the broadcaster T1.

[0128] In the example of FIG. 6, the peer group to which the viewer G1-U1, who is the experiencer V, belongs is the peer group G1, and the members of the peer group G1 are the viewers G1-U1 to G1-U6.

[0129] In this case, the venue layout setting unit 84 sets the viewing positions of viewers G1-U1 to G1-U6 who are members of the peer group G1 to which the viewer G1-U1 who is the experiencer V belongs, according to the layout of the viewing positions among the members of the peer group G1. However, the viewing position P(G1-U1) of the viewer G1-U1 who is the experiencer V is set to the viewable position DP(m, n) which is the optimal viewing position as described above.

[0130] In the example of Figure 6, the viewing positions of the members of the peer group G1 are divided into two rows, a front row and a back row. Viewer G1-U1, who is the experiencer V, is located in the center of the front row, viewer G1-U2 is located on the right side of the front row, and viewer G1-U3 is located on the left side of the front row. Viewer G1-U4 is located in the center of the back row, viewer G1-U5 is located on the right side of the back row, and viewer G1-U6 is located on the left side of the back row.

[0131] The venue layout setting unit 84 sets the viewing positions of members of the peer group G1 other than viewer G1-U1 in accordance with the arrangement of viewing positions among the members of the peer group G1, and so that the viewing position P(G1-U1) of viewer G1-U1, who is the experiencer V, becomes the viewing position DP(m, n), which is the optimal viewing position.

[0132] As a result, as shown in Figure 6, the viewing positions of viewers G1-U1 to G1-U6 belonging to the peer group G1 are set to viewing positions DP(m, n), DP(m, n+1), DP(m, n-1), DP(m+1, n), DP(m+1, n+1), and DP(m+1, n-1), respectively (see Figure 4).

[0133] The viewing positions of viewers other than the members of the peer group G1 are set by any method.

[0134] (Example 2) Fig. 7 is a diagram illustrating Example 2 of the second setting form of venue layout. Fig. 7 shows a virtual space in which the same event venue as Fig. 4 is constructed, with the height direction being perpendicular to the paper surface. The distribution position P(T1) of distributor T1 and the viewable position DP in the virtual space of Fig. 7 are the same as those in Fig. 4, and only some of the symbols for the viewable position DP are shown.

[0135] Figure 7 shows the case where the venue arrangement is set for viewer G1-U2, who is different from viewer G1-U1 in Figure 6 and belongs to the same peer group G1 as in Figure 6, and shows the case where viewer G1-U2 is the experiencer V.

[0136] Also, it is assumed that viewer G1-U2 has designated that he or she belongs to the peer group G1 using the peer group designation unit 104 (see FIG. 2) of the client system 22 that he or she uses. It is also assumed that viewers G1-U1 to G1-U6 belong to the peer group G1, as in the case of FIG.

[0137] Furthermore, viewer G1-U2 is assumed to have designated the viewing position at which the distance between the viewer's viewing position and the distributor's distribution position is the shortest as the optimal viewing position using the best viewing position designation unit 103 (see Figure 2) of the client system 22 that he or she uses.

[0138] In the second setting form of the venue arrangement, in the virtual space of FIG. 7, the distribution position P(T1) of the distributor T1 is set to a predetermined position P0, similarly to the case of FIG.

[0139] The viewing position P(G1-U2) of the viewer G1-U2 who is the experiencer V is set to the viewing position DP(m, n) that is the shortest distance in front of the distribution position P(T1) of the distributor T1.

[0140] In other words, when the viewing position P(G1-U2) of viewer G1-U2 is changed to each of the viewing positions DP, the viewing position P(G1-U2) of viewer G1-U2 is set to the viewing position DP(m, n), which is the viewing position P(G1-U2) when the vector BP(G1-U2, T1) pointing from the distribution position P(T1) of distributor T1 to the viewing position P(G1-U2) of viewer G1-U2 becomes the vector BP0 of the smallest magnitude.

[0141] Also, the viewing positions of viewers G1-U1 and G1-U3 to G1-U6, who are members of the peer group G1 to which viewer G1-U2 belongs, are set near the viewing position P(G1-U2) of viewer G1-U2. The viewing positions of viewers G1-U1 to G1-U6 are viewing positions DP(m, n-1), DP(m, n), DP(m, n-2), DP(m+1, n-1), DP(m+1, n), and DP(m+1, n-2), respectively (see FIG. 4).

[0142] (Processing in Example 2 of the Second Setting Form) 2 acquires best viewing position information of viewer G1-U2, who is experiencer V, from user information acquisition unit 83. The best viewing position information of viewer G1-U2 is information about the optimal viewing position specified by best viewing position designation unit 103 of client system 22 used by viewer G1-U2. Then, venue layout setting unit 84 sets distribution position P(T1) of distributor T1 and viewing position P(G1-U2) of viewer G1-U2, who is experiencer V, so as to conform to the conditions specified by the best viewing position information of viewer G1-U2.

[0143] Therefore, the venue arrangement setting unit 84 sets the distribution position P(T1) of the distributor T1 to the position P0 in the same manner as in FIG.

[0144] In addition, the venue layout setting unit 84 sets the viewing position P(G1-U2) of the viewer G1-U2, who is the experiencer V, as the optimal viewing position at the viewing position DP(m, n) that is the shortest distance from the distribution position P(T1) of the distributor T1 among the viewing positions DP.

[0145] That is, when the viewing position P(G1-U2) of viewer G1-U2 is changed to each of the viewing positions DP, the venue layout setting unit 84 detects, as the optimal viewing position, the viewing position P(G1-U2) when the vector BP(G1-U2,T1) pointing from the distribution position P(T1) to the viewing position P(G1-U2) best matches the positional relationship specified by the best viewing position designation unit 103 (best viewing position information).The venue layout setting unit 84 then sets the viewing position P(G1-U2) of viewer G1-U2 to the detected optimal viewing position.

[0146] Furthermore, the venue layout setting unit 84 acquires peer group information of the viewer G1-U2, who is the experiencer V, from the user information acquisition unit 83 (see FIG. 2). The peer group information of the viewer G1-U2 is information about the peer group specified by the peer group designation unit 104 (see FIG. 2) of the client system 22 used by the viewer G1-U2. The venue layout setting unit 84 detects the peer group to which the viewer G1-U2, who is the experiencer V, belongs and its members, based on the acquired peer group information of the viewer G1-U2. Then, the venue layout setting unit 84 sets the viewing positions of the members of the detected peer group other than the experiencer V.

[0147] In the example of FIG. 7, the peer group to which the viewer G1-U2, who is the experiencer V, belongs is the peer group G1, and the members of the peer group G1 are the viewers G1-U1 to G1-U6.

[0148] In this case, the venue layout setting unit 84 sets the viewing positions of viewers G1-U1 to G1-U6 who are members of the peer group G1 to which viewer G1-U2 who is the experiencer V belongs, according to the layout of viewing positions determined in advance among the members of the peer group G1. However, the viewing position P(G1-U2) of viewer G1-U2 who is the experiencer V is set to the viewable position DP(m, n) which is the optimal viewing position as described above.

[0149] The arrangement of the viewing positions among the members of the peer group G1 is determined in advance as shown in FIG.

[0150] The venue layout setting unit 84 sets the viewing position P(G1-U2) of viewer G1-U2, who is the experiencer V, to be the viewing position DP(m, n), which is the optimal viewing position, in accordance with the arrangement of viewing positions determined in advance among the members of the peer group G1. As a result, as shown in Fig. 7, the viewing positions of viewers G1-U1 to G1-U6 belonging to the peer group G1 are set to the viewing positions DP(m, n-1), DP(m, n), DP(m, n-2), DP(m+1, n-1), DP(m+1, n), and DP(m+1, n-2), respectively (see Fig. 4).

[0151] The viewing positions of viewers other than the members of the peer group G1 are set by any method.

[0152] The arrangement of the viewing positions of viewers G1-U1 to G1-U6 in Fig. 7 is shifted by one column to the left as a whole relative to the arrangement of the viewing positions of viewers G1-U1 to G1-U6 in Fig. 6. This means that regardless of which member of the friend group G1 the experiencer V is, the arrangement of the viewing positions (relative positional relationship) of viewers G1-U1 to G1-U6 among the members of the friend group G1 is set to be the same.

[0153] (Example 3) Figure 8 is a diagram illustrating Example 3 of the second setting form of venue layout. Note that Figure 8 shows a virtual space in which the same event venue as Figure 4 is constructed, with the height direction being perpendicular to the paper surface. The distribution position P(T1) of distributor T1 and the viewable position DP in the virtual space of Figure 8 are the same as those in Figure 4, and only some of the symbols for the viewable position DP are shown.

[0154] Compared to the case of Figure 7, Figure 8 differs in the optimal viewing position specified by viewer G1-U2 using the best viewing position designation unit 103 (see Figure 2) of the client system 22 that he or she uses, but the other conditions are the same as those in Figure 7.

[0155] It is assumed that viewer G1-U2, who is the experiencer V, has specified the viewable position DP(m+1, n+2) diagonally from the distributor's distribution position using the best viewing position specification unit 103 of the client system 22 that he or she uses. However, specification of the best viewing position is not limited to directly specifying the viewable position DP(m+1, n+2).

[0156] In the second setting form of the venue arrangement, in the virtual space of FIG. 8, the distribution position P(T1) of the distributor T1 is set to a predetermined position P0, similarly to the case of FIG.

[0157] The viewing position P(G1-U2) of the viewer G1-U2 who is the experiencer V is set to a viewable position DP(m+1, n+2) diagonally relative to the distribution position P(T1) of the distributor T1.

[0158] In other words, when the viewing position P(G1-U2) of viewer G1-U2 is changed to one of the viewing positions DP, the viewing position P(G1-U2) of viewer G1-U2 is set to the viewing position DP(m+1, n+2), which is the viewing position P(G1-U2) when the vector BP(G1-U2, T1) pointing from the distribution position P(T1) of distributor T1 to the viewing position P(G1-U2) of viewer G1-U2 best matches the conditions of the optimal viewing position specified by viewer G1-U2, who is the experiencer V.

[0159] Also, the viewing positions of viewers G1-U1 and G1-U3 to G1-U6, who are members of the peer group G1 to which viewer G1-U2 belongs, are set near the viewing position P(G1-U2) of viewer G1-U2. The viewing positions of viewers G1-U1 to G1-U6 are viewing positions DP(m+1,n+1), DP(m+1,n+2), DP(m,n), DP(m+2,n+1), DP(m+2,n+2), and DP(m+2,n), respectively (see FIG. 4).

[0160] (Processing in Example 3 of the Second Setting Form) 2 acquires best viewing position information of viewer G1-U2, who is experiencer V, from user information acquisition unit 83. The best viewing position information of viewer G1-U2 is information about the optimal viewing position specified by best viewing position designation unit 103 of client system 22 used by viewer G1-U2. Then, venue layout setting unit 84 sets distribution position P(T1) of distributor T1 and viewing position P(G1-U2) of viewer G1-U2, who is experiencer V, so as to conform to the conditions specified by the best viewing position information of viewer G1-U2.

[0161] Therefore, the venue arrangement setting unit 84 sets the distribution position P(T1) of the distributor T1 to the position P0 in the same manner as in FIG.

[0162] Furthermore, the venue layout setting unit 84 detects, as the optimum viewing position, the viewing position P(G1-U2) when the vector that best matches the positional relationship specified by the best viewing position designation unit 103 (best viewing position information) is obtained from among the vectors BP(G1-U2, T1) obtained when the viewing position P(G1-U2) of the viewer G1-U2 is changed to each of the viewable positions DP. Then, the venue layout setting unit 84 sets the viewing position P(G1-U2) of the viewer G1-U2 to the detected optimum viewing position. In the example of FIG. 8, the viewable position DP(m+1, n+2) is detected as the optimum viewing position.

[0163] Furthermore, the venue layout setting unit 84 acquires peer group information of the viewer G1-U2, who is the experiencer V, from the user information acquisition unit 83 (see FIG. 2). The peer group information of the viewer G1-U2 is information about the peer group designated by the peer group designation unit 104 (see FIG. 2) of the client system 22 used by the viewer G1-U2. Based on the acquired peer group information of the viewer G1-U2, the venue layout setting unit 84 detects the peer group G1 to which the viewer G1-U2, who is the experiencer V, belongs and the viewers G1-U1 to G1-U6 who are members of the group.

[0164] The venue layout setting unit 84 sets the viewing positions of the detected viewers G1-U1, G1-U3 to G1-U6, who are members of the peer group G1 other than the viewer G1-U2, according to the layout of the viewing positions among the members of the peer group G1. The layout of the viewing positions among the members of the peer group G1 is determined in advance as shown in FIG.

[0165] As a result, as shown in Figure 8, the viewing positions of viewers G1-U1 to G1-U6 belonging to the peer group G1 are set to viewing positions DP(m+1, n+1), DP(m+1, n+2), DP(m+1, n), DP(m+2, n+1), DP(m+2, n+2), and DP(m+2, n) (see Figure 4), respectively.

[0166] The viewing positions of viewers other than the members of the peer group G1 are set by any method.

[0167] The arrangement of the viewing positions of viewers G1-U1 to G1-U6 in Fig. 8 is shifted two rows to the right and one row back as a whole compared to the arrangement of the viewing positions of viewers G1-U1 to G1-U6 in Fig. 6. This means that no matter which member of the peer group G1 the experiencer V is, or no matter what the optimal viewing position designated by the experiencer V is, the arrangement of the viewing positions of viewers G1-U1 to G1-U6 among the members of the peer group G1 (relative positional relationship) is set to be the same.

[0168] (Example 4) Fig. 9 is a diagram illustrating Example 4 of the second setting form of venue layout. Fig. 9 shows a virtual space in which the same event venue as Fig. 4 is constructed, with the height direction being perpendicular to the paper surface. The distribution position P(T1) of distributor T1 and the viewable position DP in the virtual space of Fig. 9 are the same as those in Fig. 4, and only some of the symbols for the viewable position DP are shown.

[0169] Figure 9 shows a case where the venue arrangement is set for viewer G2-U1, who is different from viewer G1-U1 in Figure 6 and belongs to a peer group G2 different from that in Figure 6, and shows a case where viewer G2-U1 is the experiencer V.

[0170] Also, it is assumed that viewer G2-U1 has designated that he or she belongs to peer group G2 using peer group designation unit 104 (see FIG. 2) of client system 22 that he or she uses. It is also assumed that viewers G2-U1 to G2-U6 belong to peer group G2.

[0171] In the second setting form of the venue arrangement, in the virtual space of FIG. 9, the distribution position P(T1) of the distributor T1 is set to a predetermined position P0, similarly to the case of FIG.

[0172] The viewing position P(G2-U1) of the viewer G2-U1 who is the experiencer V is set to the viewing position DP(m, n) that is the shortest distance in front of the distribution position P(T1) of the distributor T1.

[0173] In other words, when the viewing position P(G2-U1) of viewer G2-U1 is changed to each of the viewing positions DP, the viewing position P(G2-U1) of viewer G2-U1 is set to the viewing position DP(m, n), which is the viewing position P(G2-U1) when the vector BP(G2-U1, T1) pointing from the distribution position P(T1) of distributor T1 to the viewing position P(G2-U1) of viewer G2-U1 becomes the vector BP0 of the smallest magnitude.

[0174] Furthermore, the viewing positions of viewers G2-U2 to G2-U6, who are members of the peer group G2 to which viewer G2-U1 belongs, are set near the viewing position P(G2-U1) of viewer G2-U1. The viewing positions of viewers G2-U1 to G2-U6 are viewing positions DP(m,n), DP(m,n+1), DP(m,n-1), DP(m+1,n), DP(m+1,n+1), and DP(m+1,n-1), respectively (see FIG. 4).

[0175] (Processing in Example 4 of the Second Setting Form) 2 acquires best viewing position information of viewer G2-U1, who is experiencer V, from user information acquisition unit 83. The best viewing position information of viewer G2-U1 is information about the optimal viewing position specified by best viewing position designation unit 103 of client system 22 used by viewer G2-U1. Then, venue layout setting unit 84 sets distribution position P(T1) of distributor T1 and viewing position P(G2-U1) of viewer G2-U1, who is experiencer V, so as to meet the conditions specified by the best viewing position information of viewer G2-U1.

[0176] Therefore, the venue arrangement setting unit 84 sets the distribution position P(T1) of the distributor T1 to the position P0 in the same manner as in FIG.

[0177] In addition, the venue layout setting unit 84 sets the viewing position P(G2-U1) of the viewer G2-U1, who is the experiencer V, as the optimal viewing position at the viewing position DP(m, n) that is the shortest distance from the distribution position P(T1) of the distributor T1 among the viewing positions DP.

[0178] That is, the venue layout setting unit 84 detects, as the optimum viewing position, the viewing position P(G2-U1) when the vector that best matches the positional relationship specified by the best viewing position designation unit 103 (best viewing position information) is obtained from among the vectors BP(G2-U1, T1) obtained when the viewing position P(G2-U1) of viewer G2-U1 is changed to each of the viewable positions DP. Then, the venue layout setting unit 84 sets the viewing position P(G2-U1) of viewer G2-U1 to the detected optimum viewing position.

[0179] Furthermore, the venue layout setting unit 84 acquires peer group information of the viewer G2-U1, who is the experiencer V, from the user information acquisition unit 83 (see FIG. 2). The peer group information of the viewer G2-U1 is information about the peer group designated by the peer group designation unit 104 (see FIG. 2) of the client system 22 used by the viewer G2-U1. Based on the acquired peer group information of the viewer G2-U1, the venue layout setting unit 84 detects the peer group G2 to which the viewer G2-U1, who is the experiencer V, belongs and the viewers G2-U1 to G2-U6 who are its members.

[0180] The venue arrangement setting unit 84 sets the viewing positions of the viewers G2-U2 to G2-U6, who are members of the detected friend group G2 other than the viewer G2-U1, in accordance with the arrangement of viewing positions predetermined among the members of the friend group G2.

[0181] In the example of Figure 9, the viewing positions of the members of the peer group G2 are divided into two rows, a front row and a back row. Viewer G2-U1, who is the experiencer V, is located in the center of the front row, viewer G2-U2 is located on the right side of the front row, and viewer G2-U3 is located on the left side of the front row. Viewer G2-U4 is located in the center of the back row, viewer G2-U5 is located on the right side of the back row, and viewer G2-U6 is located on the left side of the back row.

[0182] The venue layout setting unit 84 sets the viewing position P(G2-U1) of the viewer G2-U1, who is the experiencer V, to be the optimal viewing position, viewing position DP(m, n), in accordance with the arrangement of viewing positions among the members of the peer group G2.

[0183] As a result, as shown in Figure 9, the viewing positions of viewers G2-U1 to G2-U6 belonging to the peer group G2 are set to viewing positions DP(m, n), DP(m, n+1), DP(m, n-1), DP(m+1, n), DP(m+1, n+1), and DP(m+1, n-1), respectively (see Figure 4).

[0184] The viewing positions of viewers other than the members of the peer group G2 are set in any manner.

[0185] Comparing Figure 9 with Figure 6, the viewers around participant V are replaced by the peer group to which participant V belongs.

[0186] (Example 5) Fig. 10 is a diagram illustrating Example 5 of the second setting form of venue layout. Fig. 10 shows a virtual space in which the same event venue as Fig. 4 is constructed, with the height direction being perpendicular to the paper surface. The distribution position P(T1) of distributor T1 and the viewable position DP in the virtual space of Fig. 10 are the same as those in Fig. 4, and only some of the symbols for the viewable position DP are shown.

[0187] Figure 10 shows a case where the venue arrangement is set for viewer G2-U2, who is different from viewer G2-U1 in Figure 9 and belongs to the same peer group G2 as in Figure 9, and shows a case where viewer G2-U2 is the experiencer V.

[0188] Also, it is assumed that viewer G2-U2 has designated that he or she belongs to the peer group G2 using the peer group designation unit 104 (see FIG. 2) of the client system 22 that he or she uses. It is also assumed that viewers G2-U1 to G2-U6 belong to the peer group G2, as in the case of FIG.

[0189] Furthermore, viewer G2-U2 is assumed to have designated the viewing position when the distance between the viewer's viewing position and the distributor's distribution position is the shortest as the optimal viewing position using the best viewing position designation unit 103 (see Figure 2) of the client system 22 that he or she uses.

[0190] In the second setting form of the venue arrangement, in the virtual space of FIG. 10, the distribution position P(T1) of the distributor T1 is set to a predetermined position P0, similarly to the case of FIG.

[0191] The viewing position P(G2-U2) of the viewer G2-U2 who is the experiencer V is set to the viewing position DP(m, n) that is the shortest distance in front of the distribution position P(T1) of the distributor T1.

[0192] In other words, when the viewing position P(G2-U2) of viewer G2-U2 is changed to each of the viewing positions DP, the viewing position P(G2-U2) of viewer G2-U2 is set to the viewing position DP(m, n), which is the viewing position P(G2-U2) when the vector BP(G2-U2, T1) pointing from the distribution position P(T1) of distributor T1 to the viewing position P(G2-U2) of viewer G2-U2 becomes the vector BP0 of the smallest magnitude.

[0193] Also, the viewing positions of viewers G2-U1 and G2-U3 to G2-U6, who are members of the peer group G2 to which viewer G2-U2 belongs, are set near the viewing position P(G2-U2) of viewer G2-U2. The viewing positions of viewers G2-U1 to G2-U6 are viewing positions DP(m, n-1), DP(m, n), DP(m, n-2), DP(m+1, n-1), DP(m+1, n), and DP(m+1, n-2), respectively (see FIG. 4).

[0194] (Processing in Example 5 of the Second Setting Form) 2 acquires best viewing position information of viewer G2-U2, who is experiencer V, from user information acquisition unit 83. The best viewing position information of viewer G2-U2 is information about the optimal viewing position specified by best viewing position designation unit 103 of client system 22 used by viewer G2-U2. Then, venue layout setting unit 84 sets distribution position P(T1) of distributor T1 and viewing position P(G2-U2) of viewer G2-U2, who is experiencer V, so as to meet the conditions specified by the best viewing position information of viewer G2-U2.

[0195] Therefore, the venue arrangement setting unit 84 sets the distribution position P(T1) of the distributor T1 to the position P0 in the same manner as in FIG.

[0196] In addition, the venue layout setting unit 84 sets the viewing position P(G2-U2) of the viewer G2-U2, who is the experiencer V, as the optimal viewing position at the viewing position DP(m, n) that is the shortest distance from the distribution position P(T1) of the distributor T1 among the viewing positions DP.

[0197] That is, the venue layout setting unit 84 detects, as the optimum viewing position, the viewing position P(G2-U2) when the vector that best matches the positional relationship specified by the best viewing position designation unit 103 (best viewing position information) is obtained from among the vectors BP(G2-U2, T1) obtained when the viewing position P(G2-U2) of viewer G2-U2 is changed to each of the viewable positions DP. Then, the venue layout setting unit 84 sets the viewing position P(G2-U2) of viewer G2-U2 to the detected optimum viewing position.

[0198] Furthermore, the venue layout setting unit 84 acquires peer group information of the viewer G2-U2, who is the experiencer V, from the user information acquisition unit 83 (see FIG. 2). The peer group information of the viewer G2-U2 is information about the peer group designated by the peer group designation unit 104 (see FIG. 2) of the client system 22 used by the viewer G2-U2. Based on the acquired peer group information of the viewer G2-U2, the venue layout setting unit 84 detects the peer group G2 to which the viewer G2-U2, who is the experiencer V, belongs and the viewers G2-U1 to G2-U6 who are its members.

[0199] The venue layout setting unit 84 sets the viewing positions of the viewers G2-U1, G2-U3 to G2-U6, who are members of the detected peer group G2 other than the viewer G2-U2, according to the layout of the viewing positions among the members of the peer group G2. The layout of the viewing positions among the members of the peer group G2 is determined in advance as shown in FIG.

[0200] As a result, as shown in Figure 10, the viewing positions of viewers G2-U1 to G2-U6 belonging to the peer group G2 are set to viewing positions DP(m, n-1), DP(m, n), DP(m, n-2), DP(m+1, n-1), DP(m+1, n), and DP(m+1, n-2), respectively (see Figure 4).

[0201] The viewing positions of viewers other than the members of the peer group G2 are set in any manner.

[0202] The arrangement of the viewing positions of viewers G2-U1 to G2-U6 in Fig. 10 is shifted by one column to the left as a whole compared to the arrangement of the viewing positions of viewers G2-U1 to G2-U6 in Fig. 9. This means that regardless of which member of the friend group G2 the experiencer V is, the arrangement of the viewing positions of viewers G2-U1 to G2-U6 among the members of the friend group G2 (relative positional relationship) is set to be the same.

[0203] According to the second setting form of the venue arrangement described above, even if a large number of viewers simultaneously watch the content distributed by the distributor in the same space, each viewer can watch the content distributed by the distributor from their own optimal viewing position.

[0204] Furthermore, when a group such as a peer group is set up, the viewer who is a peer is placed near the participant. Therefore, while participating in the event, the participant can easily know how their peers are doing as if they were actually meeting them. Furthermore, if voice chat or text chat is enabled in the peer group, or if the viewers or groups who are chatting are set as peer groups, they can easily chat even while participating in the event.

[0205] Furthermore, regardless of whether the viewer is a viewer belonging to a peer group, the viewing positions are the same for all members of the peer group (among the members). Therefore, for example, viewers belonging to the same peer group will not recognize each other as being on their right side. For example, when chatting, they will not end up facing opposite directions when they intended to face each other.

[0206] <Third venue layout configuration> (Example 1) Fig. 11 is a diagram illustrating Example 1 of the third setting form of venue layout. Fig. 11 shows a virtual space in which the same event venue as Fig. 4 is constructed, with the height direction being perpendicular to the paper surface. The distribution position P(T1) of distributor T1 and the viewable position DP in the virtual space of Fig. 11 are the same as those in Fig. 4, and only some of the symbols for the viewable position DP are shown.

[0207] The third setting form of venue arrangement is an example in which the broadcasting position of the broadcaster is fixed to a predetermined position.

[0208] Figure 11 shows a case where a venue arrangement is set for any of viewers G1-U1 to G1-U6 belonging to the peer group G1, and shows a case where the venue arrangement for all viewers G1-U1 to G1-U6 is the same.

[0209] It is also assumed that a representative is designated for the peer group G1, and that the representative designates, as the optimal viewing position, the viewing position where the distance between the position of the peer group G1 and the broadcasting position of the broadcaster is the shortest, using the best viewing position designation unit 103 (see FIG. 2) of the client system 22 that the representative uses. Note that the designation of the relative positional relationship between the position of the peer group G1 and the broadcasting position of the broadcaster will be described later.

[0210] In the third setting form of the venue arrangement, in the virtual space of FIG. 11, the distribution position P(T1) of the distributor T1 is set to a predetermined position P0, similarly to the case of FIG.

[0211] Furthermore, the position (described later) of the fellow group G1 is set to a position that is the shortest distance in front of the broadcaster T1's broadcast position P(T1).

[0212] That is, when the position of the friend group G1 is changed within the settable range, the position of the friend group G1 when the vector BP(G1, T1) pointing from the distribution position P(T1) of the distributor T1 to the position of the friend group G1 becomes a vector of the smallest magnitude is detected as the optimal viewing position. Then, the position of the friend group G1 is set to the detected optimal viewing position.

[0213] In the example of Figure 11, the viewing position P(G1-U1) of viewer G1-U1 is set as the position of the peer group G1, and the viewing position P(G1-U1) of viewer G1-U1 is set as the viewing position DP(m, n).

[0214] Also, the viewing positions of viewers G1-U2 to G1-U6, who are members of the peer group G1 to which viewer G1-U1 belongs, are set near the viewing position P(G1-U1) of viewer G1-U1. The viewing positions of viewers G1-U1 to G1-U6 are viewing positions DP(m,n), DP(m,n+1), DP(m,n-1), DP(m+1,n), DP(m+1,n+1), and DP(m+1,n-1), respectively (see FIG. 4).

[0215] (Processing in Example 1 of the Third Setting Form) 2 acquires the peer group information of the experiencer V from the user information acquisition unit 83 when setting the venue arrangement for an arbitrary viewer (experiencer V) belonging to the peer group G1. The peer group information of the experiencer V is information about the peer group designated by the peer group designation unit 104 (see FIG. 2) of the client system 22 used by the experiencer V. Based on the acquired peer group information of the experiencer V, the venue arrangement setting unit 84 detects the peer group G1 to which the experiencer V belongs and the viewers G1-U1 to G1-U6 who are members of the group.

[0216] Furthermore, the venue layout setting unit 84 acquires best viewing position information of the friend group G1 to which the experiencer V belongs from the user information acquisition unit 83. The best viewing position information of the friend group G1 is information about the optimal viewing position for the friend group G1, and is specified by the best viewing position designation unit 103 of the client system 22 used by the representative of the friend group G1, and is acquired by the user information acquisition unit 83. It is assumed that the representative of the friend group G1 is determined in advance.

[0217] Here, the position of the peer group (as a whole) refers to the viewing position where the members of the peer group are positioned together in the virtual space. Specifically, for example, the members of the peer group G1 are positioned at the viewing position DP according to the viewing position arrangement predetermined among the members of the peer group G1, as in the second setting form. In this case, the viewing position of a predetermined viewer belonging to the peer group G1 is used as a reference, and the viewing positions of all members of the peer group G1 are determined by determining which of the viewing positions DP the viewing position of the reference viewer should be set to. The viewing position of the reference viewer represents the position of the peer group G1.

[0218] The position of a peer group is, for example, the viewing position of the viewer who is positioned in the center of the front side in the arrangement of viewing positions among the members of the peer group.

[0219] The reference position for the peer group does not have to be the viewing position of a specific viewer, but may be, for example, the center position of an area that includes the viewing positions of the peer group members.

[0220] In the example of Fig. 11, the arrangement of viewing positions among the members of the peer group G1 of each of viewers G1-U1 to G1-U6 who are members of the peer group G1 is determined in advance, as in the case of Fig. 6. Then, the viewing position P(G1-U1) of viewer G1-U1, who is arranged in the center of the forefront in the arrangement of viewing positions among the members of the peer group G1, is set as the position for the peer group G1.

[0221] It is also assumed that the representative of the peer group G1 has previously designated the best viewing position for the position of the peer group G1 using the best viewing position designation unit 103 of the client system 22 that he or she uses.

[0222] 11, it is assumed that the representative of the peer group G1 has designated the optimal viewing position for the viewing position P(G1-U1) of the viewer G1-U1, who is located as part of the peer group G1. In the following, it is assumed that the representative of the peer group G1 has designated the viewing position where the distance between the viewing position P(G1-U1) of the viewer G1-U1 and the distribution position P(T1) of the distributor T1 is the shortest as the optimal viewing position for the viewing position P(G1-U1) of the viewer G1-U1, who is located as part of the peer group G1.

[0223] The venue layout setting unit 84 sets the distribution position P(T1) of the distributor T1 to a position P0 that corresponds to the center of the stage, for example, as in the case of FIG.

[0224] In addition, the venue layout setting unit 84 sets the viewing position P(G1-U1) of viewer G1-U1, who is a member of the peer group G1, as the optimal viewing position at the viewing position DP(m, n) that is the shortest distance from the distribution position P(T1) of distributor T1 among the viewing positions DP.

[0225] That is, when the viewing position P(G1-U1) of viewer G1-U1, who is a member of the peer group G1, is changed to each of the viewing positions DP, the venue layout setting unit 84 detects, as the optimal viewing position, the viewing position P(G1-U1) at which the vector BP(G1,T1) (=P(G1-U1,T1)) pointing from the distribution position P(T1) to the peer group G1 best matches the positional relationship specified by the best viewing position designation unit 103 (best viewing position information).The venue layout setting unit 84 then sets the viewing position P(G1-U1) of viewer G1-U1 to the detected optimal viewing position.

[0226] In addition, the venue arrangement setting unit 84 also sets the viewing positions of members other than viewer G1-U1 of the peer group G1 in accordance with the arrangement of viewing positions among the members of the peer group G1, and so that the viewing position P(G1-U1) of viewer G1-U1, who is in the peer group G1, becomes the viewing position DP(m, n).

[0227] As a result, as shown in Figure 11, the viewing positions of viewers G1-U1 to G1-U6 belonging to the peer group G1 are set to viewing positions DP(m, n), DP(m, n+1), DP(m, n-1), DP(m+1, n), DP(m+1, n+1), and DP(m+1, n-1), respectively (see Figure 4).

[0228] The viewing positions of viewers other than the members of the peer group G1 are set by any method.

[0229] In the third setting mode of the venue arrangement, if the experiencer V is one of the members of the peer group G1, the venue arrangement shown in Fig. 11 is set. Therefore, the venue arrangement for each of the viewers G1-U1 to G1-U6 who are members of the peer group G1 is the same. That is, in the third setting mode of the venue arrangement, the venue arrangement is set on a peer group basis.

[0230] (Example 2) Fig. 12 is a diagram illustrating Example 2 of the third setting form of venue layout. Fig. 12 shows a virtual space in which the same event venue as Fig. 4 is constructed, with the height direction being perpendicular to the paper surface. The distribution position P(T1) of distributor T1 and the viewable position DP in the virtual space of Fig. 12 are the same as those in Fig. 4, and only some of the symbols for the viewable position DP are shown.

[0231] Figure 12 shows a case where a venue arrangement is set for any of viewers G2-U1 to G2-U6 who belong to a peer group G2 that is different from peer group G1 in Figure 11, and shows a case where the venue arrangement for all viewers G2-U1 to G2-U6 is the same.

[0232] It is also assumed that a representative is designated for the peer group G2, and that the representative designates the viewing position when the distance between the position of the peer group G2 and the broadcaster's broadcasting position is the shortest as the optimal viewing position using the best viewing position designation unit 103 (see Figure 2) of the client system 22 that the representative uses.

[0233] In the third setting form of the venue arrangement, in the virtual space of FIG. 12, the distribution position P(T1) of the distributor T1 is set to a predetermined position P0, similarly to the case of FIG.

[0234] Furthermore, the position of the fellow group G2 is set to a position that is the shortest distance in front of the broadcasting position P(T1) of the broadcaster T1.

[0235] That is, when the position of the friend group G2 is changed within the settable range, the position of the friend group G2 when the vector BP(G2, T1) pointing from the distribution position P(T1) of the distributor T1 to the position of the friend group G2 becomes a vector of the smallest magnitude is detected as the optimal viewing position. Then, the position of the friend group G2 is set to the detected optimal viewing position.

[0236] In the example of Figure 12, the viewing position P(G2-U1) of viewer G2-U1 is set as the position for the peer group G2, and the viewing position P(G2-U1) of viewer G2-U1 is set as the viewing position DP(m, n).

[0237] Furthermore, the viewing positions of viewers G2-U2 to G2-U6, who are members of the peer group G2 to which viewer G2-U1 belongs, are set near the viewing position P(G2-U1) of viewer G2-U1. The viewing positions of viewers G2-U1 to G2-U6 are viewing positions DP(m,n), DP(m,n+1), DP(m,n-1), DP(m+1,n), DP(m+1,n+1), and DP(m+1,n-1), respectively (see FIG. 4).

[0238] The viewing positions of viewers other than the members of the peer group G2 are set in any manner.

[0239] The process for setting the venue layout in FIG. 12 is the same as that in FIG. 11, and therefore a description thereof will be omitted.

[0240] According to the third setting form of the venue arrangement described above, even if a large number of viewers watch the content distributed by the distributor simultaneously and in the same space, each viewer can watch the content distributed by the distributor in the optimal viewing position in groups of friends.

[0241] Furthermore, when a group such as a peer group is set up, the viewer who is a peer is placed near the participant. Therefore, while participating in the event, the participant can easily know how their peers are doing as if they were actually meeting them. Furthermore, if voice chat or text chat is enabled in the peer group, or if the viewers or groups who are chatting are set as peer groups, they can easily chat even while participating in the event.

[0242] Furthermore, regardless of whether the viewer is a viewer belonging to a peer group, the viewing positions are the same for all members of the peer group (among the members). Therefore, for example, viewers belonging to the same peer group will not recognize each other as being on their right side. For example, when chatting, they will not end up facing opposite directions when they intended to face each other.

[0243] <Fourth venue layout configuration> (Example 1) Fig. 13 is a diagram illustrating Example 1 of the fourth setting form of venue layout. Fig. 13 shows a virtual space in which the same event venue as Fig. 4 is constructed, with the height direction being perpendicular to the paper surface. The distribution position P(T1) of distributor T1 and the viewable position DP in the virtual space of Fig. 13 are the same as those in Fig. 4, and only some of the symbols for the viewable position DP are shown.

[0244] The fourth setting form of the venue arrangement is a modified example of the third setting form of FIGS. 11 and 12, and is an example in which the distribution position of the distributor is changed.

[0245] FIG. 13 shows a case where the venue arrangement is set for a viewer G2-U2 who belongs to a peer group G2, and shows a case where the viewer G2-U2 is an experiencer V. In FIG.

[0246] Also, it is assumed that viewer G2-U2 has designated that he or she belongs to the peer group G2 using the peer group designation unit 104 (see FIG. 2) of the client system 22 that he or she uses. It is also assumed that viewers G2-U1 to G2-U6 belong to the peer group G2.

[0247] Furthermore, viewer G2-U2 is assumed to have designated the viewing position where the distance between the viewer's (experiencer's) viewing position and the distributor's distribution position is the shortest as the optimal viewing position using the best viewing position designation unit 103 (see Figure 2) of the client system 22 that he / she uses.

[0248] It is also assumed that a representative is designated for the peer group G2, and that the representative designates the viewing position when the distance between the position of the peer group G2 and the broadcaster's broadcasting position is the shortest as the optimal viewing position using the best viewing position designation unit 103 (see Figure 2) of the client system 22 that the representative uses.

[0249] In the fourth setting form of venue arrangement, in the virtual space of Figure 13, the position of the friend group G2 is set to a position that is the shortest distance in front of the predetermined fixed position P0 where the distribution position P(T1) of the broadcaster T1 is originally set, just like in Figure 12.

[0250] That is, when the position of the friend group G2 is changed within the settable position range, the position of the friend group G2 when the vector from the position P0 to the position of the friend group G2 is the smallest vector is detected as the optimum viewing position. Then, the position of the friend group G2 is set to the detected optimum viewing position.

[0251] In the example of Figure 13, as in Figure 12, the viewing position P(G2-U1) of viewer G2-U1 is set as the position for the peer group G2, and the viewing position P(G2-U1) of viewer G2-U1 is set as the viewing position DP(m, n).

[0252] Furthermore, the viewing positions of viewers G2-U2 to G2-U6, who are members of the peer group G2 to which viewer G2-U1 belongs, are set near the viewing position P(G2-U1) of viewer G2-U1. The viewing positions of viewers G2-U1 to G2-U6 are viewing positions DP(m,n), DP(m,n+1), DP(m,n-1), DP(m+1,n), DP(m+1,n+1), and DP(m+1,n-1), respectively (see FIG. 4).

[0253] The viewing positions of viewers other than the members of the peer group G2 are set in any manner.

[0254] On the other hand, the distribution position P(T1) of distributor T1 is set to position P1, which is different from position P0 in the case of Fig. 12. Position P1 is the position at the shortest distance in front of viewable position DP(m, n+1), which is the viewing position P(G2-U2) of viewer G2-U2, who is the experiencer V.

[0255] In other words, when the distribution position P(T1) of distributor T1 is changed within the range of settable positions, distribution position P(T1) is set to position P1, which is the distribution position P(T1) when the vector BP(G2-U2, T1) pointing from distributor T1's distribution position P(T1) to viewer G2-U2's viewing position P(G2-U2) becomes the smallest vector BP0.

[0256] (Processing in Example 1 of the Fourth Setting Form) 2 acquires peer group information of viewer G2-U2 from the user information acquisition unit 83 when setting the venue arrangement for viewer G2-U2, who is the experiencer V. The peer group information of viewer G2-U2 is information about the peer group specified by the peer group designation unit 104 (see FIG. 2) of the client system 22 used by viewer G2-U2. Based on the acquired peer group information of viewer G2-U2, the venue arrangement setting unit 84 detects the peer group G2 to which viewer G2-U2, who is the experiencer V, belongs and the viewers G2-U1 to G2-U6 who are members of the group.

[0257] Furthermore, the venue layout setting unit 84 acquires best viewing position information of the peer group G2 to which the experiencer V belongs from the user information acquisition unit 83. The best viewing position information of the peer group G2 is information about the optimal viewing position for the peer group G2, and is specified by the best viewing position designation unit 103 of the client system 22 used by the representative of the peer group G2, and is acquired by the user information acquisition unit 83. It is assumed that the representative of the peer group G2 is determined in advance.

[0258] In the example of Fig. 13, the arrangement of viewing positions among the members of the peer group G2 of each of viewers G2-U1 to G2-U6 who are members of the peer group G2 is determined in advance, as in the case of Fig. 12. Then, the viewing position P(G2-U1) of viewer G2-U1, who is arranged in the center of the forefront in the arrangement of viewing positions among the members of the peer group G2, is set as the position for the peer group G2.

[0259] It is also assumed that the representative of the peer group G2 has previously designated the best viewing position for the position of the peer group G2 using the best viewing position designation unit 103 of the client system 22 that he or she uses.

[0260] 13, it is assumed that the representative of the peer group G2 has specified the optimal viewing position for the viewing position P(G2-U1) of the viewer G2-U1, who is a member of the peer group G2. In the following, it is assumed that the representative of the peer group G2 has specified the viewing position where the distance between the viewing position P(G2-U1) of the viewer G2-U1 and the distribution position P(T1) of the distributor T1 is the shortest as the optimal viewing position for the viewing position P(G2-U1) of the viewer G2-U1, who is a member of the peer group G2.

[0261] The venue layout setting unit 84 temporarily sets the distribution position P(T1) of the distributor T1 to a position P0 corresponding to the center of the stage, for example, as in the case of Fig. 12. Note that the position P0 at which the distribution position P(T1) of the distributor T1 is temporarily set does not have to be the position P0, as in the case of the distribution position P(T1) of the distributor T1 in the first setting form.

[0262] In addition, the venue layout setting unit 84 sets the viewing position P(G2-U1) of viewer G2-U1, who is a member of the peer group G2, as the optimal viewing position at the viewing position DP(m, n) that is the shortest distance from the distribution position P(T1) of distributor T1 among the viewing positions DP.

[0263] That is, when the viewing position P(G2-U1) of viewer G2-U1, who is a member of the peer group G2, is changed to one of the viewing positions DP, the venue layout setting unit 84 detects, as the optimal viewing position, the viewing position P(G2-U1) when the vector from the distribution position P(T1) (provisionally set position P0) to the viewing position P(G2-U1) best matches the positional relationship specified by the best viewing position designation unit 103 (best viewing position information).The venue layout setting unit 84 then sets the viewing position P(G2-U1) of viewer G2-U1 to the detected optimal viewing position.

[0264] In addition, the venue arrangement setting unit 84 sets the viewing positions of members of the peer group G2 other than viewer G2-U1 in accordance with the arrangement of viewing positions among the members of the peer group G2 and so that the viewing position of viewer G2-U1, who is in the peer group G2, becomes the viewing position DP(m, n).

[0265] As a result, as shown in Figure 13, the viewing positions of viewers G2-U1 to G2-U6 belonging to the peer group G1 are set to viewing positions DP(m, n), DP(m, n+1), DP(m, n-1), DP(m+1, n), DP(m+1, n+1), and DP(m+1, n-1), respectively (see Figure 4).

[0266] The viewing positions of viewers other than the members of the peer group G2 are set in any manner.

[0267] At this stage, the arrangement of the distribution position P(T1) of the distributor T1 and the viewing positions of the viewers G2-U1 to G2-U6 who are members of the friend group G2 is the same as in FIG.

[0268] Furthermore, in the fourth setting form of venue arrangement, the venue arrangement setting unit 84 sets the distribution position P(T1) to a position among the positions that can be set as the distribution position P(T1) of the distributor T1 at which the distance between the distribution position P(T1) of the distributor T1 and the viewing position P(G2-U2) of the viewer G2-U2, who is the experiencer V, is the shortest.

[0269] That is, when the distribution position P(T1) of distributor T1 is changed within the settable range of positions, the venue layout setting unit 84 detects the distribution position P(T1) when the vector BP(G1-U2, T1) pointing from the distribution position P(T1) to the viewing position P(G2-U2) becomes the vector BP0 of the smallest magnitude as the optimal viewing position (the distribution position P(T1) for which the viewing position P(G2-U2) is the optimal viewing position, hereinafter referred to as the optimal position). Note that in the example of FIG. 13, position P1 is detected as the optimal position.

[0270] Then, the venue layout setting unit 84 sets the distribution position P(T1) of the distributor T1 to the detected optimum position P1.

[0271] According to the fourth setting form of the venue arrangement described above, even if a large number of viewers watch the content distributed by the distributor simultaneously and in the same space, each viewer can watch the content distributed by the distributor from the optimal viewing position.

[0272] Furthermore, when a group such as a peer group is set up, the viewer who is a peer is placed near the participant. Therefore, while participating in the event, the participant can easily know how their peers are doing as if they were actually meeting them. Furthermore, if voice chat or text chat is enabled in the peer group, or if the viewers or groups who are chatting are set as peer groups, they can easily chat even while participating in the event.

[0273] Furthermore, regardless of whether the viewer is a viewer belonging to a peer group, the viewing positions are the same for all members of the peer group (among the members). Therefore, for example, viewers belonging to the same peer group will not recognize each other as being on their right side. For example, when chatting, they will not end up facing opposite directions when they intended to face each other.

[0274] Furthermore, since the broadcasting position of the broadcaster is not significantly changed, it is possible to prevent inconsistencies with the broadcaster's background (stage, etc.).

[0275] <Venue layout configurations for 5th to 9th configurations> Fig. 14 is a diagram illustrating the configuration of the venue layout used in the fifth to ninth setting forms of the venue layout described in Fig. 15 to Fig. 25. Fig. 14 shows a virtual space in which an event venue is constructed, with the height direction being perpendicular to the plane of the paper.

[0276] In the fifth to ninth venue layout configurations, the viewing position is set to a different position for each viewer who is to experience the event.

[0277] In the virtual space of Figure 14, viewing positions DP(m, n), DP(m, n+1), DP(m, n-1), DP(m+1, n), ... and viewing positions DP(m, n+r), DP(m, n+r+1), DP(m, n+r-1), DP(m+1, n+r), ... represent positions that can be set as the viewer's viewing position (hereinafter, the entire viewing position will be represented as DP).

[0278] Viewers U1 and U2 are viewers who will be focused on as experiencers in the following description. When viewer U1 is the experiencer, the viewing position P(U1) of viewer U1 is set to the viewable position DP(m, n). When viewer U2 is the experiencer, the viewing position P(U2) of viewer U2 is set to the viewable position DP(m, n+r).

[0279] Furthermore, the viewing positions of each viewer when they are experiencers are determined in advance so that they are not set to the same viewable position DP, just as in the real world. Therefore, only viewer U1 has his viewing position set to viewable position DP(m, n) when he is an experiencer, and only viewer U2 has his viewing position set to viewable position DP(m, n+r) when he is an experiencer. The viewing position when he is an experiencer is the position from which the viewer who is an experiencer views in the virtual space.

[0280] The distribution position P(T1) of the distributor T1 is shown as a position P0 when set at the center of the stage at the event venue, for example. However, the distribution position P(T1) of the distributor T1 is changed as appropriate depending on the viewing positions of the viewers who will be experiencing the event.

[0281] <Fifth venue layout configuration> (Example 1) Fig. 15 is a diagram illustrating Example 1 of the fifth setting form of venue layout. Fig. 15 shows a virtual space in which the event venue of Fig. 14 is constructed, with the height direction being perpendicular to the paper surface. The viewable positions DP in the virtual space of Fig. 15 are the same as those in Fig. 14, and only some of the symbols for the viewable positions DP are shown.

[0282] FIG. 15 shows a case where the venue arrangement is set for the viewer U1 in FIG.

[0283] Furthermore, viewer U1 is assumed to have designated the viewing position at which the distance between the viewer's viewing position and the distributor's distribution position is the shortest as the optimal viewing position using the best viewing position designation unit 103 (see Figure 2) of the client system 22 that he or she uses.

[0284] In the fifth setting form of the venue layout, in the virtual space of FIG. 15, the viewing position P(U1) of the viewer U1 who is the participant V is set to a predetermined viewing position DP(m, n).

[0285] In addition, the distribution position P(T1) of the distributor T1 is set to position P2, among the possible positions, which is the shortest distance in front of the viewing position P(U1) (=DP(m, n)) of the viewer U1, who is the experiencer V.

[0286] That is, when the distribution position P(T1) of the distributor T1 is changed within the settable range of positions, the distribution position P(T1) is set as the optimal viewing position (optimal position) at position P2, which is the distribution position P(T1) when the vector BP(U1,T1) pointing from the distribution position P(T1) of the distributor T1 to the viewing position P(U1) of the viewer U1 becomes the vector BP0 of the smallest magnitude. The optimal viewing position (optimal position) here means the distribution position P(T1) of the distributor T1 when the viewing position P(U1) of the viewer U1, who is the experiencer V, becomes the optimal viewing position (viewing environment).

[0287] (Processing in Example 1 of the Fifth Setting Form) 2 acquires best viewing position information of viewer U1, who is the experiencer V, from user information acquisition unit 83. The best viewing position information of viewer U1 is information about the optimal viewing position specified by best viewing position designation unit 103 of client system 22 used by viewer U1. Then, venue layout setting unit 84 sets distribution position P(T1) of distributor T1 and viewing position P(U1) of viewer U1, who is the experiencer V, so as to meet the conditions specified by the best viewing position information of viewer U1.

[0288] Therefore, the venue layout setting unit 84 sets the viewing position P(U1) of the viewer U1, who is the experiencer V, to a predetermined viewable position DP(m, n). For example, the venue layout setting unit 84 may have the viewer participating in the event select, as the viewing position for the experiencer V, one of the viewable positions DP that has not been selected by another viewer, in the order in which the viewer logs in to the distribution server 41 or applies to participate in the event.

[0289] Furthermore, the venue layout setting unit 84 may automatically assign one of the viewable positions DP to each viewer participating in the event so that the viewer does not overlap with other viewers.

[0290] In addition, the venue layout setting unit 84 sets the distribution position P(T1) of the distributor T1 at a position that is the shortest distance from the viewing position P(U1) of the viewer U1, who is the experiencer V, to the set viewing position DP(m, n) among the positions that can be set as the distribution position P(T1) of the distributor T1.

[0291] That is, when the distribution position P(T1) of the distributor T1 is changed within the settable range of positions, the venue layout setting unit 84 detects, as the optimal position, the distribution position P(T1) when the vector BP(U1,T1) pointing from the distribution position P(T1) to the viewing position P(U1) of the viewer U1 becomes the vector BP0 with the smallest magnitude. Then, the venue layout setting unit 84 sets the distribution position P(T1) of the distributor T1 to the detected optimal position.

[0292] In this fifth setting form, it is assumed that the best viewing position designation unit 103 (see FIG. 2) designates the viewing position when the distance between the viewer's (viewer's) viewing position and the distributor's distribution position is the shortest (when the relative positional relationship (conditions) between the viewing position and the distribution position is designated to be the shortest). This is not limited to this case, and the venue layout setting unit 84 performs the following processing for any condition (positional relationship) designated by the best viewing position designation unit 103. When the distribution position P(T1) is changed within the settable position range, the venue layout setting unit 84 detects, as the optimal position, the distribution position P(T1) when the vector BP(U1, T1) from the distribution position P(T1) to the viewing position P(U1) best matches the positional relationship (conditions) designated by the best viewing position designation unit 103 (best viewing position information). Then, the venue layout setting unit 84 sets the distribution position P(T1) of the distributor T1 to the detected optimal position. In the sixth to eighth setting forms, the optimum position that meets any condition designated by the best viewing position designation unit 103 (best viewing position information) is similarly detected.

[0293] The viewing positions of the viewers other than the viewer U1 who is the experiencer V may be set by any method. For example, the viewing positions of the viewers other than the viewer U1 who is the experiencer V may be set to viewing positions DP that are assigned in advance to each viewer as the viewing position when they are an experiencer.

[0294] (Example 2) Fig. 16 is a diagram illustrating Example 2 of the fifth setting form of venue layout. Fig. 16 shows a virtual space in which the event venue of Fig. 14 is constructed, with the height direction being perpendicular to the paper surface. The viewable positions DP in the virtual space of Fig. 16 are the same as those in Fig. 14, and only some of the symbols for the viewable positions DP are shown.

[0295] FIG. 16 shows a case where the venue arrangement is set for the viewer U2 in FIG.

[0296] Furthermore, viewer U1 is assumed to have designated the viewing position at which the distance between the viewer's viewing position and the distributor's distribution position is the shortest as the optimal viewing position using the best viewing position designation unit 103 (see Figure 2) of the client system 22 that he or she uses.

[0297] In the sixth setting form of the venue layout, in the virtual space of FIG. 16, the viewing position P(U2) of the viewer U2 who is the experiencer V is set to a predetermined viewing position DP(m, n+r).

[0298] In addition, the distribution position P(T1) of the distributor T1 is set to position P3, which is the shortest distance in front of the viewing position P(U1) (=DP(m, n+r)) of the viewer U2, who is the experiencer V, among the possible positions.

[0299] In other words, when the distribution position P(T1) of distributor T1 is changed within the range of settable positions, the distribution position P(T1) is set as the optimal position at position P3, which is the distribution position P(T1) when the vector BP(U2, T1) pointing from the distribution position P(T1) of distributor T1 to the viewing position P(U2) of viewer U2 becomes the vector BP0 of the smallest magnitude.

[0300] The venue layout setting process in FIG. 16 is the same as that in FIG. 15, and therefore a description thereof will be omitted.

[0301] According to the fifth setting form of the venue arrangement described above, even if a large number of viewers watch the content distributed by distributor T1 simultaneously and in the same space, each viewer can watch the content distributed by distributor T1 at their own optimal viewing position.

[0302] <Sixth venue layout configuration> (Example 1) Fig. 17 is a diagram illustrating Example 1 of the sixth setting form of venue layout. Fig. 17 shows a virtual space in which the event venue of Fig. 14 is constructed, with the height direction being perpendicular to the paper surface. The viewable positions DP in the virtual space of Fig. 17 are the same as those in Fig. 14, and only some of the reference symbols are used for the viewable positions DP.

[0303] FIG. 17 shows a case where the venue arrangement is set for the viewer G1-U1 in FIG. 14 when the viewer U1 is a viewer G1-U1 in the companion group G1, and the viewer G1-U1 is set as the experiencer V.

[0304] Also, it is assumed that viewer G1-U1 has designated that he or she belongs to the peer group G1 using the peer group designation unit 104 (see FIG. 2) of the client system 22 that he or she uses. It is also assumed that viewers G1-U1 to G1-U6 belong to the peer group G1.

[0305] Furthermore, viewer G1-U1 is assumed to have designated the viewing position when the distance between the viewer's viewing position and the distributor's distribution position is the shortest as the optimal viewing position using the best viewing position designation unit 103 (see Figure 2) of the client system 22 that he or she uses.

[0306] In the sixth setting form of the venue arrangement, in the virtual space of Figure 17, the viewing position P (G1-U1) of the viewer G1-U1 (viewer U1 in Figure 14), who is the experiencer V, is set to a predetermined viewing position DP (m, n).

[0307] In addition, the distribution position P(T1) of the distributor T1 is set to position P2, among the possible positions, which is the shortest distance in front of the viewing position P(G1-U1) (=DP(m, n)) of the viewer G1-U1, who is the experiencer V.

[0308] In other words, when the distribution position P(T1) of distributor T1 is changed within the range of settable positions, distribution position P(T1) is set to position P2, which is the distribution position P(T1) when the vector BP(G1-U1, T1) pointing from distributor T1's distribution position P(T1) to viewer G1-U1's viewing position P(G1-U1) becomes the smallest vector BP0.

[0309] Also, the viewing positions of viewers G1-U2 to G1-U6, who are members of the peer group G1 to which viewer G1-U1 belongs, are set near the viewing position P(G1-U1) of viewer G1-U1. The viewing positions of viewers G1-U1 to G1-U6 are viewing positions DP(m,n), DP(m,n+1), DP(m,n-1), DP(m+1,n), DP(m+1,n+1), and DP(m+1,n-1), respectively (see FIG. 14).

[0310] (Processing in Example 1 of the Sixth Setting Form) 2 acquires best viewing position information of viewer G1-U1, who is experiencer V, from user information acquisition unit 83. The best viewing position information of viewer G1-U1 is information about the optimal viewing position specified by best viewing position designation unit 103 of client system 22 used by viewer G1-U1. Then, venue layout setting unit 84 sets distribution position P(T1) of distributor T1 and viewing position P(G1-U1) of viewer G1-U1, who is experiencer V, so as to meet the conditions specified by the best viewing position information of viewer G1-U1.

[0311] Therefore, the venue layout setting unit 84 sets the viewing position P(G1-U1) of the viewer G1-U1, who is the experiencer V, to a predetermined viewing position DP(m, n).

[0312] In addition, the venue layout setting unit 84 sets the distribution position P(T1) of the distributor T1 at a position that is the shortest distance from the viewing position P(G1-U1) of the viewer G1-U1, who is the experiencer V, to the set viewing position DP(m, n) among the positions that can be set as the distribution position P(T1) of the distributor T1.

[0313] That is, when the distribution position P(T1) of the distributor T1 is changed within the settable range of positions, the venue layout setting unit 84 detects, as the optimal position, the distribution position P(T1) when the vector BP(G1-U1, T1) pointing from the distribution position P(T1) to the viewing position P(G1-U1) of the viewer G1-U1 becomes the vector BP0 with the smallest magnitude. Then, the venue layout setting unit 84 sets the distribution position P(T1) of the distributor T1 to the detected optimal position.

[0314] Furthermore, the venue layout setting unit 84 acquires peer group information of the viewer G1-U1, who is the experiencer V, from the user information acquisition unit 83 (see FIG. 2). The peer group information of the viewer G1-U1 is information about the peer group designated by the peer group designation unit 104 (see FIG. 2) of the client system 22 used by the viewer G1-U1. Based on the acquired peer group information of the viewer G1-U1, the venue layout setting unit 84 detects the peer group G1 to which the viewer G1-U1, who is the experiencer V, belongs and the viewers G1-U1 to G1-U6 who are its members.

[0315] The venue arrangement setting unit 84 sets the viewing positions of the viewers G1-U2 to G1-U6 who are members other than the detected viewer G1-U1 of the friend group G1 according to the arrangement of the viewing positions among the members of the friend group G1.

[0316] The conditions for arranging the viewing positions among the members of the peer group G1 are the same as those in the second setting form of the venue arrangement in FIG. 6, and therefore a description thereof will be omitted.

[0317] As a result, as shown in Figure 17, the viewing positions of viewers G1-U1 to G1-U6 belonging to the peer group G1 are set to viewing positions DP(m, n), DP(m, n+1), DP(m, n-1), DP(m+1, n), DP(m+1, n+1), and DP(m+1, n-1), respectively (see Figure 14).

[0318] The viewing positions of viewers other than the members of the peer group G1 are set by any method.

[0319] (Example 2) Fig. 18 is a diagram illustrating Example 2 of the sixth setting form of venue layout. Fig. 18 shows a virtual space in which the event venue of Fig. 14 is constructed, with the height direction being perpendicular to the paper surface. The viewable positions DP in the virtual space of Fig. 18 are the same as those in Fig. 14, and only some of the symbols for the viewable positions DP are shown.

[0320] 18 shows a case where the venue arrangement is set for viewer G1-U2 when viewer U2 in FIG. 14 is viewer G1-U2 of friend group G1 in FIG. 17, and viewer G1-U2 is set as experiencer V.

[0321] Also, it is assumed that viewer G1-U2 has designated that he or she belongs to the peer group G1 using the peer group designation unit 104 (see FIG. 2) of the client system 22 that he or she uses. It is also assumed that viewers G1-U1 to G1-U6 belong to the peer group G1.

[0322] Furthermore, viewer G1-U2 is assumed to have designated the viewing position at which the distance between the viewer's viewing position and the distributor's distribution position is the shortest as the optimal viewing position using the best viewing position designation unit 103 (see Figure 2) of the client system 22 that he or she uses.

[0323] In the sixth setting form of the venue arrangement, in the virtual space of Figure 18, the viewing position P (G1-U2) of the viewer G1-U2 (viewer U2 in Figure 14), who is the experiencer V, is set to the viewing position (m, n+1) rather than the predetermined viewing position DP (m, n+r).

[0324] The viewing position (m, n+1) is the viewing position of viewer G1-U2 in the venue layout set for viewer G1-U1, when viewer G1-U1 in Figure 17 (viewer U1 in Figure 14) is the experiencer V.

[0325] That is, in the sixth setting form, for viewers G1-U1 to G1-U6 who belong to the same peer group G1, the viewing positions when each is an experiencer V are set to viewing positions DP corresponding to the arrangement of the viewing positions among the members of the peer group G1.

[0326] Note that Figure 17 will also be referenced in the seventh setting form of venue arrangement described below, and does not go so far as to describe setting the viewing position of viewers who belong to the same peer group as the experiencer to a viewing position DP that corresponds to the arrangement of the viewing positions among the members of peer group G1.

[0327] In addition, the distribution position P(T1) of the distributor T1 is set to position P4, which is the shortest distance in front of the viewing position P(G1-U2) (=DP(m, n+1)) of the viewer G1-U2, who is the experiencer V, among the possible positions.

[0328] In other words, when the distribution position P(T1) of distributor T1 is changed within the range of settable positions, distribution position P(T1) is set to position P4, which is the distribution position P(T1) when the vector BP(G1-U2, T1) pointing from distributor T1's distribution position P(T1) to viewer G1-U2's viewing position P(G1-U2) becomes the smallest vector BP0.

[0329] Also, the viewing positions of viewers G1-U1 and G1-U3 to G1-U6, who are members of the peer group G1 to which viewer G1-U2 belongs, are set near the viewing position P(G1-U2) of viewer G1-U2. The viewing positions of viewers G1-U1 to G1-U6 are viewable positions DP(m,n), DP(m,n+1), DP(m,n-1), DP(m+1,n), DP(m+1,n+1), and DP(m+1,n-1), respectively, as in Fig. 17 (see Fig. 14).

[0330] (Processing in Example 2 of the Sixth Setting Form) 2 acquires best viewing position information of viewer G1-U2, who is experiencer V, from user information acquisition unit 83. The best viewing position information of viewer G1-U2 is information about the optimal viewing position specified by best viewing position designation unit 103 of client system 22 used by viewer G1-U2. Then, venue layout setting unit 84 sets distribution position P(T1) of distributor T1 and viewing position P(G1-U2) of viewer G1-U2, who is experiencer V, so as to conform to the conditions specified by the best viewing position information of viewer G1-U2.

[0331] The venue layout setting unit 84 sets the viewing position P(G1-U2) of the viewer G1-U1, who is the experiencer V, to a predetermined viewing position DP(m, n+1), as will be described later.

[0332] In addition, the venue layout setting unit 84 sets the distribution position P(T1) of the distributor T1 at a position that is the shortest distance from the viewing position P(G1-U2) of the viewer G1-U2, who is the experiencer V, to the viewing position DP(m, n+1) where the viewing position P(G1-U2) of the viewer G1-U2 is set.

[0333] That is, when the distribution position P(T1) of the distributor T1 is changed within the settable range of positions, the venue layout setting unit 84 detects, as the optimal position, the distribution position P(T1) when the vector BP(G1-U2, T1) pointing from the distribution position P(T1) to the viewing position P(G1-U2) of the viewer G1-U2 becomes the vector BP0 with the smallest magnitude. Then, the venue layout setting unit 84 sets the distribution position P(T1) of the distributor T1 to the detected optimal position.

[0334] Furthermore, before setting the venue layout for each viewer, the venue layout setting unit 84 sets the viewing position of each viewer when he / she is an experiencer for each peer group.

[0335] The venue layout setting unit 84 acquires, from the user information acquisition unit 83, peer group information about the peer groups designated by the peer group designation unit 104 (see FIG. 2) of the client system 22 used by each viewer, and uses the peer group information to determine the member composition of each peer group. Focusing on the peer group G1, the venue layout setting unit 84 detects the members of the peer group G1 from the peer group information.

[0336] The members of the peer group G1 in FIGS. 17 and 18 are viewers G1-U1 to G1-U6.

[0337] The venue arrangement setting unit 84 sets the viewing positions of the viewers G1-U1 to G1-U6 who are members of the friend group G1 when they are experiencing the event, according to the arrangement of viewing positions that has been decided in advance among the members of the friend group G1.

[0338] Furthermore, the venue layout setting unit 84 sets the viewing positions of members of peer groups other than the peer group G1 when they are participants according to the layout of viewing positions that has been decided in advance among the members. At this time, the venue layout setting unit 84 prevents the overlapping setting of viewing positions of multiple viewers (viewing positions when they are participants) at one settable position.

[0339] Furthermore, when setting the venue arrangement for viewer G1-U2, who is the experiencer V, the venue arrangement setting unit 84 acquires peer group information for viewer G1-U2 from the user information acquisition unit 83 (see FIG. 2). The peer group information for viewer G1-U2 is information about the peer group specified by the peer group designation unit 104 (see FIG. 2) of the client system 22 used by viewer G1-U2. Using the acquired peer group information for viewer G1-U2, the venue arrangement setting unit 84 detects the peer group G1 to which viewer G1-U2, who is the experiencer V, belongs and the viewers G1-U1 to G1-U6 who are its members.

[0340] The venue layout setting unit 84 sets the viewing positions of viewers G1-U1, G1-U3 to G1-U6, who are members of the detected peer group G1 other than viewer G1-U2, according to the layout of the viewing positions among the members of the peer group G1. However, because the venue layout setting unit 84 sets the viewing positions of viewers G1-U1, G1-U3 to G1-U6 as the viewing positions when they were participants according to the layout of the viewing positions among the members of the peer group G1, the viewing positions of viewers G1-U1, G1-U3 to G1-U6 as the participants may be applied directly to the venue layout setting.

[0341] As a result, as shown in Figure 18, the viewing positions of viewers G1-U1 to G1-U6 belonging to the peer group G1 are set to viewing positions DP(m, n), DP(m, n+1), DP(m, n-1), DP(m+1, n), DP(m+1, n+1), DP(m+1, n-1), respectively (see Figure 14), and are set to positions close to each other.

[0342] (Example 3) Fig. 19 is a diagram illustrating Example 3 of the sixth setting form of venue layout. Fig. 19 shows a virtual space in which the event venue of Fig. 14 is constructed, with the height direction being perpendicular to the paper surface. The viewable positions DP in the virtual space of Fig. 19 are the same as those in Fig. 14, and only some of the symbols for the viewable positions DP are shown.

[0343] Figure 19 shows the case where the venue arrangement is set for viewer G2-U1 when viewer U2 in Figure 14 is viewer G2-U1 of a friend group G2 that is different from friend group G1 in Figure 17, and viewer G2-U1 is set as experiencer V1.

[0344] Also, it is assumed that viewer G2-U1 has designated that he or she belongs to peer group G2 using peer group designation unit 104 (see FIG. 2) of client system 22 that he or she uses. It is also assumed that viewers G2-U1 to G2-U6 belong to peer group G2.

[0345] Furthermore, viewer G2-U1 is assumed to have designated the viewing position where the distance between the viewer's viewing position and the distributor's distribution position is the shortest as the optimal viewing position using the best viewing position designation unit 103 (see Figure 2) of the client system 22 that he or she uses.

[0346] In the sixth setting form of the venue arrangement, in the virtual space of Figure 19, the viewing position P (G2-U1) of the viewer G2-U1 (viewer U2 in Figure 14), who is the experiencer V, is set to a predetermined viewing position DP (m, n + r).

[0347] In addition, the distribution position P(T1) of the distributor T1 is set to position P3, which is the shortest distance in front of the viewing position P(G2-U1) (=DP(m, n+r)) of the viewer G2-U1, who is the experiencer V, among the possible positions.

[0348] In other words, when the distribution position P(T1) of distributor T1 is changed within the range of settable positions, distribution position P(T1) is set to position P3, which is the distribution position P(T1) when the vector BP(G2-U1, T1) pointing from distributor T1's distribution position P(T1) to viewer G2-U1's viewing position P(G2-U1) becomes the smallest vector BP0.

[0349] Also, the viewing positions of viewers G2-U2 to G1-U6, who are members of the peer group G2 to which viewer G2-U1 belongs, are set near the viewing position P(G2-U1) of viewer G2-U1. The viewing positions of viewers G2-U1 to G2-U6 are viewing positions DP(m,n+r), DP(m,n+r+1), DP(m,n+r-1), DP(m+1,n+r), DP(m+1,n+r+1), and DP(m+1,n+r-1), respectively (see FIG. 14).

[0350] Here, the viewing positions of viewers G2-U1 to G2-U6 who are members of the peer group G2 when they are participants are set according to the arrangement of viewing positions among the members of the peer group G2, similar to the peer group G1 in Figure 18.

[0351] Therefore, the venue layout setting unit 84 of the distribution server 41 in Figure 2 obtains the layout shown in Figure 19 by applying the viewing positions of viewers G2-U1 to G2-U6 when they are participants to the venue layout setting for viewer G2-U1.

[0352] The venue layout setting process in FIG. 19 is the same as that in FIGS. 17 and 18, and therefore a description thereof will be omitted.

[0353] (Example 4) Fig. 20 is a diagram illustrating Example 4 of the sixth setting form of venue layout. Fig. 20 shows a virtual space in which the event venue of Fig. 14 is constructed, with the height direction being perpendicular to the paper surface. The viewable positions DP in the virtual space of Fig. 19 are the same as those in Fig. 14, and only some of the symbols for the viewable positions DP are shown.

[0354] Figure 20 shows the case where the venue arrangement is set for viewer G2-U2 when viewer U2 in Figure 14 is viewer G2-U2 of a friend group G2 that is different from friend group G1 in Figure 17, and viewer G2-U2 is set as experiencer V1.

[0355] Also, it is assumed that viewer G2-U2 has designated that he or she belongs to the peer group G2 using the peer group designation unit 104 (see FIG. 2) of the client system 22 that he or she uses. It is also assumed that viewers G2-U1 to G2-U6 belong to the peer group G2.

[0356] Furthermore, viewer G2-U2 is assumed to have designated the viewing position when the distance between the viewer's viewing position and the distributor's distribution position is the shortest as the optimal viewing position using the best viewing position designation unit 103 (see Figure 2) of the client system 22 that he or she uses.

[0357] In the sixth setting form of the venue arrangement, in the virtual space of Figure 20, the viewing position P (G2-U2) of the viewer G2-U2 (viewer U2 in Figure 14), who is the experiencer V, is set to a predetermined viewing position DP (m, n + r).

[0358] In addition, the distribution position P(T1) of the distributor T1 is set to position P3, which is the shortest distance in front of the viewing position P(G2-U2) (=DP(m, n+r)) of the viewer G2-U2, who is the experiencer V, among the possible positions.

[0359] In other words, when the distribution position P(T1) of distributor T1 is changed within the range of settable positions, distribution position P(T1) is set to position P3, which is the distribution position P(T1) when the vector BP(G2-U2, T1) pointing from the distribution position P(T1) of distributor T1 to the viewing position P(G2-U2) of viewer G2-U2 becomes the vector BP0 of the smallest magnitude.

[0360] Also, the viewing positions of viewers G2-U1 and G2-U3 to G1-U6, who are members of the peer group G2 to which viewer G2-U2 belongs, are set near the viewing position P(G2-U2) of viewer G2-U2. The viewing positions of viewers G2-U1 to G2-U6 are viewing positions DP(m, n+r-1), DP(m, n+r), DP(m, n+r-2), DP(m+1, n+r-1), DP(m+1, n+r), and DP(m+1, n+r-2), respectively (see FIG. 14).

[0361] Here, in terms of the viewing positions among the members of the peer group G2, viewer G2-U2 is to the right of viewer G2-U1. Viewer U2 in FIG. 14, who is the experiencer V, does not change his or her viewing position whether he or she is viewer G2-U1 in FIG. 19 or viewer G2-U2 in FIG. 20. Therefore, comparing FIG. 19 and FIG. 20, the viewing positions of viewers G2-U1 to G2-U6, who are members of the peer group G2, are shifted one row to the left in FIG. 20.

[0362] The venue layout setting process in FIG. 20 is the same as that in FIGS. 17 to 19, and therefore a description thereof will be omitted.

[0363] According to the sixth setting form of the venue arrangement described above, even if a large number of viewers simultaneously watch the content distributed by the distributor in the same space, each viewer can watch the content distributed by the distributor from their own optimal viewing position.

[0364] Furthermore, when a group such as a peer group is set up, the viewer who is a peer is placed near the participant. Therefore, while participating in the event, the participant can easily know how their peers are doing as if they were actually meeting them. Furthermore, if voice chat or text chat is enabled in the peer group, or if the viewers or groups who are chatting are set as peer groups, they can easily chat even while participating in the event.

[0365] Furthermore, regardless of whether the viewer is a viewer belonging to a peer group, the viewing positions are the same for all members of the peer group (among the members). Therefore, for example, viewers belonging to the same peer group will not recognize each other as being on their right side. For example, when chatting, they will not end up facing opposite directions when they intended to face each other.

[0366] <7th venue layout configuration> (Example 1) Fig. 21 is a diagram illustrating Example 1 of the seventh setting form of venue layout. Fig. 21 shows a virtual space in which the event venue of Fig. 14 is constructed, with the height direction being perpendicular to the paper surface. The viewable positions DP in the virtual space of Fig. 21 are the same as those in Fig. 14, and only some of the symbols for the viewable positions DP are shown.

[0367] 21 shows a case where the venue arrangement is set for viewer G1-U2 when viewer U2 in FIG. 14 is viewer G1-U2 of friend group G1 in FIG. 17, and viewer G1-U2 is set as experiencer V.

[0368] Also, it is assumed that viewer G1-U2 has designated that he or she belongs to the peer group G1 using the peer group designation unit 104 (see FIG. 2) of the client system 22 that he or she uses. It is also assumed that viewers G1-U1 to G1-U6 belong to the peer group G1.

[0369] Furthermore, viewer G1-U2 is assumed to have designated the viewing position at which the distance between the viewer's viewing position and the distributor's distribution position is the shortest as the optimal viewing position using the best viewing position designation unit 103 (see Figure 2) of the client system 22 that he or she uses.

[0370] In the seventh setting form of the venue arrangement, in the virtual space of Figure 21, the viewing position P (G1-U2) of the viewer G1-U2 (viewer U2 in Figure 14), who is the experiencer V, is set to a predetermined viewing position DP (m, n + r).

[0371] Here, in Figure 21, unlike the case of Figure 18, the viewing position of viewer G1-U2 when experiencing the experience is not set near viewer G1-U1 in Figure 17 (viewer U1 in Figure 14), who is a member of the same peer group G1.

[0372] In addition, the distribution position P(T1) of the distributor T1 is set to position P3, which is the shortest distance in front of the viewing position P(G1-U2) (=DP(m, n+r)) of the viewer G1-U2, who is the experiencer V, among the possible positions.

[0373] In other words, when the distribution position P(T1) of distributor T1 is changed within the range of settable positions, distribution position P(T1) is set to position P3, which is the distribution position P(T1) when the vector BP(G1-U2, T1) pointing from distributor T1's distribution position P(T1) to viewer G1-U2's viewing position P(G1-U2) becomes the smallest vector BP0.

[0374] Also, the viewing positions of viewers G1-U1 and G1-U3 to G1-U6, who are members of the peer group G1 to which viewer G1-U2 belongs, are set near the viewing position P(G1-U2) of viewer G1-U2. The viewing positions of viewers G1-U1 to G1-U6 are viewing positions DP(m, n+r-1), DP(m, n+r), DP(m, n+r-2), DP(m+1, n+r-1), DP(m+1, n+r), and DP(m+1, n+r-2), respectively (see FIG. 14).

[0375] (Processing in Example 1 of the Seventh Setting Form) 2 acquires best viewing position information of viewer G1-U2, who is experiencer V, from user information acquisition unit 83. The best viewing position information of viewer G1-U2 is information about the optimal viewing position specified by best viewing position designation unit 103 of client system 22 used by viewer G1-U2. Then, venue layout setting unit 84 sets distribution position P(T1) of distributor T1 and viewing position P(G1-U2) of viewer G1-U2, who is experiencer V, so as to conform to the conditions specified by the best viewing position information of viewer G1-U2.

[0376] Therefore, the venue layout setting unit 84 sets the viewing position P(G1-U2) of the viewer G1-U2, who is the experiencer V, to a predetermined viewing position DP(m, n+r).

[0377] In addition, the venue layout setting unit 84 sets the distribution position P(T1) of the distributor T1 at a position that is the shortest distance from the viewing position P(G1-U2) of the viewer G1-U2, who is the experiencer V, to the viewing position DP(m, n+r) where the viewing position P(G1-U2) of the viewer G1-U2 is set.

[0378] That is, when the distribution position P(T1) of the distributor T1 is changed within the settable range of positions, the venue layout setting unit 84 detects the distribution position P(T1) when the vector BP(G1-U2, T1) pointing from the distribution position P(T1) to the viewing position P(G1-U2) of the viewer G1-U2 becomes the smallest vector BP0 as the optimal viewing position. Then, the venue layout setting unit 84 sets the distribution position P(T1) of the distributor T1 to the detected optimal viewing position.

[0379] Furthermore, the venue layout setting unit 84 acquires peer group information of the viewer G1-U2, who is the experiencer V, from the user information acquisition unit 83 (see FIG. 2). The peer group information of the viewer G1-U2 is information about the peer group designated by the peer group designation unit 104 (see FIG. 2) of the client system 22 used by the viewer G1-U2. Based on the acquired peer group information of the viewer G1-U2, the venue layout setting unit 84 detects the peer group G1 to which the viewer G1-U2, who is the experiencer V, belongs and the viewers G1-U1 to G1-U6 who are members of the group.

[0380] The venue arrangement setting unit 84 sets the viewing positions of viewers G1-U1 and G1-U3 to G1-U6, who are members of the detected peer group G1 other than viewer G1-U2, according to the arrangement of viewing positions among the members of the peer group G1.

[0381] The conditions for arranging the viewing positions among the members of the peer group G1 are the same as those in the second setting form of the venue arrangement in FIG. 6, and therefore a description thereof will be omitted.

[0382] As a result, as shown in Figure 21, the viewing positions of viewers G1-U1 to G1-U6 belonging to the peer group G1 are set to viewing positions DP(m, n+r-1), DP(m, n+r), DP(m, n+r-2), DP(m+1, n+r-1), DP(m+1, n+r), and DP(m+1, n+r-2), respectively.

[0383] If viewer U1 in Fig. 14 is viewer G1-U1, a member of peer group G1, applying the setting process of this seventh setting form results in a venue layout similar to that of Fig. 17. Therefore, even if members of the same peer group are watching from viewing positions that are far apart, the members of the peer group are nearby in each virtual space.

[0384] According to the seventh setting form of the venue arrangement described above, even if a large number of viewers watch the content distributed by the distributor simultaneously and in the same space, each viewer can watch the content distributed by the distributor from their own optimal viewing position.

[0385] Furthermore, when a group such as a peer group is set up, the viewer who is a peer is placed near the participant. Therefore, while participating in the event, the participant can easily know how their peers are doing as if they were actually meeting them. Furthermore, if voice chat or text chat is enabled in the peer group, or if the viewers or groups who are chatting are set as peer groups, they can easily chat even while participating in the event.

[0386] Furthermore, regardless of whether the viewer is a viewer belonging to a peer group, the viewing positions are the same for all members of the peer group (among the members). Therefore, for example, viewers belonging to the same peer group will not recognize each other as being on their right side. For example, when chatting, they will not end up facing opposite directions when they intended to face each other.

[0387] <8th venue layout configuration> (Example 1) Fig. 22 is a diagram illustrating Example 1 of the eighth setting form of venue layout. Fig. 22 shows a virtual space in which the event venue of Fig. 14 is constructed, with the height direction being perpendicular to the paper surface. The viewable positions DP in the virtual space of Fig. 22 are the same as those in Fig. 14, and only some of the symbols for the viewable positions DP are shown.

[0388] Figure 22 shows a case where viewer U1 in Figure 14 is viewer G1-U1 of peer group G1, and the venue arrangement is set for any viewer among viewers G1-U1 to G1-U6 belonging to peer group G1, and shows a case where the venue arrangement for all viewers among viewers G1-U1 to G1-U6 is the same.

[0389] It is also assumed that a representative is designated for the peer group G1, and that the representative designates the viewing position where the distance between the position of the peer group G1 and the broadcaster's broadcasting position is the shortest as the optimal viewing position using the best viewing position designation unit 103 (see Figure 2) of the client system 22 that the representative uses.

[0390] In the eighth setting form of the venue layout, in the virtual space of FIG. 22, the viewing position of viewer G1-U1 (viewer U1 in FIG. 14) is set to a predetermined viewing position DP(m, n).

[0391] Near the viewing position of viewer G1-U1, the viewing positions of viewers G1-U2 to G1-U6, who are members of the peer group G1 to which viewer G1-U1 belongs, are set according to the arrangement of viewing positions predetermined among the members of the peer group G1. The viewing positions of viewers G1-U1 to G1-U6 are viewing positions DP(m,n), DP(m,n+1), DP(m,n-1), DP(m+1,n), DP(m+1,n+1), and DP(m+1,n-1), respectively (see FIG. 14).

[0392] 22, the viewing position P(G1-U1) of viewer G1-U1 is set as the position of the peer group G1. The distribution position P(T1) of distributor T1 is set to position P2, which is the shortest distance in front of the viewing position (G1-U1) (=DP(m, n)) of viewer G1-U1, who is the experiencer V, among the settable positions.

[0393] In other words, when the distribution position P(T1) of distributor T1 is changed within the range of settable positions, distribution position P(T1) is set to position P2, which is the distribution position P(T1) when the vector BP(G1, T1) pointing from distributor T1's distribution position P(T1) to the position of the peer group G1 (viewing position P(G1-U1) of viewer G1-U1) becomes a vector of the smallest magnitude.

[0394] (Processing in Example 1 of the Eighth Setting Form) When setting the venue layout for an arbitrary viewer (experiencer V) belonging to the peer group G1, the venue layout setting unit 84 of the distribution server 41 in Fig. 2 acquires peer group information of the experiencer V from the user information acquisition unit 83. The peer group information of the experiencer V is information about the peer group specified by the peer group designation unit 104 (see Fig. 2) of the client system 22 used by the experiencer V. Based on the acquired peer group information of the experiencer V, the venue layout setting unit 84 detects the peer group G1 to which the experiencer V belongs and the viewers G1-U1 to G1-U6 who are members of the group.

[0395] The venue layout setting unit 84 sets the viewing positions of viewers G1-U1 to G1-U6 to predetermined viewing positions DP. The conditions for arranging the viewing positions of viewers G1-U1 to G1-U6 are the same as those for the viewing positions among the members of the peer group G1 described in the second venue layout setting form of FIG. 6, and therefore further explanation is omitted.

[0396] In Figure 22, viewer G1-U1 is assumed to be viewer U1 in Figure 14, so the viewing positions of viewers G1-U1 to G1-U6 are set to viewing positions DP(m, n), DP(m, n+1), DP(m, n-1), DP(m+1, n), DP(m+1, n+1), and DP(m+1, n-1), respectively (see Figure 14), so that the viewing position P(G1-U1) of viewer G1-U1 becomes viewing position DP(m, n).

[0397] Furthermore, the venue layout setting unit 84 acquires best viewing position information of the friend group G1 to which the experiencer V belongs from the user information acquisition unit 83. The best viewing position information of the friend group G1 is information about the optimal viewing position for the friend group G1, and is specified by the best viewing position designation unit 103 of the client system 22 used by the representative of the friend group G1, and is acquired by the user information acquisition unit 83. It is assumed that the representative of the friend group G1 is determined in advance.

[0398] The position of the peer group G1 is the same as that of the third setting form of venue arrangement, so detailed explanation will be omitted. It represents the viewing position of the viewer that is used as the reference for arranging the viewing positions among the members of the peer group G1. For example, the viewing position of the viewer who is located in the center of the front side in arranging the viewing positions among the members of the peer group G1 is set as the position of the peer group G1.

[0399] In the example of Fig. 22, the viewing position P(G1-U1) of viewer G1-U1 (viewer U1 in Fig. 14) who is positioned in the center of the front in the arrangement of viewing positions among the members of the peer group G1 is set as the position for the peer group G1. Note that the position for the peer group G1 is not limited to this and may be set to any position.

[0400] The representative of the peer group G1 is assumed to have designated the viewing position where the distance between the viewing position P(G1-U1) of viewer G1-U1 and the distribution position P(T1) of distributor T1 is the shortest as the optimal viewing position for the viewing position P(G1-U1) of viewer G1-U1, who is in the peer group G1.

[0401] The venue placement setting unit 84 sets the distribution position P(T1) of the distributor T1 at a position among the positions that can be set as the distribution position P(T1) of the distributor T1, which is the shortest distance from the viewing position DP(m, n) where the viewing position P(G1-U1) of the viewer G1-U1, who is a member of the peer group G1, is set.

[0402] That is, when the distribution position P(T1) of the distributor T1 is changed within the settable range of positions, the venue layout setting unit 84 detects, as the optimal position, the distribution position P(T1) when the vector BP(G1-U1, T1) pointing from the distribution position P(T1) to the viewing position P(G1-U1) of the viewer G1-U1 becomes the vector BP0 with the smallest magnitude. Then, the venue layout setting unit 84 sets the distribution position P(T1) of the distributor T1 to the detected optimal position.

[0403] In the eighth setting form of the venue arrangement, if the experiencer V is one of the members of the friend group G1, the venue arrangement shown in Fig. 22 is set. Therefore, the venue arrangement for each of the viewers G1-U1 to G1-U6 who are members of the friend group G1 is the same. That is, in the eighth setting form of the venue arrangement, the venue arrangement is set on a friend group basis.

[0404] (Example 2) Fig. 23 is a diagram illustrating Example 2 of the eighth setting form of venue layout. Fig. 23 shows a virtual space in which the event venue of Fig. 14 is constructed, with the height direction being perpendicular to the paper surface. The viewable positions DP in the virtual space of Fig. 23 are the same as those in Fig. 14, and only some of the symbols for the viewable positions DP are shown.

[0405] Figure 23 shows a case where viewer U2 in Figure 14 is viewer G2-U1 of peer group G2, and the venue arrangement is set for any viewer among viewers G2-U1 to G2-U6 belonging to peer group G2, and shows a case where the venue arrangement for all viewers among viewers G2-U1 to G2-U6 is the same.

[0406] It is also assumed that a representative is designated for the peer group G2, and that the representative designates the viewing position when the distance between the position of the peer group G2 and the broadcaster's broadcasting position is the shortest as the optimal viewing position using the best viewing position designation unit 103 (see Figure 2) of the client system 22 that the representative uses.

[0407] In the eighth setting form of the venue layout, in the virtual space of FIG. 23, the viewing position of viewer G2-U1 (viewer U2 in FIG. 14) is set to a predetermined viewing position DP(m, n+r).

[0408] Near the viewing position of viewer G2-U1, the viewing positions of viewers G2-U2 to G2-U6, who are members of peer group G2 to which viewer G2-U1 belongs, are set according to the arrangement of viewing positions predetermined among the members of peer group G2. The viewing positions of viewers G2-U1 to G2-U6 are viewing positions DP(m,n+r), DP(m,n+r+1), DP(m,n+r-1), DP(m+1,n+r), DP(m+1,n+r+1), and DP(m+1,n+r-1), respectively (see FIG. 14).

[0409] 23, the viewing position P(G2-U1) of viewer G2-U1 is set as the position of the friend group G2. The distribution position P(T1) of distributor T1 is set to position P3, which is the shortest distance in front of the viewing position (G2-U1) (=DP(m, n+r)) of viewer G2-U1, who is the experiencer V, among the settable positions.

[0410] In other words, when the distribution position P(T1) of distributor T1 is changed within the range of settable positions, distribution position P(T1) is set to position P3, which is the distribution position P(T1) when the vector BP(G2, T1) pointing from distributor T1's distribution position P(T1) to the position of the peer group G2 (viewer G2-U1's viewing position P(G2-U1)) becomes a vector of the smallest magnitude.

[0411] The venue layout setting process in FIG. 23 is the same as that in FIG. 22, and therefore will not be described here.

[0412] According to the eighth setting form of the venue arrangement described above, even if a large number of viewers watch the content distributed by the distributor simultaneously and in the same space, each viewer can watch the content distributed by the distributor in the optimal viewing position in groups of friends.

[0413] Furthermore, when a group such as a peer group is set up, the viewer who is a peer is placed near the participant. Therefore, while participating in the event, the participant can easily know how their peers are doing as if they were actually meeting them. Furthermore, if voice chat or text chat is enabled in the peer group, or if the viewers or groups who are chatting are set as peer groups, they can easily chat even while participating in the event.

[0414] Furthermore, regardless of whether the viewer is a viewer belonging to a peer group, the viewing positions are the same for all members of the peer group (among the members). Therefore, for example, viewers belonging to the same peer group will not recognize each other as being on their right side. For example, when chatting, they will not end up facing opposite directions when they intended to face each other.

[0415] <9th venue layout configuration> (Example 1) Fig. 24 is a diagram illustrating Example 1 of the ninth setting form of venue layout. Fig. 24 shows a virtual space in which the event venue of Fig. 14 is constructed, with the height direction being perpendicular to the paper surface. The viewable positions DP in the virtual space of Fig. 24 are the same as those in Fig. 14, and only some of the symbols for the viewable positions DP are shown.

[0416] 24 shows a case where the venue arrangement is set for the viewer G1-U1 in FIG. 14 when the viewer U1 is a viewer G1-U1 in the companion group G1, and the viewer G1-U1 is set as the experiencer V. In FIG.

[0417] In the ninth setting form of the venue arrangement, in the virtual space of Figure 24, the viewing position P (G1-U1) of the viewer G1-U1 (viewer U1 in Figure 14), who is the experiencer V, is set to a predetermined viewing position DP (m, n).

[0418] Furthermore, the distribution position P(T1) of the distributor T1 is set to a predetermined position P0.

[0419] Also, the viewing positions of viewers G1-U2 to G1-U6, who are members of the peer group G1 to which viewer G1-U1 belongs, are set near the viewing position P(G1-U1) of viewer G1-U1. The viewing positions of viewers G1-U1 to G1-U6 are viewing positions DP(m,n), DP(m,n+1), DP(m,n-1), DP(m+1,n), DP(m+1,n+1), and DP(m+1,n-1), respectively (see FIG. 14).

[0420] (Processing in Example 1 of the 9th Setting Form) The venue layout setting unit 84 of the distribution server 41 in FIG. 2 sets the viewing position P(G1-U1) of the viewer G1-U1 who is the experiencer V to a predetermined viewing position DP(m, n).

[0421] Furthermore, the venue layout setting unit 84 acquires peer group information of the viewer G1-U1, who is the experiencer V, from the user information acquisition unit 83 (see FIG. 2). The peer group information of the viewer G1-U1 is information about the peer group specified by the peer group designation unit 104 (see FIG. 2) of the client system 22 used by the viewer G1-U1. Using the acquired peer group information of the viewer G1-U1, the venue layout setting unit 84 detects the peer group G1 to which the viewer G1-U1, who is the experiencer V, belongs and its members, viewers G1-U1 to G1-U6. Then, the venue layout setting unit 84 sets the viewing positions of viewers G1-U2 to G1-U6, who are members of the detected peer group G1 other than viewer G1-U1, in accordance with the arrangement of the viewing positions among the members of the peer group G1.

[0422] The conditions for arranging the viewing positions among the members of the peer group G1 are the same as those in the second setting form of the venue arrangement in FIG. 6, and therefore a description thereof will be omitted.

[0423] As a result, as shown in Figure 24, the viewing positions of viewers G1-U1 to G1-U6 belonging to the peer group G1 are set to viewing positions DP(m, n), DP(m, n+1), DP(m, n-1), DP(m+1, n), DP(m+1, n+1), and DP(m+1, n-1), respectively (see Figure 14).

[0424] The viewing positions of viewers other than the members of the peer group G1 are set by any method.

[0425] (Example 2) Fig. 25 is a diagram illustrating Example 2 of the ninth setting form of venue layout. Fig. 25 shows a virtual space in which the event venue of Fig. 14 is constructed, with the height direction being perpendicular to the paper surface. The viewable positions DP in the virtual space of Fig. 25 are the same as those in Fig. 14, and only some of the symbols for the viewable positions DP are shown.

[0426] 25 shows a case where the venue arrangement is set for viewer G1-U2 when viewer U2 in FIG. 14 is viewer G1-U2 of friend group G1 in FIG. 24, and viewer G1-U2 is set as experiencer V.

[0427] In the ninth setting form of the venue arrangement, in the virtual space of Figure 25, the viewing position P (G1-U2) of the viewer G1-U2 (viewer U2 in Figure 14), who is the experiencer V, is set to a predetermined viewing position DP (m, n + r).

[0428] Also, the distribution position P(T1) of the distributor T1 is set to a predetermined position P0, similar to FIG.

[0429] Also, the viewing positions of viewers G1-U1 and G1-U3 to G1-U6, who are members of the peer group G1 to which viewer G1-U2 belongs, are set near the viewing position P(G1-U2) of viewer G1-U2. The viewing positions of viewers G1-U1 to G1-U6 are viewing positions DP(m, n+r-1), DP(m, n+r), DP(m, n+r-2), DP(m+1, n+r-1), DP(m+1, n+r), and DP(m+1, n+r-2), respectively (see FIG. 14).

[0430] The venue layout setting process in FIG. 25 is the same as that in FIG. 24, and therefore will not be described here.

[0431] According to the ninth setting of the venue layout described above, when a group such as a peer group is set up, the viewers who are peers are placed near the participant. Therefore, while participating in the event, the participant can easily know how their peers are doing as if they were actually meeting them. Furthermore, if peer groups are enabled for voice chat or text chat, or if the viewers or groups who are chatting are set up as peer groups, they can easily chat even while participating in the event.

[0432] Furthermore, regardless of whether the viewer is a viewer belonging to a peer group, the viewing positions are the same for all members of the peer group (among the members). Therefore, for example, viewers belonging to the same peer group will not recognize each other as being on their right side. For example, when chatting, they will not end up facing opposite directions when they intended to face each other.

[0433] <<Entertainment System 11 Details>> <Server System 21> FIG. 26 is a block diagram illustrating a functional configuration related to content distribution of the server system 21 of FIG.

[0434] 26, the server system 21 includes a distribution server 41, a multi-view camera 42, and a sensor 43.

[0435] The server system 21 generates distribution data including content (the distributor's own video and audio) to be distributed by the distributor to a large number of viewers who have participated in a specified event, and supplies the data to a client system 22 that is communicatively connected via a network 23 (see Figure 1).

[0436] The multi-viewpoint camera 42 captures images of a broadcaster, for example, with a green screen as the background, from multiple viewpoints using multiple video cameras, and supplies the acquired multi-viewpoint images to the distribution server 41.

[0437] The sensor 43 is a sensor for detecting the position, posture, and movement of the broadcaster by, for example, a depth camera, a body position sensor, or a position sensor using an infrared camera and a reflective marker. The sensor signal obtained by the sensor 43 is supplied to the broadcasting server 41.

[0438] FIG. 27 is a diagram illustrating the multi-view camera 42 and the sensor 43. As shown in FIG.

[0439] 27, a broadcaster T1 broadcasts his / her own content such as singing and dancing to a large number of viewers using a virtual system. The broadcaster T1 performs singing and dancing in a green screen recording studio or the like.

[0440] The multi-viewpoint camera 42 has a plurality of photographing cameras Cam1, Cam2, ..., CamN (N is a positive integer). Hereinafter, the plurality of photographing cameras Cam1, Cam2, ..., CamN will each be abbreviated as photographing camera Cam.

[0441] The cameras Cam of the multi-view camera 42 are arranged so as to surround the periphery of the distributor T1, and photograph the distributor T1 from multiple directions.

[0442] The depth camera DC captures a depth image of the broadcaster T1.

[0443] The infrared camera IRCam shines infrared light onto a reflective marker IRM worn on the body of broadcaster T1 and captures the reflected light.

[0444] The body position sensors BPSR and BPSL are attached to the right and left wrists of the streamer T1 to detect the position of the right and left wrists of the streamer T1. The body position sensors are attached to the body parts other than the wrists, such as the torso, ankles, and knees, which are necessary for detecting the position, posture, and movement of the streamer T1.

[0445] FIG. 28 shows how a broadcaster is being filmed in a studio.

[0446] In FIG. 28, broadcaster T1 performs in a space covered with green cloth and walls. Multiple pillars 141A, 141B, ... (hereinafter abbreviated as pillars 141) are installed around the broadcaster T1 at approximately equal intervals all around. Each pillar 141 is equipped with one camera Cam of the multi-view camera 42, one above and one below. Each pillar 141 is also equipped with an infrared camera IRCam that captures the infrared reflection of a reflective marker IRM attached to the body of broadcaster T1, and multiple lights 142 that irradiate broadcaster T1 with illumination light including visible light and infrared light. Tripods 143 are placed between the pillars 141 as needed, and support a depth camera DC, a stereo camera (not shown), and the like. Body position sensors BPSR and BPSL are attached to both wrists of broadcaster T1.

[0447] Note that the depth camera DC, infrared camera IRCam (reflective marker IRM), and body position sensors BPSR and BPSL included in the sensor 43 in FIG. 26 may be any one type, or the sensor 43 itself may not be present.

[0448] In Figure 26, the distribution server 41 has a camera video input unit 121, a camera image data generation unit 122, a streaming processing unit 123, a sensing input unit 124, a body position information generation unit 125, a 3D model position information generation unit 126, a content data generation unit 127, and a network transmission unit 128.

[0449] The camera image input unit 121 acquires images of the distributor T1, etc. captured by each camera Cam of the multi-viewpoint camera 42, and audio collected by a microphone (not shown). The camera image input unit 121 converts the acquired images and audio into an editable signal format and supplies them to the camera image data generation unit 122.

[0450] The camera image data generation unit 122 performs necessary processing such as removing unnecessary object images from the multi-viewpoint images from the camera image input unit 121. The camera image data generation unit 122 also performs necessary processing such as removing noise from the audio from the camera image input unit 121. The camera image data generation unit 122 supplies the processed multi-viewpoint images and audio to the streaming processing unit 123.

[0451] The streaming processing unit 123 encodes the multi-viewpoint video and audio from the camera image data generation unit 122 and supplies the encoded video and audio to the content data generation unit 127 as video stream data and audio stream data.

[0452] The sensing input unit 124 acquires a sensor signal from the sensor 43 and supplies it to the body position information generation unit 125 .

[0453] The body position information generation unit 125 analyzes the sensor signal from the sensing input unit 124 and generates so-called bone data that represents the movement of the skeletal structure of the broadcaster T1. The body position information generation unit 125 supplies the generated bone data to the 3D model position information generation unit 126.

[0454] The 3D model position information generation unit 126 generates 6DoF (six degrees of freedom) data (6DoF data) that serves as position information of each part such as the head, hands, and feet when creating a 3D model of the distributor T1, based on the bone data from the body position information generation unit 125. The 3D model position information generation unit 126 supplies the generated 6DoF data to the content data generation unit 127.

[0455] The content data generation unit 127 integrates the video stream data and audio data stream from the streaming processing unit 123 and the 6DoF data from the 3D model position information generation unit 126 as content data (distribution data) to be distributed to the client system 22 in Figure 1, and supplies it to the network transmission unit 128.

[0456] 1, and transmits content data from the content data generation unit 127 to the information processing device 61 of the client system 22. In addition to the content data shown here, the content data distributed from the distribution server 41 to the information processing device 61 includes the venue layout data described above, and such data is also distributed.

[0457] <Client System 22> FIG. 29 is a block diagram illustrating a functional configuration related to content reception and the like of the client system 22 in FIG.

[0458] FIG. 29 illustrates an example of the functional configuration of each of the information processing device 61, the HMD 62, and the hand controller 63 of the client system 22 in FIG.

[0459] The information processing device 61 has a network transmission input unit 151, a content input data analysis unit 152, a distributor video processing unit 153, a timing synchronization unit 154, a 3D object control unit 155, a other viewer input data analysis unit 156, a timing synchronization unit 157, a 3D object collision detection unit 158, a timing synchronization unit 159, a user output data generation unit 160, and a network transmission output unit 161.

[0460] 1. The network transmission input unit 151 also controls communication with the distribution server 41 of the server system 21 via the network 23. The network transmission input unit 151 also controls communication with information processing devices 61 of other client systems 22 (referred to as other information processing devices 61). The network transmission input unit 151 supplies content data transmitted from the distribution server 41 to the content input data analysis unit 152. The network transmission input unit 151 also supplies data (audio stream data and metadata) transmitted from the other information processing devices 61 to the other viewer input data analysis unit 156.

[0461] The content input data analysis unit 152 analyzes the content data from the network transmission input unit 151 and separates the video stream data, audio stream data, and metadata distributed from the distribution server 41. The content input data analysis unit 152 supplies the separated video stream to the distributor video processing unit 153. The content input data analysis unit 152 also supplies the separated audio stream data and metadata to the distributor video processing unit 153.

[0462] The distributor video processing unit 153 decodes the video stream data from the content input data analysis unit 152, and performs the necessary video processing, frame reduction, format conversion, etc. to generate a free viewpoint video from the multi-viewpoint video acquired as a free viewpoint from the multi-viewpoint video. The distributor video processing unit 153 supplies the processed video data to the timing synchronization unit 154.

[0463] The timing synchronization unit 154 reduces the time difference between the video data from the distributor video processing unit 153, the audio stream data from the content input data analysis unit 152, and the distributor metadata, and synchronizes them. The timing synchronization unit 154 supplies the video data and metadata to the 3D object control unit 155.

[0464] The timing synchronization unit 154 also supplies the audio stream data to the headphone output unit 181 of the HMD 62. The timing synchronization unit 154 also supplies the video data and metadata to the 3D object control unit 155.

[0465] The 3D object control unit 155 controls the 3D objects in the virtual space to be displayed on the VR space display unit 182 of the HMD 62 based on the video data, metadata, etc. from the timing synchronization unit 154.

[0466] The other viewer input data analysis unit 156 analyzes data from the other information processing devices 61 via the network transmission input unit 151 and separates it into audio stream data and metadata. The other viewer input data analysis unit 156 supplies the separated audio stream data and metadata to the timing synchronization unit 157. The audio stream data from the other information processing devices 61 mainly includes audio stream data of the other viewer with whom the experiencer is engaged in voice chat. The metadata from the other information processing devices 61 includes 6DoF data of the other viewer's body (head, hands) and text data entered by the other viewer with whom the experiencer is engaged in voice chat.

[0467] The timing synchronization unit 157 synchronizes the audio stream data and metadata from the other viewer input data analysis unit 156 by reducing the time difference between them. The timing synchronization unit 157 supplies the synchronized audio stream data to the headphone output unit 181 of the HMD 62, and supplies the synchronized metadata to the 3D object control unit 155.

[0468] The 3D object collision detection unit 158 ​​causes the vibration generation unit 202 of the hand controller 63 to generate vibrations in response to an instruction from the 3D object control unit 155 .

[0469] The timing synchronization unit 159 reduces the time lag between 6DoF data (metadata) indicating the position, posture, and movement of the head from the HMD spatial information detection unit 184 (motion sensor) and audio stream data from the microphone input unit 183 (microphone) of the HMD 62, and synchronizes them. The timing synchronization unit 159 supplies the synchronized audio stream data and metadata to the user output data generation unit 160.

[0470] The user output data generation unit 160 integrates the audio stream data and metadata from the timing synchronization unit 159 to generate data for transmission, and supplies this to the network transmission output unit 161 .

[0471] The network transmission output unit 161 controls communication with the distribution server 41 of the server system 21 and the information processing devices 61 of other client systems 22. The network transmission output unit 161 supplies data from the experiencer output data generation unit 160 to the distribution server 41 or other information processing devices 61 via the network 23.

[0472] The HMD 62 includes a headphone output unit 181, a VR space display unit 182, a microphone input unit 183, and an HMD space information detection unit 184.

[0473] The headphone output unit 181 outputs the audio stream data from the timing synchronization unit 154 as audio from the headphones. As a result, the audio of the content distributed from the distribution server 41 is output from the headphones of the HMD 62.

[0474] Furthermore, the headphone output unit 181 outputs the audio stream data supplied from the timing synchronization unit 157 as audio from the headphones, thereby outputting audio such as voice chat audio supplied from the other information processing device 61 from the headphones.

[0475] The microphone input unit 183 picks up the voice of the user wearing the HMD 62 and supplies it as audio stream data to the timing synchronization unit 159. As a result, the voice of the user is supplied to the information processing device 61 of the other party in the voice chat.

[0476] The HMD space information detection unit 184 detects the position, posture, and movement of the HMD 62 using, for example, a motion sensor, and supplies the detected data as 6DoF data (metadata) to the 3D object control unit 155 and timing synchronization unit 159. The position, posture, and movement of the HMD 62 indicate the position, posture, and movement of the user's head. The 3D object control unit 155 detects the line of sight (front direction) of the HMD 62, etc., from the 6DoF data from the HMD space information detection unit 184. The 6DoF data supplied from the HMD space information detection unit 184 to the timing synchronization unit 159 is also supplied to another information processing device 61, and is reflected in the movement of the user's avatar, which is viewed by other viewers.

[0477] The hand controller 63 includes a hand spatial information detection unit 201 and a vibration generation unit 202 .

[0478] The hand spatial information detection unit 201 detects the position, posture, and movement of the hand controller 63 using, for example, a motion sensor, and supplies the detected data as 6DoF data (metadata) to the 3D object control unit 155 and the HMD spatial information detection unit 184. The position, posture, and movement of the hand controller 63 indicate the position, posture, and movement of the user's hands (both hands) holding the hand controller 63. The 3D object control unit 155 detects the user's operation using the 6DoF data from the hand spatial information detection unit 201, and reflects this data in the movement of the user's avatar, etc. in the virtual space. The 6DoF data supplied from the hand spatial information detection unit 201 to the HMD spatial information detection unit 184 is also supplied to another information processing device 61 via the timing synchronization unit 159, and is reflected in the movement of the user's avatar, etc., which are viewed by other viewers.

[0479] The vibration generation unit 202 vibrates the hand controller 63 in response to an instruction from the 3D object collision detection unit 158. When the user collides with an object in the virtual space, an instruction to generate vibration is given from the 3D object control unit 155 to the vibration generation unit 202 via the 3D object collision detection unit 158.

[0480] <3D object control section 155> The 3D object control unit 155 (display control unit) creates 3D models of various objects in the virtual space that constructs the event venue based on the distribution data (content data) from the distribution server 41, and generates an image in which the various objects in the virtual space are rendered from a predetermined viewpoint in a predetermined line of sight direction. The creation and rendering of various objects are repeatedly executed at a predetermined cycle.

[0481] The viewpoint during rendering is the viewing position from which the user using the HMD 62 views the content of the distributor, and the line of sight during rendering is the line of sight of the HMD 62. The 3D object control unit 155 supplies the video generated by rendering to the VR space display unit 182 of the HMD 62 for display.

[0482] The 3D object control unit 155 performs rendering of the virtual space, using the direction in the virtual space corresponding to the front direction of the HMD 62 in real space as the line of sight during rendering, based on the position, posture, and movement of the HMD 62 detected by the HMD space information detection unit 184. The 3D object control unit 155 also generates an image of the field of view displayable on the VR space display unit 182 (hereinafter referred to as the field of view of the HMD 62) by rendering the virtual space.

[0483] The 3D object control unit 155 obtains object data indicating the shape, texture, position, etc. of fixed objects such as a stage at an event venue to be placed in the virtual space from metadata from the distribution server 41, and creates a 3D model in the virtual space. The 3D object control unit 155 also maps the texture onto the 3D model during rendering.

[0484] Furthermore, the 3D object control unit 155 acquires the viewing positions of viewers participating in the event in the virtual space from metadata (venue layout data) from the distribution server 41, and places avatars at the viewing positions of each viewer. Note that the venue layout can also be set by the 3D object control unit 155 instead of the distribution server 41 by acquiring information about viewers participating in the event and information about members of a peer group, and therefore in this embodiment, it is assumed that the venue layout is set by the 3D object control unit 155.

[0485] The 3D object control unit 155 acquires object data (avatar data) indicating the shape, texture, position, posture, and movement of the avatar from metadata from the information processing device 61 of the viewer who is the avatar himself.

[0486] That is, the 3D object control unit 155 acquires avatar data indicating the basic shape and texture of the viewer's avatar, and 6DoF data indicating the viewer's position, posture, and movement (position, posture, and movement of the head and hands) from another information processing device 61.

[0487] The 3D object control unit 155 creates a 3D model of each viewer's avatar in the virtual space using the metadata (venue layout data) from the distribution server 41 and the metadata (avatar data and 6DoF data) from each information processing device 61, and maps textures onto the 3D model during rendering. As a result, each viewer's avatar, which moves in accordance with the viewer's live-action movements, is placed in the virtual space.

[0488] Furthermore, the 3D object control unit 155 determines the distribution position of the distributor who distributes the content to a predetermined position such as the center of the stage, and places a live-action avatar (for example, a volumetric image) of the distributor at the distribution position.

[0489] The 3D object control unit 155 acquires the distributed multi-view video using the video stream data (video data from the timing synchronization unit 154) from the distribution server 41, and generates 3D shape data and texture of the distributor from the multi-view video. The 3D object control unit 155 then creates a 3D model of the distributor at the distribution position in the virtual space using the distributor's 3D shape data, and maps the texture generated from the live-action video onto the distributor's 3D model during rendering. This generates a video in which the distributor's live-action avatar is placed at the distributor's distribution position.

[0490] <First form of object control> A first mode of object control executed by the 3D object control unit 155 will be described.

[0491] The 3D object control unit 155 can adopt any of the first to ninth setting forms of venue layout described above when setting the broadcaster's broadcast position and the viewer's viewing position at the event venue in the virtual space.

[0492] In the first form of object control, a case where the second setting form of the venue arrangement described in Figures 6 to 10 is adopted will be described. Also, the relative positional relationship between the viewing position of the participant and the distribution position of the distributor is set so that the distance between the viewing position of the participant and the distribution position of the distributor is the shortest distance.

[0493] 30 is a diagram showing the state of an event venue in a virtual space when the distributor is in a standby state before starting distribution of content (before the live performance). The event venue is filled with avatars of many viewers U participating in the event, and viewers G1-U1 on the left and right in the center are participants V, who are viewers watching the video generated by the 3D object control unit 155.

[0494] Viewer G1-U1, who is participant V, belongs to friend group G1, and avatars of viewers G1-U2 to G1-U6, who are members of friend group G1, are placed around the avatar of viewer G1-U1. Note that descriptions of the positions of the avatars of the broadcaster and viewers (including participants) and the distance between the avatars can be considered descriptions of the broadcaster's broadcasting position and the viewer's viewing position.

[0495] Also, a circle 221 of a predetermined radius is drawn with the viewing position of the experiencer V at its center. Note that the circle 221 is for illustrative purposes only and is not actually drawn. The avatars (viewing positions) of viewers G1-U2 to G1-U6 and viewer Ui, who are positioned within the range inside the circle 221, are considered to be close to the avatar (viewing position) of the experiencer V. In other words, if the distance from the viewing position of the experiencer V is equal to or less than a predetermined threshold, they are considered to be close to the avatar of the experiencer V.

[0496] On the other hand, the avatar of viewer Uo located outside the circle 221 is considered not to be close to the avatar of experiencer V. In other words, if the distance from the experiencer's viewing position is greater than a predetermined threshold, it is considered not to be close to the avatar of experiencer V.

[0497] The avatars of the viewers G1-U2 to G1-U6 and the viewer Ui who are close to the avatar of the experiencer V are set to be avatars that can perform realistic movements. A realistic movement means an avatar that performs a movement corresponding to the movement of the viewer.

[0498] On the other hand, the avatar of the viewer Uo who is not close to the avatar of the experiencer V does not move in a live-action manner, but is generated as a simplified mob avatar or a shadow.

[0499] According to this, the avatars of viewers Uo who are not close to the avatar (viewing position) of the experiencer V are drawn as simplified mob avatars or shadows that do not move in a realistic manner, thereby reducing the drawing data for drawing the avatars and reducing the processing load (drawing load, etc.) of modeling, rendering, etc. in the 3D object control unit 155.

[0500] Note that the 3D object control unit 155 is configured to change the viewer avatar to be drawn between a first form, which imposes a heavy processing load, and a second form, which imposes a lighter processing load than the first form, depending on the distance from the viewing position of the experiencer V. However, this is not limited to this. For example, the appearance of the avatar may remain unchanged, with the first form being an avatar that moves in a realistic manner, and the second form being an avatar that does not move in a realistic manner. Furthermore, the condition for changing the form of the avatar between the first form and the second form may be the number of avatars to be drawn in the first form, which depends on the processing load of communication and drawing in the information processing device 61. For example, the 3D object control unit 155 may change the form of the avatars closest to the viewing position of the experiencer V to the first form, and when the number of drawn avatars in the first form exceeds a predetermined threshold, change the form of the remaining avatars to the second form.

[0501] Furthermore, the form of the avatar may be changed among three or more forms with different processing loads. For example, an avatar whose distance from the viewing position of the experiencer V is equal to or less than a predetermined first threshold is a high-definition avatar that can move in a realistic manner. An avatar whose distance from the viewing position of the experiencer V is greater than the first threshold and equal to or less than a predetermined second threshold (> first threshold) is a high-definition avatar that cannot move in a realistic manner. An avatar whose distance from the viewing position of the experiencer V is greater than the second threshold may be a simplified avatar that cannot move in a realistic manner.

[0502] Furthermore, even if an avatar is close to the avatar of the participant V, an avatar that is located outside the field of view of the participant V, i.e., the central field of view of the HMD 62 worn by the participant V (the rendering range for the virtual space), may be a simplified avatar that does not move in a realistic manner.

[0503] Figure 31 shows the state of an event venue in a virtual space when content is being distributed by distributor T1 (live). Note that parts in the figure that are common to Figure 30 are given the same reference numerals and their explanations will be omitted.

[0504] 31, a live-action avatar of distributor T1 is placed in front of the avatar of viewer G1-U1, who is participant V. That is, the avatar of participant V is placed in the closest position to the live-action avatar of distributor T1 on the front side. Therefore, the avatar of participant V can view the content in the optimal viewing environment.

[0505] Furthermore, since all viewers are equivalent to the experiencers V when viewing content on their own HMDs 62, all viewers can view content in the optimal viewing environment.

[0506] <Processing Procedure> FIG. 32 is a flowchart showing the processing procedure of the first mode of object control by the 3D object control unit 155.

[0507] In step S11, the 3D object control unit 155 determines the placement of the experiencer among the members of the peer group to which the experiencer belongs. The process proceeds from step S11 to step S12.

[0508] In step S12, the 3D object control unit 155 determines the placement of the friend group within the event venue. The process proceeds from step S12 to step S13.

[0509] In step S13, the 3D object control unit 155 places the avatars of viewers who are not members of the peer group at positions outside the peer group. The process proceeds from step S13 to step S14.

[0510] In step S14, the 3D object control unit 155 starts searching for all viewers (avatars) other than the experiencer. The process proceeds from step S14 to step S15.

[0511] In step S15, the 3D object control unit 155 determines whether the searched avatar is close to the user and within the user's central visual field.

[0512] If it is determined in step S15 that the retrieved avatar is close to the user and within the user's central visual field, the process proceeds to step S16, where the 3D object control unit 155 sets the retrieved avatar as an avatar that can move realistically. The process proceeds from step S16 to step S18.

[0513] If it is determined in step S15 that the searched avatar is neither close to nor within the central visual field of the user, the process proceeds to step S17, where the 3D object control unit 155 sets the searched avatar as a shadow or mob avatar. The process proceeds from step S17 to step S18.

[0514] In step S18, the 3D object control unit 155 determines whether or not the search for all avatars other than the experiencer has been completed.

[0515] If it is determined in step S18 that the search for all avatars other than the experiencer has not been completed, the process returns from step S18 to step S15, and the process from step S15 is repeated.

[0516] If it is determined in step S18 that the search for all avatars other than the experiencer has been completed, the process proceeds from step S18 to step S19.

[0517] In step S19, the 3D object control unit 155 executes processing for scene transition to “Before Live Performance.” The processing proceeds from step S19 to step S20.

[0518] In step S20, the 3D object control unit 155 determines whether the scene start condition for "during live performance" is met. For example, it determines whether a certain amount of time has passed in the "before live performance" state, or whether it is time for the live performance to start.

[0519] If it is determined in step S20 that the scene start condition "during live performance" is not met, the process repeats step S20.

[0520] If it is determined in step S20 that the scene start condition "live performance" is met, the process proceeds from step S20 to step S21.

[0521] In step S21, the 3D object control unit 155 executes processing for scene transition to “live.” The processing proceeds from step S21 to step S22.

[0522] In step S22, the 3D object control unit 155 determines whether the scene start condition for "after live performance" is met. For example, it determines whether a certain amount of time has passed in the "during live performance" state, or whether it is time for the live performance to end.

[0523] If it is determined in step S22 that the "after live performance" scene start condition is not met, the process repeats step S22.

[0524] If it is determined in step S22 that the "after live performance" scene start condition is met, the process proceeds from step S22 to step S23.

[0525] In step S23, the 3D object control unit 155 executes processing for scene transition to "after live performance."

[0526] During the processing of steps S19 to S23 above, the 3D object control unit 155 inherits the positional relationship between the avatars of the experiencer and the viewer so that it does not become discontinuous due to scene changes, etc. For example, the 3D object control unit 155 stores the initial position and current position of each viewer close to the experiencer or each viewer in a peer group as list data, and inherits the positional relationship of the viewers by referring to the list data every time the scene changes.

[0527] According to the first form of object control described above, even when a large number of viewers simultaneously view content distributed by a distributor in the same space, each viewer can view the content distributed by the distributor from their own optimal viewing position.

[0528] Furthermore, since only the avatars of the viewers who are close to the experiencer are displayed in a realistic manner, the processing load on the information processing device 61 (such as the load of drawing the avatars) is reduced.

[0529] Furthermore, by adopting the second setting form of the venue layout described in Figures 6 to 10, when a peer group is set up, the viewers who are considered to be peers are placed near the participant. Therefore, while participating in the event, the participant can easily know how their peers are doing as if they were actually meeting them. Furthermore, if voice chat or text chat is enabled in the peer group, or if the viewers or groups who are chatting are set up as peer groups, they can easily chat even while participating in the event.

[0530] Furthermore, regardless of whether the viewer is a viewer belonging to a peer group, the viewing positions are the same for all members of the peer group (among the members). Therefore, for example, viewers belonging to the same peer group will not recognize each other as being on their right side. For example, when chatting, they will not end up facing opposite directions when they intended to face each other.

[0531] <Second form of object control> Next, a second mode of object control executed by the 3D object control unit 155 will be described.

[0532] In the second form of object control, a case where the fifth setting form of the venue arrangement described in Figures 15 and 16 is adopted will be described. In addition, the relative positional relationship between the viewing position of the participant and the distribution position of the distributor is set so that the distance between the viewing position of the participant and the distribution position of the distributor is the shortest distance.

[0533] FIG. 33 is a diagram showing the state of an event venue in a virtual space when a distributor is distributing content (live).

[0534] In Figure 33, avatars of many viewers U participating in the event are placed at the event venue, with the avatar (viewing position) of viewer U1, who is the participant V, placed in the center left and right. Also, a live-action avatar of broadcaster T1 is placed in front of the avatar (viewing position) of participant V, and the avatar (viewing position) of participant V is placed in the closest position to the live-action avatar of broadcaster T1 in front of it.

[0535] Avatars of arbitrary viewers U2 to U8 are placed within a range (a range of a predetermined distance or less) of the avatar of viewer U1, who is the experiencer V. The avatars of viewers U1 to U8 are set to be avatars that can move in a realistic manner.

[0536] In addition, an avatar of an arbitrary viewer Uo is placed at a viewing position other than viewers U1 to U8. The avatar of viewer Uo does not move in a live-action manner, but is set as a simplified mob avatar or a shadow. Note that the form of the viewer's avatar and the conditions for changing the form are the same as in the first form of object control, so explanations will be omitted.

[0537] Figure 34 is a diagram showing the state of an event venue in a virtual space when a distributor is distributing content (live), and shows a case where the viewing position of the participant is different from that in Figure 33.

[0538] In Figure 34, the avatars of many viewers U participating in the event are arranged at the event venue, with the avatar of viewer U1, who is the participant V, placed on the left side of the event. Also, a live-action avatar of broadcaster T1 is placed in front of the avatar of participant V, and the avatar of participant V is placed closest to and in front of the live-action avatar of broadcaster T1.

[0539] Avatars of arbitrary viewers U2 to U8 are placed within a range (a range of a predetermined distance or less) of the avatar of viewer U1, who is the experiencer V. The avatars of viewers U1 to U8 are set to be avatars that can move in a realistic manner.

[0540] In addition, an avatar of an arbitrary viewer Uo is placed at a viewing position other than the viewers U1 to U8. The avatar of the viewer Uo does not move in a live-action manner, but is set as a simplified mob avatar or a shadow.

[0541] Figure 35 is a diagram showing the state of an event venue in a virtual space when a distributor is distributing content (during a live broadcast), and shows a case where the viewing position of the participant is different from that of Figures 33 and 34.

[0542] In Figure 35, the avatars of many viewers U participating in the event are placed at the event venue, and the avatar of viewer U1, who is the participant V, is placed on the right side of the whole. In addition, a live-action avatar of broadcaster T1 is placed in front of the avatar of participant V, and the avatar of participant V is placed in the closest position to the live-action avatar of broadcaster T1 in front of it.

[0543] Avatars of arbitrary viewers U2 to U8 are placed within a range (a range of a predetermined distance or less) of the avatar of viewer U1, who is the experiencer V. The avatars of viewers U1 to U8 are set to be avatars that can move in a realistic manner.

[0544] In addition, an avatar of an arbitrary viewer Uo is placed at a viewing position other than the viewers U1 to U8. The avatars of viewers U1 to U8 are set as avatars that can move in a realistic manner. The avatar of viewer Uo does not move in a realistic manner and is set as a simplified mob avatar or a shadow.

[0545] According to the second form of object control described above, no matter where the avatar of participant V is placed in the venue, participant V's avatar will be placed in the closest position to the front of the streamer's live-action avatar (since the streamer's live-action avatar is placed in the closest position to the front of participant V's avatar), so participant V can always watch the content in the optimal viewing environment.

[0546] Furthermore, since avatars other than those around the user V are set to simplified avatars or avatars that do not move in a realistic manner, the processing load of the 3D object control unit 155, such as modeling and rendering, is reduced.

[0547] In Figures 33 to 35, all viewers will be viewing the live-action avatar of broadcaster T1 as experiencer V from the front, and other viewers may feel uncomfortable because they are not facing the direction of the live-action avatar of broadcaster T1.

[0548] FIG. 36 is a diagram showing a modification of the avatar arrangements shown in FIGS.

[0549] In FIG. 36, the orientations of the avatars of all viewers U1 to U8 and viewer Uo are corrected so that they face forward toward the live-action avatar of streamer T1. This reduces the sense of discomfort that viewers may have when not facing the streamer T1. Note that only the orientations of avatars within a predetermined distance range from the viewing position of participant V may be corrected so that they face forward toward the live-action avatar of streamer T1. Furthermore, the correction of the viewer avatars to face the live-action avatar of streamer T1 can be applied regardless of whether the venue arrangement setting is any of the first to ninth setting types described above.

[0550] <Processing Procedure> FIG. 37 is a flowchart showing the processing procedure of the second mode of object control by the 3D object control unit 155.

[0551] In step S41, the 3D object control unit 155 determines the venue layout of the experiencer and all other viewers. The process proceeds from step S41 to step S42.

[0552] In step S42, the 3D object control unit 155 places the stage position of the distributor in front of the experiencer. The process proceeds from step S42 to step S43.

[0553] In step S43, the 3D object control unit 155 starts searching for all viewers (avatars) other than the experiencer. The process proceeds from step S43 to step S44.

[0554] In step S44, the 3D object control unit 155 determines whether the searched avatar is close to the user and within the user's central visual field.

[0555] If it is determined in step S44 that the retrieved avatar is close to the user and within the user's central visual field, the process proceeds to step S45, where the 3D object control unit 155 sets the retrieved avatar as an avatar that can move realistically. The process proceeds from step S45 to step S47.

[0556] If it is determined in step S44 that the searched avatar is neither close to nor within the central visual field of the user, the process proceeds to step S46, where the 3D object control unit 155 sets the searched avatar as a shadow or mob avatar. The process proceeds from step S46 to step S47.

[0557] In step S47, the 3D object control unit 155 determines whether or not the search for all avatars other than the experiencer has been completed.

[0558] If it is determined in step S47 that the search for all avatars other than the experiencer has not been completed, the process returns from step S47 to step S44, and the process from step S44 is repeated.

[0559] If it is determined in step S47 that the search for all avatars other than the experiencer has been completed, the process proceeds from step S47 to step S48.

[0560] In step S48, the 3D object control unit 155 adjusts the angles of the avatars around the user so that they face the broadcaster (see FIG. 36). The process proceeds from step S48 to step S49.

[0561] In step S49, the 3D object control unit 155 executes processing for scene transition to “Before the live performance.” The processing proceeds from step S49 to step S50.

[0562] In step S50, the 3D object control unit 155 determines whether the scene start condition for "during live performance" is met. For example, it determines whether a certain amount of time has passed in the "before live performance" state, or whether it is time for the live performance to start.

[0563] If it is determined in step S50 that the scene start condition "during live performance" is not met, the process repeats step S50.

[0564] If it is determined in step S50 that the scene start condition "during live performance" is met, the process proceeds from step S50 to step S51.

[0565] In step S51, the 3D object control unit 155 executes processing for scene transition to “live.” The processing proceeds from step S51 to step S52.

[0566] In step S52, the 3D object control unit 155 determines whether the scene start condition for "after live performance" is met. For example, it determines whether a certain amount of time has passed in the "during live performance" state, or whether it is time for the live performance to end.

[0567] If it is determined in step S52 that the "after live performance" scene start condition is not met, the process repeats step S52.

[0568] If it is determined in step S52 that the "after live performance" scene start condition is met, the process proceeds from step S52 to step S53.

[0569] In step S53, the 3D object control unit 155 executes processing for scene transition to "after live performance."

[0570] During the processing of steps S49 to S53 above, the 3D object control unit 155 inherits the positional relationship between the avatars of the experiencer and the viewer so that it does not become discontinuous due to scene changes, etc. For example, the 3D object control unit 155 stores the initial position and current position of each viewer close to the experiencer or each viewer in a peer group as list data, and inherits the positional relationship of the viewers by referring to the list data each time the scene changes.

[0571] According to the second form of object control described above, even when a large number of viewers simultaneously view content distributed by a distributor in the same space, each viewer can view the content distributed by the distributor from their own optimal viewing position.

[0572] Furthermore, since only the avatars of the viewers who are close to the experiencer are displayed in a realistic manner, the processing load on the information processing device 61 (such as the load of drawing the avatars) is reduced.

[0573] In addition, the posture of the avatars around the participant is corrected so that they face forward toward the broadcaster, improving the sense of realism.

[0574] This technology is not limited to application in virtual reality, but can also be used to hold various events by fusing the 3D images of virtual broadcasters and viewer avatars into the 3D space of the real world (real space). This technology can also be applied to augmented reality, mixed reality, alternative reality, etc.

[0575] In addition to mass-connected live music events, this technology can also be applied to the distribution of entertainment content such as live sports and variety shows, as well as for purposes such as distance education and lessons and remote work support. Furthermore, because this technology can be used to achieve verbal and non-verbal communication with people participating in an event at the same time, as if they were meeting in person, it can be applied to remote communication services, promoting the business use of remote communication services.

[0576] <Program> The series of processes in the distribution server 41, information processing device 61, etc. described above can be executed by hardware or software. When the series of processes are executed by software, the programs constituting the software are installed on a computer. Here, the computer includes a computer built into dedicated hardware, and a general-purpose personal computer, for example, that can execute various functions by installing various programs.

[0577] FIG. 38 is a block diagram showing an example of the hardware configuration of a computer that executes the above-described series of processes by a program.

[0578] In the computer, a CPU (Central Processing Unit) 401, a ROM (Read Only Memory) 402, and a RAM (Random Access Memory) 403 are interconnected by a bus 404.

[0579] An input / output interface 405 is further connected to the bus 404. An input unit 406, an output unit 407, a storage unit 408, a communication unit 409, and a drive 410 are connected to the input / output interface 405.

[0580] The input unit 406 includes a keyboard, a mouse, a microphone, etc. The output unit 407 includes a display, a speaker, etc. The storage unit 408 includes a hard disk, a non-volatile memory, etc. The communication unit 409 includes a network interface, etc. The drive 410 drives removable media 411 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory.

[0581] In a computer configured as described above, the CPU 401 performs the above-described series of processes by, for example, loading a program stored in the storage unit 408 into the RAM 403 via the input / output interface 405 and the bus 404 and executing it.

[0582] The program executed by the computer (CPU 401) can be provided by being recorded on removable media 411 such as package media, for example. The program can also be provided via wired or wireless transmission media such as a local area network, the Internet, or digital satellite broadcasting.

[0583] In a computer, the program can be installed in the storage unit 408 via the input / output interface 405 by inserting the removable medium 411 into the drive 410. The program can also be received by the communication unit 409 via a wired or wireless transmission medium and installed in the storage unit 408. Alternatively, the program can be installed in the ROM 402 or the storage unit 408 in advance.

[0584] The program executed by the computer may be a program that processes in chronological order according to the order described in this specification, or may be a program that processes in parallel or at the required timing, such as when called.

[0585] The present technology can also be configured as follows. (1) a processing unit that sets the viewing position of at least one viewer among a plurality of viewers who view content distributed from a distributor virtually located at a predetermined distribution position in a virtual space or a real space, so that a relative positional relationship between the viewing position where the viewer views the content as an experiencer and the distribution position is determined for the viewer; An information processing device having the above. (2) The processing unit When each of the plurality of viewers viewing the content is considered to be a viewer, the viewing position and the distribution position of the viewer are set. The information processing device according to (1) above. (3) The plurality of viewers are viewers who simultaneously view the content. The information processing device according to (1) or (2). (4) The processing unit The positional relationship determined for the experiencer is a positional relationship designated by the experiencer, or a relative positional relationship determined in advance as an optimal viewing position that provides the experiencer with an optimal viewing environment relative to the distribution location. The information processing device according to any one of (1) to (3). (5) The optimal viewing position is the viewing position that is the shortest distance from the distribution position among the viewing positions that can be set by the user. The information processing device according to (4) above. (6) The processing unit Setting the viewing positions of the viewers other than the experiencer as recognized by the experiencer The information processing device according to any one of (1) to (5). (7) The processing unit A group consisting of a plurality of the viewers is set in advance, and when a group to which the experiencer belongs is set as a focus group, the experiencer sets the viewing positions of the viewers belonging to the focus group so that the relative positional relationship of the viewing positions of the viewers belonging to the focus group is the same regardless of which of the viewers belongs to the focus group. The information processing device according to (6) above. (8) The processing unit When the relative positional relationship between the position of the attention group as a whole and the distribution position is a relative position determined for the attention group, the relative positional relationship between the viewing position of the experiencer and the distribution position is set to a positional relationship determined for the experiencer. The information processing device according to (7) above. (9) The processing unit The viewing positions of the viewers belonging to the group of interest are set to positions adjacent to any of the viewing positions of the viewers. The information processing device according to (7) or (8). (10) The processing unit The viewer sets up a group of friends to talk to. The information processing device according to any one of (7) to (9). (11) The viewing positions of the viewers other than the experiencer are positions in the virtual space or the real space viewed by the experiencer, where an avatar representing the viewer is displayed. The information processing device according to any one of (6) to (10). (12) The avatar is positioned facing the direction of the distribution location. The information processing device according to (11) above. (13) The viewing position of the viewer other than the experiencer is a position where the alter ego that moves in response to the live-action movement of the viewer is displayed when the distance from the viewing position of the experiencer is equal to or less than a predetermined threshold, and is a position where the alter ego that does not correspond to the live-action movement of the viewer is displayed when the distance from the viewing position of the experiencer is greater than the threshold. The information processing device according to (11) or (12). (14) A display control unit that generates an image of the alter ego Further having The information processing device according to any one of (11) to (13). (15) The distribution position is a position where a live-action video of the distributor is displayed. The information processing device according to any one of (1) to (14). (16) The live-action video of the broadcaster is a volumetric video generated from video of the broadcaster taken from multiple viewpoints. The information processing device according to (15) above. (17) The processing unit The distribution position is set to the same position regardless of the viewer who is the experiencer, and the viewing position of the experiencer is set so that the relative positional relationship between the viewing position of the experiencer and the distribution position is a predetermined positional relationship for the experiencer. The information processing device according to any one of (1) to (16). (18) The processing unit The viewing position of each of the viewers who are the experiencers is set to a different position, and the distribution position is set so that the relative positional relationship between the viewing position of each of the experiencers and the distribution position is a positional relationship determined for each of the experiencers. The information processing device according to any one of (1) to (16). (19) Processing section have Information processing device The processing unit In a virtual space or a real space, for at least one viewer among a plurality of viewers who view content distributed from a distributor virtually placed at a predetermined distribution position, the viewing position of the viewer and the distribution position are set so that the relative positional relationship between the viewing position where the viewer views the content as an experiencer and the distribution position is determined for the viewer. Information processing methods. (20) Computer, a processing unit that sets the viewing position of at least one viewer among a plurality of viewers who view content distributed from a distributor virtually located at a predetermined distribution position in a virtual space or a real space, so that a relative positional relationship between the viewing position where the viewer views the content as an experiencer and the distribution position is determined for the viewer; A program to function as a [Explanation of symbols]

[0586] 11 Entertainment system, 21 Server system, 22 Client system, 41 Distribution server, 42 Multi-view camera, 61 Information processing device, 62 HMD, 84 Venue layout setting unit, 155 3D object control unit

Claims

1. a processing unit that sets the viewing positions of the experiencer belonging to the group of interest and the distribution position such that a relative positional relationship between the viewing position where the group of interest views the content and a distribution position where the distributor is virtually located is a positional relationship determined for the group of interest, and that sets the viewing positions of the experiencer belonging to the group of interest and the viewers other than the experiencer such that an arrangement of the viewing positions of the experiencer belonging to the group of interest and the viewers other than the experiencer is an arrangement of the members belonging to the group of interest determined for the group of interest within the viewing position of the group of interest; An information processing device having the above.

2. The plurality of viewers are viewers who simultaneously view the content. The information processing device according to claim 1 .

3. The processing unit As the positional relationship determined for the group of interest, a positional relationship designated by the group of interest or a relative positional relationship determined in advance as an optimal viewing position that provides the group of interest with the optimal viewing environment relative to the distribution position is used. The information processing device according to claim 1 .

4. The optimum viewing position is the viewing position that is the shortest distance from the distribution position among the view positions that can be set for the target group. The information processing device according to claim 3 .

5. The processing unit For each of the experiencers, a viewing position of the viewers who do not belong to the attention group is set among the plurality of viewers. The information processing device according to claim 1 .

6. The viewing positions of the viewers other than the experiencer are positions in the virtual space or the real space viewed by the experiencer, where an avatar representing the viewer is displayed. The information processing device according to claim 5 .

7. The avatar is positioned facing the direction of the distribution location. The information processing device according to claim 6 .

8. The viewing position of the viewer other than the experiencer is a position where the alter ego that moves in response to the live-action movement of the viewer is displayed when the distance from the viewing position of the experiencer is equal to or less than a predetermined threshold, and is a position where the alter ego that does not correspond to the live-action movement of the viewer is displayed when the distance from the viewing position of the experiencer is greater than the threshold. The information processing device according to claim 6 .

9. A display control unit that generates an image of the alter ego Further having The information processing device according to claim 6 .

10. The arrangement of the members belonging to the target group is such that the members are adjacent to each other. The information processing device according to claim 1 .

11. The processing unit: Among the plurality of viewers, a plurality of viewers who converse with each other are set as the members belonging to one of the groups. The information processing device according to claim 1 .

12. The distribution position is a position where the live-action video of the distributor is displayed. The information processing device according to claim 1 .

13. The live-action video of the broadcaster is a volumetric video generated from video of the broadcaster taken from multiple viewpoints. The information processing device according to claim 12.

14. The processing unit The distribution position is set to the same position regardless of the group to be set as the group of interest, and the viewing position of the group of interest is set so that the relative positional relationship between the viewing position of the group of interest and the distribution position is a positional relationship determined for the group of interest. The information processing device according to claim 1 .

15. The processing unit The viewing position of each of the target groups is set to a different position, and the distribution position is set so that the relative positional relationship between the viewing position of each of the target groups and the distribution position is a positional relationship determined for each of the target groups. The information processing device according to claim 1 .

16. Processing section have Information processing device The processing unit A plurality of viewers watch content distributed by a distributor in a virtual space or a real space, and at least a portion of the plurality of viewers are set as members belonging to one of a plurality of groups consisting of a plurality of the viewers. Each of the plurality of viewers is an experiencer. For each experiencer, a group of the plurality of groups to which the experiencer belongs as a member is set as a focus group. The viewing position and the delivery position of the focus group are set so that a relative positional relationship between the viewing position where the focus group watches the content and a delivery position where the distributor is virtually located is a positional relationship determined for the focus group. The viewing positions of the experiencer belonging to the focus group and the viewers other than the experiencer are set so that the arrangement of the viewing positions of the experiencer belonging to the focus group and the viewers other than the experiencer is the arrangement of the members belonging to the focus group determined for the focus group, within the viewing position of the focus group. Information processing methods.

17. Computer, a processing unit that sets the viewing positions of the experiencer belonging to the group of interest and the distribution position such that a relative positional relationship between the viewing position where the group of interest views the content and a distribution position where the distributor is virtually located is a positional relationship determined for the group of interest, and that sets the viewing positions of the experiencer belonging to the group of interest and the viewers other than the experiencer such that an arrangement of the viewing positions of the experiencer belonging to the group of interest and the viewers other than the experiencer is an arrangement of the members belonging to the group of interest determined for the group of interest within the viewing position of the group of interest; A program to function as a

Images