Content distribution apparatus, content distribution program, content distribution method, content display device, content display program, and content display method

Abstract

To display a virtual character (avatar) arranged in a virtual space to be easily viewed.SOLUTION: In a content distribution system, a content distribution server 3 includes: an avatar position acquisition unit which acquires positions of a plurality of virtual characters arranged in a virtual space, the virtual characters corresponding to participants, respectively, in response to actions of the corresponding participants; a trigger detection unit which detects a first trigger; and a display control data distribution unit which generates and distributes display control data for displaying at least a part of the virtual space in which avatars are arranged. The display control data distribution unit generates, until the first trigger is detected, display control data for arranging the virtual characters in the virtual space in accordance with the positions acquired by the virtual character position acquisition unit, and, in response to the first trigger detected, generates and distributes display control data in which a position of a first virtual character arranged in the virtual space is changed, the first virtual character being associated with the first trigger out of the multiple virtual characters.SELECTED DRAWING: Figure 8

Description

[Technical Field]

[0001] The present disclosure relates to a content distribution device, a content distribution program, and a content distribution method for distributing a virtual space in which a virtual character is placed as content, and also to a content display device, a content display program, and a content display method. [Background technology]

[0002] Patent Document 1 discloses a content distribution server that displays a virtual space in which a virtual character is placed on a display. The virtual character is operated by the user, and is usually displayed so that the user's actions are faithfully reflected in the actions of the virtual character. This is because a sense of immersion in the virtual space can be achieved. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 6469279 Summary of the Invention [Problem to be solved by the invention]

[0004] However, since the size of the display is limited, if an attempt is made to faithfully reflect the user's actions in the actions of the virtual character, the virtual character may become difficult to see.

[0005] In view of the above circumstances, the present disclosure aims to provide a content distribution server, a content distribution method, and a content distribution program, as well as a content display device, a content display program, and a content display method, which are capable of displaying virtual characters placed in a virtual space in a more easily viewable manner. [Means for solving the problem]

[0006] According to one aspect of the present disclosure, there is provided a content distribution device comprising: a virtual character position acquisition unit that acquires the positions in a virtual space of each of a plurality of virtual characters corresponding to each of a plurality of participants in response to an action of the corresponding participant; a trigger detection unit that detects a first trigger; and a display control data distribution unit that generates and distributes display control data for displaying at least a portion of the virtual space in which the plurality of virtual characters are arranged, wherein until the first trigger is detected, the display control data distribution unit generates the display control data that changes the position of the plurality of virtual characters in the virtual space to the position acquired by the virtual character position acquisition unit, and in response to the detection of the first trigger, generates the display control data in which the position in the virtual space of a first virtual character among the plurality of virtual characters that is associated with the first trigger is changed.

[0007] The first trigger is transmitted from a terminal of a first participant corresponding to a second virtual character associated with the first trigger, and the display control data distribution unit preferably generates, in response to detection of the first trigger, the display control data in which the position of the first virtual character in the virtual space is changed so that the first virtual character is highlighted compared to before the first trigger was detected, and the display control data is for displaying at least a portion of the virtual space as seen from the second virtual character.

[0008] In response to the detection of the first trigger, the display control data distribution unit controls the first virtual character in the virtual space so that the first virtual character approaches a predetermined position. It is preferable to generate the display control data in which the arrangement of the virtual space has been changed, and the display control data for displaying at least a part of the virtual space as seen from the predetermined position.

[0009] It is desirable that, in response to detection of the first trigger, the display control data distribution unit generates display control data in which the position of the first virtual character in the virtual space is changed so that the first virtual character faces a predetermined position, and the display control data is for displaying at least a portion of the virtual space as seen from the predetermined position.

[0010] It is desirable that the first trigger is transmitted from a terminal of a first participant corresponding to a second virtual character associated with the first trigger, and that the predetermined position is the position of the second virtual character.

[0011] It is desirable that the predetermined position is a position different from any of the plurality of virtual characters.

[0012] The predetermined position is preferably the position of a third virtual character, which is not associated with the first trigger, among the plurality of virtual characters.

[0013] The first trigger is transmitted from a terminal of a first participant corresponding to a second virtual character associated with the first trigger, and the display control data includes first display control data for displaying at least a portion of the virtual space as seen from the second virtual character and second display control data for displaying at least a portion of the virtual space as seen from a third virtual character not associated with the first trigger. In response to detection of the first trigger, the display control data distribution unit preferably generates the first display control data in which the arrangement of the first virtual character is changed so that the first virtual character is highlighted compared to before the first trigger is detected, and generates the second display control data in which the arrangement of the multiple virtual characters in the virtual space is in accordance with the arrangement acquired by the virtual character arrangement acquisition unit, both before and after the first trigger is detected.

[0014] In response to detection of the first trigger, it is desirable that the display control data distribution unit generates the display control data in which the positions of the first virtual character and the second virtual character associated with the first trigger in the virtual space are changed so that the first virtual character and the second virtual character associated with the first trigger face each other.

[0015] In response to detection of the first trigger, it is desirable that the display control data distribution unit generates the display control data in which the position of the third virtual character not associated with the first trigger in the virtual space is changed so that the third virtual character faces the first virtual character.

[0016] In response to detection of the first trigger, it is desirable that the display control data distribution unit generates the display control data in which the position of the third virtual character in the virtual space is changed so that the third virtual character faces the first virtual character when the first virtual character speaks, and so that the third virtual character faces the second virtual character when a second virtual character associated with the first trigger speaks.

[0017] In response to the detection of the first trigger, the display control data distribution unit changes the positions in the virtual space of a third virtual character and a fourth virtual character that are not associated with the first trigger in consideration of the relative positional relationship between the third virtual character and the fourth virtual character acquired by the virtual character position acquisition unit. It is desirable to generate display control data.

[0018] It is preferable that, in response to detection of the first trigger, the display control data distribution unit generates the display control data in which the display mode of the first virtual character is changed.

[0019] Preferably, the first trigger corresponds to the initiation of a conversation between the first virtual character and a second virtual character associated with the first trigger.

[0020] It is desirable that the trigger detection unit detects a second trigger after detecting the first trigger, and that the display control data distribution unit, in response to the detection of the second trigger, generates the display control data that restores the position of the first virtual character in the virtual space, whose position had been changed, to the position acquired by the virtual character position acquisition unit.

[0021] Preferably, the second trigger corresponds to the initiation of a conversation between a second virtual character associated with the first trigger and the first virtual character.

[0022] According to another aspect of the present disclosure, there is provided a content distribution program that causes a computer to function as a virtual character position acquisition unit that acquires the positions in a virtual space of each of a plurality of virtual characters corresponding to each of a plurality of participants in response to an action of the corresponding participant, a trigger detection unit that detects a first trigger, and a display control data distribution unit that generates and distributes display control data for displaying at least a portion of the virtual space in which the plurality of virtual characters are positioned, wherein the display control data distribution unit generates the display control data that changes the positions of the plurality of virtual characters in the virtual space to the positions acquired by the virtual character position acquisition unit until the first trigger is detected, and generates the display control data in which the position in the virtual space of a first virtual character associated with the first trigger among the plurality of virtual characters is changed in response to the detection of the first trigger.

[0023] According to another aspect of the present disclosure, there is provided a content distribution method comprising the steps of: a virtual character position acquisition unit acquiring the positions in a virtual space of each of a plurality of virtual characters corresponding to each of a plurality of participants in response to an action of the corresponding participant; a trigger detection unit detecting a first trigger; and a display control data distribution unit generating and distributing display control data for displaying at least a portion of the virtual space in which the plurality of virtual characters are arranged, wherein until the first trigger is detected, the display control data distribution unit generates the display control data that changes the position of the plurality of virtual characters in the virtual space to the position acquired by the virtual character position acquisition unit, and in response to the detection of the first trigger, generates the display control data in which the position in the virtual space of a first virtual character among the plurality of virtual characters that is associated with the first trigger is changed.

[0024] According to another aspect of the present disclosure, a virtual space display system includes a virtual character control unit that transmits data indicating an arrangement of a first virtual character corresponding to a participant in a virtual space to a content distribution server in response to an action of the participant; a trigger generation unit that generates a first trigger in response to an instruction from the participant and transmits the first trigger to the content distribution server; and a display control unit that displays at least a part of the virtual space in which a plurality of virtual characters including the first virtual character are arranged, based on display control data distributed from the content distribution server, wherein before transmitting the first trigger, the display control unit receives the display control data that causes the arrangement of the plurality of virtual characters in the virtual space to correspond to actions of a plurality of participants corresponding to each of the plurality of virtual characters, and after transmitting the first trigger, causes the arrangement of the plurality of virtual characters to correspond to actions of a plurality of participants corresponding to each of the plurality of virtual characters. The content display device receives the display control data in which the position of the second virtual character associated with the first trigger in the virtual space has been changed.

[0025] According to another aspect of the present disclosure, there is provided a content display program that causes a computer to function as: a virtual character control unit that transmits data indicating the position in a virtual space of a first virtual character corresponding to a participant to a content distribution server in accordance with an action of the participant; a trigger generation unit that generates a first trigger and transmits it to the content distribution server in accordance with an instruction from the participant; and a display control unit that displays at least a portion of the virtual space in which multiple virtual characters including the first virtual character are positioned, based on display control data distributed from the content distribution server, wherein before the first trigger is transmitted, the display control unit receives the display control data that changes the position of the multiple virtual characters in the virtual space to a position that corresponds to the actions of multiple participants corresponding to each of the multiple virtual characters, and after the first trigger is transmitted, receives the display control data in which the position in the virtual space of a second virtual character of the multiple virtual characters that is associated with the first trigger is changed.

[0026] A content display method is provided, comprising: a step of a virtual character control unit transmitting data indicating a position in a virtual space of a first virtual character corresponding to the participant to a content distribution server in accordance with an action of the participant; a step of a trigger generation unit generating a first trigger in accordance with an instruction from the participant and transmitting the first trigger to the content distribution server; and a step of a display control unit displaying at least a part of the virtual space in which a plurality of virtual characters including the first virtual character are positioned, based on display control data distributed from the content distribution server, wherein before transmitting the first trigger, the display control unit receives the display control data that changes the position of the plurality of virtual characters in the virtual space to a position that corresponds to the actions of a plurality of participants corresponding to each of the plurality of virtual characters, and after transmitting the first trigger, receives the display control data in which the position in the virtual space of a second virtual character of the plurality of virtual characters that is associated with the first trigger is changed. [Effects of the Invention]

[0027] This makes it easier to see the virtual characters placed in the virtual space. [Brief explanation of the drawings]

[0028] [Figure 1] 1 is a block diagram showing a schematic configuration of a content distribution system according to an embodiment. [Figure 2] FIG. 2 is a block diagram showing the schematic configuration of a participant terminal 1a. [Figure 3] FIG. 2 is a block diagram showing a schematic configuration of a viewer terminal 2. [Figure 4] FIG. 2 is a block diagram showing a schematic configuration of a content distribution server 3. [Figure 5] FIG. 10 is a sequence diagram showing an example of a processing operation of the content distribution system before a conversation starts. [Figure 6] FIG. 2 is a diagram showing a schematic diagram of avatars A to D arranged in a virtual space. [Figure 7A] FIG. 2 is a diagram showing a model of content displayed on the display 15 of the participant terminal 1a. [Figure 7B] FIG. 2 is a diagram schematically showing the content displayed on the display 15 of the participant terminal 1d. [Figure 7C] FIG. 2 is a diagram schematically showing the content displayed on the display 23 of the viewer terminal 2. [Figure 8] FIG. 10 is a sequence diagram showing an example of a processing operation of the content distribution system after a conversation starts. [Figure 9A] FIG. 2 is a diagram showing a model of content displayed on the display 15 of the participant terminal 1a. [Figure 9B] FIG. 2 is a diagram schematically showing the content displayed on the display 15 of the participant terminal 1d. [Figure 9C] FIG. 2 is a diagram schematically showing the content displayed on the display 23 of the viewer terminal 2. [Figure 10] FIG. 9C is a diagram showing a variation of FIG. 9B, and is a diagram showing a model of the content displayed on the display 15 of the participant terminal 1d. [Figure 11] FIG. 9C is a diagram showing a variation of FIG. 9B, and is a diagram showing a model of the content displayed on the display 15 of the participant terminal 1d. [Figure 12] FIG. 9C is yet another variation of FIG. 9B, and is a diagram schematically showing the content displayed on the display 15 of the participant terminal 1d. [Figure 13] FIG. 9C is yet another variation of FIG. 9B, and is a diagram schematically showing the content displayed on the display 15 of the participant terminal 1d. [Figure 14] FIG. 10 is a sequence diagram showing an example of a processing operation of the content distribution system after the conversation ends. DETAILED DESCRIPTION OF THE INVENTION

[0029] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. Note that the embodiments described below do not unduly limit the content of the present disclosure described in the claims. Furthermore, not all of the components shown in the embodiments are necessarily essential components of the present disclosure.

[0030] 1 is a block diagram showing a schematic configuration of a content distribution system according to one embodiment. The content distribution system is composed of participant terminals 1a-1d, a viewer terminal 2, and a content distribution server 3, which are communicatively connected via a network such as a WAN (World Area Network). For convenience, four participant terminals 1a-1d and one viewer terminal 2 are shown, but there is no limit to the number of these.

[0031] This content distribution system allows users of participant terminals 1a to 1d to view in real time on participant terminals 1a to 1d and viewer terminal 2 the avatars (virtual characters) corresponding to the users of those terminals acting in a specified virtual space (hereinafter referred to as "content").

[0032] [Configuration of participant terminals 1a to 1d] Participant terminals 1a to 1d are used by users (hereinafter referred to as "participants") who make their avatars active in the virtual space. In the following, making one's corresponding avatar active in the virtual space is also referred to as "participating." Participants using participant terminals 1a to 1d are referred to as participants A to D, respectively, and the avatars corresponding to participants A to D are referred to as avatars A to D, respectively. Because the participant terminals 1a to 1d have the same configuration, participant terminal 1a will be described as a representative.

[0033] 2 is a block diagram showing a schematic configuration of the participant terminal 1a. The participant terminal 1a includes a communication unit 11, an operation unit 12, an action input unit 13, a storage unit 14, a display 15, a control unit 16, and the like.

[0034] The communication unit 11 is a NIC (Network Interface Card) for performing wired or wireless communication. controller) and transmits content via a network. It communicates with the distribution server 3. The operation unit 12 is an input interface that allows participants to give various instructions. The action input unit 13 is an input interface that accepts actions from participants to make the avatar move in the virtual space. The storage unit 14 is composed of RAM (Random Access Memory), ROM (Read Only Memory), etc., and stores data for executing various control processes. The program and various data are stored non-temporarily or temporarily. The display 15 displays content and the like.

[0035] The control unit 16 includes an avatar control unit 161, a trigger generation unit 162, and a display control unit 163. At least some of these units may be implemented by hardware, or may be realized by a processing circuit (processor) of the participant terminal 1a executing a predetermined program stored in the storage unit 14.

[0036] The avatar control unit 161 generates data for making the avatar act in the virtual space in response to actions taken by participant A on the action input unit 13. The activities here include actions such as movement and conversation. This data is transmitted from the communication unit 11 to the content distribution server 3. Note that this data may also be transmitted from the communication unit 11 to the other participant terminals 1b to 1d or the viewer terminal 2.

[0037] The trigger generation unit 162 generates a trigger in response to a predetermined operation on the operation unit 12 or a predetermined action on the action input unit 13 by the user. This trigger is transmitted from the communication unit 11 to the content distribution server 3. Note that this trigger may also be transmitted from the communication unit 11 to the other participant terminals 1b to 1d or the viewer terminal 2. In this embodiment, as examples of triggers, a conversation start trigger corresponding to the start of a conversation with an avatar corresponding to another user and a conversation end trigger corresponding to the end of the started conversation will be described. As will be described later, the position of the avatar placed in the virtual space is changed in response to the trigger.

[0038] The display control unit 163 receives display control data (described later) transmitted from the content distribution server 3, and causes the display 15 to display the content based on this display control data.

[0039] As an example, participant terminal 1a may be a smartphone (or tablet terminal). The smartphone has a touch panel display and a microphone. The touch panel display is, for example, a liquid crystal display and a transparent touch pad arranged one on top of the other, with the liquid crystal display functioning as display 15 and the touch pad functioning as operation unit 12 and action input unit 13.

[0040] The avatar in the virtual space moves in response to the participant's operation on the touchpad. For example, when a participant swipes right on the touchpad, the avatar moves right in the virtual space. The microphone may also function as the action input unit 13, and the avatar in the virtual space may move in response to the participant's speech into the microphone. For example, the user's speech into the microphone may be reflected in the speech of the avatar in the virtual space. In addition, various sensors such as an acceleration sensor and buttons provided on the smartphone may function as the operation unit 12 and / or the action input unit 13.

[0041] As another example, the operation unit 12 of the participant terminal 1a may be a stick-type controller for VR (Virtual Reality) that includes operation buttons, a keyboard, a pointing device, etc. The action input unit 13 may be a motion sensor that detects the participant's movement. The avatar in the virtual space moves in accordance with the detected participant's movement (motion data). For example, when the participant turns to the right, the avatar turns to the right in the virtual space. Furthermore, the display 15 may be an HMD (Head Mount Display).

[0042] As described above, the participant terminal 1a may be configured from a single device such as a smartphone, or may be configured from multiple devices such as a VR controller, a motion sensor, and an HMD.

[0043] [Configuration of viewer terminal 2] The viewer terminal 2 is used by a user (hereinafter referred to as a "viewer") who views content without participating in the content.

[0044] 3 is a block diagram showing a schematic configuration of the viewer terminal 2. The viewer terminal 2 is a configuration in which the action input unit 13, the avatar control unit 161, and the trigger generation unit 162 in the participant terminal 1a are omitted. If the purpose is only to view content, a viewer terminal 2 with such a simple configuration is sufficient. Of course, it is also possible to view content using the participant terminal 1a without participating in the content.

[0045] [Configuration of Content Distribution Server 3] 4 is a block diagram showing a schematic configuration of the content distribution server 3. The content distribution server 3 includes a communication unit 31, a storage unit 32, and a control unit 33. The content distribution server 3 may be composed of one device or multiple devices.

[0046] The communication unit 31 is a communication interface equipped with a NIC for wired or wireless communication, and communicates with the participant terminals 1a to 1d and the viewer terminal 2 via a network. The storage unit 32 is composed of RAM, ROM, etc., and stores programs for executing various control processes, various data, etc., non-temporarily or temporarily.

[0047] The control unit 33 includes an avatar placement acquisition unit 331, a trigger detection unit 332, and a display control data distribution unit 333. At least some of these units may be implemented in hardware, or may be realized by a processing circuit (processor) of the content distribution server 3 executing a predetermined program stored in the storage unit 32.

[0048] The avatar position acquisition unit 331 acquires the position in the virtual space of each avatar corresponding to each participant from the avatar control unit 161 of the participant terminals 1a to 1d. For example, the position of avatar A in the virtual space is acquired in response to the action of participant A on the action input unit 13 of the participant terminal 1a. The acquired position may be temporarily stored in the storage unit 32. Note that the "position" in this specification may refer to both the position and orientation of the avatar in the virtual space, or at least one of them.

[0049] The trigger detection unit 332 detects that a trigger has been generated by the trigger generation unit 162 of the participant terminals 1a to 1d. Here, the conversation start trigger is associated with an avatar that will participate in the conversation (hereinafter referred to as a "conversation avatar"). In other words, a conversation avatar is associated with a conversation start trigger, and an avatar that is not associated with the conversation start trigger does not participate in the conversation (hereinafter referred to as a "non-conversation avatar"). The trigger detection unit 322 also identifies the conversation avatar associated with the conversation start trigger. Note that the conversation avatar is usually a plurality of avatars including an avatar corresponding to the participant using the participant terminal that generated the conversation start trigger, but it may be only one avatar.

[0050] The display control data distribution unit 333 generates display control data based on the arrangement of each avatar acquired by the avatar arrangement acquisition unit 331 and the trigger detected by the trigger detection unit 332, and distributes the display control data to the participant terminals 1a to 1d and the viewer terminal 2. Specifically, the display control data distribution unit 333 has an avatar control unit 333a and a display control data generation unit 333b.

[0051] The avatar control unit 333a controls the placement of each avatar in the virtual space and generates avatar placement information indicating the placement of each avatar in the virtual space. The avatar control unit 333a controls the display mode of each avatar, and the avatar placement information may include the display mode of the avatar. This avatar arrangement information is used to display content on the displays 15 of the participant terminals 1a to 1d and the display 23 of the viewer terminal 2, that is, to generate display control data.

[0052] Specifically, until a conversation start trigger is detected, the avatar control unit 333a generates avatar placement information by placing the avatar in the virtual space according to the placement acquired by the avatar placement acquisition unit 331. It can be said that the placement of the avatar until a conversation start trigger is detected faithfully reflects the user's actions on the action input units 13 of the participant terminals 1a to 1d.

[0053] Furthermore, in response to the detection of the conversation start trigger, the avatar control unit 333a changes the arrangement of at least some of the avatars (for example, at least some of the conversation avatars) in the virtual space and updates the avatar arrangement information. The changed arrangement does not necessarily match the arrangement acquired by the avatar arrangement acquisition unit 331. In other words, the arrangement of the avatars after the conversation start trigger is detected does not faithfully reflect the actions of the participants in response to the action input units 13 of the participant terminals 1a to 1d.

[0054] The change in placement may be a change in the position in the virtual space, a change in the orientation of the avatar in the virtual space, or both. Examples of changes include highlighting the conversation avatar, moving the conversation avatar closer to a predetermined position, or facing the conversation avatar toward a predetermined position. Furthermore, when only a portion of the virtual space is not displayed on display 15, 23, the position of the conversation avatar may be changed so that all conversation avatars are displayed. Alternatively, the display mode of the conversation avatar may be changed (for example, the conversation avatar is usually six-head-tall, but is now eight-head-tall). Details will be described later.

[0055] It is desirable that the avatar control unit 333a stores the avatar arrangement before the change in the storage unit 32 so that the avatar arrangement before the change (the arrangement acquired by the avatar arrangement acquisition unit 331) is not lost.

[0056] Then, in response to the detection of a conversation end trigger after the conversation start trigger, the avatar control unit 333a restores the changed avatar arrangement to the arrangement acquired by the avatar arrangement acquisition unit 331, thereby updating the avatar arrangement information. As a result, the avatar arrangement after the conversation end trigger is detected is restored to one that faithfully reflects the actions of the participants on the action input units 13 of the participant terminals 1a to 1d. At this time, the avatar control unit 333a may use the avatar arrangement stored in the storage unit 32.

[0057] The display control data generation unit 333b uses the avatar placement information generated and updated by the avatar control unit 333a to generate display control data for displaying content on the display 15 of the participant terminals 1a to 1d and the display 23 of the viewer terminal 2. The display control data is distributed from the communication unit 31 to the participant terminals 1a to 1d and the viewer terminal 2.

[0058] The rendering of the images displayed on the displays 15 and 23 may be performed by the display control unit 163 of the participant terminals 1a to 1d and the display control unit 251 of the viewer terminal 2, or by the display control data generation unit 333b of the content distribution server 3.

[0059] When the participant terminals 1a to 1d perform rendering, data indicating the arrangement and display mode of each avatar in the virtual space based on the avatar arrangement information is distributed as display control data. Then, based on the display control data, the display control unit 163 of the participant terminals 1a to 1d generates an image of the content in which each avatar is arranged in the virtual space, and displays it on the display 15. The same applies when the viewer terminal 2 performs rendering.

[0060] On the other hand, when the display control data generation unit 333b of the content distribution server 3 performs rendering, the display control data generation unit 333b generates data (image data) corresponding to an image of the content in which each avatar is arranged in the virtual space, based on the avatar arrangement information. The generated image data is then distributed as display control data. The display control unit 163, 251 then causes the display 15, 23 to display the image of the content based on the display control data.

[0061] As described above, rendering may be performed by the participant terminals 1a to 1d and the viewer terminal 2, or by the content distribution server 3, but the former is more preferable in order to avoid a time lag.

[0062] Here, the content displayed on participant terminals 1a-1d and viewer terminal 2 may be the same for participant terminals 1a-1d and viewer terminal 2, but it is preferable that the content displayed on each terminal be different. Specifically, participant terminal 1a displays a virtual space with avatar A as the viewpoint as its content. The same is true for participant terminals 1b-1d. Furthermore, viewer terminal 2 displays a virtual space with a virtual camera set at an arbitrary position in the virtual space (for example, a position that provides a bird's-eye view of the virtual space) as its viewpoint as its content.

[0063] The viewpoint may also be switchable. For example, the participant terminal 1a may initially display the virtual space as seen from avatar A, but in response to a predetermined operation on the operation unit 12, the virtual space as seen from another avatar or from a virtual camera may be displayed. The viewer terminal 2 may initially display the virtual space as seen from a virtual camera, but in response to a predetermined operation on the operation unit 22, the virtual space as seen from a specific avatar may be displayed. In addition, multiple virtual cameras with different installation positions or different zooms may be set in the virtual space, and it may be possible to switch which virtual camera displays the virtual space from. Furthermore, the entire virtual space may be displayed, or only a portion of it may be displayed.

[0064] [Processing operation of content distribution system before conversation starts] 5 is a sequence diagram showing an example of the processing operation of the content distribution system before the start of a conversation. Note that, although only the participant terminal 1a will be described below, the other participant terminals 1b to 1d also operate in the same manner.

[0065] When participant A performs a predetermined action on the action input unit 13 of participant terminal 1a, the avatar control unit 161 generates data for moving avatar A in the virtual space and transmits this data to the content distribution server 3 (step S1). The action of avatar A here refers to the placement of avatar A in the virtual space, and more specifically, to moving avatar A in the virtual space or making avatar A face a specific direction.

[0066] The content distribution server 3 then receives the data. Based on this data, the avatar placement acquisition unit 331 acquires the placement (position and / or orientation) of avatar A in the virtual space (step S11). This placement directly reflects the actions of participant A on the action input unit 13.

[0067] Next, based on the acquired placement, the avatar control unit 333a sets the placement of avatar A in the virtual space and generates avatar placement information (step S12). Again, this placement also directly reflects the actions of participant A on the action input unit 13.

[0068] Next, the display control data generating unit 333b generates display control data based on the generated avatar arrangement information. The display control data is then distributed to the participant terminal 1a (step The display control data is also distributed to the other participant terminals 1 b to 1 d and the viewer terminal 2 ).

[0069] In response to the distribution of the display control data from the content distribution server 3, the display control unit 165 of the participant terminal 1a receives the display control data. This display control data shows avatars A to D arranged in the virtual space in accordance with the movements of each participant A to D. Based on this display control data, the display control unit 163 displays the content (the virtual space in which the avatars are arranged) on the display 15 (step S2). The other participant terminals 1b to 1d and the viewer terminal 2 also display the content in the same way. The above process is repeated every time data for moving an avatar is transmitted from any of the participant terminals 1a to 1d.

[0070] 6 is a diagram showing a schematic diagram of avatars A to D arranged in a virtual space. As shown in the figure, avatars A to D are arranged in order from the left.

[0071] 7A is a diagram showing a schematic representation of the content displayed on the display 15 of the participant terminal 1a, and corresponds to FIG. 6. As shown in FIG. 7A, the virtual space as seen from avatar A in FIG. 6 is displayed on the display 15 of the participant terminal 1a. When the participant terminal 1a is a smartphone, the display 15 is typically vertically long, so the virtual space appears compressed horizontally, but the positions and orientations of avatars A to D in FIG. 6 are faithfully reproduced.

[0072] Figure 7B is a diagram schematically showing the content displayed on the display 15 of the participant terminal 1d, and corresponds to Figure 6. As shown in Figure 7B, the virtual space as seen from avatar D in Figure 6 is displayed on the display 15 of the participant terminal 1b.

[0073] Figure 7C is a diagram that schematically illustrates the content displayed on the display 23 of the viewer terminal 2, and corresponds to Figure 6. In Figure 7C, it is assumed that a virtual camera is placed in a position that views the virtual space from above and in front of the viewer, and that the entire virtual space is within the field of view of the virtual camera. The virtual space as seen from this virtual camera is then displayed on the display 23 of the viewer terminal 2.

[0074] When rendering is performed at the participant terminals 1a to 1d and the viewer terminal 2, the display control data only needs to indicate the placement of the avatars A to D in the virtual space, so the display control data transmitted to the participant terminals 1a to 1d and the viewer terminal 2 can be the same. Then, each of the participant terminals 1a to 1d and the viewer terminal 2 processes the display control data and generates an image showing the avatars A to D and the virtual space as seen from the virtual camera.

[0075] On the other hand, when rendering is performed at the participant terminals 1a to 1d and the viewer terminal 2, image data corresponding to the images shown in Figures 7A to 7C are transmitted as display control data. Therefore, the display control data transmitted to the participant terminals 1a to 1d and the viewer terminal 2 are different from each other.

[0076] [Processing operation of content distribution system after conversation starts] FIG. 8 is a sequence diagram showing an example of the processing operation of the content distribution system after the start of a conversation, which is performed following FIG.

[0077] When participant A instructs participant terminal 1a to start a conversation, trigger generation unit 162 generates a conversation start trigger and transmits it to content distribution server 3 (step S21). Information for identifying an avatar associated with the conversation start trigger, i.e., a conversation avatar, is also transmitted to content distribution server 3. The instruction to start a conversation is given to operation unit 12 and / or action input unit 13.

[0078] If the participant terminal 1a is a smartphone, an instruction to start a conversation may be, for example, speaking into a microphone, entering a specific character or word (such as "!" or "Good morning") in a text input field displayed on a touch panel display, pressing a button, touching a specific icon displayed on a touch panel display, or rotating the smartphone from portrait to landscape orientation (detected by an acceleration sensor).

[0079] Participant A may also specify a conversation avatar. For example, the conversation avatar may be specified by tapping on any avatar displayed on the touch panel display. Alternatively, the participant may select any avatar from a list of avatars placed in the virtual space. Also, if the participant is talking to themselves, they may not need to specify a conversation avatar (in this case, the only conversation avatar is Avatar A).

[0080] Furthermore, if the participant terminal 1a includes a VR controller, the instruction to start a conversation may be to press a predetermined button on the controller, and a conversation avatar may be identified by a pointer displayed in the virtual space in conjunction with the movement of the controller.

[0081] When a conversation start trigger is transmitted, the trigger detection unit 332 of the content distribution server 3 detects the conversation start trigger (step S31). The trigger detection unit 332 also identifies a conversation avatar associated with the conversation start trigger (step S32). Note that the conversation avatar does not necessarily have to be identified by participant A, and may be automatically identified by the trigger detection unit 332 depending on the context of the conversation.

[0082] In response to the detection of the conversation start trigger, the avatar control unit 333a changes the positions of at least some of the avatars in the virtual space and updates the avatar position information (step S33). As a result of such a change in position, the positions of the avatars in the virtual space become different from the actions of each participant in response to the action input unit 13.

[0083] The avatar placement information updated here may differ for each of the participant terminals 1a to 1d and the viewer terminal 2. That is, avatar placement information is generated for each of the participant terminals 1a to 1d and the viewer terminal 2 (in other words, for each avatar and virtual camera).

[0084] Next, the display control data generator 333b generates display control data based on the generated avatar placement information. The display control data is then distributed to the participant terminal 1a (step S34). The display control data is also distributed to the other participant terminals 1b-1d and the viewer terminal 2. If the avatar placement information differs for each of the participant terminals 1a-1d and the viewer terminal 2, the display control information differs for each of the participant terminals 1a-1d and the viewer terminal 2 even when rendering is performed at each of the participant terminals 1a-1d and the viewer terminal 2.

[0085] In response to the distribution of the display control data from the content distribution server 3, the display control unit 165 of the participant terminal 1a receives the display control data. Compared with the display control data received in step S2 of FIG. 5, this display control data has a changed arrangement of the conversation avatars in the virtual space. Based on this display control data, the display control unit 163 displays the content (the virtual space in which the avatars are arranged) on the display 15 (step S22). The other participant terminals 1b to 1d and the viewer terminals similarly display the content.

[0086] Even after the conversation start trigger is detected, the avatar placement acquisition unit 331 of the content distribution server 3 acquires the placement of the avatar in the virtual space from the avatar control unit 161 of each participant terminal 1a to 1d, and reflects this in the placement of the avatar or stores it in the memory unit 32 as necessary.

[0087] FIG. 9A is a diagram schematically showing content displayed on display 15 of participant terminal 1a. FIG. 9B is a diagram schematically showing content displayed on display 15 of participant terminal 1d. FIG. 9C is a diagram schematically showing content displayed on display 23 of viewer terminal 2. FIGS. 9A to 9C correspond to FIGS. 7A to 7C, respectively. It is assumed that a conversation start trigger with avatars A and C as conversation avatars has been detected in the state of FIG. 6, and FIG. 9A shows the viewpoint of the conversation avatar, FIG. 9B shows the viewpoint of a non-conversation avatar, and FIG. 9C shows the viewpoint of a virtual camera.

[0088] As shown in FIG. 9A, conversation avatar C, who is the conversation partner of conversation avatar A, is displayed near the center of display 15. More specifically, even if conversation avatar C has not moved from the state shown in FIG. 6 (participant C has not taken any action to move avatar C), conversation avatar C is displayed near the center of display 15 in response to a conversation start trigger. This means that in step S33 of FIG. 8, conversation avatar C has been changed for participant terminal 1a so that it is closer to conversation avatar A. Furthermore, conversation avatar C may be displayed larger than in FIG. 6.

[0089] In this way, even if conversational avatar C of the conversation partner is far away from the user (conversational avatar A) or even if display 15 is small, conversational avatar C can be highlighted and displayed in an easy-to-see manner.

[0090] It is also desirable that conversation avatar C face conversation avatar A (facing forward on display 15). More specifically, even if conversation avatar C is not facing conversation avatar A in the state shown in Figure 6, conversation avatar C will face conversation avatar A in response to a conversation start trigger. This is because it is natural for conversation avatars A and C to face each other.

[0091] Furthermore, it is desirable to have the non-conversational avatars B and D face the conversational avatar A or the conversational avatar C. More specifically, even if the non-conversational avatars B and D are not facing the conversational avatar A or the conversational avatar C in the state of FIG. 6, the non-conversational avatars B and D will face the conversational avatar A or the conversational avatar C in response to a conversation start trigger. This is because it is natural for the non-conversational avatars B and D to also focus on the conversational avatar A or the conversational avatar C. Furthermore, the non-conversational avatars B and D may face the conversational avatar A (facing forward on the display 15) when the conversational avatar A speaks, and face the conversational avatar C when the conversational avatar C speaks.

[0092] Furthermore, the positions of non-conversational avatars B and D may be the same as or different from those in Figure 6. Even if they are different, it is desirable that the positions in Figure 6, more specifically the relative positional relationship between non-conversational avatars B and D, be taken into consideration. For example, since non-conversational avatar D is to the right of non-conversational avatar B in Figure 6, it is desirable that non-conversational avatar D be placed to the right of non-conversational avatar B in Figure 9A to maintain this positional relationship. In either case, since non-conversational avatars B and D are less important than conversational avatar C, they should be displayed appropriately so as not to look unnatural.

[0093] Furthermore, the avatar's comments may be displayed in a speech bubble. This is also true in other figures, although not shown.

[0094] In response to an operation by participant A, the content displayed on display 15 may be switched between FIG. 7A and FIG. 9A.

[0095] As shown in FIG. 9B, the display 15 of the participant terminal 1d corresponding to the non-conversational avatar D 7A. For such content, even after a conversation start trigger is detected, the avatar control unit 333a does not need to change the content for the participant terminal 1d in step S33 of FIG. 8, and the avatar control unit 333a continues to generate avatar placement information based on the placement acquired by the avatar placement acquisition unit 331.

[0096] As shown in Fig. 9C, from the viewpoint of the virtual camera, conversation avatars A and C are displayed near the center of display 23. This means that in step S33 of Fig. 8, conversation avatars A and C have been changed for viewer terminal 2 (for the virtual camera) to be closer to the position of the virtual camera.

[0097] In this way, even if conversation avatars A and C are far apart from each other or even if display 23 is small, conversation avatars A and C are emphasized and can be displayed in an easy-to-see manner.

[0098] It is also desirable that conversation avatars A and C face the position of the virtual camera (facing forward on display 23). It is also desirable that avatars B and D, which are not conversation avatars, face conversation avatars A and C. It is also possible that non-conversation avatars B and D face conversation avatar A when conversation avatar A speaks, and face conversation avatar C when conversation avatar C speaks.

[0099] Furthermore, similar to FIG. 9A, the positions of non-conversational avatars B and D may be the same as or different from those in FIG.

[0100] It should be noted that the content displayed on display 23 may be switchable between FIG. 7C and FIG. 9C in response to an operation by the viewer user.

[0101] Fig. 10 is a modified example of Fig. 9B, and is a diagram schematically showing content displayed on the display 15 of the participant terminal 1d. Unlike Fig. 9B, conversational avatars A and C are facing the position of non-conversational avatar D (facing forward on the display 15). This display makes it easy for participant D corresponding to non-conversational avatar D to understand that avatars A and C facing him are conversational avatars.

[0102] FIG. 11 is a modified example of FIG. 9B, and is a diagram schematically showing content displayed on the display 15 of the participant terminal 1d. Unlike FIG. 10, conversation avatars A and C face each other. This is because it is natural to display them as if they are facing each other and having a conversation. Note that in FIG. 9C as well, conversation avatars A and C may face each other.

[0103] FIG. 12 is another variation of FIG. 9B, and is a diagram schematically illustrating content displayed on display 15 of participant terminal 1d. Unlike FIGS. 10 and 11, conversational avatar A may face a position between non-conversational avatar D and conversational avatar C, and conversational avatar C may face a position between non-conversational avatar D and conversational avatar A. This makes it easy for participant D corresponding to non-conversational avatar D to recognize that avatars A and C are conversational avatars, and the conversational avatars A and C appear to be facing each other, which is natural. Note that, similarly in FIG. 9C, conversational avatar A may face a position between the virtual camera and conversational avatar C, and conversational avatar C may face a position between the virtual camera and conversational avatar A.

[0104] 13 is another variation of FIG. 9B, and is a diagram schematically illustrating content displayed on display 15 of participant terminal 1d. As in FIG. 9A, conversation avatars A and C may be displayed near the center of display 15. In this case, the orientation of conversation avatars A and C may be the same as in any of FIGS. 10 to 12.

[0105] Note that multiple templates for arranging conversational avatars and non-conversational avatars may be determined in advance and stored in storage unit 32. Then, when a conversation start trigger is detected, avatar control unit 333a selects an appropriate template based on rules determined according to the number of conversational avatars and non-conversational avatars, etc. Then, avatar control unit 333a may arrange each avatar in the virtual space by fitting each avatar into the selected template.

[0106] [Processing operation of the content distribution system after the conversation ends] FIG. 14 is a sequence diagram showing an example of the processing operation of the content distribution system after the conversation ends, which is performed following FIG.

[0107] When participant A instructs the participant terminal 1a to end the conversation, the trigger generation unit 162 generates a conversation end trigger and transmits it to the content distribution server 3 (step S41). The instruction to end the conversation is sent to the operation unit 12 and / or the action input unit 13. The instruction to end the conversation may be the same as the instruction to start the conversation.

[0108] For example, if participant terminal 1a is a smartphone, an instruction to end the conversation may be given by, for example, speaking into a microphone, entering a specific character or word in a character input field displayed on a touch panel display, pressing a button, touching a specific icon displayed on a touch panel display, or rotating the smartphone from landscape to portrait orientation (detected by an acceleration sensor).

[0109] Furthermore, if the participant terminal 1a includes a VR controller, the instruction to end the conversation may be given by pressing a predetermined button on the controller.

[0110] When the conversation end trigger is transmitted, the trigger detection unit 332 of the content distribution server 3 detects the conversation end trigger (step S51).

[0111] In response to detection of the conversation end trigger, the avatar control unit 333a restores the original avatar arrangement that was changed in step S33 of Fig. 8 (step S52). Specifically, the avatar control unit 333a sets the arrangement of avatar A in the virtual space based on the avatar arrangement acquired by the avatar arrangement acquisition unit 331, and updates the avatar arrangement information. As a result, the arrangement of each avatar in the virtual space returns to one that directly reflects the actions of the participants in response to the action input unit 13.

[0112] Next, the display control data generator 333b generates display control data based on the avatar arrangement information and distributes it to the participant terminal 1a (step S53). The display control data is also distributed to the other participant terminals 1b to 1d and the viewer terminal 2.

[0113] The participant terminal 1a receives the display control data in response to distribution of the display control data from the content distribution server 3. Based on this display control data, the display control unit 163 displays the content (a virtual space in which avatars are placed) on the display 15 (step S42). The other participant terminals 1b to 1d and the viewer terminals similarly display the content.

[0114] As a result, after a conversation start trigger is detected, the display shown in FIGS. 9A to 9C is restored to the display shown in FIGS. 7A to 7C upon detection of a conversation end trigger.

[0115] In this manner, in this embodiment, the position of the avatar in the virtual space is changed in response to the start of a conversation trigger, thereby making it possible to display the avatar in the virtual space in an easy-to-see manner.

[0116] While the preferred embodiments of the present disclosure have been described above, the present disclosure is not limited to such specific embodiments, and includes the inventions set forth in the claims and their equivalents. Furthermore, the device configurations described in the above embodiments and modifications can be combined as appropriate as long as no technical contradiction occurs. [Explanation of symbols]

[0117] 1a~1d Participant terminals 11 Communications Department 12 Control section 13 Operation input section 14 Storage section 15 Display 16 Control Unit 17 Avatar control unit 18 Trigger Generation Unit 19 Display control unit 2. Viewer terminal 21 Communications Department 22 Control section 23 Display 24 Memory section 25 Control Unit 26 Display control unit 3 Content distribution server 31 Communications Department 32 Storage section 33 Control Unit 331 Avatar Placement Acquisition Unit 332 Trigger detection unit 333 Display Control Data Distribution Unit 333a Avatar control unit 333b Display control data generation unit

Claims

[Claim 1] a virtual character position acquisition unit that acquires the position of a virtual character corresponding to a participant in a virtual space in response to the participant's movement; a trigger detection unit that detects a first trigger and then detects a second trigger; a display control data distribution unit that generates and distributes display control data for displaying at least a part of the virtual space in which the virtual character is placed, The display control data distribution unit generating the display control data for causing the virtual character in the virtual space to be positioned in accordance with the position acquired by the virtual character position acquisition unit until the first trigger is detected; generating the display control data in which the position of the virtual character in the virtual space has been changed in response to the detection of the first trigger; In response to detection of the second trigger, the content distribution device generates the display control data that returns the position of the virtual character in the virtual space, whose position had been changed, to the position acquired by the virtual character position acquisition unit.

Images