Content distribution apparatus, content distribution program, content distribution method, content display device, content display program, and contents display method
The system adjusts virtual character arrangements in response to triggers, enhancing visibility and immersion by highlighting and repositioning characters during interactions.
Patent Information
- Application Number
- JP2024135564
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-08-15
- Publication Date
- 2024-11-06
- Estimated Expiration
- 2039-06-28
AI Technical Summary
The challenge of faithfully reflecting user actions on virtual characters in a finite display space can make them difficult to see.
A system that includes a virtual character placement acquisition unit, a trigger detection unit, and a display control data distribution unit to adjust the arrangement of virtual characters in response to triggers, such as the start of a conversation, to highlight and reposition characters for easier viewing.
Virtual characters can be easily seen and highlighted during interactions, improving user immersion and clarity in virtual spaces.
Smart Images

Figure 2024156997000001_ABST
Abstract
Description
[Technical field]
[0001] The present disclosure relates to a content distribution device, a content distribution program, and a content distribution method for distributing a virtual space in which a virtual character is placed as content, and also to a content display device, a content display program, and a content display method. [Background technology]
[0002] Patent Document 1 discloses a content distribution server that displays a virtual space in which a virtual character is placed on a display. The virtual character is operated by the user, and is usually displayed so that the user's actions are faithfully reflected in the virtual character's actions. This is because a sense of immersion in the virtual space can be obtained. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Patent No. 6469279 Summary of the Invention [Problem to be solved by the invention]
[0004] However, since the size of a display is finite, if an attempt is made to faithfully reflect the user's movements in the movements of a virtual character, the virtual character may become difficult to see.
[0005] In view of the above circumstances, the present disclosure aims to provide a content distribution server, a content distribution method, and a content distribution program, as well as a content display device, a content display program, and a content display method, which are capable of more easily displaying virtual characters placed in a virtual space. [Means for solving the problem]
[0006] According to one aspect of the present disclosure, there is provided a content distribution device comprising: a virtual character position acquisition unit that acquires a position in a virtual space of each of a plurality of virtual characters corresponding to each of a plurality of participants in response to an action of the corresponding participant; a trigger detection unit that detects a first trigger; and a display control data distribution unit that generates and distributes display control data for displaying at least a portion of the virtual space in which the plurality of virtual characters are arranged, wherein, until the first trigger is detected, the display control data distribution unit generates the display control data for changing the position in the virtual space of the plurality of virtual characters according to the position acquired by the virtual character position acquisition unit, and in response to detection of the first trigger, generates the display control data in which the position in the virtual space of a first virtual character associated with the first trigger among the plurality of virtual characters is changed.
[0007] It is preferable that the first trigger is transmitted from a terminal of a first participant corresponding to a second virtual character associated with the first trigger, and that the display control data distribution unit, in response to detection of the first trigger, generates the display control data in which a position of the first virtual character in the virtual space is changed so that the first virtual character is highlighted compared to before the first trigger was detected, and the display control data is for displaying at least a portion of the virtual space as seen from the second virtual character.
[0008] In response to detection of the first trigger, the display control data distribution unit controls the first virtual character in the virtual space so that the first virtual character approaches a predetermined position. It is preferable to generate the display control data in which the arrangement of the virtual space is changed, the display control data being for displaying at least a part of the virtual space as seen from the predetermined position.
[0009] It is desirable that, in response to detection of the first trigger, the display control data distribution unit generates the display control data in which the position of the first virtual character in the virtual space is changed so that the first virtual character faces a predetermined position, and the display control data is for displaying at least a portion of the virtual space as seen from the predetermined position.
[0010] It is preferable that the first trigger is transmitted from a terminal of a first participant corresponding to a second virtual character associated with the first trigger, and the predetermined position is the position of the second virtual character.
[0011] It is desirable that the predetermined position is a position different from any of the multiple virtual characters.
[0012] The predetermined position is preferably a position of a third virtual character, which is not associated with the first trigger, among the plurality of virtual characters.
[0013] The first trigger is transmitted from a terminal of a first participant corresponding to a second virtual character associated with the first trigger, and the display control data includes first display control data for displaying at least a part of the virtual space as seen from the second virtual character and second display control data for displaying at least a part of the virtual space as seen from a third virtual character not associated with the first trigger. It is preferable that, in response to detection of the first trigger, the display control data distribution unit generates the first display control data in which an arrangement of the first virtual character is changed so that the first virtual character is highlighted compared to before the first trigger is detected, and generates the second display control data in which the arrangement of the multiple virtual characters in the virtual space is in accordance with the arrangement acquired by the virtual character arrangement acquisition unit, both before and after the first trigger is detected.
[0014] It is preferable that, in response to detection of the first trigger, the display control data distribution unit generates the display control data in which the positions of the first virtual character and the second virtual character associated with the first trigger in the virtual space are changed so that the first virtual character and the second virtual character associated with the first trigger face each other.
[0015] It is preferable that, in response to detection of the first trigger, the display control data distribution unit generates the display control data in which a position of the third virtual character not associated with the first trigger in the virtual space is changed so that the third virtual character faces the first virtual character.
[0016] It is desirable that, in response to detection of the first trigger, the display control data distribution unit generates the display control data in which a position of the third virtual character in the virtual space is changed so that the third virtual character faces the first virtual character when the first virtual character speaks, and so that the third virtual character faces the second virtual character when a second virtual character associated with the first trigger speaks.
[0017] The display control data distribution unit, in response to the detection of the first trigger, changes positions in the virtual space of a third virtual character and a fourth virtual character that are not associated with the first trigger, taking into consideration the relative positional relationship between the third virtual character and the fourth virtual character acquired by the virtual character position acquisition unit. It is desirable to generate display control data.
[0018] It is preferable that, in response to detection of the first trigger, the display control data delivery unit generates the display control data in which a display mode of the first virtual character is changed.
[0019] Preferably, the first trigger corresponds to initiating a conversation between the first virtual character and a second virtual character associated with the first trigger.
[0020] It is desirable that the trigger detection unit detects a second trigger after detecting the first trigger, and that the display control data distribution unit, in response to detecting the second trigger, generates the display control data that restores the arrangement of the first virtual character, whose arrangement has been changed, in the virtual space to an arrangement that conforms to the arrangement acquired by the virtual character arrangement acquisition unit.
[0021] Preferably, the second trigger corresponds to initiating a conversation between a second virtual character associated with the first trigger and the first virtual character.
[0022] According to another aspect of the present disclosure, there is provided a content distribution program that causes a computer to function as a virtual character position acquisition unit that acquires a position in a virtual space of each of a plurality of virtual characters corresponding to each of a plurality of participants in response to an action of the corresponding participant, a trigger detection unit that detects a first trigger, and a display control data distribution unit that generates and distributes display control data for displaying at least a portion of the virtual space in which the plurality of virtual characters are arranged, wherein the display control data distribution unit generates the display control data that changes the position of the plurality of virtual characters in the virtual space to the position acquired by the virtual character position acquisition unit until the first trigger is detected, and generates the display control data in which the position in the virtual space of a first virtual character associated with the first trigger among the plurality of virtual characters is changed in response to detection of the first trigger.
[0023] According to another aspect of the present disclosure, there is provided a content distribution method comprising the steps of: a virtual character position acquisition unit acquiring a position in a virtual space of each of a plurality of virtual characters corresponding to each of a plurality of participants in response to an action of the corresponding participant; a trigger detection unit detecting a first trigger; and a display control data distribution unit generating and distributing display control data for displaying at least a portion of the virtual space in which the plurality of virtual characters are arranged, wherein until the first trigger is detected, the display control data distribution unit generates the display control data for changing the position of the plurality of virtual characters in the virtual space in accordance with the position acquired by the virtual character position acquisition unit, and in response to detection of the first trigger, generates the display control data in which the position in the virtual space of a first virtual character associated with the first trigger among the plurality of virtual characters is changed.
[0024] According to another aspect of the present disclosure, a virtual character control unit is configured to transmit data indicating an arrangement of a first virtual character corresponding to a participant in a virtual space to a content distribution server in response to an action of the participant; a trigger generation unit is configured to generate a first trigger in response to an instruction of the participant and transmit the first trigger to the content distribution server; and a display control unit is configured to display at least a part of the virtual space in which a plurality of virtual characters including the first virtual character are arranged, based on display control data distributed from the content distribution server, wherein before the transmission of the first trigger, the display control unit receives the display control data to cause an arrangement of the plurality of virtual characters in the virtual space to correspond to actions of a plurality of participants corresponding to each of the plurality of virtual characters, and after the transmission of the first trigger, the display control unit causes the arrangement of the plurality of virtual characters to correspond to actions of the plurality of participants corresponding to each of the plurality of virtual characters. The content display device receives the display control data in which a position in the virtual space of a second virtual character associated with the first trigger has been changed.
[0025] According to another aspect of the present disclosure, there is provided a content display program that causes a computer to function as: a virtual character control unit that transmits data indicating an arrangement in a virtual space of a first virtual character corresponding to a participant to a content distribution server in response to an action of the participant; a trigger generation unit that generates a first trigger and transmits it to the content distribution server in response to an instruction of the participant; and a display control unit that displays at least a portion of the virtual space in which a plurality of virtual characters including the first virtual character are arranged, based on display control data distributed from the content distribution server, wherein the display control unit receives the display control data that changes the arrangement of the plurality of virtual characters in the virtual space to an arrangement corresponding to actions of a plurality of participants corresponding to each of the plurality of virtual characters before the transmission of the first trigger, and receives the display control data in which an arrangement in the virtual space of a second virtual character associated with the first trigger among the plurality of virtual characters is changed after the transmission of the first trigger.
[0026] A content display method is provided, comprising: a virtual character control unit transmitting data indicating an arrangement in a virtual space of a first virtual character corresponding to the participant to a content distribution server in response to an action of the participant; a trigger generation unit generating a first trigger in response to an instruction from the participant and transmitting the first trigger to the content distribution server; and a display control unit displaying at least a part of the virtual space in which a plurality of virtual characters including the first virtual character are arranged, based on display control data distributed from the content distribution server, wherein before the first trigger is transmitted, the display control unit receives the display control data that changes the arrangement of the plurality of virtual characters in the virtual space to an arrangement corresponding to actions of a plurality of participants corresponding to each of the plurality of virtual characters, and after the first trigger is transmitted, receives the display control data in which an arrangement in the virtual space of a second virtual character associated with the first trigger among the plurality of virtual characters is changed. Effect of the Invention
[0027] This makes it easier to see the virtual characters placed in the virtual space. [Brief description of the drawings]
[0028] [Figure 1] 1 is a block diagram showing a schematic configuration of a content delivery system according to an embodiment. [Diagram 2] FIG. 2 is a block diagram showing a schematic configuration of a participant terminal 1a. [Diagram 3] FIG. 2 is a block diagram showing a schematic configuration of a viewer terminal 2. [Figure 4] FIG. 2 is a block diagram showing a schematic configuration of a content distribution server 3. [Diagram 5] FIG. 11 is a sequence diagram showing an example of a processing operation of the content delivery system before a conversation starts. [Figure 6] FIG. 2 is a diagram showing a schematic diagram of avatars A to D arranged in a virtual space. [Figure 7A] FIG. 2 is a diagram showing a schematic diagram of the content displayed on the display 15 of the participant terminal 1a. [Figure 7B] FIG. 2 is a diagram showing a schematic diagram of the content displayed on the display 15 of the participant terminal 1d. [Figure 7C] FIG. 2 is a diagram showing a schematic diagram of the content displayed on the display 23 of the viewer terminal 2. [Figure 8] FIG. 11 is a sequence diagram showing an example of a processing operation of the content delivery system after a conversation starts. [Figure 9A] FIG. 2 is a diagram showing a schematic diagram of the content displayed on the display 15 of the participant terminal 1a. [Figure 9B] FIG. 2 is a diagram showing a schematic diagram of the content displayed on the display 15 of the participant terminal 1d. [Figure 9C] FIG. 2 is a diagram showing a schematic diagram of the contents displayed on the display 23 of the viewer terminal 2. [Figure 10] FIG. 9C is a modified example of FIG. 9B, and shows a schematic diagram of the content displayed on the display 15 of the participant terminal 1d. [Figure 11] FIG. 9C is a modified example of FIG. 9B, and shows a schematic diagram of the content displayed on the display 15 of the participant terminal 1d. [Figure 12] FIG. 9C is yet another modified example of FIG. 9B, and is a diagram showing the content displayed on the display 15 of the participant terminal 1d. [Figure 13] FIG. 9C is yet another modified example of FIG. 9B, and is a diagram showing the content displayed on the display 15 of the participant terminal 1d. [Figure 14] FIG. 11 is a sequence diagram showing an example of a processing operation of the content delivery system after a conversation ends. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0029] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. Note that the embodiments described below do not unduly limit the contents of the present disclosure described in the claims. In addition, not all components shown in the embodiments are necessarily essential components of the present disclosure.
[0030] 1 is a block diagram showing a schematic configuration of a content delivery system according to an embodiment. The content delivery system is composed of participant terminals 1a-1d, a viewer terminal 2, and a content delivery server 3, which are communicatively connected via a network such as a WAN (World Area Network). For convenience, four participant terminals 1a-1d and one viewer terminal 2 are illustrated, but there is no limit to the number of these.
[0031] This content distribution system enables users of participant terminals 1a to 1d to view in real time on participant terminals 1a to 1d and viewer terminal 2 the avatars (virtual characters) corresponding to those users acting in a specified virtual space (hereinafter referred to as "content").
[0032] [Configuration of participant terminals 1a to 1d] Participant terminals 1a to 1d are used by users (hereinafter referred to as "participants") who operate avatars in a virtual space. In the following, operating an avatar corresponding to oneself in a virtual space is also referred to as "participating." Participants using participant terminals 1a to 1d are referred to as participants A to D, respectively, and avatars corresponding to participants A to D are referred to as avatars A to D, respectively. Since participant terminals 1a to 1d have the same configuration, participant terminal 1a will be described as a representative.
[0033] 2 is a block diagram showing a schematic configuration of the participant terminal 1a. The participant terminal 1a includes a communication unit 11, an operation unit 12, an action input unit 13, a storage unit 14, a display 15, a control unit 16, and the like.
[0034] The communication unit 11 is a NIC (Network Interface Card) for performing wired or wireless communication. A communication interface that has a controller and transmits content via a network. The virtual machine communicates with the distribution server 3. The operation unit 12 is an input interface that allows the participant to give various instructions. The action input unit 13 is an input interface that accepts actions from the participant to make the avatar move in the virtual space. The storage unit 14 is composed of RAM (Random Access Memory), ROM (Read Only Memory), etc., and stores data for executing various control processes. The program and various data are stored non-temporarily or temporarily. The display 15 displays contents and the like.
[0035] The control unit 16 includes an avatar control unit 161, a trigger generation unit 162, and a display control unit 163. At least a part of these units may be implemented by hardware, or may be realized by a processing circuit (processor) of the participant terminal 1a executing a predetermined program stored in the storage unit 14.
[0036] The avatar control unit 161 generates data for making the avatar act in the virtual space in response to actions made by participant A on the action input unit 13. The activities here include actions such as movement and conversation. This data is transmitted from the communication unit 11 to the content distribution server 3. Note that this data may also be transmitted from the communication unit 11 to the other participant terminals 1b to 1d or the viewer terminal 2.
[0037] The trigger generating unit 162 generates a trigger in response to a predetermined operation on the operating unit 12 or a predetermined action on the action input unit 13 by the user. This trigger is transmitted from the communication unit 11 to the content distribution server 3. Note that this trigger may also be transmitted from the communication unit 11 to the other participant terminals 1b to 1d or the viewer terminal 2. In this embodiment, as examples of triggers, a conversation start trigger corresponding to the start of a conversation with an avatar corresponding to another user and a conversation end trigger corresponding to the end of a started conversation will be described. As will be described later, the position of the avatar arranged in the virtual space is changed in response to the trigger.
[0038] The display control unit 163 receives display control data (described later) transmitted from the content distribution server 3, and causes the display 15 to display the content based on this display control data.
[0039] As an example, the participant terminal 1a may be a smartphone (or a tablet terminal). The smartphone has a touch panel display and a microphone. The touch panel display is, for example, a liquid crystal display and a transparent touch pad arranged on top of each other, and the liquid crystal display functions as the display 15, and the touch pad functions as the operation unit 12 and the action input unit 13.
[0040] Then, the avatar in the virtual space acts according to the participant's operation on the touchpad. For example, when the participant swipes right on the touchpad, the avatar moves right in the virtual space. Also, a microphone may function as the action input unit 13, and the avatar in the virtual space may act according to the participant's speech into the microphone. For example, the user's speech into the microphone may be reflected in the speech of the avatar in the virtual space. In addition, various sensors such as an acceleration sensor and buttons provided on the smartphone may function as the operation unit 12 and / or the action input unit 13.
[0041] As another example, the operation unit 12 of the participant terminal 1a is a stick-type controller for VR (Virtual Reality) that is composed of an operation button, a keyboard, a pointing device, etc. The motion input unit 13 may be a motion sensor that detects the motion of the participant. The avatar in the virtual space moves according to the detected motion (motion data) of the participant. For example, when the participant turns to the right, the avatar turns to the right in the virtual space. Furthermore, the display 15 may be an HMD (Head Mount Display).
[0042] As described above, the participant terminal 1a may be composed of one device such as a smartphone, or may be composed of multiple devices such as a VR controller, a motion sensor, and an HMD.
[0043] [Configuration of viewer device 2] The viewer terminal 2 is used by a user (hereinafter referred to as a "viewer") who views content without participating in the content.
[0044] 3 is a block diagram showing a schematic configuration of the viewer terminal 2. The viewer terminal 2 is obtained by omitting the action input unit 13, the avatar control unit 161, and the trigger generation unit 162 in the participant terminal 1a. If the only purpose is to view the content, a viewer terminal 2 having such a simple configuration is sufficient. Of course, the content may be viewed using the participant terminal 1a without participating in the content.
[0045] [Content distribution server 3 configuration] 4 is a block diagram showing a schematic configuration of the content distribution server 3. The content distribution server 3 includes a communication unit 31, a storage unit 32, and a control unit 33. The content distribution server 3 may be composed of one device or may be composed of multiple devices.
[0046] The communication unit 31 is a communication interface equipped with a NIC for wired or wireless communication, and communicates with the participant terminals 1a to 1d and the viewer terminal 2 via a network. The storage unit 32 is composed of RAM, ROM, etc., and stores programs for executing various control processes, various data, etc. non-temporarily or temporarily.
[0047] The control unit 33 includes an avatar arrangement acquisition unit 331, a trigger detection unit 332, and a display control data distribution unit 333. At least some of these may be implemented in hardware, or may be realized by a processing circuit (processor) of the content distribution server 3 executing a predetermined program stored in the storage unit 32.
[0048] The avatar position acquisition unit 331 acquires the position in the virtual space of each avatar corresponding to each participant from the avatar control unit 161 of the participant terminals 1a to 1d. For example, the position in the virtual space of avatar A is acquired in response to the action of participant A on the action input unit 13 of the participant terminal 1a. The acquired position may be temporarily stored in the storage unit 32. Note that the position in this specification may refer to both the position and the orientation of the avatar in the virtual space, or at least one of them.
[0049] The trigger detection unit 332 detects that a trigger has been generated by the trigger generation unit 162 of the participant terminals 1a to 1d. Here, an avatar that participates in the conversation (hereinafter referred to as a "conversation avatar") is associated with the conversation start trigger. In other words, a conversation avatar is associated with a conversation start trigger, and an avatar that is not associated with the conversation start trigger does not participate in the conversation (hereinafter referred to as a "non-conversation avatar"). The trigger detection unit 322 also identifies the conversation avatar associated with the conversation start trigger. Note that the conversation avatar is usually a plurality of avatars including an avatar corresponding to a participant who uses the participant terminal that generated the conversation start trigger, but it may be only one avatar.
[0050] The display control data distribution unit 333 generates display control data based on the arrangement of each avatar acquired by the avatar arrangement acquisition unit 331 and the trigger detected by the trigger detection unit 332, and distributes the display control data to the participant terminals 1a to 1d and the viewer terminal 2. Specifically, the display control data distribution unit 333 has an avatar control unit 333a and a display control data generation unit 333b.
[0051] The avatar control unit 333a controls the placement of each avatar in the virtual space, and generates avatar placement information indicating the placement of each avatar in the virtual space. The avatar control unit 333a controls the display mode of each avatar, and the avatar placement information may include the display mode of the avatar. This avatar arrangement information is used to display the content on the display 15 of the participant terminals 1a to 1d and the display 23 of the viewer terminal 2, that is, to generate display control data.
[0052] Specifically, until a conversation start trigger is detected, the avatar control unit 333a generates avatar placement information by placing the avatars in the virtual space according to the placement acquired by the avatar placement acquisition unit 331. It can be said that the placement of the avatars until a conversation start trigger is detected faithfully reflects the user's actions on the action input units 13 of the participant terminals 1a to 1d.
[0053] Furthermore, in response to detection of the conversation start trigger, the avatar control unit 333a changes the arrangement of at least some of the avatars (for example, at least some of the conversation avatars) in the virtual space to update the avatar arrangement information. The changed arrangement does not necessarily match the arrangement acquired by the avatar arrangement acquisition unit 331. In other words, the arrangement of the avatars after detection of the conversation start trigger does not faithfully reflect the actions of the participants on the action input units 13 of the participant terminals 1a to 1d.
[0054] The change in arrangement may be a change in the position in the virtual space, a change in the orientation of the avatar in the virtual space, or both. Examples of the change include a change in which the conversation avatar is highlighted, a change in which the conversation avatar approaches a predetermined position, or a change in which the conversation avatar faces a predetermined position. In addition, when only a portion of the virtual space is not displayed on display 15, 23, the position of the conversation avatar may be changed so that all conversation avatars are displayed. Alternatively, the display mode of the conversation avatar may be changed (for example, the conversation avatar is normally 6-head-to-body ratio, but is 8-head-to-body ratio only). Details will be described later.
[0055] It is preferable that the avatar control unit 333a stores the pre-change avatar arrangement in the storage unit 32 so that the pre-change avatar arrangement (the arrangement acquired by the avatar arrangement acquisition unit 331) is not lost.
[0056] Then, in response to detection of a conversation end trigger after the conversation start trigger, the avatar control unit 333a restores the changed avatar arrangement to the arrangement acquired by the avatar arrangement acquisition unit 331, and updates the avatar arrangement information. As a result, the avatar arrangement after detection of the conversation end trigger is restored to one that faithfully reflects the actions of the participants on the action input units 13 of the participant terminals 1a to 1d. At this time, the avatar control unit 333a may use the avatar arrangement stored in the storage unit 32.
[0057] The display control data generation unit 333b uses the avatar arrangement information generated and updated by the avatar control unit 333a to generate display control data for displaying content on the display 15 of the participant terminals 1a to 1d and the display 23 of the viewer terminal 2. The display control data is distributed from the communication unit 31 to the participant terminals 1a to 1d and the viewer terminal 2.
[0058] The rendering of the images displayed on the displays 15 and 23 may be performed by the display control unit 163 of the participant terminals 1a to 1d and the display control unit 251 of the viewer terminal 2, or by the display control data generating unit 333b of the content distribution server 3.
[0059] When the participant terminals 1a to 1d perform rendering, data indicating the arrangement and display mode of each avatar in the virtual space based on the avatar arrangement information is distributed as display control data. Then, based on the display control data, the display control unit 163 of the participant terminals 1a to 1d generates an image of the content in which each avatar is arranged in the virtual space, and displays it on the display 15. The same applies when the viewer terminal 2 performs rendering.
[0060] On the other hand, when the display control data generating unit 333b of the content distribution server 3 performs rendering, the display control data generating unit 333b generates data (image data) corresponding to an image of the content in which each avatar is arranged in the virtual space based on the avatar arrangement information. Then, the generated image data is distributed as display control data. Then, based on this display control data, the display control unit 163, 251 causes the display 15, 23 to display the image of the content.
[0061] As described above, rendering may be performed by the participant terminals 1a to 1d and the viewer terminal 2, or may be performed by the content distribution server 3, but the former is more preferable in order to avoid the occurrence of a time lag.
[0062] Here, the content displayed on the participant terminals 1a-1d and the viewer terminal 2 may be the same for the participant terminals 1a-1d and the viewer terminal 2, but it is preferable that the content is different from one another. Specifically, a virtual space with avatar A as the viewpoint is displayed as content on the participant terminal 1a. The same is true for the participant terminals 1b-1d. Moreover, a virtual space with a viewpoint of a virtual camera set at an arbitrary position in the virtual space (for example, a position that provides a bird's-eye view of the virtual space) is displayed as content on the viewer terminal 2.
[0063] The viewpoint may be switchable. For example, the participant terminal 1a may display the virtual space as seen from the avatar A as an initial setting, but in response to a predetermined operation on the operation unit 12, the virtual space as seen from another avatar or the virtual camera may be displayed. The viewer terminal 2 may display the virtual space as seen from the virtual camera as an initial setting, but in response to a predetermined operation on the operation unit 22, the virtual space as seen from a specific avatar may be displayed. In the virtual space, multiple virtual cameras with different installation positions or different zooms may be set, and it may be possible to switch which virtual camera displays the virtual space from. Furthermore, the entire virtual space may be displayed, or only a part of it may be displayed.
[0064] [Processing operation of content distribution system before conversation starts] 5 is a sequence diagram showing an example of the processing operation of the content distribution system before the start of a conversation. Note that, although only the participant terminal 1a will be described below, the other participant terminals 1b to 1d are similar.
[0065] When participant A performs a predetermined action on the action input unit 13 of the participant terminal 1a, the avatar control unit 161 generates data for moving avatar A in the virtual space and transmits this to the content distribution server 3 (step S1). The action of avatar A here refers to the placement of avatar A in the virtual space, and more specifically, refers to moving avatar A in the virtual space or making avatar A face a specific direction.
[0066] Then, the content distribution server 3 receives the above data. Based on this data, the avatar position acquisition unit 331 acquires the position (position and / or orientation) of avatar A in the virtual space (step S11). This position directly reflects the action of participant A on the action input unit 13.
[0067] Next, based on the acquired position, the avatar control unit 333a sets the position of the avatar A in the virtual space and generates avatar position information (step S12). Again, this position also directly reflects the actions of the participant A on the action input unit 13.
[0068] Next, the display control data generating unit 333b generates display control data based on the generated avatar arrangement information. Then, the display control data is distributed to the participant terminal 1a (step The display control data is also distributed to the other participant terminals 1 b to 1 d and the viewer terminal 2 ).
[0069] In response to the distribution of the display control data from the content distribution server 3, the display control unit 165 of the participant terminal 1a receives the display control data. This display control data is in such a way that the avatars A to D are arranged in the virtual space in accordance with the movements of the participants A to D. Based on such display control data, the display control unit 163 causes the display 15 to display the content (the virtual space in which the avatars are arranged) (step S2). The other participant terminals 1b to 1d and the viewer terminal 2 also display the content in the same manner. The above process is repeated every time data for moving the avatars is transmitted from any of the participant terminals 1a to 1d.
[0070] 6 is a diagram showing a schematic diagram of a state in which avatars A to D are arranged in a virtual space. As shown in the figure, it is assumed that avatars A to D are arranged in order from the left.
[0071] Fig. 7A is a diagram showing a schematic of the content displayed on the display 15 of the participant terminal 1a, and corresponds to Fig. 6. As shown in Fig. 7A, the virtual space seen from avatar A in Fig. 6 is displayed on the display 15 of the participant terminal 1a. When the participant terminal 1a is a smartphone, the normal display 15 is vertically long, so it appears compressed in the horizontal direction, but it faithfully reproduces the positions and orientations of avatars A to D in Fig. 6.
[0072] Fig. 7B is a diagram showing a schematic of the content displayed on the display 15 of the participant terminal 1d, and corresponds to Fig. 6. As shown in Fig. 7B, the virtual space seen from the avatar D in Fig. 6 is displayed on the display 15 of the participant terminal 1b.
[0073] Fig. 7C is a diagram showing a schematic of the content displayed on the display 23 of the viewer terminal 2, and corresponds to Fig. 6. In Fig. 7C, it is assumed that a virtual camera is placed at a position to view the virtual space from above on the front side, and that the entire virtual space is within the field of view of the virtual camera. The virtual space as viewed from this virtual camera is then displayed on the display 23 of the viewer terminal 2.
[0074] When rendering is performed by the participant terminals 1a-1d and the viewer terminal 2, the display control data only needs to indicate the arrangement of the avatars A-D in the virtual space, so the display control data transmitted to the participant terminals 1a-1d and the viewer terminal 2 can be common. Then, each of the participant terminals 1a-1d and the viewer terminal 2 processes the display control data and generates an image showing the avatars A-D and the virtual space as seen from the virtual camera.
[0075] On the other hand, when rendering is performed at the participant terminals 1a to 1d and the viewer terminal 2, image data corresponding to the images shown in Figures 7A to 7C are transmitted as display control data. Therefore, the display control data transmitted to the participant terminals 1a to 1d and the viewer terminal 2 are different from each other.
[0076] [Processing operation of content distribution system after conversation starts] FIG. 8 is a sequence diagram showing an example of the processing operation of the content delivery system after the start of a conversation, which is performed following FIG.
[0077] When participant A instructs participant terminal 1a to start a conversation, trigger generating unit 162 generates a conversation start trigger and transmits it to content distribution server 3 (step S21). Information for identifying an avatar associated with the conversation start trigger, i.e., a conversation avatar, is also transmitted to content distribution server 3. The instruction to start a conversation is given to operation unit 12 and / or action input unit 13.
[0078] If the participant terminal 1a is a smartphone, an instruction to start a conversation may be, for example, speaking into a microphone, entering a specific character or word (such as "!" or "Good morning") in a character input field displayed on a touch panel display, pressing a button, touching a specific icon displayed on the touch panel display, or rotating the smartphone from portrait to landscape orientation (detected by an acceleration sensor).
[0079] Participant A may also specify a conversation avatar. As an example, the conversation avatar may be specified by tapping on any avatar displayed on a touch panel display. Alternatively, any avatar may be selected from a list of avatars placed in the virtual space. Also, in cases such as talking to oneself, it is not necessary to specify a conversation avatar (in this case, the only conversation avatar is avatar A).
[0080] Furthermore, if the participant terminal 1a includes a VR controller, the instruction to start a conversation may be to press a predetermined button on the controller, and a conversation avatar may be specified by a pointer that is displayed in the virtual space in conjunction with the movement of the controller.
[0081] When a conversation start trigger is transmitted, the trigger detection unit 332 of the content distribution server 3 detects the conversation start trigger (step S31). The trigger detection unit 332 also identifies a conversation avatar associated with the conversation start trigger (step S32). Note that the conversation avatar does not necessarily have to be identified by participant A, and may be automatically identified by the trigger detection unit 332 depending on the context of the conversation.
[0082] In response to the detection of the conversation start trigger, the avatar control unit 333a changes the arrangement of at least some of the avatars in the virtual space and updates the avatar arrangement information (step S33). As a result of such change in arrangement, the arrangement of the avatars in the virtual space becomes different from the actions of each participant to the action input unit 13.
[0083] The avatar placement information updated here may differ for each of the participant terminals 1a to 1d and the viewer terminal 2. That is, avatar placement information is generated for each of the participant terminals 1a to 1d and the viewer terminal 2 (in other words, for each avatar and for the virtual camera).
[0084] Next, the display control data generator 333b generates display control data based on the generated avatar arrangement information. The display control data is then distributed to the participant terminal 1a (step S34). The display control data is also distributed to the other participant terminals 1b-1d and the viewer terminal 2. When the avatar arrangement information is different for each of the participant terminals 1a-1d and the viewer terminal 2, the display control information is different for each of the participant terminals 1a-1d and the viewer terminal 2 even when rendering is performed in the participant terminals 1a-1d and the viewer terminal 2.
[0085] In response to the distribution of the display control data from the content distribution server 3, the display control unit 165 of the participant terminal 1a receives the display control data. Compared with the display control data received in step S2 of Fig. 5, this display control data has a changed arrangement of the conversation avatars in the virtual space. Based on this display control data, the display control unit 163 causes the display 15 to display the content (the virtual space in which the avatars are arranged) (step S22). The other participant terminals 1b to 1d and the viewer terminals also display the content in the same manner.
[0086] Even after the conversation start trigger is detected, the avatar placement acquisition unit 331 of the content distribution server 3 acquires the placement of the avatar in the virtual space from the avatar control unit 161 of each participant terminal 1a to 1d, and reflects it in the placement of the avatar or stores it in the memory unit 32 as necessary.
[0087] Fig. 9A is a diagram showing a model of the content displayed on the display 15 of the participant terminal 1a. Fig. 9B is a diagram showing a model of the content displayed on the display 15 of the participant terminal 1d. Fig. 9C is a diagram showing a model of the content displayed on the display 23 of the viewer terminal 2. Figs. 9A to 9C correspond to Figs. 7A to 7C, respectively. It is assumed that a conversation start trigger with avatars A and C as conversation avatars has been detected in the state of Fig. 6, and Fig. 9A shows the viewpoint of the conversation avatar, Fig. 9B shows the viewpoint of a non-conversation avatar, and Fig. 9C shows the viewpoint of a virtual camera.
[0088] As shown in FIG 9A, conversation avatar C, who is the conversation partner of conversation avatar A, is displayed near the center of display 15. More specifically, even if conversation avatar C has not moved from the state in FIG 6 (participant C has not performed any action to move avatar C), conversation avatar C is displayed near the center of display 15 in response to a conversation start trigger. This means that in step S33 in FIG 8, conversation avatar C has been changed so as to be closer to conversation avatar A for participant terminal 1a. Also, conversation avatar C may be displayed larger than in FIG 6.
[0089] In this way, even if the conversation partner conversation avatar C is far away from the user (conversation avatar A) or even if the display 15 is small, the conversation avatar C can be highlighted and displayed in an easy-to-see manner.
[0090] It is also desirable for conversation avatar C to face conversation avatar A (to face forward on display 15). More specifically, even if conversation avatar C is not facing conversation avatar A in the state shown in Fig. 6, conversation avatar C will face conversation avatar A in response to a conversation start trigger. This is because it is natural for conversation avatars A and C to face each other.
[0091] Furthermore, it is preferable that the non-conversational avatars B and D face the conversational avatar A or the conversational avatar C. More specifically, even if the non-conversational avatars B and D are not facing the conversational avatar A or the conversational avatar C in the state of Fig. 6, the non-conversational avatars B and D face the conversational avatar A or the conversational avatar C in response to a conversation start trigger. This is because it is natural for the non-conversational avatars B and D to also focus on the conversational avatar A or the conversational avatar C. Also, the non-conversational avatars B and D may face the conversational avatar A (facing forward on the display 15) when the conversational avatar A speaks, and face the conversational avatar C when the conversational avatar C speaks.
[0092] Furthermore, the positions of non-conversational avatars B and D may be the same as in FIG. 6 or may be different. Even if they are different, it is preferable that the positions in FIG. 6, more specifically, the relative positional relationship between non-conversational avatars B and D, be taken into consideration. For example, since non-conversational avatar D is to the right of non-conversational avatar B in FIG. 6, it is preferable that non-conversational avatar D is also placed to the right of non-conversational avatar B in FIG. 9A to maintain such positional relationship. In any case, since non-conversational avatars B and D are less important than conversational avatar C, they should be displayed appropriately so as not to look unnatural.
[0093] Furthermore, the avatar's remarks may be displayed in a speech bubble. This is similar to the other figures, although not shown.
[0094] Depending on the operation of participant A, the content displayed on display 15 may be switched between FIG. 7A and FIG. 9A.
[0095] As shown in FIG. 9B, the display 15 of the participant terminal 1d corresponding to the non-conversational avatar D 7A. For such content, even after the conversation start trigger is detected, the avatar control unit 333a may continue to generate avatar placement information for the participant terminal 1d based on the placement acquired by the avatar placement acquisition unit 331 without making the change in step S33 in FIG.
[0096] As shown in Fig. 9C, from the viewpoint of the virtual camera, the conversation avatars A and C are displayed near the center of the display 23. This means that in step S33 of Fig. 8, the conversation avatars A and C have been changed for the viewer terminal 2 (for the virtual camera) to be closer to the position of the virtual camera.
[0097] In this manner, even if conversation avatars A and C are far away from each other or even if display 23 is small, conversation avatars A and C are highlighted and can be displayed in an easily visible manner.
[0098] It is also preferable that conversation avatars A and C face the position of the virtual camera (facing forward on display 23). It is further preferable that avatars B and D, which are not conversation avatars, face the conversation avatars A and C. It is also possible that the non-conversation avatars B and D face the conversation avatars A and C when the conversation avatar A speaks, and face the conversation avatar C when the conversation avatar C speaks.
[0099] Furthermore, similarly to FIG. 9A, the positions of non-conversational avatars B and D may be the same as those in FIG. 6 or may be different.
[0100] It should be noted that the content displayed on display 23 may be switchable between FIG. 7C and FIG. 9C in response to an operation by a viewer user.
[0101] Fig. 10 is a modified example of Fig. 9B, and is a diagram showing a schematic diagram of the content displayed on the display 15 of the participant terminal 1d. Unlike Fig. 9B, the conversation avatars A and C face the position of the non-conversation avatar D (facing forward on the display 15). With this type of display, it is easy for the participant D corresponding to the non-conversation avatar D to understand that the avatars A and C facing him / her are conversation avatars.
[0102] Fig. 11 is a modified example of Fig. 9B, and is a diagram showing a schematic diagram of the content displayed on the display 15 of the participant terminal 1d. Unlike Fig. 10, the conversation avatars A and C face each other. This is because it is natural to display them facing each other and having a conversation. Note that, in Fig. 9C as well, the conversation avatars A and C may face each other.
[0103] FIG. 12 is another modified example of FIG. 9B, and is a diagram showing a schematic diagram of the content displayed on the display 15 of the participant terminal 1d. Unlike FIG. 10 and FIG. 11, the conversation avatar A may face a position between the non-conversation avatar D and the conversation avatar C, and the conversation avatar C may face a position between the non-conversation avatar D and the conversation avatar A. This makes it easy for the participant D corresponding to the non-conversation avatar D to understand that the avatars A and C are conversation avatars, and the conversation avatars A and C appear to be facing each other, which is natural. Note that in FIG. 9C as well, the conversation avatar A may face a position between the virtual camera and the conversation avatar C, and the conversation avatar C may face a position between the virtual camera and the conversation avatar A.
[0104] Fig. 13 is yet another modified example of Fig. 9B, and is a diagram showing a schematic diagram of content displayed on the display 15 of the participant terminal 1d. As in Fig. 9A, the conversation avatars A and C may be displayed near the center of the display 15. In this case, the orientation of the conversation avatars A and C may be the same as any of Figs. 10 to 12.
[0105] Note that, regarding the arrangement of conversational avatars and non-conversational avatars, a plurality of templates may be determined in advance and stored in storage unit 32. Then, when a conversation start trigger is detected, avatar control unit 333a selects an appropriate template based on rules determined according to the number of conversational avatars and non-conversational avatars, etc. Then, avatar control unit 333a may place each avatar in the virtual space by fitting each avatar into the selected template.
[0106] [Processing operation of the content distribution system after the conversation ends] FIG. 14 is a sequence diagram showing an example of the processing operation of the content distribution system after the conversation ends, which is performed following FIG.
[0107] When participant A instructs the participant terminal 1a to end the conversation, the trigger generation unit 162 generates a conversation end trigger and transmits it to the content distribution server 3 (step S41). The instruction to end the conversation is sent to the operation unit 12 and / or the action input unit 13. The instruction to end the conversation may be the same as the instruction to start the conversation.
[0108] For example, if the participant terminal 1a is a smartphone, the instruction to end the conversation may be, for example, speaking into a microphone, entering a specific character or word in a character input field displayed on a touch panel display, pressing a button, touching a specific icon displayed on a touch panel display, or rotating the smartphone from landscape to portrait orientation (detected by an acceleration sensor).
[0109] Furthermore, if the participant terminal 1a includes a VR controller, the instruction to end the conversation may be given by pressing a predetermined button on the controller.
[0110] When the conversation end trigger is transmitted, the trigger detection unit 332 of the content distribution server 3 detects the conversation end trigger (step S51).
[0111] In response to detection of the conversation end trigger, the avatar control unit 333a restores the avatar arrangement changed in step S33 of Fig. 8 to its original arrangement (step S52). Specifically, the avatar control unit 333a sets the arrangement of avatar A in the virtual space based on the avatar arrangement acquired by the avatar arrangement acquisition unit 331, and updates the avatar arrangement information. As a result, the arrangement of each avatar in the virtual space is restored to one that directly reflects the actions of the participants to the action input unit 13.
[0112] Next, the display control data generating unit 333b generates display control data based on the avatar arrangement information and distributes it to the participant terminal 1a (step S53). The display control data is also distributed to the other participant terminals 1b to 1d and the viewer terminal 2.
[0113] The participant terminal 1a receives the display control data in response to the distribution of the display control data from the content distribution server 3. Based on this display control data, the display control unit 163 causes the display 15 to display the content (the virtual space in which the avatars are arranged) (step S42). The other participant terminals 1b to 1d and the viewer terminals also display the content in the same manner.
[0114] As a result, the display as shown in Figs. 9A to 9C after the detection of a conversation start trigger returns to the display as shown in Figs. 7A to 7C upon detection of a conversation end trigger.
[0115] In this manner, in this embodiment, the location of the avatar in the virtual space is changed in response to the start of a conversation trigger, thereby making it possible to display the avatar in the virtual space in an easily viewable manner.
[0116] Although the preferred embodiment of the present disclosure has been described above, the present disclosure is not limited to the specific embodiment, and the present disclosure includes the invention described in the claims and its equivalents. In addition, the configurations of the devices described in the above embodiments and modifications can be combined as appropriate as long as no technical contradiction occurs. [Explanation of symbols]
[0117] 1a~1d Participant terminals 11 Communications Department 12 Control section 13 Operation input section 14 Storage section 15 Display 16 Control section 17 Avatar Control Unit 18 Trigger Generation Section 19 Display control section 2. Viewer terminal 21 Communications Department 22 Control section 23 Display 24 Memory section 25 Control Unit 26 Display control section 3 Content distribution server 31 Communications Department 32 Storage section 33 Control Unit 331 Avatar Placement Acquisition Unit 332 Trigger detection unit 333 Display Control Data Distribution Unit 333a Avatar control unit 333b Display control data generation unit
Claims
1. a virtual character position acquisition unit that acquires a position in a virtual space of a virtual character corresponding to a participant in response to a movement of the participant; a trigger detection unit that detects a first trigger and then detects a second trigger; a display control data distribution unit that generates and distributes display control data for displaying at least a part of the virtual space in which the virtual character is placed, The display control data distribution unit generating the display control data for causing a placement of the virtual character in the virtual space to conform to the placement acquired by the virtual character placement acquisition unit until the first trigger is detected; generating the display control data in which a position of the virtual character in the virtual space is changed in response to the detection of the first trigger; A content distribution device that generates display control data in response to detection of the second trigger, which restores the arrangement of the virtual character in the virtual space, whose arrangement had been changed, to an arrangement that conforms to the arrangement acquired by the virtual character arrangement acquisition unit.
2. the content distribution device is connected to a terminal used by the participant; The content distribution device according to claim 1 , wherein the first trigger and the second trigger are transmitted from the terminal.
3. 3. The content distribution device according to claim 1, wherein the display control data distribution unit generates, in response to detection of the first trigger, display control data in which a position of the virtual character in the virtual space is changed so that the virtual character approaches a predetermined position, and the display control data is for displaying at least a portion of the virtual space as seen from the predetermined position.
4. 3. The content distribution device according to claim 1, wherein the display control data distribution unit generates, in response to detection of the first trigger, display control data in which a position of the virtual character in the virtual space is changed so that the virtual character faces a predetermined position, the display control data being for displaying at least a portion of the virtual space as seen from the predetermined position.
5. 5. The content placement device according to claim 1, wherein the virtual character position acquisition unit acquires the position of the virtual character in the virtual space in response to an input by a participant to an input interface.
6. Computer, a virtual character position acquisition unit that acquires a position in a virtual space of a virtual character corresponding to a participant in response to a movement of the participant; a trigger detection unit that detects a first trigger and then detects a second trigger; a display control data distribution unit that generates and distributes display control data for displaying at least a part of the virtual space in which the virtual character is placed; The display control data distribution unit generating the display control data for causing a placement of the virtual character in the virtual space to conform to the placement acquired by the virtual character placement acquisition unit until the first trigger is detected; generating the display control data in which a position of the virtual character in the virtual space is changed in response to the detection of the first trigger; In response to the detection of the second trigger, the virtual character whose position has been changed is the content delivery program generating the display control data in which the arrangement of the character in the virtual space is restored to an arrangement that conforms to the arrangement acquired by the virtual character arrangement acquisition unit.
7. A virtual character position acquisition unit acquires a position in a virtual space of a virtual character corresponding to a participant in response to a movement of the participant; A step in which a trigger detection unit detects a first trigger and then detects a second trigger; a display control data delivery unit generating and delivering display control data for displaying at least a part of the virtual space in which the virtual character is placed; The display control data distribution unit generating the display control data for causing a placement of the virtual character in the virtual space to conform to the placement acquired by the virtual character placement acquisition unit until the first trigger is detected; generating the display control data in which a position of the virtual character in the virtual space is changed in response to the detection of the first trigger; A content distribution method which generates display control data in response to detection of the second trigger, the display control data restoring the arrangement of the virtual character in the virtual space, whose arrangement had been changed, to the arrangement acquired by the virtual character arrangement acquisition unit.
8. a virtual character control unit that transmits data indicating a position of a virtual character corresponding to the participant in a virtual space to a content distribution server in response to an action of the participant; a trigger generating unit that transmits a first trigger to the content distribution server in response to an instruction from the participant, and then transmits a second trigger to the content distribution server; a display control unit that displays at least a part of the virtual space in which the virtual character is placed based on display control data distributed from the content distribution server, The display control unit is before transmitting the first trigger, receiving the display control data for causing a position of the virtual character in the virtual space to correspond to an action of the participant; receiving the display control data in which a position of the virtual character in the virtual space has been changed after the first trigger is transmitted; After the second trigger is transmitted, the content display device receives the display control data to change the position of the virtual character in the virtual space, whose position has been changed, to a position corresponding to the action of the participant.
9. Computer, a virtual character control unit that transmits data indicating a position of a virtual character corresponding to the participant in a virtual space to a content distribution server in response to an action of the participant; a trigger generating unit that transmits a first trigger to the content distribution server in response to an instruction from the participant, and then transmits a second trigger to the content distribution server; a display control unit that displays at least a part of the virtual space in which the virtual character is placed, based on display control data distributed from the content distribution server; The display control unit is before transmitting the first trigger, receiving the display control data for causing a position of the virtual character in the virtual space to correspond to an action of the participant; receiving the display control data in which a position of the virtual character in the virtual space has been changed after the first trigger is transmitted; The content display program receives the display control data that changes the position of the virtual character in the virtual space, whose position has been changed after the second trigger is transmitted, to a position corresponding to the action of the participant.
10. A virtual character control unit controls a virtual character corresponding to the participant in response to the participant's action. transmitting data indicating a placement of the character in the virtual space to a content distribution server; A trigger generating unit generates a first trigger for the content distribution server in response to an instruction from the participant. and then transmitting a second trigger to the content distribution server; a display control unit that displays at least a part of the virtual space in which the virtual character is placed, based on display control data distributed from the content distribution server; The display control unit is before transmitting the first trigger, receiving the display control data for causing a position of the virtual character in the virtual space to correspond to an action of the participant; receiving the display control data in which a position of the virtual character in the virtual space has been changed after the first trigger is transmitted; The content display method receives the display control data for changing the position of the virtual character in the virtual space, whose position has been changed after the second trigger is transmitted, to a position corresponding to the action of the participant.
11. A content distribution device according to any one of claims 1 to 5, A system comprising: the content display device according to claim 8 .
12. The system according to claim 11 , wherein the content distribution device transmits the display control data to the content display device, thereby causing the content display device to display at least a portion of the virtual space in which the virtual character is located.
Citation Information
Patent Citations
Three-dimensional virtual reality space display processor, display processing method and information providing medium
JP1998154053A
Virtual three-dimensional space conversation system
JP2002312295A
E-mail content displaying program
JP2003167826A
Visual instruction of current voice speaker
JP2005100420A
Cellular phone
JP2006129196A
