Control program for a terminal device, terminal device, control method for a terminal device, control program for a server device, server device, and control method for a server device

Abstract

To improve a motivation of a user to continue a communication with the other user.SOLUTION: A control program for a terminal device causes a terminal device of a first user to: display at least a first image including a first object indicating the first user and a second image including a second object indicating a second user; transmit information relating to the display of the first image to a terminal device of the second user; in a case where a first voice of the first user is acquired, transmit the first voice to the terminal device of the second user; display the first image including the first object which is changed in accordance with an action or the first voice of the first user; in a case where a second voice of the second user is received, output the second voice; display the second image including the second object which is changed in accordance with an action or the second voice of the second user; display the first object changed in accordance with an instruction from the first user; and display the second image changed in accordance with the instruction from the first user.SELECTED DRAWING: Figure 3

Description

Technical Field

[0001] The embodiments disclosed in this specification relate to a control program for a terminal device, a terminal device, a control method for a terminal device, a control program for a server device, a server device, and a control method for a server device.

Background Art

[0002] Conventionally, there has been known an information system that realizes communication by a plurality of users each using a terminal device such as a PC (Personal Computer) to transmit various information such as an image indicating each user himself / herself and / or the voice of each user to the terminal devices of other users. For example, Non-Patent Document 1 discloses a technology of an information system that realizes voice chat between users by sharing images and voices of each user acquired from a camera and a microphone provided in the PC of each user connected to the Internet. Further, Non-Patent Document 1 discloses a technology in which, by using a function called "screen sharing", each PC of other users acquires and shares a moving image or the like from the PC of any user participating in the voice chat.

Prior Art Documents

Non-Patent Documents

[0003]

Non-Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the conventional information system, when a user communicates with another user, there is no diversity in the output from the user's terminal device, so there has been a problem that the user gets bored with communicating with another user.

[0005] The disclosed control program for a terminal device, the terminal device, the control method for the terminal device, the control program for a server device, the server device, and the control method for the server device can improve the willingness of a user who intends to continue communicating with another user.

Means for Solving the Problems

[0006] The control program for a terminal device is a control program for a terminal device of a first user, and causes the terminal device of the first user to display at least a first image including a first object indicating the first user and a second image including a second object indicating a second user different from the first user, transmit information regarding the display of the first image to the terminal device of the second user, transmit the first voice of the first user to the terminal device of the second user when the first voice of the first user is acquired, display a first image including a first object that changes according to the operation or the first voice of the first user, output the second voice when the second voice of the second user is received, display a second image including a second object that changes according to the operation or the second voice of the second user, and receive information for displaying a third image including a third object indicating a distribution user from the terminal device of the distribution user according to a first instruction by the first user or a first instruction by the second user, and display the third image.

[0007] In addition, in the control program of the terminal device, when the second voice of the second user is received by the terminal device of the first user during the display of the third image, output the second voice, and when the third voice of the distribution user is received, output the third voice. It is preferable that the first voice obtained when the first voice of the first user is acquired and transmitted to the terminal device of the second user is not transmitted to the terminal device of the distribution user.

[0008] In addition, in the control program of the terminal device, cause the terminal device of the first user to change the display of the first image and the second image in response to the display of the third image, and end the display of the third image in response to the second instruction by the first user or the second instruction by the second user, and return to before the change of the display of the first image and the second image. It is preferable to execute this.

[0009] In addition, in the control program of the terminal device, it is preferable that the change in the display of the first image and the second image is to change the size or position of the first image and the second image, or to change the first image and the second image to a fourth image including a first object and a second object.

[0010] In addition, in the control program of the terminal device, it is preferable to cause the terminal device of the first user to display a third image including a fourth object corresponding to the third instruction by the first user or the third instruction by the second user during the display of the third image.

[0011] In addition, in the control program of the terminal device, when the conditions regarding the display request of the third instruction by the first user and / or the third instruction by the second user are satisfied during the display of the third image, cause the terminal device of the first user to display a third image including a fifth object. It is preferable to execute this.

[0012] Also, in the control program of the terminal device, the conditions regarding the display request are that the fourth object corresponding to the third instruction by the first user and the fourth object corresponding to the third instruction by the second user are specific types of objects that are different from each other, and that the time difference between the timing of the third instruction by the first user and the timing of the third instruction by the second user is within a predetermined time. This is preferably the case.

[0013] Also, in the control program of the terminal device, in the display of the third image including the fifth object, when the conditions regarding the display request are satisfied on the terminal device of the first user, it is preferable to execute the display of the third image including the fifth object without displaying the fourth object corresponding to the third instruction by the first user and the fourth object corresponding to the third instruction by the second user.

[0014] Also, in the control program of the terminal device, in the display of the third image including the fourth object, it is preferable to execute the inclusion of the fourth object with the display mode changed according to the number of times of the third instruction by the first user and / or the second user in the third image on the terminal device of the first user.

[0015] Also, in the control program of the terminal device, during the display of the third image, when a predetermined condition regarding the total number corresponding to the fourth instruction by the first user and / or the second user is satisfied on the terminal device of the first user, it is preferable to execute the display of the third image including the sixth object.

[0016] Also, in the control program of the terminal device, in the display of the third image including the sixth object, it is preferable to execute the display of an image regarding the first user and the second user that is located near the sixth object or superimposed on the sixth object on the terminal device of the first user.

[0017] Also, in the control program of the terminal device, a first input object for the first user to select a sixth object is displayed on the terminal device of the first user. When the first input object is specified by the first user, a second input object for the first user to input a fourth instruction is displayed, and information regarding the selection of the sixth object is transmitted to the terminal device of the second user. It is preferable that the information regarding the selection of the sixth object is used to display a second input object for the second user to input a fourth instruction on the terminal device of the second user that has received the information.

[0018] The control program of the server device is a control program of a server device capable of communicating with each of the terminal device of the first user and the terminal device of a second user different from the first user. The control program receives information regarding the display of a first image including a first object indicating the first user from the terminal device of the first user, receives information regarding the display of a second image including a second object indicating the second user from the terminal device of the second user, transmits information for displaying at least the first image to at least the terminal device of the second user, transmits information for displaying at least the second image to at least the terminal device of the first user, when receiving the first voice of the first user, transmits the first voice to the terminal device of the second user, transmits information for displaying a first image including a first object that changes according to the operation or the first voice of the first user to at least the terminal device of the second user, when receiving the second voice of the second user, transmits the second voice to the terminal device of the first user, transmits information for displaying a second image including a second object that changes according to the operation or the second voice of the second user to at least the terminal device of the first user, and transmits information for displaying a third image including a third object indicating the distribution user, received from the terminal device of the distribution user, to the terminal device of the first user and the terminal device of the second user according to a first instruction by the first user or a first instruction by the second user.

[0019] The terminal device is a terminal device of a first user, and displays at least a first image including a first object indicating the first user and a second image including a second object indicating a second user different from the first user, transmits information regarding the display of the first image to the terminal device of the second user, and when acquiring the first voice of the first user, transmits the first voice to the terminal device of the second user, displays a first image including a first object that changes according to the operation or the first voice of the first user, and when receiving the second voice of the second user, outputs the second voice, displays a second image including a second object that changes according to the operation or the second voice of the second user, and receives, in response to a first instruction by the first user or a first instruction by the second user, information for displaying a third image including a third object indicating a distribution user from the terminal device of the distribution user, and displays the third image, and includes a processing unit.

[0020] The server device is a server device capable of communicating with each of the terminal device of the first user and the terminal device of a second user different from the first user, receives information regarding the display of a first image including a first object indicating the first user from the terminal device of the first user, receives information regarding the display of a second image including a second object indicating the second user from the terminal device of the second user, transmits information for displaying at least the first image to at least the terminal device of the second user, transmits information for displaying at least the second image to at least the terminal device of the first user, and when receiving the first voice of the first user, transmits the first voice to the terminal device of the second user, transmits information for displaying a first image including a first object that changes according to the operation or the first voice of the first user to at least the terminal device of the second user, and when receiving the second voice of the second user, transmits the second voice to the terminal device of the first user, transmits information for displaying a second image including a second object that changes according to the operation or the second voice of the second user to at least the terminal device of the first user, and transmits, in response to a first instruction by the first user or a first instruction by the second user, information for displaying a third image including a third object indicating a distribution user received from the terminal device of the distribution user, to the terminal device of the first user and the terminal device of the second user, and includes a processing unit.

[0021] The control method of the terminal device is a control method of the terminal device of the first user. The terminal device of the first user displays at least a first image including a first object indicating the first user and a second image including a second object indicating a second user different from the first user, transmits information regarding the display of the first image to the terminal device of the second user, and when the first voice of the first user is acquired, transmits the first voice to the terminal device of the second user, displays a first image including a first object that changes according to the operation or the first voice of the first user, outputs the second voice when the second voice of the second user is received, displays a second image including a second object that changes according to the operation or the second voice of the second user, and receives information for displaying a third image including a third object indicating the distribution user from the terminal device of the distribution user according to a first instruction by the first user or a first instruction by the second user, and displays the third image.

[0022] A control method for a server device is a control method for a server device capable of communicating with each of a terminal device of a first user and a terminal device of a second user different from the first user. The method includes receiving, from the terminal device of the first user, information regarding the display of a first image including a first object indicating the first user; receiving, from the terminal device of the second user, information regarding the display of a second image including a second object indicating the second user; transmitting, to at least the terminal device of the second user, information for displaying at least the first image; transmitting, to at least the terminal device of the first user, information for displaying at least the second image; transmitting, to the terminal device of the second user, the first voice when the first voice of the first user is received; transmitting, to at least the terminal device of the second user, information for displaying a first image including a first object that changes according to the operation or the first voice of the first user; transmitting, to the terminal device of the first user, the second voice when the second voice of the second user is received; transmitting, to at least the terminal device of the first user, information for displaying a second image including a second object that changes according to the operation or the second voice of the second user; and transmitting, according to a first instruction by the first user or a first instruction by the second user, information for displaying a third image including a third object indicating the distribution user, received from the terminal device of the distribution user, to the terminal device of the first user and the terminal device of the second user.

Advantages of the Invention

[0023] The control program for the terminal device, the terminal device, the control method for the terminal device, the control program for the server device, the server device, and the control method for the server device can improve the willingness of a user who wants to continue communication with other users.

Brief Description of the Drawings

[0024]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Embodiments for Carrying Out the Invention

[0025] Hereinafter, various embodiments of the present invention will be described with reference to the drawings. However, it should be noted that the technical scope of the present invention is not limited to those embodiments, but extends to the invention described in the claims and its equivalents.

[0026] (Overview of the Information System) FIG. 1 is a schematic diagram for explaining an example of the overview of the information system. The information system includes a terminal device operated by each of a plurality of users and a server device. For example, the terminal device is an information processing device such as a multifunctional mobile phone (so-called "smartphone") owned by the user. For example, the server device is a computer for providing a communication service between terminal devices via a communication network.

[0027] The terminal device stores a control program such as an application program, loads the control program into the memory in response to a start operation from the user, and starts a communication service by executing instructions included in the loaded control program. When the communication service is started, the terminal device realizes a plurality of functions by executing instructions included in the control program.

[0028] For example, the terminal device of the user realizes a generation function of generating output information including character video data including motion data based on various input data input by the user. For example, the input data is a plurality of imaging data acquired at predetermined sampling time intervals by an imaging device provided in the terminal device of the user, and in this case, the user is shown in each imaging data. The character video data is an example of information regarding the display of a user output image including a character object indicating the user. During the communication service, the output information is generated at predetermined time intervals.

[0029] Also, for example, the terminal device of the user realizes an output function of displaying a user output image based on the character video data and transmitting the generated output information to the terminal device of another user via the server device, and thus transmitting the output information to the server device at predetermined time intervals. Also, for example, the terminal device of the user realizes a function of displaying another user output image including a character object indicating another user based on the output information of another user transmitted from the server device at predetermined time intervals.

[0030] When the communication service is started, as shown in Fig. 1(a), the user's terminal device displays, for example, the user output image (1) and the other user output image (2). When the communication service is started and the other user has not participated in the communication service, only the user output image (1) is displayed by the user's terminal device. When the communication service is started and the user has not participated in the communication service, only the other user output image (2) is displayed on the other user's terminal device.

[0031] The user output image (1) includes the user's character object that operates according to the user's motion data included in the character video data. Also, the other user output image (2) includes the other user's character object that operates according to the other user's motion data included in the received other user's output information. In this way, the user's terminal device displays the user output image (1) including the user's character object that changes according to the user's operation, and the other user output image (2) including the other user's character object that changes according to the other user's operation.

[0032] Since both the user's terminal device and the other user's terminal device are equipped with microphones, the user's terminal device acquires the voice emitted by the user, and the other user's terminal device acquires the voice emitted by the other user. Then, the user's terminal device includes the acquired user voice data in the output information and transmits the output information including the user voice data to the other user's terminal device via the server device, so as to transmit the output information to the server device. Also, the user's terminal device receives from the server device the output information including the other user's voice data transmitted to the server device by the other user's terminal device.

[0033] For example, when voice is generated by a user, the motion data of the user included in the character video data includes face motion data indicating the movement of the user's lips. In this case, on the user's terminal device, a user output image (1) including the user's character object whose lips move in approximate synchronization with the voice generated by the user is displayed. There may be a case where the output information of another user received by the user's terminal device includes the voice data of the other user together with the motion data of the other user. In this case, on the user's terminal device, the voice of the other user is output, and another user output image (2) including the character object of the other user whose lips move in approximate synchronization with the voice of the other user is displayed.

[0034] In addition to the functions described above, the user's terminal device realizes a function of displaying a distribution image based on the output information distributed in a specific distribution event in response to an instruction by the user or an instruction by another user. The distribution image is a user output image based on the character video data of the distributing user. Hereinafter, an example of a specific distribution event by the distributing user will be described.

[0035] In order for the distributing user to start a specific distribution event, the terminal device of the distributing user loads a video distribution application program into the memory in response to an execution start operation from the distributing user, and executes the instructions included in the loaded video distribution application program. The video distribution application program is a partial element program of a control program stored in the terminal device of the distributing user. The video distribution program may be a program different from the control program. In a specific distribution event, the terminal device of the distributing user has a function of transmitting output information including game video data such as character video data including the motion data input by the distributing user to the server device.

[0036] For a viewing user to view the distribution image of the distributing user, the terminal device of the viewing user loads the video distribution application program into the memory in response to an execution start operation from the viewing user, and executes the instructions included in the loaded video distribution application program. In a specific distribution event, the terminal device of the viewing user transmits a viewing instruction for the distribution image that the viewing user desires to view among the distribution images being distributed to the server device in response to a viewing start operation by the viewing user. The server device transmits output information regarding the distribution image that the viewing user desires to view to the terminal device of the viewing user in response to the viewing instruction from the terminal device of the viewing user. When the terminal device of the viewing user receives the output information transmitted by the server device, it displays a distribution image including the character object of the distributing user based on the character video data of the distributing user included in the output information. In this way, the distributing user can implement a distribution event that provides the distribution image related to the distributing user to the terminal devices of one or more viewing users via the server device.

[0037] When the viewing start by the user is operated during the communication service, the terminal device of the user participating in the communication service displays a screen for asking the user whether to also display the distribution image on the terminal devices of other users (Fig. 1(b)). When the terminal device of the user obtains an instruction to also display the distribution image on the terminal devices of other users in response to the user's operation on the displayed screen (Fig. 1(b)), it transmits a viewing instruction for the distribution image to the server device. When a plurality of distribution images are being distributed, information regarding one distribution image according to the selection instruction by the user may be transmitted to the server device together with the viewing instruction.

[0038] When the server device receives the viewing instruction transmitted from the terminal device of the user, it transmits output information for displaying the distribution image corresponding to the viewing instruction of the user to the terminal device of the user and the terminal devices of other users. When a viewing instruction is transmitted from the terminal device of the user, the terminal device of the user and the terminal devices of other users display the distribution image (3) based on the output information transmitted from the server device (Fig. 1(c)).

[0039] When the server device receives a viewing instruction transmitted from the terminal device of another user, it transmits output information for displaying a distribution image corresponding to the viewing instruction of the other user to the terminal device of the user and the terminal device of the other user. When a viewing instruction is transmitted from the terminal device of another user, the terminal device of the user and the terminal device of the other user can display the distribution image (3) based on the output information transmitted from the server device in the same manner as when a viewing instruction is transmitted from the terminal device of the user (Fig. 1(c)).

[0040] In addition, when the output information includes the voice data of the distributing user, the terminal device of the user and the terminal device of the other user display a distribution image (3) including a character object of the distributing user whose lips move so as to be substantially synchronized with the voice generated by the distributing user.

[0041] When the terminal device of the user and the terminal device of the other user display the distribution image (3), as shown in Fig. 1(c), they reduce and display the user output image (1) and the other user output image (2). Also, when the terminal device of the user and the terminal device of the other user display the distribution image (3), they may end the display of the user output image (1) and the other user output image (2).

[0042] As described above with reference to Fig. 1, in the control program of the terminal device of the user, the terminal device of the user, the control method of the terminal device of the user, the control program of the server device, the server device, and the control method of the server device, according to an instruction by the user or an instruction by another user, the terminal device of the user receives, via the server, information for displaying a distribution image including a character object indicating the distributing user transmitted by the terminal device of the distributing user, and displays the distribution image. In this way, by changing the output from the terminal device of the user by the user or another user during the communication service by the control program of the terminal device of the user, the terminal device of the user, the control method of the terminal device of the user, the control program of the server device, the server device, and the control method of the server device, it is possible to improve the user's willingness to continue using for communication.

[0043] In a conventional information system, when a user communicates with another user via a character object such as an avatar indicating the user and then starts another service, the user has to interrupt or terminate the communication service. After that, the user and the other user can receive the provision of another service by instructing the start of the other service to a server device or the like. As described above, in the conventional information system, when the user and the other user receive the provision of another service while receiving the provision of a service, communications related to the interruption or termination of the service and communications related to the start of the other service have occurred. Thus, when the user and the other user receiving the provision of a service attempt to receive the provision of another service during the service, there has been a problem that the processing load on the terminal device and / or the communication load between the terminal device and the server device increases. On the other hand, in the control program for the user's terminal device, the user's terminal device, the control method for the user's terminal device, the control program for the server device, the server device, and the control method for the server device disclosed in the embodiment, the user and the other user can receive the provision of the distribution service only by communicating regarding the start of the distribution service, and it is possible to reduce the processing load on the terminal device and / or the communication load between the terminal device and the server device.

[0044] In the example shown in FIG. 1, the user and the other user are users belonging to a predetermined communication group among a plurality of users who can use the communication service. The predetermined communication group is a group created by either the user or the other user. In the example shown in FIG. 1, character objects of two users are displayed, but character objects of three or more users belonging to the predetermined communication group may be displayed so that three or more users can communicate.

[0045] Also, in the example shown in FIG. 1, the user and other users may be users having a predetermined relationship. Other users having a predetermined relationship with the user are, for example, mutual followers of the user. Note that when the user follows another user and the other user also follows the user (the user and the other user are mutual followers), the user and the other user become mutual followers. Also, other users having a predetermined relationship with the user may be other users having a mutual following relationship with a predetermined user who is mutually following the user. Also, other users having a predetermined relationship with the user may be other users having a friend relationship with the user, or other users in which specific information (phone number, email address, predetermined ID (identification), etc.) is stored in the user's terminal device. Further, when the user's terminal device has a function of distributing a user output image including the user's character object to one or more other users' terminal devices via a server device, other users having a predetermined relationship with the user are other users who have viewed the user output image distributed by the user. In this case, when the user and other users having a predetermined relationship perform communication as shown in FIG. 1, a predetermined communication group composed of the user and other users may be temporarily created by the user's or other users' terminal device or the server device.

[0046] Note that the above description of FIG. 1 is only for deepening the understanding of the content of the present invention. The present invention is specifically implemented in each of the embodiments described below, and may be implemented by various modifications without substantially exceeding the principle of the present invention. All such modifications are included in the scope of the present invention and the disclosure of this specification.

[0047] (Information System 1) FIG. 2 is a diagram showing an example of the schematic configuration of the information system 1. The information system 1 includes terminal devices 2 each operated by a plurality of users and a server device 3. The terminal devices 2 and the server device 3 are interconnected via a communication network such as a base station 4, a mobile communication network 5, a gateway 6, and the Internet 7, for example. Communication between the terminal devices 2 and the server device 3 is performed based on a communication protocol such as the Hypertext Transfer Protocol (HTTP). Also, between the terminal devices 2 and the server device 3, a connection is first established by HTTP communication, and then communication may be performed based on WebSocket, which is a two-way communication with a lower cost (less communication load and processing load) than HTTP communication. Note that the communication method between the terminal devices 2 and the server device 3 is not limited to the above-described method, and any communication method technology may be used between the terminal devices 2 and the server device 3 as long as the present embodiment can be realized.

[0048] The terminal device 2 is an information processing device such as a smartphone. The terminal device 2 may be a mobile phone, a notebook PC, a tablet terminal, a tablet PC, a head-mounted display (HMD), an e-book reader, or a wearable computer, for example. The terminal device 2 may be a portable game machine or a game console, for example. The terminal device 2 may be any information processing device as long as it can output the display of the user and the character objects of other users and the voices of the user and other users.

[0049] In the example shown in FIG. 2, one server device 3 is illustrated as a component of the information system 1, but the server device 3 may be a set of a plurality of physically separate server devices 3. In this case, each of the plurality of server devices 3 may have the same function or may have a distributed function of one server device 3.

[0050] (Terminal device 2) FIG. 3 is a diagram showing an example of the schematic configuration of the terminal device 2. The terminal device 2 is connected to the server device 3 via a communication network such as a base station 4, a mobile communication network 5, a gateway 6, and the Internet 7, and communicates with the server device 3. The terminal device 2 generates character video data including motion data according to various data (such as imaging data) input by the user, and transmits output information including the generated character video data and / or the user's voice data to the server device 3. Further, the terminal device 2 receives output information of other users transmitted from the server device 3, displays a character object of other users based on the received output information, and / or outputs the voice of other users. To realize such functions, the terminal device 2 includes a terminal communication I / F 21, a terminal storage device 22, a display device 23, an input device 24, an imaging device 25, a microphone 26, and a terminal processing device 27.

[0051] The terminal communication I / F 21 is implemented as hardware, firmware, or communication software such as a TCP / IP (Transmission Control Protocol / Internet Protocol) driver or a PPP (Point-to-Point Protocol) driver, or a combination thereof. The terminal device 2 can transmit data to other devices such as the server device 3 and receive data from other devices via the terminal communication I / F 21.

[0052] The terminal storage device 22 is, for example, a semiconductor memory device such as a ROM (Read Only Memory) or a RAM (Random Access Memory). The terminal storage device 22 stores an operating system program, a driver program, a control program, data, etc., which are used for processing in the terminal processing device 27. The driver programs stored in the terminal storage device 22 include an output device driver program for controlling the display device 23 and an input device driver program for controlling the input device 24. The control program stored in the terminal storage device 22 is, for example, an application program for realizing various functions related to communication services. Note that the control program may be transmitted from the server device 3 or other devices.

[0053] The terminal storage device 22 stores, as data, identification information (e.g., user ID (identification)) for uniquely identifying a user who operates the terminal device 2. Further, the terminal storage device 22 stores, as data, background data, model data, etc. Further, the terminal storage device 22 stores, as data, a user table T1, an object table T2, and a group table T3. Further, the terminal storage device 22 may temporarily store data related to a predetermined process.

[0054] The background data is asset data for constructing a virtual space in which character objects of the user and the distribution user exist in the user output image and the distribution image. The background data includes data for drawing the background of the virtual space, data for drawing various objects included in the user output image and the distribution image, and data for drawing various background objects displayed in the user output image and the distribution image other than these. The background data may include object position information indicating the positions of various background objects in the virtual space.

[0055] The display device 23 is a liquid crystal display. Note that the display device 23 may also be an organic EL (Electro-Luminescence) display or the like. The display device 23 displays a moving image corresponding to the moving image data and / or a still image corresponding to the still image data supplied from the terminal processing device 27 on the display screen. Also, the display device 23 may not be a component of the terminal device 2. In this case, the display device 23 may be a display of an HMD capable of communicating with the server device 3, a projection device for Projection Mapping capable of communicating with the terminal device 2 via wire or wirelessly, a retinal projection type projection device, or the like.

[0056] The input device 24 is a pointing device such as a touch panel. When the input device 24 is a touch panel, the input device 24 can detect various touch operations such as taps, double-taps, and drags of the user. The touch panel may be provided with a capacitive proximity sensor and configured to be able to detect non-contact operations of the user. Note that the input device 24 may also be an input key or the like. The user can use the input device 24 to input characters, numbers, symbols, or the position on the display screen of the display device 23. When the input device 24 is operated by the user, the input device 24 generates a signal corresponding to the operation. Then, the input device 24 supplies the generated signal to the terminal processing device 27 as a user instruction.

[0057] The imaging device 25 is a camera having an imaging optical system, an imaging element, an image processing unit, and the like. The imaging optical system is, for example, an optical lens, and forms an image of a light beam from a subject on the imaging surface of the imaging element. The imaging element is a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor), etc., and outputs an image of the subject image formed on the imaging surface. The image processing unit creates moving image data in a predetermined file format at predetermined intervals from the images continuously generated by the imaging element and outputs the data as imaging data. Alternatively, the image processing unit creates still image data in a predetermined file format from the image generated by the imaging element and outputs the data as imaging data.

[0058] The microphone 26 is a sound collecting device configured to acquire the voice emitted by the user and convert it into voice data. The microphone 26 is configured to be able to acquire the user's voice input, convert the user's voice input acquired by the microphone 26 into voice data, and output the voice data to the terminal processing device 27.

[0059] The terminal processing device 27 is a processor that loads the operating system program, driver program, and control program stored in the terminal storage device 22 into the memory and executes the instructions included in the loaded programs. The terminal processing device 27 is, for example, an electronic circuit such as a CPU (Central Processing Unit), MPU (Micro Processing Unit), DSP (Digital Signal Processor), GPU (Graphics Processing Unit), or a combination of various electronic circuits. The terminal processing device 27 may be realized by an integrated circuit such as an ASIC (Application Specific Integrated Circuit), PLD (Programmable Logic Device), FPGA (Field Programmable Gate Array), MCU (Micro Controller Unit). In FIG. 3, the terminal processing device 27 is illustrated as a single component, but the terminal processing device 27 may be a set of a plurality of physically separate processors.

[0060] The terminal processing device 27 functions as a generation unit 271, a transmission unit 272, a reception unit 273, a display processing unit 274, and a voice output unit 275 by executing various instructions included in the control program. The functions of the generation unit 271, the transmission unit 272, the reception unit 273, the display processing unit 274, and the voice output unit 275 will be described later.

[0061] (Various Tables) FIG. 4 is a diagram showing an example of the data structures of a user table T1, an object table T2, and a group table T3 stored in the terminal storage device 22. Note that at least one of the user table T1, the object table T2, and the group table T3 may be stored in the server storage device 32 of the server device 3. In this case, the terminal device 2 may receive the latest table stored in the server storage device 32 at a predetermined timing and store it in the terminal storage device 22.

[0062] (User Table T1) FIG. 4(a) is an example of the data structure of a user table T1 for managing users who participate in a communication service. In the user table T1, for each user, a user ID, the name of the user, the user's character object, the objects owned by the user, and the objects in use, etc. are stored in association with each other. In the user table T1, information indicating the total amount of coins (virtual currency value "coins") owned by the user and / or user points, etc. may be stored in association with the user ID of the user. The user ID is an example of identification data for uniquely identifying each user. The name is an example of data indicating the name of each user.

[0063] For example, a character object is a model ID for identifying model data for generating an animation of the character object. The model data is stored in the terminal storage device 22 in association with the model ID. The model data may be three-dimensional model data for generating a three-dimensional animation, or two-dimensional model data for generating two-dimensional model data. The model data includes, for example, rig data (so-called "skeleton data") indicating the skeleton of the face and parts other than the face of the character object, and surface data indicating the shape and texture of the surface of the character object. The model data may include a plurality of different model data. Each of the plurality of model data may have different rig data or the same rig data. Each of the plurality of model data may have different surface data or the same surface data.

[0064] A possessed object is an object ID indicating an object possessed by each user. The possessed object is a wearable object that can be associated with a specific part of the character object, a wallpaper object arranged on the back of the character objects of the user and the distribution user in the user output image and the distribution image, and the like. Details of the wearable object and the wallpaper object will be described later. The possessed object is an object selected by a lottery game executed by the user's terminal device 2 or the server device 3 by the user's operation. Also, the possessed object may be an object that the user has come to possess by consuming the virtual currency value "coin" in the purchase function in the information system 1.

[0065] The usage object is an object ID indicating an object used in the user output image being displayed on the user's terminal device 2. For example, during a communication service, when a user's change instruction is input, a wearable object held as the user's own object is worn on the user's character object included in the user output image being displayed. In this case, the object ID of the wearable object worn on the user's character object is stored in the user table T1 in association with the user ID as the usage object. Also, for example, during a communication service, when a user's change instruction is input, a wallpaper object held as the user's own object is arranged behind the user's character object in the user output image being displayed. In this case, the object ID of the wallpaper object arranged in the user output image is stored in the user table T1 in association with the user ID as the usage object.

[0066] (Object Table T2) Figure 4(b) is an example of the data structure of the object table T2 that manages the objects selected as additional objects. The additional object is, for example, a gift object that a user gives to another user. In the object table T2, for each additional object, the object ID, name, image information, rarity, and placement location, etc. are stored in association with each other.

[0067] The object ID is an example of identification data for uniquely identifying each additional object. The image information is one or more still images corresponding to each additional object. The image information may also be one or more types of moving images corresponding to each additional object. The rarity is information indicating the degree of rarity of each additional object. The placement location is information indicating the location where the image information of each additional object is displayed. Note that when the display position and display range of the character object are determined, information indicating the relative position with respect to the character object may be stored as the placement location.

[0068] Additional objects are classified into multiple types (categories). For example, additional objects include effect objects used as effect gifts, normal objects used as normal gifts, wearable objects used as wearable gifts, and message objects used as message gifts. The additional objects may include wallpaper objects arranged on the back of character objects in the user output image and the distribution image. Note that information indicating the type (category) of the additional object may be stored in the object table T2 in association with the object ID of the additional object. Hereinafter, the image information and the arrangement location will be described according to the type of the additional object.

[0069] An effect object is an object that affects the overall impression of the user output image and / or another user output image. Also, an effect object is an object that affects the overall impression of the distribution image. An effect object is, for example, an object imitating confetti. When the effect object is an object imitating confetti, an image showing a plurality of pieces of paper is stored as the image information.

[0070] Information indicating "space" is stored as the location where the effect object is placed. For example, an object imitating confetti is displayed over the entire user output image and / or other user output images. Note that the effect object may be displayed over the entire screen (communication screen described later) including the user output image and other user output images according to the user's instruction. Also, the effect object may be displayed only within the output image selected by the user among the user output image and other user output images. Further, the effect object may be displayed so as to overlap with the character object included in the user output image and / or other user output images. Different from the wearable object described later, the effect object is displayed without being associated with a specific part of the character. In this way, by displaying the effect object according to the user's instruction, the terminal device 2 of the information system 1 can change the overall impression of the user output image and / or other user output images compared to before the effect object is displayed. Note that in the distribution image as well, the above-described effect object is displayed in the same manner.

[0071] Normally, an object is an object that imitates, for example, a stuffed toy, a bouquet of flowers, an accessory, or an item suitable for a gift or present. Information indicating "space" as the placement location of the normal object is stored. For example, information regarding a predetermined movement route is associated with the normal object, and a normal object moving along the predetermined movement route within the user output image, within another user output image, or within the distribution image is displayed. The information indicating "space" stored as the placement location of the "normal object" may be classified into multiple types. The multiple types of "space" are, for example, "central space" (the area in the center of the image when the user output image or another user output image is divided into three parts horizontally), "left space" (the area on the left side of the image when the user output image or another user output image is divided into three parts horizontally), and "right space" (the area on the right side of the image when the user output image or another user output image is divided into three parts horizontally). Also, the multiple types of "space" may be "central space" (the area in the center of the image when the user output image or another user output image is divided into three parts vertically), "upper space" (the area on the upper side of the image when the user output image or another user output image is divided into three parts vertically), and "lower space" (the area on the lower side of the image when the user output image or another user output image is divided into three parts vertically). In this case, the movement route associated with the normal object is set within the type of "space" associated as the placement location of the normal object. For example, when information indicating "right space" is stored in the normal object, information regarding a movement route for the normal object to move within the area on the right side of the image when the user output image or another user output image is divided into three parts horizontally is associated with the normal object. Also, a normal object moving along a predetermined movement rule may be displayed starting from a position set for each normal object within the user output image or another user output image or a position automatically determined randomly. The predetermined movement rule is, for example, a movement rule set such that the normal object moves as if it is in free fall. Note that the normal object may be displayed so as to overlap with the character object. In this case, unlike the wearable object described later, the normal object is displayed without being associated with a specific part of the character object.In addition, a normal object may be displayed so as to perform a movement that bounces back at the timing of contacting the character object. Note that in the distribution image as well, the above-described effect object is similarly displayed.

[0072] When the normal object is displayed overlapping the character object, for example, the normal object may be displayed so as to overlap with a part other than the "head excluding the 'face'" of the character object. In this case, the normal object is displayed so as not to overlap with the "head" of the character object. Also, the normal object may be displayed so as to overlap with a part other than the "upper body including the 'face'" of the character object. In this case, the normal object is displayed so as not to overlap with the "upper body" of the character object.

[0073] The worn object is an object that is displayed in the user output image, other user output image, or distribution image in association with a specific part (wearing location) of the character object. For example, the specific part may be the front left side, front right side, rear left side, rear right side, front center side, rear center side, left eye, right eye, left ear, right ear, and entire hair of the head of the character object. Also, the specific part may be the thumb, ring finger, wrist, elbow, shoulder, forearm, entire hand, entire arm, etc.

[0074] The worn object associated with a specific part of the character object is displayed in the user output image, other user output image, or distribution image so as to contact the specific part of the character object. Also, the worn object associated with a specific part of the character object may be displayed in the user output image, other user output image, or distribution image so as to cover a part or all of the specific part of the character object. The specific part may be specified by three-dimensional position information indicating a position in the three-dimensional coordinate space, or may be associated with the position information of the three-dimensional coordinate space.

[0075] The image information of the worn object is, for example, image information imitating an accessory (such as a hairpin, necklace or earrings) worn on a character object, clothing (such as a T-shirt or a one-piece dress), a costume, and other items that can be worn by a character object.

[0076] As the placement location of the worn object, information indicating the wearing part showing which part of the character object the worn object is associated with is stored. For example, when the worn object is a "hairpin", information indicating the "head" of the character object is stored as the placement location of the worn object. Also, when the worn object is a "T-shirt", information indicating the "torso" of the character object is stored as the placement location of the worn object.

[0077] As the placement location of the worn object, information indicating a plurality of wearing parts in a three-dimensional coordinate space may be stored. For example, when the worn object is a "hairpin", information indicating two parts, namely "left side behind the head" and "right side behind the head" of the character object, may be stored as the placement location of the worn object. Thereby, the worn object imitating a "hairpin" is displayed as being worn on both the "left side behind the head" and the "right side behind the head" of the character object.

[0078] When a plurality of types of worn objects having a common wearing location are worn on a character object, the plurality of types of worn objects are worn on the character object at intervals of time. Thereby, a plurality of types of worn objects having a common wearing part are not worn on the character object at the same time. For example, when "head" is stored as the wearing location of both the worn object indicating a "hairpin" and the worn object indicating a "hat", the worn object indicating a "hairpin" and the worn object indicating a "hat" are not displayed on the head of the character object at the same time.

[0079] In the object table T2, the display time corresponding to the type of the additional object may be stored in association with the object ID of the additional object. For example, the display time of the worn object may be stored as a longer time than the display time of the effect object and the display time of the normal object. For example, when "60 seconds" is stored as the display time of the worn object, "5 seconds" may be stored as the display time of the effect object, and "10 seconds" may be stored as the display time of the normal object.

[0080] (Group table T3) FIG. 4(c) is an example of the data structure of a group table T3 that manages groups to which a user belongs (groups of users with a friendship relationship, groups with other users who are mutual followers, groups arbitrarily created by the user or other users, etc.). The group table T3 is provided individually for each user, and the group table T3 shown in FIG. 4(c) is the group table T3 of the user who operates the terminal device 2 that stores the group table T3.

[0081] In the group table T3, for each group, the group ID of the group, the name of the group, the belonging users belonging to the group, etc. are stored in association with each other. The group ID is an example of identification data for uniquely identifying each group. The name is an example of data indicating the name of each group. The belonging user is the user ID of each user belonging to the group.

[0082] Returning to FIG. 3, the functions of the generation unit 271, the transmission unit 272, the reception unit 273, the display processing unit 274, and the voice output unit 275 will be described.

[0083] (Generation unit 271) The generation unit 271 acquires the imaging data continuously output by the imaging device 25 from the imaging device 25. For example, the imaging device 25 of the terminal device 2 held by the user is provided in the terminal device 2 such that the face of the user looking at the display screen of the display device 23 is in the shooting direction. The imaging device 25 continuously images the face of the user in the shooting direction, acquires the imaging data of the face of the user, and outputs it to the generation unit 271 of the terminal processing device 27. The imaging device 25 may acquire imaging data by imaging parts other than the face of the user, such as the head, arms, hands (including fingers), chest, torso, legs, or other parts. Further, the imaging device 25 may be a 3D camera capable of detecting the depth of a person's face.

[0084] Based on the continuously acquired imaging data, the generation unit 271 generates face motion data, which is a digital representation of the movement of the user's face, as needed over time. The face motion data may be generated at predetermined sampling time intervals. In this way, the face motion data generated by the generation unit 271 can digitally represent the movement (change in expression) of the user's face in a time series.

[0085] The generation unit 271 may generate body motion data, which is a digital representation of the position and orientation of each part (head, arms, hands (including fingers), chest, torso, legs, or other parts) of the user, together with the face motion data or separately from the face motion data.

[0086] The body motion data may be generated based on detection information from a known motion sensor worn by the user. In this case, the terminal communication I / F 21 of the terminal device 2 has a predetermined communication circuit for acquiring the detection information from the motion sensor worn by the user by wireless communication. Then, the generation unit 271 generates the body motion data based on the detection information acquired by the terminal communication I / F 21. The body motion data may be generated at predetermined sampling time intervals. Thus, the body motion data generated by the generation unit 271 can digitally represent the movement of the user's body in time series.

[0087] The generation of the body motion data based on the detection information from the motion sensor worn by the user may be performed, for example, in a photography studio. In this case, the photography studio may be equipped with a base station, a tracking sensor, and a display. The base station is, for example, a multi-axis laser emitter. The motion sensor worn by the user may be, for example, the Vive Tracker provided by HTC CORPORATION, and the base station may be, for example, the base station provided by HTC CORPORATION.

[0088] In addition, a support computer may be installed in a separate room adjacent to the photography studio. The display in the photography studio may be configured to display information received from the support computer. The server device 3 may be installed in the same room as the room where the support computer is installed. The room where the support computer is installed and the photography studio may be separated by a glass window. In this case, the operator of the support computer can visually recognize the user. The support computer may be configured to be able to change the settings of various devices provided in the photography studio according to the operations of the support. The support computer can, for example, change the setting of the scanning interval by the base station, the setting of the tracking sensor, and the various settings of various other devices. The operator may input a message to the support computer, and the input message may be displayed on the display in the photography studio.

[0089] The generation unit 271 generates character video data including face motion data and / or body motion data generated at any time, and outputs the generated character video data to the display processing unit 274. Hereinafter, the face motion data and the body motion data may be collectively referred to as motion data. In addition, the generation unit 271 generates output information including the generated character video data and the user ID stored in the terminal storage device 22, and outputs the generated output information to the transmission unit 272. Note that when the generation unit 271 acquires the voice data of the user output from the microphone 26, the generation unit 271 generates output information including the generated character video data, the acquired voice data, and the user ID stored in the terminal storage device 22, and outputs the generated output information to the transmission unit 272.

[0090] (Transmission unit 272) The transmission unit 272 transmits the output information output from the generation unit 271 to the server device 3 via the terminal communication I / F 21 together with the destination information. The destination information includes the user IDs of one or more other users who are participating in the communication service with the user. Also, the user ID included in the output information may be used as the destination information. For example, the server device 3 stores the user IDs of one or more other users who are participating in the communication service with the user, and when it acquires the output information, it identifies the user IDs of one or more other users who are participating in the communication service with the user included in the output information, and transmits the received output information to the terminal device 2 of the other user indicated by the identified user ID.

[0091] Also, the transmission unit 272 transmits information indicating various instructions input by the user operating the input device 24 to the server device 3 via the terminal communication I / F 21 together with the user ID stored in the terminal storage device 22 and the destination information. The destination information may not be transmitted together with the information indicating the various instructions, and other information may be transmitted together with the information indicating the various instructions. The various instructions by the user include additional instructions and the like. For example, the additional instruction is transmitted to the server device 3 via the terminal communication I / F 21 together with the object ID of the additional object to be included in the distribution image and the user ID of the user.

[0092] Also, in response to the distribution start instruction by the user, the transmission unit 272 transmits information regarding the distribution start instruction for instructing the start of the distribution event by the user to the server device 3 via the terminal communication I / F 21 together with the user ID of the user stored in the terminal storage device 22. Hereinafter, the user who has given the distribution start instruction may be referred to as the distribution user, and the user ID of the distribution user may be referred to as the distribution user ID.

[0093] Also, the transmission unit 272 (of the terminal device 2 of the distribution user) transmits the output information of the distribution user output from the generation unit 271 to the server device 3 via the terminal communication I / F 21 together with the user ID (distribution user ID) of the distribution user stored in the terminal storage device 22 as output information for displaying the distribution image of the distribution user in the distribution event.

[0094] Also, the transmission unit 272 (of the terminal device 2 of the distribution user) transmits information regarding the distribution end instruction for instructing the end of the distribution event by the distribution user in response to the end instruction of the distribution by the distribution user to the server device 3 via the terminal communication I / F 21 together with the user ID (distribution user ID) of the distribution user stored in the terminal storage device 22.

[0095] Also, in response to the viewing start instruction of the distribution image by the user, the transmission unit 272 transmits information regarding the viewing start instruction to the server device 3 via the terminal communication I / F 21 together with the information regarding the distribution image and the user ID of the user stored in the terminal storage device 22. The information regarding the distribution image is information for specifying the distribution image whose viewing has been instructed by the user, for example, the identification information (distribution image ID) of the distribution image or the user ID of the distribution user who is distributing the distribution image, etc. Hereinafter, the user who has given the viewing start instruction of the distribution image may be referred to as the viewing user, and the user ID of the viewing user may be referred to as the viewing user ID.

[0096] (Receiving unit 273) The receiving unit 273 receives, via the terminal communication I / F 21, output information of other users and information indicating various instructions of other users, etc., transmitted from the server device 3. The receiving unit 273 outputs the received information to the terminal processing device 27. The output information of other users transmitted from the server device 3 is generated by the generation unit 271 of the terminal device 2 of other users and transmitted to the server device 3 by the transmission unit 272 of the terminal device 2 of other users. The output information of other users includes character video data of other users, voice data of other users, user IDs of other users, etc. There may be a case where the output information of other users does not include the voice data of other users, and there may be a case where the output information of other users does not include the character video data of other users.

[0097] Also, the receiving unit 273 receives, via the terminal communication I / F 21, the output information of the distribution user transmitted from the server device 3. The receiving unit 273 outputs the received output information of the distribution user to the terminal processing device 27.

[0098] (Display processing unit 274) (Of the user's terminal device 2) The display processing unit 274 displays, as a user output image, an image drawn based on the motion data (character video data) of the user generated by the generation unit 271 on the display device 23. Also, (of the user's terminal device 2) the display processing unit 274 displays, as an other user output image, an image drawn based on the motion data (character video data) included in the output information of other users received by the receiving unit 273 on the display device 23.

[0099] Also, the display processing unit 274 (of the user's terminal device 2) displays, on the display device 23, as the distribution image of the distribution user, an image drawn based on the motion data (character video data) included in the output information of the distribution user received by the receiving unit 273. The output information of the distribution user received by the receiving unit 273 (of the user's terminal device 2) is output information for displaying the distribution image of the distribution user being distributed, transmitted from the server device 3 in response to information regarding the viewing start instruction transmitted from the user's terminal device 2. Also, the output information of the distribution user received by the receiving unit 273 (of the user's terminal device 2) is output information for displaying the distribution image of the distribution user being distributed, transmitted from the server device 3 in response to information regarding the viewing start instruction transmitted from the terminal device 2 of another user participating in the same communication service as the user.

[0100] Hereinafter, the drawing process of the image based on the motion data will be described. In the drawing process of the image based on the motion data of the user (the user operating the terminal device 2), the user ID stored in the terminal storage device 22 is used, and in the drawing process of the image based on the motion data included in the output information of other users and the distribution user received by the receiving unit 273, the user ID included in the output information is used.

[0101] First, the display processing unit 274 extracts from the user table T1 the model ID of the character object associated with the user ID and the object ID of the object to be used. Next, the display processing unit 274 reads from the terminal storage device 22 the model data associated with the extracted model ID, the image information and the placement location associated with the object ID of the object to be used. Next, the display processing unit 274 generates an animation of the character object with the object to be used attached to the placement location based on the read model data, the image information and the placement location of the object to be used, and the motion data. When the motion data includes face motion data, the display processing unit 274 generates an animation of the character object such that the expression of the character object changes based on the face motion data. Thereby, the display processing unit 274 can generate an animation of the character object that moves in synchronization with the movement of the user's expression based on the read model data and the face motion data. When the motion data includes face motion data and body motion data, the display processing unit 274 generates an animation of the character object that moves in synchronization with the expression and body movement of the user based on the read model data, the face motion data, and the body motion data.

[0102] Next, the display processing unit 274 draws an image including the animation (moving image) of the generated character object and the background image showing the background generated using the background data stored in the terminal storage device 22. Note that the display processing unit 274 may use the wallpaper object stored in the terminal storage device 22 and associated with the communication group in advance as the background image. In this case, the same wallpaper object may be applied as the background image for all users in the communication group. Then, the display processing unit 274 outputs drawing data indicating the drawn image and ends the drawing process of the image based on the motion data. Note that the image drawn based on the character object associated with the user ID stored in the terminal storage device 22 is the user's user output image. Also, the image drawn based on the character object associated with the user ID included in the output information of another received user is the other user output image of the other user. Further, the image drawn based on the character object associated with the user ID included in the output information of the received distribution user is the distribution image of the distribution user.

[0103] In addition, the display processing unit 274 displays a distribution image including an additional object in response to an additional instruction to display an additional object in the distribution image from the user. The display processing unit 274 also displays a distribution image including an additional object in response to an additional instruction for an additional object in the distribution image from another user.

[0104] When the object ID included in the additional instruction for the additional object from the user or another user is the object ID of any effect object, the display processing unit 274 refers to the object table T2, extracts the still image or moving image (image information) of the effect object associated with the object ID included in the additional instruction from the terminal storage device 22, and generates a distribution image including the extracted still image or moving image. For example, when an additional instruction for an effect object showing confetti or fireworks is given, the display processing unit 274 generates a distribution image including a moving image of an effect object (not shown) imitating confetti or fireworks.

[0105] When the object ID included in the addition instruction of the additional object from the user or another user is the object ID of the normal object, the display processing unit 274 refers to the object table T2 and extracts the still image or moving image (image information) and the placement location of the normal object associated with the object ID of the normal object. Next, the display processing unit 274 generates a distribution image including the still image or moving image of the normal object placed at the position indicated by the placement location.

[0106] The display processing unit 274 may generate a distribution image including a moving image of a normal object moving within the display area of the distribution image. Hereinafter, for example, the display processing unit 274 may generate a distribution image including a moving image of a normal object falling from the top to the bottom of the distribution image. In this case, the normal object may be displayed within the display area of the distribution image while falling from the start of the fall to the lower end of the distribution image, and may disappear from the distribution image after falling to the lower end of the distribution image. Note that the movement route of the normal object may be a route in the left-to-right direction, right-to-left direction, upper-left to lower-left direction, or other directions of the distribution image, and may also be a route along a straight orbit, circular orbit, elliptical orbit, spiral orbit, or other orbits.

[0107] When the object ID included in the addition instruction of the additional object from the user or another user is the object ID of the wearable object, the display processing unit 274 displays notification information regarding the wearing instruction within the distribution image. The display processing unit 274 refers to the object table T2 in response to the wearing instruction from the distributing user, and extracts the image information and the placement location of the wearable object associated with the object ID included in the addition instruction. Next, the display processing unit 274 generates a distribution image including a character object with the wearable object worn at the wearing part indicated by the placement location based on the extracted image information and placement location.

[0108] (Audio output unit 275) When the output information of another user includes the voice data of the other user, the voice output unit 275 outputs, from a speaker (not shown), the voice of the other user generated based on the voice data, together with the display of the output image of the other user by the display processing unit 274. As a result, during the lip movement of the character object of the other user included in the output image of the other user, the voice of the other user is output, so that the user can view the output image of the other user including the character object of the other user as if the other user were speaking.

[0109] Also, when the output information of the distributing user includes the voice data of the distributing user, the voice output unit 275 outputs, from a speaker (not shown), the voice of the distributing user generated based on the voice data, together with the display of the distribution image by the display processing unit 274. As a result, during the lip movement of the character object of the distributing user included in the distribution image, the voice of the distributing user is output, so that the user can view the distribution image including the character object of the distributing user as if the distributing user were speaking.

[0110] (Server device 3) FIG. 5 is a diagram showing an example of the schematic configuration of the server device 3. The server device 3 that provides a communication service to each of a plurality of user terminal devices 2 transmits the output information transmitted from the terminal device 2 of one user and the information indicating various instructions to the terminal device 2 of another user different from the one user. For this purpose, the server device 3 includes a server communication I / F 31, a server storage device 32, and a server processing device 33. For example, the terminal device 2 that is the transmission destination of the information by the terminal device 2 of one user is the terminal device 2 of the user indicated by the user ID included in the received transmission destination information.

[0111] The server communication I / F 31 is implemented as hardware, firmware, communication software such as a TCP / IP driver or a PPP driver, or a combination thereof. The server device 3 can transmit information to other devices and receive information from other devices via the server communication I / F 31.

[0112] The server storage device 32 is, for example, a semiconductor memory device such as a ROM or a RAM. The server storage device 32 may be, for example, a magnetic disk, an optical disk, or various other storage devices capable of storing data. The server storage device 32 stores an operating system program, a driver program, an application program, data, etc. used in the processing by the server processing device 33. Note that the server storage device 32 stores, as data, the distribution user ID of the distribution user during distribution, and stores, in association with the distribution user ID of the distribution user, the user ID (viewing user ID) of the viewing user who is viewing the distribution image of the distribution user. Note that the distribution user ID is a kind of information regarding the distribution image. The information regarding the distribution image may be the identification information (distribution image ID) of the distribution image. For example, the distribution image ID, the distribution user ID, and the viewing user ID may be stored in association with each other. Further, the server storage device may store a user table T1, an object table T2, and a group table T3.

[0113] The server processing device 33 is a processor that loads an operating system program, a driver program, and a control program stored in the server storage device 32 into a memory and executes instructions included in the loaded programs. The server processing device 33 is, for example, an electronic circuit such as a CPU, an MPU, a DSP, a GPU, or a combination of various electronic circuits. The server processing device 33 may be realized by an integrated circuit such as an ASIC, a PLD, an FPGA, or an MCU. In FIG. 5, the server processing device 33 is illustrated as a single component, but the server processing device 33 may be a set of a plurality of physically separate processors. The server processing device 33 functions as a server receiving unit 331 and a server transmitting unit 332 by executing various instructions included in the control program.

[0114] (Server receiving unit 331) The server receiving unit 331 receives output information transmitted from the terminal device 2 of any one of a plurality of users and information indicating various instructions via the server communication I / F 31. Note that the server receiving unit 331 may receive destination information together with the output information transmitted from the terminal device 2 and the information indicating various instructions.

[0115] Also, the server receiving unit 331 receives information regarding the distribution start instruction transmitted from the user's terminal device 2 and the user ID via the server communication I / F 31. The server receiving unit 331 stores the received user ID in the server storage device 32 as a distribution user ID indicating the distribution user during distribution. Hereinafter, the user of the terminal device 2 that transmitted the distribution start instruction is referred to as the distribution user. Also, the server receiving unit 331 receives the output information of the distribution user transmitted from the terminal device 2 of the distribution user via the server communication I / F 31 together with the distribution user ID. At a predetermined timing (for example, immediately after receiving the distribution start instruction, after a predetermined time has elapsed since the distribution start instruction), the server receiving unit 331 extracts the model ID of the character object associated with the distribution user ID and the object ID of the used object from the user table T1. Next, the server receiving unit 331 generates a thumbnail image of the character object of the distribution user based on the model data associated with the extracted model ID, the image information and the placement location associated with the object ID of the used object. The server receiving unit 331 stores the generated thumbnail image in the server storage device 32 in association with the information regarding the distribution image as the selected image. The information regarding the distribution image is information for specifying the distribution image instructed by the user to start viewing, for example, the identification information (distribution image ID) of the distribution image or the user ID of the distribution user distributing the distribution image, etc. Also, when a so-called room or world for the viewing user to view the distribution image is set, the information regarding the distribution image may be the room ID or world ID for identifying the room. The thumbnail image stored as the selected image may be any image as long as it is an image showing the character object of the distribution user created in advance. For example, the profile image of the character object of the distribution user may be stored as the thumbnail image.

[0116] Further, the server receiving unit 331 receives information regarding the distribution end instruction transmitted from the terminal device 2 of the distribution user and the distribution user ID via the server communication I / F 31. The server receiving unit 331 deletes the received distribution user ID and the viewing user ID associated with the distribution user ID from among the distribution user IDs stored in the server storage device 32.

[0117] Further, the server receiving unit 331 receives information regarding the viewing start instruction transmitted from the user's terminal device 2, information regarding the distribution image, and the user ID of the user via the server communication I / F 31. The server receiving unit 331 determines whether the received information regarding the distribution image is information regarding the distribution image being distributed. When the received information regarding the distribution image is information regarding the distribution image being distributed, the server receiving unit 331 stores the received user ID of the user in the server storage device 32 in association with the information regarding the distribution image. As a result, the received user ID of the user is stored as the viewing user ID of the viewing user of the distribution image identified by the information regarding the distribution image.

[0118] In addition, when the server receiving unit 331 receives the destination information together with the viewing start instruction from the user's terminal device 2, based on the received destination information, it associates the user IDs of other users belonging to the same communication group as the user (other users who have participated in the communication service and are communicating with the user) with the information regarding the received distribution image and stores them in the server storage device 32. For example, when the destination information includes the user IDs of other users belonging to the same communication group as the user, the server receiving unit 331 extracts the user IDs of other users from the destination information and stores the extracted user IDs in association with the information regarding the distribution image. When the destination information includes a group ID for identifying the communication group to which the user belongs, it refers to the group table T3 etc. stored in the server storage device 32, extracts the user IDs associated with the group ID, and stores the extracted user IDs in association with the information regarding the distribution image. As a result, the user IDs of other users belonging to the same communication group as the user are stored as the viewing user IDs of the viewing users of the distribution image identified by the information regarding the distribution image.

[0119] In this way, due to the viewing start instruction by the user participating in the communication service, output information for displaying the distribution image of the distributing user is transmitted to the user's terminal device 2 and the terminal devices 2 of other users belonging to the same communication group as the user.

[0120] Further, when the server receiving unit 331 receives the information regarding the viewing end instruction transmitted from the terminal device 2 of the viewing user and the viewing user ID, it deletes the same viewing user ID as the received viewing user ID stored in the server storage device 32.

[0121] (Server transmission unit 332) The server transmission unit 332 transmits the output information received by the server reception unit 331 and the information indicating various instructions to the terminal device 2 of another user indicated by the user ID included in the destination information received simultaneously via the server communication I / F 31. Further, the server transmission unit 332 may transmit the information indicating various instructions received by the server reception unit 331 to the terminal device 2 of one or more other users designated by the user who transmitted the information via the server communication I / F 31.

[0122] In addition, the server transmission unit 332 transmits the output information of the distribution user received by the server reception unit 331 to the terminal device 2 of the viewing user indicated by the viewing user ID associated with the distribution user ID of the distribution user stored in the server storage device 32 via the server communication I / F 31. Further, the server transmission unit 332 transmits information indicating various instructions of the viewing user received by the server reception unit 331 to the terminal device 2 of the distribution user indicated by the distribution user ID associated with the user ID of the viewing user, and the terminal device 2 of the viewing user indicated by the user ID of another viewing user associated with the distribution user ID via the server communication I / F 31.

[0123] (Examples of various screens) Hereinafter, with reference to FIGS. 6 to 15, examples of various screens displayed on the display device 23 of the user's terminal device 2 will be described. In FIGS. 6 to 15, a plurality of components with the same reference numerals are components having equivalent functions to each other.

[0124] FIG. 6(a) is a diagram showing an example of a group creation screen 600 displayed on the display device 23 of the user's terminal device 2. The group creation screen 600 includes an other user display area 601, a selection object 602, and a creation button 603. For example, the group creation screen 600 is displayed when a group creation object or the like on a home screen (not shown) displayed in response to the execution of a control program stored in the terminal storage device 22 is selected by an operation of the user input device 24.

[0125] In the other user display area 601, other user information indicating each of the other users having a predetermined relationship with the user is displayed. In the example shown in FIG. 6(a), the display processing unit 274 of the user's terminal device 2 displays the thumbnail image of the character object of the other user and the name of the other user as the other user information.

[0126] The selection object 602 is an operation object for selecting each of the other users indicated by the respective other user information. In the example shown in FIG. 6(a), the display processing unit 274 of the user's terminal device 2 displays a checkbox object corresponding to each other user information as the selection object 602. For example, when the selection object 602 is selected by the operation of the user's input device 24, the selection object 602 is displayed with a "check" mark. In this case, the other user corresponding to the other user information of the selection object 602 with the "check" mark is in a selected state. Also, when the selection object 602 with the "check" mark is selected by the operation of the user's input device 24, the selection object 602 is displayed without the "check" mark. In this case, the other user corresponding to the other user information of the selection object 602 without the "check" mark is in a non - selected state. Each of the selection objects 602 is associated with the user ID of the other user related to the corresponding other user information.

[0127] The creation button 603 is a button object or the like for the user to newly create a communication group. When the creation button 603 is selected by the user's operation of the input device 24, a new group is created with the user operating the terminal device 2 and other users in the selected state in the selection object 602 as the belonging users. For example, the display processing unit 274 of the user's terminal device 2 identifies the user ID of the user stored in the terminal storage device 22 and the user ID of the other user associated with the selection object 602 in the state selected in the selection object 602. Then, the display processing unit 274 associates the user ID of the identified user and the user ID of the other user as the belonging users with the newly created group ID and stores them in the group table T3. At this time, the display processing unit 274 may automatically associate the name of the newly created group with the newly created group ID, or may associate the name of the group input by the user with the newly created group ID.

[0128] When a new group is created in response to the selection of the creation button 603, the display processing unit 274 displays an information exchange screen 700 for the belonging users of the new group. FIG. 7(a) is a diagram showing an example of the information exchange screen 700 displayed on the display device 23 of the user's terminal device 2. The information exchange screen 700 includes a display area 701 for displaying information such as text or images input by each of the belonging users of the new group, information (thumbnail images of character objects, etc.) 702 indicating the belonging users who input the information displayed in the display area 701, an input object 703 for the user to input text or images to be displayed in a new display area 701, and a start object 704 for starting a communication service.

[0129] When the information exchange screen 700 is displayed, the transmission unit 272 of the user's terminal device 2 transmits an instruction to display the information exchange screen, together with information about the new group and destination information, to the server device 3 via the terminal communication I / F 21. The information about the new group is the group ID, name, and each user ID of the users belonging to the new group. The destination information includes the user IDs of other users excluding the user who operates the terminal device 2 among the users belonging to the new group. The server receiving unit 331 of the server device 3 receives the instruction to display the information exchange screen, information about the new group, and destination information via the server communication I / F 31. Note that the server receiving unit 331 may store the received destination information in the server storage device 32. The server transmitting unit 332 of the server device 3 transmits the instruction to display the information exchange screen and information about the new group to the terminal devices 2 of other users indicated by the user IDs included in the destination information via the server communication I / F 31. When the terminal device 2 of another user receives, via the server device 3, the instruction to display the information exchange screen transmitted from the terminal device 2 of the user, it can display the information exchange screen 700 that enables information exchange among the users belonging to the new group.

[0130] Returning to the explanation in FIG. 7(a). For example, when new information is input to the input object 703 by the operation of any of the users belonging to the group, a display area 701 for displaying the new information is added to the information exchange screen 700 displayed by the terminal device 2 of the user who input the information. Further, the transmission unit 272 of the terminal device 2 of the user who input the information transmits the newly input information to the terminal devices 2 of the users belonging to the group other than the user who input the information via the server device 3. As a result, a display area 701 for displaying the new information is also added to the information exchange screen 700 displayed on the terminal devices 2 of other users who are users belonging to the group other than the user who input the information.

[0131] The start object 704 is a button object or the like for starting a communication service that each user belonging to a new group can participate in. When the start object 704 is selected by the user's operation of the input device 24, a start process of the communication service is executed, where the group capable of information exchange by the information exchange screen 700 is set as the communication group. Hereinafter, an example of the start process in response to the user's selection of the start object 704 will be described.

[0132] First, the display processing unit 274 of the user's terminal device 2 displays a communication screen 810 (Fig. 8(b)) that can be displayed by each user's terminal device 2 belonging to the communication group. Also, the display processing unit 274 stores the group ID of the communication group in the terminal storage device 22 as the group ID of the group that started the communication service. Furthermore, the display processing unit 274 stores the user ID of the user in the terminal storage device 22 as the user ID of the user participating in the communication service. Note that if all other users belonging to the communication group have not yet participated in the communication service, only the user's user output information is displayed on the communication screen 810.

[0133] Next, the transmission unit 272 of the user's terminal device 2 transmits an instruction to start a communication service to the server device 3 via the terminal communication I / F 21 together with the user ID of the user stored in the terminal storage device 22, information regarding the communication group, and / or destination information. The information regarding the communication group is the group ID, name, and the respective user IDs of the users belonging to the communication group. The destination information includes the respective user IDs of other users excluding the user operating the terminal device 2 among the users belonging to the communication group. Note that when the destination information is stored in the server storage device 32, the destination information may not be transmitted. The server receiving unit 331 of the server device 3 receives the start instruction, user ID, information regarding the communication group, and / or destination information via the server communication I / F 31. The server transmitting unit 332 of the server device 3 transmits the start instruction, user ID, and information regarding the communication group to the terminal devices 2 of other users indicated by the user IDs included in the destination information via the server communication I / F 31.

[0134] The receiving unit 237 of the terminal device 2 of another user receives from the server device 3 the start instruction, user ID, and information regarding the communication group transmitted from the terminal device 2 of the user. The receiving unit 237 stores the group ID among the information regarding the communication group in the terminal storage device 22 as the group ID of the group that started the communication service. Further, the display processing unit 274 stores the transmitted user ID in the terminal storage device 22 as the user ID of the user participating in the communication service. The display processing unit 274 of the terminal device 2 of another user displays a notification screen (not shown) based on the received information regarding the communication group. In response to the selection of a predetermined object in the notification screen by the user, the display processing unit 274 displays a group selection screen 710 (FIG. 7(b)) for participating in the communication service on the display device 23. Thus, the start processing is completed. Note that the display processing unit 274 of the terminal device 2 of another user may include a participation button 805, which will be described later, in the notification screen. Thereby, without displaying the group selection screen 710, other users can immediately participate in the communication service.

[0135] The start processing may be executed when the creation button 603 of the group creation screen 600 is selected by an operation of the input device 24 by the user. That is, in response to the selection of the creation button 603 by the user, the start processing of the communication service using the new group created in the group creation screen 600 as the communication group may be executed. In this case, the information exchange screen 700 is not displayed.

[0136] Also, the start process is not limited to the start process of the communication service that uses the new group created on the group creation screen 600 as the communication group. For example, the start process of the communication service that uses an already created group as the communication group may be executed. For example, FIG. 6(b) is a diagram showing an example of a group selection screen 610 for selecting a communication group created by any user. For example, the group selection screen 610 is displayed when a group selection object or the like on a home screen (not shown) displayed in response to the execution of a control program stored in the terminal storage device 22 is selected by an operation of the user input device 24.

[0137] The group selection screen 610 displayed on the user's terminal device 2 includes a group display area 611 for selecting any one of a plurality of communication groups. In the group display area 611, group information indicating each of the already created communication groups to which the user belongs is displayed. In the example shown in FIG. 6(b), the display processing unit 274 of the user's terminal device 2 displays the thumbnail images of the respective users belonging to the communication group and the name of the group as the group information. In the example shown in FIG. 6(b), the thumbnail images of other users among the users belonging to the group are displayed, but the thumbnail images of all the users belonging to the group may be displayed. In addition, when only one other user other than the user is included in the communication group, as shown in FIG. 8(b), the name of the one other user instead of the name of the group may be displayed.

[0138] When one group information included in the group display area 611 is selected by an operation of the input device 24 by the user, an information exchange screen 700 for the communication group corresponding to the selected group information is displayed by the user belonging to the communication group. The information exchange screen 700 includes information such as text or an image input by each of the users belonging to the communication group. Also in this case, to the terminal devices 2 of other users among the users belonging to the communication group, an instruction to display the information exchange screen and information regarding the communication group are transmitted via the server device 3, and the information exchange screen 700 is also displayed on the terminal devices 2 of other users.

[0139] And, in the information exchange screen 700, when the start object 704 is selected by the user, start processing of the communication service by the communication group that performs information exchange in the information exchange screen 700 is executed. When the start processing is executed, the display processing unit 274 of the user's terminal device 2 displays a communication screen 810 (FIG. 8(b)) that can be displayed by the terminal devices 2 of each user belonging to the communication group. Also, the display processing unit 274 of the terminal device 2 of another user displays a notification screen (not shown), and in response to an operation of another user on the notification screen, a group selection screen 710 (FIG. 7(b)) for participating in the communication service is displayed on the display device 23. Also in this case, the display processing unit 274 of the terminal device 2 of another user may include a participation button 805 described later in the notification screen.

[0140] Also in this case, the start processing may be executed when one group information is selected in the group selection screen 610 by an operation of the input device 24 by the user. That is, in response to the selection of one group information by the user, start processing of the communication service by the communication group corresponding to the selected group information may be executed. In this case, the information exchange screen 700 is not displayed.

[0141] Next, a method for a user who has not participated in a communication service that has already started to participate will be described. FIG. 7(b) is a diagram showing an example of a group selection screen 710 displayed on the display device 23 of the user's terminal device 2. For example, the group selection screen 710 is displayed in response to the selection of a predetermined object within the displayed notification screen. Further, the group selection screen 710 may be displayed when a group selection object or the like on the home screen displayed in response to the execution of a control program stored in the terminal storage device 22 is selected by an operation of the user's input device 24.

[0142] In the group display area 711 of the group selection screen 710, group information indicating a communication group in which the communication service has been started is displayed so as to be distinguishable from other group information. In the example shown in FIG. 7(b), the group information displayed at the top is the one indicating the communication group in which the communication service has been started. For example, information indicating the number of participating users in the communication service is displayed superimposed on or in the vicinity of each thumbnail image of the users belonging to the communication group. Also, a mark image 712 indicating the communication service is displayed in the vicinity of the name of the communication group.

[0143] When group information indicating a communication group in which the communication service has been started among the group information included in the group display area 711 is selected by an operation of the input device 24 by the user, an information exchange screen 800 by the users belonging to the communication group corresponding to the selected group information is displayed.

[0144] FIG. 8(a) is a diagram showing an example of an information exchange screen 800 displayed on the display device 23 of the user's terminal device 2. The information exchange screen 800 includes display areas 801a to 801b for displaying information such as text or images input by each of the users belonging to the communication group in which the communication service has been started, information (thumbnail images of character objects, etc.) 802a to 802b indicating the users who input the information displayed in each of the display areas 801a to 801b, an input object 803 for the user to input text or an image to be displayed in a new display area 801, a service display area 804 indicating the communication service that has already been started, and a participation button 805 for participating in the communication service that has already been started.

[0145] Thumbnail images of the character objects of three users participating in the communication service are displayed in the service display area 804 shown in FIG. 8(a). Information indicating that the communication service has been started is displayed in the display area 801b shown in FIG. 8(a). When the participation button 805 is selected by the user, a participation process is executed. An example of the participation process will be described below.

[0146] When the participation button 805 is selected by the user's operation of the input device 24, first, the display processing unit 274 of the user's terminal device 2 stores the user ID of the user stored in the terminal storage device 22 as the user ID of the users participating in the communication service related to the service display area 804 in the terminal storage device 22. Next, the display processing unit 274 displays a communication screen 810 (FIG. 8(b)) including the user output images of all the users participating in the communication service.

[0147] Next, the transmission unit 272 of the user's terminal device 2 transmits an instruction to participate in the communication service to the server device 3 via the terminal communication I / F 21 together with the user ID of the user stored in the terminal storage device 22, information regarding the communication group, and / or destination information. The information regarding the communication group is the group ID, name, and the respective user IDs of the users belonging to the communication group. The destination information includes the respective user IDs of other users excluding the user operating the terminal device 2 among the users belonging to the communication group. The server receiving unit 331 of the server device 3 receives the participation instruction, user ID, information regarding the communication group, and / or destination information via the server communication I / F 31. The server transmission unit 332 of the server device 3 transmits the participation instruction, user ID, and information regarding the communication group to the terminal devices 2 of other users indicated by the user IDs included in the destination information via the server communication I / F 31.

[0148] The receiving unit 237 of the terminal device 2 of other users receives, from the server device 3, the participation instruction, user ID, and information regarding the communication group transmitted from the terminal device 2 of the user. The receiving unit 237 stores the received user ID in the terminal storage device 22 as the user ID of the user participating in the communication service. When the communication screen 810 is being displayed on the terminal device, the display processing unit 274 of the terminal device 2 of other users displays the communication screen 810 including the user output images of all users participating in the communication service. Thus, the participation process ends.

[0149] The selection process may be executed when group information is selected on the group selection screen 710 by the user's operation of the input device 24. That is, in response to the selection of the group information by the user, a process of participating in a communication service in which the communication group corresponding to the group information is eligible to participate may be executed. In this case, the information exchange screen 800 is not displayed.

[0150] Embodiments of starting or participating in a communication service are not limited to the examples described above. For example, other starting processes different from the starting process according to the selection of the start object 704 by the user may be executed. The other starting process is executed when a predetermined display object for specifying the start of the communication service is selected by the user on a predetermined screen such as the home screen. Note that the predetermined display object may be displayed when a thumbnail image of the user's character object or the like is selected, or may be included in a menu item on the predetermined screen. The other starting process may be automatically executed when a predetermined starting condition is satisfied. For example, the predetermined starting condition is that the current time has reached a predetermined time, a predetermined time has elapsed since the end of the previous communication service, the number of mutual followers of the user has exceeded a predetermined number, and the like. Hereinafter, an example of another starting process will be described.

[0151] First, the transmission unit 272 of the user's terminal device 2 transmits an instruction to start a communication service to the server device 3 via the terminal communication I / F 21 together with the user ID of the user stored in the terminal storage device 22 and / or the destination information. In addition, the transmission unit 272 stores the user ID of the user in the terminal storage device 22 as the user ID of the user participating in the communication service. The destination information includes the user IDs of one or more other users having a predetermined relationship with the user. For example, the destination information may include the user IDs of one or more other users who are mutual followers of the user. In addition, instead of or in addition to the user IDs of one or more other users who are mutual followers of the user, the destination information may include the user IDs of other users who are in a mutual following relationship with a predetermined user who is a mutual follower of the user.

[0152] The server receiving unit 331 of the server device 3 receives a start instruction, a user ID, and / or destination information via the server communication I / F 31. The server transmitting unit 332 of the server device 3 transmits the start instruction, the user ID, and the destination information to the terminal device 2 of another user indicated by the user ID included in the destination information via the server communication I / F 31. The receiving unit 237 of the terminal device 2 of another user receives the start instruction, the user ID, and the destination information transmitted from the user's terminal device 2 from the server device 3. The receiving unit 237 stores the transmitted user ID in the terminal storage device 22 as the user ID of the user participating in the communication service. The display processing unit 274 of the terminal device 2 of another user displays a notification screen (not shown) on the display device 23 based on the received user ID. The notification screen includes information prompting participation in the communication service from the user indicated by the received user ID and a participation button or the like.

[0153] When the participation button in the notification screen is selected by an operation of the input device 24 by another user, the display processing unit 274 of the terminal device 2 of another user stores the user ID of the other user stored in the terminal storage device 22 as the user ID of the user participating in the communication service related to the service display area 804 in the terminal storage device 22. Next, the display processing unit 274 displays a communication screen 810 (Fig. 8(b)) including the user output images of all the users participating in the communication service.

[0154] Next, the transmission unit 272 of the terminal device 2 of another user transmits an instruction to participate in the communication service to the server device 3 via the terminal communication I / F 21 together with the user ID of the other user stored in the terminal storage device 22 and / or the destination information. The destination information is obtained by deleting the user ID of the other user of the terminal device 2 that transmits the destination information from the user ID included in the destination information received by the reception unit 237 previously, and at the same time adding the user ID received by the reception unit 237. The server reception unit 331 of the server device 3 receives the participation instruction, the user ID, and / or the destination information via the server communication I / F 31. The server transmission unit 332 of the server device 3 transmits the participation instruction, the user ID, and the destination information to the terminal device 2 of the other user indicated by the user ID included in the destination information via the server communication I / F 31.

[0155] The reception unit 237 of the terminal device 2 of the user who is the destination of the participation instruction receives the participation instruction, the user ID, and the destination information transmitted from the user's terminal device 2 from the server device 3. The reception unit 237 stores the received user ID in the terminal storage device 22 as the user ID of the user participating in the communication service. When the communication screen 810 is being displayed on the terminal device 2, the display processing unit 274 of the terminal device 2 displays the communication screen 810 including the user output images of all the users participating in the communication service. Thus, a series of participation processes are completed.

[0156] Note that the embodiments of starting or participating in a communication service with other users having a predetermined relationship with the user are not limited to the above-described examples. For example, when a predetermined display object for specifying the start of a communication service is selected by the user, a selection screen including information indicating other users who are mutual followers of one or more users may be displayed. In this case, when information indicating any other user is selected by the user, other start processing based on a start instruction to start communication with the selected other user may be executed. Further, in this case, an information exchange screen with the selected other user is displayed, and when a start button within the information exchange screen is selected, other start processing based on a start instruction to start communication with the other user may be executed.

[0157] In a conventional information system, a user could not issue an instruction to start and / or participate in communication with other users having a predetermined relationship with the user, such as mutual followers of the user, using a simple interface. In the information system 1 disclosed in the present embodiment, by executing the above-described other start processing, it is possible to improve the user interface related to the instruction to start and / or participate in communication and reduce the communication load between the server device 3 and the terminal device 2.

[0158] FIG. 8(b) is a diagram showing an example of a communication screen 810 displayed on the display device 23 of the terminal device 2. The communication screen 810 is a communication screen of a communication group including the user operating the terminal device 2 as a belonging user. Hereinafter, the user operating the terminal device 2 is referred to as user A, and users other than user A who are participating in the communication service corresponding to the communication screen 810 are referred to as user B1, user B2, user B3,.... Note that user B1, user B2, user B3,... may be collectively referred to as user B.

[0159] The communication screen 810 includes at least a user output image 812a including the character object 811a of user A. In the example shown in FIG. 8(b), in addition to user A, there are three users (user B1, user B2, user B3) participating in the communication service. That is, user output images 812b1, 812b2, 812b3 including the respective character objects 811b1, 811b2, 811b3 of user B1, user B2, and user B3 are included in the communication screen 810. Hereinafter, the character objects 811b1, 811b2, 811b3 may be collectively referred to as the character object 811b, and the user output images 812b1, 812b2, 812b3 may be collectively referred to as the user output image 812b. Note that user B is another user for user A, and the user output image 812b of user B displayed on the terminal device 2 of user A is another user output image.

[0160] When there is no user other than user A participating in the communication service, only the user output image 812a is included in the communication screen 810. Every time user B participates in the communication service, the user output image 812b of the user B is newly included in the communication screen 810. There is no upper limit to the number of users who can participate in the communication service. For example, when nine users B other than user A participate in the communication service, together with the user output image 812a of user A, the respective user output images 812b1, 812b2, 812b3, ··· 812b9 of the nine users B are included in the communication screen 810.

[0161] The character object 811a is an animation (moving image) of the character object of User A generated by the display processing unit 274 based on the motion data of User A generated by the generation unit 271 and the character object and usage object associated with the user ID of User A in the user table T1. Note that the motion data of User A generated by the generation unit 271 is the same as the motion data included in the output information transmitted to the terminal device 2 of User B. The output information of User A includes the voice data of User A together with the motion data of User A. When the motion data of User A generated by the generation unit 271 includes the face motion data of User A, a user output image 812a including the character object 811a whose expression changes in synchronization with the movement of the expression of User A is displayed. For example, when User A is speaking, a user output image 812a including the character object 811a with moving lips is displayed. Also, when the motion data of User A generated by the generation unit 271 includes the body motion data of User A, a user output image 812a including the character object 811a whose corresponding part moves in synchronization with the movement of the body of User A is displayed.

[0162] Note that the transmission unit 272 of the terminal device 2 of user A transmits the output information of user A to the server device 3 via the terminal communication I / F 21 together with the destination information (the user IDs of each user B (user B1 to user B3) included in the communication group). Next, the server reception unit 331 of the server device 3 receives the output information of user A transmitted from the terminal device 2 of user A via the server communication I / F 31. Next, the server transmission unit 332 of the server device 3 refers to the user IDs of the received users B (user B1 to user B3) and transmits the output information of user A to the terminal devices 2 of users B (user B1 to user B3) via the server communication I / F 31. Then, when the reception unit 273 of the terminal device 2 of user B receives the output information via the terminal communication I / F 21, the display processing unit 274 of the terminal device 2 of user B displays a user output image 812a including a character object 811a based on the motion data of user A indicated by the user ID included in the output information.

[0163] The character object 811b is an animation (moving image) of the character object of User B generated by the display processing unit 274 based on the motion data included in the output information of User B received by the receiving unit 273 and the character object associated with the user ID of User B in the user table T1. When the motion data of User B received by the receiving unit 273 includes the face motion data of User B, a user output image 812b including the character object 811b whose expression changes in synchronization with the movement of the expression of User B is displayed. For example, when User B makes a sound, a user output image 812b including the character object 811b with moving lips is displayed. Also, when the motion data of User B generated by the generation unit 271 includes the body motion data of User B, a user output image 812b including the character object 811b in which the corresponding part moves in synchronization with the movement of the body of User B is displayed. When the output information of User B received by the receiving unit 273 includes the voice data of User B, the user output image 812b is displayed by the display processing unit 274, and the voice of User B generated based on the voice data is output as voice by the voice output unit 275.

[0164] In this way, by displaying the communication screen 810 including the user output image 812a and the user output image 812b, User A can listen to the voice of User B while seeing the character object 811b of User B as if making a sound. Also, the character object and voice data of User A are output by the terminal device 2 of User B. Thereby, User A and User B participating in the communication service can communicate via the character object.

[0165] The communication screen 810 includes a play start button 813. In the example shown in FIG. 8(b), the play start button 813 is arranged within the display area of the user output image 812a, but may also be displayed outside the display area of the user output image 812a. Further, the play start button 813 may be display-controlled by the display processing unit 274 so as to be displayed for a predetermined time when a predetermined display condition is satisfied.

[0166] The play start button 813 is an object image such as a button object for instructing the display of a selection screen 900 for selecting a distribution image to be displayed on the terminal device 2 of user A and the terminal devices 2 of users B (users B1 to B3) among the currently distributed distribution images. When the play start button 813 is selected by an operation of the input device 24 by user A, the selection screen 900 is displayed. The communication screen 810 is also displayed on each of the terminal devices 2 of users B1 to B3 who are communicating with user A. Therefore, the play start button 813 is displayed not only on the terminal device 2 of user A but also on each of the terminal devices 2 of users B1 to B3.

[0167] FIG. 9(a) is a diagram showing an example of the selection screen 900 displayed on the display device 23 of the terminal device 2. The selection screen 900 is displayed when the play start button 813 included in the communication screen 810 (FIG. 8(b)) is selected by an operation of the input device 24 by user A. When a distribution list button (not shown) is selected by an operation of the input device 24 by user A, the selection screen 1000 described later may be displayed instead of the selection screen 900.

[0168] On the selection screen 900, selection images 901, 902, 903, and 904 related to the currently distributed distribution image are displayed. Thumbnail images of the character objects included in the corresponding distribution image are displayed in each of the selection images 901, 902, 903, and 904. The number of selection images displayed on the selection screen 900 is not limited to four. When the display processing unit 274 of the terminal device 2 cannot include the selection image related to the currently distributed distribution image within the selection screen 900, the selection image corresponding to the distribution image may be displayed scrollably. In this case, in response to a swipe operation by user A (for example, an operation in which a finger moves from the bottom to the top of the screen while touching the screen), a selection image that is not currently displayed on the selection screen 900 is scrolled and displayed within the selection screen 900.

[0169] Furthermore, the selection screen 900 includes user output images 812a, 812b1, 812b2, and 812b3 each including character objects 811a, 811b1, 811b2, and 811b3. The user output images 812a, 812b1, 812b2, and 812b3 included in the selection screen 900 are those obtained by changing the display of the user output images 812a, 812b1, 812b2, and 812b3 included in the communication screen 810. The change in display includes at least one of, for example, a change in display mode, a change in display content, and a change in display method.

[0170] The change in the display mode is, for example, changing the display size of the user output images 812a, 812b1, 812b2, and 812b3, changing the display position of the user output images 812a, 812b1, 812b2, and 812b3, changing at least one of the brightness, lightness, and chroma of the user output images 812a, 812b1, 812b2, and 812b3, changing the transparency of the user output images 812a, 812b1, 812b2, and 812b3, changing the shape of the display frame of the user output images 812a, 812b1, 812b2, and 812b3 (for example, changing from a rectangular shape to a circular shape), setting the presence or absence of the display frame of the user output images 812a, 812b1, 812b2, and 812b3, flashing the display of the user output images 812a, 812b1, 812b2, and 812b3, and performing a display that automatically moves the user output images 812a, 812b1, 812b2, and 812b3, etc. For example, the user output images 812a, 812b1, 812b2, and 812b3 included in the selection screen 900 shown in FIG. 9(a) are the user output images 812a, 812b1, 812b2, and 812b3 included in the communication screen 810 that have been reduced and the display position has been changed.

[0171] The change in the displayed content is, for example, at least one of changing the character objects 811a, 811b1, 811b2, and 811b3 (included in the user output images 812a, 812b1, 812b2, and 812b3) to still images, changing the character objects 811a, 811b1, 811b2, and 811b3 to deformed images, and changing the character objects 811a, 811b1, 811b2, and 811b3 to the corresponding user names. Note that the still image may be a profile image or an icon image of each user. Even if the images in the user output images 812a, 812b1, 812b2, and 812b3 are still images and user names, voice data of users B1 to B3 may be output based on the output information of each of users B1 to B3 received at predetermined time intervals. Thereby, it is possible to continue voice communication with user A and users B1 to B3 while reducing the processing load on the terminal device 2 by not using motion data.

[0172] The change in the display method is, for example, to display the user output images 812a, 812b1, 812b2, and 812b3 when a predetermined display condition is satisfied. Also, the change in the display method is, for example, to end the display of the user output images 812a, 812b1, 812b2, and 812b3 when a predetermined display condition is satisfied. For example, the change in the display method is to display the user output image 812 corresponding to the output voice data only while the user's voice data is being output, to display the user output images 812a, 812b1, 812b2, and 812b3 for a predetermined time (for example, 10 seconds) after a predetermined operation (for example, a swipe operation, a hook operation, etc.) by the user of the terminal device 2 is detected, or to display the user output images 812a, 812b1, 812b2, and 812b3 after the elapse of a predetermined time (for example, 10 seconds) after an operation by the user of the terminal device 2 is detected (in this case, the display of the user output images 812a, 812b1, 812b2, and 812b3 ends when any operation by the user of the terminal device 2 is detected), etc. For example, the change in the display method may be to end the display of the user output images 812b1, 812b2, and 812b3 of users B1 to B3 other than user A who operates the terminal device 2.

[0173] In the selection screen 900 shown in FIG. 9(a), a user output image 812a including a character object 811a whose corresponding part moves in synchronization with the facial expression and body movement of user A is displayed. Also, user output images 812b1 to 812b3 including character objects 811b1 to 811b3 whose corresponding parts move in synchronization with the facial expression and body movement of users B1 to B3 are displayed. Also, user A can listen to the voices of users B1 to B3 while looking at the character objects 811b1 to 811b3 of users B1 to B3 as if they were speaking on the selection screen 900.

[0174] The following describes an example of the display process of the selection screen 900. When the viewing start button 813 included in the communication screen 810 (Fig. 8(b)) is selected by the operation of the input device 24 by User A, the input device 24 inputs a confirmation instruction to the terminal processing device 27. The transmission unit 272 of the terminal device 2 of User A transmits information indicating the confirmation instruction input from the input device 24 to the server device 3 via the terminal communication I / F 21 together with the user ID of User A stored in the terminal storage device 22. Next, the server reception unit 331 of the server device 3 receives information indicating the confirmation instruction and the user ID of User A via the server communication I / F 31.

[0175] Next, the server transmission unit 332 of the server device 3 extracts information on all or part of the distribution images stored in the server storage device 32, and extracts the selection images associated with the information on the extracted distribution images. The server transmission unit 332 transmits the information on the extracted distribution images and the selection images to the terminal device 2 of User A via the server communication I / F 31. Next, the reception unit 273 of the terminal device 2 of User A receives information on one or more distribution images and the selection images via the terminal communication I / F 21. Then, the display processing unit 274 of the terminal device 2 of User A displays and outputs a selection screen 900 including the received selection image to the display device 23. Note that information on the corresponding distribution image is associated with the selection image included in the selection screen 900. Thus, the display process of the selection screen 900 ends.

[0176] When any one of the plurality of selection images 901, 902, 903, and 904 is selected by the operation of the input device 24 by User A, the input device 24 inputs a viewing start instruction to the terminal processing device 27. The input device 24 inputs information on the distribution image associated with the selected selection image to the terminal processing device 27 together with the viewing start instruction. Then, the display processing unit 274 of the terminal device 2 of User A superimposes and displays a confirmation screen 910 on the selection screen 900 based on the selection image associated with the information on the distribution image input by the input device 24.

[0177] FIG. 9(b) is a diagram showing an example of a confirmation screen 910 displayed on the display device 23 of the terminal device 2. The confirmation screen 910 includes the selected image selected by the user A on the selection screen 900, a confirmation button 911, and a cancel button 912. The confirmation button 911 is an object image such as a button object for instructing the execution of transmission of an instruction to start viewing. The cancel button 912 is an object image such as a button object for ending the display of the confirmation screen 910.

[0178] When the confirmation button 911 is selected by the operation of the input device 24 by the user A, the transmission unit 272 of the terminal device 2 of the user A transmits information indicating an instruction to start viewing and information regarding the distribution image, which have already been input according to the operation of the selection screen 900, and the user ID and destination information of the user A stored in the terminal storage device 22 to the server device 3 via the terminal communication I / F 21.

[0179] Next, the server receiving unit 331 of the server device 3 receives, via the server communication I / F 31, information indicating an instruction to start viewing, information regarding the distribution image, the user ID of the user A, and the destination information. Next, the server receiving unit 331 determines whether the received information regarding the distribution image is information regarding the distribution image being distributed.

[0180] When the information regarding the received distribution image is the information regarding the distribution image being distributed, the server receiving unit 331 associates the received user ID of user A with the information regarding the received distribution image and stores it in the server storage device 32. Similarly, the server transmitting unit 332, based on the received destination information, associates the user IDs of users B1 to B3 with the information regarding the received distribution image and stores it in the server storage device 32. For example, when the destination information includes the respective user IDs of users B1 to B3, the server receiving unit 331 extracts the respective user IDs of users B1 to B3 from the destination information, and associates the extracted user IDs with the information regarding the distribution image and stores it. When the destination information includes a group ID for identifying the communication group to which user A belongs, the server storage device 32 refers to the group table T3 etc. stored therein, extracts the user IDs of users B1 to B3 associated with the group ID, and associates the extracted user IDs of users B1 to B3 with the information regarding the distribution image and stores it. As a result, user A and users B1 to B3 participating in the communication service are registered as viewers of the distribution image of the distribution user selected by user A. Thereafter, user A, user B1, user B2, and user B3 participating in the communication service can view the distribution image of the distribution user selected by user A.

[0181] The server receiving unit 331 of the server device 3 transmits the names of users A and B1 to B3 newly registered as viewing users or the names of the communication groups to which users A and B1 to B3 belong to the terminal device 2 of the distributing user. The terminal device 2 of the distributing user may display the name of each received user or the name of the communication group, and may also display information indicating that a new viewing user has been registered. When various tables T1 to T3 are stored in the terminal storage device 11, the server receiving unit 331 may also transmit the respective user IDs of users A and B1 to B3 newly registered as viewing users. In this case, the terminal device 2 of the distributing user refers to the user table T1 or the group table T3 stored in the terminal device 2 of the distributing user, extracts and displays the name of each user or the name of the communication group corresponding to each received user ID.

[0182] FIG. 10(a) is a diagram showing another example of the selection screen 1000 displayed on the display device 23 of the terminal device 2. Different from the selection screen 900, the selection screen 1000 does not include user output images 812a, 812b1, 812b2, and 812b3 each including character objects 811a, 811b1, 811b2, and 811b3. The selection screen 1000 includes selection images 1001, 1002, 1003, 1004, 1005, and 1006. Each of the selection images 1001, 1002, 1003, 1004, 1005, and 1006 is an image for selecting a distribution image to be viewed, similar to the selection images 901, 902, 903, and 904. When the selection screen 1000 shown in FIG. 10(a) is displayed on the display device 23 of the terminal device 2 of user A, the voice data of users B1 to B3 may be output based on the output information of each of users B1 to B3 received at predetermined time intervals. Thereby, even when the selection screen 1000 shown in FIG. 10(a) is displayed, it is possible to continue voice communication with users A and B1 to B3 in the same manner as when the selection screen 900 shown in FIG. 9(a) is displayed. Further, each of the selection screens 900 and 1000 may include a switching object (not shown). For example, when the switching object in the selection screen 900 is selected in response to an operation of the input device 24 by user A, the display processing unit 274 of the terminal device 2 of user A ends the display of the selection screen 900 and displays the selection screen 1000. When the switching object in the selection screen 1000 is selected in response to an operation of the input device 24 by user A, the display processing unit 274 of the terminal device 2 of user A ends the display of the selection screen 1000 and displays the selection screen 900. In this way, the user can switch between the selection screens 900 and 1000 according to the preferences of the user of the terminal device 2 on which the selection screens 900 and 1000 are displayed.

[0183] FIG. 10(b) is a diagram showing an example of a distribution screen 1010 displayed on the display device 23 of the terminal device 2. The distribution screen 1010 includes a distribution image 1012 including a character object 1011, an evaluation button 1013, an addition button 1014, a comment button 1015, a response information display area 1016, and a viewing end button 1017. The distribution screen 1010 also includes user output images 812a, 812b1, 812b2, and 812b3 each including character objects 811a, 811b1, 811b2, and 811b3, respectively.

[0184] The character object 1011 is an animation (moving image) of the character object of the distribution user generated by the display processing unit 274 based on the motion data included in the output information of the distribution user received by the receiving unit 273 and the character object associated with the user ID of the distribution user in the user table T1. Hereinafter, an example of the display processing of the distribution image 1012 including the character object 1011 will be described.

[0185] In response to the viewing start instruction by User A, the server device 3 stores the user ID of User A and the user IDs of Users B1 to B3 in association with the distribution user ID associated with the selection image selected by User A on the selection screen 900 or the selection screen 1000. The server transmission unit 332 of the server device 3 transmits the output information of the distribution user of the distribution user ID associated with the user ID of User A and the user IDs of Users B1 to B3 to each of the terminal devices 2 of User A and Users B1 to B3 via the server communication I / F 31. The receiving unit 273 of each of the terminal devices 2 of User A and Users B1 to B3 receives the transmitted output information of the distribution user from the server device 3 via the terminal communication I / F 21.

[0186] When the motion data of the distribution user included in the output information received by the receiving unit 273 includes the face motion data of the distribution user, a distribution image 1012 including a character object 1011 whose expression changes in synchronization with the movement of the expression of the distribution user is displayed. For example, when the distribution user makes a sound, a distribution image 1012 including a character object 1011 whose lips are moving is displayed. Also, when the motion data of the distribution user received by the receiving unit 273 includes the body motion data of the distribution user, a distribution image 1012 including a character object 1011 whose corresponding part moves in synchronization with the movement of the body of the distribution user is displayed. When the output information of the distribution user received by the receiving unit 273 includes the voice data of the distribution user, the distribution image 1012 is displayed by the display processing unit 274, and the voice of the distribution user generated based on the voice data is output as voice by the voice output unit 275. Thereby, user A can listen to the voice of the distribution user while seeing the character object 1011 of the distribution user making a movement as if making a sound. Thus, the display process of the distribution image 1012 ends. The display process of the distribution image 1012 is executed every time the output information of the distribution user is received at predetermined time intervals (for example, every 2 seconds).

[0187] The evaluation button 1013 is an object image for instructing the transmission of evaluation data regarding the character object 1011 included in the distribution image 1012 or evaluation data regarding the distribution user of the character object 1011. When the evaluation button 811 is selected in response to the operation of the input device 24 by user A, the transmission unit 272 of the terminal device 2 creates evaluation data indicating that a "positive evaluation of the character object 1011 included in the distribution image 1012" has been made or evaluation information indicating that a "positive evaluation of the distribution user of the character object 1011 included in the distribution image 1012" has been made. The evaluation information is a type of response information. Details of the display and transmission processes of the evaluation information (response information) will be described later.

[0188] Note that the evaluation button 1013 may create evaluation data indicating that a "negative evaluation of the character object 1011 included in the distribution image 1012" has been made, or evaluation information indicating that a "negative evaluation of the distribution user of the character object 1011 included in the distribution image 1012" has been made. Also, the distribution screen 1010 may include a plurality of types of evaluation buttons 1013 (for example, two types of evaluation buttons: an evaluation button for creating positive evaluation information and an evaluation button for creating negative evaluation information).

[0189] The add button 1014 is an object image for instructing the display of a selection screen 1100 for selecting an additional object to be included in the distribution screen 1010. When the add button 1014 is selected in response to an operation of the input device 24 by User A, the selection screen 1100 is displayed. Details of the selection screen 1100 will be described later.

[0190] The comment button 1015 is an object image for instructing the display of a comment input window (not shown) for inputting a comment (character string) to be displayed on the distribution screen 1010. When the comment button 1015 is selected in response to an operation of the input device 24 by User A, the comment input window is superimposed and displayed on the distribution screen 1010. The comment input window is displayed only on the display device 23 of the terminal device 2 of the user who selected the comment button 1015, and the comment input window and the character string being input in the comment input window are not displayed on the display devices 23 of other terminal devices 2. For example, in response to an operation of the input device 24 by User A, the display processing unit 274 creates comment information indicating the comment (character string) input in the comment input window. The comment information is a type of response information. Details of the display and transmission processing of the comment information (response information) will be described later.

[0191] The response information display area 1016 includes response information (comment data, evaluation data, and / or information regarding additional objects (described later)) created in response to an operation by User A, and response information transmitted from each terminal device 2 displaying the distribution screen 1010 (the terminal devices 2 of each user who is viewing the distribution image 1012 of the same distribution user).

[0192] In the example of the response information display area 1016 shown in FIG. 10(b), it is shown that comment information indicating a comment (character string) of "Cool" has been transmitted from the terminal device 2 of the viewing user named "User R". It is also shown that evaluation information has been transmitted from the terminal device 2 of the viewing user named "User F". Furthermore, it is shown that evaluation information created by the terminal device 2 of User A who operates this terminal device 2 has been transmitted.

[0193] For each terminal device 2 displaying the distribution screen 1010, the display processing unit 274 displays the created response information in the response information display area 1016 with the names of the users arranged in time series each time the response information is created. Also, for each terminal device 2 displaying the distribution screen 1010, the transmission unit 272 transmits a request to transmit the response information, together with the created response information and the user ID stored in the terminal storage device 22 of each terminal device 2, to the server device 3 via the terminal communication I / F 21. The server reception unit 331 of the server device 3 receives a display request for the response information transmitted from each terminal device 2 displaying the distribution screen 1010, together with the response information and the user ID. When the received user ID is the viewing user ID, the server transmission unit 332 of the server device 3 extracts the distribution user ID associated with the received user ID from the server storage device 32. The server transmission unit 332 extracts viewing user IDs other than the received user ID among the viewing user IDs associated with the extracted distribution user ID. Then, the server transmission unit 332 transmits the received response information and user ID to the terminal device 2 of the distribution user indicated by the extracted distribution user ID and the terminal device 2 of the viewing user indicated by the extracted viewing user ID. The reception unit 273 of each terminal device 2 displaying the distribution screen 1010 receives the response information and user ID transmitted from the server device 3 via the terminal communication I / F 21. The display processing unit 274 of each terminal device 2 displaying the distribution screen 1010 displays the distribution screen 1010 including the response information and the names of the users arranged in time series within the response information display area 1016 based on the received response information and the name (user table T1) associated with the received user ID.

[0194] An upper limit number may be set for the number of response information that can be displayed in the response information display area 1016. In the example of the response information display area 1016 shown in FIG. 10(b), the upper limit number of response information that can be displayed is "3". When the number of response information displayed on each terminal device 2 exceeds the set upper limit number, the display processing unit 274 of each terminal device 2 displays the distribution screen 1010 including the three newly received response information in the response information display area 1016 in order.

[0195] Note that the response information in the response information display area 1016 may be displayed scrollably. In this case, in response to a swipe operation by the user (for example, an operation in which the finger moves from the bottom to the top of the screen while touching the screen), response information that is not currently included in the response information display area 1016 is scroll-displayed within the response information display area 1016.

[0196] The viewing end button 1017 is an object image such as a button object for ending the display of the distribution screen 1010 and ending the viewing of the distribution image 1012. When the viewing end button 1017 is selected by an operation of the input device 24 by user A, the display processing unit 274 ends the display of the distribution screen 1010 and redisplays the communication screen 810 (FIG. 8(b)). Then, the transmission unit 272 of the terminal device 2 transmits information regarding the viewing end instruction, together with the user ID stored in the terminal storage device 22 and the destination information, to the server device 3 via the terminal communication I / F 21. When the server receiving unit 331 of the server device 3 receives the information regarding the viewing end instruction and the user ID transmitted from the user's terminal device 2, it deletes the received user ID stored in the server storage device 32 as the viewing user ID. Thereby, the viewing of the distribution image by the user who selected the viewing end button 1017 ends. Further, the server transmission unit 332 may transmit information regarding the viewing end instruction to the terminal devices 2 of users B1 to B3 indicated by the user ID included in the destination information. In this case, also in the terminal devices 2 of users B1 to B3, when the viewing end instruction is received, the display of the distribution screen 1010 is ended and the communication screen 810 (FIG. 8(b)) is redisplayed.

[0197] The distribution screen 1010 includes user output images 812a, 812b1, 812b2, and 812b3 each including character objects 811a, 811b1, 811b2, and 811b3. The user output images 812a, 812b1, 812b2, and 812b3 included in the distribution screen 1010 are those obtained by changing the display of the user output images 812a, 812b1, 812b2, and 812b3 included in the communication screen 810. The change in display includes at least one of, for example, a change in display mode, a change in display content, and a change in display method.

[0198] The change in display mode is, for example, changing the display size of the user output images 812a, 812b1, 812b2, and 812b3, changing the display position of the user output images 812a, 812b1, 812b2, and 812b3, changing at least one of the brightness, lightness, and saturation of the user output images 812a, 812b1, 812b2, and 812b3, changing the transparency of the user output images 812a, 812b1, 812b2, and 812b3, changing the shape of the display frame of the user output images 812a, 812b1, 812b2, and 812b3 (for example, changing from a rectangular shape to a circular shape), setting the presence or absence of the display frame of the user output images 812a, 812b1, 812b2, and 812b3, blinking the display of the user output images 812a, 812b1, 812b2, and 812b3, and performing a display that automatically moves the user output images 812a, 812b1, 812b2, and 812b3, etc. For example, the user output images 812a, 812b1, 812b2, and 812b3 included in the distribution screen 1010 shown in FIG. 10(b) are those obtained by reducing the user output images 812a, 812b1, 812b2, and 812b3 included in the communication screen 810 and changing the display position.

[0199] The change in the displayed content is, for example, at least one of changing the character objects 811a, 811b1, 811b2, and 811b3 (included in the user output images 812a, 812b1, 812b2, and 812b3) to still images, changing the character objects 811a, 811b1, 811b2, and 811b3 to deformed images, and changing the character objects 811a, 811b1, 811b2, and 811b3 to the corresponding user names. Note that the still image may be a profile image or an icon image of each user. Even if the images in the user output images 812a, 812b1, 812b2, and 812b3 are still images and user names, the voice data of users B1 to B3 may be output based on the output information of each of users B1 to B3 received at predetermined time intervals. Thereby, it becomes possible to continue voice communication with user A and users B1 to B3 while reducing the processing load on the terminal device 2 by not using motion data.

[0200] The change in the display method is, for example, to display the user output images 812a, 812b1, 812b2, and 812b3 when a predetermined display condition is satisfied. Also, the change in the display method is, for example, to end the display of the user output images 812a, 812b1, 812b2, and 812b3 when a predetermined display condition is satisfied. For example, the change in the display method is to display the user output image 812 corresponding to the output voice data only while the user's voice data is being output, to display the user output images 812a, 812b1, 812b2, and 812b3 for a predetermined time (for example, 10 seconds) after a predetermined operation (for example, a swipe operation, a hook operation, etc.) by the user of the terminal device 2 is detected, or to display the user output images 812a, 812b1, 812b2, and 812b3 after a predetermined time (for example, 10 seconds) has elapsed after an operation by the user of the terminal device 2 is detected (in this case, the display of the user output images 812a, 812b1, 812b2, and 812b3 ends when any operation by the user of the terminal device 2 is detected), etc. Also, the change in the display method may be to display a part of the distribution screen 1010. For example, the change in the display method may be to end the display of the user output images 812b1, 812b2, and 812b3 of users B1 to B3 other than user A who operates the terminal device 2. Also, for example, the change in the display method may be to reduce the display size of the distribution image 1012, and in this case, the display method may be such that the user output images 812a, 812b1, 812b2, and 812b3 do not overlap the distribution image 1012. Also, the change in the display method is to display the user output images 812a, 812b1, 812b2, and 812b3 without displaying the distribution image 1012. Also, the change in the display method is to display the additional button 1014, the comment button 1015, and the response information display area 1016 without displaying the distribution image 1012 and the user output images 812a, 812b1, 812b2, and 812b3.

[0201] Note that at least two of the various display modes described above may be controlled to switch in response to an operation by user A, such as a switching object (not shown). In this case, in response to a switching instruction by user A, information regarding the switching instruction may be transmitted to each of the terminal devices 2 of users B1 to B3 via the server device 3. In each of the terminal devices 2 of users B1 to B3 that has received the information regarding the switching instruction, the information regarding the switching instruction is referred to, and the user output images 812a, 812b1, 812b2, and 812b3 are displayed in the same display mode as the display mode in the terminal device 2 of user A. Note that this switching operation is not limited to the operation by user A (the user who gave the viewing start instruction), and the display modes of the user output images 812a, 812b1, 812b2, and 812b3 may also be switched by an operation by any of users B1 to B3. When the information regarding the switching instruction is not transmitted to each of the terminal devices 2 of users B1 to B3, each user can arbitrarily switch the display mode of the user output images 812a, 812b1, 812b2, and 812b3 for each terminal device 2. Further, the display modes of the user output images 812a, 812b1, 812b2, and 812b3 each including the character objects 811a, 811b1, 811b2, and 811b3 are not limited to the distribution screen 1010, and may also be applied to the user output images 812a, 812b1, 812b2, and 812b3 on other screens. Further, a screen for the user to select at least one of the various display modes described above may be displayed at an arbitrary timing before the display of the distribution screen 1010. When at least one display mode is selected by the user, the distribution screen 1010 is displayed according to the display mode selected by the user.

[0202] Even in the distribution screen 1010 shown in FIG. 10(b), a user output image 812a including a character object 811a whose corresponding part moves in synchronization with the facial expression and body movement of user A is displayed, and a character object 811b (811b1 to 811b3) whose corresponding part moves in synchronization with the facial expression and body movement of user B (users B1 to B3) is displayed. Also, even while the distribution screen 1010 is being displayed, the voice data of user B (users B1 to B3) is output. As a result, user A can listen to the voice of user B (users B1 to B3) while looking at the character object 811b (811b1 to 811b3) of user B (users B1 to B3) as if user B is speaking. Thereby, user A can listen to the voice of the distributing user and the voice of user B (users B1 to B3). Note that the output information of user A and user B (users B1 to B3) is limited to exchange within the communication group and is not transmitted to the terminal devices 2 of other viewing users and the distributing user. Note that the user output images 812a, 812b1, 812b2, and 812b3 may not be included in the distribution screen 1010. Even in this case, the voice data of user B (users B1 to B3) may be output.

[0203] Note that instead of the user output images 812a, 812b1, 812b2, and 812b3, one output image including the character object 811a and the character objects 811b (811b1 to 811b3) may be included in the distribution screen 1010. Also, the distribution screen 1010 may include a switching button (not shown). For example, when a switching object is selected in response to an operation of the input device 24 by user A, the input device 24 inputs a switching instruction to the terminal processing device 27. The display processing unit 274 ends the display of the distribution screen 1010 and redisplay the communication screen 810 (FIG. 8(b)). Then, the transmission unit 272 of the terminal device 2 transmits information regarding the switching instruction, together with the user ID stored in the terminal storage device 22 and the destination information, to the server device 3 via the terminal communication I / F 21. When the server receiving unit 331 of the server device 3 receives the information regarding the switching instruction, the user ID, and the destination information transmitted from the user's terminal device 2, the server transmission unit 332 transmits the information regarding the switching instruction to the terminal devices 2 of users B1 to B3 indicated by the user ID included in the destination information. As a result, also in the terminal devices 2 of users B1 to B3, when the switching instruction is received, the display of the distribution screen 1010 is ended and the communication screen 810 (FIG. 8(b)) is redisplayed. The redisplayed communication screen 810 in response to the switching instruction may also include a switching button. For example, when a switching object is selected in response to an operation of the input device 24 by user A, the input device 24 inputs a switching instruction to the terminal processing device 27. The display processing unit 274 ends the display of the communication screen 810 and redisplay the distribution screen 1010. Then, the transmission unit 272 of the terminal device 2 transmits the information regarding the switching instruction, together with the user ID stored in the terminal storage device 22 and the destination information, to the server device 3 via the terminal communication I / F 21.

[0204] When the server receiving unit 331 of the server device 3 receives information regarding a switching instruction, a user ID, and destination information transmitted from the user's terminal device 2, the server transmitting unit 332 transmits the information regarding the switching instruction to the terminal devices 2 of users B1 to B3 indicated by the user ID included in the destination information. As a result, also in the terminal devices 2 of users B1 to B3, when a switching instruction is received, the display of the communication screen 810 is terminated and the distribution screen 1010 is redisplayed. Note that the switching instruction is not limited to the switching instruction by user A (the user who issued the viewing start instruction), and the above-described processing corresponding to the switching instruction may be executed even by a switching instruction by any of users B1 to B3. Further, the information related to the switching instruction may not be transmitted to the terminal devices 2 of other users via the server device 3. Thereby, each user can arbitrarily switch between the distribution screen 1010 and the communication screen 810 for each terminal device 2. Also, during the redisplay of the communication screen 810 in response to the switching instruction, the audio data of the distribution user may be output based on the output information of the distribution user received at predetermined time intervals. In this way, by realizing the switching function between the distribution screen 1010 and the communication screen 810 in the terminal device 2, even when viewing the distribution image while displaying the communication screen, by enabling the switching of the display mode of the screen, it is possible to realize an optimal display mode according to the distribution content and the video chat situation at that time without requiring a large display capable of displaying a plurality of screens on the display of the terminal device 2.

[0205] FIG. 11(a) is a diagram showing an example of a selection screen 1100 displayed on the display device 23. As shown in FIG. 11(a), the selection screen 1100 is displayed so as to overlap the distribution screen 1010. The selection screen 1100 may be displayed after the display of the distribution screen 1010 is terminated.

[0206] In the example shown in FIG. 11(a), an image showing six types of additional candidate objects is included within the display area of the selection screen 1100. The name indicating the additional candidate object may be arranged near the image indicating the additional candidate object. The number of additional candidate objects included within the display area of the selection screen 1100 is not limited to six. When the display processing unit 274 of the terminal device 2 cannot include a part of the images showing a plurality of additional candidate objects within the display area of the selection screen 1100, the images showing the additional candidate objects may be displayed in a scrollable manner. In this case, in response to a swipe operation by user A (for example, an operation in which the finger moves from the right to the left of the screen while the finger is in contact with the screen), the images showing the additional candidate objects that are not currently included within the display area of the selection screen 1100 are scrolled and displayed within the display area of the selection screen 1100.

[0207] Each of the additional candidate objects represents an additional object. The image showing the additional candidate object is, for example, an icon image showing a gift object which is a type of additional object, a thumbnail image, etc. Note that on the selection screen 1100, the images of each additional candidate object may be classified and displayed for each type of additional object (free gift, paid gift, accessory, support goods, appeal, variety, cooperation gift that requires cooperation from the users belonging to the group, etc.). Note that an additional object belonging to a paid gift is an additional object that can be purchased by the user consuming virtual currency value "coins". An additional object belonging to a free gift is an additional object that can be obtained, for example, by consuming points that can be acquired by watching a distribution instead of consuming a currency value, or the like. Note that the additional object may be an object held by user A by playing a predetermined mission executed on the terminal device 2 and clearing the predetermined mission.

[0208] When an additional candidate object is selected in response to an operation of the input device 24 by User A, the input device 24 inputs an addition instruction to the terminal processing device 27 together with the object ID corresponding to the selected additional candidate object. Hereinafter, an example of the addition process according to the addition instruction will be described.

[0209] First, when the display processing unit 274 acquires the input addition instruction and object ID, it refers to the object table T2 and extracts a still image or a moving image (image information) of the additional object associated with the acquired object ID from the terminal storage device 22. Next, the display processing unit 274 generates a new distribution image 1012 including the extracted still image or moving image in the distribution image 1012 including the character object 1011 of the distribution user. Further, the display processing unit 274 refers to the object table T2 and creates additional object information using the name associated with the acquired object ID. The additional object information is a kind of response information, for example, information indicating that User A has given an additional object to the distribution user.

[0210] Next, when the transmission unit 272 acquires the input additional instruction and the object ID, it transmits information indicating the additional instruction, together with the acquired object ID and the user ID of user A stored in the terminal storage device 22, to the server device 3 via the terminal communication I / F 21. Next, the server reception unit 331 of the server device 3 receives, via the server communication I / F 31, information indicating the additional instruction, the object ID, and the user ID of user A. Next, when the received user ID is the viewing user ID, the server transmission unit 332 of the server device 3 extracts the distribution user ID associated with the received user ID from the server storage device 32. The server transmission unit 332 extracts viewing user IDs other than the received user ID among the viewing user IDs associated with the extracted distribution user ID. Then, the server transmission unit 332 transmits, via the server communication I / F 31, information indicating the received additional instruction, the object ID, and the user ID of user A to the terminal device 2 of the user indicated by the extracted viewing user ID. Further, the server transmission unit 332 transmits, via the server communication I / F 31, information indicating the received additional instruction, the object ID, and the user ID of user A to the terminal device 2 of the distribution user indicated by the extracted distribution user ID.

[0211] Then, the reception unit 273 of the terminal device 2 of the viewing user (excluding user A) and the distribution user receives, via the terminal communication I / F 21, information indicating the additional instruction, the user ID of user A, and the object ID. Next, the display processing unit 274 of the terminal device 2 refers to the object table T2 and extracts a still image or a moving image (image information) of the additional object associated with the received object ID from the terminal storage device 22. Next, the display processing unit 274 generates a new distribution image 1012 including the extracted still image or moving image in the distribution image 1012 including the character object 1011 of the distribution user. Thus, the additional process ends.

[0212] FIG. 11(b) is a diagram showing another example of the distribution screen 1110 displayed on the display device 23 of the terminal device 2. Similar to the distribution screen 1010, the distribution screen 1110 includes a distribution image 1012 including a character object 1011, an evaluation button 1013, an addition button 1014, a comment button 1015, a response information display area 1016, and a viewing end button 1017. Also, similar to the distribution screen 1010, the distribution screen 1110 includes user output images 812a, 812b1, 812b2, and 812b3 each including character objects 811a, 811b1, 811b2, and 811b3, respectively.

[0213] Unlike the distribution screen 1010, the distribution screen 1110 includes an additional object 1111 and an additional object 1112. Both the additional object 1111 and the additional object 1112 are still images or moving images indicating additional objects. The additional object 1112 includes various information regarding the user who gave the addition instruction for the additional object 1112, together with a still image or a moving image indicating the additional object 1112. Hereinafter, taking the case where the user who gave the addition instruction for the additional object 1112 is user A as an example, an example of the display process of the additional object 1112 will be described.

[0214] When an additional candidate object (corresponding to the additional object 1112) is selected in response to an operation of the input device 24 by the user A, the input device 24 inputs an addition instruction to the terminal processing device 27 together with the object ID corresponding to the selected additional candidate object. When the display processing unit 274 acquires the input addition instruction and object ID, it refers to the object table T2, extracts a still image or a moving image (image information) of the additional object associated with the acquired object ID from the terminal storage device 22, and further refers to the group table T3 to extract the name of the group associated with the user ID of the user A stored in the terminal storage device 22. Then, the display processing unit 274 generates a new distribution image 1012 including the additional object 1112 composed of the extracted still image or moving image and the name of the group in the distribution image 1012 including the character object 1011 of the distribution user.

[0215] The transmission unit 272 of the terminal device 2 of User A transmits information indicating an addition instruction related to the additional object 1112, the acquired object ID, and the user ID of User A stored in the terminal storage device 2 to the terminal devices 2 of the viewing users (excluding User A) and the distribution user via the server device 3. When the information indicating the addition instruction related to the additional object 1112, the user ID of User A, and the object ID are received by the receiving unit 273 of the terminal devices 2 of the viewing users (excluding User A) and the distribution user, the display processing unit 274 of the terminal devices 2 of the viewing users (excluding User A) and the distribution user refers to the object table T2, extracts a still image or a moving image (image information) of the additional object associated with the received object ID from the terminal storage device 22, and further refers to the group table T3 to extract the name of the communication group associated with the received user ID. Then, the display processing unit 274 of the terminal device 2 generates a new distribution image 1012 including the still image or the moving image extracted and the additional object 1112 composed of the name of the communication group in the distribution image 1012 including the character object 1011 of the distribution user. The additional object 1112 is, for example, another object (an object indicating a signboard or the like) located near a predetermined additional object or overlapping with the predetermined additional object and having a name displayed thereon. Thus, the display processing of the additional object 1112 is completed. Note that the various information regarding the user who gave the addition instruction for the additional object 1112, which is displayed together with the still image or the moving image indicating the additional object 1112, is not limited to the name of the communication group to which the user who gave the addition instruction belongs. The various information regarding the user who gave the addition instruction may be the names of all the users belonging to the communication group to which the user who gave the addition instruction belongs. Further, the additional object 1112 may be a set of the respective character objects of all the users belonging to the communication group to which the user who gave the addition instruction belongs. In this case, each character object may be controlled by the display processing unit 274 to automatically perform a predetermined operation (such as waving a hand, clapping hands, dancing, etc.).

[0216] The additional objects added to the distribution screen may change in shape, size, arrangement, color, brightness, and / or design while the distribution screen is being displayed when a predetermined change condition is satisfied. Note that the predetermined change condition may be a condition related to the display request of the additional object. For example, the predetermined change condition is that the condition related to the timing of an additional instruction by any one of the users (e.g., user A, user B1, user B2, and user B3) belonging to the same communication group is satisfied, and / or that the users belonging to the same communication group have given additional instructions for a plurality of different specific types of additional objects. In this case, even if users (e.g., users other than user A, user B1, user B2, and user B3) belonging to other communication groups give additional instructions for specific types of additional objects that are different from each other within a predetermined period, the predetermined change condition is not satisfied. Note that the predetermined change condition may be that the condition related to the timing of an additional instruction by any one of all the users watching the same distribution screen is satisfied, and / or that additional instructions for a plurality of different specific types of additional objects have been given. That the condition related to the timing of the additional instruction is satisfied means that the difference time between the timings of the additional instructions by a plurality of users is within a predetermined period, etc. In response to the additional instruction by the user, a predetermined point is given to the user by the server device 3. When the predetermined change condition is satisfied, a point more than the predetermined point may be given to the user who has given the additional instruction that satisfies the predetermined change condition. The predetermined change condition may be that the condition related to the timing of an additional instruction by any one of a plurality of users having a predetermined relationship is satisfied, and / or that the plurality of users having a predetermined relationship have given additional instructions for a plurality of different specific types of additional objects. In this case, even if the condition related to the timing of the additional instruction by a user not having the predetermined relationship is satisfied, the predetermined change condition is not satisfied. The predetermined relationship among a plurality of users is, for example, that one of the plurality of users is a mutual follower of another of the plurality of users.In addition, when one user follows another user and the other user also follows the one user (the one user and the other user are following each other), the one user and the other user become mutual followers. Further, the predetermined relationship among a plurality of users may be that one of the plurality of users has a mutual following relationship with a predetermined user who is following each other with another of the plurality of users. Also, the predetermined relationship among a plurality of users may be a friendship relationship, or specific information (phone number, email address, predetermined ID (identification), etc.) of another of the plurality of users may be stored in the terminal device of one of the plurality of users. Further, the predetermined relationship among a plurality of users may be a relationship in which the number of times the plurality of users have participated in the same communication service and communicated with each other is equal to or more than a predetermined number of times. Also, the predetermined relationship among a plurality of users may be a relationship in which each of the plurality of users has participated in the same and different communication services, and the number of times is equal to or more than a predetermined number of times.

[0217] For example, if an addition instruction for the additional object 1201 indicating an orange, an addition instruction for the additional object 1202 indicating a mochi, and an addition instruction for the additional object 1203 indicating a pedestal are given by users belonging to the same communication group within a predetermined period (e.g., 10 seconds), a distribution screen including the additional object 1211 indicating a kagami mochi may be displayed. For example, if, within 10 seconds after the addition instruction for the additional object 1201 is given by user A, the addition instruction for the additional object 1202 and the addition instruction for the additional object 1203 are given by user B1, a predetermined change condition is satisfied. Also, if, within 10 seconds after the addition instruction for the additional object 1202 is given by user B2, the addition instruction for the additional object 1201 and the addition instruction for the additional object 1203 are given by user B2, a predetermined change condition is satisfied. Also, if, within 10 seconds after the addition instruction for the additional object 1203 is given by user B3, the addition instruction for the additional object 1202 is given by user B1 and the addition instruction for the additional object 1201 is given by user A, a predetermined change condition is satisfied. Also, if, within 10 seconds after the addition instruction for the additional object 1201 is given by user A, the addition instruction for the additional object 1202 and the addition instruction for the additional object 1203 are given by user A, a predetermined change condition is satisfied. Note that the determination process as to whether the predetermined change condition is satisfied is executed by the server transmission unit 332 of the server device 3 that has received each addition instruction transmitted by the terminal device 2 of each user.

[0218] In the display process of the distribution screen including the additional object 1211 showing a kagami mochi, after the display periods of the additional objects 1201, 1202, and 1203 have elapsed and the display of the additional objects 1201, 1202, and 1203 has ended within the distribution screen, the process of displaying the additional object 1211 showing a kagami mochi on the distribution screen may be included. Or, in the display process of the distribution screen including the additional object 1211 showing a kagami mochi, when there is an additional instruction regarding all of the additional objects 1201, 1202, and 1203 (or after a predetermined time has elapsed from all of the additional instructions), the process of ending the display of the additional objects 1201, 1202, and 1203 and displaying the additional object 1211 showing a kagami mochi on the distribution screen may be included. Or, in the display process of the distribution screen including the additional object 1211 showing a kagami mochi, at an arbitrary timing during the display of the additional objects 1201, 1202, and 1203, the process of ending the display of the additional objects 1201, 1202, and 1203 and displaying the additional object 1211 showing a kagami mochi on the distribution screen may be included.

[0219] Note that a plurality of specific types of additional objects that are different from each other may be, for example, additional objects of the same attribute respectively. Also, a plurality of specific types of additional objects that are different from each other may be additional objects of the same type respectively. Also, a plurality of specific types of additional objects that are different from each other may be additional objects associated with the same identification information respectively. Also, a plurality of specific types of additional objects that are different from each other may be a plurality of additional objects that are associated with each other and stored in a table or the like in advance. Note that the conditions regarding the display request of the additional object include a predetermined change condition that users belonging to the same communication group have given additional instructions for a plurality of specific types of additional objects that are different from each other. Thus, when a plurality of additional objects of the same attribute, a plurality of additional objects of the same type, or a plurality of additional objects associated with the same ID are associated with each other in a table or the like in advance, the conditions regarding the display request of the additional object include that the additional object requested to be displayed satisfies a predetermined change condition as described above. And the conditions regarding the display request of the additional object are not limited to the above example related to the predetermined change condition, and may widely include other conditions.

[0220] Note that, instead of the additional objects 1201, 1202, and 1203 changing to the additional object 1211 indicating a stacked rice cake due to the addition instruction of the additional object 1201 indicating an orange, the addition instruction of the additional object 1202 indicating a mochi, and the addition instruction of the additional object 1203 indicating a pedestal, when a predetermined change condition is satisfied, the display control is performed so that the additional objects 1201, 1202, and 1203 are arranged at predetermined relative positions, whereby the additional objects 1201, 1202, and 1203 may be configured to integrally indicate a stacked rice cake. The display control for arranging at predetermined relative positions means, for example, automatically arranging the additional object 1202 below the additional object 1201 by a first distance with respect to the additional object 1201, and automatically arranging the additional object 1203 below the additional object 1201 by a second distance (longer than the first distance), and displaying the additional objects 1201, 1202, and 1203.

[0221] FIG. 12(a) is a diagram showing an example of the distribution screen 1200 displayed on the display device 23 of the terminal device 2, and FIG. 12(b) is a diagram showing another example of the distribution screen 1210 displayed on the display device 23 of the terminal device 2.

[0222] Similar to the distribution screen 1010, the distribution screen 1200 includes a distribution image 1012 including a character object 1011, an evaluation button 1013, an additional button 1014, a comment button 1015, a response information display area 1016, and a viewing end button 1017. Also, similar to the distribution screen 1010, the distribution screen 1200 includes user output images 812a, 812b1, 812b2, and 812b3 each including character objects 811a, 811b1, 811b2, and 811b3.

[0223] Unlike the distribution screen 1010, the distribution screen 1200 includes an additional object 1201, an additional object 1202, and an additional object 1203. The additional objects 1201 to 1203 are each a still image or a moving image indicating an additional object. The additional objects 1201 to 1203 are additional objects of different specific types and are additional objects of a predetermined specific combination. Note that the combination of additional objects that satisfies the change condition may be two additional objects or four or more additional objects. Further, the combination of additional objects that satisfies the change condition may include at least a part of the same specific type of additional object. For example, in the case of a combination of an additional object of type G, an additional object of type G, an additional object of type H, and an additional object of type K, the change condition may be satisfied.

[0224] When the server transmission unit 332 of the server device 3 determines that a predetermined change condition is satisfied for the additional object 1201, the additional object 1202, and the additional object 1203, it transmits a display instruction for the additional object 1211 to the terminal devices 2 of the viewing users (including user A, user B1, user B2, and user B3) and the distribution user, together with the object ID of the additional object 1211. The combinations of the object IDs of the additional object 1201, the additional object 1202, and the additional object 1203 are stored in association with the object ID of the additional object 1211. When the display processing unit 274 of the terminal devices 2 of the viewing users and the distribution user receives the display instruction for the additional object 1211 by the receiving unit 273, it extracts a still image or a moving image (image information) of the additional object associated with the simultaneously received object ID from the terminal storage device 22. Next, the display processing unit 274 of the terminal device 2 generates a new distribution image 1012 that includes the additional object 1211, which is the extracted still image or moving image, in the distribution image 1012 that includes the character object 1011 of the distribution user. Thus, when the conditions regarding the display request for the additional object corresponding to the additional instruction of a plurality of types of additional objects are satisfied, an additional object different from the additional object corresponding to the additional instruction is displayed. Note that at least a part of the image of the additional object corresponding to the additional instruction may be used for the image of the additional object different from the additional object corresponding to the additional instruction.

[0225] The determination process of whether or not the specified change conditions are satisfied may be executed by the terminal device 2 of the distribution user. When the terminal device 2 of the distribution user receives, via the server device 3, an addition instruction for the additional object 1201, an addition instruction for the additional object 1202, and an addition instruction for the additional object 1203 from the terminal device 2 of the viewing user, the display processing unit 274 determines whether or not the specified change conditions are satisfied. When the terminal device 2 of the distribution user determines that the specified conditions are satisfied, it extracts the object ID of the additional object 1211 stored in the terminal storage device 22 in association with the combination of the object ID of the additional object 1201, the object ID of the additional object 1202, and the object ID of the additional object 1203, and executes the display processing of the additional object 1211. Then, the transmission unit 272 of the terminal device 2 of the distribution user transmits a display instruction for the additional object 1211, together with the object ID of the additional object 1211, to the terminal device 2 of the viewing user via the server device 3. When the display processing unit 274 of the terminal device 2 of the viewing user receives the display instruction for the additional object 1211 by the reception unit 273, it extracts a still image or a moving image (image information) of the additional object associated with the simultaneously received object ID from the terminal storage device 22. Next, the display processing unit 274 generates a new distribution image 1012 including the additional object 1211, which is the extracted still image or moving image, in the distribution image 1012 including the character object 1011 of the distribution user, and displays a distribution screen 1210 including the new distribution image 1012.

[0226] In the distribution screen 1200, before determining whether a predetermined change condition is satisfied, the display of the additional object 1201 in response to the addition instruction of the additional object 1201, the display of the additional object 1202 in response to the addition instruction of the additional object 1202, and the display of the additional object 1203 in response to the addition instruction of the additional object 1203 are performed. Before determining whether the predetermined change condition is satisfied, the displays of the additional object 1201, the additional object 1202, and the additional object 1203 are not performed. If it is not determined that the predetermined change condition is satisfied, the displays of the additional object 1201, the additional object 1202, and the additional object 1203 may be performed. In this case, when it is determined that the predetermined change condition is satisfied, the displays of the additional object 1201, the additional object 1202, and the additional object 1203 are not performed, and the display of the additional object 1211 is performed.

[0227] Further, the predetermined change condition may be that the numerical value input by any one of the users (for example, user A, user B1, user B2, and user B3) belonging to the same communication group within a predetermined period (for example, 10 seconds) exceeds a predetermined value. Note that the predetermined change condition may be that the numerical value input by any one of all the users viewing the same distribution screen within a predetermined period exceeds a predetermined value.

[0228] For example, when the total number of coins input within a predetermined period from the coins held by each user belonging to the same communication group exceeds a predetermined number, a distribution screen including a specific additional object may be displayed. When the total number of coins input within a predetermined period by each user belonging to the same communication group does not exceed the predetermined number, the size of the specific additional object may be changed so as to become smaller, and a distribution screen including the changed specific additional object may be displayed. Also, when the total number of coins input within a predetermined period by each user belonging to the same communication group does not exceed the predetermined number, a distribution screen not including the specific additional object may be displayed.

[0229] When an additional candidate object is selected in response to an operation of the input device 24 by User A, the input device 24 inputs an addition instruction to the terminal processing device 27 together with the object ID corresponding to the selected additional candidate object. When the input object ID is the object ID of a specific additional object, the display processing unit 274 displays the input screen 1300 on the display device 23. Next, the transmission unit 272 transmits an instruction to display the input screen, together with the user ID of User A stored in the terminal storage device 22 and / or the destination information, to the server device 3 via the terminal communication I / F 21. The server reception unit 331 of the server device 3 receives the instruction to display the input screen and the user ID of User A via the server communication I / F 31. When the destination information is transmitted together with the instruction to display the input screen, the server reception unit 331 receives the destination information. The server transmission unit 332 of the server device 3 transmits the instruction to display the input screen and the user ID of User A to the terminal device 2 of User B (User B1 to User B3) indicated by the user ID included in the destination information via the server communication I / F 31.

[0230] The receiving unit 237 of the terminal device 2 of User B (User B1 to User B3) receives, from the server device 3, a display instruction for the input screen of User A and the user ID of User A. The display processing unit 274 extracts, from the user table T1, the name associated with the received user ID of User A, and displays the input screen 1310 on the display device 23 based on the extracted name. Note that the input screen 1310 may not be automatically displayed in response to the reception of the display instruction. In this case, in the distribution screen, an icon or a badge or the like indicating that there has been a call such as "Let's send a gift together" from another user may be displayed, and when the user taps on the icon or the badge or the like, the input screen 1310 may be displayed.

[0231] FIG. 13(a) is a diagram showing an example of the input screen 1300 displayed on the display device 23 of the terminal device 2 of User A. The input screen 1300 is displayed superimposed on the distribution screen 1010. The input screen 1300 includes information prompting User A to input coins, information indicating the number of coins input by User A, and information indicating the total number of coins input by each user belonging to the same communication group. The input screen 1300 also includes a numerical input object 1301 for inputting the number of coins.

[0232] The numerical input object 1301 is an object image such as a button object for inputting the number of coins. In the example shown in Fig. 13(a), the input screen 1300 includes three types of button objects, but it may include two or fewer types of button objects, or may include four or more types of button objects. For example, when the numerical input object 1301 displayed as "1 coin" by user A is selected once, "1" is input as the number of coins input. Also, when the numerical input object 1301 displayed as "1 coin" by user A is selected five times, "1" is input five times as the number of coins input, and the number of coins input by user A becomes "5". Also, when the numerical input object 1301 displayed as "10 coins" by user A is selected twice, "10" is input twice as the number of coins input, and the number of coins input by user A becomes "20". Also, when the numerical input object 1301 displayed as "100 coins" by user A is selected three times, "100" is input three times as the number of coins input, and the number of coins input by user A becomes "300". In the example shown in Fig. 13(a), the number of coins input by user A is "220", and the total number of coins input by each user belonging to the same communication group is "730". Note that information that can recognize who input the coins may be displayed on the input screen 1300. As information that can recognize who input the coins, for example, the name of the user who input the coins is displayed. As information that can recognize who input the coins, instead of the name of the user who input the coins, or together with the name of the user who input the coins, an icon image indicating the user may be displayed. Further, the number of coins input by each user may be displayed.

[0233] FIG. 13(b) is a diagram showing an example of an input screen 1310 displayed on the display device 23 of the terminal device 2 of user B1. The input screen 1310 is displayed superimposed on the distribution screen 1010. The input screen 1310 includes information prompting user B1 to input coins, information indicating the number of coins input by user B1, and information indicating the total number of coins input by each user belonging to the same communication group. The input screen 1310 also includes a numerical input object 1311 for inputting the number of coins.

[0234] The numerical input object 1302 is an object image such as a button object for inputting the number of coins. It has the same function as the numerical input object 1301 shown in FIG. 13(a). In the example shown in FIG. 13(b), the number of coins input by user B1 is "130", and the total number of coins input by each user belonging to the same communication group is "730". Each time the numerical input object 1302 is selected in response to an operation of the input device 24 by user B1, the input device 24 inputs a numerical transmission instruction for transmitting the number of coins input by user B1 and the number of coins input by user B1 to the terminal processing device 27. The transmission unit 272 of the terminal device 2 of user B1 transmits information indicating the numerical transmission instruction input from the input device 24, together with the number of coins input and the user ID of user B1 stored in the terminal storage device 22, to the server device 3 via the terminal communication I / F 21. Next, the server reception unit 331 of the server device 3 receives, via the server communication I / F 31, information indicating the numerical transmission instruction, the number of coins input, and the user ID of user B1.

[0235] Next, the server transmission unit 332 of the server device 3 transmits information indicating the received numerical value transmission instruction, the number of coins input, and the user ID of user B1 to the terminal device 2 of user A (the user who gave the display instruction for the input screen) via the server communication I / F 31. Next, the reception unit 273 of the terminal device 2 of user A receives information indicating the numerical value transmission instruction, the number of coins input, and the user ID of user B1 via the terminal communication I / F 21. Then, the display processing unit 274 of the terminal device 2 of user A updates the total number of coins by adding the received input number to the total number of current coins input by each user belonging to the same communication group. Then, the display processing unit 274 of the terminal device 2 of user A displays the input screen 1300 including the updated total number of coins, and the transmission unit 272 transmits information indicating the updated total number of coins to the terminal devices 2 of users B (users B1 to B3) via the server device 3. As a result, it becomes possible to update the total number of coins also in the input screen 1300 displayed on the terminal devices 2 of users B (users B1 to B3). Note that the update process for the total number of coins may be executed by the server device 3. In this case, the update result (information indicating the updated total number of coins) is transmitted to the terminal devices 2 of users A and B (users B1 to B3) together with the information indicating the numerical value transmission instruction, the number of coins input, and the user ID of user B1.

[0236] The display processing unit 274 of the terminal device 2 of User A (the user who gave the instruction to display the input screen) displays the distribution screen 1010 including the specific additional object 1400 when the total number of updated coins exceeds a predetermined number F1 (for example, "1000") within a predetermined period E1 (for example, 10 seconds) after the input screen 1300 is displayed. Also, in this case, the transmission unit 272 of the terminal device 2 transmits the object ID indicating the specific additional object 1400 to the terminal devices 2 of the viewing users (including User B (Users B1 to B3)) of the distribution image 1012 via the server device 3. As a result, the distribution screen 1010 including the specific additional object 1400 can also be displayed on the input screen 1300 displayed on the terminal devices 2 of the viewing users of the distribution image 1012. FIG. 14(a) is a diagram showing an example of the distribution screen 1010 including the specific additional object 1400 displayed on the display device 23 of the terminal device 2 of User A. In the example shown in FIG. 14(a), the specific additional object 1400 is an additional object that is displayed together with various information regarding the user who gave the additional instruction. Note that the display processing unit 274 may display the distribution screen 1010 including the specific additional object 1400 with its size changed (for example, enlarged) when the total number of updated coins exceeds a predetermined number F2 (for example, "1500") within a predetermined period E2 (for example, 5 seconds) after the total number of updated coins exceeds the predetermined number F1.

[0237] Alternatively, the predetermined change condition may be that the total number of selections of a specific additional object input within a predetermined period (e.g., 10 seconds) by any one of the users belonging to the same communication group (e.g., User A, User B1, User B2, and User B3) exceeds a predetermined value. Note that the predetermined change condition may also be that the number of selections of a specific additional object input within a predetermined period by any one of all the users viewing the same distribution screen exceeds a predetermined number of times. Note that each time the numerical value corresponding to the number of selections increases, the shape, size, arrangement, color, brightness, and / or design of the additional object may continue to change. For example, it may be controlled such that the size of the additional object gradually increases as the numerical value corresponding to the number of selections increases. Also, as the numerical value corresponding to the number of selections increases, the design of the additional object may gradually change (e.g., the color and brightness change sequentially, or the appearance changes as an animal grows). Or, as the numerical value corresponding to the number of selections increases, other objects may be added to the additional object (such as the luxury of the appearance changing). Or, as the numerical value corresponding to the number of selections increases, the number displayed together with the additional object may increase or decrease. Also, the predetermined change condition may be that the number of users who input a specific additional object within a predetermined period (e.g., 10 seconds) among the users belonging to the same communication group (e.g., User A, User B1, User B2, and User B3) exceeds a predetermined number. Note that the predetermined change condition may also be that the number of users who input a specific additional object within a predetermined period among all the users viewing the same distribution screen exceeds a predetermined number. Note that each time the number of users who input a specific additional object increases, the shape, size, arrangement, color, brightness, and / or design of the additional object may continue to change. For example, it may be controlled such that the size of the additional object gradually increases as the number of users who input a specific additional object increases. Also, as the number of users who input a specific additional object increases, the design of the additional object may gradually change (e.g., the color and brightness change sequentially, or the appearance changes as an animal grows).Alternatively, as the number of users who input a specific additional object increases, other objects may be added to the additional object (such as a change in the luxury of the appearance). Or, as the number of users who input a specific additional object increases, the number displayed together with the additional object may increase or decrease.

[0238] In addition, when an additional condition that a numerical value corresponding to the total number of selections of a specific additional object input within a predetermined period (for example, 10 seconds) by any one of the users (for example, User A, User B1, User B2, and User B3) belonging to the same communication group exceeds a predetermined value is satisfied, an image indicating an additional candidate object corresponding to a new additional object corresponding to the condition may be added to the selection screen 1100. Also, when an additional condition that the number of users who input a specific additional object within a predetermined period (for example, 10 seconds) among the users (for example, User A, User B1, User B2, and User B3) belonging to the same communication group exceeds a predetermined number is satisfied, an image indicating an additional candidate object corresponding to a new additional object corresponding to the condition may be added to the selection screen 1100. In this way, if the above-described additional conditions are not satisfied, the information system 1 can prepare additional objects that are not added to the distribution screen of the distributing user, thereby improving the willingness of the users participating in the communication service to participate in the distribution event.

[0239] When an additional candidate object (within the selection screen 1100) is selected in response to an operation of the input device 24 by User A, additional processing according to the additional instruction is executed in each of the terminal devices 2 of User A, the viewing users (excluding User A), and the distributing user, as well as in the server device 3. Similarly, when an additional candidate object is selected in response to an operation of the input device 24 by each of Users B (Users B1 to B3), additional processing according to the additional instruction is executed in each of the terminal devices 2 of User B, the viewing users (excluding User B), and the distributing user, as well as in the server device 3.

[0240] Here, when the object ID corresponding to the additional candidate object selected according to the operation of the input device 24 by the users (for example, user A and users B1 to B3) belonging to the communication group is the object ID of a specific additional object, the display processing unit 274 of each user's terminal device 2 causes the aggregated parameter value stored in the terminal storage device 22 to be changed. For example, the change in the aggregated parameter value is a process of increasing by "1" each time it is determined that the object ID corresponding to the additional candidate object selected by the user is the object ID of a specific additional object.

[0241] For example, when an additional candidate object is selected according to the operation of the input device 24 by user A, if the object ID corresponding to the selected additional candidate object is the object ID of a specific additional object, before the addition process according to the addition instruction, the display processing unit 274 of user A's terminal device 2 causes the aggregated parameter value stored in the terminal storage device 22 to be changed. In the addition process according to the addition instruction by user A, the receiving unit 273 of user B's terminal device 2 receives, via the terminal communication I / F 21, information indicating the addition instruction, user A's user ID, and the object ID. Here, since the received object ID is the object ID of a specific additional object, the display processing unit 274 of the terminal device 2 causes the aggregated parameter value stored in the terminal storage device 22 to be changed.

[0242] When the aggregated parameter value exceeds a predetermined value or is below a predetermined value, the display processing unit 274 of each terminal device 2 belonging to the communication group executes a change process in the display process of a specific additional object hereafter. For example, when the object ID corresponding to the additional candidate object selected in response to the operation of the input device 24 by user A is the object ID of a specific additional object, the display processing unit 274 refers to the object table T2 and extracts a still image or a moving image (image information) of the additional object associated with the object ID. Next, the display processing unit 274 changes the extracted still image or moving image and generates a new distribution image 1012 including the changed still image or moving image (image of the specific additional object after the change) in the distribution image 1012 including the character object 1011 of the distribution user. Also, in the addition process in response to the addition instruction by user A, the receiving unit 273 of each terminal device 2 of the viewing user (excluding user A) and the distribution user receives information indicating the addition instruction, the user ID of user A, and the object ID via the terminal communication I / F 21. Next, when the received object ID is the object ID of a specific additional object, the display processing unit 274 of the terminal device 2 of user B refers to the object table T2 and extracts a still image or a moving image (image information) of the additional object associated with the received object ID. Next, the display processing unit 274 changes the extracted still image or moving image and generates a new distribution image 1012 including the changed still image or moving image (image of the specific additional object after the change) in the distribution image 1012 including the character object 1011 of the distribution user.

[0243] FIG. 14(b) is a diagram showing another example of a distribution screen 1410 including a modified specific additional object 1414 displayed on the display device 23 of the terminal device 2. The additional objects 1411 to 1413 included in the distribution screen 1410 are specific additional objects before modification, and the modified specific additional object 1414 is larger in size than the specific additional objects 1411 to 1413 before modification. In this way, after a predetermined change condition regarding the number of selections of a specific additional object selected in response to an additional instruction operation by a user belonging to a communication group is satisfied, when a specific additional object is selected in response to the additional instruction operation, the specific additional object is modified and displayed. Note that if at least one of the predetermined change conditions exemplified above is satisfied, the additional object added to the distribution screen changes in shape, size, arrangement, color, luminance, and / or design while being displayed on the distribution screen.

[0244] (Operation Sequence of Information System 1) FIG. 15 is a diagram showing an example of the operation sequence of the information system 1. This operation sequence is mainly executed by the terminal processing device 27 and the server processing device 33 in cooperation with the respective elements of the terminal device 2 and the server device 3 based on a control program stored in advance in the terminal storage device 22 and the server storage device 32. Hereinafter, it will be described assuming that user A operates the terminal device 2a, user B operates the terminal device 2b, and the distribution user C operates the terminal device 2c.

[0245] First, the transmission unit 272 of the terminal device 2a transmits, via the terminal communication I / F 21 together with the destination information, output information including the character video data including the motion data of user A generated by the generation unit 271 based on the imaging data continuously output by the imaging device 25, the voice data of user A output from the microphone 26, and the user ID of user A to the server device 3 (step S101). Note that the destination information may not be included in the transmission process of the transmission unit 272. Since the process of step S101 is continuously executed at predetermined time intervals (for example, every 2 seconds) until the distribution event ends, the processes related to steps S101 to S110 are intermittently executed.

[0246] Next, the server transmission unit 332 of the server device 3 refers to the destination information and transmits the output information received from the terminal device 2a to the terminal device 2b via the server communication I / F 31 (step S102).

[0247] Also, the transmission unit 272 of the terminal device 2b transmits, via the terminal communication I / F 21 together with the destination information, output information including the character video data of user B, the voice data of user B, and the user ID of user B to the server device 3 (step S103). Next, the server transmission unit 332 of the server device 3 refers to the destination information and transmits the output information received from the terminal device 2b to the terminal device 2a via the server communication I / F 31 (step S104).

[0248] The display processing unit 274 of the terminal device 2a displays and outputs, on the display device 23 of the terminal device 2a, a communication screen including a user output image including the character object of user A and a user output image including the character object of user B based on the respective output information of user A and user B, and outputs the voice of user B (step S105).

[0249] Similar to step S105, the display processing unit 274 of the terminal device 2b displays and outputs a communication screen including a user output image including the character object of user A and a user output image including the character object of user B based on the respective output information of user A and user B on the display device 23 of the terminal device 2b, and outputs the voice of user A (step S106).

[0250] The transmission unit 272 of the terminal device 2c transmits output information including the character video data of the distribution user C and the voice data of the distribution user C to the server device 3 via the terminal communication I / F 21 in order to distribute it to the terminal device 2 of the viewing user (step S107).

[0251] The transmission unit 272 of the terminal device 2a transmits information indicating a viewing start instruction, which is input in response to the operation of the input device 24 by user A, to the server device 3 via the terminal communication I / F 21 together with the user ID of the distribution user C, the user ID of user A, and the destination information (user ID of user B) (step S108). Next, the server transmission unit 332 of the server device 3 refers to the received user ID of user A and the destination information (user ID of user B), and transmits the output information received (step S109) from the terminal device 2c of the distribution user C to the terminal device 2a via the server communication I / F 31 (step S110) and to the terminal device 2b (step S111).

[0252] The display processing unit 274 of the terminal device 2a displays and outputs a distribution screen including a distribution image including the character object of the distribution user C based on the output information of the distribution user C on the display device 23 of the terminal device 2a, and outputs the voice of the distribution user C (step S112).

[0253] The display processing unit 274 of the terminal device 2b displays and outputs a distribution screen including a distribution image including the character object of the distribution user C based on the output information of the distribution user C on the display device 23 of the terminal device 2b, and outputs the voice of the distribution user C (step S113).

[0254] As described in detail above, in the information system 1 of the present embodiment, in response to an instruction from user A or an instruction from user B while participating in the communication service, the terminal device 2 of user A receives the output information transmitted from the terminal device 2 of the distribution user via the server device 3. Thereby, the terminal device 2 of user A can view the distribution image of the distribution user. In this way, by changing the output from the terminal device 2 by user A or at least one user B during the communication service by the information system 1 of the present embodiment, it is possible to improve the user's willingness to continue using for communication. Also, upon receiving a viewing start instruction from one user participating in the communication service, a plurality of users (one user and other users) participating in the communication service can view the same distribution image simultaneously, enabling the activation of viewing of the distribution image. In addition, the user can give additional objects such as gifts that cannot be given to the character object of the distribution user by one user together with other users, thereby fostering a sense of unity among the users participating in the communication service, that is, it is possible to improve the willingness to view the distribution image during the communication service. Furthermore, since the user can seamlessly start co-viewing of content such as a distribution image while continuing the communication service, it is possible to continue communication via the avatar while viewing the same content among users.

[0255] (Modification Example 1) Note that the present invention is not limited to the present embodiment. For example, the information system 1 may have a function that enables the start of a distribution event for a user during communication with other users. For example, in the communication screen 810 shown in FIG. 8(b), a distribution start button may be included together with the viewing start button 813. The distribution start button is an object image such as a button object for inputting a distribution start instruction for instructing the start of distribution of a distribution image by the user.

[0256] For example, when the distribution start button is selected by operating the input device 24 by User A, the input device 24 inputs a distribution start instruction to the terminal processing device 27. The transmission unit 272 of the terminal device 2 of User A (the user who input the distribution start instruction) transmits, in response to the distribution start instruction by User A, information regarding the distribution start instruction for instructing the start of the distribution event by the user, together with the user ID of User A stored in the terminal storage device 22, to the server device 3 via the terminal communication I / F 21.

[0257] Next, the server reception unit 331 of the server device 3 receives, via the server communication I / F 31, the information regarding the distribution start instruction transmitted from the terminal device 2 of the user and the user ID. The server reception unit 331 stores the received user ID in the server storage device 32 as the distribution user ID indicating the user during distribution. As a result, User A is registered in the server device 3 as the distribution user. Thereafter, the server reception unit 331 receives, via the server communication I / F 31, the output information of User A transmitted together with the user ID of User A from the terminal device 2 of User A as the output information of the distribution user.

[0258] At a predetermined timing (for example, immediately after receiving the distribution start instruction, or after a predetermined time has elapsed since the distribution start instruction), the server receiving unit 331 extracts from the user table T1 the model ID of the character object associated with the user ID of user A, who is the distribution user, and the object ID of the object to be used. Next, based on the model data associated with the extracted model ID, the image information and the placement location associated with the object ID of the extracted object to be used, the server receiving unit 331 generates a thumbnail image of the character object of user A. The server receiving unit 331 stores the generated thumbnail image in the server storage device 32 in association with the user ID of user A (the distribution user) as the selected image of user A. The thumbnail image stored as the selected image may be any image as long as it shows the character object of the distribution user created in advance. For example, the profile image of the character object of the distribution user may be stored as the thumbnail image.

[0259] The display processing unit 274 of the terminal device 2 of user A displays a distribution screen including its own distribution image. That is, the display processing unit 274 of the terminal device 2 of user A displays, on the display device 23, as the distribution image, an image drawn based on the motion data (character video data) of user A generated by the generation unit 271. Note that, unlike the distribution screen 1010, the evaluation button 1013, the addition button 1014, and the comment button 1015 are not included in the distribution screen displayed on the terminal device 2 of user A, who is the distribution user. Also, in the distribution screen displayed on the terminal device 2 of user A, the user output images 812a, 812b1, 812b2, and 812b3 are displayed when a viewing start instruction is given by any one of users B1 to B3.

[0260] Also, on the distribution screen displayed on the terminal device 2 of user A who is the distribution user, a distribution end button is displayed, similar to the viewing end button 1017 of the distribution screen 1010. The distribution end button is an object image such as a button object for ending the display of the distribution screen and ending the distribution of the distribution image. When the distribution end button is selected by the operation of the input device 24 by user A, the display processing unit 274 ends the display of the distribution screen and redisplays the communication screen 810 (Fig. 8(b)). Next, the transmission unit 272 of the terminal device 2 transmits information regarding the distribution end instruction, together with the user ID stored in the terminal storage device 22, to the server device 3 via the terminal communication I / F 21.

[0261] The server reception unit 331 of the server device 3 receives the information regarding the distribution end instruction transmitted from the terminal device 2 of user A and the user ID (distribution user ID) of user A via the server communication I / F 31. Then, the server reception unit 331 deletes the received user ID of user A and the viewing user ID associated with the user ID of user A from among the distribution user IDs stored in the server storage device 32. Thereby, the distribution of the distribution image of user A who selected the distribution end button ends.

[0262] In this way, by the information system 1, during the communication service, by enabling the output from the user's terminal device to be changed by the user or other users through a simple interface, it becomes possible to improve the user's willingness to continue using the communication.

[0263] In a conventional information system, when a user is communicating with another user and wants to start another service, the user has to interrupt or terminate the communication service. After that, the user and the other user can receive the provision of another service by instructing the server device or the like to start the other service. Thus, in the conventional information system, when the user and the other user want to receive the provision of another service while receiving the provision of a service, a plurality of communications related to the interruption or termination of the service and the start of another service occur, which may cause a problem of an increase in the processing load of the terminal device and / or the communication load between the terminal device and the server device. In contrast, in the information system 1, a user receiving a communication service can start the distribution of the distribution image of his or her character object by a simple operation of only selecting a distribution start button. Also, in the information system 1, a user during the distribution of the distribution image can end the distribution and easily return to the communication service by simply giving an instruction to end the distribution. Thus, the user and the other user can receive the provision of various services with less communication than in the conventional information system, and it is possible to reduce the processing load of the terminal device and / or the communication load between the terminal device and the server device.

[0264] (Modification Example 2) Also, the information system 1 may have a function that enables viewing of a distribution event when another user communicating with a user starts the distribution event. FIG. 16(a) is a diagram showing another example of a communication screen 1600 displayed on the display device 23 of the terminal device 2 of user A.

[0265] On the communication screen 1600, similar to the communication screen 810, there are included the user output image 812a of user A, the user output image 812b1 of user B1, the user output image 812b2 of user B2, the user output image 812b3 of user B3, and the viewing start button 813. Different from the communication screen 810, on the communication screen 1600, a live broadcast mark 1601 indicating the user who has started the distribution event is displayed.

[0266] In the example shown in FIG. 16(a), since the live broadcast mark 1601 is included within the display area of the user output image 812b3 of user B3, it can be visually recognized that user B3 has started the distribution event. Note that the user output image 812b3 of user B3 is the same as the distribution image being distributed by user B3 in the distribution event, but within the display area of the user output image 812b3 of user B3, a thumbnail image of the character object of user B3 may be displayed instead of the user output image 812b3. Also, within the display area of the user output image 812b3 of user B3, character information or the like indicating that it is in the process of being distributed may be displayed instead of the user output image 812b3. Further, when the communication screen 1600 is being displayed, the voice data of user B3 may not be output. In the communication screen 1600 shown in FIG. 16(a), when the viewing start button 813 is selected by the operation of the input device 24 by user A, the selection screen 1610 is displayed.

[0267] FIG. 16(b) is a diagram showing an example of the selection screen 1610 displayed on the display device 23 of the terminal device 2 of user A. On the selection screen 1610, selection images 1611, 1612, 1613, and 1614 related to the currently distributed distribution image are displayed on the communication screen 1600. Each of the selection images 1611, 1612, 1613, and 1614 is an image for selecting the distribution image to be viewed, similar to the selection images 901, 902, 903, and 904 included in the selection screen 900.

[0268] The selected image 1611 is a selected image for selecting the distribution image of user B3 who was communicating with user A. When the selected image 1611 is selected by the operation of the input device 24 by user A, the input device 24 inputs an instruction to start viewing the distribution image of user B3 to the terminal processing device 27. Thereafter, various processes for starting viewing similar to the selection screen 900 and the confirmation screen 910 are executed, and the distribution screen 1700 is displayed.

[0269] FIG. 17(a) is a diagram showing an example of the distribution screen 1700 displayed on the display device 23 of the terminal device 2 of user A. On the distribution screen 1700, various similar objects are displayed except that the character objects included in the distribution screen 1010 are different. Note that, in the distribution screen 1700, since the character object 1701 of user B3 is included, the user output image 812b3 of user B3 may not be included.

[0270] When the end viewing button 1017 is selected by the operation of the input device 24 by user A, the display processing unit 274 ends the display of the distribution screen 1700 and redisplays the communication screen 1600 (FIG. 16(a)).

[0271] (Modification Example 3) Further, the information system 1 may have a function that enables a user who is communicating with other users to start a distribution event by all or some of the users who are communicating. FIG. 17(b) is a diagram showing another example of the communication screen 1710 displayed on the display device 23 of the terminal device 2 of user A.

[0272] The communication screen 1710 includes, similar to the communication screen 810, a user output image 812a including the character object 811a of user A, a user output image 812b1 including the character object 811b1 of user B1, a user output image 812b2 including the character object 811b2 of user B2, a user output image 812b3 including the character object 811b3 of user B3, and a viewing start button 813. Different from the communication screen 810, the communication screen 1710 further includes a distribution start button 1711.

[0273] The distribution start button 1711 is an object image such as a button object for instructing the start of distribution of a distribution image including the respective character objects of user A and all users (users B1 to B3) communicating with user A.

[0274] For example, when the distribution start button 1711 is selected by an operation of the input device 24 by user A, the input device 24 inputs a distribution start instruction to the terminal processing device 27. The transmission unit 272 of the terminal device 2 of user A (the user who input the distribution start instruction) transmits information regarding the distribution start instruction for instructing the start of the user's distribution event to the server device 3 via the terminal communication I / F 21 together with the user ID of user A stored in the terminal storage device 22 and the respective user IDs of users B1 to B3.

[0275] Next, the server receiving unit 331 of the server device 3 receives, via the server communication I / F 31, information regarding the distribution start instruction transmitted from the user's terminal device 2, the user ID of user A, and the respective user IDs of users B1 to B3. The server receiving unit 331 stores the received user IDs of the four users in the server storage device 32 as distribution user IDs indicating the users being distributed. As a result, user A and users B1 to B3 are registered in the server device 3 as the distribution users of a common distribution image. Thereafter, the server receiving unit 331 receives, via the server communication I / F 31, the output information of user A and users B1 to B3 transmitted together with the user ID of user A from the terminal device 2 of user A as the output information of the distribution users.

[0276] Note that at a predetermined timing (for example, immediately after receiving the distribution start instruction, or after a predetermined time has elapsed since the distribution start instruction), the server receiving unit 331 extracts, from the user table T1, the model ID of each character object associated with the user ID of each of user A and users B1 to B3 who are the distribution users, and the object ID of the object to be used. Next, based on each model data associated with the extracted model IDs and the image information and placement location associated with the object ID of the extracted object to be used, the server receiving unit 331 generates thumbnail images of the character objects of user A and users B1 to B3 respectively. The server receiving unit 331 stores the generated thumbnail images in the server storage device 32 in association with the user ID of user A (the distribution user), who is one of the distribution users, as the selected image of user A. The thumbnail image stored as the selected image may be any image as long as it shows the character object of the distribution user created in advance. For example, the profile image of the character object of the distribution user may be stored as the thumbnail image.

[0277] The server transmission unit 332 of the server device 3 transmits the output images of each of user A and users B1 to B3 to the terminal device 2 of the viewing user. The display processing unit 274 of the terminal device 2 of the viewing user displays a distribution screen including a distribution image common to the four users. That is, the display processing unit 274 of the terminal device 2 of the viewing user displays, on the display device 23, as a distribution image, an image drawn based on the received motion data (character video data) of each of user A and users B1 to B3.

[0278] FIG. 18(a) is a diagram showing an example of the distribution screen 1800 displayed on the display device 23 of the terminal device 2 of the viewing user. The distribution screen 1800 includes an evaluation button 1013, an addition button 1014, and a comment button 1015, similar to the distribution screen 1010. Further, different from the distribution screen 1010, the distribution screen 1800 displays a distribution image 1801 including character objects 811a, 811b1, 811b2, 811b3 of each of user A and users B1 to B3.

[0279] The display processing unit 274 of each of the terminal devices 2 of user A and users B1 to B3 displays a distribution screen including a distribution image 1801 common to the four users. Note that, different from the distribution screen 1800, the distribution screens displayed on each of the terminal devices 2 of user A and users B1 to B3, who are the distribution users, do not include the evaluation button 1013, the addition button 1014, and the comment button 1015.

[0280] Also, on the distribution screen displayed on the terminal device 2 of user A, who is the distribution user, a distribution end button is displayed, similar to the viewing end button 1017 of the distribution screen 1010. The distribution end button is an object image such as a button object for ending the display of the distribution screen and ending the distribution of the distribution image. When the distribution end button is selected by an operation of the input device 24 by user A, the display processing unit 274 displays an end confirmation screen 1810.

[0281] FIG. 18(b) is a diagram showing an example of an end confirmation screen 1810 displayed on a display device 23 of a terminal device 2 of a distribution user. The end confirmation screen 1810 is displayed superimposed on a distribution screen 1800. The end confirmation screen 1810 includes a selection object 1811 for selecting whether to shift to a communication service, an end distribution button 1812, and a continue distribution button 1813.

[0282] In response to the selection by user A for the selection object 1811, the display indicating the selected state of the selection object 1811 and the display indicating the non-selected state of the selection object 1811 are switched. When user A selects the selection object 1811 in the non-selected state, the selection object 1811 changes to the selected state, and when user A selects the selection object 1811 in the selected state, the selection object 1811 changes to the non-selected state.

[0283] The distribution end button 1812 is an object image such as a button object for ending the display of the distribution screen 1800 and ending the distribution of the distribution image 1801. When the distribution end button is selected by the operation of the input device 24 by User A, the display processing unit 274 ends the display of the distribution screen 1800. When the option object 1811 is in a selected state, the display processing unit 274 redisplay the communication screen 1710 (Fig. 17(b)). On each of the terminal devices 2 of other distribution users, User B1 to B3, a screen regarding whether or not to participate in the communication service may be displayed before the communication screen 1710 is redisplayed. In this case, on the terminal device 2 that has rejected participation in the communication service, the communication screen 1710 is not redisplayed. When the option object 1811 is in a non-selected state when the distribution end button is selected by the operation of the input device 24 by User A, the display of the distribution screen 1800 is ended without redisplaying the communication screen 1710 (Fig. 17(b)). Next, the transmission unit 272 of the terminal device 2 transmits information regarding the distribution end instruction, together with the user ID stored in the terminal storage device 22, to the server device 3 via the terminal communication I / F 21. When information regarding the selection by User A for the option object 1811 is transmitted to each of the terminal devices 2 of other distribution users, User B1 to B3, via the server device 3, a message regarding whether or not to shift to the communication service may be displayed on each of the terminal devices 2 of User B1 to B3. Then, on the terminal device 2 that has input an instruction to shift to the communication service, the communication screen 1710 is redisplayed.

[0284] The server receiving unit 331 of the server device 3 receives information regarding the distribution end instruction transmitted from the terminal device 2 of user A and the user IDs (distribution user IDs) of user A and users B1 to B3 via the server communication I / F 31. Then, the server receiving unit 331 deletes the received user IDs of user A and users B1 to B3 and the viewing user IDs associated with the user IDs of user A and users B1 to B3 from among the distribution user IDs stored in the server storage device 32. As a result, the distribution of the distribution image of user A who selected the distribution end button ends.

[0285] When the distribution end button is selected by the operation of the input device 24 by user A, the display processing unit 274 ends the display of the end confirmation screen 1810, and the display of the distribution screen 1800 ends.

[0286] In this way, by the information system 1, during the communication service, by enabling the output from the user's terminal device to be changed by the user or other users through a simple interface, it becomes possible to improve the user's willingness to continue using for communication. Note that in response to an operation on any one of the terminal devices 2 of a plurality of users who are not participating in the communication service, the plurality of users become distribution users, and a distribution screen including a distribution image common to the plurality of users (a distribution image including each character object of the plurality of users) may be configured to be displayed. In this case, a button for instructing the start of the communication service is displayed within the distribution screen including the distribution image common to the plurality of users, and when the button is operated by any one of the plurality of users, a communication group to which the plurality of users belong is configured, and the communication service related to the communication group may be started.

[0287] (Modification Example 4) When users belonging to each of a plurality of communication groups view a distribution image by the same distribution user, a ranking for each communication group may be displayed at the end of the distribution of the distribution image. For example, each time an additional instruction for an additional object is transmitted from a user belonging to a communication group to the server device 3, the server device 3 increases the group points corresponding to the communication group to which the user who gave the additional instruction belongs. At the end of the distribution of the distribution image, the server device 3 creates ranking information according to the group points for each communication group that viewed the distribution image, and transmits the ranking information to the terminal device 2 of the viewing user. As a result, the viewing user can view the ranking of the communication group for the distribution image that the user has viewed. Further, the server device 3 may transmit the ranking information to the terminal device 2 in response to a display request from the terminal device 2. In addition, when the total of the group points of the communication group generated within a specific period during the distribution of the distribution image of a specific distribution user is equal to or more than a predetermined value, each user belonging to the communication group may be given an item regarding the specific distribution user.

[0288] (Modification Example 5) The information system 1 may provide a function that enables a communication group to be created after the distribution of a distribution image between a viewing user who has not participated in the communication service and another viewing user who has viewed the distribution image by the same distributing user. For example, the server transmission unit 332 of the server device 3 transmits display data of a screen for inquiring whether or not to create a group to the terminal device 2 of the viewing user of the distribution image whose distribution has ended. When the server reception unit 331 of the server device 3 receives an instruction to create a group from the terminal device 2, the server transmission unit 332 transmits display data for displaying the group creation screen 600 (FIG. 6(a)) to the terminal device 2. The display processing unit 274 of the terminal device 2 that has received the display data displays the group creation screen 600. In the other user display area 601 in the group creation screen 600, other user information indicating viewing users other than the user of the terminal device 2 is displayed. In this way, by providing the group creation screen 600 in which other user information indicating viewing users is displayed from the server device 3, the user of the terminal device 2 can create a communication group and start a communication service by operating on the group creation screen 600. Note that the provision of the group creation screen 600 in which other user information indicating viewing users is displayed may be executed during the distribution of the distribution image.

[0289] (Modification Example 6) Also, when the distribution of the distribution image by a specific distribution user is started, a notification object may be displayed on the communication screen 810 shown in FIG. 8(b). The notification object is a popped-up object or a so-called "badge" superimposed on the viewing start button 813. The specific distribution user is a user who belongs to the group (the group shown in the group table T3) to which the user who is communicating on the communication screen 810 belongs and who is not communicating on the communication screen 810. In response to the selection of the notification object by the user, the selection screen 900 or 1000 is displayed. Note that the selection screen 900 or 1000 includes the selected image of the specific distribution user. Thereby, the user can view the distribution image of the specific distribution user. Alternatively, in response to the selection of the notification object by the user, the distribution screen 1010 related to the distribution image 1012 of the specific distribution user may be displayed. Also, when a communication group is selected by a specific distribution user before or at the start of the distribution of the distribution image in the terminal device 2 of the specific distribution user, when the distribution of the distribution image is started, the above-described notification object may be automatically displayed on the communication screen 810 related to the selected communication group. By realizing the above-described viewing start method in the terminal device 2, the user can efficiently select the distribution to be viewed, that is, the number of user operations can be reduced, and the usability of the user can be improved. Thereby, it is possible to reduce the processing load in the terminal device 2.

[0290] (Modification Example 7) When the character object is generated based on 3D model data for generating 3D animations, the user output image for each user may be an image of the character object, which is a three-dimensional object (3D object) arranged in a virtual space determined for each user, as seen from a predetermined viewpoint within the virtual space. For example, the display processing unit 274 arranges a 2D screen in the line-of-sight direction of a predetermined viewpoint, projects the 3D coordinates of various three-dimensional objects arranged in the virtual space onto the 2D screen, and displays an image of the 2D screen surface onto which various objects are projected as the user output image. Note that the line-of-sight direction of the predetermined viewpoint is the direction facing the character object, and the 2D screen moves and rotates according to the movement of the predetermined viewpoint and the rotation of the line-of-sight direction.

[0291] In addition, the display processing unit 274 may control the movement of a predetermined viewpoint and / or the rotation of the line-of-sight direction of the predetermined viewpoint in response to a predetermined operation on the communication screen. Further, the display processing unit 274 may include an automatic movement button for automatically moving a predetermined viewpoint in the communication screen. In this case, for example, when the automatic movement button is selected by an operation of the input device 24 by user A, the display processing unit 274 may automatically move the predetermined viewpoint according to a predetermined movement rule.

[0292] (Modification Example 8) When the character object is generated based on 3D model data for generating 3D animations, the user output image for each user is an image of the virtual space as seen from a user viewpoint arranged at a predetermined position (for example, the position of the eyes of the character object) of the character object, which is a three-dimensional object (3D object) arranged in a virtual space common to each user. Note that the user viewpoint may move from a predetermined position of the character object in response to an operation by the user and / or automatically, and may be located behind, above, or in front of the character object.

[0293] An example of how to use the communication service in the virtual space common to each user will be described. For example, in FIG. 1 9 As shown in FIG. 2, the display processing unit 274 causes a device object S such as a virtual tablet PC to appear within the field of view from the user's perspective of the character object C of user A in the virtual space. Various screens described in FIGS. 6 to 15 and 17 are displayed on the display device portion of this device object S. In this case, the user output image of user A displayed on the display device portion of the device object S is a two-dimensional image seen from within the virtual space from a virtual camera provided at a predetermined position of the device object S. The voice data of user A is the voice data acquired by the microphone 26 of the terminal device 2.

[0294] The transmission unit 272 of the terminal device 2 transmits the user output image of user A, the voice data of user A, and the user ID of user A to the terminal devices 2 of all user Bs via the server device 3. Note that the transmission unit 272 may transmit, instead of the user output image of user A, the position and line-of-sight direction of the virtual camera in the virtual space, the position and body orientation of the character object of user A in the virtual space, and the motion data of user A. Also, the terminal device 2 of user A receives the user output image of each user B, the voice data of each user B, and the user ID of each user B from the terminal devices 2 of each user B via the server device 3. Then, the display processing unit 274 of the terminal device 2 of user A displays the user output image of each user B on the display device portion of the device object S and outputs the voice data of each user B as voice from the terminal device 2. Thereby, it becomes possible to realize a communication service using the virtual device object S.

[0295] (Modification Example 9) At least a part of the functions realized by the terminal processing device 27 of the terminal device 2 may be realized by a processor other than the terminal processing device 27 of the terminal device 2. At least a part of the functions realized by the terminal processing device 27 may be realized by, for example, the server processing device 33 of the server device 3. Specifically, a part of the functions of the generation unit 271 and the display processing unit 274 may be executed in the server device 3. For example, the terminal device 2 transmits the continuously acquired imaging data and audio data to the server device 3 together with the user ID of the user who operates the terminal device 2. Then, the server device 3 uses the functions of the generation unit 271 and the display processing unit 274 to generate character video data and generate display information for displaying a communication screen including the user output images of all users on the display device 23. Then, the server device 3 transmits the display information to each terminal device 2 of all users together with audio information (audio data). Each terminal device 2 outputs the information received from the server device 3 (so-called "server rendering").

[0296] (Modification Example 10) The terminal device 2 has a function of displaying a communication screen or the like by executing various instructions included in a control program stored in the terminal device 2. However, in order to realize a communication service, the terminal device 2 calls a browser function incorporated in a web application, and uses this browser function to receive a web page (a document described in a markup language such as HTML (Hyper Text Markup Language)) from a server device, and may execute a control program incorporated in this web page (so-called "browser rendering"). For example, by using HTML 5 as the markup language, the terminal device 2 can easily execute new information processing. By adopting such a web application to realize a communication service in the terminal device, the program producer can provide new information processing to the client side (terminal device side) simply by incorporating a new program into the web page transmitted by the server device, and can significantly reduce the man-hours for producing the new program. Also, on the client side, by simply receiving a web page without downloading a new control program, the client can receive the provision of a new service, and it is possible to reduce the load on the communication network, communication cost, and / or communication time compared to downloading the control program, and it is possible to realize simplification of the user interface.

[0297] (Modification Example 11) The generation unit 271 of the terminal device 2 of User A may generate output information including face motion data without using imaging data. For example, the terminal storage device 22 of the terminal device 2 stores face motion data corresponding to voice data, and the generation unit 271 extracts the face motion data corresponding to the acquired voice data of User A from the terminal storage device 22, and generates output information including the extracted face motion data, the voice data, and the user ID of User A. Further, the generation unit 271 of the terminal device 2 of User A may generate output information including the voice data of User A output from the microphone 26 and the user ID stored in the terminal storage device 22 without including the face motion data. In this case, the display processing unit 274 of the terminal device 2 of User B may extract the face motion data corresponding to the voice data of User A included in the output information of User A received via the server device 3, and generate an animation of the character object of User A. Note that the generation process of the face motion data corresponding to the user's voice data may be a process using a known lip-sync algorithm.

[0298] In this way, in the terminal device 2 of User A that uses the HMD as the display device 23, it is possible to communicate with User B via the character object without acquiring the imaging data of User A.

Description of Signs

[0299] 1 Information system 2 (2a, 2b1, 2b2) Terminal device 21 Terminal communication I / F 22 Terminal storage device 23 Display device 24 Input device 25 Imaging device 26 Microphone 27 Terminal processing device 271 Generation unit 272 Transmission unit 273 Reception unit 274 Display processing unit 275 Voice output unit 3 Server device 31 Server communication I / F 32 Server storage device 33 Server processing device 331 Server receiving section 332 Server transmitting section 4 Base station 5 Mobile communication network 6 Gateway 7 Internet

Claims

1. A control program for a terminal device of a first user, comprising: displaying on the terminal device of the first user at least a first image including a first object indicating the first user and a second image including a second object indicating a second user different from the first user; in response to a first instruction by the first user, transmitting information for displaying a third image including the first object and the second object to a terminal device of at least a third user different from the first user and the second user so that the third image is displayed on the terminal device of the third user; displaying the third image in response to a first instruction by the first user or a first instruction by the second user; ending the display of the first image and the second image in response to the display of the third image; ending the display of the third image and redisplaying the first image and the second image in response to a second instruction by the first user or a second instruction by the second user during the display of the third image. A control program for causing the above to be executed.

2. The control program according to claim 1, wherein the first object changes according to an action or voice of the first user, and the second object changes according to an action or voice of the second user.

3. In the display of the first image and the second image, on the terminal device of the first user: transmitting information regarding the display of the first image to the terminal device of the second user; when the voice of the first user is acquired, transmitting the voice of the first user to the terminal device of the second user; displaying the first image including the first object that changes according to an action or voice of the first user; when the voice of the second user is received, outputting the voice of the second user; displaying the second image including the second object that changes according to an action or voice of the second user. The control program according to claim 2, for causing the above to be executed.

4. During the display of the third image, on the terminal device of the first user: when the voice of the second user is received, outputting the voice of the second user; when the voice of the first user is acquired, transmitting the voice of the first user to the terminal devices of the second user and the third user respectively. The control program according to claim 1, for causing the above to be executed.

5. On the terminal device of the first user ​ Ending the display of the third image in response to a third instruction by the first user or a third instruction by the second user during the display of the third image, without redisplaying the first image and the second image. The control program according to claim 1, which causes the above to be executed. **Claim 6** The third image is changed in response to a specific instruction by the third user. The control program according to any one of claims 1 to 5, wherein the first image and the second image are not changed in response to a specific instruction by the third user. **Claim 7** On the terminal device of the first user, Receiving information for displaying a fourth image including a third object indicating the distribution user from the terminal device of the distribution user in response to a fourth instruction by the first user or a fourth instruction by the second user, and displaying the fourth image. The control program according to any one of claims 1 to 6, which causes the above to be executed. **Claim 8** A control program for a server device capable of communicating with each of a terminal device of a first user and a terminal device of a second user different from the first user, Receiving information regarding the display of a first image including a first object indicating the first user from the terminal device of the first user, and receiving information regarding the display of a second image including a second object indicating the second user from the terminal device of the second user. Transmitting information for at least displaying the first image to at least the terminal device of the second user, and transmitting information for at least displaying the second image to at least the terminal device of the first user. Transmitting information for displaying a third image including the first object and the second object, received from the terminal device of the first user or the terminal device of the second user, to at least one terminal device of a third user different from the first user and the second user in response to a first instruction by the first user or a first instruction by the second user. On the terminal device of the first user, Causing the third image to be displayed in response to a first instruction by the first user or a first instruction by the second user. On the terminal device of the first user, Ending the display of the first image and the second image in response to the display of the third image. Ending the display of the third image and redisplaying the first image and the second image in response to a second instruction by the first user or a second instruction by the second user during the display of the third image. A control program for execution.

9. A terminal device of a first user, displaying at least a first image including a first object indicating the first user and a second image including a second object indicating a second user different from the first user, in response to a first instruction by the first user, transmitting information for displaying a third image including the first object and the second object so that the third image is displayed on a terminal device of at least one third user different from the first user and the second user, displaying the third image in response to a first instruction by the first user or a first instruction by the second user, ending the display of the first image and the second image in response to the display of the third image, a processing unit that ends the display of the third image and redisplays the first image and the second image in response to a second instruction by the first user or a second instruction by the second user during the display of the third image A terminal device comprising the same.

10. A server device capable of communicating with each of a terminal device of a first user and a terminal device of a second user different from the first user, receiving information regarding the display of a first image including a first object indicating the first user from the terminal device of the first user, and receiving information regarding the display of a second image including a second object indicating the second user from the terminal device of the second user, transmitting information for displaying at least the first image to at least the terminal device of the second user, and transmitting information for displaying at least the second image to at least the terminal device of the first user, transmitting information for displaying a third image including the first object and the second object, received from the terminal device of the first user or the terminal device of the second user, to a terminal device of at least one third user different from the first user and the second user in response to a first instruction by the first user or a first instruction by the second user, to the terminal device of the first user, causing the third image to be displayed in response to a first instruction by the first user or a first instruction by the second user, to the terminal device of the first user, ending the display of the first image and the second image in response to the display of the third image, A processing unit that ends the display of the third image and redisplays the first image and the second image in response to a second instruction by the first user or a second instruction by the second user during the display of the third image A server device comprising the same **Claim 11** A control method for a terminal device of a first user, comprising: The terminal device of the first user Displays at least a first image including a first object indicating the first user and a second image including a second object indicating a second user different from the first user In response to a first instruction by the first user, transmits information for displaying a third image including the first object and the second object so that the third image is displayed on a terminal device of at least one third user different from the first user and the second user Displays the third image in response to a first instruction by the first user or a first instruction by the second user In response to the display of the third image, ends the display of the first image and the second image During the display of the third image, ends the display of the third image and redisplays the first image and the second image in response to a second instruction by the first user or a second instruction by the second user A control method characterized by including the above **Claim 12** A control method for a server device capable of communicating with each of a terminal device of a first user and a terminal device of a second user different from the first user, comprising: Receives information regarding the display of a first image including a first object indicating the first user from the terminal device of the first user, and receives information regarding the display of a second image including a second object indicating the second user from the terminal device of the second user Transmits information for displaying at least the first image to at least the terminal device of the second user, and transmits information for displaying at least the second image to at least the terminal device of the first user In response to a first instruction by the first user or a first instruction by the second user, transmits information for displaying a third image including the first object and the second object, received from the terminal device of the first user or the terminal device of the second user, to a terminal device of at least one third user different from the first user and the second user To the terminal device of the first user Causes the third image to be displayed in response to a first instruction by the first user or a first instruction by the second user On the terminal device of the first user, in response to the display of the third image, end the display of the first image and the second image, during the display of the third image, in response to a second instruction by the first user or a second instruction by the second user, end the display of the third image and redisplay the first image and the second image A control method characterized by including the above.

Images