Control Program for Terminal Device, Terminal Device, Control Method for Terminal Device, Control Program for Server Device, Server Device, and Control Method for Server Device

Abstract

To improve motivation of a user for continuing communication with another user.SOLUTION: A control program executes: displaying at least a first image including a first object showing a first user, and a second image including a second object showing a second user, on a terminal device of the first user; transmitting information on the display of the first image to the terminal device of the second user; transmitting first voice of the first user to the terminal device of the second user; displaying the first image including the first object changing according to an operation or the first voice of the first user; outputting received second voice of the second user; displaying the second image including the second object changing according to an operation or the second voice of the second user; and displaying the first image including the first object that is at least partially changed on the basis of at least one third object selected from a plurality of third objects according to an instruction of the first user.SELECTED DRAWING: Figure 3

Description

Technical Field

[0001] The embodiments disclosed in this specification relate to a control program for a terminal device, a terminal device, a control method for a terminal device, a control program for a server device, a server device, and a control method for a server device.

Background Art

[0002] Conventionally, there has been known an information system in which a plurality of users communicate with each other by transmitting various information such as an image indicating each user himself / herself and / or the voice of each user to the terminal devices of other users using terminal devices such as PCs (Personal Computers). For example, Patent Document 1 discloses a technology of an information system in which each user performs a voice chat with a character object of another user using a character object such as an avatar that acts as the user's alter ego in a virtual space.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the conventional information system, when a user communicates with another user, there is no diversity in the output from the user's terminal device, so there has been a problem that the user gets bored with communicating with another user.

[0005] The disclosed control program for a terminal device, terminal device, control method for a terminal device, control program for a server device, server device, and control method for a server device make it possible to improve the motivation of a user who intends to continue communicating with another user.

Means for Solving the Problems

[0006] The control program of the terminal device is a control program for the terminal device of the first user, which causes the terminal device of the first user to display at least a first image including a first object indicating the first user and a second image including a second object indicating a second user different from the first user, transmit information regarding the display of the first image to the terminal device of the second user, transmit the first voice of the first user to the terminal device of the second user when the first voice of the first user is acquired, display a first image including a first object that changes according to the operation or the first voice of the first user, output the second voice when the second voice of the second user is received, display a second image including a second object that changes according to the operation or the second voice of the second user, and display a first image including a first object at least partially changed based on at least one third object selected from a plurality of third objects according to an instruction by the first user.

[0007] Further, in the control program of the terminal device, when two or more third objects are selected according to an instruction by the first user, the terminal device of the first user is caused to display a plurality of first selection objects for the first user to perform a selection operation on the third object used to change the first object from among the two or more third objects, and a second selection object for collectively selecting all of the two or more third objects used to change the first object.

[0008] Also, in the control program of the terminal device, the terminal device of the first user receives information about at least one fourth object selected from a plurality of fourth objects according to an instruction by the second user. When the application of the fourth object selected by the second user is instructed, a second image including a second object that is at least partially changed based on the information about the at least one fourth object is displayed, and according to an instruction by the first user, a first image including a first object that is at least partially changed based on the information about the at least one fourth object is displayed. It is preferable to execute this.

[0009] Also, in the control program of the terminal device, the terminal device of the first user receives information about at least one fourth object selected from a plurality of fourth objects according to an instruction by the second user. When the application of the fourth object selected by the second user is instructed, a second image including a second object that is at least partially changed based on the information about the at least one fourth object is displayed, and according to an instruction by the first user, at least one fourth object is selected from the plurality of fourth objects, and a first image including a first object that is at least partially changed based on the selected at least one fourth object is displayed. It is preferable to execute this.

[0010] Also, in the control program of the terminal device, the terminal device of the first user receives information about at least one fourth object selected from a plurality of fourth objects according to an instruction by the second user, and displays a second image including a second object that is at least partially changed based on the information about the at least one fourth object according to an instruction by the second user. According to an instruction by the first user for the second object included in the displayed second image, at least one fourth object is selected from the plurality of fourth objects, and a first image including a first object that is at least partially changed based on the selected at least one fourth object is displayed. It is preferable to execute this.

[0011] Also, in the control program of the terminal device, when a first user's terminal device satisfies a predetermined first condition, a first object at least partially changed based on at least one fourth object is restored to the first object before the change, and a first image including the first object restored to before the change is displayed. It is preferable that the first user can execute the selection of at least one fourth object from among a plurality of fourth objects during the period from when the first object is changed based on at least one fourth object until it is restored to the first object before the change.

[0012] Also, in the control program of the terminal device, the predetermined first condition includes obtaining a specific instruction from the first user, the information regarding the display of the first image and the transmission of the first voice and the reception of the second voice being completed, the information regarding the display of the second image and the transmission of the second voice and the reception of the first voice being completed, a predetermined time having elapsed since at least a part of the first object was changed based on at least one fourth object, or when at least a part of the first object is being changed based on at least one fourth object, the first user instructing the selection of at least one third object from among a plurality of third objects in response to an instruction, or when at least a part of the first object is being changed based on at least one fourth object, the second user instructing the selection of at least one third object from among a plurality of third objects in response to an instruction.

[0013] Also, in the control program of the terminal device, it is preferable that displaying the first image including the first object at least partially changed based on at least one fourth object is executed when a predetermined second condition is satisfied.

[0014] In addition, in the control program of the terminal device, it is preferable that the predetermined second condition includes that the number of times the first image including the first object at least partially changed based on at least one fourth object is displayed is equal to or less than a predetermined number of times.

[0015] In addition, in the control program of the terminal device, when at least one fourth object is selected from a plurality of fourth objects in response to an operation of the first instruction object by the first user on the terminal device of the first user, it is preferable to execute giving a first privilege to the second user.

[0016] In addition, in the control program of the terminal device, when at least one fourth object is selected from a plurality of fourth objects in response to an operation of the first instruction object by the first user on the terminal device of the first user, it is preferable to execute giving a second privilege to the first user.

[0017] In addition, in the control program of the terminal device, when at least one fourth object is not selected from a plurality of fourth objects without the first instruction object being operated by the first user on the terminal device of the first user, it is preferable to execute giving a third privilege to the first user.

[0018] In addition, in the control program of the terminal device, when the predetermined second condition is satisfied on the terminal device of the first user, a second instruction object for selecting at least one fifth object from a plurality of fifth objects and information regarding the execution of the selection are displayed, and in response to an operation of the second instruction object by the first user, at least one fifth object is selected from a plurality of fifth objects, and it is preferable to execute displaying a first image including the first object at least partially changed based on the selected at least one fifth object.

[0019] In addition, in the control program of the terminal device, it is preferable that the predetermined second condition is that a predetermined time has elapsed since the first object was changed based on at least one third object.

[0020] In addition, in the control program of the terminal device, it is preferable that the plurality of fifth objects include an object that is applied to and displayed on the second object indicating the second user.

[0021] The control program of the server device is a control program of a server device capable of communicating with each of the terminal device of the first user and the terminal device of the second user different from the first user. The control program receives information regarding the display of the first image including the first object indicating the first user from the terminal device of the first user, receives information regarding the display of the second image including the second object indicating the second user from the terminal device of the second user, transmits information for displaying at least the first image to at least the terminal device of the second user, transmits information for displaying at least the second image to at least the terminal device of the first user, when receiving the first voice of the first user, transmits the first voice to the terminal device of the second user, transmits information for displaying the first image including the first object that changes according to the operation or the first voice of the first user to at least the terminal device of the second user, when receiving the second voice of the second user, transmits the second voice to the terminal device of the first user, transmits information for displaying the second image including the second object that changes according to the operation or the second voice of the second user to at least the terminal device of the first user, selects at least one third object from among a plurality of third objects according to an instruction by the first user, and transmits information for displaying the first image including the first object at least partially changed based on the selected at least one third object to at least the terminal device of the second user.

[0022] The terminal device is a terminal device of a first user, and displays at least a first image including a first object indicating the first user and a second image including a second object indicating a second user different from the first user, transmits information regarding the display of the first image to the terminal device of the second user, and when acquiring the first voice of the first user, transmits the first voice to the terminal device of the second user, displays a first image including a first object that changes according to the action or first voice of the first user, when receiving the second voice of the second user, outputs the second voice, displays a second image including a second object that changes according to the action or second voice of the second user, and displays a first image including a first object at least partially changed based on at least one third object selected from a plurality of third objects according to an instruction by the first user, and includes a processing unit.

[0023] The server device is a server device capable of communicating with each of the terminal device of the first user and the terminal device of the second user different from the first user. The server device receives information regarding the display of the first image including the first object indicating the first user from the terminal device of the first user, receives information regarding the display of the second image including the second object indicating the second user from the terminal device of the second user, transmits information for at least displaying the first image to at least the terminal device of the second user, transmits information for at least displaying the second image to at least the terminal device of the first user, when receiving the first voice of the first user, transmits the first voice to the terminal device of the second user, and transmits information for displaying the first image including the first object that changes according to the operation or the first voice of the first user to at least the terminal device of the second user. When receiving the second voice of the second user, transmits the second voice to the terminal device of the first user, and transmits information for displaying the second image including the second object that changes according to the operation or the second voice of the second user to at least the terminal device of the first user. The server device selects at least one third object from among a plurality of third objects according to an instruction by the first user, and transmits information for displaying the first image including the first object at least partially changed based on the selected at least one third object to at least the terminal device of the second user, and includes a processing unit.

[0024] The control method of the terminal device is a control method of the terminal device of the first user. The terminal device of the first user displays at least a first image including a first object indicating the first user and a second image including a second object indicating a second user different from the first user, transmits information regarding the display of the first image to the terminal device of the second user, and when acquiring the first voice of the first user, transmits the first voice to the terminal device of the second user, displays a first image including a first object that changes according to the operation or the first voice of the first user, outputs the second voice when receiving the second voice of the second user, displays a second image including a second object that changes according to the operation or the second voice of the second user, and displays a first image including a first object at least partially changed based on at least one third object selected from a plurality of third objects according to an instruction by the first user.

[0025] A control method for a server device is a control method for a server device capable of communicating with each of a terminal device of a first user and a terminal device of a second user different from the first user. The method includes receiving, from the terminal device of the first user, information regarding display of a first image including a first object indicating the first user; receiving, from the terminal device of the second user, information regarding display of a second image including a second object indicating the second user; transmitting, to at least the terminal device of the second user, information for displaying at least the first image; transmitting, to at least the terminal device of the first user, information for displaying at least the second image; transmitting, to the terminal device of the second user, the first voice when the first voice of the first user is received; transmitting, to at least the terminal device of the second user, information for displaying a first image including a first object that changes according to an action or the first voice of the first user; transmitting, to the terminal device of the first user, the second voice when the second voice of the second user is received; transmitting, to at least the terminal device of the first user, information for displaying a second image including a second object that changes according to an action or the second voice of the second user; selecting at least one third object from a plurality of third objects according to an instruction by the first user; and transmitting, to at least the terminal device of the second user, information for displaying a first image including a first object at least partially changed based on the selected at least one third object.

Advantages of the Invention

[0026] The control program for the terminal device, the terminal device, the control method for the terminal device, the control program for the server device, the server device, and the control method for the server device can improve the willingness of a user who wants to continue communication with other users.

Brief Description of the Drawings

[0027]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Embodiments for Carrying Out the Invention

[0028] Hereinafter, various embodiments of the present invention will be described with reference to the drawings. However, it should be noted that the technical scope of the present invention is not limited to those embodiments, but extends to the invention described in the claims and its equivalents.

[0029] (Overview of the Information System) FIG. 1 is a schematic diagram for explaining an example of the overview of the information system. The information system includes a terminal device operated by each of a plurality of users and a server device. For example, the terminal device is an information processing device such as a multifunctional mobile phone (so-called "smartphone") owned by the user. For example, the server device is a computer for providing a communication service between terminal devices via a communication network.

[0030] The terminal device stores a control program such as an application program, loads the control program into the memory in response to a start operation from the user, and starts a communication service by executing instructions included in the loaded control program. When the communication service is started, the terminal device realizes a plurality of functions by executing instructions included in the control program.

[0031] For example, the user's terminal device realizes a generation function for generating output information including character video data including motion data based on various input data input by the user. For example, the input data is a plurality of imaging data acquired at predetermined sampling time intervals by an imaging device provided in the user's terminal device, and in this case, the user is shown in each imaging data. The character video data is an example of information related to the display of a user output image including a character object indicating the user. During the communication service, the output information is generated at predetermined time intervals.

[0032] The character object is a three-dimensional object generated based on, for example, three-dimensional model data having the appearance of a humanoid animated character. Also, the character object may be a three-dimensional object generated based on three-dimensional model data having the appearance of various shapes such as an animal such as a dog or a cat, or an artifact such as a robot. In this case, the user output image includes an image of the character object viewed from a predetermined viewpoint. The character object may also be a two-dimensional object generated based on two-dimensional model data. Further, by applying image information indicating an animal such as a dog or a cat, or an artifact such as a robot to the surface of the character object, the appearance of an animal such as a dog or a cat, or an artifact such as a robot is expressed. Hereinafter, the three-dimensional object and the two-dimensional object may be simply collectively referred to as an object.

[0033] When the character object is an object having the appearance of a humanoid animated character, the character object is composed of a plurality of partial objects. For example, the character object is composed of a partial object corresponding to the head, a partial object corresponding to the torso, a partial object corresponding to the arms, a partial object corresponding to the legs, and so on. Also, the partial object may correspond to each part of the face (eyes, mouth, nose, eyebrows, beard, or hair, etc.). Also, for the same part (head, torso, etc.), a plurality of types of partial objects may be prepared. For example, as partial objects corresponding to the hair part, a partial object corresponding to black hair and a partial object corresponding to brown hair are prepared. Also, as partial objects corresponding to the eye part, a partial object corresponding to black downturned eyes, a partial object corresponding to blue downturned eyes, a partial object corresponding to black upturned eyes, and a partial object corresponding to blue upturned eyes may be prepared. Also, the character object may be composed of a partial object corresponding to a hat that covers at least a part of the head, a partial object corresponding to clothing that covers at least a part of the torso and arms, and so on. Thus, the character object is an object composed of a plurality of partial objects, and the partial object is a part of the components of the character object. Also, the character object and the partial object may be configured to be able to change their sizes. For example, when the user instructs a change in the height of the back, the sizes of various partial objects such as the head, torso, legs, and arms are changed so as to be the changed height of the back. Also, for example, when the user instructs a change in the size of a partial object, the size of the corresponding partial object may be changed (for example, when an instruction to change the length of the leg is given, the length of the leg may be changed).

[0034] In response to an instruction by the user, one partial object that constitutes a character object can be changed to a new partial object of the same type as the partial object at the position. For example, by changing the partial object corresponding to the long pants that constitute the character object to a new partial object corresponding to shorts, the appearance of the character object is changed from an appearance as if wearing long pants to an appearance as if wearing shorts. Also, in response to an instruction by the user, a new partial object may be set as a partial object that constitutes the character object. For example, by applying a new partial object corresponding to a hat to a character object not wearing a hat, the appearance of the character object is changed from an appearance as if not wearing anything on the head to an appearance as if wearing a hat. In this way, by applying a new partial object to the character object, the appearance of the new partial object of the character object is changed. Note that the additional object that can be worn on the character object described later is a type of partial object.

[0035] For example, the user's terminal device realizes an output function of transmitting the generated output information to the server device at predetermined time intervals in order to display a user output image based on the character video data and transmit the generated output information to the terminal devices of other users via the server device. Also, for example, the user's terminal device realizes a function of displaying an output image of another user including a character object representing the other user based on the output information of the other user transmitted from the server device at predetermined time intervals.

[0036] When the communication service is started, as shown in FIG. 1(a), for example, a user output image (1) and another user output image (2) are displayed on the user's terminal device. When the communication service is started and another user has not participated in the communication service, only the user output image (1) is displayed on the user's terminal device. When the communication service is started and the user has not participated in the communication service, only the other user output image (2) is displayed on the other user's terminal device.

[0037] The user output image (1) includes a user character object that operates according to the user's motion data included in the character video data. Also, the other user output image (2) includes another user character object that operates according to the other user's motion data included in the received other user output information. In this way, the user's terminal device displays the user output image (1) including the user character object that changes according to the user's operation, and displays the other user output image (2) including the other user character object that changes according to the other user's operation.

[0038] Since both the user's terminal device and the other user's terminal device are equipped with microphones, the user's terminal device acquires the voice emitted by the user, and the other user's terminal device acquires the voice emitted by the other user. Then, the user's terminal device includes the acquired user voice data in the output information and transmits the output information including the user voice data to the other user's terminal device via the server device, so as to transmit the output information to the server device. Also, the user's terminal device receives the output information including the other user's voice data transmitted to the server device by the other user's terminal device from the server device.

[0039] For example, when voice is generated by a user, the user's motion data included in the character video data includes face motion data indicating the movement of the user's lips. In this case, on the user's terminal device, a user output image (1) including a user character object whose lips move in approximate synchronization with the voice generated by the user is displayed. There may be a case where the output information of another user received by the user's terminal device includes the voice data of the other user together with the motion data of the other user. In this case, on the user's terminal device, the voice of the other user is output, and another user output image (2) including a character object of the other user whose lips move in approximate synchronization with the voice of the other user is displayed.

[0040] In addition to the functions described above, the information system may implement a function of providing a selection event for selecting information regarding at least one specific object from among a plurality of specific objects in response to an instruction from the user. Further, when the specific object can be used as a partial object of the character object, the user's terminal device may implement a function of displaying a user output image (1) including the user's character object at least partially changed based on the selected at least one specific object. What is selected in the selection event may be anything as long as it changes the display mode of the user's character object and / or changes the output voice data. For example, in the selection event, the background image that serves as the background of the character object in the user output image may be selected. Also, in the selection event, an image or partial object for changing the expression of the character object in the user output image may be selected. For example, when an image or partial object for changing the expression is used (applied) by the user, at least a part of the animation of the character object, which is generated so that the expression of the character object changes based on the user's face motion data, is changed to the image or partial object for changing the expression. Since the image or partial object does not change based on the face motion data, when this image or partial object is used, the expression is changed to an expression different from the user's face motion data. Also, in the selection event, automation data for automatically operating the character object (such as waving a hand, making a peace sign, etc.) may be selected. Also, in the selection event, sound source data for outputting a predetermined sound effect or music, etc. may be selected. Also, in the selection event, right data indicating the right to execute a voice conversion process for changing voice elements such as the pitch and / or formant of the voice data when the input voice data is output may be selected. When the right data related to the voice conversion process is used (applied) by the user, the voice data input by the user is changed by the voice conversion process, and output information including the changed voice data is transmitted.Also, in a selection event, a character object may be selected. For example, when a character object is selected in a selection event, the current user character object may be changed to the selected character object temporarily (e.g., for one minute) or until the communication service ends. Also, in a selection event, right data indicating the right to perform a predetermined event may be selected. For example, the right data is right data indicating the right to perform a specific selection event, etc.

[0041] For example, when a display instruction of a selection instruction screen is input by a user during a communication service on the user's terminal device, the selection instruction screen is displayed (Fig. 1(b)). The selection instruction screen includes, for example, a selection instruction button. When the selection instruction button included in the displayed selection instruction screen is selected according to the user's operation, the user's terminal device transmits information indicating the selection instruction to the server device. The server device stores information about a plurality of specific objects. The information about the specific object includes, for example, identification information (object ID (identification)) for identifying the specific object. The name, attributes, etc. of the specific object may also be included in the information about the specific object.

[0042] When the server device receives information indicating a selection instruction from the user's terminal device, it extracts information regarding a plurality of stored specific objects. The server device selects information regarding at least one specific object from among the information regarding the plurality of extracted specific objects according to a predetermined selection method. The predetermined selection method is, for example, a method of selecting information regarding at least one specific object from among the information regarding the plurality of specific objects based on a predetermined selection probability associated with the information regarding each specific object. The predetermined selection probability is an example of the selection probability that the information regarding the specific object is selected. For example, when the information regarding each specific object is selected with equal probability from among the information regarding the plurality of specific objects, the same selection probability is associated with each of the information regarding the plurality of specific objects. Note that the predetermined selection method may be a method of selecting information regarding at least one specific object from among the information regarding the plurality of specific objects according to the order associated with the information regarding each specific object.

[0043] The server device transmits the information regarding the at least one selected specific object to the user's terminal device (the terminal device that transmitted the information indicating the selection instruction). The user's terminal device displays a selection result screen (FIG. 1(c)) based on the received information regarding the at least one specific object. The selection result screen includes, for example, information indicating at least one specific object and a use button. When the use button included in the displayed selection result screen is selected according to the user's operation, a use instruction is input to the user's terminal device. The user's terminal device displays a user output image (1) including a user character object at least partially modified based on the information regarding the at least one specific object according to the use instruction (FIG. 1(d)).

[0044] For example, information regarding at least one specific object is an object ID for identifying a wearable object that changes the appearance of a part of the user's character object. The information regarding at least one specific object may also be an object ID for identifying a wallpaper object arranged on the back of the user's character object. In the example shown in FIG. 1(c), the information regarding the specific object used for changing at least a part of the user's character object is an object ID for identifying a wearable object "hat" that changes the appearance of the "head" of the character object.

[0045] In the examples shown in FIGS. 1(c) and (d), in response to a use instruction by the user, the user's terminal device acquires image information indicating the wearable object "hat" based on the information regarding the wearable object "hat". For example, the user's terminal device acquires, from the storage device of the terminal device, the image information of the "hat" associated with the object ID for identifying the wearable object "hat" received from the server device. Then, the user's terminal device generates an animation of the user's character object with the wearable object "hat" worn on the "head" based on the acquired image information. As shown in FIG. 1(d), the user's terminal device displays a user output image (1) including the user's character object wearing the "hat" based on the generated animation.

[0046] As described above with reference to FIG. 1, in the control program of the terminal device, the terminal device, the control method of the terminal device, the control program of the server device, the server device, and the control method of the server device, a user output image (1) including a user character object in which at least a part is changed based on a specific object selected from a plurality of specific objects in response to an instruction by the user is displayed. In this way, by the control program of the terminal device, the terminal device, the control method of the terminal device, the control program of the server device, the server device, and the control method of the server device, during the communication service, by allowing the output from the terminal device to be changed by the user or another user, it becomes possible to improve the user's willingness to continue using for communication.

[0047] In a conventional information system, when a user communicates with another user via a character object such as an avatar indicating the user and then wants to start another service or event, the user has to interrupt or terminate the communication service. After that, the user and the other user can receive the provision of another service by instructing a server device or the like to start another service or event. Thus, in a conventional information system, in order for a user and another user to receive the provision of another service or the like while receiving the provision of a service, a plurality of communications related to the interruption or termination of the service and the start of another service occur, which may cause a problem of an increase in the processing load of the terminal device and / or the communication load between the terminal device and the server device. On the contrary, in the control program of the user's terminal device, the user's terminal device, the control method of the user's terminal device, the control program of the server device, the server device, and the control method of the server device disclosed in the embodiments, the user and the other user can receive the provision of the selection event of the specific object only by the communication related to the start of the selection event of the specific object, and it becomes possible to reduce the processing load of the terminal device and / or the communication load between the terminal device and the server device. Further, by the control program of the user's terminal device, the user's terminal device, the control method of the user's terminal device, the control program of the server device, the server device, and the control method of the server device disclosed in the embodiments, it becomes possible to realize a seamless transition to another event such as another service or a selection event while continuing the communication service with a simple interface.

[0048] In the example shown in FIG. 1, the user and other users are users belonging to a predetermined communication group among a plurality of users who can use the communication service. The predetermined communication group is a group created by either the user or other users. In the example shown in FIG. 1, character objects of two users are displayed, but character objects of three or more users belonging to a predetermined communication group may be displayed, and three or more users may be configured to be able to communicate.

[0049] Also, in the example shown in FIG. 1, the user and other users may be users having a predetermined relationship. For example, other users having a predetermined relationship with the user are mutual followers of the user. Note that when the user follows another user and the other user also follows the user (the user and the other user are mutual followers), the user and the other user become mutual followers. Also, other users having a predetermined relationship with the user may be other users having a mutual following relationship with a predetermined user who is a mutual follower of the user. Also, other users having a predetermined relationship with the user may be other users having a friend relationship with the user, or other users in which specific information (phone number, email address, predetermined ID (identification), etc.) is stored in the user's terminal device. Also, when the user's terminal device has a function of distributing a user output image including the user's character object to one or more other users' terminal devices via a server device, other users having a predetermined relationship with the user are other users who have viewed the user output image distributed by the user. In this case, when users having a predetermined relationship and other users perform communication as shown in FIG. 1, a predetermined communication group composed of the user and other users may be temporarily created by the user's or other users' terminal device or the server device.

[0050] Note that the above description of FIG. 1 is merely for deepening the understanding of the content of the present invention. The present invention is specifically implemented in each of the following embodiments, and may also be implemented by various modifications without substantially exceeding the principle of the present invention. All such modifications are included in the scope of the present invention and the disclosure of this specification.

[0051] (Information System 1) FIG. 2 is a diagram showing an example of the schematic configuration of the information system 1. The information system 1 includes terminal devices 2 operated by each of a plurality of users and a server device 3. The terminal device 2 and the server device 3 are interconnected via a communication network such as a base station 4, a mobile communication network 5, a gateway 6, and the Internet 7, for example. Between the terminal device 2 and the server device 3, communication is performed based on a communication protocol such as the Hypertext Transfer Protocol (HTTP). Also, between the terminal device 2 and the server device 3, a connection is first established by HTTP communication, and then communication may be performed based on WebSocket, which is a two-way communication with a lower cost (less communication load and processing load) than HTTP communication. Note that the communication method between the terminal device 2 and the server device 3 is not limited to the above-described method, and any communication method technology may be used between the terminal device 2 and the server device 3 as long as the present embodiment can be realized.

[0052] The terminal device 2 is an information processing device such as a smartphone. The terminal device 2 may be a mobile phone, a notebook PC, a tablet terminal, a tablet PC, a head-mounted display (HMD), an e-book reader, or a wearable computer, etc. The terminal device 2 may be a portable game machine or a game console, etc. The terminal device 2 may be any information processing device as long as it can output the display of the user and the character objects of other users, as well as the voices of the user and other users.

[0053] In the example shown in FIG. 2, one server device 3 is illustrated as a component of the information system 1, but the server device 3 may be a collection of a plurality of physically separate server devices 3. In this case, each of the plurality of server devices 3 may have the same function, or may have a function that is distributed from one server device 3. For example, a server device 3a having a function of transmitting and receiving output information of a user and output information of other users, and a server device 3b having a function of providing a selection event to a user may be components of the information system 1.

[0054] (Terminal device 2) FIG. 3 is a diagram showing an example of the schematic configuration of the terminal device 2. The terminal device 2 is connected to the server device 3 via a communication network such as a base station 4, a mobile communication network 5, a gateway 6, and the Internet 7, and communicates with the server device 3. The terminal device 2 generates character video data including motion data according to various data (such as imaging data) input by the user, and transmits output information including the generated character video data and / or the user's voice data to the server device 3. Further, the terminal device 2 receives output information of other users transmitted from the server device 3, displays a character object of other users based on the received output information, and / or outputs the voice of other users. To realize such functions, the terminal device 2 includes a terminal communication I / F 21, a terminal storage device 22, a display device 23, an input device 24, an imaging device 25, a microphone 26, and a terminal processing device 27.

[0055] The terminal communication I / F 21 is implemented as hardware, firmware, or communication software such as a TCP / IP (Transmission Control Protocol / Internet Protocol) driver or a PPP (Point-to-Point Protocol) driver, or a combination thereof. The terminal device 2 can transmit data to other devices such as the server device 3 and receive data from other devices via the terminal communication I / F 21.

[0056] The terminal storage device 22 is, for example, a semiconductor memory device such as a ROM (Read Only Memory) or a RAM (Random Access Memory). The terminal storage device 22 stores an operating system program, a driver program, a control program, data, etc. used in the processing by the terminal processing device 27. The driver programs stored in the terminal storage device 22 include an output device driver program for controlling the display device 23 and an input device driver program for controlling the input device 24. The control program stored in the terminal storage device 22 is, for example, an application program for realizing various functions related to communication services. Note that the control program may be transmitted from the server device 3 or other devices.

[0057] The terminal storage device 22 stores, as data, identification information (e.g., user ID (identification)) for uniquely identifying the user who operates the terminal device 2. Further, the terminal storage device 22 stores, as data, background data, model data, etc. Further, the terminal storage device 22 stores, as data, a user table T1, an object table T2, and a group table T3. Further, the terminal storage device 22 may temporarily store data related to predetermined processing.

[0058] The background data is asset data for constructing a virtual space in which the user's character object exists in the user output image. The background data includes data for drawing the background of the virtual space, data for drawing various objects included in the user output image, and data for drawing various background objects displayed in the user output image other than these. The background data may include object position information indicating the positions of various background objects in the virtual space.

[0059] The display device 23 is a liquid crystal display. Note that the display device 23 may also be an organic EL (Electro-Luminescence) display or the like. The display device 23 displays a moving image corresponding to moving image data and / or a still image corresponding to still image data supplied from the terminal processing device 27 on the display screen. Further, the display device 23 may not be a component of the terminal device 2. In this case, the display device 23 may be a display of an HMD capable of communicating with the server device 3, a projection device for Projection Mapping capable of communicating with the terminal device 2 via wire or wirelessly, a retinal projection type projection device, or the like.

[0060] The input device 24 is a pointing device such as a touch panel. When the input device 24 is a touch panel, the input device 24 can detect various touch operations such as a user's tap, double-tap, drag, etc. The touch panel may be provided with a capacitive proximity sensor and configured to be able to detect a non-contact operation of the user. Note that the input device 24 may also be an input key or the like. The user can use the input device 24 to input characters, numbers, symbols, or the position on the display screen of the display device 23. When the input device 24 is operated by the user, the input device 24 generates a signal corresponding to the operation. Then, the input device 24 supplies the generated signal to the terminal processing device 27 as a user instruction.

[0061] The imaging device 25 is a camera having an imaging optical system, an image sensor, an image processing unit, etc. The imaging optical system is, for example, an optical lens, which forms an image of a light beam from a subject on the imaging surface of the image sensor. The image sensor is a CCD (Charge Coupled Device) or CMOS (Complementary Metal Oxide Semiconductor), etc., and outputs an image of the subject image formed on the imaging surface. The image processing unit creates moving image data in a predetermined file format at predetermined intervals from the images continuously generated by the image sensor and outputs it as imaging data. Alternatively, the image processing unit creates still image data in a predetermined file format from the image generated by the image sensor and outputs it as imaging data.

[0062] The microphone 26 is a sound collection device configured to acquire the voice emitted by the user and convert it into voice data. The microphone 26 is configured to be able to acquire the voice input of the user, convert the voice input of the user acquired by the microphone 26 into voice data, and output the voice data to the terminal processing device 27.

[0063] The terminal processing device 27 is a processor that loads the operating system program, driver program, and control program stored in the terminal storage device 22 into the memory and executes the instructions included in the loaded programs. The terminal processing device 27 is, for example, an electronic circuit such as a CPU (Central Processing Unit), MPU (Micro Processing Unit), DSP (Digital Signal Processor), GPU (Graphics Processing Unit), or a combination of various electronic circuits. The terminal processing device 27 may be realized by an integrated circuit such as an ASIC (Application Specific Integrated Circuit), PLD (Programmable Logic Device), FPGA (Field Programmable Gate Array), or MCU (Micro Controller Unit). In FIG. 3, the terminal processing device 27 is illustrated as a single component, but the terminal processing device 27 may be a collection of a plurality of physically separate processors.

[0064] The terminal processing device 27 functions as a generation unit 271, a transmission unit 272, a reception unit 273, a display processing unit 274, and a voice output unit 275 by executing various instructions included in the control program. The functions of the generation unit 271, the transmission unit 272, the reception unit 273, the display processing unit 274, and the voice output unit 275 will be described later.

[0065] (Various Tables) FIG. 4 is a diagram showing an example of the data structures of a user table T1, an object table T2, and a group table T3 stored in the terminal storage device 22. Note that at least one of the user table T1, the object table T2, and the group table T3 may be stored in the server storage device 32 of the server device 3. In this case, the terminal device 2 may receive the latest table stored in the server storage device 32 at a predetermined timing and store it in the terminal storage device 22.

[0066] (User table T1) FIG. 4(a) is an example of the data structure of a user table T1 that manages users participating in a communication service. In the user table T1, for each user, a user ID, the name of the user, the user's character object, the objects held by the user, and the objects used, etc. are stored in association with each other. In the user table T1, information indicating the total amount of coins (virtual currency value of "coins") held by the user and / or user points, etc. may be stored in association with the user ID of the user. The user ID is an example of identification data for uniquely identifying each user. The name is an example of data indicating the name of each user.

[0067] For example, a character object is a model ID for identifying model data for generating an animation of the character object. The model data is stored in the terminal storage device 22 in association with the model ID. The model data may be three-dimensional model data for generating a three-dimensional animation, or two-dimensional model data for generating a two-dimensional model. The model data includes, for example, rig data (so-called "skeleton data") indicating the skeleton of the face and parts other than the face of the character object, and surface data indicating the shape and texture of the surface of the character object. The model data may include a plurality of different model data. Each of the plurality of model data may have different rig data or the same rig data. Each of the plurality of model data may have different surface data or the same surface data. Note that a plurality of object IDs associated with each of the plurality of partial objects constituting the character object may be associated with the model ID. In this case, three-dimensional model data for generating a three-dimensional animation may be stored in the terminal storage device 22 and the server storage device 32 for each object ID of the plurality of partial objects. In this case, in the display process of the character object, the object IDs of the plurality of partial objects associated with the model ID are extracted, the three-dimensional model data corresponding to each object ID (of each partial object) is specified, and the character object may be displayed based on the specified three-dimensional model data (of each partial object). Also, image information corresponding to each three-dimensional model data may be stored.

[0068] The owned object is an object ID indicating an object owned by each user. The owned object can be a wearable object that can be associated with a specific part of the character object, or a wallpaper object arranged on the back of the user's character object in the user output image. Details of the wearable object and the wallpaper object will be described later. The owned object may include a specific object selected by a selection event provided by the server device 3 by the user's operation. Also, the owned object may be an object that the user has come to possess by consuming "coins" of virtual currency value in the purchase function in the information system 1.

[0069] The used object is an object ID indicating an object being used in the user output image being displayed on the user's terminal device 2. For example, during a communication service, when a user's change instruction is input, a wearable object owned as the user's owned object is worn on the user's character object included in the displayed user output image. In this case, the object ID of the wearable object worn on the user's character object is stored in the user table T1 in association with the user ID as the used object. Also, for example, during a communication service, when a user's change instruction is input, a wallpaper object owned as the user's owned object is arranged on the back of the user's character object in the displayed user output image. In this case, the object ID of the wallpaper object arranged in the user output image is stored in the user table T1 in association with the user ID as the used object.

[0070] (Object Table T2) Figure 4(b) is an example of the data structure of object table T2 that manages objects selected as additional objects. The additional objects are, for example, gift objects that a user gives to other users. In object table T2, for each additional object, an object ID, name, image information, rarity, and placement location, etc. are stored in association with each other.

[0071] The object ID is an example of identification data for uniquely identifying each additional object. The image information is one or more still images corresponding to each additional object. The image information may also be one or more types of moving images corresponding to each additional object. The rarity is information indicating the degree of rarity of each additional object. The placement location is information indicating the location where the image information of each additional object is displayed. Note that when the display position and display range of the character object are determined, information indicating the relative position with respect to the character object may be stored as the placement location.

[0072] The additional objects are classified into a plurality of types (categories). For example, the additional objects include effect objects used as effect gifts, normal objects used as normal gifts, wearable objects used as wearable gifts, and message objects used as message gifts. The additional objects may include wallpaper objects arranged on the back of the character object in the user output image. Note that information indicating the type (category) of the additional object may be stored in object table T2 in association with the object ID of the additional object. Hereinafter, the image information and the placement location will be described according to the type of the additional object.

[0073] An effect object is an object that affects the overall impression of a user output image and / or another user output image. The effect object is, for example, an object imitating confetti. When the effect object is an object imitating confetti, an image showing a plurality of pieces of paper is stored as image information.

[0074] Information indicating "space" is stored as the location where the effect object is placed. For example, an object imitating confetti is displayed on the entire user output image and / or another user output image. Note that the effect object may be displayed on the entire screen (communication screen described later) including the user output image and other user output images in response to a user instruction. Also, the effect object may be displayed only within the output image selected by the user among the user output image and other user output images. Further, the effect object may be displayed so as to overlap with a character object included in the user output image and / or another user output image. Different from the wearable object described later, the effect object is displayed without being associated with a specific part of the character. In this way, the terminal device 2 of the information system 1 can change the overall impression of the user output image and / or another user output image by displaying the effect object in response to a user instruction, as compared with before the effect object is displayed.

[0075] Normally, an object is an object that imitates, for example, a stuffed toy, a bouquet of flowers, an accessory, or an item suitable for a gift or present. Information indicating "space" as the location where the normal object is placed is stored. For example, information regarding a predetermined movement route is associated with the normal object, and a normal object that moves along the predetermined movement route within the user output image or another user output image is displayed. The information indicating "space" stored as the location of the "normal object" may be classified into multiple types. The multiple types of "space" are, for example, "central space" (the region at the center of the image when the user output image or another user output image is divided into three parts horizontally), "left space" (the region on the left side of the image when the user output image or another user output image is divided into three parts horizontally), and "right space" (the region on the right side of the image when the user output image or another user output image is divided into three parts horizontally). Also, the multiple types of "space" may be "central space" (the region at the center of the image when the user output image or another user output image is divided into three parts vertically), "upper space" (the region on the upper side of the image when the user output image or another user output image is divided into three parts vertically), and "lower space" (the region on the lower side of the image when the user output image or another user output image is divided into three parts vertically). In this case, the movement route associated with the normal object is set within the type of "space" associated as the location of the normal object. For example, when information indicating "right space" is stored in the normal object, information regarding a movement route for the normal object to move within the region on the right side of the image when the user output image or another user output image is divided into three parts horizontally is associated with the normal object. Also, a normal object that moves along a predetermined movement rule may be displayed starting from a position set for each normal object within the user output image or another user output image or a position automatically determined randomly. The predetermined movement rule is, for example, a movement rule set so that the normal object moves as if it is in free fall. Note that the normal object may be displayed so as to overlap with the character object. In this case, unlike the wearable object described later, the normal object is displayed without being associated with a specific part of the character object.In addition, a normal object may be displayed to move so as to bounce back at the timing of contacting the character object.

[0076] When the normal object is displayed overlapping the character object, for example, the normal object may be displayed so as to overlap with a part of the character object other than the "head" including the "face". In this case, the normal object is displayed so as not to overlap with the "head" of the character object. Also, the normal object may be displayed so as to overlap with a part of the character object other than the "upper body" including the "face". In this case, the normal object is displayed so as not to overlap with the "upper body" of the character object.

[0077] The worn object is an object that is displayed in the user output image or other user output image in association with a specific part (wearing location) of the character object. For example, the specific part may be the front left side, front right side, rear left side, rear right side, front center side, rear center side, left eye, right eye, left ear, right ear, and the entire hair, etc. on the head of the character object. Also, the specific part may be the thumb, index finger, wrist, elbow, shoulder, upper arm, entire hand, entire arm, etc.

[0078] The worn object associated with a specific part of the character object is displayed in the user output image or other user output image so as to contact the specific part of the character object. Also, the worn object associated with a specific part of the character object may be displayed in the user output image or other user output image so as to cover a part or all of the specific part of the character object. The specific part may be specified by three-dimensional position information indicating a position in the three-dimensional coordinate space, or may be associated with the position information of the three-dimensional coordinate space.

[0079] The image information of the worn object is, for example, image information imitating an accessory (such as a hairpin, necklace or earrings) worn on a character object, clothing (such as a T-shirt or a one-piece dress), a costume, and other things that can be worn by a character object.

[0080] As the placement location of the worn object, information indicating the wearing part showing which part of the character object the worn object is associated with is stored. For example, when the worn object is a "hairpin", information indicating the "head" of the character object is stored as the placement location of the worn object. Also, when the worn object is a "T-shirt", information indicating the "torso" of the character object is stored as the placement location of the worn object.

[0081] As the placement location of the worn object, information indicating a plurality of wearing parts in a three-dimensional coordinate space may be stored. For example, when the worn object is a "hairpin", information indicating two parts, namely, the "left side behind the head" and the "right side behind the head" of the character object, may be stored as the placement location of the worn object. Thereby, the worn object imitating the "hairpin" is displayed as being worn on both the "left side behind the head" and the "right side behind the head" of the character object.

[0082] When a plurality of types of worn objects having a common wearing location are worn on a character object, the plurality of types of worn objects are worn on the character object at intervals of time. Thereby, a plurality of types of worn objects having a common wearing part are not worn on the character object at the same time. For example, when "head" is stored as the wearing location of both the worn object indicating a "hairpin" and the worn object indicating a "hat", the worn object indicating a "hairpin" and the worn object indicating a "hat" are not displayed on the head of the character object at the same time.

[0083] In the object table T2, the display time corresponding to the type of the additional object may be stored in association with the object ID of the additional object. For example, the display time of the wearable object may be stored as a time longer than the display time of the effect object and the normal object. For example, when "60 seconds" is stored as the display time of the wearable object, "5 seconds" may be stored as the display time of the effect object, and "10 seconds" may be stored as the display time of the normal object.

[0084] (Group table T3) FIG. 4(c) is an example of the data structure of the group table T3 that manages the groups to which the user belongs (groups of users in a friendship relationship, groups with other users who are mutual followers, groups arbitrarily created by the user or other users, etc.). The group table T3 is provided individually for each user, and the group table T3 shown in FIG. 4(c) is the group table T3 of the user who operates the terminal device 2 that stores the group table T3.

[0085] In the group table T3, for each group, the group ID of the group, the name of the group, the belonging users belonging to the group, etc. are stored in association with each other. The group ID is an example of identification data for uniquely identifying each group. The name is an example of data indicating the name of each group. The belonging user is the user ID of each user belonging to the group.

[0086] Returning to FIG. 3, the functions of the generation unit 271, the transmission unit 272, the reception unit 273, the display processing unit 274, and the voice output unit 275 will be described.

[0087] (Generation unit 271) The generation unit 271 acquires the imaging data continuously output by the imaging device 25 from the imaging device 25. For example, the imaging device 25 of the terminal device 2 held by the user is provided in the terminal device 2 such that the face of the user looking at the display screen of the display device 23 is in the shooting direction. The imaging device 25 continuously images the face of the user in the shooting direction, acquires the imaging data of the user's face, and outputs it to the generation unit 271 of the terminal processing device 27. The imaging device 25 may also acquire imaging data by imaging parts other than the user's face, such as the head, arms, hands (including fingers), chest, torso, legs, or other parts. Further, the imaging device 25 may be a 3D camera capable of detecting the depth of the person's face.

[0088] Based on the continuously acquired imaging data, the generation unit 271 generates face motion data, which is a digital representation of the movement of the user's face, as needed over time. The face motion data may be generated at predetermined sampling time intervals. In this way, the face motion data generated by the generation unit 271 can digitally represent the movement (change in expression) of the user's face in a time series.

[0089] The generation unit 271 may generate body motion data, which is a digital representation of the position and orientation of each part of the user (head, arms, hands (including fingers), chest, torso, legs, or other parts), together with the face motion data or separately from the face motion data.

[0090] The body motion data may be generated based on detection information from a known motion sensor worn by the user. In this case, the terminal communication I / F 21 of the terminal device 2 has a predetermined communication circuit for acquiring detection information from the motion sensor worn by the user by wireless communication. Then, the generation unit 271 generates body motion data based on the detection information acquired by the terminal communication I / F 21. The body motion data may be generated at predetermined sampling time intervals. In this way, the body motion data generated by the generation unit 271 can digitally represent the movement of the user's body in time series.

[0091] The generation of the body motion data based on the detection information from the motion sensor worn by the user may be performed, for example, in a photography studio. In this case, the photography studio may be provided with a base station, a tracking sensor, and a display. The base station is, for example, a multi-axis laser emitter. The motion sensor worn by the user may be, for example, the Vive Tracker provided by HTC CORPORATION, and the base station may be, for example, the base station provided by HTC CORPORATION.

[0092] Alternatively, a supporter computer may be installed in a separate room adjacent to the photography studio. The display in the photography studio may be configured to display information received from the supporter computer. The server device 3 may be installed in the same room as the room where the supporter computer is installed. The room where the supporter computer is installed and the photography studio may be separated by a glass window. In this case, the operator of the supporter computer can visually recognize the user. The supporter computer may be configured to be able to change the settings of various devices provided in the photography studio according to the operations of the supporter. The supporter computer can, for example, change the settings such as the scanning interval by the base station, the settings of the tracking sensor, and the various settings of various other devices. The operator may input a message to the supporter computer, and the input message may be displayed on the display in the photography studio.

[0093] The generation unit 271 generates character video data including face motion data and / or body motion data generated at any time, and outputs the generated character video data to the display processing unit 274. Hereinafter, the face motion data and the body motion data may be collectively referred to as motion data. Further, the generation unit 271 generates output information including the generated character video data and the user ID stored in the terminal storage device 22, and outputs the generated output information to the transmission unit 272. Note that when the generation unit 271 acquires the voice data of the user output from the microphone 26, the generation unit 271 generates output information including the generated character video data, the acquired voice data, and the user ID stored in the terminal storage device 22, and outputs the generated output information to the transmission unit 272.

[0094] The generation unit 271 generates game image data showing the game screen of the game played by the user at any time during the game progress, generates output information including the generated game image data and the user ID stored in the terminal storage device 22, and outputs the generated output information to the transmission unit 272. Note that the output information may include the generated character video data and / or the acquired audio data together with the generated game image data.

[0095] (Transmission unit 272) The transmission unit 272 transmits the output information output from the generation unit 271 to the server device 3 via the terminal communication I / F 21 together with the destination information. The destination information includes the user IDs of one or more other users who are participating in the communication service with the user. Also, the user ID included in the output information may be used as the destination information. For example, the server device 3 stores the user IDs of one or more other users who are participating in the communication service with the user, and when it acquires the output information, it identifies the user IDs of one or more other users who are participating in the communication service with the user of the user ID included in the output information, and transmits the received output information to the terminal device 2 of the other user indicated by the identified user ID.

[0096] Further, the transmission unit 272 transmits, via the terminal communication I / F 21, information indicating various instructions input by the user operating the input device 24, together with the user ID and the destination information stored in the terminal storage device 22, to the server device 3. The various instructions by the user include, for example, a selection instruction, a use instruction, and an addition instruction, etc. The information indicating the addition instruction is transmitted to the server device 3 via the terminal communication I / F 21 together with the object ID of the additional object to be included in the other user output image and the user ID stored in the terminal storage device 22. The information indicating the selection instruction is transmitted to the server device 3 via the terminal communication I / F 21 together with the user ID etc. stored in the terminal storage device 22. The information indicating the use instruction is transmitted to the server device 3 via the terminal communication I / F 21 together with the object ID of at least one specific object set as the use object and the user ID etc. stored in the terminal storage device 22. In addition, when a partial object is selected by the user and an instruction to create a character object composed of the selected partial object is given, the model ID for identifying the model data of the character object and the object IDs of a plurality of partial objects constituting the character object may be transmitted to the server device 3 via the terminal communication I / F 21 together with the user ID etc. stored in the terminal storage device 22. In this case, the server device 3 may store the user ID, the model ID, and the object IDs of a plurality of partial objects constituting the character object in the server storage device 32 in association with each other. Also, via the server device 3, the terminal device 2 of another user that has received the model ID for identifying the model data of the user's character object, the object IDs of a plurality of partial objects constituting the user's character object, and the user ID of the user may store the user ID, the model ID, and the object IDs of a plurality of partial objects constituting the character object in the terminal storage device 22 in association with each other.As a result, the user's terminal device 2 only needs to transmit only the user ID (or model ID) to other users' terminal devices via the server device 3. Then, the other users' terminal devices can extract the object IDs of a plurality of partial objects associated with the received user ID (or model ID). And the other users' terminal devices can display the user's character object based on the 3D model data (of each partial object) corresponding to each extracted object ID.

[0097] (Receiving unit 273) The receiving unit 273 receives, via the terminal communication I / F 21, the output information of other users and information indicating various instructions of other users, etc., transmitted from the server device 3. The receiving unit 273 outputs the received information to the terminal processing device 27. The output information of other users transmitted from the server device 3 is generated by the generation unit 271 of the other users' terminal device 2 and transmitted to the server device 3 by the transmission unit 272 of the other users' terminal device 2. The output information of other users includes the character video data of other users, the audio data of other users, the user ID of other users, etc. There may be a case where the audio data of other users is not included in the output information of other users, and there may be a case where the character video data of other users is not included in the output information of other users.

[0098] In addition, the receiving unit 273 receives, via the terminal communication I / F 21, the information indicating the selection result transmitted from the server device 3. The information indicating the selection result is the information indicating the result of the selection process executed by the server device 3 in response to the selection instruction by the user or other users. The receiving unit 273 receives the user ID of the user who gave the selection instruction together with the information indicating the selection result. When the user ID of the user operating the terminal device 2 is the same as the received user ID, the receiving unit 273 stores the object ID of at least one specific object received as the information indicating the selection result in the user table T1 in association with the user ID of the user as the user's owned object.

[0099] (Display processing unit 274) The display processing unit 274 displays, on the display device 23, as a user output image, an image drawn based on the motion data (character video data) generated by the generation unit 271. Further, the display processing unit 274 displays, on the display device 23, as an output image of another user, an image drawn based on the motion data (character video data) included in the output information of another user received by the reception unit 273. Hereinafter, the drawing process of the image based on the motion data will be described. In the drawing process of the image based on the motion data of the user (the user operating the terminal device 2), the user ID stored in the terminal storage device 22 is used, and in the drawing process of the image based on the motion data included in the output information of another user received by the reception unit 273, the user ID included in the output information is used.

[0100] First, the display processing unit 274 extracts, from the user table T1, the model ID of the character object associated with the user ID and the object ID of the object to be used. Next, the display processing unit 274 reads out, from the terminal storage device 22, the model data associated with the extracted model ID, the image information and the placement location associated with the object ID of the object to be used. Next, the display processing unit 274 generates an animation of the character object with the object to be used mounted at the placement location, based on the read model data, the image information and the placement location of the object to be used, and the motion data. When the object IDs of a plurality of partial objects constituting the character object are associated with the model ID of the character object, the display processing unit 274 extracts the model data corresponding to the object IDs of the plurality of partial objects associated with the extracted model ID. Next, the display processing unit 274 generates an animation of the character object with the object to be used mounted at the placement location, based on the read model data of the plurality of partial objects, the image information and the placement location of the object to be used, and the motion data. Note that the object to be used may be included in the plurality of partial objects.

[0101] When the face motion data is included in the motion data, the display processing unit 274 generates an animation of the character object so that the expression of the character object changes based on the face motion data. Thereby, the display processing unit 274 can generate an animation of the character object that moves in synchronization with the movement of the user's expression based on the read model data and face motion data. When the face motion data and body motion data are included in the motion data, the display processing unit 274 generates an animation of the character object that moves in synchronization with the movement of the user's expression and body based on the read model data, face motion data, and body motion data. Next, the display processing unit 274 draws an image including the generated animation (moving image) of the character object and the background image showing the background generated using the background data stored in the terminal storage device 22. Note that the display processing unit 274 may use the wallpaper object stored in the terminal storage device 22 and associated with the communication group in advance as the background image. In this case, the same wallpaper object may be applied as the background image for all members of the communication group. Then, the display processing unit 274 outputs drawing data indicating the drawn image and ends the drawing process of the image based on the motion data. Note that the image drawn based on the character object associated with the user ID stored in the terminal storage device 22 is the user output image of the user. Also, the image drawn based on the character object associated with the user ID included in the output information of other received users is the other user output image of the other user.

[0102] In addition, in response to a user's change instruction, the display processing unit 274 may display, on the display device 23, a character object newly equipped with a wearable object held by the user as the user's held object. For example, when the wearable object changed by the user is "kerchief", the display processing unit 274 extracts the object ID of the wearable object ("kerchief") from the held objects associated with the user ID of the user in the user table T1, and stores it as a used object. The display processing unit 274 extracts the image information and the placement location associated with the object ID stored as the used object from the object table T2. Next, the display processing unit 274 generates a user output image including a character object with the wearable object ("kerchief") worn on the head (the placement location associated with the object ID of "kerchief") based on the extracted image information and placement location. Note that the display processing unit 274 may generate a user output image including a character object with a wearable object that moves in accordance with the movement of the wearing part (placement location) of the character object.

[0103] In addition, the display processing unit 274 reads out, from the terminal storage device 22, the image information associated with the object ID of the specific object received as the information indicating the selection result, and displays a selection result screen on the display device 23 based on the read image information.

[0104] In addition, the display processing unit 274 may display, on the display device 23, a user output image including a character object with a new wearable object worn, based on the information indicating the selection result received from the server device 3. The information indicating the selection result is information indicating the result of the selection process executed by the server device 3 in response to the user's selection instruction. The information indicating the selection result includes, for example, the object ID of the specific object selected by the selection process. The number of object IDs of the specific object included in the information indicating the selection result may be 1 or 2 or more. Hereinafter, an example of the use process according to the use instruction will be described.

[0105] First, when a use instruction is input by the user's operation of the input device 24, the display processing unit 274 of the user's terminal device 2 executes a storage process for the object ID of a specific object included in the information indicating the selection result. The storage process for the specific object is a process in which the object ID of the specific object included in the information indicating the selection result is stored in the user table T1 in association with the user ID of the user as the used object. When the object IDs of a plurality of specific objects are included in the information indicating the selection result, the object ID of at least one specific object instructed to be used by the user among the plurality of specific objects is stored in the user table T1 in association with the user ID of the user as the used object. In this way, the object ID of at least one specific object set as the used object is stored.

[0106] Also, when the specific object stored as the used object is a worn object, the display processing unit 274 executes display processing for the worn object. Hereinafter, an example of the display processing for the worn object will be described. In the description of an example of the display processing for the worn object, the specific object stored as the used object is referred to as the "worn object". First, the display processing unit 274 extracts the image information and the placement location associated with the object ID of the worn object (specific object) stored as the used object from the object table T2. The display processing unit 274 generates an animation of the character object of the user on which the worn object is worn at the placement location based on the extracted image information and the placement location. Then, the display processing unit 274 displays a user output image including the character object of the user on which the worn object is worn at the placement location based on the generated animation. Thus, the display processing for the worn object is completed, and the use processing according to the use instruction is also completed.

[0107] In the display process of the wearable object, the display processing unit 274 may display a user output image including a character object wearing a wearable object that moves along with the movement of the wearing part (placement location) of the character object. For example, when the specific object stored as the usage object is the wearable object "beret", a user output image including the user's character object with the wearable object "beret" worn on the head is displayed. Also, in the user output image, the wearable object "beret" is displayed so as to move along with the movement of the head of the character object.

[0108] Further, when the specific object stored as the usage object is a wallpaper object, the display processing unit 274 executes the display process of the wallpaper object. Hereinafter, an example of the display process of the wallpaper object will be described. Note that, during the description of an example of the display process of the wallpaper object, the specific object stored as the usage object is referred to as the "wallpaper object". First, the display processing unit 274 extracts the image information associated with the object ID of the wallpaper object (specific object) stored as the usage object from the object table T2. The display processing unit 274 displays a user output image that uses the extracted image information as the background image of the user's character object. Thus, the display process of the wallpaper object is completed, and the usage process according to the usage instruction is also completed.

[0109] In addition, the display processing unit 274 displays a user output image including the additional object in response to an additional instruction of the additional object from another user. The display processing unit 274 displays a user output image of another user including the additional object in response to an additional instruction to display the additional object in the user output image of another user from the user.

[0110] When the object ID included in the addition instruction of the additional object from another user is the object ID of any of the effect objects, the display processing unit 274 refers to the object table T2, extracts the still image or moving image (image information) of the effect object associated with the object ID included in the addition instruction from the terminal storage device 22, and generates a user output image including the extracted still image or moving image. For example, when an addition instruction for an effect object indicating confetti or fireworks is given, the display processing unit 274 generates a user output image including a moving image of an effect object (not shown) imitating confetti or fireworks. When the object ID included in the addition instruction of the additional object from the user is the object ID of any of the effect objects, similarly, the display processing unit 274 refers to the object table T2, extracts the still image or moving image (image information) of the effect object associated with the object ID included in the addition instruction from the terminal storage device 22, and generates another user output image including the extracted still image or moving image.

[0111] When the object ID included in the addition instruction of the additional object from another user is the object ID of a normal object, the display processing unit 274 refers to the object table T2 and extracts the still image or moving image (image information) of the normal object and the placement location associated with the object ID of the normal object. Next, the display processing unit 274 generates a user output image including the still image or moving image of the normal object placed at the position indicated by the placement location. Also, when the object ID included in the addition instruction of the additional object from the user is the object ID of a normal object, similarly, the display processing unit 274 refers to the object table T2, extracts the still image or moving image (image information) of the normal object and the placement location associated with the object ID of the normal object, and generates another user output image including the still image or moving image of the normal object placed at the position indicated by the placement location.

[0112] The display processing unit 274 may generate a user output image and other user output images including a moving image of a normal object that moves within the display areas of the user output image and the other user output images. Hereinafter, the user output image and the other user output images may be collectively referred to as output images. For example, the display processing unit 274 may generate an output image including a moving image of a normal object that falls from the top to the bottom of the output image. In this case, the normal object may be displayed within the display area of the output image while falling from the start of the fall to the lower end of the output image, and may disappear from the output image after falling to the lower end of the output image. Note that the movement route of the normal object may be a route in the left-to-right direction, right-to-left direction, upper-left to lower-left direction, or other directions of the output image, and may also be a route along a straight orbit, circular orbit, elliptical orbit, spiral orbit, or other orbits.

[0113] When the object ID included in the addition instruction of the additional object from another user is the object ID of the wearable object, the display processing unit 274 displays notification information regarding the attachment instruction within the user output image. In response to the attachment instruction from the user, the display processing unit 274 refers to the object table T2 and extracts the image information and the placement location of the wearable object associated with the object ID included in the addition instruction. Next, the display processing unit 274 generates a user output image including a character object with the wearable object attached to the attachment site indicated by the placement location based on the extracted image information and placement location.

[0114] In addition, in response to a user's instruction, the display processing unit 274 starts a game that the user plays and displays the game screen of the game on the display device 23. When the game is started, the display processing unit 274 displays the game screen of the game that progresses in response to the game progress instruction by the user's game operation on the display device 23, and when the end condition of the game is satisfied, the display of the game screen ends. The end condition of the game is predetermined according to the rules of the game. For example, the user's game medium (such as a character) has won or lost against an opponent, the user's game medium has reached a predetermined destination, or a game object operated by the user has reached a predetermined state (for example, a plurality of frames (game objects) are arranged in a grid on the game field).

[0115] (Audio output unit 275) When the audio data of another user is included in the output information of another user, the audio output unit 275 outputs the voice of another user generated based on the audio data from a speaker (not shown) together with the display of the output image of another user by the display processing unit 274. Thereby, during the lip movement of the character object of another user included in the output image of another user, the voice of another user is output, so that the user can view the output image of another user including the character object of another user who seems to be speaking.

[0116] (Server device 3) FIG. 5 is a diagram showing an example of the schematic configuration of the server device 3. The server device 3 that provides a communication service to each of the terminal devices 2 of a plurality of users transmits the output information transmitted from the terminal device 2 of one user and the information indicating various instructions to the terminal device 2 of another user different from the one user. For this purpose, the server device 3 includes a server communication I / F 31, a server storage device 32, and a server processing device 33. For example, the terminal device 2 that is the transmission destination of the information by the terminal device 2 of one user is the terminal device 2 of the user indicated by the user ID included in the received transmission destination information.

[0117] The server communication I / F 31 is implemented as hardware, firmware, communication software such as a TCP / IP driver or a PPP driver, or a combination thereof. The server device 3 can transmit information to other devices and receive information from other devices via the server communication I / F 31.

[0118] The server storage device 32 is, for example, a semiconductor memory device such as a ROM or a RAM. The server storage device 32 may be, for example, a magnetic disk, an optical disk, or various other storage devices capable of storing data other than the above. The server storage device 32 stores an operating system program, a driver program, an application program, data, etc. used in the processing by the server processing device 33. Note that the server storage device 32 may store, as data, a user table T1, an object table T2, and a group table T3. Further, the server storage device 32 stores a selection event ID for identifying a selection event and an object group ID for identifying an object group used in the selection event in association with each other. The server storage device 32 stores, in association with the object group ID, the object ID of each of a plurality of specific objects. For example, when the server device 3 can provide a plurality of types of selection events, a plurality of selection event IDs for identifying each of the plurality of types of selection events are stored. Also, a plurality of object group IDs associated with each of the plurality of selection event IDs are stored, and each object group ID stores the object ID of each of a plurality of specific objects.

[0119] The server processing device 33 is a processor that loads an operating system program, a driver program, and a control program stored in the server storage device 32 into the memory and executes instructions included in the loaded programs. The server processing device 33 is, for example, an electronic circuit such as a CPU, MPU, DSP, GPU, or a combination of various electronic circuits. The server processing device 33 may be implemented by an integrated circuit such as an ASIC, PLD, FPGA, MCU, etc. In FIG. 5, the server processing device 33 is illustrated as a single component, but the server processing device 33 may be a collection of a plurality of physically separate processors. The server processing device 33 functions as a server reception unit 331, a server transmission unit 332, and a selection unit 333 by executing various instructions included in the control program.

[0120] (Server reception unit 331) The server reception unit 331 receives output information transmitted from the terminal device 2 of any one of a plurality of users and information indicating various instructions via the server communication I / F 31. Note that the server reception unit 331 may receive other information such as transmission destination information together with the output information transmitted from the terminal device 2 and the information indicating various instructions.

[0121] For example, the server reception unit 331 receives information indicating a selection instruction, a selection event ID, the user ID of user A, and transmission destination information from the user's terminal device 2 via the server communication I / F 31. The server reception unit 331 inputs the received information indicating the selection instruction and the selection event ID to the selection unit 333. When information indicating the number of selections is transmitted together with the information indicating the selection instruction, the server reception unit 331 receives the information indicating the number of selections together with the information indicating the selection instruction and inputs the received information indicating the number of selections to the selection unit 333.

[0122] (Server transmission unit 332) The server transmission unit 332 transmits the output information received by the server reception unit 331 and the information indicating various instructions to the terminal device 2 of another user indicated by the user ID included in the destination information received simultaneously via the server communication I / F 31. Further, the server transmission unit 332 may transmit the information indicating various instructions received by the server reception unit 331 to the terminal device 2 of one or more other users designated by the user who transmitted the information via the server communication I / F 31.

[0123] In addition, when the object ID of at least one specific object is selected by the selection unit 333 (to be described later) in response to a selection instruction by the user, the server transmission unit 332 has a function of transmitting the selected object ID of the specific object. For example, the server transmission unit 332 acquires, from the selection unit 333, the object ID of at least one specific object selected by the selection unit 333 in the selection event designated by the user as information indicating the selection result. Further, the server transmission unit 332 acquires the user ID and the destination information of the user received together with the information indicating the selection instruction from the server reception unit 331. Next, the server transmission unit 332 transmits, via the server communication I / F 31, the information indicating the selection result and the user ID of the user who gave the selection instruction to the terminal device 2 of the user indicated by the user ID included in the terminal device 2 of the user and the destination information.

[0124] (Selection unit 333) The selection unit 333 acquires the information indicating the selection instruction and the selection event ID from the server reception unit 331. When the information indicating the number of selections is transmitted together with the information indicating the selection instruction, the selection unit 333 also acquires the information indicating the number of selections from the server reception unit 331. The selection unit 333 extracts the object group ID associated with the input selection event ID from among the plurality of object group IDs stored in the server storage device 32.

[0125] Next, the selection unit 333 selects the object ID of at least one specific object from among the object IDs of a plurality of specific objects associated with the extracted object group ID according to a predetermined selection method. Note that when the selection unit 333 acquires information indicating the number of selections, it selects the object IDs of the specific objects by the number of selections from among the object IDs of the plurality of specific objects associated with the extracted object ID. For example, when acquiring information indicating the selection number "1", the selection unit 333 selects the object ID of one specific object from among the object IDs of the plurality of specific objects associated with the extracted object ID. Also, for example, when acquiring information indicating the selection number "10", the selection unit 333 selects the object IDs of 10 specific objects from among the object IDs of the plurality of specific objects associated with the extracted object ID. Then, the selection unit 333 inputs the object ID of the selected specific object to the server transmission unit 332.

[0126] (Examples of various screens) Hereinafter, with reference to FIGS. 6 to 15, examples of various screens displayed on the display device 23 of the user's terminal device 2 will be described. In FIGS. 6 to 15, a plurality of components with the same reference numerals are components having equivalent functions to each other.

[0127] FIG. 6(a) is a diagram showing an example of a group creation screen 600 displayed on the display device 23 of the user's terminal device 2. The group creation screen 600 includes another user display area 601, a selection object 602, and a creation button 603. For example, the group creation screen 600 is displayed when a group creation object or the like on a home screen (not shown) displayed in response to the execution of a control program stored in the terminal storage device 22 is selected by an operation of the user input device 24.

[0128] In the other user display area 601, other user information indicating each of the other users having a predetermined relationship with the user is displayed. In the example shown in FIG. 6(a), the display processing unit 274 of the user's terminal device 2 displays the thumbnail image of the character object of the other user and the name of the other user as the other user information.

[0129] The selection object 602 is an operation object for selecting each of the other users indicated by the respective other user information. In the example shown in FIG. 6(a), the display processing unit 274 of the user's terminal device 2 displays a checkbox object corresponding to each other user information as the selection object 602. For example, when the selection object 602 is selected by an operation of the user's input device 24, the selection object 602 is displayed with a "check" mark. In this case, the other user corresponding to the other user information of the selection object 602 having a "check" mark is in a selected state. Also, when the selection object 602 having a "check" mark is selected by an operation of the user's input device 24, the selection object 602 is displayed without a "check" mark. In this case, the other user corresponding to the other user information of the selection object 602 without a "check" mark is in a non-selected state. The user ID of the other user related to the corresponding other user information is associated with each of the selection objects 602.

[0130] The creation button 603 is a button object or the like for the user to newly create a communication group. When the creation button 603 is selected by the user's operation of the input device 24, a new group is created with the user operating the terminal device 2 and other users selected in the selection object 602 as the belonging users. For example, the display processing unit 274 of the user's terminal device 2 identifies the user ID of the user stored in the terminal storage device 22 and the user ID of the other users associated with the selection object 602 in the state selected in the selection object 602. Then, the display processing unit 274 associates the user ID of the identified user and the user ID of the other users as the belonging users with the newly created group ID and stores them in the group table T3. At this time, the display processing unit 274 may automatically associate the name of the newly created group with the newly created group ID, or may associate the name of the group input by the user with the newly created group ID.

[0131] When a new group is created in response to the selection of the creation button 603, the display processing unit 274 displays an information exchange screen 700 for the belonging users of the new group. FIG. 7(a) is a diagram showing an example of the information exchange screen 700 displayed on the display device 23 of the user's terminal device 2. The information exchange screen 700 includes a display area 701 for displaying information such as text or images input by each of the belonging users of the new group, information (thumbnail images of character objects, etc.) 702 indicating the belonging users who input the information displayed in the display area 701, an input object 703 for the user to input text or images to be displayed in a new display area 701, and a start object 704 for starting a communication service.

[0132] When the display instruction of the information exchange screen 700 is displayed on the user's terminal device 2, the transmission unit 272 of the terminal device 2 transmits the display instruction of the information exchange screen to the server device 3 via the terminal communication I / F 21 together with the information about the new group and the destination information. The information about the new group is the group ID, name, and each user ID of the belonging users of the new group. The destination information includes the respective user IDs of other users excluding the user who operates the terminal device 2 among the belonging users of the new group. The server receiving unit 331 of the server device 3 receives the display instruction of the information exchange screen, the information about the new group, and the destination information via the server communication I / F 31. Note that the server receiving unit 331 may store the received destination information in the server storage device 32. The server transmission unit 332 of the server device 3 transmits the display instruction of the information exchange screen and the information about the new group to the terminal devices 2 of other users indicated by the user IDs included in the destination information via the server communication I / F 31. When the terminal device 2 of another user receives the display instruction of the information exchange screen transmitted from the terminal device 2 of the user via the server device 3, it can display the information exchange screen 700 that enables information exchange among the belonging users of the new group.

[0133] Return to the explanation in FIG. 7(a). For example, when new information is input to the input object 703 by the operation of any of the belonging users, a display area 701 for displaying the new information is added to the information exchange screen 700 displayed by the terminal device 2 of the user who input the information. Further, the transmission unit 272 of the terminal device 2 of the user who input the information transmits the newly input information to the terminal devices 2 of the belonging users other than the user who input the information via the server device 3. As a result, a display area 701 for displaying the new information is also added to the information exchange screen 700 displayed on the terminal device 2 of another user who is a belonging user other than the user who input the information.

[0134] The start object 704 is a button object or the like for starting a communication service that each user belonging to a new group can participate in. When the start object 704 is selected by the user's operation of the input device 24, a start process of the communication service is executed, where the group that can exchange information through the information exchange screen 700 is set as the communication group. Hereinafter, an example of the start process in response to the user's selection of the start object 704 will be described.

[0135] First, the display processing unit 274 of the user's terminal device 2 displays a communication screen 810 (FIG. 8(b)) that can be displayed by each user's terminal device 2 belonging to the communication group. Also, the display processing unit 274 stores the group ID of the communication group in the terminal storage device 22 as the group ID of the group that started the communication service. Furthermore, the display processing unit 274 stores the user ID of the user in the terminal storage device 22 as the user ID of the user participating in the communication service. Note that if all other users belonging to the communication group have not yet participated in the communication service, only the user's user output image is displayed on the communication screen 810.

[0136] Next, the transmission unit 272 of the user's terminal device 2 transmits an instruction to start a communication service to the server device 3 via the terminal communication I / F 21 together with the user ID of the user stored in the terminal storage device 22, information regarding the communication group, and / or destination information. The information regarding the communication group includes the group ID, name, and respective user IDs of the users belonging to the communication group. The destination information includes the respective user IDs of other users excluding the user operating the terminal device 2 among the users belonging to the communication group. Note that when the destination information is stored in the server storage device 32, the destination information may not be transmitted. The server reception unit 331 of the server device 3 receives the start instruction, user ID, information regarding the communication group, and destination information via the server communication I / F 31. The server transmission unit 332 of the server device 3 transmits the start instruction, user ID, and information regarding the communication group to the terminal devices 2 of other users indicated by the user IDs included in the destination information via the server communication I / F 31.

[0137] The receiving unit 237 of the terminal device 2 of another user receives from the server device 3 the start instruction, user ID, and information regarding the communication group transmitted from the user's terminal device 2. The receiving unit 237 stores the group ID among the information regarding the communication group in the terminal storage device 22 as the group ID of the group that has started the communication service. Further, the display processing unit 274 stores the transmitted user ID in the terminal storage device 22 as the user ID of the user participating in the communication service. The display processing unit 274 of the terminal device 2 of another user displays a notification screen (not shown) based on the received information regarding the communication group. In response to the selection of a predetermined object in the notification screen by the user, the display processing unit 274 displays a group selection screen 710 (Fig. 7(b)) for participating in the communication service on the display device 23. Thus, the start processing is completed. Note that the display processing unit 274 of the terminal device 2 of another user may include a participation button 805 described later in the notification screen. Thereby, without displaying the group selection screen 710, other users can immediately participate in the communication service.

[0138] The start processing may be executed when the creation button 603 of the group creation screen 600 is selected by the operation of the input device 24 by the user. That is, in response to the selection of the creation button 603 by the user, the start processing of the communication service using the new group created in the group creation screen 600 as the communication group may be executed. In this case, the information exchange screen 700 is not displayed.

[0139] Also, the start process is not limited to the start process of the communication service that uses the new group created on the group creation screen 600 as the communication group. For example, the start process of the communication service that uses an already created group as the communication group may be executed. For example, FIG. 6(b) is a diagram showing an example of a group selection screen 610 for selecting a communication group created by any user. For example, the group selection screen 610 is displayed when a group selection object or the like on the home screen (not shown) displayed in response to the execution of the control program stored in the terminal storage device 22 is selected by an operation of the user input device 24.

[0140] The group selection screen 610 displayed on the user's terminal device 2 includes a group display area 611 for selecting any one of a plurality of communication groups. In the group display area 611, group information indicating each of the already created communication groups to which the user belongs is displayed. In the example shown in FIG. 6(b), the display processing unit 274 of the user's terminal device 2 displays the thumbnail image of each of the users belonging to the communication group and the name of the group as the group information. In the example shown in FIG. 6(b), the thumbnail images of other users among the users belonging to the group are displayed, but the thumbnail images of all the users belonging to the group may be displayed. When only one other user other than the user is included in the communication group, as shown in FIG. 6(b), the name of the one other user instead of the name of the group may be displayed.

[0141] When one piece of group information included in the group display area 611 is selected by an operation of the input device 24 by the user, an information exchange screen 700 for the users belonging to the communication group corresponding to the selected group information is displayed. The information exchange screen 700 includes information such as text or images input by each of the users belonging to the communication group. Also in this case, to the terminal devices 2 of other users among the users belonging to the communication group, an instruction to display the information exchange screen and information regarding the communication group are transmitted via the server device 3, and the information exchange screen 700 is also displayed on the terminal devices 2 of other users.

[0142] And, in the information exchange screen 700, when a start object 704 is selected by the user, start processing of a communication service by the communication group that performs information exchange in the information exchange screen 700 is executed. When the start processing is executed, the display processing unit 274 of the user's terminal device 2 displays a communication screen 810 (FIG. 8(b)) that can be displayed by the terminal devices 2 of each user belonging to the communication group. Also, the display processing unit 274 of the terminal device 2 of another user displays a notification screen (not shown), and in response to an operation of another user on the notification screen, a group selection screen 710 (FIG. 7(b)) for participating in the communication service is displayed on the display device 23. Note that also in this case, the display processing unit 274 of the terminal device 2 of another user may include a participation button 805 described later in the notification screen.

[0143] Note that also in this case, the start processing may be executed when one piece of group information is selected in the group selection screen 610 by an operation of the input device 24 by the user. That is, in response to the selection of one piece of group information by the user, start processing of a communication service by the communication group corresponding to the selected group information may be executed. In this case, the information exchange screen 700 is not displayed.

[0144] Next, a method for a user who has not participated in a communication service that has already started to participate will be described. FIG. 7(b) is a diagram showing an example of a group selection screen 710 displayed on the display device 23 of the user's terminal device 2. For example, the group selection screen 710 is displayed in response to the selection of a predetermined object within the displayed notification screen. Also, the group selection screen 710 may be displayed when a group selection object on the home screen displayed in response to the execution of a control program stored in the terminal storage device 22 is selected by an operation of the user's input device 24.

[0145] In the group display area 711 of the group selection screen 710, group information indicating a communication group in which the communication service has been started is displayed so as to be distinguishable from other group information. In the example shown in FIG. 7(b), the group information displayed at the top is the one indicating the communication group in which the communication service has been started. For example, information indicating the number of participating users in the communication service is displayed superimposed on or in the vicinity of each thumbnail image of the users belonging to the communication group. Also, a mark image 712 indicating the communication service is displayed in the vicinity of the name of the communication group.

[0146] When group information indicating a communication group in which the communication service has been started is selected from among the group information included in the group display area 711 by an operation of the input device 24 by the user, an information exchange screen 800 by the users belonging to the communication group corresponding to the selected group information is displayed.

[0147] FIG. 8(a) is a diagram showing an example of an information exchange screen 800 displayed on the display device 23 of the user's terminal device 2. The information exchange screen 800 includes display areas 801a to 801b for displaying information such as text or images input by each of the users belonging to the communication group in which the communication service has been started, and information (thumbnail images of character objects, etc.) 802a to 802b indicating the users who input the information displayed in each of the display areas 801a to 801b, an input object 803 for the user to input text or an image to be displayed in a new display area 801, a service display area 804 indicating the communication service that has already been started, and a participation button 805 for participating in the communication service that has already been started.

[0148] In the service display area 804 shown in FIG. 8(a), thumbnail images of character objects of three users participating in the communication service are displayed. In the display area 801b shown in FIG. 8(a), information indicating that the communication service has been started is displayed. When the participation button 805 is selected by the user, a participation process is executed. Hereinafter, an example of the participation process will be described.

[0149] When the participation button 805 is selected by the user's operation of the input device 24, first, the display processing unit 274 of the user's terminal device 2 stores the user ID of the user stored in the terminal storage device 22 as the user ID of the users participating in the communication service related to the service display area 804 in the terminal storage device 22. Next, the display processing unit 274 displays a communication screen 810 (FIG. 8(b)) including the user output images of all the users participating in the communication service.

[0150] Next, the transmission unit 272 of the user's terminal device 2 transmits an instruction to participate in the communication service to the server device 3 via the terminal communication I / F 21 together with the user ID of the user stored in the terminal storage device 22, information regarding the communication group, and / or destination information. The information regarding the communication group is the group ID, name, and the respective user IDs of the belonging users of the communication group. The destination information includes the respective user IDs of other users excluding the user operating the terminal device 2 among the users belonging to the communication group. The server receiving unit 331 of the server device 3 receives the participation instruction, user ID, information regarding the communication group, and / or destination information via the server communication I / F 31. The server transmission unit 332 of the server device 3 transmits the participation instruction, user ID, and information regarding the communication group to the terminal devices 2 of other users indicated by the user IDs included in the destination information via the server communication I / F 31.

[0151] The receiving unit 237 of the terminal device 2 of other users receives from the server device 3 the participation instruction, user ID, and information regarding the communication group transmitted from the terminal device 2 of the user. The receiving unit 237 stores the received user ID in the terminal storage device 22 as the user ID of the user participating in the communication service. When the communication screen 810 is being displayed on the terminal device, the display processing unit 274 of the terminal device 2 of other users displays the communication screen 810 including the user output images of all the users participating in the communication service. Thus, the participation process is completed.

[0152] The participation process may be executed when group information is selected on the group selection screen 710 by the user's operation of the input device 24. That is, in response to the selection of group information by the user, a participation process for the communication service in which the communication group corresponding to the group information is participable may be executed. In this case, the information exchange screen 800 is not displayed.

[0153] Embodiments for starting or participating in a communication service are not limited to the examples described above. For example, other start-up processes different from the start-up process according to the selection of the start object 704 by the user may be executed. The other start-up process is executed when a predetermined display object for specifying the start of the communication service is selected by the user on a predetermined screen such as the home screen. Note that the predetermined display object may be displayed when a thumbnail image of the user's character object or the like is selected, or may be included in the menu items of the predetermined screen. The other start-up process may be automatically executed when a predetermined start condition is satisfied. For example, the predetermined start condition is that the current time has reached a predetermined time, a predetermined time has elapsed since the end of the previous communication service, the number of mutual followers of the user has exceeded a predetermined number, and the like. Hereinafter, an example of another start-up process will be described.

[0154] First, the transmission unit 272 of the user's terminal device 2 transmits an instruction to start a communication service to the server device 3 via the terminal communication I / F 21 together with the user ID of the user stored in the terminal storage device 22 and / or the destination information. In addition, the transmission unit 272 stores the user ID of the user as the user ID of the user participating in the communication service in the terminal storage device 22. The destination information includes the user IDs of one or more other users having a predetermined relationship with the user. For example, the destination information may include the user IDs of one or more other users who are mutual followers of the user. In addition, instead of or in addition to the user IDs of one or more other users who are mutual followers of the user, the destination information may include the user IDs of other users who are in a mutual follow relationship with a predetermined user who is a mutual follower of the user.

[0155] The server receiving unit 331 of the server device 3 receives a start instruction, a user ID, and / or destination information via the server communication I / F 31. The server transmitting unit 332 of the server device 3 transmits the start instruction, the user ID, and the destination information to the terminal device 2 of another user indicated by the user ID included in the destination information via the server communication I / F 31. The receiving unit 237 of the terminal device 2 of another user receives the start instruction, the user ID, and the destination information transmitted from the user of the terminal device 2 from the server device 3. The receiving unit 237 stores the transmitted user ID in the terminal storage device 22 as the user ID of the user participating in the communication service. The display processing unit 274 of the terminal device 2 of another user displays a notification screen (not shown) on the display device 23 based on the received user ID. The notification screen includes information prompting participation in the communication service from the user indicated by the received user ID and a participation button or the like.

[0156] When the participation button in the notification screen is selected by an operation of the input device 24 by another user, the display processing unit 274 of the terminal device 2 of another user stores the user ID of the other user stored in the terminal storage device 22 as the user ID of the user participating in the communication service related to the service display area 804 in the terminal storage device 22. Next, the display processing unit 274 displays a communication screen 810 (FIG. 8(b)) including the user output images of all the users participating in the communication service.

[0157] Next, the transmission unit 272 of the terminal device 2 of another user transmits an instruction to participate in the communication service to the server device 3 via the terminal communication I / F 21 together with the user ID of the other user and / or the destination information stored in the terminal storage device 22. The destination information is obtained by deleting the user ID of the other user of the terminal device 2 that transmits the destination information from the user ID included in the destination information received by the reception unit 237 first, and at the same time adding the user ID received by the reception unit 237. The server reception unit 331 of the server device 3 receives the participation instruction, the user ID, and / or the destination information via the server communication I / F 31. The server transmission unit 332 of the server device 3 transmits the participation instruction, the user ID, and the destination information to the terminal device 2 of the other user indicated by the user ID included in the destination information via the server communication I / F 31.

[0158] The reception unit 237 of the terminal device 2 of the user who is the destination of the participation instruction receives from the server device 3 the participation instruction, the user ID, and the destination information transmitted from the terminal device 2 of the user. The reception unit 237 stores the received user ID in the terminal storage device 22 as the user ID of the user participating in the communication service. When the communication screen 810 is being displayed on the terminal device 2, the display processing unit 274 of the terminal device 2 displays the communication screen 810 including the user output images of all the users participating in the communication service. Thus, a series of participation processes is completed.

[0159] Note that the embodiments of starting or participating in a communication service with another user having a predetermined relationship with the user are not limited to the above-described examples. For example, when a predetermined display object for specifying the start of a communication service is selected by the user, a selection screen including information indicating other users who are mutual followers of one or more users may be displayed. In this case, when information indicating any other user is selected by the user, other start processing based on a start instruction to start communication with the selected other user may be executed. Further, in this case, an information exchange screen with the selected other user is displayed, and when a start button within the information exchange screen is selected, other start processing based on a start instruction to start communication with the other user may be executed.

[0160] In a conventional information system, a user could not issue an instruction to start and / or participate in communication with another user having a predetermined relationship with the user, such as a mutual follower of the user, using a simple interface. In the information system 1 disclosed in the present embodiment, by executing the above-described other start processing, it is possible to improve the user interface related to the instruction to start and / or participate in communication and reduce the communication load between the server device 3 and the terminal device 2.

[0161] FIG. 8(b) is a diagram showing an example of a communication screen 810 displayed on the display device 23 of the terminal device 2. The communication screen 810 is a communication screen of a communication group including the user operating the terminal device 2 as a belonging user. Hereinafter, the user operating the terminal device 2 is referred to as user A, and users other than user A who are participating in the communication service corresponding to the communication screen 810 are referred to as user B1, user B2, user B3, ···. Note that user B1, user B2, user B3, ··· may be collectively referred to as user B.

[0162] The communication screen 810 includes at least a user output image 812a that includes the character object 811a of user A. In the example shown in FIG. 8(b), in addition to user A, there are three users (user B1, user B2, user B3) participating in the communication service. That is, the user output images 812b1, 812b2, 812b3 that include the respective character objects 811b1, 811b2, 811b3 of user B1, user B2, and user B3 are included in the communication screen 810. Hereinafter, the character objects 811b1, 811b2, 811b3 may be collectively referred to as the character object 811b, and the user output images 812b1, 812b2, 812b3 may be collectively referred to as the user output image 812b. Note that user B is another user for user A, and the user output image 812b of user B displayed on the terminal device 2 of user A is another user output image.

[0163] When there are no users other than user A participating in the communication service, only the user output image 812a is included in the communication screen 810. Each time user B participates in the communication service, the user output image 812b of that user B is newly included in the communication screen 810. There is no upper limit to the number of users who can participate in the communication service. For example, when nine users B other than user A are participating in the communication service, together with the user output image 812a of user A, the respective user output images 812b1, 812b2, 812b3, ··· 812b9 of the nine users B are included in the communication screen 810.

[0164] The character object 811a is an animation (moving image) of the character object of User A generated by the display processing unit 274 based on the motion data of User A generated by the generation unit 271 and the character object and the used object associated with the user ID of User A in the user table T1. Note that the motion data of User A generated by the generation unit 271 is the same as the motion data included in the output information transmitted to the terminal device 2 of User B. The output information of User A includes the voice data of User A together with the motion data of User A. When the face motion data of User A is included in the motion data of User A generated by the generation unit 271, a user output image 812a including the character object 811a whose expression changes in synchronization with the movement of the expression of User A is displayed. For example, when User A is speaking, a user output image 812a including the character object 811a with moving lips is displayed. Also, when the body motion data of User A is included in the motion data of User A generated by the generation unit 271, a user output image 812a including the character object 811a in which the corresponding part moves in synchronization with the movement of the body of User A is displayed.

[0165] The transmission unit 272 of the terminal device 2 of user A transmits the output information of user A to the server device 3 via the terminal communication I / F 21, together with the destination information (user IDs of each user B (user B1 to user B3) included in the communication group). Next, the server reception unit 331 of the server device 3 receives the output information of user A transmitted from the terminal device 2 of user A via the server communication I / F 31. Next, the server transmission unit 332 of the server device 3 refers to the user IDs of the received users B (user B1 to user B3), and transmits the output information of user A to the terminal devices 2 of users B (user B1 to user B3) via the server communication I / F 31. When the reception unit 273 of the terminal device 2 of user B receives the output information via the terminal communication I / F 21, the display processing unit 274 of the terminal device 2 of user B displays a user output image 812a including a character object 811a based on the motion data of user A indicated by the user ID included in the output information.

[0166] The character object 811b is an animation (moving image) of the character object of User B generated by the display processing unit 274 based on the motion data included in the output information of User B received by the reception unit 273 and the character object associated with the user ID of User B in the user table T1. When the motion data of User B received by the reception unit 273 includes the face motion data of User B, a user output image 812b including the character object 811b whose expression changes in synchronization with the movement of the expression of User B is displayed. For example, when User B makes a sound, a user output image 812b including the character object 811b with moving lips is displayed. Also, when the motion data of User B generated by the generation unit 271 includes the body motion data of User B, a user output image 812b including the character object 811b in which the corresponding part moves in synchronization with the movement of the body of User B is displayed. When the output information of User B received by the reception unit 273 includes the voice data of User B, the user output image 812b is displayed by the display processing unit 274, and the voice of User B generated based on the voice data is output as voice by the voice output unit 275.

[0167] In this way, by displaying the communication screen 810 including the user output image 812a and the user output image 812b, User A can listen to the voice of User B while seeing the character object 811b of User B as if making a sound. Also, the character object and voice data of User A are output by the terminal device 2 of User B. Thereby, User A and User B participating in the communication service can communicate via the character object.

[0168] The communication screen 810 includes a selection event button 813 and a change button 814. In the example shown in FIG. 8(b), the selection event button 813 and the change button 814 are arranged within the display area of the user output image 812a, but may be displayed outside the display area of the user output image 812a. Also, the selection event button 813 and the change button 814 may be display-controlled by the display processing unit 274 so as to be displayed for a predetermined time when a predetermined display condition is satisfied. The predetermined display condition is, for example, that a predetermined time has elapsed since the start of the communication service related to the communication screen 810. Also, the predetermined display condition may be that the number of users participating in the communication service related to the communication screen 810 exceeds a predetermined number (for example, two people). Also, the predetermined display condition may be that a specific user has participated in the communication service related to the communication screen 810. The specific user is, for example, a user whose specific parameter value is equal to or greater than a predetermined value. When the specific parameter value that the user has is the number of followers of the user, the specific user is a user with a predetermined number (for example, 30 people) or more. Also, when the specific parameter value that the user has is the number of times the selection event performed by the user, the specific user is a user whose number of times the selection event performed by the user is equal to or greater than a predetermined number of times. Also, when the specific parameter value that the user has is the number of times the user has participated in the communication service, the specific user is a user whose number of times the user has participated in the communication service is equal to or greater than a predetermined number of times. Also, when the specific parameter value that the user has is the total time the user has used the communication service in which the user has participated, the specific user is a user whose total time the user has used the communication service in which the user has participated is equal to or greater than a predetermined time. Also, when the specific parameter value that the user has is a parameter value such as the level related to the communication service, the specific user is a user whose parameter value such as the level related to the communication service is equal to or greater than a predetermined value. The level related to the communication service increases as the user participates in the communication service.Also, when the specific parameter value that the user has is a parameter value such as the level related to the distribution event, the specific user is a user whose parameter value such as the level related to the distribution event is equal to or greater than a predetermined value. The level related to the distribution event increases each time the user becomes a distribution user and distributes a distribution image. The level related to the distribution event may also increase each time the user becomes a viewing user and views the distribution image. Also, the predetermined display condition may be satisfied by satisfying two or more of the above-described conditions.

[0169] The selection event button 813 is an object image such as a button object for instructing the display of a selection screen 900 for selecting a selection event. When the selection event button 813 is selected by the operation of the input device 24 by user A, the selection screen 900 is displayed. Details of the selection screen 900 will be described later.

[0170] The change button 814 is an object image such as a button object for attaching a new attachment object to the character object 811a. When an attachment object of the same type or the same attachment location as the new attachment object is already attached to the character object 811a, the already attached attachment object is changed to the new attachment object. When the change button 814 is selected by the operation of the input device 24 by user A, the communication screen 1100 (FIG. 11(b)) is displayed. Note that the display of the communication screen 1100 may be executed when the character object 811a or the user output image 812a is selected by the operation of the input device 24 by user A. Details of the communication screen 1100 will be described later.

[0171] FIG. 9(a) is a diagram showing an example of a selection screen 900 displayed on the display device 23 of the terminal device 2. The selection screen 900 includes event start buttons 901 corresponding to a plurality of types of selection events. A selection event is an event in which at least one specific object is selected from an object group constituting a plurality of specific objects according to a user's instruction and presented to the user according to a predetermined selection method. A selection event corresponding to the event start button 901 selected by user A is provided to user A. The event start button 901 is associated with a selection event ID of the corresponding selection event.

[0172] The object groups used in each of the plurality of types of selection events are different from each other. For example, the plurality of specific objects constituting the object group used in a certain selection event are not included in the object group used in other selection events. Note that some of the specific objects constituting the object group used in a certain selection event may be included in the object group used in other selection events. Also, the plurality of specific objects constituting the object group used in a certain selection event and the plurality of specific objects constituting the object group used in other selection events may be the same. The number of specific objects selected in a certain selection event may be different from the number of specific objects selected in other selection events.

[0173] In the example shown in FIG. 9(a), four event start buttons 901a to 901d corresponding to four types of selection events are included in the selection screen 900. The number of event start buttons 901 displayed on the selection screen 900 is not limited to four. When the display processing unit 274 of the terminal device 2 cannot include all types of event start buttons 901 within the selection screen 900, the event start buttons 901 may be displayed in a scrollable manner. In this case, in response to a swipe operation by User A (for example, an operation in which a finger moves from the bottom to the top of the screen while touching the screen), event start buttons 901 that are not currently displayed on the selection screen 900 are scrolled and displayed within the selection screen 900.

[0174] When any one of the plurality of event start buttons 901 is selected by an operation of the input device 24 by User A, the input device 24 inputs a display instruction for the selection instruction screen to the terminal processing device 27. The input device 24 inputs the selection event ID associated with the selected event start button 901 to the terminal processing device 27 together with the display of the selection instruction screen. When any one of the event start buttons 901 is selected by an operation of the input device 24 by User A, the display of the selection screen 900 ends, and the communication screen 910 and the selection instruction screen 911 are displayed.

[0175] During the period when the selection screen 900 is being displayed, the transmission unit 272 of the terminal device 2 of user A may include, in the output information transmitted to the terminal devices 2 of user B (users B1 to B3) via the server device 3, information for displaying the selection screen 900. The information for displaying the selection screen 900 may be video information for displaying a moving image of the selection screen 900 being displayed on the display device 23 of the terminal device 2 of user A. The information for displaying the selection screen 900 may also be image information for displaying a still image of the selection screen 900 being displayed on the display device 23 of the terminal device 2 of user A. In this case, the output information may not include character video data including the motion data of user A. As a result, when the terminal device 2 of user B (users B1 to B3) receives the output information of user A via the server device 3, it becomes possible to display the selection screen 900 corresponding to the operation of user A, and user B can visually recognize the operation status of user A with respect to the selection screen 900. The information for displaying the selection screen 900 may also be an object ID for identifying the event start buttons 901a to 901d. In this case, when the terminal device 2 of user B (users B1 to B3) receives the output information of user A via the server device 3, it may extract the drawing data of the event start buttons 901a to 901d corresponding to the object ID included in the output information from the terminal storage device 22 and draw the selection screen 900.

[0176] FIG. 9(b) is a diagram showing an example of a communication screen 910 and a selection instruction screen 911 displayed on the display device 23 of the terminal device 2. As shown in FIG. 9(b), the selection instruction screen 911 is displayed superimposed on the communication screen 910. The selection instruction screen 911 may be displayed on the entire screen of the display device 23. In this case, the communication screen 910 is not displayed.

[0177] On the communication screen 910, a user output image 812a including the character object 811a of user A is enlarged and displayed. Also, a user output image 913 including the character objects 811b1, 811b2, and 811b3 of user B1, user B2, and user B3, respectively, is displayed superimposed on the user output image 812a. When the communication screen 910 is displayed, the voice data of user B1, user B2, and user B3, respectively, is output. Note that in the communication screen 910, the user output image 913 may not be displayed. Even in this case, the voice data of user B1, user B2, and user B3, respectively, may be output.

[0178] The selection instruction screen 911 includes information about the selection event indicated by the selection event ID associated with the event start button 901 selected on the selection screen 900 (for example, the name of the selection event, etc.) and the selection instruction button 912. The selection instruction screen 911 shown in FIG. 9(b) includes two types of selection instruction buttons 912a and 912b. When the selection instruction button 912a is selected by user A, the number of selected object IDs of the specific object selected in the selection event is "1". When the selection instruction button 912b is selected by user A, the number of selected object IDs of the specific object selected in the selection event is "10". Note that the number of selection instruction buttons 912 included in the selection instruction screen 911 may be one or three or more. Also, the number of selected object IDs of the specific object selected in the selection event corresponding to the selection instruction button 912 is not limited to "1" and "10", and may be any number.

[0179] While the communication screen 910 and the selection instruction screen 911 are being displayed on the terminal device 2 of User A, the transmission unit 272 of the terminal device 2 of User A may include, in the output information transmitted to the terminal devices 2 of User B (Users B1 to B3) via the server device 3, information for displaying the selection instruction screen 911. The information for displaying the selection instruction screen 911 is video information for displaying a moving image of the selection instruction screen 911 displayed on the display device 23 of the terminal device 2 of User A. The information for displaying the selection instruction screen 911 may also be image information for displaying a still image of the selection instruction screen 911 displayed on the display device 23 of the terminal device 2 of User A. Thereby, when the terminal device 2 of User B (Users B1 to B3) receives the output information of User A via the server device 3, it becomes possible to display the communication screen 910 and the selection instruction screen 911 according to the operation of User A, and User B can visually recognize the operation status of User A with respect to the selection instruction screen 911. The information for displaying the selection instruction screen 911 may also be a selection event ID associated with the event start button 901 selected by User A and an object ID for identifying the two types of selection instruction buttons 912a and 912b. In this case, when the terminal device 2 of User B (Users B1 to B3) receives the output information of User A via the server device 3, information regarding the selection event corresponding to the selection event ID included in the output information (for example, the name of the selection event, etc.) and the drawing data of the selection instruction buttons 912a and 912b corresponding to the object ID included in the output information are extracted from the terminal storage device 22, and the selection instruction screen 911 may be drawn. Note that, while the selection result screens 1000 and 1010 are being displayed on the terminal device 2 of User A, the information for displaying the selection result screens 1000 and 1010 may be transmitted to the terminal devices 2 of User B (Users B1 to B3) via the server device 3. Thereby, the selection result screens 1000 and 1010 are displayed on the terminal device 2 of User B (Users B1 to B3).

[0180] Hereinafter, the two types of selection instruction buttons 912a and 912b included in the selection instruction screen 911 displayed on the terminal device 2 of User A are collectively referred to as the selection instruction button 912, and the functions common to both will be described. First, when the selection instruction button 912 is selected by the operation of the input device 24 by User A, the input device 24 inputs the selection instruction together with the selection event ID input together with the display instruction of the selection instruction screen to the terminal processing device 27. The transmission unit 272 of the terminal device 2 of User A transmits the information indicating the input selection instruction and the selection event ID to the server device 3 via the terminal communication I / F 21 together with the user ID of User A and the destination information. In the example shown in FIG. 9(b), when the selection instruction button 912a or the selection instruction button 912b is selected, the information indicating the number of selections corresponding to the selected selection instruction button 912 is transmitted together with the information indicating the selection instruction.

[0181] The server receiving unit 331 of the server device 3 receives the information indicating the selection instruction, the selection event ID, the user ID of User A, and the destination information via the server communication I / F 31. The server receiving unit 331 inputs the received information indicating the selection instruction and the selection event ID to the selection unit 333. When the information indicating the number of selections is transmitted together with the information indicating the selection instruction, the server receiving unit 331 receives the information indicating the number of selections together with the information indicating the selection instruction, and inputs the received information indicating the number of selections to the selection unit 333.

[0182] The selection unit 333 of the server device 3 extracts the object group ID associated with the input selection event ID from among the plurality of object group IDs stored in the server storage device 32. Next, the selection unit 333 selects the object ID of at least one specific object according to a predetermined selection method from among the object IDs of the plurality of specific objects associated with the extracted object group ID. Note that when information indicating the number of selections is input, the selection unit 333 selects the object IDs of the specific objects by the number of selections from among the object IDs of the plurality of specific objects associated with the extracted object ID. For example, when information indicating the selection number "1" is input, the selection unit 333 selects the object ID of one specific object from among the object IDs of the plurality of specific objects associated with the extracted object ID. Also, for example, when information indicating the selection number "10" is input, the selection unit 333 selects the object IDs of 10 specific objects from among the object IDs of the plurality of specific objects associated with the extracted object ID. Then, the selection unit 333 inputs the object ID of the selected specific object to the server transmission unit 332 as information indicating the selection result.

[0183] The server transmission unit 332 of the server device 3 acquires information indicating the selection result from the selection unit 333. Also, the server transmission unit 332 acquires the user ID of user A and the destination information received together with the information indicating the selection instruction from the server reception unit 331. Next, the server transmission unit 332 transmits the information indicating the selection result and the user ID of user A to the terminal device 2 of user A and the terminal devices 2 of users B1 to B3 indicated by the user ID included in the destination information via the server communication I / F 31.

[0184] The receiving unit 237 of the terminal device 2 of User A receives the information indicating the selection result and the user ID of User A transmitted from the server device 3 via the terminal communication I / F 21. The receiving unit 237 of the terminal device 2 of User A stores the object ID of the specific object received as the information indicating the selection result in the user table T1 in association with the user ID of User A as the object owned by User A.

[0185] Also, the display processing unit 274 of the terminal device 2 of User A extracts the image information and / or name associated with the object ID of the specific object received as the information indicating the selection result by referring to the object table T2. The display processing unit 274 of the terminal device 2 of User A displays the selection result screen 1000 or the selection result screen 1010 on the display device 23 based on the read image information and / or name.

[0186] FIG. 10(a) is a diagram showing an example of the selection result screen 1000 displayed on the display device 23 of the terminal device 2 of User A, and FIG. 10(b) is a diagram showing an example of the selection result screen 1010 displayed on the display device 23 of the terminal device 2 of User A. The selection result screen 1000 is displayed when the object ID of one specific object is received as the information indicating the selection result, and the selection result screen 1010 is displayed when the object IDs of a plurality of specific objects are received as the information indicating the selection result.

[0187] On the selection result screen 1000 shown in FIG. 10(a), information 1001 indicating one specific object, a use button 1002, and a cancel button 1003 are included. The information 1001 indicating one specific object is image information and / or a name associated with the object ID of one specific object received as information indicating the selection result. The use button 1002 is an object image such as a button object for instructing the use of one specific object that is the selection result. When the use button 1002 is selected by the operation of the input device 24 by user A, the above-described use process is executed. The cancel button 1003 is an object image such as a button object for ending the display of the selection result screen 1000 and redisplaying the communication screen 810 (FIG. 8(b)).

[0188] When the use button 1002 is selected by the operation of the input device 24 by user A, the display processing unit 274 of the terminal device 2 of user A displays the communication screen 1100 on the display device 23. FIG. 11(a) is a diagram showing an example of the communication screen 1100 displayed on the display device 23 of the user's terminal device 2. Similar to the communication screen 810, the communication screen 1100 includes a user output image 812a including the character object 811a of user A, and user output images 812b1, 812b2, 812b3 including the respective character objects 811b1, 811b2, 811b3 of user B1, user B2, and user B3. Also, similar to the communication screen 810, the communication screen 1100 includes a selection event button 813 and a change button 814.

[0189] When the use button 1002 is selected by the operation of the input device 24 by user A, the above-described use process based on the object ID of one specific object received as information indicating the selection result is executed. By executing the use process, a user output image 812a including the character object 811a of user A changed by the image information associated with the object ID of one specific object received as information indicating the selection result is displayed. In the example shown in FIG. 11(a), the character object 811a is changed to a character object 811a with the wearing object "hat" 1101 worn on the head, and the user output image 812a including the changed character object 811a is displayed.

[0190] The selection result screen 1010 shown in FIG. 10(b) includes information 1011 indicating a plurality of specific objects, a selected object 1012, a use button 1013a, a use button 1013b, and a cancel button 1014. The information 1011 indicating a plurality of specific objects is image information and / or a name associated with each of the object IDs of the plurality of specific objects received as information indicating the selection result.

[0191] The selection object 1012 is an operation object for selecting the object IDs of a plurality of specific objects. In the example shown in FIG. 10(b), the display processing unit 274 of the user's terminal device 2 displays a checkbox object corresponding to the information indicating each specific object as the selection object 1012. For example, when the selection object 1012 is selected by an operation of the user's input device 24, the selection object 1012 is displayed with a "check" mark. In this case, the object ID of the specific object corresponding to the selection object 1012 with the "check" mark is in a selected state. Also, when the selection object 1012 with the "check" mark is selected by an operation of the user's input device 24, the selection object 1012 is displayed without the "check" mark. In this case, the object ID of the specific object corresponding to the selection object 1012 without the "check" mark is in a non-selected state. Each of the selection objects 1012 is associated with the object ID of the corresponding specific object.

[0192] The use button 1013a and the use button 1013b are object images such as button objects for instructing the use of a specific object that is the selection result. When the use button 1013a is selected by the operation of the input device 24 by User A, use processing based on the object ID of the specific object selected by the operation on the selection object 1012 of User A is executed. By executing the use processing, the character object 811a is changed based on the image information associated with each of the object IDs of the plurality of specific objects received as information indicating the selection result and selected by User A. Then, on the communication screen 1100, a user output image 812a including the changed character object 811a is displayed. When the use button 1013b is selected by the operation of the input device 24 by User A, use processing based on the object IDs of all the specific objects received as information indicating the selection result is executed. By executing the use processing, the character object 811a is changed based on the image information associated with each of the object IDs of all the specific objects received as information indicating the selection result. Then, on the communication screen 1100, a user output image 812a including the changed character object 811a is displayed. The cancel button 1014 is an object image such as a button object for ending the display of the selection result screen 1010 and redisplaying the communication screen 810 (Fig. 8(b)).

[0193] The use instruction for executing the use processing is not limited to being input according to the user's operation on the selection result screens 1000 and 1010. For example, the use instruction may be input according to the user's operation on a selection screen 1110 for selecting an object to be used from among the objects held by the user.

[0194] FIG. 11(b) is a diagram showing an example of a selection screen 1110 displayed on the display device 23 of the terminal device 2. The selection screen 1110 shown in FIG. 11(b) is displayed superimposed on the communication screen 910. The selection screen 1110 may be displayed after the display of the communication screen 910 is terminated.

[0195] The selection screen 1110 includes a plurality of type objects 1111 indicating the types of wearable objects and a plurality of wearable candidate objects 1112 indicating the wearable objects. When any one of the plurality of type objects 1111 is selected by an operation of the input device 24 by user A, the type of the wearable object corresponding to the selected type object 1111 is specified. When the type of the wearable object is specified, wearable candidate objects 1112 indicating the specified type of wearable object among the objects owned by user A are displayed on the selection screen 1110. Here, when the terminal device 2 of user A receives information indicating the selection result, the object ID of the specific object received as the information indicating the selection result is stored in the user table T1 in association with the user ID of user A as an object owned by user A. Therefore, the wearable candidate objects 1112 include wearable candidate objects 1112 indicating the specific object selected by the selection event.

[0196] When a wearable candidate object 1112 corresponding to the object ID of the specific object selected by the selection event is selected from among the plurality of wearable candidate objects 1112 by an operation of the input device 24 by user A, the input device 24 inputs a use instruction to the terminal processing device 27, and the above-described use processing based on the object ID of the selected specific object is executed. As a result, the display processing unit 274 displays a communication screen 1100 including a user output image 812a including a character object 811a wearing the specific object selected by the selection event.

[0197] Information indicating the selection result of a selection event in response to a selection instruction by User A is transmitted to the terminal device 2 of User A and also to each of the terminal devices 2 of User B (Users B1 to B3). The character object 811b of User B may be changed based on the information indicating the selection result of the selection event in response to the selection instruction by User A. Hereinafter, various processes related to the change of the character object 811b1 of User B1 executed in the terminal device 2 of User B1 will be described. The various processes executed in the terminal device 2 of User B1 are similarly executed in the terminal devices 2 of User B2 and User B3.

[0198] The receiving unit 237 of the terminal device 2 of User B1 receives, via the terminal communication I / F 21, the information indicating the selection result of the selection event in response to the selection instruction by User A and the user ID of User A transmitted from the server device 3. The receiving unit 237 of the terminal device 2 of User B1 stores the object ID of the specific object received as the information indicating the selection result in the terminal storage device 22 until the communication service in which User B1 is currently participating ends. Note that the object ID of the specific object is not stored as an object owned by User B1. Thereby, User B1 can temporarily use the selection result of the selection event in response to the selection instruction by User A.

[0199] Next, the display processing unit 274 of the terminal device 2 of User B1 extracts the image information and / or name associated with the object ID of the specific object received as the information indicating the selection result of the selection event in response to the selection instruction by User A, by referring to the object table T2. The display processing unit 274 of the terminal device 2 of User B1 displays the selection result screen 1200 or the selection result screen 1210 on the display device 23 based on the read image information and / or name.

[0200] FIG. 12(a) is a diagram showing an example of a selection result screen 1200 displayed on the display device 23 of the terminal device 2 of user B1, and FIG. 12(b) is a diagram showing an example of a selection result screen 1210 displayed on the display device 23 of the terminal device 2 of user B1. The selection result screen 1200 is displayed when the object ID of one specific object is received as information indicating the selection result of a selection event in response to a selection instruction by user A. Further, the selection result screen 1210 is displayed when the object IDs of a plurality of specific objects are received as information indicating the selection result of a selection event in response to a selection instruction by user A.

[0201] The selection result screen 1200 shown in FIG. 12(a) includes information 1201 indicating one specific object, a provisional use button 1202, and a cancel button 1203. The information 1201 indicating one specific object is image information and / or a name associated with the object ID of one specific object received as information indicating the selection result of a selection event in response to a selection instruction by user A. The provisional use button 1202 is an object image such as a button object for instructing the provisional use of one specific object that is the selection result of a selection event in response to a selection instruction by user A. The provisional use of a specific object means using a specific object that is not stored as an object held by user B1 until a predetermined end condition is satisfied.

[0202] The predetermined end condition is, for example, that User A performs an operation to instruct the end of trial use and obtains an instruction to end the trial use in response to the operation. Also, the predetermined end condition may be to end User A's participation in the communication service according to User A's instruction. For example, by ending User A's participation in the communication service, the transmission of User A's output information and the reception of the respective output information of Users B1 to B3 are ended, and a predetermined condition is satisfied. Also, the predetermined end condition may be to end the participation of any one of Users B1 to B3 in the communication service according to the instruction of any one of Users B1 to B3. For example, by ending User B1's participation in the communication service, the transmission of User B1's output information and the reception of the respective output information of Users A, B2, and B3 are ended, and a predetermined condition is satisfied. Also, the predetermined end condition may be to forcibly end the participation of any one of Users B1 to B3 in the communication service according to User A's instruction. Also, the predetermined end condition may be to forcibly end User A's participation in the communication service according to the instruction of any one of Users B1 to B3.

[0203] The predetermined end condition may be that a predetermined time has elapsed since the trial use of one specific object. Also, the predetermined end condition may be that a selection event has been started by User A during the trial use of one specific object. Also, the predetermined end condition may be that a selection event has been started by any one of Users B1 to B3 during the trial use of one specific object.

[0204] When the trial use button 1202 is selected by the operation of the input device 24 by User B1, the same processing as the above-described use processing is executed. The cancel button 1203 is an object image such as a button object for ending the display of the selection result screen 1200 and redisplaying the communication screen 810.

[0205] Note that the trial use button 1202 may be controlled so that the selection of the trial use button 1202 is permitted only when predetermined usage conditions are satisfied. The predetermined usage conditions may be, for example, that the number of times the use process of a specific object (the number of times of trial use) is executed in response to the selection of the trial use button 1213a by the operation of the user (in the example shown in FIG. 12(a), user B1) of the terminal device displaying the selection result screen 1200 is equal to or less than a predetermined number of times. The predetermined usage conditions may be that a predetermined time (for example, 10 minutes) has elapsed since the start of the communication service in which the user (in the example shown in FIG. 12(a), user B1) of the terminal device displaying the selection result screen 1200 participates. The predetermined usage conditions may be a period until a predetermined time (for example, 10 minutes) has elapsed since the start of the communication service in which the user (in the example shown in FIG. 12(a), user B1) of the terminal device displaying the selection result screen 1200 participates. The predetermined trial conditions may be a period until a re-selection event is started by user A.

[0206] For example, when the trial use button 1202 is selected by the operation of the input device 24 by user B1, the display processing unit 274 of the terminal device 2 of user B1 displays the communication screen 1100 on the display device 23. The communication screen 1100 includes, similar to the communication screen 810, a user output image 812a including the character object 811a of user A, and user output images 812b1, 812b2, 812b3 including the respective character objects 811b1, 811b2, 811b3 of users B1, B2, and B3. Further, the communication screen 1100 includes a selection event button 813 and a change button 814, similar to the communication screen 810.

[0207] When the temporary use button 1202 is selected by operating the input device 24 by user B1, the above-described use process is executed based on the object ID of one specific object received as information indicating the selection result of the selection event corresponding to the selection instruction by user A. By executing the use process, a user output image 812b1 including the character object 811b1 of user B1 changed by the image information associated with the object ID of one specific object received as information indicating the selection result corresponding to the selection instruction by user A is displayed.

[0208] The selection result screen 1210 shown in FIG. 12(b) includes information 1211 indicating a plurality of specific objects, a selection object 1212, a temporary use button 1213a, a temporary use button 1213b, and a cancel button 1214. The information 1211 indicating a plurality of specific objects is image information and / or names associated with the respective object IDs of a plurality of specific objects received as information indicating the selection result of the selection event corresponding to the selection instruction by user A.

[0209] The selection object 1212 is an operation object for selecting the object IDs of a plurality of specific objects. In the example shown in FIG. 12(b), the display processing unit 274 of the user's terminal device 2 displays a checkbox object corresponding to the information indicating each specific object as the selection object 1212. For example, when the selection object 1212 is selected by an operation of the user's input device 24, the selection object 1212 is displayed with a "check" mark. In this case, the object ID of the specific object corresponding to the selection object 1212 with the "check" mark is in a selected state. Also, when the selection object 1212 with the "check" mark is selected by an operation of the user's input device 24, the selection object 1212 is displayed without the "check" mark. In this case, the object ID of the specific object corresponding to the selection object 1212 without the "check" mark is in a non-selected state. Each of the selection objects 1212 is associated with the object ID of the corresponding specific object.

[0210] The temporary use button 1213a and the temporary use button 1213b are object images such as button objects for instructing the temporary use of a specific object that is the selection result of a selection event in response to a selection instruction by user A. When the temporary use button 1213a is selected by an operation of the input device 24 by user B1, a use process based on the object ID of the specific object that is the result information of the selection event in response to the selection instruction by user A is executed. By executing the use process in response to the selection of the temporary use button 1213a, the character object 811b1 is changed based on the image information associated with each of the object IDs selected by user B1 among the object IDs of the plurality of specific objects received as information indicating the selection result by user A. Then, on the communication screen 1100, a user output image 812b1 including the changed character object 811b1 is displayed.

[0211] When the temporary use button 1213b is selected by operating the input device 24 by User A, usage processing based on the object IDs of all specific objects received as information indicating the selection result of the selection event corresponding to the selection instruction by User A is executed. By executing the usage processing in response to the selection of the temporary use button 1213b, the character object 811b1 is changed based on the image information associated with each of the object IDs of all specific objects received as information indicating the selection result of the selection event corresponding to the selection instruction by User A. Then, on the communication screen 1100, a user output image 812b1 including the changed character object 811b1 is displayed. The cancel button 1214 is an object image such as a button object for ending the display of the selection result screen 1210 and redisplaying the communication screen 810 (FIG. 8(b)).

[0212] In the terminal device 2 of User B (Users B1 to B3), when information indicating the selection result of the selection event corresponding to the selection instruction by User A is received, the same selection event as the selection event corresponding to the selection instruction by User A may be provided to User B (Users B1 to B3). Hereinafter, various processes related to the provision of the same selection event, which are executed in the terminal device 2 of User B1, will be described. The various processes executed in the terminal device 2 of User B1 are similarly executed in the terminal devices 2 of User B2 and User B3.

[0213] When object IDs of a plurality of specific objects are received as information indicating a selection result of a selection event in response to a selection instruction by User A, instead of displaying the selection result screen 1210, a plurality of selection result screens 1200 may be sequentially displayed. The first displayed selection result screen 1200 includes information 1201 indicating one specific object among the plurality of specific objects, a provisional use button 1202, and a cancel button 1203. When the provisional use button 1202 is selected by an operation of the input device 24 by User B1, the same process as the above-described use process is executed, and a selection result screen 1200 related to the next specific object among the plurality of specific objects is displayed. The cancel button 1203 is an object image such as a button object for ending the display of the selection result screen 1200 and displaying a selection result screen 1200 related to the next specific object among the plurality of specific objects. When selection result screens 1200 related to all of the plurality of specific objects are displayed, if the provisional use button 1202 of the last displayed selection result screen 1200 is selected, the same process as the use process is executed, and a selection result screen 1300 is displayed. Also, when selection result screens 1200 related to all of the plurality of specific objects are displayed, if the cancel button 1203 of the last displayed selection result screen 1200 is selected, a selection result screen 1300 is displayed.

[0214] FIG. 13(a) is a diagram showing an example of a selection result screen 1300 displayed on the display device 23 of the terminal device 2 of User B1, and FIG. 13(b) is a diagram showing an example of a selection result screen 1310 displayed on the display device 23 of the terminal device 2 of User B1. The selection result screen 1300 is displayed when an object ID of one specific object is received as information indicating a selection result of a selection event in response to a selection instruction by User A. Also, the selection result screen 1310 is displayed when object IDs of a plurality of specific objects are received as information indicating a selection result of a selection event in response to a selection instruction by User A.

[0215] The selection result screen 1300 is a screen obtained by further adding two types of selection instruction buttons 1301a and 1301b to the selection result screen 1200 (Fig. 12(a)). Also, the selection result screen 1310 is a screen obtained by further adding two types of selection instruction buttons 1301a and 1301b to the selection result screen 1210 (Fig. 12(b)). The two types of selection instruction buttons 1301a and 1301b have the same functions as the two types of selection instruction buttons 912a and 912b on the selection instruction screen 911 (Fig. 9(b)). Note that the terminal device 2 or the server device 3 may control such that the selection of the selection instruction buttons 912a and 912b becomes possible when a predetermined object (e.g., "ticket object") owned by the user is consumed or when the user pays a consideration.

[0216] For example, when the selection instruction button 1301a is selected by the operation of the input device 24 by user B1, the terminal device 2 of user B1 transmits information indicating the selection instruction, a selection event ID (the selection event ID of the selection event corresponding to the selection instruction by user A), the user ID of user B1, and destination information (the user IDs of user A, user B2, and user B3 respectively) to the server device 3. In the server device 3, one object ID of a specific object is selected from among the object IDs of a plurality of specific objects associated with the received selection event ID according to a predetermined selection method, and the selected object ID of the specific object is transmitted as information indicating the selection result to the terminal device 2 of the user indicated by the user ID included in the terminal device 2 of user B1 and the destination information.

[0217] When the selection instruction button 1301b is selected by the operation of the input device 24 by user B1, the terminal device 2 of user B1 transmits information indicating the selection instruction, the selection event ID (the selection event ID of the selection event corresponding to the selection instruction by user A), the user ID of user B1, and the destination information (the user IDs of user A, user B2, and user B3) to the server device 3. In the server device 3, 10 object IDs of specific objects are selected from among the object IDs of a plurality of specific objects associated with the received selection event ID according to a predetermined selection method, and the selected object IDs of the specific objects are transmitted as information indicating the selection result to the terminal device 2 of user B1 and the terminal devices 2 of the users indicated by the user IDs included in the destination information.

[0218] In this way, when a selection event is carried out in response to a selection instruction by one of a plurality of users belonging to a communication group that participates in a communication service and communicates with each other, other users belonging to the communication group can also carry out the same selection event as the selection event carried out by the user. Also, when another user desires to carry out the selection event that has been carried out earlier by himself / herself, there has been a problem that it is impossible to reach the screen for carrying out the desired selection event without performing a plurality of operations such as searching for the desired selection event from among a plurality of selection events. With the information system 1 of the present embodiment, it is possible to reach the screen for carrying out the selection event desired by the user with a simple user operation, and a significant improvement in usability is possible.

[0219] In FIGS. 13(a) and (b), at the timing when information indicating the selection result of a selection event in response to a selection instruction by another user is received, a selection result screen for providing the user with the same selection event as the selection event performed by the other user is displayed. During the display period of the character object of the other user in which a specific object corresponding to the selection result of the selection event in response to the selection instruction by the other user is used, an event providing button for the user to execute the same selection event as the selection event performed by the other user may be displayed.

[0220] FIG. 14(a) is a diagram showing an example of a communication screen 1400 displayed on the display device 23 of the terminal device 2 of user A. The character object 811b1 of user B1 in the user output image 812b1 included in the communication screen 1400 is changed based on a specific object corresponding to the selection result of a selection event in response to a selection instruction by user B1. During the period in which the user output image 812b1 including the changed character object 811b1 is displayed, an event providing button 1402 is displayed within the display area of the user output image 812a of user A.

[0221] When the event providing button 1402 is selected by the operation of the input device 24 by user A, a selection instruction screen 911 (Fig. 14(b)) is displayed. Note that the selection instruction screen 911 shown in Fig. 14(b) has the same function as the selection instruction screen 911 shown in Fig. 9(b). When the selection instruction buttons 912 (selection instruction buttons 912a and 912b) included in the selection instruction screen 911 shown in Fig. 14(b) are selected, selection processing of the same selection event as the selection event corresponding to the selection instruction by user B1 is executed. Note that when two or more of users B1 to B3 have previously performed a selection event, each character object 811b of the two or more users is changed based on a specific object corresponding to the selection result of the selection event. Before and after the event providing button 1402 is selected, user A selects any one of the user output images 812b (or a predetermined button within the user output image 812b) in which the character object 811b has been changed. Thereby, the selection instruction screen 911 (Fig. 14(b)) related to the selection event previously performed by user B corresponding to the selected user output image 812b is displayed. Note that in this case, when the event providing button 1402 is selected by user A, a screen for selecting any one of two or more users B who have previously performed a selection event may be displayed. When user A operates this screen, the selection instruction screen 911 (Fig. 14(b)) related to the selection event previously performed by the selected user B is displayed. Note that during the period in which the user output image 812b1 including the changed character object 811b1 is displayed, the event providing button 1402 may not be displayed within the display area of the user output image 812a of user A. In this case, when the character object 811b1 or the user output image 812b1 is selected by the operation of the input device 24 by user A, the selection instruction screen 911 (Fig. 14(b)) is displayed.

[0222] As described above, when a selection event is performed in response to a selection instruction by one user among a plurality of users belonging to a communication group that participates in a communication service and communicates with each other, during a period in which the character object or user output image of one user is changed based on a specific object selected by the selection event, other users belonging to the communication group can also perform the same selection event as the selection event performed by the user.

[0223] The event providing button 1402 operable by user A shown in FIG. 14(a) may be displayed during a period in which the character object of user A temporarily uses a specific object received as information indicating the selection result of a selection event in response to a selection instruction by any one of users B1 to B3.

[0224] FIG. 15(a) is a diagram showing an example of a communication screen 1500 displayed on the display device 23 of the terminal device 2 of user A. The character object 811b1 of user B1 in the user output image 812b1 included in the communication screen 1500 is changed based on a specific object corresponding to the selection result of a selection event in response to a selection instruction by user B1. In this case, during a period in which the character object 811a of user A in the user output image 812a included in the communication screen 1500 temporarily uses a specific object corresponding to the selection result of a selection event in response to a selection instruction by user B1, the event providing button 1402 may be displayed within the display area of the user output image 812a of user A.

[0225] The event providing button 1402 operable by user A shown in FIG. 15(a) may be displayed when the number of character objects temporarily using a specific object received as information indicating the selection result of a selection event corresponding to a selection instruction by any one of users B1 to B3 is equal to or more than a predetermined number (for example, "2"). When the event providing button 1402 is selected by an operation of the input device 24 by user A, a selection instruction screen 911 is displayed. The displayed selection instruction screen 911 has the same function as the selection instruction screen 911 shown in FIG. 9(b). When a selection instruction button 912 (selection instruction buttons 912a and 912b) included in the selection instruction screen 911 is selected, a selection process of the same selection event as the selection event corresponding to the selection instruction by user B1 is executed.

[0226] FIG. 15(b) is a diagram showing an example of a communication screen 1510 displayed on the display device 23 of the terminal device 2 of user A. The character object 811b1 of user B1 in the user output image 812b1 included in the communication screen 1500 is changed based on a specific object corresponding to the selection result of a selection event corresponding to a selection instruction by user B1. In this case, when two (≥predetermined number) of the character objects 811b2 of user B2 and 811b3 of user B3 in the user output image 812a included in the communication screen 1500 are temporarily using a specific object corresponding to the selection result of a selection event corresponding to a selection instruction by user B1, the event providing button 1402 may be displayed within the display area of the user output image 812a of user A. When the event providing button 1402 is selected by an operation of the input device 24 by user A, a selection instruction screen 911 is displayed. The displayed selection instruction screen 911 has the same function as the selection instruction screen 911 shown in FIG. 9(b). When a selection instruction button 912 (selection instruction buttons 912a and 912b) included in the selection instruction screen 911 is selected, a selection process of the same selection event as the selection event corresponding to the selection instruction by user B1 is executed.

[0227] In a conventional information system, after a user starts communication with another user via a character object, in order to change the output image including the character object, the communication service has to be interrupted. Then, after the communication service is interrupted, it is necessary to activate a function for changing the appearance of the character object and / or an image such as the background in the output image including the character object. And the user has to perform a complicated procedure of participating in the communication service again after changing the character object and / or the output image using the change function. In contrast, the information system 1 of the present embodiment enables display of information related to a selection event without interrupting communication via the character object. Thereby, in the information system 1 of the present embodiment, since the user interface for changing the user's character object during communication does not become complicated, it is possible to improve usability compared to the conventional information system. Also, in the information system 1 of the present embodiment, since the user's character object can be changed without interrupting communication, the number of communication times and the communication volume between the server device 3 and the terminal device 2 can be reduced. Thus, in the information system 1 of the present embodiment, it is possible to improve the communication between the server device 3 and the terminal device 2. Also, when a user wants to try using an object provided by a selection event, the user has no choice but to execute the selection event, and some users may hesitate to execute the selection event. With the information system 1 of the present embodiment, the user can temporarily use an object or the like acquired by another user by a selection event executed by another user with a simple operation. Also, the user can perform the selection event after visually recognizing the usage status of the object acquired by another user in the selection event. Thus, the information system 1 of the present embodiment can realize trial use of the object of the selection event while improving usability compared to the conventional information system.

[0228] (Operation Sequence of Information System 1) FIG. 16 is a diagram showing an example of the operation sequence of Information System 1. This operation sequence is mainly executed by the terminal processing device 27 and the server processing device 33 in cooperation with the respective elements of the terminal device 2 and the server device 3 based on a control program stored in advance in the terminal storage device 22 and the server storage device 32. Hereinafter, it will be described assuming that user A operates the terminal device 2a, user B1 operates the terminal device 2b1, and user B2 operates the terminal device 2b2. Note that the terminal devices of users other than user A are not limited to only the terminal devices 2b1 to 2b2 of users B1 and B2, and the terminal devices 2 of three or more users may be connected to the server device 3.

[0229] First, the transmission unit 272 of the terminal device 2a transmits, via the terminal communication I / F 21, output information including character video data including the motion data of user A generated by the generation unit 271 based on the imaging data continuously output by the imaging device 25, the voice data of user A output from the microphone 26, and the user ID of user A to the server device 3 (step S101). Note that the output information may include game image data indicating the game screen of the game played by the user and the user ID of user A. Further, transmission destination information may be included in the transmission process of the transmission unit 272. Since the process of step S101 is continuously executed at predetermined time intervals (for example, every 2 seconds) until the distribution event ends, the processes related to steps S101 to S110 are executed intermittently.

[0230] Next, the server transmission unit 332 of the server device 3 transmits the output information received from the terminal device 2a to the terminal device 2b1 via the server communication I / F 31 (step S102) and also transmits it to the terminal device 2b2 (step S103).

[0231] Also, the transmission unit 272 of the terminal device 2b1 transmits output information including the character video data of user B1, the voice data of user B1, and the user ID of user B1 to the server device 3 via the terminal communication I / F 21 (step S104). Next, the server transmission unit 332 of the server device 3 transmits the output information received from the terminal device 2b1 to the terminal device 2a via the server communication I / F 31 (step S105) and also transmits it to the terminal device 2b2.

[0232] Also, the transmission unit 272 of the terminal device 2b2 transmits output information including the character video data of user B2, the voice data of user B2, and the user ID of user B2 to the server device 3 via the terminal communication I / F 21 (step S106). Next, the server transmission unit 332 of the server device 3 transmits the output information received from the terminal device 2b2 to the terminal device 2a via the server communication I / F 31 (step S107) and also transmits it to the terminal device 2b1.

[0233] The display processing unit 274 of the terminal device 2a displays and outputs a communication screen including a user output image including the character object of user A, a user output image including the character object of user B1, and a user output image including the character object of user B2 based on the respective output information of user A, user B1, and user B2 on the display device 23 of the terminal device 2a, and outputs the voices of user B1 and user B2 (step S108).

[0234] Similar to step S108, the display processing unit 274 of the terminal device 2b1 displays and outputs a communication screen including a user output image including the character object of user A, a user output image including the character object of user B1, and a user output image including the character object of user B2 based on the respective output information of user A, user B1, and user B2 on the display device 23 of the terminal device 2b1, and outputs the voices of user A and user B2 (step S109).

[0235] Similarly to step S108, the display processing unit 274 of the terminal device 2b2 displays and outputs a communication screen including a user output image including the character object of user A, a user output image including the character object of user B1, and a user output image including the character object of user B2 on the display device 23 of the terminal device 2b2 based on the output information of each of user A, user B1, and user B2, and outputs the voices of user A and user B1 (step S110).

[0236] Next, the transmission unit 272 of the terminal device 2a transmits information indicating a selection instruction, which is input in response to an operation of the input device 24 by user A, to the server device 3 via the terminal communication I / F 21 (step S111).

[0237] Next, the selection unit 333 of the server device 3 executes a selection process based on the information indicating the selection instruction received from the terminal device 2a (step S112), and inputs information indicating the result of the selection process (information indicating the selection result) to the server transmission unit 332.

[0238] Next, the server transmission unit 332 of the server device 3 transmits the information indicating the selection result acquired from the selection unit 333 to the terminal device 2a via the server communication I / F 31 (step S113), transmits it to the terminal device 2b1 (step S114), and transmits it to the terminal device 2b2 (step S115).

[0239] The display processing unit 274 of the terminal device 2a displays and outputs the selection result screens 1200 and 1210 on the display device 23 of the terminal device 2b1 based on the information indicating the selection result transmitted from the server device 3 (step S116). Also, the display processing unit 274 of the terminal device 2b1 displays and outputs the selection result screens 1300 and 1310 on the display device 23 of the terminal device 2b1 based on the information indicating the selection result transmitted from the server device 3 (step S117). Also, the display processing unit 274 of the terminal device 2b2 displays and outputs the selection result screens 1300 and 1310 on the display device 23 of the terminal device 2b1 based on the information indicating the selection result transmitted from the server device 3 (step S118).

[0240] As described in detail above, in the information system 1 of the present embodiment, a user output image including a character object of user A in which at least a part is changed based on a specific object selected from a plurality of specific objects in response to an instruction by user A is displayed. In this way, by diversifying the output from the terminal device 2 in response to an instruction by user A during the communication service by the information system 1 of the present embodiment, it becomes possible to improve the user's willingness to continue using for communication.

[0241] (Modification Example 1) Note that the present invention is not limited to the present embodiment. For example, a privilege may be given to the user or another user according to the selection status of the user with respect to the selection instruction buttons 1301a and 1301b included in the selection result screens 1300 and 1310.

[0242] For example, when any one of users B1 to B3 selects the selection instruction buttons 1301a and 1301b included in the selection result screens 1300 and 1310 related to the information indicating the selection result of the selection event according to the selection instruction by user A, a privilege W is granted to user A. For example, the privilege W is granted to user A by storing information indicating the privilege W associated with the user ID of user A in the terminal storage device 22 of the terminal device 2 of user A and / or the server storage device 32 of the server device 3. The privilege W is, for example, a predetermined object (e.g., a "ticket object") consumed to select the selection instruction buttons 912a and 912b. The privilege W may also be points exchangeable for a predetermined object consumed to select the selection instruction buttons 912a and 912b. When any one of users B1 to B3 selects the selection instruction buttons 1301a and 1301b included in the selection result screens 1300 and 1310 related to the information indicating the selection result of the selection event according to the selection instruction by user A, if a predetermined time condition is satisfied, the privilege W may be granted to user A. The predetermined time condition is, for example, that the time from the selection instruction by user A to the selection of the selection instruction buttons 1301a and 1301b by any one of users B1 to B3 is within a predetermined granting condition period. Also, the predetermined time condition may be that the time from when the selection result screens 1300 and 1310 related to the information indicating the selection result of the selection event according to the selection instruction by user A are displayed to the selection of the selection instruction buttons 1301a and 1301b by any one of users B1 to B3 is within a predetermined granting condition period.

[0243] In addition, when any one of users B1 to B3 selects the selection instruction buttons 1301a and 1301b included in the selection result screens 1300 and 1310 regarding the information indicating the selection result of the selection event according to the selection instruction by user A, a privilege X may be given to the user who selected the selection instruction buttons 1301a and 1301b. Also, when any one of users B1 to B3 selects the selection instruction buttons 1301a and 1301b included in the selection result screens 1300 and 1310 regarding the information indicating the selection result of the selection event according to the selection instruction by user A, a privilege Y may be given to the users who did not select the selection instruction buttons 1301a and 1301b. Further, when none of users B1 to B3 selects the selection instruction buttons 1301a and 1301b included in the selection result screens 1300 and 1310 regarding the information indicating the selection result of the selection event according to the selection instruction by user A within a predetermined time, a privilege Y may be given to users B1 to B3. Also, when any one of users B1 to B3 selects the selection instruction buttons 1301a and 1301b included in the selection result screens 1300 and 1310 regarding the information indicating the selection result of the selection event according to the selection instruction by user A, a privilege Z may be given to all of user A and users B1 to B3. Also, when any one of users B1 to B3 selects the selection instruction buttons 1301a and 1301b included in the selection result screens 1300 and 1310 regarding the information indicating the selection result of the selection event according to the selection instruction by user A, a privilege may be given to all or some of the users among user A and users B1 to B3 to whom a privilege has not been given yet.

[0244] Note that privilege W is a privilege with a higher value than privileges X and Y. Also, privilege X may be a privilege with a higher value than privilege Y. When the privilege is an additional object selected in the selection event, a privilege with a higher value means an additional object with a lower probability of being selected in the selection event. Also, when the privilege is a ticket object, the ticket object that allows the selection instruction button 912 to be selected more times is a privilege with a higher value.

[0245] Also, when user B1 selects the selection instruction buttons 1301a and 1301b included in the selection result screens 1300 and 1310 related to the information indicating the selection result of the selection event according to the selection instruction by user A, and then user B2 selects them, the privilege X given to user B1 may be a privilege with a higher value than the privilege X given by user B2. Thus, the earlier a user selects the selection instruction buttons 1301a and 1301b, the higher the privilege X is given.

[0246] Also, when user B1 selects the selection instruction buttons 1301a and 1301b included in the selection result screens 1300 and 1310 related to the information indicating the selection result of the selection event according to the selection instruction by user A, and then user B2 selects them, the privilege X given to user B1 may be a privilege with a lower value than the privilege X given by user B2. Thus, lured by the selection of the selection instruction buttons 1301a and 1301b by other users, a user who selects the selection instruction buttons 1301a and 1301b is given a higher privilege X than the user who selected earlier.

[0247] (Modification Example 2) Also, when all of user A and users B1 to B3 who belong to the same communication group and participate in the communication service execute the selection process of the same type of selection event during the communication service, one specific object among a plurality of specific objects related to the same type of selection event may be given to user A and users B1 to B3. Also, when user A and users B1 to B3 execute the selection process of the selection event in a predetermined order during the communication service, one specific object among a plurality of specific objects related to a predetermined selection event may be given to user A and users B1 to B3.

[0248] (Modification Example 3) Also, when any one of user A and users B1 to B3, who belong to the same communication group and participate in the communication service, consumes a predetermined object during the communication service and executes the selection process of the selection event by selecting the selection instruction buttons 912a and 912b, until the communication service ends, the other users among user A and users B1 to B3 may be able to execute the selection process of the selection event by selecting the selection instruction buttons 912a and 912b without consuming the predetermined object.

[0249] (Modification Example 4) Also, when any one of user A and users B1 to B3, who belong to the same communication group and participate in the communication service, consumes a predetermined object during the communication service and executes the selection process of the selection event by selecting the selection instruction buttons 912a and 912b, until the communication service ends, the other users among user A and users B1 to B3 may be able to execute the selection process of the selection event by selecting the selection instruction buttons 912a and 912b without consuming the predetermined object.

[0250] (Modification Example 5) Also, for example, when a predetermined time has elapsed after performing a selection event in response to a selection instruction by User A, the display processing unit 274 of the terminal device 2 of User A may display information 1700 prompting the selection of the selection instruction buttons 912a and 912b (Fig. 17(a)). Further, when a predetermined time has elapsed after the character object of User A has used a specific object received as information indicating the selection result of the selection event in response to the selection instruction by User A, the display processing unit 274 of the terminal device 2 of User A may display information 1700 prompting the selection of the selection instruction buttons 912a and 912b. Also, when a predetermined time has elapsed during which the number of character objects temporarily using a specific object received as information indicating the selection result of the selection event in response to the selection instruction by User A is less than a predetermined number (for example, "1"), the display processing unit 274 of the terminal device 2 of User A may display information 1700 prompting the selection of the selection instruction buttons 912a and 912b. The display of the information 1700 prompting the selection of the selection instruction buttons 912a and 912b by the terminal device 2 of User A may be executed when the character object of the user among Users B1 to B3, on which User A has performed a predetermined operation, has used a specific object. For example, in the communication screen, when the size of the user output image of another user can be changed by the operation of the user, the user on which User A has performed a predetermined operation is the user of the user output image whose size has been greatly changed by the operation of User A. In this case, the selection event prompted by the information 1700 is a selection event in which the specific object used by the user on which User A has performed a predetermined operation can be selected. Since the communication screen 1100 includes the selection event button 813, when User A's willingness to perform the selection event prompted by the information 1700 is improved, User A can reach the screen for starting the selection event by selecting the selection event button 813. In this case, when the selection event button 813 is selected, a selection instruction screen 911 related to the selection event prompted by the information 1700 may be displayed. Also, the information 1700 may be displayed so as to be selectable by the user.When information 1700 is selected by user A, a selection instruction screen 911 related to the selection event prompted by information 1700 may be displayed.

[0251] The display of information 1710 prompting the selection of selection instruction buttons 912a and 912b by the terminal device 2 of user A may be executed when a character object uses a specific object received as information indicating the selection result of a selection event corresponding to a selection instruction by any one of users B1 to B3 (FIG. 17(b)). The display of information 1710 prompting the selection of selection instruction buttons 912a and 912b by the terminal device 2 of user A may be executed when the number of users B participating in the communication service in which user A participates is less than a predetermined number. The display of information 1710 prompting the selection of selection instruction buttons 912a and 912b by the terminal device 2 of user A may be executed when the number of users B participating in the communication service in which user A participates is equal to or more than a predetermined number. The display of information 1710 prompting the selection of selection instruction buttons 912a and 912b by the terminal device 2 of user A may be executed when a predetermined time has elapsed after the number of users B participating in the communication service in which user A participates has stopped changing. Since the communication screen 1100 includes a selection event button 813, when user A's willingness to perform the selection event prompted by information 1700 is improved, user A can reach the screen for starting the selection vent by selecting the selection event button 813. In this case, when the selection event button 813 is selected, a selection instruction screen 911 related to the selection event (the selection event implemented in response to a selection instruction by any one of users B1 to B3) prompted by information 1700 may be displayed. Also, information 1700 may be displayed so as to be selectable by the user. When information 1700 is selected by user A, a selection instruction screen 911 related to the selection event prompted by information 1700 may be displayed.

[0252] (Modification Example 6) Also, for example, every time a character object temporarily uses a specific object received as information indicating the selection result of a selection event in response to a selection instruction by User A, the display processing unit 274 of the terminal device 2 of User A may display the user name of the character object temporarily used this time and information indicating that it has been temporarily used.

[0253] (Modification Example 7) When a character object is generated based on 3D model data for generating a 3D animation, the user output image of each user may be an image of a character object, which is a three-dimensional object (3D object) arranged in a virtual space defined for each user, as viewed from a predetermined viewpoint within the virtual space. For example, the display processing unit 274 arranges a 2D screen in the line-of-sight direction of a predetermined viewpoint, projects the 3D coordinates of various three-dimensional objects arranged in the virtual space onto the 2D screen, and displays an image of the 2D screen surface onto which various objects are projected as the user output image. Note that, for example, the line-of-sight direction of a predetermined viewpoint for displaying the user output image of User A on the terminal device 2 of User A is a direction facing the character object of User A. Then, the 2D screen for displaying the user output image of User A on the terminal device 2 of User A is controlled to move and rotate in response to the movement of the predetermined viewpoint and the rotation of the line-of-sight direction.

[0254] (Modification Example 8) When a character object is generated based on 3D model data for generating a 3D animation, the user output image of each user may also be an image of the virtual space as viewed from a user viewpoint arranged at a predetermined position (for example, the position of the eyes of the character object) of a character object, which is a three-dimensional object (3D object) arranged in a virtual space common to each user. Note that the user viewpoint may move from a predetermined position of the character object in response to an operation by the user and / or automatically, and may be located behind, above, or in front of the character object.

[0255] An example of how to use a communication service in a virtual space common to each user will be described. For example, as shown in FIG. 18, the display processing unit 274 causes a device object S such as a virtual tablet PC to appear within the field of view from the user's perspective of the character object C of user A in the virtual space. Various screens described in FIGS. 6 to 15 and 17 are displayed on the display device portion of this device object S. In this case, the user output image of user A displayed on the display device portion of the device object S is a two-dimensional image seen from a virtual camera provided at a predetermined position of the device object S within the virtual space. The voice data of user A is the voice data acquired by the microphone 26 of the terminal device 2.

[0256] The transmission unit 272 of the terminal device 2 transmits the user output image of user A, the voice data of user A, and the user ID of user A to the terminal devices 2 of all users B via the server device 3. Note that the transmission unit 272 may transmit, instead of the user output image of user A, the position and line-of-sight direction of the virtual camera in the virtual space, the position and body orientation of the character object of user A in the virtual space, and the motion data of user A. Also, the terminal device 2 of user A receives the user output image of each user B, the voice data of each user B, and the user ID of each user B from the terminal devices 2 of each user B via the server device 3. Then, the display processing unit 274 of the terminal device 2 of user A displays the user output image of each user B on the display device portion of the device object S and outputs the voice data of each user B as voice from the terminal device 2. Thereby, it becomes possible to realize a communication service using the virtual device object S.

[0257] (Modification Example 9) At least a part of the functions realized by the terminal processing device 27 of the terminal device 2 may be realized by a processor other than the terminal processing device 27 of the terminal device 2. At least a part of the functions realized by the terminal processing device 27 may be realized by, for example, the server processing device 33 of the server device 3. Specifically, a part of the functions of the generation unit 271 and the display processing unit 274 may be executed in the server device 3. For example, the terminal device 2 transmits continuously acquired imaging data and audio data to the server device 3 together with the user ID of the user operating the terminal device 2. Then, the server device 3 uses the functions of the generation unit 271 and the display processing unit 274 to generate character video data and generate display information for displaying a communication screen including the user output images of all users on the display device 23. Then, the server device 3 transmits the display information to each terminal device 2 of all users together with audio information (audio data). Each terminal device 2 outputs the information received from the server device 3 (so-called "server rendering").

[0258] (Modification Example 10) The terminal device 2 has a function of displaying a communication screen or the like by executing various instructions included in a control program stored in the terminal device 2. However, in order to realize a communication service, the terminal device 2 calls a browser function incorporated in a web application, and uses this browser function to receive a web page (a document described by a markup language such as HTML (Hyper Text Markup Language)) from a server device, and may execute a control program incorporated in this web page (so-called "browser rendering"). For example, by using HTML 5 as the markup language, the terminal device 2 can easily execute new information processing. By adopting such a web application to realize a communication service in the terminal device, the program producer can provide new information processing to the client side (terminal device side) simply by incorporating a new program into the web page transmitted by the server device, and can significantly reduce the man-hours for producing the new program. Also, on the client side, by simply receiving a web page without downloading a new control program, a new service can be received, and compared with downloading a control program, it is possible to reduce the load on the communication network, communication cost and / or communication time, and it is possible to realize simplification of the user interface.

[0259] (Modification Example 11) The generation unit 271 of the terminal device 2 of User A may generate output information including face motion data without using imaging data. For example, the terminal storage device 22 of the terminal device 2 stores face motion data corresponding to voice data, and the generation unit 271 extracts the face motion data corresponding to the acquired voice data of User A from the terminal storage device 22, and generates output information including the extracted face motion data, the voice data, and the user ID of User A. Also, the generation unit 271 of the terminal device 2 of User A may generate output information including the voice data of User A output from the microphone 26 and the user ID stored in the terminal storage device 22 without including the face motion data. In this case, the display processing unit 274 of the terminal device 2 of User B may extract the face motion data corresponding to the voice data of User A included in the output information of User A received via the server device 3, and generate an animation of the character object of User A. Note that the generation process of the face motion data corresponding to the user's voice data may be a process using a known lip-sync algorithm.

[0260] In this way, in the terminal device 2 of User A that uses the HMD as the display device 23, it is possible to communicate with User B via the character object without acquiring the imaging data of User A.

Explanation of Reference Numerals

[0261] 1 Information system 2 (2a, 2b1, 2b2) Terminal device 21 Terminal communication I / F 22 Terminal storage device 23 Display device 24 Input device 25 Imaging device 26 Microphone 27 Terminal processing device 271 Generation unit 272 Transmission unit 273 Reception unit 274 Display processing unit 275 Voice output unit 3 Server device 31 Server communication I / F 32 Server storage device 33 Server processing device 331 Server receiving section 332 Server transmitting section 333 Selection section 4 Base station 5 Mobile communication network 6 Gateway 7 Internet

Claims

1. A control program for a terminal device of a first user, comprising: displaying on the terminal device of the first user at least a first image including a first object indicating the first user and a second image including a second object indicating a second user different from the first user; transmitting information regarding the display of the first image to the terminal device of the second user; when the first voice of the first user is acquired, transmitting the first voice to the terminal device of the second user; displaying the first image including the first object that changes according to the operation or the first voice of the first user; when the second voice of the second user is received, outputting the second voice; displaying the second image including the second object that changes according to the operation or the second voice of the second user; displaying the first image including the first object, at least a part of which is changed based on at least one third object selected from a plurality of third objects in response to a first instruction by the first user; causing the above to be executed; providing, on the terminal device of the first user, an interface for the first user to give the first instruction when a first condition regarding the first or the second user is satisfied; A control program for causing the above to be executed.

2. receiving, on the terminal device of the first user, information regarding at least one fourth object selected from a plurality of fourth objects in response to a second instruction by the second user; displaying the second image including the second object, at least a part of which is changed based on the information regarding the at least one fourth object in response to an application instruction of the selected fourth object by the second user; selecting at least one fourth object from the plurality of fourth objects in response to a third instruction by the first user, and displaying the first image including the first object, at least a part of which is changed based on the selected at least one fourth object; The control program according to claim 1, which causes the above to be executed.

3. [[ID=41 ​ ​ In the third instruction by the first user, when the second object included in the displayed second image is selected by the first user, the plurality of fourth objects in the selection according to the third instruction are the plurality of fourth objects selected by the second user indicated by the second object selected by the first user. The control program according to claim 2.

4. On the terminal device of the first user, When a second condition is satisfied, the first object at least partially changed based on the at least one fourth object is restored to the first object before the change, and the first image including the first object restored to before the change is displayed. Cause to execute, In the period from when the first object is changed based on the at least one fourth object until it is restored to the first object before the change, the first user can execute the selection of at least one fourth object from among the plurality of fourth objects. The control program according to claim 2 or 3.

5. The second condition is Obtaining a specific instruction from the first user, The information regarding the display of the first image, the transmission of the first voice, and the reception of the second voice have ended, The information regarding the display of the second image, the transmission of the second voice, and the reception of the first voice have ended, A predetermined time has elapsed since at least a part of the first object was changed based on the at least one fourth object, When at least a part of the first object is changed based on the at least one fourth object, the first user starts the selection of at least one of the plurality of third objects in response to an instruction, or When at least a part of the first object is changed based on the at least one fourth object, the second user starts the selection of at least one of the plurality of third objects in response to an instruction. Including, the control program according to claim 4.

6. Displaying the first image including the first object at least partially changed based on the at least one fourth object is executed when a third condition is satisfied. The control program according to any one of claims 2 to 5.

7. The third condition is The number of times the first image including the first object at least partially changed based on the at least one fourth object is displayed is equal to or less than a predetermined number of times. The control program according to claim 6, including.

8. On the terminal device of the first user, When at least one of the plurality of fourth objects is selected in response to an operation of a first instruction object by the first user, a first privilege is granted to the second user. To execute this. The control program according to any one of claims 2 to 7.

9. On the terminal device of the first user, When at least one of the plurality of fourth objects is selected in response to an operation of a first instruction object by the first user, a second privilege is granted to the first user. To execute this. The control program according to any one of claims 2 to 8.

10. On the terminal device of the first user, When at least one of the plurality of fourth objects is not selected without the first instruction object being operated by the first user, a third privilege is granted to the first user. To execute this. The control program according to any one of claims 2 to 9.

11. On the terminal device of the first user, When the third condition is satisfied, a second instruction object for executing the selection of at least one of the plurality of fifth objects and information regarding the execution of the selection are displayed. In response to an operation of the second instruction object by the first user, at least one of the plurality of fifth objects is selected, and the first image including the first object at least partially changed based on the selected at least one fifth object is displayed. To execute this. The control program according to any one of claims 1 to 10.

12. The control program according to claim 11, wherein the third condition is that a predetermined time has elapsed since the first object was changed based on the at least one third object.

13. The control program according to claim 11 or 12, wherein the plurality of fifth objects include an object that is applied to and displayed on the second object indicating the second user.

14. A control program for a server device capable of communicating with each of a terminal device of a first user and a terminal device of a second user different from the first user, wherein the server device, receives information regarding the display of a first image including a first object indicating the first user from the terminal device of the first user, and receives information regarding the display of a second image including a second object indicating the second user from the terminal device of the second user, transmits information for displaying at least the first image to at least the terminal device of the second user, and transmits information for displaying at least the second image to at least the terminal device of the first user, when receiving the first voice of the first user, transmits the first voice to the terminal device of the second user, transmits information for displaying the first image including the first object that changes according to the operation or the first voice of the first user to at least the terminal device of the second user, when receiving the second voice of the second user, transmits the second voice to the terminal device of the first user, transmits information for displaying the second image including the second object that changes according to the operation or the second voice of the second user to at least the terminal device of the first user, transmits information for displaying the first image including the first object that is at least partially changed based on at least one third object selected from among a plurality of third objects in response to a first instruction by the first user to at least the terminal device of the second user, causes to execute, in the terminal device of the first user, when a first condition regarding the first user or the second user is satisfied, provides an interface for the first user to issue the first instruction, A control program characterized by the above.

15. A terminal device of a first user, At least display a first image including a first object indicating the first user and a second image including a second object indicating a second user different from the first user. Transmit information regarding the display of the first image to the terminal device of the second user. When the first voice of the first user is acquired, transmit the first voice to the terminal device of the second user. Display the first image including the first object that changes according to the operation of the first user or the first voice. When the second voice of the second user is received, output the second voice. Display the second image including the second object that changes according to the operation of the second user or the second voice. A processing unit that displays the first image including the first object at least partially changed based on at least one of the third objects selected from a plurality of third objects in response to a first instruction by the first user. Comprising The processing unit When a first condition regarding the first or second user is satisfied, provide an interface for the first user to give the first instruction. A terminal device characterized by causing the above to be executed.

16. A server device capable of communicating with each of the terminal device of the first user and the terminal device of the second user different from the first user, Receive information regarding the display of a first image including a first object indicating the first user from the terminal device of the first user, and receive information regarding the display of a second image including a second object indicating the second user from the terminal device of the second user. Transmit information for at least displaying the first image to at least the terminal device of the second user, and transmit information for at least displaying the second image to at least the terminal device of the first user. When the first voice of the first user is received, transmit the first voice to the terminal device of the second user. Transmit information for displaying the first image including the first object that changes according to the operation of the first user or the first voice to at least the terminal device of the second user. When the second voice of the second user is received, transmit the second voice to the terminal device of the first user. Transmit information for displaying the second image including the second object that changes according to the operation of the second user or the second voice to at least the terminal device of the first user. A processing unit that transmits information for displaying the first image including the first object at least partially changed based on at least one of the third objects selected from among a plurality of third objects in response to a first instruction by the first user, to at least the terminal device of the second user comprising In the terminal device of the first user When a first condition regarding the first user or the second user is satisfied, an interface for the first user to give the first instruction is provided A server device characterized by this

17. A control method for a terminal device of a first user, comprising The terminal device of the first user displays at least a first image including a first object indicating the first user and a second image including a second object indicating a second user different from the first user transmits information regarding the display of the first image to the terminal device of the second user when the first voice of the first user is acquired, transmits the first voice to the terminal device of the second user displays the first image including the first object that changes according to the operation or the first voice of the first user when the second voice of the second user is received, outputs the second voice displays the second image including the second object that changes according to the operation or the second voice of the second user displays the first image including the first object at least partially changed based on at least one of the third objects selected from among a plurality of third objects in response to a first instruction by the first user including The terminal device of the first user when a first condition regarding the first user or the second user is satisfied, provides an interface for the first user to give the first instruction A control method characterized by including this

18. A control method for a server device capable of communicating with each of a terminal device of a first user and a terminal device of a second user different from the first user, comprising The server device receives information regarding the display of a first image including a first object indicating the first user from the terminal device of the first user, and receives information regarding the display of a second image including a second object indicating the second user from the terminal device of the second user Transmit information for at least displaying the first image to at least the terminal device of the second user, and transmit information for at least displaying the second image to at least the terminal device of the first user. When the first voice of the first user is received, transmit the first voice to the terminal device of the second user. Transmit information for displaying the first image including the first object that changes according to the operation of the first user or the first voice to at least the terminal device of the second user. When the second voice of the second user is received, transmit the second voice to the terminal device of the first user. Transmit information for displaying the second image including the second object that changes according to the operation of the second user or the second voice to at least the terminal device of the first user. Transmit information for displaying the first image including the first object that is at least partially changed based on at least one of the third objects selected from a plurality of third objects in response to a first instruction by the first user to at least the terminal device of the second user. including In the terminal device of the first user When a first condition regarding the first user or the second user is satisfied, an interface for the first user to give the first instruction is provided. A control method characterized by the above.

Images