Indicating control device

Abstract

This display control device comprises: a first acquisition unit that acquires, from an external device, a message and an identifier indicating a type of rendering with which the message is provided using a virtual object; a storage device that stores a plurality of rendering data items corresponding one-to-one to a plurality of rendering types; a second acquisition unit that acquires one rendering data item of the plurality of rendering data items from the storage device on the basis of the identifier; and a display control unit that provides the message with a rendering using a virtual object, the rendering being included in the one rendering data item acquired by the second acquisition unit, and causes a display device to display a virtual space including the message provided with the rendering.

Description

Technical Field

[0001] The present invention relates to a display control device.

Background Art

[0002] In a network system including a server and a plurality of terminal devices, the terminal device may cause the display device to display a virtual space and may transmit and receive messages between the terminal devices.

[0003] For example, Patent Document 1 discloses a technique related to a system having a terminal device and a server capable of playing a game using a map showing the positional relationship of a plurality of virtual objects arranged in a virtual space. In the system, in order to realize communication mainly by a plurality of users during the game, the terminal device stores templates of a plurality of messages. Further, the terminal device receives a request for creating a message using a template selected by the user. The server creates a message using the template information included in the message creation request and the position information of a plurality of virtual objects on the map in response to the message creation request from the terminal device, and transmits the created message to other terminal devices.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, in transmitting and receiving messages between terminal devices, when using an image with a large capacity such as a three-dimensional image to produce a message, it is conceivable that the communication bandwidth is compressed due to the large capacity of the image.

[0006] Therefore, the present invention aims to solve the problem of producing a message using an image with a large capacity in a virtual space while suppressing the degree of compression of the communication band as compared with the prior art.

Means for Solving the Problems

[0007] A display control device according to a preferred aspect of the present invention includes: a first acquisition unit that acquires a message and an identifier indicating a type of effect applied to the message using a virtual object from an external device; a storage device that stores a plurality of effect data corresponding one-to-one to a plurality of types of effects; a second acquisition unit that acquires one piece of effect data from among the plurality of effect data from the storage device based on the identifier; and a display control unit that performs an effect using the virtual object included in the one piece of effect data acquired by the second acquisition unit on the message, and causes a display device to display a virtual space including the message on which the effect has been performed.

Advantages of the Invention

[0008] According to the present invention, compared with the prior art, it is possible to produce a message using an image with a large capacity in a virtual space while suppressing the degree of compression of the communication band.

Brief Description of the Drawings

[0009]

Figure 1

Figure 2A

Figure 2B

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9A

Figure 9B

Figure 10A

Figure 10B

Figure 11A

Figure 11B

Mode for Carrying Out the Invention

[0010] 1: First Embodiment Hereinafter, an information processing system 1 including terminal devices 10-J and 10-K as display control devices according to the first embodiment of the present invention will be described with reference to FIGS. 1 to 11B.

[0011] 1-1: Configuration of the First Embodiment 1-1-1: Overall Configuration FIG. 1 shows the overall configuration of the information processing system 1. As shown in FIG. 1, the information processing system 1 includes terminal devices 10-1, 10-2,... 10-J,... 10-K,... 10-N, an authentication server 20, a message management server 30, and a database server 40. N is an integer of 1 or more. K is an integer of 1 or more and N or less. J is an integer of 1 or more and N or less, and is an integer different from K. In the present embodiment, the terminal devices 10-1, 10-2,... 10-J,... 10-K,... 10-N have the same configuration. However, terminal devices with different configurations may also be included.

[0012] In the information processing system 1, the terminal devices 10-1, 10-2, … 10-J, … 10-K, … 10-N, the authentication server 20, the message management server 30, and the database server 40 are connected to be communicable with each other via the communication network NET. The same applies to the terminal device 10-K as to the terminal device 10-J. In FIG. 1, the user U J is assumed to use the terminal device 10-J. Also, the user U K is assumed to use the terminal device 10-K. The terminal devices 10-J and 10-K are an example of a display control device.

[0013] The terminal device 10-J is a terminal for the user U J to execute message transmission and reception with the user U K . Also, the terminal device 10-J causes a virtual object arranged in a virtual space to be displayed on a display 14 described later provided in the terminal device 10-J. The virtual space is, as an example, a celestial sphere-shaped space. Also, the virtual object is, for example, a virtual object indicating data such as a still image, a moving image, a 3DCG model, an HTML file, and a text file, and a virtual object indicating an application. Here, examples of the text file include a memo, a source code, a diary, and a recipe. Also, examples of the application include a browser, an application for using SNS, and an application for generating a document file. Note that the above “message” may be text corresponding to the content of the message or an image.

[0014] Similarly, the terminal device 10-K is a terminal for the user U K to execute message transmission and reception with the user U J . Also, the terminal device 10-K, like the terminal device 10-J, causes a virtual object arranged in a virtual space to be displayed on a display 14 described later provided in the terminal device 10-K.

[0015] Incidentally, the terminal devices 10-J and 10-K are preferably mobile terminal devices such as smartphones and tablets, for example.

[0016] Among the terminal devices 10-1 to 10-N, the terminal devices 10-1 to 10-N other than the terminal devices 10-J and 10-K also execute message transmission and reception in the same manner as the terminal devices 10-J and 10-K. Incidentally, the terminal devices 10-1 to 10-N other than the terminal devices 10-J and 10-K may or may not display a virtual space in the same manner as the terminal devices 10-J and 10-K. The terminal devices 10-1 to 10-N other than the terminal devices 10-J and 10-K are also preferably mobile terminal devices such as smartphones and tablets, for example.

[0017] The authentication server 20 is a server that authenticates the terminal devices 10-1 to 10-N. The authentication server 20 authenticates the terminal devices 10-1 to 10-N using the authentication information acquired from the terminal devices 10-1 to 10-N.

[0018] The message management server 30 manages the messages transmitted and received among the terminal devices 10-1 to 10-N. In the present embodiment, the message management server 30 includes a message database MDB, which will be described later, that stores text information corresponding to the content of the message.

[0019] The database server 40 includes a database that stores data used for message transmission and reception among the terminal devices 10-1 to 10-N. The database server 40 includes a rendering database RDB, which will be described later, that stores rendering data for rendering the messages transmitted and received between the terminal device 10-J and the terminal device 10-K.

[0020] Here, examples of the "presentation" include imparting a visual effect, an acoustic effect, and a tactile feedback to the message. Further, as an example of imparting a visual effect, for instance, there are processes such as changing the background of the message, the color of the characters, and the size of the characters, or imparting an animation image, an emoji, and a sticker. Also, as an example of imparting an acoustic effect, for instance, there are processes such as playing a melody, a specific sound representing the situation indicated by the message, and a sound effect accompanying the above visual effect. Furthermore, as an example of imparting a tactile feedback, when the user U K holds the terminal device 10-K, there is a process of vibrating the terminal device 10-K.

[0021] Also, the "presentation data" is data used, for example, by a later-described processing device 11 provided in the terminal device 10-K for the above presentation. For example, based on data indicating a virtual object included in the presentation data, the processing device 11 imparts a visual effect using the virtual object to the message. Alternatively, the processing device 11 imparts an acoustic effect to the message based on the acoustic data included in the presentation data. Alternatively, the processing device 11 vibrates the terminal device 10-K based on the motion data included in the presentation data.

[0022] FIG. 2A, FIG. 2B, and FIG. 3 are diagrams showing examples of presenting a message using the presentation data. For example, as shown in the example of FIG. 2A, the terminal device 10-K provides a virtual reality space VS to the user U K . Further, as a virtual object for presenting the message received from the terminal device 10-J using the presentation data, the terminal device 10-K displays a spherical virtual object VO1 in the virtual reality space VS. As shown in FIG. 2A, it is assumed that the user U K touches the virtual object VO1 with one hand.

[0023] As a result, the terminal device 10-K uses additional production data to rupture the spherical virtual object VO1 and display a virtual object VO2 that shows a text file with text corresponding to the content of the message M, as shown in the example of FIG. 2B.

[0024] Alternatively, as another production example, as shown in FIG. 3, the terminal device 10-K may display in the virtual reality space VS a virtual object VO3 in which the text corresponding to the content of the message M received from the terminal device 10-J undulates, using other production data.

[0025] Note that the virtual objects VO1 to VO3 are preferably three-dimensional images. However, the virtual objects VO1 to VO3 are not limited to three-dimensional images. The virtual objects VO1 to VO3 may be two-dimensional images. Also, as will be described later, the virtual space provided by the terminal device 10-K to the user U K is not limited to the virtual reality space VS, and may be an augmented reality space or a mixed reality space.

[0026] 1-1-2: Configuration of Terminal Device 10-J FIG. 4 is a block diagram showing a configuration example of the terminal device 10-J. The terminal device 10-J includes a processing device 11, a storage device 12, a communication device 13, a display 14, an input device 15, and an inertial sensor 16. Each element of the terminal device 10-J is interconnected using one or more buses for communicating information.

[0027] The processing device 11 is a processor that controls the entire terminal device 10-J. Also, the processing device 11 is configured using, for example, one or more chips. The processing device 11 is configured using, for example, a central processing unit (CPU) that includes an interface with peripheral devices, an arithmetic unit, and registers. Note that part or all of the functions of the processing device 11 may be realized using hardware such as a DSP, ASIC, PLD, or FPGA. The processing device 11 executes various processes in parallel or sequentially.

[0028] The storage device 12 is a recording medium that can be read from and written to by the processing device 11. Also, the storage device 12 stores a plurality of programs including the control program PR1 executed by the processing device 11.

[0029] Also, the storage device 12 stores a plurality of rendering data RD used for rendering the message M. The plurality of rendering data RD corresponds one-to-one to a rendering ID which is an identifier indicating the types of a plurality of renderings. The plurality of rendering data RD includes the rendering data RD acquired from the database server 40 via the communication device 13 in the transmission and reception of the message M so far. Also, the plurality of rendering data RD may include the rendering data RD stored in the storage device 12 from the beginning.

[0030] Furthermore, the storage device 12 stores login information LI used for logging in to the terminal device 10-J and authentication information CI used for authenticating the terminal device 10-J.

[0031] The communication device 13 is hardware as a transmission / reception device for communicating with other devices. The communication device 13 is also called, for example, a network device, a network controller, a network card, or a communication module. The communication device 13 may include a connector for wired connection and an interface circuit corresponding to the connector. Also, the communication device 13 may include a wireless communication interface. Examples of the connector for wired connection and the interface circuit include products compliant with wired LAN, IEEE1394, and USB. Also, examples of the wireless communication interface include products compliant with wireless LAN and Bluetooth (registered trademark).

[0032] The display 14 is a device that displays images and character information. The display 14 displays various images under the control of the processing device 11. For example, various display panels such as a liquid crystal display panel and an organic EL (Electro Luminescence) display panel are suitably used as the display 14. When an XR glass such as a VR (Virtual Reality) glass, an AR (Augmented Reality) glass, or an MR (Mixed Reality) glass is connected to the terminal device 10-J, the display 14 may not be an essential component. Specifically, by using the XR glass as the display 14, the terminal device 10-J may be configured without the display 14.

[0033] The input device 15 receives operations from the user U J For example, the input device 15 includes a pointing device such as a keyboard, a touch pad, a touch panel, or a mouse. Here, when the input device 15 includes a touch panel, it may also serve as the display 14.

[0034] The inertial sensor 16 is a sensor that detects inertial forces. The inertial sensor 16 includes, for example, one or more sensors among an acceleration sensor, an angular velocity sensor, and a gyro sensor. The processing device 11 detects the posture of the terminal device 10-J based on the output information of the inertial sensor 16. Further, the processing device 11 receives the selection of the virtual object VO, the input of characters, and the input of instructions in the virtual reality space VS based on the posture of the terminal device 10-J. For example, when the user U J operates the input device 15 with the central axis of the terminal device 10-J directed toward a predetermined area in the virtual reality space VS, the virtual objects VO1 to VO3 arranged in the predetermined area are selected. The operation of the user U J on the input device 15 is, for example, a double tap. In this way, the user U J can select the virtual objects VO1 to VO3 without looking at the input device 15 of the terminal device 10-J by operating the terminal device 10-J.

[0035] The processing device 11 reads out and executes the control program PR1 from the storage device 12. As a result, the processing device 11 functions as an acquisition unit 111, a determination unit 112, a display control unit 113, and an output unit 114.

[0036] The acquisition unit 111 acquires various data and information. FIG. 5 is a functional block diagram showing the configuration of the acquisition unit 111. The acquisition unit 111 includes a first acquisition unit 111-1, a second acquisition unit 111-2, a third acquisition unit 111-3, and a fourth acquisition unit 111-4.

[0037] The first acquisition unit 111-1 acquires, from an external device, a message M and an effect ID indicating the type of effect applied using the virtual object VO corresponding to the message M, in a form associated with each other. The effect ID is an example of an "identifier indicating the type of effect". Here, the "external device" may be the message management server 30 or the storage device 12.

[0038] In addition, the first acquisition unit 111-1 acquires, from an external device, position information SI indicating a position in the virtual reality space VS where the virtual object VO to be displayed for the effect should be located. The position information SI includes position information SI indicating an absolute position in the virtual reality space VS. Further, the position information SI may include position information SI indicating a relative position with respect to the message itself displayed in the virtual reality space VS or the text corresponding to the content of the message.

[0039] As a result, the terminal device 10-J can display the virtual object VO at a desired location in the virtual reality space VS when an effect of the message M using the virtual object VO is performed.

[0040] Furthermore, the first acquisition unit 111-1 acquires a source ID indicating the source of the above message M from an external device. The first acquisition unit 111-1 also acquires various files. The files include encapsulated files. "Encapsulation" means storing a plurality of pieces of information together in a single file. In particular, it is preferable that the source ID, the production ID, the position information SI, and the text information TI indicating the text corresponding to the content of the above message M are stored in a single encapsulated file. A specific extension is given to the file for specifying performing an effect on the above message M. The first acquisition unit 111-1 acquires the single file.

[0041] As a result, the terminal device 10-J detects the extensions of various pieces of information acquired from the external device, and when the detected extension is the specific extension, it executes an effect on the message M. Therefore, the terminal device 10-J can identify a file on which an effect should be executed only by monitoring the extension.

[0042] The second acquisition unit 111-2 acquires one piece of production data RD from among a plurality of pieces of production data RD from the storage device 12 based on the production ID acquired by the first acquisition unit 111-1. In particular, when the extension given to the encapsulated file acquired by the first acquisition unit 111-1 is the above specific extension, the second acquisition unit 111-2 acquires the above one piece of production data RD from the storage device 12.

[0043] As a result, the terminal device 10-J can perform an effect on the message M using a large-capacity image in the virtual reality space VS while suppressing the degree of compression of the communication band compared to the prior art.

[0044] Further, when the production data RD corresponding to the production ID acquired by the first acquisition unit 111-1 does not exist in the storage device 12, the second acquisition unit 111-2 acquires the production data RD corresponding to the production ID from the message management server 30 and, by extension, the database server 40 via the communication device 13. Further, the second acquisition unit 111-2 stores the acquired production data RD in the storage device 12.

[0045] As a result, when the terminal device 10-J does not store the production data RD corresponding to the production ID, the message M can be produced using the production data RD acquired from an external device.

[0046] The third acquisition unit 111-3 acquires operation information OI indicating the content of an operation on a virtual object VO used in a production, which is arranged in the virtual reality space VS. The operation may be an operation using the input device 15 by the user U J Or, the operation may be an operation in which the processing device 11 receives selection of a virtual object VO, input of characters, and input of an instruction in the virtual reality space VS based on the posture of the terminal device 10-J. Or, when an XR glass is connected to the terminal device 10-J, at least one of the body movement and the line-of-sight movement of the user U J acquired by the XR glass may be used.

[0047] The fourth acquisition unit 111-4 acquires operation information OI indicating the content of an operation by the user U J on the terminal device 10-J. In particular, the fourth acquisition unit 111-4 acquires login information LI for the terminal device 10-J as the operation information OI. Further, the fourth acquisition unit 111-4 acquires the authentication result of the terminal device 10-J from the authentication server 20 via the communication device 13. Further, the fourth acquisition unit 111-4 acquires destination data AD indicating a plurality of destination candidates as the destination of the message M from the authentication server 20 via the communication device 13. Further, as the above operation information OI, the user U JObtain text information TI indicating the text corresponding to the content of message M input to terminal device 10-J. Further, the fourth acquisition unit 111-4 obtains, as the above operation information OI, the selection result from a plurality of destination candidates indicated by destination data AD and the selection result of the effect for message M. Further, the fourth acquisition unit 111-4 obtains, via communication device 13, a notification signal from message management server 30 notifying that a message M addressed to terminal device 10-J has arrived.

[0048] Referring back to FIG. 4 for the description, determination unit 112 determines whether or not there is presentation data RD corresponding to the presentation ID acquired by first acquisition unit 111-1 in storage device 12. When there is presentation data RD corresponding to the presentation ID in storage device 12, second acquisition unit 111-2 acquires, as described above, one piece of presentation data RD corresponding to the presentation ID from among the plurality of presentation data RD in storage device 12. On the other hand, when there is no presentation data RD corresponding to the presentation ID in storage device 12, second acquisition unit 111-2 acquires, as described above, the presentation data RD corresponding to the presentation ID from message management server 30 and, by extension, database server 40 via communication device 13.

[0049] Display control unit 113 causes a preview screen of message M to be displayed on the display device when message M is transmitted from terminal device 10-J. Further, when message M is received by terminal device 10-J, display control unit 113 performs an effect using virtual object VO included in the presentation data RD acquired by second acquisition unit 111-2 on the message M. Further, display control unit 113 causes virtual reality space VS including message M on which the effect has been performed to be displayed on the display device. In particular, display control unit 113 causes virtual reality space VS including message M on which the effect has been performed to be displayed on the display device when the extension of the information acquired by first acquisition unit 111-1 is the above specific extension. The “display device” is, for example, display 14. Further, when an XR glass is connected to terminal device 10-J, the “display device” may be the XR glass.

[0050] In addition, the display control unit 113 causes a virtual object VO used for the production of the message M to be displayed at the position indicated by the position information SI acquired by the first acquisition unit 111-1 in the virtual reality space VS.

[0051] The output unit 114 outputs, via the communication device 13, operation information OI indicating the content of the operation on the virtual object VO used for production in the virtual reality space VS, which is acquired by the third acquisition unit 111-3, to an external device. Here, the "external device" refers to the message management server 30.

[0052] As a result, the operation of the user U on the virtual object VO in the virtual reality space VS J can also be applied to the virtual object VO displayed on the display device by the other terminal devices 10-1 to 10-N.

[0053] In addition, the output unit 114 outputs the authentication information CI stored in the storage device 12 to the authentication server 20 via the communication device 13.

[0054] In addition, when sending the message M, the output unit 114 J outputs the destination ID corresponding to the destination of the message M selected by the user U, the source ID indicating the user U who is the sender of the message M J the production ID indicating the type of production, the position information SI indicating the position where the virtual object VO is displayed in the virtual reality space VS, and the text information TI indicating the text corresponding to the content of the message M to the message management server 30. It is preferable that these destination ID, source ID, production ID, position information SI, and text information TI are stored in a single file.

[0055] In addition, when receiving the message M, the output unit 114 outputs a request signal for requesting the message M to the message management server 30.

[0056] In addition, when receiving the message M, the output unit 114 outputs a request signal to the message management server 30, which requests the source ID indicating the source of the message M, the effect ID indicating the type of effect, the position information SI indicating the position where the virtual object VO is displayed in the virtual reality space VS, and the text information TI indicating the text corresponding to the content of the message M.

[0057] In addition, when the effect data RD corresponding to the effect ID acquired by the first acquisition unit 111-1 does not exist in the storage device 12, the output unit 114 outputs the effect ID to the message management server 30.

[0058] 1-1-3: Configuration of the authentication server 20 FIG. 6 is a block diagram showing a configuration example of the authentication server 20. The authentication server 20 includes a processing device 21, a storage device 22, a communication device 23, a display 24, and an input device 25. Each element included in the authentication server 20 is interconnected using one or a plurality of buses for communicating information.

[0059] The processing device 21 is a processor that controls the entire authentication server 20. Further, the processing device 21 is configured using, for example, one or a plurality of chips. The processing device 21 is configured using, for example, a central processing unit (CPU) including an interface with peripheral devices, an arithmetic unit, and registers. Note that part or all of the functions of the processing device 21 may be realized using hardware such as a DSP, an ASIC, a PLD, and an FPGA. The processing device 21 executes various processes in parallel or sequentially.

[0060] The storage device 22 is a recording medium that can be read from and written to by the processing device 21. Further, the storage device 22 stores a plurality of programs including the control program PR2 executed by the processing device 21.

[0061] In addition, the memory device 22 stores an authentication information database CDB. The authentication information database CDB is a database in which authentication information CI used for authenticating the terminal devices 10-1 to 10-N is stored. As will be described later, the acquisition unit 211 provided in the processing device 21 collates the authentication information CI acquired from any one of the terminal devices 10-1 to 10-N with the authentication information CI stored in the authentication information database CDB, whereby the authentication server 20 authenticates each of the terminal devices 10-1 to 10-N.

[0062] The communication device 23 is hardware as a transmission / reception device for communicating with other devices. The communication device 23 is also called, for example, a network device, a network controller, a network card, or a communication module. The communication device 23 may include a connector for wired connection and an interface circuit corresponding to the connector. Further, the communication device 23 may include a wireless communication interface. Examples of the connector and the interface circuit for wired connection include products compliant with wired LAN, IEEE1394, and USB. Examples of the wireless communication interface include products compliant with wireless LAN and Bluetooth (registered trademark).

[0063] The display 24 is a device that displays images and character information. The display 24 displays various images under the control of the processing device 21. For example, various display panels such as a liquid crystal display panel and an organic EL display panel are preferably used as the display 24.

[0064] The input device 25 is a device that receives operations from the administrator of the information processing system 1. For example, the input device 25 includes a pointing device such as a keyboard, a touch pad, a touch panel, or a mouse. Here, when the input device 25 includes a touch panel, it may also serve as the display 24.

[0065] The processing device 21 reads and executes the control program PR2 from the storage device 22, for example. As a result, the processing device 21 functions as an acquisition unit 211, an authentication unit 212, and an output unit 213.

[0066] The acquisition unit 211 acquires the authentication information CI from any one of the terminal devices 10-1 to 10-N. Also, when the authentication unit 212 can authenticate any one of the terminal devices 10-1 to 10-N, the acquisition unit 211 acquires the destination data AD from the database server 40.

[0067] The authentication unit 212 compares the authentication information CI acquired by the acquisition unit 211 with the authentication information CI stored in the authentication information database CDB stored in the storage device 22, and authenticates any one of the terminal devices 10-1 to 10-N from which the acquisition unit 211 acquired the authentication information CI.

[0068] The output unit 213 transmits the authentication result of the authentication unit 212 to any one of the terminal devices 10-1 to 10-N from which the acquisition unit 211 acquired the authentication information CI. Also, when the authentication unit 212 can authenticate any one of the terminal devices 10-1 to 10-N, the output unit 213 transmits a request signal for requesting the destination data AD to the database server 40. Further, the output unit 213 transmits the destination data AD to any one of the terminal devices 10-1 to 10-N from which the acquisition unit 211 acquired the authentication information CI.

[0069] 1-1-4: Configuration of Message Management Server 30 FIG. 7 is a block diagram showing a configuration example of the message management server 30. The message management server 30 includes a processing device 31, a storage device 32, a communication device 33, a display 34, and an input device 35. Each element of the message management server 30 is interconnected using one or more buses for communicating information.

[0070] The processing device 31 is a processor that controls the entire message management server 30. Further, the processing device 31 is configured using, for example, one or more chips. The processing device 31 is configured using, for example, a central processing unit (CPU) including an interface with peripheral devices, an arithmetic unit, registers, and the like. Note that part or all of the functions of the processing device 31 may be realized using hardware such as a DSP, ASIC, PLD, and FPGA. The processing device 31 executes various processes in parallel or sequentially.

[0071] The storage device 32 is a recording medium that can be read from and written to by the processing device 31. Further, the storage device 32 stores a plurality of programs including a control program PR3 executed by the processing device 31.

[0072] Further, the storage device 32 stores a message database MDB. In the message database MDB, a message ID that identifies a message M transmitted and received between the terminal devices 10-1 to 10-N, a source ID indicating the source of the message M, a destination ID indicating the destination of the message M, and text information TI indicating text corresponding to the content of the message M are associated and stored. Further, when an effect is applied to the message M, the effect ID and the position information SI are further associated and stored with respect to the set of the message ID, the source ID, the destination ID, and the text information TI.

[0073] The communication device 33 is hardware as a transmission / reception device for communicating with other devices. The communication device 33 is also called, for example, a network device, a network controller, a network card, or a communication module. The communication device 33 includes a connector for a wired connection and may include an interface circuit corresponding to the connector. Further, the communication device 33 may include a wireless communication interface. Examples of the connector and the interface circuit for a wired connection include products compliant with wired LAN, IEEE1394, and USB. Examples of the wireless communication interface include products compliant with wireless LAN and Bluetooth (registered trademark).

[0074] The display 34 is a device that displays images and character information. The display 34 displays various images under the control of the processing device 31. For example, various display panels such as a liquid crystal display panel and an organic EL display panel are preferably used as the display 34.

[0075] The input device 35 is a device that receives operations from the administrator of the information processing system 1. For example, the input device 35 includes a pointing device such as a keyboard, a touch pad, a touch panel, or a mouse. Here, when the input device 35 includes a touch panel, it may also serve as the display 34.

[0076] The processing device 31, for example, reads and executes the control program PR3 from the storage device 32. As a result, the processing device 31 functions as an acquisition unit 311, a collation unit 312, and an output unit 313.

[0077] When the terminal device 10-J transmits the message M, the acquisition unit 311 receives from the terminal device 10-J J the destination ID corresponding to the destination of the message M selected by the user U, the user U who is the sender of the message M J indicating the sender ID, the effect ID indicating the type of effect, the position information SI indicating the position where the virtual object VO is displayed in the virtual reality space VS, and the text information TI indicating the text corresponding to the content of the message M. It is preferable that these destination ID, sender ID, effect ID, position information SI, and text information TI are stored in a single file. The destination ID, sender ID, effect ID, position information SI, and text information TI acquired by the acquisition unit 311 are stored in the message database MDB in a state linked to the message ID.

[0078] Also, when the acquisition unit 311 receives the message M from the terminal device 10-J, it acquires a request signal for requesting the message M from the terminal device 10-J. The request signal includes the above-mentioned message ID. Also, when the terminal device 10-J does not store the production data RD corresponding to the production ID acquired by the terminal device 10-J, the acquisition unit 311 acquires the production ID from the terminal device 10-J. Further, as will be described later, after the output unit 313 transmits a request signal including the production ID to the database server 40, the acquisition unit 311 acquires the production data RD from the database server 40. The request signal is a signal for requesting the production data RD corresponding to the production ID.

[0079] Furthermore, the acquisition unit 311 acquires operation information OI indicating the content of an operation on the virtual object VO used in the production from the terminal device 10-J.

[0080] The collation unit 312 collates the message ID included in the request signal acquired by the acquisition unit 311 from the terminal device 10-J with the message ID included in the message database MDB.

[0081] When the acquisition unit 311 acquires the destination ID, source ID, production ID, location information SI, and text information TI at the time of transmission of the message M by the terminal device 10-J, the output unit 313 transmits an ACK signal to the terminal device 10-J.

[0082] Also, when the output unit 313 receives the message M from the terminal device 10-J, it transmits a notification signal notifying that the message M addressed to the terminal device 10-J has arrived to the terminal device 10-J.

[0083] Also, when the output unit 313 receives the message M from the terminal device 10-J, it reads out the source ID, production ID, location information SI, and text information TI corresponding to the message ID collated by the collation unit 312 from the message database MDB and transmits them to the terminal device 10-J.

[0084] In addition, when the acquisition unit 311 acquires the production ID from the terminal device 10-J, the output unit 313 transmits a request signal including the production ID and the message ID associated with the production ID to the database server 40. The request signal is a signal for requesting production data RD corresponding to the production ID. Further, when the acquisition unit 311 acquires the production data RD from the database server 40, the output unit 313 transmits the production data RD to the terminal device 10-J.

[0085] 1-1-5: Configuration of Database Server 40 FIG. 8 is a block diagram showing a configuration example of the database server 40. The database server 40 includes a processing device 41, a storage device 42, a communication device 43, a display 44, and an input device 45. Each element included in the database server 40 is interconnected using one or a plurality of buses for communicating information.

[0086] The processing device 41 is a processor that controls the entire database server 40. Further, the processing device 41 is configured using, for example, one or a plurality of chips. The processing device 41 is configured using, for example, a central processing unit (CPU) including an interface with peripheral devices, an arithmetic unit, and registers. Note that part or all of the functions of the processing device 41 may be realized using hardware such as a DSP, an ASIC, a PLD, and an FPGA. The processing device 41 executes various processes in parallel or sequentially.

[0087] The storage device 42 is a recording medium that can be read from and written to by the processing device 41. Further, the storage device 42 stores a plurality of programs including a control program PR4 executed by the processing device 41.

[0088] In addition, the storage device 42 stores a destination database ADB. In the destination database ADB, destination data AD indicating the destinations of users who transmit and receive the message M using the terminal devices 10-1 to 10-J is stored.

[0089] In addition, the storage device 42 stores a production database RDB. In the production database RDB, production data RD for producing a message M is stored in a form associated with a production ID.

[0090] The communication device 43 is hardware as a transmission / reception device for communicating with other devices. The communication device 43 is also called, for example, a network device, a network controller, a network card, or a communication module. The communication device 43 includes a connector for a wired connection and may include an interface circuit corresponding to the connector. Further, the communication device 43 may include a wireless communication interface. Examples of the connector for a wired connection and the interface circuit include products compliant with wired LAN, IEEE1394, and USB. Examples of the wireless communication interface include products compliant with wireless LAN and Bluetooth (registered trademark).

[0091] The display 44 is a device that displays images and character information. The display 44 displays various images under the control of the processing device 41. For example, various display panels such as a liquid crystal display panel and an organic EL display panel are preferably used as the display 44.

[0092] The input device 45 is a device that receives operations from the administrator of the information processing system 1. For example, the input device 45 includes a pointing device such as a keyboard, a touch pad, a touch panel, or a mouse. Here, when the input device 45 includes a touch panel, it may also serve as the display 44.

[0093] For example, the processing device 41 reads and executes the control program PR4 from the storage device 42. As a result, the processing device 41 functions as an acquisition unit 411, a collation unit 412, and an output unit 413.

[0094] When the terminal device 10-J transmits the message M, after the authentication server 20 authenticates the terminal device 10-J, the acquisition unit 411 acquires a request signal for requesting the destination data AD from the authentication server 20.

[0095] Also, when the terminal device 10-J receives the message M, when the message management server 30 acquires the production ID from the terminal device 10-J, the acquisition unit 411 acquires a request signal including the production ID and the message ID associated with the production ID from the message management server 30. The request signal is a signal for requesting the production data RD corresponding to the production ID.

[0096] The collation unit 412 collates the production ID included in the request signal acquired by the acquisition unit 411 from the terminal device 10-J with the production IDs included in the production database RDB.

[0097] When the terminal device 10-J transmits the message M and the acquisition unit 411 acquires a request signal for requesting the destination data AD, the output unit 413 transmits the destination data AD to the authentication server 20.

[0098] Also, when the terminal device 10-J receives the message M, the output unit 413 reads out the production data RD corresponding to the production ID collated by the collation unit 412 from the production database RDB and outputs it to the message management server 30.

[0099] 1-2: Operation of the First Embodiment Figures 9A to 11B are sequence diagrams showing the operation of the information processing system 1 according to the first embodiment. Hereinafter, the operation of the information processing system 1 will be described with reference to Figures 9A to 11B.

[0100] 1-2-1: Operation When the Terminal Device 10-J Transmits a Message Figures 9A and 9B are sequence diagrams showing the operation when the terminal device 10-J transmits a message.

[0101] In step S1, the processing device 11 provided in the terminal device 10-J functions as a fourth acquisition unit 111-4. The processing device 11 acquires login information LI for the terminal device 10-J as operation information OI indicating the content of the operation of the user U J for the terminal device 10-J.

[0102] In step S2, the processing device 11 provided in the terminal device 10 collates the login information LI acquired in step S1 with the login information LI stored in the storage device 12.

[0103] In step S3, when the login information LI acquired by the processing device 11 matches the login information LI stored in the storage device 12, the processing device 11 functions as an output unit 114. The processing device 11 transmits the authentication information CI stored in the storage device 12 to the authentication server 20. Also, the processing device 21 provided in the authentication server 20 functions as an acquisition unit 211. The processing device 21 acquires the authentication information CI from the terminal device 10-J. When the login information LI acquired by the processing device 11 does not match the login information LI stored in the storage device 12, the processing device 11 executes the process of step S1.

[0104] In step S4, the processing device 21 provided in the authentication server 20 functions as an authentication unit 212. The processing device 21 collates the authentication information CI acquired in step S3 with the authentication information CI stored in the authentication information database CDB to authenticate the terminal device 10-J. When the processing device 21 cannot authenticate the terminal device 10-J, an authentication result indicating that authentication could not be performed is transmitted to the terminal device 10-J.

[0105] In step S5, the processing device 21 provided in the authentication server 20 functions as an output unit 213. The processing device 21 transmits a request signal for requesting destination data AD to the database server 40. Also, the processing device 41 provided in the database server 40 functions as an acquisition unit 411. The processing device 41 acquires a request signal for requesting destination data AD from the authentication server 20.

[0106] In step S6, the processing device 41 provided in the database server 40 functions as an output unit 413. The processing device 41 transmits the destination data AD to the authentication server 20. Also, the processing device 21 provided in the authentication server 20 functions as an acquisition unit 211. The processing device 21 acquires the destination data AD from the database server 40.

[0107] In step S7, the processing device 21 provided in the authentication server 20 functions as an output unit 213. The processing device 21 transmits the authentication result indicating that the terminal device 10-J has been authenticated and the destination data AD to the terminal device 10-J. Also, the processing device 11 provided in the terminal device 10-J functions as a fourth acquisition unit 111-4. The processing device 11 acquires the authentication result indicating that the terminal device 10-J has been authenticated and the destination data AD from the authentication server 20. Further, the processing device 11 stores the acquired authentication result and destination data AD in the storage device 12.

[0108] In step S8, the processing device 11 provided in the terminal device 10-J functions as a fourth acquisition unit 111-4. The processing device 11 J acquires text information TI indicating the text corresponding to the content of the message M input by the user U into the terminal device 10-J. The text may be the text input by the user U into the terminal device 10-J via the input device 15. Alternatively, the text may be the text read by the processing device 11 from a device external to the terminal device 10-J. J

[0109] In step S9, the processing device 11 provided in the terminal device 10-J functions as a display control unit 113. The processing device 11 outputs a request signal to the storage device 12, requesting the destination data AD and the rendering data RD stored in the storage device 12.

[0110] ​In step S10, the processing device 11 provided in the terminal device 10-J functions as the display control unit 113. The processing device 11 acquires the destination data AD and the effect data RD stored in the storage device 12 from the storage device 12.

[0111] In step S11, the processing device 11 provided in the terminal device 10-J functions as the display control unit 113. The processing device 11 causes the display 14 to display a preview screen of the message M transmitted by the user U J Specifically, the processing device 11 causes the display 14 to display the text indicated by the text information TI acquired in step S8. Further, using the destination data AD acquired in step S10, the processing device 11 causes the display 14 to display a selection screen for selecting a desired destination from a plurality of destination candidates. Furthermore, using the effect data RD acquired in step S10, the processing device 11 causes the display 14 to display a selection screen for selecting one or more effects for the message M. The selection screen for selecting the effect includes a screen for selecting the virtual object VO used for the effect and a screen for selecting the position where the virtual object VO is displayed in the virtual reality space VS. The user U J selects one or more destinations, one or more effects, and one or more positions on these selection screens. The processing device 11 displays a preview screen of the message M according to the selection result of the user U J . If there is no problem with the message M displayed on the preview screen, the user U J finally clicks the "Determine" button as an example.

[0112] In step S12, the processing device 11 provided in the terminal device 10-J stores the selection result of the destination selected by the user U J , the selection result of the effect, the position information SI indicating the display position of the virtual object VO in the virtual reality space VS, and the text information TI acquired in step S8 in the storage device 12.

[0113] In step S13, the processing device 11 provided in the terminal device 10-J functions as an output unit 114. The processing device 11 associates the destination ID corresponding to the selection result of the destination stored in the storage device 12 in step S12, the effect ID corresponding to the selection result of the effect, the position information SI, and the text information TI with the source ID indicating the source terminal device 10-J, and transmits them to the message management server 30. Also, the processing device 31 provided in the message management server 30 functions as an acquisition unit 311. The processing device 31 acquires the destination ID, the source ID, the effect ID, the position information SI, and the text information TI from the terminal device 10-J. Further, the processing device 31 stores the acquired destination ID, source ID, effect ID, position information SI, and text information TI in the message database MDB.

[0114] In step S14, the processing device 31 provided in the message management server 30 functions as an output unit 313. The processing device 31 transmits an ACK signal to the terminal device 10-J.

[0115] 1-2-2: Operation at the time of message reception by the terminal device 10-J FIG. 10A and FIG. 10B are sequence diagrams showing the operation at the time of message reception by the terminal device 10-J. In particular, FIG. 10A and FIG. 10B are sequence diagrams showing the operation at the time of message reception when the effect data RD corresponding to the effect ID acquired by the terminal device 10-J does not exist in the storage device 12.

[0116] In step S21, the processing device 31 provided in the message management server 30 functions as an output unit 313. The processing device 31 transmits a notification signal to the terminal device 10-J notifying that a message M addressed to the terminal device 10-J has arrived. The notification signal includes the above message ID. Also, the processing device 11 provided in the terminal device 10-J functions as a fourth acquisition unit 111-4. The processing device 11 acquires the above notification signal from the message management server 30.

[0117] In step S22, the processing device 11 provided in the terminal device 10-J functions as an output unit 114. The processing device 11 transmits the authentication information CI stored in the storage device 12 to the authentication server 20. Also, the processing device 21 provided in the authentication server 20 functions as an acquisition unit 211. The processing device 21 acquires the authentication information CI from the terminal device 10-J.

[0118] In step S23, the processing device 21 provided in the authentication server 20 functions as an authentication unit 212. The processing device 21 collates the authentication information CI acquired in step S22 with the authentication information CI stored in the authentication information database CDB to authenticate the terminal device 10-J.

[0119] In step S24, the processing device 21 provided in the authentication server 20 functions as an output unit 213. The processing device 21 transmits the authentication result of the terminal device 10-J to the terminal device 10-J. When the authentication result is that the terminal device 10-J is authenticated, the information processing system 1 executes the following steps.

[0120] In step S25, the processing device 11 provided in the terminal device 10-J functions as an output unit 114. The processing device 11 transmits a request signal for requesting the message M to the message management server 30. The request signal includes the above message ID. Also, the processing device 31 provided in the message management server 30 functions as an acquisition unit 311. The processing device 31 acquires the above request signal from the terminal device 10-J.

[0121] In step S26, the processing device 31 provided in the message management server 30 functions as a collation unit 312. The processing device 31 collates the message ID included in the request signal acquired in step S25 with the message ID included in the message database MDB. Also, the processing device 31 functions as an output unit 313. The processing device 31 reads out the sender ID, the effect ID, the position information SI, and the text information TI corresponding to the message ID collated by the collation unit 312 from the message database MDB and transmits them to the terminal device 10-J. Further, the processing device 11 provided in the terminal device 10-J functions as a first acquisition unit 111-1. The processing device 11 acquires the sender ID, the effect ID, the position information SI, and the text information TI from the message management server 30 via the communication device 13. Also, the processing device 11 stores the acquired sender ID, effect ID, position information SI, and text information TI in the storage device 12 in a format associated with the message ID.

[0122] In step S27, the processing device 11 provided in the terminal device 10-J functions as a determination unit 112. The processing device 11 determines whether or not the effect data RD corresponding to the effect ID acquired in step S26 exists in the storage device 12. Here, it is assumed that the determination result is negative, that is, the effect data RD corresponding to the effect ID does not exist in the storage device 12. The processing device 11 functions as an output unit 114. The processing device 11 transmits the above effect ID to the message management server 30. The processing device 31 provided in the message management server 30 functions as an acquisition unit 311. The processing device 31 acquires the above effect ID from the terminal device 10-J.

[0123] In step S28, the processing device 31 provided in the message management server 30 functions as an output unit 313. The processing device 31 transmits a request signal for requesting the production data RD corresponding to the above production ID to the database server 40 via the communication device 33. The request signal includes the above production ID. Further, the processing device 41 provided in the database server 40 functions as an acquisition unit 411. The processing device 41 acquires the above request signal from the message management server 30 via the communication device 43.

[0124] In step S29, the processing device 41 provided in the database server 40 functions as a collation unit 412. The processing device 41 collates the production ID included in the request signal acquired from the terminal device 10-J in step S28 with the production ID included in the production database RDB. Further, the processing device 41 functions as an output unit 413. The processing device 41 reads out the production data RD corresponding to the collated production ID from the production database RDB and transmits it to the message management server 30. Also, the processing device 31 provided in the message management server 30 functions as an acquisition unit 311. The processing device 31 acquires the production data RD corresponding to the above production ID from the database server 40.

[0125] In step S30, the processing device 31 provided in the message management server 30 functions as an output unit 313. The processing device 31 transmits the production data RD corresponding to the above production ID acquired in step S29 to the terminal device 10-J. Further, the processing device 11 provided in the terminal device 10-J functions as a second acquisition unit 111-2. The processing device 11 acquires the production data RD corresponding to the above production ID from the message management server 30.

[0126] In step S31, the processing device 11 provided in the terminal device 10-J functions as a display control unit 113. The processing device 11 acquires the position information SI associated with the message ID included in the notification signal acquired in step S21 from the storage device 12.

[0127] In step S32, the processing device 11 provided in the terminal device 10-J functions as the display control unit 113. Using the image data included in the effect data RD acquired in step S30, the processing device 11 renders a virtual object VO used for the effect of the message M. Also, using the position information SI acquired in step S26, the processing device 11 aligns the rendered virtual object VO within the virtual reality space VS.

[0128] In step S33, the processing device 11 provided in the terminal device 10-J functions as the display control unit 113. The processing device 11 causes the display device to display the virtual reality space VS including the message M on which the effect using the virtual object VO has been performed.

[0129] In step S34, the processing device 11 provided in the terminal device 10-J functions as the third acquisition unit 111-3. The processing device 11 acquires operation information OI indicating the content of an operation J performed by the user U as the main body with respect to the virtual object VO used for the effect.

[0130] In step S35, the processing device 11 provided in the terminal device 10-J stores the operation information OI acquired in step S34 in the storage device 12.

[0131] In step S36, the processing device 11 provided in the terminal device 10-J functions as the output unit 114. The processing device 11 transmits the operation information OI stored in the storage device 12 in step S34 to the message management server 30. Also, the processing device 31 provided in the message management server 30 functions as the acquisition unit 311. The processing device 31 acquires the operation information OI from the terminal device 10-J.

[0132] In step S37, the processing device 31 provided in the message management server 30 executes a synchronization process between the terminal devices 10-1 to 10-J that share the virtual reality space VS with the terminal device 10-J by using the operation information OI acquired in step S36. Specifically, the processing device 31 functions as an output unit 313. The processing device 31 transmits the above operation information OI to any one of the terminal devices 10-1 to 10-J that are the transmission sources of the message M, and the terminal devices 10-1 to 10-J that share the virtual reality space VS or the virtual object VO with the terminal device 10-J. The terminal devices 10-1 to 10-J that have acquired the operation information OI apply the acquired operation information OI to the virtual object VO corresponding to the virtual object VO that is the operation target of the user U J in the virtual reality space VS displayed on their own display devices. As a result, the virtual object VO displayed on the display device becomes a state in which the operation centered on the user U J is reflected.

[0133] In step S39, the processing device 11 provided in the terminal device 10-J functions as a display control unit 113. The processing device 11 acquires the operation information OI from the storage device 12. Further, the processing device 11 uses the image data, the position information SI, and the operation information OI included in the effect data RD used in step S32 to render the virtual object VO in which the operation centered on the user U J is reflected, and performs alignment in the virtual reality space VS.

[0134] In step S40, the processing device 11 provided in the terminal device 10-J functions as a display control unit 113. The processing device 11 causes the display device to display the virtual reality space VS including the message M on which the effect using the virtual object VO after the operation centered on the user U J is performed.

[0135] FIG. 11A and FIG. 11B are sequence diagrams showing the operations at the time of message reception by the terminal device 10-J. In particular, FIGS. 11A and 11B are sequence diagrams showing the operations at the time of message reception when the production data RD corresponding to the production ID acquired by the terminal device 10-J exists in the storage device 12.

[0136] Note that, for the sake of simplifying the explanation below, among the operations described in FIGS. 11A and 11B, the operations identical to those described in FIGS. 10A and 10B will not be described in detail, and basically, the correspondence relationship between the steps of both will be described.

[0137] Steps S51 to S56 are the same as steps S21 to S26 in FIGS. 10A and 10B.

[0138] In step S57, the processing device 11 provided in the terminal device 10-J functions as a determination unit 112. The processing device 11 determines whether or not the production data RD corresponding to the production ID acquired in step S26 exists in the storage device 12. Here, it is assumed that the determination result is affirmative, that is, the production data RD corresponding to the production ID exists in the storage device 12. The processing device 11 functions as a display control unit 113. The processing device 11 acquires, from the storage device 12, the production data RD corresponding to the production ID and the position information SI associated with the message ID included in the notification signal acquired in step S21.

[0139] Steps S58 to S66 are the same as steps S32 to S40 in FIGS. 10A and 10B.

[0140] 1-3: Effects of the First Embodiment According to the above description, the terminal device 10-J as a display control device includes a first acquisition unit 111-1, a storage device 12, a second acquisition unit 111-2, and a display control unit 113. The first acquisition unit 111-1 acquires, from an external device, a message M and an effect ID which is an identifier indicating the type of effect applied to the message M using a virtual object VO. The storage device 12 stores a plurality of effect data RD that correspond one-to-one to a plurality of types of effects. The second acquisition unit 111-2 acquires, based on the effect ID which is the above identifier, one piece of effect data RD from among the plurality of effect data RD stored in the storage device 12. The display control unit 113 performs an effect using the virtual object VO included in the one piece of effect data RD acquired by the second acquisition unit 111-2 on the above message M. Further, the display control unit 113 causes a virtual reality space VS including the message M on which the above effect has been performed to be displayed on a display 14 as a display device.

[0141] Since the terminal device 10-J has the above configuration, compared with the prior art, it is possible to perform an effect on the message M using an image with a large capacity in the virtual reality space VS while suppressing the communication capacity. In particular, the terminal device 10-J does not need to perform a huge amount of communication for performing an effect on the message M between the terminal devices 10-1 to 10-N. As a result, the synchronization process among the terminal devices 10-1 to 10-N sharing the virtual reality space VS becomes stable.

[0142] Further, according to the above description, in the terminal device 10-J, the first acquisition unit 111-1 further acquires, from an external device, position information SI indicating a position in the virtual reality space VS where the virtual object VO used in the effect should be displayed. The display control unit 113 causes the virtual object VO used in the effect to be displayed at the position indicated by the above position information SI in the virtual reality space VS.

[0143] Since the terminal device 10-J has the above configuration, when producing the message M using the virtual object VO, it is possible to display the virtual object VO at a desired location in the virtual reality space VS. Also, the terminal device 10-J acquires the above position information SI from an external device. As a result, for the terminal device 10-J, the display position of the virtual object VO in the virtual reality space VS can be specified from the message M's source.

[0144] Also, according to the above description, the terminal device 10-J further includes a third acquisition unit 111-3 and an output unit 114. The third acquisition unit 111-3 acquires operation information OI indicating the content of an operation mainly performed by the user U on the virtual object VO used in the production in the virtual reality space VS. J The output unit 114 outputs the above operation information OI to an external device.

[0145] Since the terminal device 10-J has the above configuration, an operation mainly performed by the user U on the virtual object VO in the virtual reality space VS can also be applied to the virtual object VO that the other terminal devices 10-1 to 10-N display on the display device. As a result, it becomes possible to synchronize the virtual object VO after being operated by the user U and the virtual object VO that the other terminal devices 10-1 to 10-N display. J Also, according to the above description, in the terminal device 10-J, when the above production data RD does not exist in the storage device 12, the second acquisition unit 111-2 acquires the production data RD from an external device and stores the production data RD in the storage device 12. J

[0146]

[0147] Since the terminal device 10-J has the above configuration, when it does not store the production data RD corresponding to the production ID, it can produce the message M using the production data RD acquired from an external device. Further, the terminal device 10-J stores the production data RD in the storage device 12, and then, when the same production ID is acquired again, it can use the production data RD stored in the storage device 12.

[0148] Also, according to the above description, in the terminal device 10-J, the first acquisition unit 111-1 acquires an encapsulated file. The file includes the message M and a production ID which is an identifier indicating the type of production. A specific extension is given to the file to specify that a production is to be performed on the message M. The second acquisition unit 111-2 acquires the above one production data from the storage device 12 when the extension of the information acquired by the first acquisition unit 111-1 is the specific extension. The display control unit 113 causes the display 14 as a display device to display the virtual reality space VS including the message M on which the above production has been performed when the extension of the information acquired by the first acquisition unit 111-1 is the above specific extension.

[0149] The terminal device 10-J as a display control device may acquire various types of information from an external device. The terminal device 10-J acquires an encapsulated file to which a specific extension is given. Since the terminal device 10-J has the above configuration, it detects the extensions of various types of information acquired from an external device, and when the detected extension is the specific extension, it executes a production on the message M. Therefore, the terminal device 10-J as a display control device can identify a file on which a production is to be executed only by monitoring the extension.

[0150] 2: Modification Example The present disclosure is not limited to the embodiments illustrated above. Specific modification modes are illustrated below. Two or more modes arbitrarily selected from the following illustrations may be combined.

[0151] 2-1: Modification Example 1 In the information processing system 1 according to the first embodiment, the message management server 30 includes a message database MDB. However, instead of the message management server 30, the database server 40 may include the message database MDB. In this case, the message management server 30 manages the message database MDB provided in the database server 40 by connecting to the database server 40 via the communication network NET.

[0152] 2-2: Modification Example 2 In the information processing system 1 according to the first embodiment, as shown in FIGS. 2A, 2B, and 3, the terminal device 10-J provides the virtual reality space VS as a virtual space to the user U J However, the virtual space provided by the terminal device 10-J is not limited to the virtual reality space VS. For example, the terminal device 10-J may provide either the augmented reality space or the mixed reality space as a virtual space to the user U J Similarly, for the terminal device 10-K, either the virtual reality space, the augmented reality space, or the mixed reality space may be provided as a virtual space to the user U K Also, the type of virtual space provided by the terminal device 10-J to the user U J and the type of virtual space provided by the terminal device 10-K to the user U K may be different from each other. The same applies to the terminal devices 10-1 to 10-N other than the terminal devices 10-J and 10-K among the terminal devices 10-1 to 10-N.

[0153] 2-3: Modification Example 3 In the information processing system 1 according to the first embodiment, when the terminal device 10-J displays a preview screen at the time of transmitting the message M, a selection screen for selecting one or more effects for the message M is displayed using a plurality of effect data RD acquired from the storage device 12. However, instead of the storage device 12, the terminal device 10-J may be connected to the database server 40 via the communication network NET, and display the above selection screen using a plurality of effect data RD acquired from the effect database RDB provided in the database server 40.

[0154] 3: Others (1) In the above-described embodiments, the storage devices 12, 22, 32, and 42 are exemplified by ROM and RAM, but flexible disks, magneto-optical disks (e.g., compact disks, digital versatile disks, Blu-ray (registered trademark) disks), smart cards, flash memory devices (e.g., cards, sticks, key drives), CD-ROM (Compact Disc-ROM), registers, removable disks, hard disks, floppy (registered trademark) disks, magnetic strips, databases, servers, and other suitable storage media. Also, the program may be transmitted from a network via a telecommunication line. Also, the program may be transmitted from the communication network NET via a telecommunication line.

[0155] (2) In the above-described embodiments, the information, signals, etc. described may be represented using any of a variety of different technologies. For example, data, instructions, commands, information, signals, bits, symbols, chips, etc. that may be referred to throughout the above description may be represented by voltage, current, electromagnetic waves, magnetic fields or magnetic particles, optical fields or photons, or any combination thereof.

[0156] (3) In the above-described embodiments, the input and output information, etc. may be stored in a specific location (e.g., memory), or may be managed using a management table. The input and output information, etc. can be overwritten, updated, or appended. The output information, etc. may be deleted. The input information, etc. may be transmitted to other devices.

[0157] (4) In the above-described embodiments, the determination may be made based on a value represented by 1 bit (0 or 1), or may be made based on a boolean value (Boolean: true or false), or may be made by comparing numerical values (e.g., comparison with a predetermined value).

[0158] (5) The processing procedures, sequences, flowcharts, etc. exemplified in the above-described embodiments may be reordered as long as there is no contradiction. For example, for the methods described in the present disclosure, the elements of various steps are presented using an exemplary order and are not limited to the specific order presented.

[0159] (6) Each function exemplified in FIGS. 1 to 11B is realized by any combination of at least one of hardware and software. Also, the method of realizing each functional block is not particularly limited. That is, each functional block may be realized using one physically or logically combined device, or two or more physically or logically separated devices may be directly or indirectly (e.g., using wired, wireless, etc.) connected and realized using these multiple devices. The functional block may be realized by combining software with the above one device or the above multiple devices.

[0160] (7) The programs exemplified in the above-described embodiments should be broadly interpreted to mean instructions, instruction sets, code, code segments, program code, programs, subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executable files, execution threads, procedures, functions, etc., whether called by the names of software, firmware, middleware, microcode, hardware description languages, or other names.

[0161] Also, software, instructions, information, etc. may be transmitted and received via a transmission medium. For example, when software is transmitted from a website, server, or other remote source using at least one of wired technologies (such as coaxial cables, fiber optic cables, twisted pairs, digital subscriber lines (DSLs)) and wireless technologies (such as infrared rays, microwaves), at least one of these wired and wireless technologies is included within the definition of the transmission medium.

[0162] (8) In each of the foregoing embodiments, the terms "system" and "network" are used interchangeably.

[0163] (9) The information, parameters, etc. described in the present disclosure may be represented using absolute values, relative values from a predetermined value, or corresponding other information.

[0164] (10) In the above-described embodiments, the terminal devices 10-1 to 10-N, the authentication server 20, the message management server 30, and the database server 40 may include cases where they are mobile stations (MS: Mobile Station). A mobile station may be referred to by those skilled in the art as a subscriber station, mobile unit, subscriber unit, wireless unit, remote unit, mobile device, wireless device, wireless communication device, remote device, mobile subscriber station, access terminal, mobile terminal, wireless terminal, remote terminal, handset, user agent, mobile client, client, or some other suitable term. Also, in the present disclosure, terms such as "mobile station", "user terminal", "user equipment (UE)", "terminal", etc. may be used interchangeably.

[0165] (11) In the above-described embodiments, the terms "connected" and "coupled", or any variations thereof, mean any direct or indirect connection or coupling between two or more elements, including the presence of one or more intermediate elements between two elements that are "connected" or "coupled" to each other. The coupling or connection between elements may be a physical coupling or connection, a logical coupling or connection, or a combination thereof. For example, "connected" may be read as "accessed". As used in the present disclosure, two elements are considered to be "connected" or "coupled" to each other using at least one of one or more wires, cables, and printed electrical connections, and also, as some non-limiting and non-exhaustive examples, electromagnetic energy having wavelengths in the radio frequency region, microwave region, and optical (both visible and invisible) region.

[0166] (12) In the above-described embodiments, the description "based on" does not mean "only based on" unless otherwise specified. In other words, the description "based on" means both "only based on" and "at least based on".

[0167] (13) As used in this disclosure, the terms "determining" and "deciding" may encompass a wide variety of operations. "Determining" and "deciding" may include, for example, judging, calculating, computing, processing, deriving, investigating, looking up (e.g., searching in a table, database, or other data structure), ascertaining, and considering something as having "determined" or "decided" something. Also, "determining" and "deciding" may include considering something as having "determined" or "decided" something after receiving (e.g., receiving information), transmitting (e.g., transmitting information), inputting, outputting, accessing (e.g., accessing data in memory). Further, "determining" and "deciding" may include considering something as having "determined" or "decided" something after resolving, selecting, choosing, establishing, comparing, etc. That is, "determining" and "deciding" may include considering something as having "determined" or "decided" some action. Also, "determining (deciding)" may be read as "assuming", "expecting", "considering", etc.

[0168] (14) In the above-described embodiments, when the terms "include", "including" and their variants are used, these terms are intended to be inclusive, similar to the term "comprising". Further, the term "or" used in this disclosure is not intended to be an exclusive disjunction.

[0169] (15) In the present disclosure, for example, when an article is added by translation, such as a, an, and the in English, the present disclosure may include that the noun following these articles is in the plural form.

[0170] (16) In the present disclosure, the term "A and B are different" may mean that "A and B are different from each other". Note that the term may also mean that "A and B are each different from C". Terms such as "separate", "coupled", etc. may also be interpreted in the same way as "different".

[0171] (17) Each aspect / embodiment described in the present disclosure may be used alone, in combination, or switched and used during execution. Also, the notification of a predetermined piece of information (for example, the notification of "being X") is not limited to an explicitly made notification, and may be made implicitly (for example, by not making the notification of the predetermined piece of information).

[0172] As described in detail above about the present disclosure, it is obvious to those skilled in the art that the present disclosure is not limited to the embodiments described in the present disclosure. The present disclosure can be implemented as modified and changed aspects without departing from the spirit and scope of the present disclosure determined by the description of the claims. Therefore, the description of the present disclosure is for the purpose of illustrative explanation and has no restrictive meaning for the present disclosure.

Description of Reference Numerals

[0173] 1... Information processing system, 10, 10-J, 10-K... Terminal devices, 11... Processing device, 12... Memory device, 13... Communication device, 14... Display, 15... Input device, 16... Inertial sensor, 20... Authentication server, 21... Processing device, 22... Memory device, 23... Communication device, 24... Display, 25... Input device, 30... Message management server, 31... Processing device, 32... Memory device, 33... Communication device, 34... Display, 35... Input device, 40... Database server, 41... Processing device, 42... Memory device, 43... Communication device, 44... Display, 45... Input device, 111... Acquisition unit, 111-1... First acquisition unit, 111-2... Second acquisition unit, 111-3... Third acquisition unit, 111-4... Fourth acquisition unit, 112... Determination unit, 113... Display control unit, 114... Output unit, 211... Acquisition unit, 212... Authentication unit, 213... Output unit, 311... Acquisition unit, 312... Verification unit, 313... Output unit, 411... Acquisition unit, 412... Verification unit, 413... Output unit, PR1~PR4... Control programs, VO, VO1~VO3... Virtual objects

Claims

1. a first acquisition unit that acquires, from an external device, a message and an identifier indicating a type of effect applied to the message using a virtual object; a storage device that stores a plurality of pieces of effect data corresponding one-to-one to a plurality of types of effects; a second acquisition unit that acquires, based on the identifier, one piece of effect data from among the plurality of pieces of effect data from the storage device; a display control unit that performs an effect using the virtual object included in the one piece of effect data acquired by the second acquisition unit on the message, and causes a display device to display a virtual space including the message on which the effect has been performed; the first acquisition unit acquires a encapsulated file; the file includes the message and the identifier; the second acquisition unit acquires the one piece of effect data from the storage device when a specific extension for designating to perform an effect on the message is attached to the file acquired by the first acquisition unit.

2. the first acquisition unit further acquires position information indicating a position in the virtual space where the virtual object used in the effect is to be displayed, from the external device; the display control unit displays the virtual object used in the effect at the position indicated by the position information in the virtual space; The display control device according to claim 1.

3. a third acquisition unit that acquires operation information indicating the content of a user operation on the virtual object used in the effect, which is arranged in the virtual space; an output unit that outputs the operation information to the external device; The display control device according to claim 1 or claim 2.

4. when the effect data corresponding to the type of effect indicated by the identifier is not stored in the storage device, the second acquisition unit acquires the effect data from the external device and stores the acquired effect data in the storage device.

Images