Display Control Device

Abstract

This display control device comprises: a destination acquisition unit that acquires at least one destination which is the transmission destination of a message and which corresponds to a place in a real space corresponding to a location in a virtual space in which a virtual object related to the message is placed, such acquisition carried out on the basis of place information indicating the place in the real space and correspondence relationship information indicating the correspondence relationship between the place in the real space and the at least one destination which is the transmission destination of the message; and a display control unit that causes a display device to display a virtual space that includes the virtual object and a destination image representing the at least one destination.

Description

[Technical Field]

[0001] The present invention relates to a display control device, and more particularly to a display control device that displays a virtual object related to a message in a virtual space. [Background technology]

[0002] XR technology, including VR (Virtual Reality), AR (Augmented Reality), and MR (Mixed Reality), may display messages represented by virtual objects in a virtual space displayed in XR glasses worn by a user on their head.

[0003] For example, Patent Document 1 discloses a technology for sharing messages to facilitate communication between users in a virtual space. Specifically, Patent Document 1 discloses a technology for displaying a virtual object showing a "graffiti message" in a virtual space shared between users. This "graffiti message" can be viewed by any user who has access to the virtual space. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Special Publication No. 2010-535363 Summary of the Invention [Problem to be solved by the invention]

[0005] However, because conventional technologies are technologies in which virtual objects representing messages are shared among users who can access a virtual space, there is no destination for the message itself. Therefore, conventional technologies do not allow users to check the destination in the virtual space for messages that have destinations. Furthermore, when a user specifies a destination and sends a message in the virtual space, there is no physical keyboard in the virtual space, making it difficult to input the destination. For example, if a virtual keyboard were to be displayed in the virtual space, the user would need to click each character on the virtual keyboard to input the destination.

[0006] SUMMARY OF THE INVENTION It is therefore an object of the present invention to provide a display control device that allows a user to easily specify and confirm the destination when sending a message to another user in a virtual space. [Means for solving the problem]

[0007] A preferred embodiment of the present invention provides a display control device that includes a destination extraction unit (destination acquisition unit) that extracts at least one destination to which a message is to be sent, the destination corresponding to a location in real space that corresponds to a position in virtual space where a virtual object related to a message is placed, based on location information indicating the location in the real space and correspondence information indicating a correspondence between the location in the real space and the at least one destination to which the message is to be sent, and a display control unit that causes a display device to display the virtual space including the virtual object and a destination image indicating the at least one destination. [Effects of the Invention]

[0008] According to the present invention, when sending a message to another user in a virtual space, the destination can be easily specified and confirmed. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a diagram showing the overall configuration of an information processing system 1 according to a first embodiment. [Figure 2] 1 is a perspective view showing the appearance of XR glasses 20 according to a first embodiment. [Figure 3] 1 is a schematic diagram of a composite space MS in which a virtual space VS and a real space RS are superimposed, which is provided to a user UK when using the XR glasses 20 according to the first embodiment. [Figure 4] FIG. 2 is a block diagram showing an example of the configuration of XR glasses 20 according to the first embodiment. [Figure 5] FIG. 2 is a block diagram showing an example of the configuration of a terminal device 10-K according to the first embodiment. [Figure 6] An example of the structure of the correspondence database CD. [Figure 7] FIG. 2 is a functional block diagram of an acquisition unit 111. [Figure 8] FIG. 3 is a functional block diagram of a generation unit 112. [Figure 9] 3 is an explanatory diagram showing an example of the operations of a generating unit 112, a destination acquiring unit 113, a display control unit 114, a receiving unit 115, and a communication control unit 116. FIG. [Figure 10] 3 is an explanatory diagram showing an example of the operations of a generating unit 112, a destination acquiring unit 113, a display control unit 114, a receiving unit 115, and a communication control unit 116. FIG. [Figure 11] 3 is an explanatory diagram showing an example of the operations of a generating unit 112, a destination acquiring unit 113, a display control unit 114, a receiving unit 115, and a communication control unit 116. FIG. [Figure 12] FIG. 2 is a block diagram showing an example of the configuration of a server 30. [Figure 13] 10 is a flowchart showing the operation of the terminal device 10-K according to the first embodiment. [Figure 14] FIG. 11 is a functional block diagram of an acquisition unit 111C. [Figure 15] FIG. 11 is a functional block diagram of a generation unit 112C. DETAILED DESCRIPTION OF THE INVENTION

[0010] 1: First embodiment An information processing system 1 including a terminal device 10-K as a display control device according to a first embodiment of the present invention will be described below with reference to FIGS.

[0011] 1-1: Configuration of the first embodiment 1-1-1: Overall structure Fig. 1 shows the overall configuration of an information processing system 1. As shown in Fig. 1, the information processing system 1 includes terminal devices 10-1, 10-2, ... 10-K, ... 10-J, XR glasses 20, and a server 30. J is an integer equal to or greater than 1. K is an integer equal to or greater than 1 and equal to or less than J. In this embodiment, the terminal devices 10-1, 10-2, ... 10-K, ... 10-J have the same configuration. However, terminal devices with different configurations may be included.

[0012] In the information processing system 1, the terminal device 10-K and the server 30 are connected to each other so as to be able to communicate with each other via a communication network NET. The terminal device 10-K and the XR glasses 20 are also connected to each other so as to be able to communicate with each other. In FIG. 1, a user U K It is assumed that the terminal device 10-K uses a combination of the terminal device 10-K and the XR glasses 20. The terminal device 10-K is an example of a display control device.

[0013] The server 30 provides various data and cloud services to the terminal device 10-K via the communication network NET.

[0014] The terminal device 10-K is a user U K The terminal device 10-K displays virtual objects arranged in a virtual space on the XR glasses 20 worn on the head of the user. The virtual space is, for example, a celestial sphere. Examples of the virtual objects include virtual objects representing data such as still images, videos, 3DCG models, HTML files, and text files, as well as virtual objects representing applications. Examples of text files include memos, source code, diaries, and recipes. Examples of applications include browsers, applications for using SNS, and applications for generating document files. The terminal device 10-K is preferably, for example, a mobile terminal device such as a smartphone or a tablet.

[0015] XR Glasses 20 is a user K The XR glasses 20 are a see-through wearable display worn on the head of a user. The XR glasses 20 display virtual objects on display panels provided in each of the lenses for both eyes based on the control of the terminal device 10-K. The XR glasses 20 are an example of a display device. In the following, an example will be described in which the XR glasses 20 are MR glasses. However, this is merely an example, and the XR glasses 20 may also be VR glasses or AR glasses.

[0016] In particular, in this embodiment, a user U wearing the XR glasses 20 on his / her head K uses the terminal device 10-K to communicate with another user U M Specifically, as will be described later, the user U K In the virtual space, a virtual object related to the message is placed, and the user U M By specifying the destination, user U M where M is an integer between 1 and J, and is other than K.

[0017] 1-1-2: XR Glasses Configuration Fig. 2 is a perspective view showing the appearance of the XR glasses 20. As shown in Fig. 2, the appearance of the XR glasses 20 is similar to that of ordinary eyeglasses, and includes temples 91 and 92, a bridge 93, frames 94 and 95, and lenses 41L and 41R.

[0018] The bridge 93 is provided with an imaging device 26. The imaging device 26 captures an image of the outside world. The imaging device 26 also outputs imaging information indicating the captured image.

[0019] Each of the lenses 41L and 41R is provided with a half mirror. A liquid crystal panel or organic EL panel for the left eye is provided in the frame 94. The liquid crystal panel or organic EL panel will hereinafter be collectively referred to as a display panel. The frame 94 is also provided with an optical member that guides light emitted from the display panel for the left eye to the lens 41L. The half mirror provided in the lens 41L transmits external light to guide it to the left eye, and reflects the light guided by the optical member before making it incident on the left eye. The frame 95 is provided with a display panel for the right eye and an optical member that guides light emitted from the display panel for the right eye to the lens 41R. The half mirror provided in the lens 41R transmits external light to guide it to the right eye, and reflects the light guided by the optical member before making it incident on the right eye.

[0020] The display 28, which will be described later, includes a lens 41L, a display panel for the left eye, and an optical member for the left eye, as well as a lens 41R, a display panel for the right eye, and an optical member for the right eye.

[0021] In the above configuration, user U K The user U can observe the image displayed on the display panel in a see-through state, superimposed on the outside world. Furthermore, the XR glasses 20 display the image for the left eye on the display panel for the left eye, and the image for the right eye on the display panel for the right eye, among the binocular images with parallax. For this reason, the XR glasses 20 allow the user U to K The displayed image is perceived as if it has depth and three-dimensionality.

[0022] FIG. 3 shows the state of a user U when using the XR glasses 20 in this embodiment. K 1 is a schematic diagram of a composite space MS in which a virtual space VS and a real space RS are superimposed, and is provided to a user U. In the real space RS, an object O is placed. K In the complex space MS, on top of the object O, there is another user U M A virtual object VO is set up for the message to be sent to the user U. KWhen the user U places the virtual object VO, a destination image AP is displayed in the virtual space VS included in the composite space MS, showing a list of destinations that are highly relevant to the location in the real space RS where the object O is placed. K is the destination of the message, and is selected from the destinations shown in the destination image AP. M Select the destination of User U K However, if the message is sent to user U, M When you select U M will be sent to.

[0023] 4 is a block diagram showing an example configuration of the XR glasses 20. The XR glasses 20 include a processing device 21, a storage device 22, a gaze detection device 23, a GPS device 24, a motion detection device 25, an imaging device 26, a communication device 27, and a display 28. The elements of the XR glasses 20 are connected to each other by one or more buses for communicating information. Note that the term "device" in this specification may be replaced with other terms such as circuit, device, or unit.

[0024] The processing device 21 is a processor that controls the entire XR glasses 20. The processing device 21 is configured using, for example, one or more chips. The processing device 21 is also configured using, for example, a central processing unit (CPU) that includes an interface with peripheral devices, an arithmetic unit, a register, etc. Some or all of the functions of the processing device 21 may be realized by hardware such as a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), and an FPGA (Field Programmable Gate Array). The processing device 21 executes various processes in parallel or sequentially.

[0025] The storage device 22 is a recording medium that can be read from and written to by the processing device 21. The storage device 22 also stores a plurality of programs including a control program PR2 that the processing device 21 executes.

[0026] The gaze detection device 23 detects the gaze of the user U K After detecting the gaze of the user U, the gaze detection device 23 generates gaze information indicating the detection result. Any method may be used for the gaze detection device 23 to detect the gaze. For example, the gaze detection device 23 may detect the gaze information based on the position of the inner corner of the eye and the position of the iris. The gaze information is K The gaze detection device 23 supplies the gaze information to a processing device 21, which will be described later. The gaze information supplied to the processing device 21 is transmitted to the terminal device 10-K via the communication device 27.

[0027] The GPS device 24 receives radio waves from multiple satellites. The GPS device 24 also generates location information from the received radio waves. The location information indicates the location of the XR glasses 20. The location information may be in any format as long as it can identify the location. The location information indicates, for example, the latitude and longitude of the XR glasses 20. As an example, the location information is obtained from the GPS device 24. However, the XR glasses 20 may obtain the location information by any method. The obtained location information is supplied to the processing device 21. The location information supplied to the processing device 21 is transmitted to the terminal device 10-K via the communication device 27.

[0028] The motion detection device 25 detects the motion of the XR glasses 20. Examples of the motion detection device 25 include inertial sensors such as an acceleration sensor that detects acceleration and a gyro sensor that detects angular acceleration. The acceleration sensor detects acceleration along orthogonal X-, Y-, and Z-axes. The gyro sensor detects angular acceleration around the X-, Y-, and Z-axes as central axes of rotation. The motion detection device 25 can generate posture information indicating the posture of the XR glasses 20 based on the output information of the gyro sensor. The motion information includes acceleration data indicating the acceleration along each of the three axes and angular acceleration data indicating the angular acceleration along each of the three axes. The motion detection device 25 also supplies the posture information indicating the posture of the XR glasses 20 and motion information related to the motion of the XR glasses 20 to the processing device 21. The posture information and motion information supplied to the processing device 21 are transmitted to the terminal device 10-K via the communication device 27.

[0029] The imaging device 26 outputs imaging information obtained by capturing an image of the outside world. The imaging device 26 also includes, for example, a lens, an imaging element, an amplifier, and an AD converter. Light collected through the lens is converted into an imaging signal, which is an analog signal, by the imaging element. The amplifier amplifies the imaging signal and outputs it to the AD converter. The AD converter converts the amplified imaging signal, which is an analog signal, into imaging information, which is a digital signal. The converted imaging information is supplied to the processing device 21. The imaging information supplied to the processing device 21 is transmitted to the terminal device 10-K via the communication device 27.

[0030] The communication device 27 is hardware serving as a transmitting / receiving device for communicating with other devices. The communication device 27 is also called, for example, a network device, a network controller, a network card, a communication module, etc. The communication device 27 may include a connector for wired connection and an interface circuit corresponding to the connector. The communication device 27 may also include a wireless communication interface. Examples of the connector and interface circuit for wired connection include products that comply with wired LAN, IEEE1394, and USB. Examples of the wireless communication interface include products that comply with wireless LAN, Bluetooth (registered trademark), etc.

[0031] The display 28 is a device that displays images. The display 28 displays various images under the control of the processing device 21. As described above, the display 28 includes the lens 41L, a display panel for the left eye, and an optical member for the left eye, as well as the lens 41R, a display panel for the right eye, and an optical member for the right eye. As the display panel, various display panels such as a liquid crystal display panel and an organic EL display panel are suitably used.

[0032] The processing device 21 functions as an acquisition unit 211 and a display control unit 212, for example, by reading out a control program PR2 from the storage device 22 and executing it.

[0033] The acquisition unit 211 acquires image information indicating an image to be displayed on the XR glasses 20 from the terminal device 10-K.

[0034] Furthermore, the acquisition unit 211 acquires gaze information supplied from the gaze detection device 23, position information supplied from the GPS device 24, movement information supplied from the movement detection device 25, and imaging information supplied from the imaging device 26. Then, the acquisition unit 211 supplies the acquired gaze information, position information, movement information, and imaging information to the communication device 27.

[0035] Based on the image information acquired by the acquisition unit 211 from the terminal device 10, the display control unit 212 causes the display 28 to display an image indicated by the image information.

[0036] 1-1-3: Terminal device configuration 5 is a block diagram showing an example of the configuration of the terminal device 10-K. The terminal device 10-K includes a processing device 11, a storage device 12, a communication device 13, a display 14, an input device 15, and an inertial sensor 16. The elements of the terminal device 10-K are connected to each other by one or more buses for communicating information.

[0037] The processing device 11 is a processor that controls the entire terminal device 10-K. The processing device 11 is configured, for example, using one or more chips. The processing device 11 is configured, for example, using a central processing unit (CPU) including an interface with peripheral devices, an arithmetic unit, a register, etc. Some or all of the functions of the processing device 11 may be realized by hardware such as a DSP, an ASIC, a PLD, and an FPGA. The processing device 11 executes various processes in parallel or sequentially.

[0038] The storage device 12 is a recording medium that can be read from and written to by the processing device 11. The storage device 12 also stores a plurality of programs including a control program PR1 executed by the processing device 11. The storage device 12 may also store image information indicating an image to be displayed on the XR glasses 20.

[0039] Furthermore, the storage device 12 stores a correspondence database CD. FIG. 6 shows an example of the configuration of the correspondence database CD. The correspondence database CD shown in FIG. 6 corresponds to one floor of an apartment building. The correspondence database CD shown in FIG. 6 stores location information indicating locations in the real space RS and a correspondence relationship between at least one destination. The location information has an information structure divided into hierarchical levels according to size. In FIG. 6, the structure of the location information included in the correspondence database CD has a hierarchical level corresponding to a "floor" as the hierarchical level corresponding to the largest location. Specifically, the location information includes the "7th floor" of the apartment building as the location of the hierarchical level corresponding to the largest location. In FIG. 7, the structure of the location information included in the correspondence database CD has a hierarchical level corresponding to a "house" as the hierarchical level corresponding to the second largest location. Specifically, the location information includes "T's residence," "N's residence," and "S's residence" on the "7th floor" of the apartment building as the locations of the hierarchical level corresponding to the second largest location. 7, the structure of the location information included in the correspondence database CD has a hierarchical level corresponding to the "room" as the hierarchical level corresponding to the location with the third largest area. Specifically, the location information has, as an example, the "living room," "first bedroom," and "second bedroom" included in the "T's residence" as locations on the hierarchical level corresponding to the location with the third largest area.

[0040] The correspondence database CD also stores a correspondence between a hierarchical location corresponding to the smallest location in the location information structure and at least one destination. The "at least one destination" is an individual or corporation that is highly related to the "smallest location." "Highly related" refers, for example, to a frequency of use of the "smallest location" exceeding a predetermined value. In the example shown in FIG. 7, "NT" and "GT," individuals who are highly related to the "living room" of "T's residence" on the "7th floor," are defined as destinations. Note that in the example shown in FIG. 7, it is assumed that people with the same initials are the same person. For example, "NT" corresponding to the "living room" of "T's residence" on the "7th floor" and "NT" corresponding to the "first bedroom" of "T's residence" on the "7th floor" are the same person. Here, the "destination" of the "at least one destination" is not limited to an individual destination and may be a corporate destination.

[0041] In addition, User U K Alternatively, the correspondence database CD may be input to the terminal device 10-K using the input device 15 described later. Alternatively, the acquisition unit 111 described later may acquire the correspondence database CD from an external device via the communication device 13.

[0042] Returning to the explanation of FIG. 5, the communication device 13 is hardware serving as a transmitting / receiving device for communicating with other devices. The communication device 13 is also called, for example, a network device, a network controller, a network card, or a communication module. The communication device 13 may include a connector for wired connection and an interface circuit corresponding to the connector. The communication device 13 may also include a wireless communication interface. Examples of the connector and interface circuit for wired connection include products that comply with wired LAN, IEEE1394, and USB. Examples of the wireless communication interface include products that comply with wireless LAN, Bluetooth (registered trademark), etc.

[0043] The display 14 is a device that displays images and text information. The display 14 displays various images under the control of the processing device 11. For example, various display panels such as a liquid crystal display panel and an organic EL (Electro Luminescence) display panel are suitably used as the display 14.

[0044] The input device 15 is a device for inputting information to a user U wearing XR glasses 20 on his / her head. K For example, the input device 15 includes a keyboard, a touchpad, a touch panel, or a pointing device such as a mouse. If the input device 15 includes a touch panel, it may also function as the display 14.

[0045] The inertial sensor 16 is a sensor that detects inertial force. The inertial sensor 16 includes, for example, one or more sensors selected from an acceleration sensor, an angular velocity sensor, and a gyro sensor. The processing device 11 detects the attitude of the terminal device 10-K based on the output information of the inertial sensor 16. Furthermore, the processing device 11 accepts the selection of a virtual object VO, the input of characters, and the input of instructions in the virtual space VS based on the attitude of the terminal device 10-K. For example, when a user U K When the user U operates the input device 15 with the central axis of the terminal device 10-K facing a predetermined area in the virtual space VS, the virtual object VO to be placed in the predetermined area is selected. K The operation is, for example, a double tap. K By operating the terminal device 10-K, the user can select the virtual object VO without looking at the input device 15 of the terminal device 10-K.

[0046] The processing device 11 reads and executes the control program PR1 from the storage device 12. As a result, the processing device 11 functions as an acquisition unit 111, a generation unit 112, a destination acquisition unit 113, a display control unit 114, a reception unit 115, and a communication control unit 116.

[0047] 7 is a functional block diagram of the acquisition unit 111. The acquisition unit 111 includes a message acquisition unit 111A and an information acquisition unit 111B.

[0048] The message acquisition unit 111A receives the message from the user U K The message is obtained by, for example, user U. K The message may be a message input by another user U to the terminal device 10-K using the input device 15. Alternatively, the message may be a message acquired by the processing device 11 from an external device via the communication device 13. The message may include a message sent by another user U to the terminal device 10-K using the method described later. M However, when the message is acquired by message acquisition unit 111A, no destination is set for the message.

[0049] The information acquisition unit 111B provides the user U with a floor according to the size of the place. K For example, referring to the correspondence database CD shown in FIG. 6, the user U K The information acquisition unit 111B inputs designation information that designates a "floor," a "house," or a "room" as the "level" of the information structure that divides the location into levels according to the size of the location, which is included in the location information. K The information acquisition unit 111B acquires the specified information input by the user U. K The information acquisition unit 111B may acquire the specified information input by the user U using the input device 15, or may acquire the specified information from an external device via the communication device 13. Alternatively, when the display control unit 114 described later displays a hierarchical image showing a list of layers in the virtual space VS, the information acquisition unit 111B acquires the specified information from the user U received by the receiving unit 115 described later. K The specified information may be acquired based on an operation on the hierarchical image.

[0050] 8 is a functional block diagram of the generation unit 112. The generation unit 112 includes an object generation unit 112A and a location information generation unit 112B.

[0051] The object generation unit 112A generates a virtual object VO related to the message acquired by the message acquisition unit 111A. The object generation unit 112A may generate the virtual object VO using image information that indicates an image to be displayed on the XR glasses 20 and that is stored in the storage device 12. Alternatively, the object generation unit 112A may generate the virtual object VO using image information that indicates an image to be displayed on the XR glasses 20 and that is acquired from the server 30 via the communication device 13.

[0052] The location information generating unit 112B also transmits the virtual object VO generated by the object generating unit 112A to the user U. K Based on the position information indicating the position in the virtual space VS where the user U has installed the virtual object VO and the designation information acquired by the information acquisition unit 111B, the location information indicating the location in the real space RS corresponding to the position in the virtual space VS is generated. For example, assuming mutually orthogonal X-axis, Y-axis, and Z-axis in the virtual space VS, the virtual object VO is positioned along the axis of the user U. K The position information indicating the position in the virtual space VS set by the user U is represented by the coordinates of these three axes. K6, when the position in the virtual space VS indicated by the position information corresponds to a point in the "living room" of the "T residence" on the "7th floor" in the real space RS and the floor indicated by the designation information is the "floor," the location information generation unit 112B generates location information indicating the "7th floor." When the position in the virtual space VS indicated by the position information corresponds to a point in the "first bedroom" of the "N residence" on the "7th floor" in the real space RS and the floor indicated by the designation information is the "house," the location information generation unit 112B generates location information indicating the "N residence" on the "7th floor." Furthermore, if the position in the virtual space VS indicated by the location information corresponds to a point in the "second bedroom" of the "S residence" on the "7th floor" in the real space RS and the floor indicated by the specified information is a "room," the location information generation unit 112B generates location information indicating the "second bedroom" of the "S residence" on the "7th floor."

[0053] Returning to FIG. 5 for explanation, the destination acquisition unit 113 acquires at least one destination corresponding to the location where the virtual object VO is installed, based on the location information generated by the location information generation unit 112B and correspondence information indicating the correspondence between the location of the real space RS and at least one destination that is the transmission destination. For example, referring to FIG. 6, when the location information indicates the "second bedroom" of the "S residence" on the "7th floor," the destination acquisition unit 113 acquires "OS" as a destination corresponding to the location where the virtual object VO is installed. Here, for example, when the location information indicates the "T residence," the destination acquisition unit 113 acquires "NT" and "GT" corresponding to the "living room" included in the "T residence," "NT" corresponding to the "first bedroom" included in the "T residence," and "GT" corresponding to the "second bedroom" included in the "T residence." However, since "NT" corresponding to the "living room" and "NT" corresponding to the "first bedroom" are the same person, when the location information indicates the "T residence," the destination acquisition unit 113 extracts "NT" only once. Similarly, Mr. "GT" corresponding to "Living Room" and Mr. "GT" corresponding to "Second Bedroom" are the same person, so when the location information indicates "T's House", the destination acquisition unit 113 acquires Mr. "GT" only once. In other words, when the location information indicates "T's House", the destination acquisition unit 113 acquires two people, Mr. "NT" and Mr. "GT".

[0054] Returning to the explanation of Figure 5, the display control unit 114 displays a virtual space VS including a virtual object VO generated by the object generation unit 112A and a destination image AP indicating at least one destination acquired by the destination acquisition unit 113 on the XR glasses 20 as a display device.

[0055] As a result, in the virtual space VS, the user U K is another user U M When sending a message to user U, K In particular, users U can easily specify and confirm destinations. K can easily recognize at least one destination that is highly related to a location in the real space RS that corresponds to a position in the virtual space VS where the virtual object VO is placed.

[0056] In addition, the display control unit 114 may display a virtual space VS including a virtual object VO and a hierarchical image showing a list of hierarchies on the XR glasses 20 as a display device before displaying the virtual space VS including the virtual object VO and the destination image AP on the XR glasses 20.

[0057] The reception unit 115 receives the user U's address for the destination image AP. K Furthermore, when the display control unit 114 causes the XR glasses 20 to display the virtual space VS including the hierarchical image, the reception unit 115 receives the user U's operation for the hierarchical image. K Accepts operations.

[0058] The communication control unit 116 receives the user U K Based on the operation of (a), the message is sent to a destination included in the at least one destination.

[0059] 9 to 11 are explanatory diagrams showing an example of the operations of the generation unit 112, the destination acquisition unit 113, the display control unit 114, the reception unit 115, and the communication control unit 116. In Fig. 9, it is assumed that a real space RS and a virtual space VS are superimposed to form a composite space MS. It is assumed that a room C exists in the real space RS, and a table T is installed in the room C.

[0060] In addition, in the virtual space VS, an X-axis, a Y-axis, and a Z-axis that are orthogonal to each other are assumed. K Furthermore, the user U K When viewed from the user, the forward direction along the X axis is the X1 direction, and the backward direction along the X axis is the X2 direction. K Furthermore, the user U K When viewed from the left, the right direction along the Y axis is the Y1 direction, and the left direction along the Y axis is the Y2 direction. These X and Y axes form a horizontal plane. The Z axis is perpendicular to the XY plane and is the direction of the user U K Furthermore, the user U KWhen viewed from the user's perspective, the downward direction along the Z axis is the Z1 direction, and the upward direction along the Z axis is the Z2 direction. These X, Y, and Z axes are applied not only to the virtual space VS but also to the composite space MS. In FIG. 9, the user U K is located at (x, y, z) = (0, 0, 0). In addition, in room C, the coordinates of the center position in the X-axis direction, Y-axis direction, and Z-axis direction of the table top of table T in the complex space MS are (x, y, z) = (x T ,y T ,z T )

[0061] Here, user U K For example, it is assumed that a message is created using the input device 15 provided in the terminal device 10-K. The message acquisition unit 111A provided in the acquisition unit 111 acquires the message.

[0062] The object generation unit 112A generates a virtual object VO related to the message acquired by the message acquisition unit 111A. The display control unit 114 displays the virtual object VO in the virtual space VS. In the example shown in FIG. 9, the virtual object VO is assumed to be spherical. However, the shape of the virtual object VO is not limited to a spherical shape. For example, the virtual object VO may be a rectangular parallelepiped or a sheet shape.

[0063] Here, user U K In the composite space MS, a virtual object VO is placed on the top of a table T. More specifically, a user U K Assume that the virtual object VO is placed at a position where the coordinates of the center of the virtual object VO are (x, y, z)=(x1, y1, z1).

[0064] 10, the display control unit 114 causes the XR glasses 20 to display a virtual space VS including the virtual object VO and a layer image LP showing a total of three layers, "floor," "house," and "room," as a layer list. KAssume that user U double-tap on "Floor" from among the layers shown in the layer image LP. K As an operation of K The information acquisition unit 111B included in the acquisition unit 111 acquires designation information that designates the "floor" as a level according to the size of the location. That is, in the example shown in FIG. 10, the information acquisition unit 111B acquires designation information that designates the "floor" of the user U. K After the virtual object VO is placed in the virtual space VS, the specified information is acquired. K After placing a virtual object VO in the virtual space VS, the user can specify the scale of the unit to be used as the location unit of the real space RS that includes the position where the virtual object VO is placed.

[0065] The location information generating unit 112B generates location information indicating the position of the virtual object VO in the virtual space VS, that is, the position where the coordinates of the center of the virtual object VO are (x, y, z) = (x1, y1, z1), and the location information indicating the position of the user U. K For example, the coordinates (x, y, z) = (x1, y1, z1) of the center of the virtual object VO are a position in the "living room" of "N's house" on the "7th floor" in the correspondence database CD illustrated in FIG. 6, and the location information is generated based on the specified information specified by the user U. K If the specified information specified by user U is "floor", the location information generating unit 112B generates location information of "7F". K can specify "7F" in terms of "floor" as the location of the real space RS in order to recognize at least one destination that is highly related to the location of the real space RS corresponding to the position in the virtual space VS where the virtual object VO is placed.

[0066] The destination acquisition unit 113 acquires at least one destination corresponding to the location where the virtual object VO is installed, based on the location information "7F" and the correspondence information included in the correspondence database CD. Specifically, in the correspondence database CD illustrated in Fig. 6, the destinations corresponding to "7F" are six people: Mr. NT, Mr. GT, Mr. TN, Mr. UN, Mr. AS, and Mr. OS. The destination acquisition unit 113 acquires the destinations of these six people.

[0067] 11, the display control unit 114 displays on the XR glasses 20 a virtual space VS including the virtual object VO and a destination image AP showing the destinations acquired by the destination acquisition unit 113, namely, Mr. NT, Mr. GT, Mr. TN, Mr. UN, Mr. AS, and Mr. OS, a total of six destinations. Note that in FIG. 11, the destination image AP shows only some of the destinations of Mr. NT, Mr. GT, Mr. TN, Mr. UN, Mr. AS, and Mr. OS. However, the destination image AP may be an image including all of the destinations. As shown in FIG. 11, when only some of the destinations are included in the destination image AP, for example, the destination image AP of user U K After touching the destination image AP, the user may scroll through a list of multiple destinations displayed as the destination image AP to check all of the destinations. K However, the configuration may also be such that when a destination that is not the message destination is tapped once in the list of multiple destinations displayed as the destination image AP, the tapped destination is deleted and a new destination that was not yet displayed is displayed.

[0068] Here, user U K is the destination image AP, and other users U M Assume that the user double-tap on "UN". K Accepts double taps on addresses that refer to "UN."

[0069] The communication control unit 116 is K11, the communication control unit 116 selects the user U from the list of destinations shown in the destination image AP. K The user U sends a message addressed to "UN" who double-tapped the screen. Specifically, the communication control unit 116 outputs the message addressed to "UN" to the server 30 via the communication device 13. As will be described later, the server 30 outputs the message addressed to "UN" to the terminal device 10-M used by "UN". As a result, the user U K In the virtual space VS, other users U M When sending a message to another user, you can simply specify the recipient of the message and then M You can send a message to user U. K Alternatively, the user may double-tap multiple destinations from the list of destinations displayed in the destination image AP, which causes the communication control unit 116 to send a message to the multiple destinations via the communication device 13.

[0070] 1-1-4: Server configuration 12 is a block diagram showing an example of the configuration of the server 30. The server 30 includes a processing device 31, a storage device 32, a communication device 33, a display 34, and an input device 35. The elements of the server 30 are connected to each other by one or more buses for communicating information.

[0071] The processing device 31 is a processor that controls the entire server 30. The processing device 31 is configured, for example, using one or more chips. The processing device 31 is configured, for example, using a central processing unit (CPU) that includes an interface with peripheral devices, an arithmetic unit, a register, etc. Some or all of the functions of the processing device 31 may be realized by hardware such as a DSP, an ASIC, a PLD, and an FPGA. The processing device 31 executes various processes in parallel or sequentially.

[0072] The storage device 32 is a recording medium that can be read from and written to by the processing device 31. The storage device 32 also stores a plurality of programs including the control program PR3 executed by the processing device 31. The storage device 32 also stores image information that indicates the image to be displayed on the XR glasses 20.

[0073] The communication device 33 is hardware serving as a transmitting / receiving device for communicating with other devices. The communication device 33 is also called, for example, a network device, a network controller, a network card, or a communication module. The communication device 33 may include a connector for wired connection and an interface circuit corresponding to the connector. The communication device 33 may also include a wireless communication interface. Examples of the connector and interface circuit for wired connection include products that comply with wired LAN, IEEE1394, and USB. Examples of the wireless communication interface include products that comply with wireless LAN, Bluetooth (registered trademark), etc.

[0074] The display 34 is a device that displays images and text information. The display 34 displays various images under the control of the processing device 31. For example, various display panels such as a liquid crystal display panel and an organic EL display panel are suitably used as the display 34.

[0075] The input device 35 is a device that receives operations from an administrator of the information processing system 1. For example, the input device 35 includes a keyboard, a touchpad, a touch panel, or a pointing device such as a mouse. Here, if the input device 35 includes a touch panel, it may also serve as the display 34.

[0076] The processing device 31, for example, reads and executes the control program PR3 from the storage device 32. As a result, the processing device 31 functions as an acquisition unit 311 and an output unit 312.

[0077] The acquisition unit 311 acquires various data from the terminal device 10-K via the communication device 33. The data includes, for example, the data of the user U wearing the XR glasses 20 on his / her head. K The data includes data indicating the operation content for the virtual object VO, which is input to the terminal device 10-K by the command.

[0078] Furthermore, the acquisition unit 311 acquires a message from the terminal device 10-K via the communication device 33. For example, as described with reference to FIG. K The terminal device 10-K used by another user U M When sending a message addressed to "UN", the acquisition unit 311 acquires the message addressed to "UN" from the terminal device 10-K.

[0079] The output unit 312 transmits a message to the terminal device 10-M via the communication device 33. For example, as described with reference to FIG. K The terminal device 10-K used by another user U M When sending a message addressed to "UN", the output unit 312 transmits the message addressed to "UN" acquired by the acquisition unit 311 to the terminal device 10-M used by "UN", as described above.

[0080] Furthermore, the output unit 312 transmits image information indicating the image to be displayed on the XR glasses 20 to the terminal device 10-K via the communication device 33. More specifically, the output unit 312 acquires the image information from the storage device 32. Furthermore, the output unit 312 transmits the acquired image information to the terminal device 10-K.

[0081] 1-2: Operation of the first embodiment 13 is a flowchart showing the operation of the terminal device 10-K according to the first embodiment. The operation of the terminal device 10-K will be described below with reference to FIG.

[0082] In step S1, the processing device 11 functions as a message acquisition unit 111A.K Get the message created by

[0083] In step S2, the processing device 11 functions as an object generation unit 112A. The processing device 11 generates a virtual object VO related to the message created in step S1. The processing device 11 also functions as a display control unit 114. The processing device 11 displays the virtual space VS including the generated virtual object VO on the XR glasses 20 as a display device. After that, the user U K places a virtual object VO in the virtual space VS.

[0084] In step S3, the processing device 11 functions as the display control unit 114. The processing device 11 displays the virtual space VS including the virtual object VO generated in step S2 and the hierarchical image LP indicating the list of layers on the XR glasses 20 as a display device.

[0085] In step S4, the processing device 11 functions as the reception unit 115. The processing device 11 receives a user U K Accepts operations.

[0086] In step S5, the processing device 11 functions as an information acquisition unit 111B. The processing device 11 provides the user U with a hierarchy according to the size of the place. K Obtain the specified information specified by.

[0087] In step S6, the processing device 11 functions as a location information generating unit 112B. The processing device 11 generates location information indicating the location in the real space RS corresponding to the position in the virtual space VS where the virtual object VO generated in step S2 is placed, based on the location information indicating the position in the virtual space VS where the virtual object VO is placed and the designation information acquired in step S5.

[0088] In step S7, the processing device 11 functions as the destination acquisition unit 113. The processing device 11 acquires at least one destination corresponding to the location where the virtual object VO is installed, based on the location information generated in step S6 and correspondence relationship information indicating the correspondence relationship between the location of the real space RS and at least one destination that is the transmission destination.

[0089] In step S8, the processing device 11 functions as the display control unit 114. The processing device 11 displays a virtual space VS including the virtual object VO generated in step S2 and a destination image AP indicating at least one destination extracted in step S7 on the XR glasses 20 as a display device.

[0090] In step S9, the processing device 11 functions as the reception unit 115. The processing device 11 receives the user U K Accepts operations.

[0091] In step S10, the processing device 11 functions as the communication control unit 116. The processing device 11 receives the user U K Based on the operation of step S7, the message is sent to the destination included in at least one destination extracted in step S7. After that, the processing device 11 ends the processing shown in FIG.

[0092] 1-3: Effects of the First Embodiment According to the above description, the terminal device 10-K as a display control device includes a destination acquisition unit 113 and a display control unit 114. The destination acquisition unit 113 acquires at least one destination of a message corresponding to a location in the real space RS that corresponds to a position in the virtual space VS where a virtual object VO related to the message is placed, based on location information indicating the location of the real space RS and correspondence information indicating the correspondence between the location of the real space RS and the at least one destination of the message. The display control unit 114 displays the virtual space VS including the virtual object VO and a destination image AP indicating the at least one destination on the XR glasses 20 as a display device.

[0093] The terminal device 10-K has the above-described configuration, and therefore, in the virtual space VS, K is another user U M When sending a message to user U, K In particular, users U can easily specify and confirm destinations. K However, when the virtual object VO related to the message is placed in the virtual space VS, the terminal device 10-K displays on the XR glasses 20 a destination image AP indicating at least one destination corresponding to the location in the real space RS corresponding to the location where the virtual object VO is placed in the virtual space VS. As a result, the user U K can easily recognize at least one destination that is highly related to a location in the real space RS that corresponds to a position in the virtual space VS where the virtual object VO is placed.

[0094] According to the above description, the location information has an information structure in which the location is divided into layers according to the size of the location. The terminal device 10-K further includes an information acquisition unit 111B and a location information generation unit 112B. The information acquisition unit 111B provides the user U with the layers according to the size of the location. K The location information generating unit 112B generates the location information based on the location information indicating the position in the virtual space VS where the virtual object VO is placed and the location information.

[0095] The terminal device 10-K has the above configuration, and therefore, the user U K In recognizing at least one destination that is highly related to the location in the real space RS corresponding to the position in the virtual space VS where the virtual object VO is installed, the user U can specify the scale of the location in the real space RS. K The user can specify whether the location unit of the real space RS is to be, for example, a town unit, a building unit, a floor unit, a house unit, or a room unit.

[0096] Furthermore, according to the above explanation, the information acquisition unit 111B acquires the designation information after the virtual object VO is placed in the virtual space VS.

[0097] The terminal device 10-K has the above configuration, and therefore, the user U K After placing a virtual object VO in the virtual space VS, the scale unit to be used as the location unit of the real space RS including the position where the virtual object VO is placed can be specified.

[0098] According to the above description, the terminal device 10-K further includes a reception unit 115 and a communication control unit 116. The reception unit 115 receives an operation on the destination image AP. The communication control unit 116 transmits the message to a destination included in the at least one destination based on the operation.

[0099] The terminal device 10-K has the above configuration, and therefore, the user U K In the virtual space VS, other users U M When sending a message to another user, you can simply specify the recipient of the message and then M In particular, users U K can send a message to the selected destinations simply by selecting at least one destination from the list of destinations included in the destination image AP.

[0100] 2: Second embodiment The configuration of an information processing system 1A including a terminal device 10A-K as a display control device according to a second embodiment of the present invention will be described below with reference to Figures 14 and 15. In the following description, for the purpose of simplifying the description, the same components of the information processing system 1A according to the second embodiment as those of the information processing system 1 according to the first embodiment will be designated by the same reference numerals, and their description may be omitted.

[0101] 2-1: Configuration of the second embodiment 2-1-1: Overall structure An information processing system 1A according to the second embodiment of the present invention differs from the information processing system 1 according to the first embodiment in that it includes a terminal device 10A-K instead of the terminal device 10-K. In other respects, the overall configuration of the information processing system 1A is the same as the overall configuration of the information processing system 1 according to the first embodiment shown in Fig. 1, and therefore illustration and description thereof will be omitted.

[0102] 2-1-2: Terminal device configuration The terminal device 10A-K differs from the terminal device 10-K in that it includes a processing device 11A instead of the processing device 11 and a storage device 12A instead of the storage device 12. The storage device 12A differs from the storage device 12 in that it stores a control program PR1A instead of the control program PR1. The processing device 11A includes an acquisition unit 111C instead of the acquisition unit 111 included in the processing device 11, and a generation unit 112C instead of the generation unit 112. In other respects, the configuration of the terminal device 10A-K is the same as the overall configuration of the terminal device 10-K according to the first embodiment shown in FIG. 5, and therefore illustration and description thereof will be omitted.

[0103] 14 is a functional block diagram of the acquisition unit 111C. In addition to the components included in the acquisition unit 111, the acquisition unit 111C further includes a history acquisition unit 111D.

[0104] The history acquisition unit 111D acquires the user history of a location in the real space RS. As an example, referring to FIG. 6, the history acquisition unit 111D acquires the user history of the "living room" of the "T residence" on the "7th floor" as a location in the real space RS, which indicates that "NT" and "GT" have used the location. For example, the history acquisition unit 111D acquires the user history of the "living room" of the "T residence" on the "7th floor" as a location in the real space RS. K may acquire the history of the user of the location in the real space RS input by the user using the input device 15. Alternatively, the history acquisition unit 111D may acquire the history of the user of the location in the real space RS from an external device via the communication device 13.

[0105] 15 is a functional block diagram of the generating unit 112C. In addition to the components included in the generating unit 112, the generating unit 112C further includes a relationship information generating unit 112D.

[0106] The relationship information generating unit 112D generates correspondence relationship information based on the user's history of the location in the real space RS acquired by the history acquiring unit 111D. As an example, referring to FIG. 6, the relationship information generating unit 112D generates correspondence relationship information indicating that the "living room" corresponds to Mr. "NT" and Mr. "GT" based on the user's history of the "living room" of the "T residence" on the "7th floor" acquired by the history acquiring unit 111D. As a result, the user U K This allows the user U to easily build a correspondence database CD stored in the storage device 12A of the terminal device 10A-K. K can generate correspondence information stored in the correspondence database CD based on actual users of the locations in the real space RS.

[0107] 2-2: Operation of the second embodiment The operation of the terminal device 10A-K according to the second embodiment is basically the same as the operation of the terminal device 10-K shown in Fig. 13, and therefore illustration and detailed description thereof will be omitted. In the operation of the terminal device 10A-K, the correspondence relationship information used in step S7 during the operation of the terminal device 10-K is generated by the relationship information generation unit 112D.

[0108] 2-3: Effects of the second embodiment According to the above description, the terminal device 10A-K as a display control device further includes a history acquisition unit 111D and a relationship information generation unit 112D in addition to the components included in the terminal device 10-K. The history acquisition unit 111D acquires the user's history of locations in the real space RS. The relationship information generation unit 112D generates correspondence relationship information based on the user's history.

[0109] The terminal device 10A-K has the above configuration, and therefore, the user U K This allows the user U to easily build a correspondence database CD stored in the storage device 12A of the terminal device 10A-K. K can generate correspondence information stored in the correspondence database CD based on actual users of the locations in the real space RS.

[0110] 3: Variation The present disclosure is not limited to the above-described exemplary embodiments. Specific modified embodiments are exemplified below. Two or more embodiments selected arbitrarily from the following examples may be combined.

[0111] 3-1: Variation 1 In the terminal device 10-K according to the first embodiment, the correspondence database CD stored in the storage device 12 stores correspondence between a location in the real space RS indicated by location information having an information structure divided into layers according to size, and at least one destination. However, the location information does not have to have an information structure divided into layers according to size. That is, the location information may have an information structure consisting of only one layer. In this case, the location information generation unit 112B does not need to use designation information, and therefore the information acquisition unit 111B does not need to be an essential component of the terminal device 10-K. The same is true for the terminal device 10A-K according to the second embodiment.

[0112] 3-2: Variation 2 In the terminal devices 10A-K according to the second embodiment, after the history acquisition unit 111D acquires the user's history in the real space RS, the relationship information generation unit 112D generates correspondence information based on the user's history in the real space RS. Then, the destination acquisition unit 113 acquires at least one destination corresponding to the location where the virtual object VO is installed, based on the location information and the correspondence information. The display control unit 114 displays a destination image AP indicating the at least one destination acquired by the destination acquisition unit 113 in the virtual space VS.

[0113] However, the destination acquisition unit 113 does not have to acquire the at least one destination based on the location information and the correspondence information. For example, the destination acquisition unit 113 may acquire at least one destination corresponding to the location where the virtual object VO is installed based on the location information and history information itself indicating the user's history in the real space RS acquired by the history acquisition unit 111D. Thereafter, the display control unit 114 may display, in the virtual space VS, a destination image AP indicating at least one destination associated with the history information itself acquired by the destination acquisition unit 113. In other words, the display control unit 114 may display, in the virtual space VS, the user's history itself of the location where the virtual object VO is installed as the destination image AP.

[0114] 3-3: Variation 3 In the terminal device 10-K according to the first embodiment, the message acquisition unit 111A receives a message from the user U K After that, the object generating unit 112A generates a virtual object VO related to the message acquired by the message acquiring unit 111A. That is, in the terminal device 10-K, the user U K After creating a message, a virtual object VO is generated based on the message. K After generating a virtual object VO, the user may create a message linked to the virtual object VO using the input device 15. The same applies to the terminal devices 10A-K according to the second embodiment.

[0115] 3-4: Variation 4 In the terminal device 10-K according to the first embodiment, a user U K After the user places the virtual object VO, the information acquisition unit 111B transfers the above hierarchy to the user U. K However, the user U K After the user specifies a hierarchical level and the information acquisition unit 111B acquires the specified information, the user U K In more detail, for example, a user U K For example, when the user U is holding a virtual object VO, the user U can select a hierarchy in accordance with the size of the location in the real space RS corresponding to the position of the virtual object VO in the virtual space VS. K After specifying, user U K Furthermore, the user U may place a virtual object VO. K However, the virtual object VO may be placed after specifying the destination of the message by operating the destination image AP displayed based on the specified layer. The same applies to the terminal devices 10A-K according to the second embodiment.

[0116] 3-5: Variation 5 In the information processing system 1 according to the first embodiment, the terminal device 10-K mainly includes an acquisition unit 111, a generation unit 112, a destination acquisition unit 113, a display control unit 114, and a correspondence database CD. However, instead of the terminal device 10-K, the server 30 may include the same components as these. The same applies to the other components. The same also applies to the information processing system 1A according to the second embodiment.

[0117] 3-6: Variation 6 In the information processing system 1 according to the first embodiment, the terminal device 10-K and the XR glasses 20 are realized as separate entities. However, the method for realizing the terminal device 10-K and the XR glasses 20 in the embodiment of the present invention is not limited to this. For example, the XR glasses 20 may have the same functions as the terminal device 10-K. In other words, the terminal device 10-K and the XR glasses 20 may be realized in a single housing. The same applies to the information processing system 1A according to the second embodiment.

[0118] 3-7: Variation 7 The information processing system 1 according to the first embodiment includes XR glasses 20. In the above description, the XR glasses 20 are MR glasses as an example. However, the XR glasses 20 may be any one of VR glasses employing VR technology, a head-mounted display (HMD) employing VR technology, AR glasses employing AR technology, an HMD employing AR technology, and an HMD employing MR technology. Alternatively, the information processing system 1 may include any one of a regular smartphone and a tablet equipped with an imaging device instead of the XR glasses 20. These VR glasses, AR glasses, HMD, smartphone, and tablet are examples of display devices. The same applies to the information processing system 1A according to the second embodiment.

[0119] 4:Other (1) In the above-described embodiment, storage devices 12 and 12A, storage device 22, and storage device 32 are exemplified by ROM and RAM, but may be flexible disks, magneto-optical disks (e.g., compact disks, digital versatile disks, Blu-ray (registered trademark) disks), smart cards, flash memory devices (e.g., cards, sticks, key drives), CD-ROMs (Compact Disc-ROMs), registers, removable disks, hard disks, floppy (registered trademark) disks, magnetic strips, databases, servers, or other suitable storage media. The program may also be transmitted from a network via a telecommunications line. The program may also be transmitted from a communications network NET via a telecommunications line.

[0120] (2) In the above-described embodiments, the described information, signals, etc. may be represented using any of a variety of different technologies. For example, data, instructions, commands, information, signals, bits, symbols, chips, etc. that may be referred to throughout the above description may be represented by voltages, currents, electromagnetic waves, magnetic fields or magnetic particles, optical fields or photons, or any combination thereof.

[0121] (3) In the above-described embodiment, input and output information may be stored in a specific location (for example, a memory) or may be managed using a management table. Input and output information may be overwritten, updated, or added to. Output information may be deleted. Input information may be transmitted to another device.

[0122] (4) In the above-described embodiment, the determination may be made by a value (0 or 1) represented using one bit, by a Boolean value (true or false), or by a comparison of numerical values (e.g., comparison with a predetermined value).

[0123] (5) The order of the process procedures, sequences, flowcharts, etc. illustrated in the above-described embodiments may be rearranged unless inconsistent. For example, the methods described in this disclosure present elements of various steps using an example order, and are not limited to the particular order presented.

[0124] (6) Each function illustrated in Figures 1 to 15 is realized by any combination of at least one of hardware and software. Furthermore, the method for realizing each functional block is not particularly limited. That is, each functional block may be realized by using one device that is physically or logically coupled, or may be realized by using two or more devices that are physically or logically separated and connected directly or indirectly (for example, by wire, wirelessly, etc.). A functional block may also be realized by combining software with the one device or the multiple devices.

[0125] (7) The programs exemplified in the above-described embodiments should be broadly construed to mean instructions, instruction sets, code, code segments, program code, programs, subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executable files, execution threads, procedures, functions, etc., regardless of whether they are called software, firmware, middleware, microcode, hardware description language, or by other names.

[0126] Software, instructions, information, etc. may also be transmitted or received over a transmission medium. For example, if software is transmitted from a website, server, or other remote source using wired technologies (such as coaxial cable, fiber optic cable, twisted pair, Digital Subscriber Line (DSL)), and / or wireless technologies (such as infrared, microwave), then these wired and / or wireless technologies are included within the definition of transmission media.

[0127] (8) In each of the foregoing embodiments, the terms "system" and "network" are used interchangeably.

[0128] (9) The information, parameters, etc. described in this disclosure may be expressed using absolute values, relative values from a predetermined value, or corresponding other information.

[0129] (10) In the above-described embodiments, the terminal devices 10-1 to 10-J and 10A-K and the server 30 may be mobile stations (MS). A mobile station may also be referred to by those skilled in the art as a subscriber station, mobile unit, subscriber unit, wireless unit, remote unit, mobile device, wireless device, wireless communication device, remote device, mobile subscriber station, access terminal, mobile terminal, wireless terminal, remote terminal, handset, user agent, mobile client, client, or some other appropriate term. In addition, in the present disclosure, terms such as "mobile station," "user terminal," "user equipment (UE)," and "terminal" may be used interchangeably.

[0130] (11) In the above-described embodiments, the terms "connected," "coupled," or any variations thereof refer to any direct or indirect connection or coupling between two or more elements, including the presence of one or more intermediate elements between two elements that are "connected" or "coupled" to each other. The coupling or connection between elements may be a physical coupling or connection, a logical coupling or connection, or a combination thereof. For example, "connected" may be read as "access." As used in this disclosure, two elements are considered to be "connected" or "coupled" to each other using at least one of one or more wires, cables, and printed electrical connections, as well as electromagnetic energy having wavelengths in the radio frequency range, microwave range, and optical (both visible and invisible) range, as some non-limiting and non-exhaustive examples.

[0131] (12) In the above embodiments, the phrase "based on" does not mean "based only on," unless otherwise specified. In other words, the phrase "based on" means both "based only on" and "based at least on."

[0132] (13) As used in this disclosure, the terms "determining" and "determining" may encompass a wide variety of actions. "Determining" and "determining" may include, for example, judging, calculating, computing, processing, deriving, investigating, looking up, searching, inquiring (e.g., searching in a table, database, or other data structure), ascertaining, and the like. "Determining" and "determining" may also include receiving (e.g., receiving information), transmitting (e.g., sending information), input, output, accessing (e.g., accessing data in memory), and the like. Furthermore, "judgment" and "decision" can include regarding resolving, selecting, choosing, establishing, comparing, etc. as having been "judgment" or "decision." In other words, "judgment" and "decision" can include regarding some action as having been "judgment" or "decision." Furthermore, "judgment (decision)" can be interpreted as "assuming," "expecting," "considering," etc.

[0133] (14) In the above embodiments, when "include," "including," and variations thereof are used, these terms are intended to be inclusive, similar to the term "comprising." Furthermore, the term "or" as used in this disclosure is not intended to be an exclusive or.

[0134] (15) In this disclosure, where articles are added by translation, such as a, an, and the in English, this disclosure may include that the nouns following these articles are plural.

[0135] (16) In this disclosure, the term "A and B are different" may mean "A and B are different from each other." The term may also mean "A and B are each different from C." Terms such as "separate" and "combined" may also be interpreted in the same way as "different."

[0136] (17) Each aspect / embodiment described in this disclosure may be used alone, in combination, or switched depending on the implementation. Notification of predetermined information (e.g., notification that "X is true") is not limited to explicit notification, but may be implicit (e.g., not notifying the predetermined information).

[0137] Although the present disclosure has been described in detail above, it is clear to those skilled in the art that the present disclosure is not limited to the embodiments described herein. The present disclosure can be implemented in modified and altered forms without departing from the spirit and scope of the present disclosure as defined by the claims. Therefore, the description of the present disclosure is intended to be illustrative and does not have any limiting meaning on the present disclosure. [Explanation of symbols]

[0138] 1, 1A... Information processing system, 10-1, 10-2, 10-K, 10-J, 10A-K... Terminal device, 11, 11A... Processing device, 12, 12A... Storage device, 13... Communication device, 14... Display, 15... Input device, 16... Inertial sensor, 20, ... XR glasses, 21... Processing device, 22... Storage device, 23... Gaze detection device, 24... GPS device, 25... Motion detection device, 26... Imaging device, 27... Communication device, 28... Display, 30... Server, 31... Processing device, 32... Storage device, 33... Communication device, 34... Display, 35... Input device, 41L, 41R...lenses, 91, 92...temples, 93...bridge, 94, 95...frame, 111...acquisition unit, 111A...message acquisition unit, 111B...information acquisition unit, 111C...acquisition unit, 111D...history acquisition unit, 112...generation unit, 112A...object generation unit, 112B...location information generation unit, 112C...generation unit, 112D...relationship information generation unit, 113...destination acquisition unit, 114...display control unit, 115...reception unit, 116...communication control unit, 311...acquisition unit, 312...output unit, PR1 to PR3...control program, U K , U M …user, VO…virtual object

Claims

1. a destination acquisition unit that acquires at least one destination to which the message is to be sent, the destination corresponding to a location in real space that corresponds to a position in virtual space where a virtual object related to the message is installed, based on location information that indicates the location in the real space and correspondence information that indicates a correspondence between the location in the real space and the at least one destination to which the message is to be sent; a display control unit that causes a display device to display the virtual space including the virtual object and a destination image that indicates the at least one destination; Equipped with the location information has an information structure in which the location is divided into a plurality of layers according to the size of the location, an information acquisition unit that acquires designation information by which a user designates a floor according to the size of the location; a location information generation unit that generates the location information based on location information indicating a position in the virtual space where the virtual object is placed and the designation information.

2. The display control device according to claim 1 , wherein the information acquisition unit acquires the designation information after the virtual object is placed in the virtual space.

3. a history acquisition unit that acquires a user history indicating a usage history of one or more users who have used the location in the real space; a relationship information generating unit that generates the correspondence relationship information based on the user history; The display control device according to claim 1 or 2, further comprising:

4. a reception unit that receives an operation on the destination image; a communication control unit that transmits the message to a destination included in the at least one destination based on the operation; The display control device according to claim 1 , further comprising:

Images