Display control device and display control method

Abstract

To provide a display control device that enables even a user who shares a three-dimensional virtual space using a device equipped with a two-dimensional display to place shared contents at an intended position in the virtual space.SOLUTION: A determination unit 313 determines, on the basis of first identification information II1, whether a first terminal device 10 displays a two-dimensional image or a three-dimensional image. A first display control unit 314, when the determination unit 313 determines that the first terminal device 10 displays the two-dimensional image, causes the first terminal device 10 to display a planar celestial sphere image PCI where a portion of a celestial sphere CS of a virtual space VS is represented in a planar manner.SELECTED DRAWING: Figure 13

Description

Technical Field

[0001] The present invention relates to a display control device and a display control method.

Background Art

[0002] Conventionally, a first user wearing a glass device such as a head-mounted display (HMD) and a second user using a device equipped with a two-dimensional display such as a personal computer (PC) may share one virtual space. Patent Document 1 discloses an information processing apparatus that acquires line-of-sight information indicating a first user's gaze position with respect to a predetermined object and presents the first user's gaze position to the second user based on predetermined input information by the first user or the second user.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the conventional information processing apparatus, when a second user attempts to place content to be shared with other users in a three-dimensional virtual space, there is a problem that it is difficult to place the content at the position intended by the second user.

[0005] The present invention has been made to solve the above problems, and an object thereof is to enable a user who shares a three-dimensional virtual space using a device equipped with a two-dimensional display to place shared content at an intended position in the virtual space.

Means for Solving the Problems

[0006] The display control device according to a preferred embodiment of the present invention includes a determination unit that determines whether the first terminal device displays a two-dimensional image or a three-dimensional image based on first identification information indicating the type of the first terminal device held by a first user, and a first display control unit that causes the first terminal device to display a planar celestial sphere image in which at least a partial region of a celestial sphere indicating the range of the entire virtual space shared by a plurality of users including the first user and a second user is represented in a planar manner when it is determined by the determination unit that the first terminal device displays a two-dimensional image.

[0007] The display control method according to a preferred embodiment of the present invention determines whether the first terminal device displays a two-dimensional image or a three-dimensional image based on first identification information indicating the type of the first terminal device held by a first user, and causes the first terminal device to display a planar celestial sphere image in which at least a partial region of a celestial sphere indicating the range of the entire virtual space shared by a plurality of users including the first user and a second user is represented in a planar manner when it is determined that the first terminal device displays a two-dimensional image.

Advantages of the Invention

[0008] According to the display control device of the present invention, even for users who share a three-dimensional virtual space using a device equipped with a two-dimensional display, shared content can be arranged at an intended position in the virtual space.

Brief Description of the Drawings

[0009]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Mode for Carrying Out the Invention

[0010] 1. First Embodiment Hereinafter, with reference to FIGS. 1 to 15, the configuration of the display control device according to the first embodiment of the present invention will be described.

[0011] 1.1. Configuration of the First Embodiment 1.1.1. Overall Configuration FIG. 1 is a diagram showing the overall configuration of an information processing system 1 including a display control device according to the first embodiment. The information processing system 1 includes a first terminal device 10, a second terminal device 20, a server 30, and a communication network NET. The server 30 is an example of a display control device.

[0012] The second terminal device 20 is a device possessed by the second user U2. In the present embodiment, the second terminal device 20 is a device including a three-dimensional display capable of displaying a three-dimensional image. For example, the second terminal device 20 is a head-mounted display (HMD) capable of experiencing VR (Virtual Reality) content. The second user U2 wears the second terminal device 20 on the head of the second user U2 himself / herself. The second terminal device 20 displays a virtual object on a display panel provided for each lens corresponding to both eyes of the user.

[0013] Note that the second terminal device 20 may be, for example, a system in which an information processing terminal such as a smartphone, a tablet terminal, a personal computer (PC), a game device, etc. is connected to goggles including a three-dimensional display.

[0014] The first terminal device 10 is a device possessed by the first user U1. In the present embodiment, the first terminal device 10 includes a device including a flat display such as a PC, a tablet terminal, a smartphone, a smartwatch, etc. The flat display is a two-dimensional display capable of displaying a two-dimensional image. As the first terminal device 10, a terminal with a relatively large display such as a PC or a tablet terminal is preferable. In the present embodiment, a PC will be described as an example of the first terminal device 10.

[0015] In FIG. 1, one first terminal device 10 and one second terminal device 20 are illustrated as examples, but this is merely an example, and the information processing system 1 can include any number of first terminal devices 10 and any number of second terminal devices 20.

[0016] In the information processing system 1, the first terminal device 10, the second terminal device 20, and the server 30 are communicably connected to each other via the communication network NET.

[0017] The server 30 is a server that provides an image display service. The server 30 collects various types of information regarding the image display service from the first terminal device 10 and the second terminal device 20 via the communication network NET, and displays an image on the first terminal device 10 and the second terminal device 20 based on the various types of information.

[0018] The information processing system 1 is a system that provides an image display service to the first user U1 who holds the first terminal device 10 and the second user U2 who holds the second terminal device 20.

[0019] FIG. 2 is a schematic diagram of the virtual space VS displayed on the second terminal device 20 in FIG. 1. The virtual space VS is defined as the space inside a virtual celestial sphere CS centered on the position of the head of the second user U2. If the radius of the celestial sphere CS is R, it can be said that the virtual space VS is the space inside the spherical surface with a radius of R. In other words, the celestial sphere CS indicates the entire range of the virtual space VS. The zenith ZE of the celestial sphere CS is the point above the head of the second user U2 on the plane SS of the celestial sphere CS. The nadir NA of the celestial sphere CS is the point under the feet of the second user U2 on the plane SS. The equator EQ is the 0-degree latitude line of the celestial sphere CS. The plane including the equator EQ and the straight line connecting the zenith ZE and the nadir NA are perpendicular to each other.

[0020] As shown in FIG. 2, one or more virtual objects VO are arranged in the virtual space VS. The virtual object VO includes five virtual objects VO1 to VO5. In the present embodiment, each of the virtual objects VO1 to VO5 is arranged on the plane SS of the celestial sphere CS. Although the second user U2 is shown in FIG. 2 for convenience, actually, the second user U2 is not displayed on the second terminal device 20.

[0021] The one or more virtual objects VO are, for example, virtual objects indicating data such as still images, moving images, three-dimensional CG models, HTML files, text files, etc., and virtual objects indicating applications. Here, examples of the text file include a memo and source code. Examples of the application include a browser, an application for using SNS, and an application for generating a document file. Note that the number of the one or more virtual objects VO in FIG. 2 is merely an example, and the number of the one or more virtual objects VO is not limited to the present disclosure.

[0022] 1.1.2. Configuration of the First Terminal Device FIG. 3 is a block diagram showing a configuration example of the first terminal device 10 in FIG. 1. As shown in FIG. 3, the first terminal device 10 includes a processing device 11, a storage device 12, a microphone 13, a speaker 14, a communication device 15, a display 16, and an input device 17. Each element included in the first terminal device 10 is interconnected by one or a plurality of buses for communicating information. Note that the term "device" in this specification may be read as other terms such as a circuit, a device, a unit, etc.

[0023] The processing device 11 is a processor that controls the entire first terminal device 10 and is configured using, for example, one or more chips. The processing device 11 is configured using, for example, a central processing unit (CPU) including an interface with peripheral devices, an arithmetic unit, and registers. Note that some or all of the functions provided by the processing device 21 may be realized by hardware such as a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), or an FPGA (Field Programmable Gate Array). The processing device 11 executes various processes in parallel or sequentially.

[0024] The storage device 12 is a recording medium that can be read from and written to by the processing device 11. The storage device 12 includes, for example, a non-volatile memory and a volatile memory. The non-volatile memory is, for example, a ROM (Read Only Memory), an EPROM (Erasable Programmable Read Only Memory), or an EEPROM (Electrically Erasable Programmable Read Only Memory). The volatile memory is, for example, a RAM (Random Access Memory).

[0025] The storage device 12 stores a plurality of programs including a control program PR1 to be executed by the processing device 11 and first identification information II1. The first identification information II1 is information indicating the type of the first terminal device 10. More specifically, the first identification information II1 is information indicating that the first terminal device 10 is a device having a display that cannot display a three-dimensional image. Further, the storage device 12 functions as a work area for the processing device 11. Here, the three-dimensional image includes an image in which one or more contents are arranged on the surface SS of the three-dimensional celestial sphere CS.

[0026] The microphone 13 converts the input voice into an electrical signal and outputs it. The voice input to the microphone 13 is, for example, the voice of the user speaking. The microphone 13 may be provided with an AD converter that converts an analog voice signal into voice information that is a digital signal. The voice information is output to the processing device 11.

[0027] The speaker 14 outputs voice. The voice output by the speaker 14 is, for example, the voice included in VR content, the voice of another user participating in a VR meeting, etc. The speaker 14 is controlled by the processing device 11.

[0028] The communication device 15 is hardware as a transmission / reception device for communicating with other devices. The communication device 15 is also called, for example, a network device, a network controller, a network card, a communication module, etc. The communication device 15 is provided with a connector for wired connection and may be provided with an interface circuit corresponding to the connector. Further, the communication device 15 may be provided with a wireless communication interface. Examples of the connector for wired connection and the interface circuit include products compliant with wired LAN, IEEE1394, and USB. Examples of the wireless communication interface include products compliant with wireless LAN and Bluetooth (registered trademark).

[0029] The display 16 is a device that displays images and character information. The display 16 displays various images based on the control by the processing device 11. For example, various display panels such as a liquid crystal panel and an organic EL panel are suitably used as the display 16.

[0030] The input device 17 receives an operation from the user. For example, the input device 17 includes a pointing device such as a keyboard, a touch pad, a touch panel, and a mouse. Here, when the input device 17 includes a touch panel, it may also serve as the display 16.

[0031] The processing device 11 functions as an acquisition unit 111, an output unit 112, and a display control unit 113 by, for example, reading and executing the control program PR1 from the storage device 12.

[0032] The acquisition unit 111 acquires instruction information according to a user operation. Here, the user operation is, for example, an operation input by the user to the first terminal device 10 using the input device 17. More specifically, the user operation may be pressing a specific part of the input device 17.

[0033] The acquisition unit 111 acquires image information indicating virtual objects VO1 to VO5 from the server 30. The acquisition unit 111 also acquires instruction information from the input device 17.

[0034] The acquisition unit 111 acquires image information from the server 30 by using the communication device 15. The acquisition unit 111 stores the acquired image information in the storage device 12. The acquisition unit 111 acquires the image information stored in the storage device 12.

[0035] The output unit 112 outputs the user's instruction information to the server 30 via the communication device 15 as necessary.

[0036] The display control unit 113 causes the display 16 to display various information based on the various information acquired by the acquisition unit 111.

[0037] 1.1.3. Configuration of the Second Terminal Device FIG. 4 is a block diagram showing a configuration example of the second terminal device 20 in FIG. 1. As shown in FIG. 4, the second terminal device 20 includes a processing device 21, a storage device 22, a gaze acquisition device 23, a motion detection device 24, a microphone 25, a speaker 26, a communication device 27, a display 28, and an input device 29. Each element of the second terminal device 20 is interconnected by one or more buses for communicating information.

[0038] The processing device 21 is a processor that controls the entire second terminal device 20 and is configured using, for example, one or more chips. The processing device 21 is configured using, for example, a central processing unit (CPU) that includes an interface with peripheral devices, an arithmetic unit, registers, and the like. Note that some or all of the functions provided in the processing device 21 may be realized by hardware such as a DSP, an ASIC, a PLD, or an FPGA. The processing device 21 executes various processes in parallel or sequentially.

[0039] The storage device 22 is a recording medium that can be read from and written to by the processing device 21. The storage device 22 includes, for example, a non-volatile memory and a volatile memory. The non-volatile memory is, for example, a ROM, an EPROM, and an EEPROM. The volatile memory is, for example, a RAM.

[0040] The storage device 22 stores a plurality of programs including a control program PR2 to be executed by the processing device 21 and second identification information II2. The second identification information II2 is information indicating the type of the second terminal device 20. More specifically, the second identification information II2 is information indicating that the second terminal device 20 is a device having a display capable of displaying a three-dimensional image. Further, the storage device 22 functions as a work area for the processing device 21.

[0041] The line-of-sight acquisition device 23 acquires the direction in which the user is looking, that is, the direction of the user's line of sight, by eye tracking that tracks the movement of the user's left and right eyeballs, and outputs line-of-sight information indicating the direction of the user's line of sight to the processing device 21 based on the acquisition result.

[0042] More specifically, the line-of-sight acquisition device 23 includes a pair of light sources and a pair of cameras. Each of the pair of light sources corresponds to the user's left eye and right eye, and each of the pair of cameras corresponds to the user's left eye and right eye. The light source corresponding to the user's left eye irradiates infrared light onto the user's left eye, and the camera corresponding to the user's left eye captures the corneal reflection image of the user's left eye as an image formed by the reflection of the irradiated infrared light. Similarly, the light source corresponding to the user's right eye irradiates infrared light onto the user's right eye, and the camera corresponding to the user's right eye captures the corneal reflection image of the user's right eye.

[0043] The line-of-sight acquisition device 23 detects the position of the user's canthus and the position of the iris from the acquired corneal reflection images of the left and right eyes, and acquires the user's line-of-sight information based on the detected position of the user's canthus and the position of the iris. Note that the method for acquiring the line of sight by the line-of-sight acquisition device 23 is not limited to the above method, and any method may be used.

[0044] The motion detection device 24 detects the motion of the second terminal device 20 and outputs motion data to the processing device 21. The motion data includes acceleration data indicating the acceleration in each direction of the X-axis, Y-axis, and Z-axis and angular acceleration data indicating the angular acceleration with each axis of the X-axis, Y-axis, and Z-axis as the center of rotation. The motion detection device 24 includes an acceleration sensor for detecting acceleration, an inertial sensor such as a gyro sensor for detecting angular acceleration, and a geomagnetic sensor for detecting the geomagnetic field in each direction of the X-axis, Y-axis, and Z-axis and detecting the direction in which the second terminal device 20 is facing.

[0045] The acceleration sensor detects the acceleration in each direction of the X-axis, Y-axis, and Z-axis that are orthogonal to each other. The gyro sensor detects the angular acceleration with each axis of the X-axis, Y-axis, and Z-axis as the center of rotation. The geomagnetic sensor detects the geomagnetism in each direction of the X-axis, Y-axis, and Z-axis and detects the direction in which the second terminal device 20 is facing. The motion detection device 24 generates attitude information indicating the attitude of the second terminal device 20 based on the output information from the gyro sensor. In addition, the motion detection device 24 outputs motion information related to the motion of the second terminal device 20 to the processing device 21.

[0046] The microphone 25 converts the input voice into an electrical signal and outputs it. The voice input to the microphone 25 is, for example, the voice uttered by the user. The microphone 25 may be provided with an AD converter that converts an analog voice signal into voice information that is a digital signal. The voice information is output to the processing device 21.

[0047] The speaker 26 outputs voice. The voice output by the speaker 26 is, for example, the voice included in the VR content, the voice uttered by other users participating in the VR conference, etc. The speaker 26 is controlled by the processing device 21.

[0048] The communication device 27 is hardware as a transmission / reception device for communicating with other devices. The communication device 27 is also called, for example, a network device, a network controller, a network card, a communication module, etc. The communication device 27 may be provided with a connector for wired connection and may be provided with an interface circuit corresponding to the connector. Further, the communication device 27 may be provided with a wireless communication interface. Examples of the connector for wired connection and the interface circuit include products compliant with wired LAN, IEEE1394, USB, etc. Examples of the wireless communication interface include products compliant with wireless LAN, Bluetooth (registered trademark), etc.

[0049] The display 28 is a device that displays images. The display 28 displays various images based on the control by the processing device 21. The display 28 includes a display for the left eye and a display for the right eye.

[0050] The input device 29 receives an input from the user. In the present embodiment, the input device 29 is used for selection of VR content used by the user, etc. The input device 29 may be, for example, a switch provided on a head-mounted display or a remote controller, etc.

[0051] The processing device 21 functions as an acquisition unit 211 and a display control unit 212 by, for example, reading and executing the control program PR2 from the storage device 22.

[0052] The acquisition unit 211 acquires a control signal and image information from the second terminal device 20. The control signal is a signal for controlling the display on the display 28. The control signal is generated by a display control unit 212 (described later) provided in the second terminal device 20. The image information is information indicating an image to be displayed on the display 28. The image information is, for example, information including information indicating virtual objects VO1 to VO5. The image information may be stored in the storage device 22 of the second terminal device 20, or may be stored in the storage device 32 of the server 30 (described later).

[0053] In addition, the acquisition unit 211 acquires gaze information input from the gaze acquisition device 23, motion information input from the motion detection device 24, and voice information input from the microphone 25. Then, the acquisition unit 211 outputs the acquired gaze information, motion information, and voice information to the communication device 27.

[0054] The display control unit 212 controls the display on the display 28 based on the control signal acquired by the acquisition unit 211. In addition, the display control unit 212 causes the virtual object VO to be displayed on the display 28 based on the image information acquired by the acquisition unit 211.

[0055] 1.1.4. Configuration of the Server FIG. 5 is a block diagram showing a configuration example of the server 30 in FIG. 1. As shown in FIG. 5, the server 30 includes a processing device 31, a storage device 32, a communication device 33, a display 34, and an input device 35. Each element included in the server 30 is interconnected by one or a plurality of buses for communicating information.

[0056] The processing device 31 is a processor that controls the entire server 30 and is configured using, for example, one or more chips. The processing device 31 is configured using, for example, a central processing unit (CPU) that includes an interface with peripheral devices, an arithmetic unit, and registers. Note that some or all of the functions provided in the processing device 31 may be realized by hardware such as a DSP, ASIC, PLD, or FPGA. The processing device 31 executes various processes in parallel or sequentially.

[0057] The storage device 32 is a recording medium that can be read from and written to by the processing device 31. The storage device 32 includes, for example, a non-volatile memory and a volatile memory. The non-volatile memory is, for example, a ROM, EPROM, or EEPROM. The volatile memory is, for example, a RAM.

[0058] The storage device 32 stores a plurality of programs including a control program PR3 to be executed by the processing device 31. The storage device 32 also functions as a work area for the processing device 31.

[0059] The communication device 33 is hardware as a transmission / reception device for communicating with other devices. The communication device 33 is also called, for example, a network device, network controller, network card, communication module, or the like. The communication device 33 includes a connector for a wired connection and may include an interface circuit corresponding to the connector. The communication device 33 may also include a wireless communication interface. Examples of the connector for a wired connection and the interface circuit include products compliant with a wired LAN, IEEE1394, or USB. Examples of the wireless communication interface include products compliant with a wireless LAN or Bluetooth (registered trademark).

[0060] The display 34 is a device that displays image and character information. The display 34 displays various images based on control by the processing device 31. For example, various display panels such as a liquid crystal panel or an organic EL panel are suitably used as the display 34.

[0061] The input device 35 is a device that accepts operations by the administrator of the information processing system 1. For example, the input device 35 includes a pointing device such as a keyboard, a touch pad, a touch panel, a mouse, etc. Here, when the input device 35 includes a touch panel, it may also serve as the display 34. The administrator of the information processing system 1 can modify the control program PR3 by using the input device 35.

[0062] The processing device 31 functions as an identification information acquisition unit 311, a content information acquisition unit 312, a determination unit 313, a first display control unit 314, and a second display control unit 315, for example, by reading and executing the control program PR3 from the storage device 32.

[0063] Hereinafter, with reference to FIGS. 6 to 12, each function of the identification information acquisition unit 311, the content information acquisition unit 312, the determination unit 313, the first display control unit 314, and the second display control unit 315 will be described.

[0064] FIG. 6 is a schematic diagram showing an example of the virtual space VS displayed by the second terminal device 20 when the second user U2 is participating in a VR meeting. The VR meeting is a meeting held on the virtual space VS. As shown in FIG. 6, the second user U2 can visually recognize the virtual object VO in the virtual space VS by wearing the second terminal device 20 on the head.

[0065] In the virtual space VS, as virtual objects VO, four slide materials SL1, SL2, SL3, and SL4 and four contents CO1, CO2, CO3, and CO4 are arranged. The second user U2 is gazing at the slide material SL3. The gazing position of the second user U2 is represented by GP1. Also, the direction of the line of sight of the second user U2 is represented by LS1. The range of the visual field of the second user U2 is represented by FOV1.

[0066] Note that the direction LS1 of the line of sight of the second user U2, the fixation position GP1 of the second user U2, and the visual field FOV1 of the second user U2 are shown for convenience in FIG. 6, but are not displayed on the display 28 of the second terminal device 20. Therefore, the four slide materials SL1 to SL4 and the four contents CO1 to CO4 are visible to the second user U2, but the direction LS1 of the line of sight of the second user U2, the fixation position GP1 of the second user U2, and the visual field FOV1 of the second user U2 are not visible.

[0067] Also, the second user U2 and the second terminal device 20 are shown for convenience in FIG. 6, but are not displayed on the display 28 of the second terminal device 20. Therefore, the second user U2 and the second terminal device 20 are not visible to the second user U2.

[0068] FIG. 7 is a schematic diagram showing an example of the virtual space VS displayed by the first terminal device 10 when the first user U1 participates in a VR meeting. As shown in FIG. 7, the first user U1 can visually recognize the planar celestial sphere image PCI as a two-dimensional image on the display 16 of the first terminal device 10. The planar celestial sphere image PCI is an image in which a partial region of the celestial sphere CS is represented in a planar manner. The first user U1 can scroll the planar celestial sphere image PCI up, down, left, and right by operating the cursor button CUR on the display 16 or the cursor key of the input device 17. The operation of the cursor button CUR or the cursor key is an example of a specific operation.

[0069] A part of the slide material SL2, all of the slide material SL3, a part of the slide material SL4, and all of the content CO3 are displayed on the display 16.

[0070] FIG. 8 is a schematic diagram for explaining the concept of a method for generating a planar celestial sphere image PCI. Hereinafter, with reference to FIG. 8, the concept of the method for generating the planar celestial sphere image PCI by the first display control unit 314 will be described. In FIG. 8, the radius of the cylinder CY is equal to the radius R of the celestial sphere CS. The cylinder CY is arranged such that the axis on the straight line connecting the zenith ZE and the nadir NA of the celestial sphere CS and the axis of the cylinder CY overlap each other. Therefore, the side surface of the cylinder CY and the equator EQ of the celestial sphere CS are in contact with each other.

[0071] A viewpoint is placed on the equatorial plane EQS including the equator EQ, and a virtual object VO viewed from the viewpoint on the equatorial plane EQS is projected onto the cylinder CY. For example, when projecting the virtual object VO6 on the celestial sphere CS onto the cylinder CY, the viewpoint VP6 is placed on the straight line L6 passing through the intersection point CP6 of the great circle GC6 passing through the virtual object VO6 and the equator EQ and the center O of the celestial sphere CS. The great circle GC6 is the intersection line between the plane including the virtual object VO6, the zenith ZE, and the nadir NA and the surface SS of the celestial sphere CS. The straight line L6 is on the equatorial plane EQS. The projection object PO6 is projected onto the intersection point of the straight line LP6 passing through the viewpoint VP6 and the virtual object VO6 and the cylinder CY.

[0072] FIG. 9 is a schematic diagram of the entire planar image HG including the planar celestial sphere image PCI. The planar celestial sphere image PCI is obtained by cutting open the cylinder CY in FIG. 8 and developing it into the planar image HG. Each meridian LO is a straight line parallel to each other, and each meridian LO is arranged at equal intervals. Each latitude LA is orthogonal to each meridian LO. Each latitude LA is a straight line parallel to each other. The interval between each latitude LA is adjusted so that it becomes wider as the latitude is higher. Therefore, the zenith ZE and the nadir NA shown in FIG. 8 become infinitely far away, and the zenith ZE and the nadir NA are not displayed in the planar image HG in FIG. 9.

[0073] In this way, the planar celestial sphere image PCI is an image of a partial region of the planar image HG obtained by projecting the virtual object VO on the surface SS of the celestial sphere CS onto the cylinder CY that is in contact with the celestial sphere CS along the equator EQ of the celestial sphere CS on the inner peripheral surface thereof and then developing the cylinder CY onto which the virtual object VO is projected into a plane.

[0074] By appropriately adjusting the intervals between the respective latitudes LA, the direction of a straight line connecting any two points on the plane SS of the celestial sphere CS is correctly represented. When the planar celestial sphere image PCI in FIG. 9 is displayed on the display 16 of the first terminal device 10, it becomes easy for the first user U1 to place the shared content at the position intended by the first user U1. The shared content is content to be shared between the first user U1 and the second user U2.

[0075] Note that the cylinder CY does not necessarily have to be in contact with the celestial sphere CS along the equator EQ of the celestial sphere CS, and it may be in contact along any great circle.

[0076] FIG. 10 is a diagram showing an example of an operation screen on the display 16 of the first terminal device 10. As shown in FIG. 10, the first user U1, for example, places the content CO5 at the first position P1 on the planar celestial sphere image PCI by drag-and-drop from the file manager FM.

[0077] When the content CO5 is placed on the planar celestial sphere image PCI by the first user U1, the position information and the image information about the content CO5 are transmitted from the first terminal device 10 to the server 30.

[0078] The content information acquisition unit 312 acquires the position information and the image information from the first terminal device 10. The position information is information indicating the first position P1. The position information is, for example, information including three-dimensional coordinates or latitude and longitude on the plane SS of the celestial sphere CS. The image information is information indicating an image of the content CO5. The image information includes a thumbnail of the content CO5, information regarding the display size of the content CO5, and the like.

[0079] The identification information acquisition unit 311 acquires the first identification information II1 from the first terminal device 10 and acquires the second identification information II2 from the second terminal device 20. Further, the identification information acquisition unit 311 acquires line-of-sight information regarding the second user U2 from the second terminal device 20.

[0080] The determination unit 313 determines, based on the second identification information II2, whether the second terminal device 20 displays a two-dimensional image or a three-dimensional image. In the present embodiment, the second terminal device 20 is an HMD. In other words, the second terminal device 20 is a device capable of displaying a three-dimensional image. Therefore, the determination unit 313 determines that the second terminal device 20 displays a three-dimensional image.

[0081] The determination unit 313 determines, based on the first identification information II1, whether the first terminal device 10 displays a two-dimensional image or a three-dimensional image. In the present embodiment, the first terminal device 10 is a PC having a flat display. In other words, the first terminal device 10 is a device that cannot display a three-dimensional image. Therefore, the determination unit 313 determines that the first terminal device 10 displays a two-dimensional image.

[0082] When the determination unit 313 determines that the first terminal device 10 displays a two-dimensional image, the first display control unit 314 generates a planar celestial sphere image PCI. The method for generating the planar celestial sphere image PCI is as described above.

[0083] The first display control unit 314 causes the first terminal device 10 to display the generated planar celestial sphere image PCI.

[0084] FIG. 11 is a diagram showing an example of a virtual space VS displayed on the display 28 of the second terminal device 20.

[0085] When the determination unit 313 determines that the second terminal device 20 displays a three-dimensional image, the second display control unit 315 generates a spatial image based on the position information regarding the first position P1 and the image information regarding the content CO5. The spatial image is a three-dimensional image. In this example, the spatial image is an image in which the content CO5 is arranged on the surface SS of the celestial sphere CS.

[0086] Further, the second display control unit 315 determines the position to arrange the content CO5 on the surface SS of the celestial sphere CS based on the relationship between the first position P1 and the positions of other contents arranged on the plane celestial sphere image PCI. The second display control unit 315 determines the size of the content CO5 based on the size of the image indicated by the image information and the sizes of other contents. The other contents are, for example, each of the contents CO1 to CO4. More specifically, the second display control unit 315 obtains the ratio between the size of the content CO1 and the size of the image of the content CO5, and multiplies the obtained ratio by the image of the content CO5 to determine the size of the content CO5.

[0087] The second display control unit 315 generates a three-dimensional spatial image in which the content CO5 is arranged on the surface SS of the celestial sphere CS based on the position where the content CO5 is arranged on the surface SS of the celestial sphere CS and the determined size of the content CO5. The second display control unit 315 causes the display 28 of the second terminal device 20 to display the spatial image. In this way, as shown in FIG. 11, the content CO5 arranged on the plane celestial sphere image PCI by the first user U1 is displayed on the display 28 of the second terminal device 20.

[0088] FIG. 12 is a diagram showing an example of the virtual space VS displayed on the display 28 of the second terminal device 20. The second user U2 shown in FIG. 11 is standing, while the second user U2 shown in FIG. 12 is sitting. Therefore, the posture of the second user U2 shown in FIG. 11 is different from the posture of the second user U2 shown in FIG. 12. Therefore, the direction LSa of the line of sight of the second user U2 with respect to the content CO5 in FIG. 11 is different from the direction LSb of the line of sight of the second user U2 with respect to the content CO5 in FIG. 12.

[0089] Therefore, the second display control unit 315 determines the orientation in which the content CO5 is arranged in the virtual space VS according to the posture of the second user U2. As shown in FIG. 12, when the second user U2 is seated, the second display control unit 315 arranges the elevation angle of the content CO5 downward compared to the case where the second user U2 is standing. Thereby, even when the second user U2 changes his or her own posture, the second user U2 can easily view the content CO5. Information regarding the posture of the second user U2 can be obtained, for example, based on the gaze information of the second user U2.

[0090] 1.2. Operations of the display control device according to the first embodiment 1.2.1. First operation of the processing device 31 FIG. 13 is a flowchart showing the first operation of the processing device 31 in FIG. 5. Hereinafter, the first operation of the processing device 31 will be described with reference to FIG. 13. The routine in FIG. 13 is started, for example, when the processing device 31 is activated and is executed every time a certain period of time elapses.

[0091] In step S11, the processing device 31 functions as the identification information acquisition unit 311 to acquire the first identification information II1 from the first terminal device 10 and acquire the second identification information II2 from the second terminal device 20.

[0092] In step S12, the processing device 31 functions as the determination unit 313 to determine whether the first terminal device 10 displays a two-dimensional image based on the first identification information II1.

[0093] When the first terminal device 10 displays a three-dimensional image, that is, when the determination result in step S12 is negative, the processing device 31 temporarily ends this routine.

[0094] On the other hand, when the first terminal device 10 displays a two-dimensional image, that is, when the determination result in step S12 is affirmative, the processing device 31 functions as the first display control unit 314 and generates a planar celestial sphere image PCI in step S13.

[0095] In step S14, the processing device 31 functions as the first display control unit 314 to cause the first terminal device 10 to display the planar celestial sphere image PCI and temporarily ends this routine.

[0096] 1.2.2. Second operation of the processing device 31 FIG. 14 is a flowchart showing the second operation of the processing device 31 in FIG. 5. Hereinafter, the second operation of the processing device 31 will be described with reference to FIG. 14. The routine in FIG. 14 is started, for example, when the processing device 31 is activated and is executed every time a certain period of time elapses. In FIG. 14, the same steps as those in FIG. 13 are denoted by the same reference numerals.

[0097] In step S11, the processing device 31 functions as the identification information acquisition unit 311 to acquire the first identification information II1 from the first terminal device 10 and acquire the second identification information II2 from the second terminal device 20.

[0098] In step S21, the processing device 31 functions as the determination unit 313 to determine whether the second terminal device 20 displays a three-dimensional image based on the second identification information II2.

[0099] When the second terminal device 20 displays a two-dimensional image, that is, when the determination result in step S21 is negative, the processing device 31 temporarily ends this routine.

[0100] On the other hand, when the second terminal device 20 displays a three-dimensional image, that is, when the determination result in step S21 is affirmative, the processing device 31 functions as the content information acquisition unit 312, and in step S22, determines whether the position information and image information of the shared content have been acquired.

[0101] When the position information and image information of the shared content have been acquired, that is, when the determination result in step S22 is affirmative, the processing device 31 functions as the second display control unit 315, and in step S23, determines the size of the shared content based on the size of the image indicated by the image information and the size of other content.

[0102] In step S24, the processing device 31 functions as the second display control unit 315 to generate a spatial image in which the shared content is arranged.

[0103] On the other hand, when the position information and image information of the shared content have not been acquired, that is, when the determination result in step S22 is negative, the processing device 31 functions as the second display control unit 315, and in step S25, generates a spatial image that does not include the shared content.

[0104] In step S26, the processing device 31 functions as the second display control unit 315 to display the spatial image on the second terminal device 20 and temporarily ends this routine.

[0105] 1.2.3. The Third Operation of the Processing Device 31 FIG. 15 is a flowchart showing the third operation of the processing device 31 in FIG. 5. Hereinafter, the third operation of the processing device 31 will be described with reference to FIG. 15. The routine in FIG. 15 is started, for example, when the processing device 31 is activated and is executed every time a certain period of time elapses. In FIG. 15, the same steps as those in FIG. 14 are denoted by the same reference numerals.

[0106] In step S11, the processing device 31 functions as an identification information acquisition unit 311 to acquire first identification information II1 from the first terminal device 10 and acquire second identification information II2 from the second terminal device 20.

[0107] In step S21, the processing device 31 functions as a determination unit 313 to determine whether the second terminal device 20 displays a three-dimensional image based on the second identification information II2.

[0108] When the second terminal device 20 displays a two-dimensional image, that is, when the determination result in step S21 is negative, the processing device 31 temporarily ends this routine.

[0109] On the other hand, when the second terminal device 20 displays a three-dimensional image, that is, when the determination result in step S21 is positive, the processing device 31 functions as a content information acquisition unit 312 to determine in step S22 whether the position information and image information of the shared content have been acquired.

[0110] When the position information and image information of the shared content have been acquired, that is, when the determination result in step S22 is positive, the processing device 31 functions as a second display control unit 315 to determine the size of the shared content based on the size of the image indicated by the image information and the size of other content in step S23.

[0111] In step S31, the processing device 31 functions as an identification information acquisition unit 311 to acquire the line-of-sight information of the second user U2 from the second terminal device 20.

[0112] In step S32, the processing device 31 functions as a second display control unit 315 to determine the orientation in which the shared content is arranged based on the line-of-sight information of the second user U2 in step S32.

[0113] In step S24, the processing device 31 functions as the second display control unit 315 to generate a spatial image in which the shared content is arranged.

[0114] On the other hand, when the position information and image information of the shared content are not acquired, that is, when the determination result in step S22 is negative, the processing device 31 functions as the second display control unit 315 to generate, in step S25, a spatial image that does not include the shared content.

[0115] In step S26, the processing device 31 functions as the second display control unit 315 to cause the second terminal device 20 to display the spatial image and temporarily end this routine.

[0116] 1.3. Effects of the First Embodiment According to the above description, the server 30 according to the first embodiment includes a determination unit 313 and a first display control unit 314. The determination unit 313 determines whether the first terminal device 10 displays a two-dimensional image or a three-dimensional image based on the first identification information II1. The first identification information II1 is information indicating the type of the first terminal device 10. The first terminal device 10 is a device held by the first user U1.

[0117] When the determination unit 313 determines that the first terminal device 10 displays a two-dimensional image, the first display control unit 314 generates a planar celestial sphere image PCI. The planar celestial sphere image PCI is an image in which a partial area of the celestial sphere CS indicating the entire range of the virtual space VS is represented planar. The virtual space VS is shared by a plurality of users including the first user U1 and the second user U2. The first display control unit 314 causes the first terminal device 10 to display the planar celestial sphere image PCI.

[0118] According to this aspect, a planar celestial sphere image PCI is generated for a device that displays a two-dimensional image, and the generated planar celestial sphere image PCI is displayed on the first terminal device 10. The planar celestial sphere image PCI is an image in which a partial region of the celestial sphere CS is represented in a planar manner. Therefore, the first user U1 can place the shared content at the intended position in the virtual space VS by placing the shared content on the planar celestial sphere image PCI.

[0119] Further, the determination unit 313 determines whether the second terminal device 20 displays a two-dimensional image or a three-dimensional image based on the second identification information II2. The second identification information II2 is information indicating the type of the second terminal device 20. The second terminal device 20 is a device possessed by the second user U2. When the first user U1 places the content to be shared at the first position P1 on the planar celestial sphere image PCI, the content information acquisition unit 312 acquires the position information and the image information from the first terminal device 10. The position information is information indicating the first position P1. The image information is information regarding the image of the content to be shared.

[0120] When the determination unit 313 determines that the second terminal device 20 displays a three-dimensional image, the second display control unit 315 generates a spatial image based on the position information and the image information. The spatial image is a three-dimensional image in which the content to be shared is arranged on the surface SS of the celestial sphere CS. When the determination unit 313 determines that the second terminal device 20 displays a three-dimensional image, the second display control unit 315 causes the second terminal device 20 to display the spatial image.

[0121] According to this aspect, the content placed on the planar celestial sphere image PCI by the first user U1 is reflected on the spatial image. Therefore, the second user U2 can visually recognize the content to be shared in the virtual space VS.

[0122] Further, the second display control unit 315 determines a position on the plane SS of the celestial sphere CS where the content to be shared is to be arranged based on the relationship between the first position indicated by the position information and the positions of other contents arranged on the plane celestial sphere image PCI. The second display control unit 315 determines the size of the content to be shared based on the size of the image indicated by the image information and the sizes of other contents. The second display control unit 315 causes the second terminal device 20 to display a three-dimensional spatial image in which the content with the determined size is arranged on the plane SS of the celestial sphere CS based on the position where the content is arranged on the plane SS of the celestial sphere CS and the size of the content.

[0123] According to this aspect, considering the positions and sizes of other contents already arranged on the virtual space VS, the position and size where the content to be shared is to be arranged are determined. Therefore, the content to be shared is arranged at a position and in a size that are easy for the second user U2 to view.

[0124] Also, the second display control unit 315 determines the orientation in which the content to be shared is to be arranged in the virtual space VS according to the posture of the second user U2. The second display control unit 315 causes the second terminal device 20 to display a spatial image based on the position where the content with the determined orientation is arranged on the plane SS of the celestial sphere CS, the size of the content, and the orientation of the content.

[0125] According to this aspect, the orientation in which the content to be shared is arranged on the virtual space VS is determined according to the posture of the second user U2, and the content to be shared is displayed on the second terminal device 20 according to the determined orientation. Therefore, the content to be shared is arranged in an orientation that is easy for the second user U2 to view.

[0126] Also, the plane celestial sphere image PCI is an image of a partial area of a plane image obtained by projecting and expanding the celestial sphere CS onto a cylinder.

[0127] According to this aspect, it becomes easy for the first user U1 to place the content to be shared at the position intended by the first user U1.

[0128] Further, when it is determined by the determination unit 313 that the first terminal device 10 displays a two-dimensional image, the first display control unit 314 scrolls the planar celestial sphere image PCI displayed on the first terminal device 10 by operating the cursor button CUR or cursor keys of the first user U1.

[0129] According to this aspect, the first user U1 can easily grasp the state of the entire virtual space VS.

[0130] Also, the display control method according to the first embodiment determines whether the first terminal device 10 displays a two-dimensional image or a three-dimensional image based on the first identification information II1. The first identification information II1 is information indicating the type of the first terminal device 10. The first terminal device 10 is a device possessed by the first user U1.

[0131] When it is determined that the first terminal device 10 displays a two-dimensional image, the display control method generates a planar celestial sphere image PCI. The planar celestial sphere image PCI is an image in which a partial region of the celestial sphere CS indicating the entire range of the virtual space VS is represented in a planar manner. The virtual space VS is shared by a plurality of users including the first user U1 and the second user U2. The display control method causes the first terminal device 10 to display the planar celestial sphere image PCI.

[0132] According to this aspect, the planar celestial sphere image PCI is generated for a device that displays a two-dimensional image, and the generated planar celestial sphere image PCI is displayed on the first terminal device 10. The planar celestial sphere image PCI is an image in which a partial region of the celestial sphere CS is represented in a planar manner. Therefore, the first user U1 can place the shared content at the intended position in the virtual space VS by placing the shared content on the planar celestial sphere image PCI.

[0133] 2. Second Embodiment Hereinafter, with reference to FIGS. 16 to 20, the configuration of the display control device according to the second embodiment of the present invention will be described. In the following description, for the sake of simplicity of explanation, the same reference numerals may be used for the same components as those in the first embodiment, and the description of their functions may be omitted. Further, in the following description, for the sake of simplicity of explanation, mainly the differences between the second embodiment and the first embodiment will be described.

[0134] 2.1. Configuration of the Second Embodiment 2.1.1. Overall Configuration FIG. 16 is a diagram showing the overall configuration of an information processing system 1A including a display control device according to the second embodiment. As shown in FIG. 16, the information processing system 1A is different from the information processing system 1 according to the first embodiment in that it includes a server 30A instead of the server 30. The server 30A is an example of a display control device.

[0135] 2.1.2. Configuration of the Terminal Device Since the first terminal device 10 has the same configuration as the first terminal device 10 according to the first embodiment, a detailed description thereof will be omitted. Since the second terminal device 20 has the same configuration as the second terminal device 20 according to the first embodiment, a detailed description thereof will be omitted.

[0136] 2.1.3. Configuration of the Server FIG. 17 is a block diagram showing a configuration example of the server 30A in FIG. 16. As shown in FIG. 17, the server 30A is different from the server 30 according to the first embodiment in that it includes a processing device 31A instead of the processing device 31 and a storage device 32A instead of the storage device 32.

[0137] The processing device 31A is a processor that controls the entire server 30A and is configured using, for example, one or more chips. The processing device 31A is configured using, for example, a central processing unit (CPU) that includes an interface with peripheral devices, an arithmetic unit, and registers. Note that some or all of the functions provided in the processing device 31A may be realized by hardware such as a DSP, an ASIC, a PLD, or an FPGA. The processing device 31A executes various processes in parallel or sequentially.

[0138] The storage device 32A is a recording medium that can be read from and written to by the processing device 31A. The storage device 32A includes, for example, a non-volatile memory and a volatile memory. The non-volatile memory is, for example, a ROM, an EPROM, and an EEPROM. The volatile memory is, for example, a RAM.

[0139] The storage device 32A stores a plurality of programs including a control program PR4 to be executed by the processing device 31A. The storage device 32A also functions as a work area for the processing device 31A.

[0140] The communication device 33, the display 34, and the input device 35 are the same as the communication device 33, the display 34, and the input device 35 of the first embodiment, respectively, and thus the description thereof is omitted.

[0141] The processing device 31A functions as an identification information acquisition unit 311, a content information acquisition unit 312, a determination unit 313, a first display control unit 314A, and a second display control unit 315 by, for example, reading and executing the control program PR4 from the storage device 32A. That is, the processing device 31A functions as the first display control unit 314A instead of the first display control unit 314, and thus is different from the processing device 31 according to the first embodiment.

[0142] The functions of the identification information acquisition unit 311, the content information acquisition unit 312, the determination unit 313, and the second display control unit 315 are the same as those of the identification information acquisition unit 311, the content information acquisition unit 312, the determination unit 313, and the second display control unit 315 of the processing device 31 in the first embodiment, and thus the description thereof is omitted.

[0143] FIG. 18 is a diagram showing an example of a planar celestial sphere image PCI according to the second embodiment. In the present embodiment, as shown in FIG. 18, the planar celestial sphere image PCI is a circular image obtained by looking down on the entire celestial sphere CS from above the celestial sphere CS. The center of the planar celestial sphere image PCI corresponds to the zenith ZE of the celestial sphere CS. The outer periphery of the planar celestial sphere image PCI corresponds to the nadir NA of the celestial sphere CS.

[0144] The first display control unit 314A generates the planar celestial sphere image PCI so that the positional relationship of the content displayed on the planar celestial sphere image PCI with respect to the longitude of the celestial sphere CS is maintained. Further, the first display control unit 314A generates the planar celestial sphere image PCI so that, with respect to the positional relationship with respect to the latitude of the celestial sphere CS, the content arranged above the celestial sphere CS is arranged more radially outward on the planar celestial sphere image PCI.

[0145] The first display control unit 314A generates the planar celestial sphere image PCI so that the content arranged above the celestial sphere CS becomes relatively larger. For example, the slide materials SL1 to SL4 are all displayed as objects of the same size in the virtual space VS. In other words, the second display control unit 315 generates the slide materials SL1 to SL4 as objects of the same size. In contrast, on the planar celestial sphere image PCI, the slide materials SL1 to SL4 are displayed larger as the slides arranged more radially outward on the planar celestial sphere image PCI.

[0146] FIG. 19 is a diagram showing an example of the case where the first user U1 arranges shared content on the planar celestial sphere image PCI. As shown in FIG. 19, when the first user U1 arranges the content CO5 on the planar celestial sphere image PCI, the first display control unit 314A enlarges the content CO5 as the first user U1 arranges the content CO5 further outward in the radial direction of the planar celestial sphere image PCI.

[0147] When the first user U1 moves the content CO5 on the planar celestial sphere image PCI while dragging the content CO5 using the input device 17, the first display control unit 314A changes the size of the content CO5 according to the position of the content CO5 in the radial direction of the planar celestial sphere image PCI.

[0148] The content CO5a is the content CO5 arranged at the outermost position in the radial direction of the planar celestial sphere image PCI. The content CO5b is the content CO5 arranged inside the content CO5a in the radial direction of the planar celestial sphere image PCI. The content CO5c is the content CO5 arranged inside the content CO5b in the radial direction of the planar celestial sphere image PCI. The content CO5d is the content CO5 arranged at the innermost position in the radial direction of the planar celestial sphere image PCI.

[0149] The content CO5a is the largest among the contents CO5a to CO5d. The content CO5b is the second largest. The content CO5c is the second largest. The content CO5d is the smallest among the contents CO5a to CO5d. According to this aspect, the second user U2 can more accurately grasp the position of the content in the latitude direction.

[0150] 2.2.1. Operation of the processing device 31A FIG. 20 is a flowchart showing the operation of the processing device 31A in FIG. 17. Hereinafter, the operation of the processing device 31A will be described with reference to FIG. 20. The routine in FIG. 20 is started, for example, when the processing device 31A is activated and is executed every time a certain period of time elapses.

[0151] In step S41, by functioning as the identification information acquisition unit 311, the processing device 31A acquires the first identification information II1 from the first terminal device 10 and acquires the second identification information II2 from the second terminal device 20.

[0152] In step S42, by functioning as the determination unit 313, the processing device 31A determines whether the first terminal device 10 displays a two-dimensional image based on the first identification information II1.

[0153] When the first terminal device 10 displays a three-dimensional image, that is, when the determination result in step S42 is negative, the processing device 31A temporarily ends this routine.

[0154] On the other hand, when the first terminal device 10 displays a two-dimensional image, that is, when the determination result in step S42 is positive, the processing device 31A functions as the content information acquisition unit 312 and determines in step S43 whether the position information and image information of the shared content have been acquired.

[0155] When the position information and image information of the shared content have been acquired, that is, when the determination result in step S43 is positive, the processing device 31A functions as the first display control unit 314A and determines the size of the shared content based on the position of the shared content and the size of the image in step S44.

[0156] In step S45, by functioning as the first display control unit 314A, the processing device 31A generates a planar celestial sphere image PCI on which the shared content is arranged.

[0157] On the other hand, when the position information and image information of the shared content have not been acquired, that is, when the determination result in step S43 is negative, the processing device 31A functions as the first display control unit 314A and generates a planar celestial sphere image PCI that does not include the shared content in step S46.

[0158] In step S47, the processing device 31A functions as the first display control unit 314A to cause the first terminal device 10 to display the planar celestial sphere image PCI, and this routine is temporarily terminated.

[0159] 2.3. Effects of the Second Embodiment According to the above description, the planar celestial sphere image PCI according to the second embodiment is a circular image obtained by overlooking the entire celestial sphere CS from above the celestial sphere CS. In the processing device 31A according to the second embodiment, the first display control unit 314A causes the first terminal device 10 to display the planar celestial sphere image PCI such that the content displayed on the planar celestial sphere image PCI maintains the positional relationship with respect to the longitude of the celestial sphere, and the content arranged above the celestial sphere CS is arranged closer to the outer side in the radial direction of the planar celestial sphere image PCI.

[0160] According to this aspect, the first user U1 can overlook the entire celestial sphere CS in the virtual space VS on the display 16. As a result, when the first user U1 arranges the content to be shared on the celestial sphere CS, the first user U1 can easily grasp the position where the content to be shared should be arranged.

[0161] Also, when the first user U1 arranges the content to be shared at the first position P1 on the planar celestial sphere image PCI, the first display control unit 314A enlarges the content to be shared as the first user U1 arranges the content to be shared closer to the outer side in the radial direction of the planar celestial sphere image PCI.

[0162] According to this aspect, when the first user U1 arranges the content to be shared on the celestial sphere CS, the first user U1 can easily grasp the position in the latitude direction of the celestial sphere CS.

[0163] 3. Modification The present disclosure is not limited to the embodiments exemplified above. Specific modified embodiments are exemplified below. Two or more embodiments arbitrarily selected from the following examples may be combined. Also, the embodiments of the above-described embodiments and the following modified embodiments can be arbitrarily combined as long as they do not conflict with each other.

[0164] 3.1. Modified Example 1 In the first embodiment, the interval between each latitude line of the planar celestial sphere image PCI is adjusted so that it becomes wider as the latitude is higher. However, it is not limited to this, and the interval between each latitude line may be equally spaced regardless of the latitude, or may be adjusted so that it becomes narrower as the latitude is higher.

[0165] 3.2. Modified Example 2 In the first embodiment, the planar celestial sphere image PCI is generated by projecting the virtual object VO on the plane SS of the celestial sphere CS onto the cylinder CY that contacts the celestial sphere CS along the equator EQ of the celestial sphere CS on its inner peripheral surface. However, the planar celestial sphere image PCI may be generated by projecting the virtual object VO on the plane SS of the celestial sphere CS onto a cone that contacts the celestial sphere CS inside its conical surface.

[0166] 3.3. Modified Example 3 In the first embodiment, the planar celestial sphere image PCI is an image in which a partial region of the celestial sphere CS is represented planar. However, the planar celestial sphere image PCI may be an image in which the entire region of the celestial sphere CS is represented planar.

[0167] 3.4. Modified Example 4 In each of the above embodiments, the number of users of the information processing systems 1 and 1A was two, but the number of users may be three or more.

[0168] 3.4. Modified Example 5 In each of the above embodiments, the first identification information II1 and the second identification information II2 were stored in the storage device 12 and the storage device 22, respectively. However, the first identification information may be information indicating that the first terminal device 10 cannot output the line-of-sight information of the first user U1. The second identification information II2 may be information indicating that the second terminal device 20 can output the line-of-sight information of the second user U2. That is, whether the first terminal device 10 or the second terminal device 20 displays a two-dimensional image or a three-dimensional image may be determined according to whether the first terminal device 10 or the second terminal device 20 can output line-of-sight information.

[0169] 4. Others (1) In the above-described embodiments, the storage device 12, the storage device 22, the storage device 32, and the storage device 32A were exemplified by ROM and RAM, but flexible disks, magneto-optical disks (e.g., compact disks, digital versatile disks, Blu-ray (registered trademark) disks), smart cards, flash memory devices (e.g., cards, sticks, key drives), CD-ROMs (Compact Disc-ROMs), registers, removable disks, hard disks, floppy (registered trademark) disks, magnetic strips, databases, servers, and other appropriate storage media. Also, the program may be transmitted from a network via a telecommunication line. Also, the program may be transmitted from the communication network NET via a telecommunication line.

[0170] (2) In the above-described embodiments, the information, signals, etc. described may be represented using any of a variety of different technologies. For example, the data, instructions, commands, information, signals, bits, symbols, chips, etc. that may be referred to throughout the above description may be represented by voltage, current, electromagnetic waves, magnetic fields or magnetic particles, optical fields or photons, or any combination thereof.

[0171] (3) In the above-described embodiments, the input and output information, etc. may be stored in a specific location (e.g., memory), or may be managed using a management table. The input and output information, etc. can be overwritten, updated, or appended. The output information, etc. may be deleted. The input information, etc. may be transmitted to other devices.

[0172] (4) In the above-described embodiments, the determination may be made based on a value represented by 1 bit (0 or 1), may be made based on a boolean value (Boolean: true or false), or may be made by comparing numerical values (e.g., comparison with a predetermined value).

[0173] (5) The processing procedures, sequences, flowcharts, etc. exemplified in the above-described embodiments may be reordered as long as there is no contradiction. For example, for the methods described in the present disclosure, the elements of various steps are presented using an exemplary order and are not limited to the presented specific order.

[0174] (6) Each function illustrated in FIGS. 1 to 20 is realized by any combination of at least one of hardware and software. Also, the method of realizing each functional block is not particularly limited. That is, each functional block may be realized using one physically or logically combined device, or two or more physically or logically separated devices may be directly or indirectly (e.g., using wired, wireless, etc.) connected and realized using these multiple devices. The functional block may be realized by combining software with the above one device or the above multiple devices.

[0175] (7) The programs exemplified in the above-described embodiments should be broadly interpreted to mean instructions, instruction sets, code, code segments, program codes, programs, subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executable files, execution threads, procedures, functions, etc., whether called by the names such as software, firmware, middleware, microcode, hardware description language, or by other names.

[0176] Also, software, instructions, information, etc. may be transmitted and received via a transmission medium. For example, when software is transmitted from a website, server, or other remote source using at least one of wired technologies (such as coaxial cable, optical fiber cable, twisted pair, digital subscriber line (DSL), etc.) and wireless technologies (such as infrared rays, microwaves, etc.), at least one of these wired and wireless technologies is included within the definition of the transmission medium.

[0177] (8) In each of the foregoing embodiments, the terms "system" and "network" are used interchangeably.

[0178] (9) The information, parameters, etc. described in the present disclosure may be represented using absolute values, relative values from a predetermined value, or corresponding other information.

[0179] (10) In the above-described embodiments, the server 30 and the server 30A may include cases where they are mobile stations (MS: Mobile Station). A mobile station may also be referred to by those skilled in the art as a subscriber station, mobile unit, subscriber unit, wireless unit, remote unit, mobile device, wireless device, wireless communication device, remote device, mobile subscriber station, access terminal, mobile terminal, wireless terminal, remote terminal, handset, user agent, mobile client, client, or some other suitable terms. Also, in the present disclosure, terms such as "mobile station", "user terminal", "user equipment (UE)", "terminal", etc. may be used interchangeably.

[0180] (11) In the above-described embodiments, the terms "connected" and "coupled", or any variations thereof, mean any direct or indirect connection or coupling between two or more elements, and may include the presence of one or more intermediate elements between two elements that are "connected" or "coupled" to each other. The coupling or connection between elements may be a physical coupling or connection, a logical coupling or connection, or a combination thereof. For example, "connected" may be read as "accessed". As used in the present disclosure, two elements may be considered to be "connected" or "coupled" to each other using at least one of one or more wires, cables, and printed electrical connections, and also, as some non-limiting and non-exhaustive examples, electromagnetic energy having wavelengths in the radio frequency region, microwave region, and optical (both visible and invisible) region.

[0181] (12) In the above-described embodiments, the description "based on" does not mean "only based on" unless otherwise specified. In other words, the description "based on" means both "only based on" and "at least based on".

[0182] (13) As used herein, the terms "determining" and "determination" may encompass a wide variety of operations. "Determining" and "determination" may include, for example, judging, calculating, computing, processing, deriving, investigating, looking up (e.g., searching in a table, database, or other data structure), ascertaining, and considering something as having been "determined". Also, "determining" and "determination" may include considering something as having been "determined" after receiving (e.g., receiving information), transmitting (e.g., transmitting information), inputting, outputting, accessing (e.g., accessing data in memory), etc. Further, "determining" and "determination" may include considering something as having been "determined" after resolving, selecting, choosing, establishing, comparing, etc. That is, "determining" and "determination" may include considering something as having been "determined" after performing some operation. Also, "determining (determination)" may be replaced with "assuming", "expecting", "considering", etc.

[0183] (14) In the above-described embodiments, when the terms "include", "including", and their variants are used, these terms are intended to be inclusive, similar to the term "comprising". Further, the term "or" as used herein is not intended to be an exclusive disjunction.

[0184] (15) In the present disclosure, for example, when articles are added by translation, such as a, an, and the in English, the present disclosure may include that the nouns following these articles are in the plural form.

[0185] (16) In the present disclosure, the term "A and B are different" may mean that "A and B are different from each other". Note that this term may also mean that "A and B are each different from C". Terms such as "separate", "coupled", etc. may also be interpreted in the same way as "different".

[0186] (17) Each aspect / embodiment described in the present disclosure may be used alone, in combination, or switched and used during execution. Also, the notification of predetermined information (for example, the notification of "being X") is not limited to the explicitly made notification, and may be made implicitly (for example, by not making the notification of the predetermined information).

[0187] As described above in detail about the present disclosure, it is obvious to those skilled in the art that the present disclosure is not limited to the embodiments described in the present disclosure. The present disclosure can be implemented as modified and changed aspects without departing from the spirit and scope of the present disclosure determined by the description of the claims. Therefore, the description of the present disclosure is for the purpose of illustrative explanation and has no restrictive meaning for the present disclosure.

Description of Reference Numerals

[0188] 1, 1A... Information processing system, 10... First terminal device, 20... Second terminal device, 26... Display, 30, 30A... Server, 311... First acquisition unit, 312... Second acquisition unit, 313... Determination unit, 314, 314A... First display control unit, 315... Second display control unit, CO1 to CO5, CO5a to CO5d... Content, CS... Celestial sphere, CY... Cylinder, HG... Planar image, II1... First identification information, II2... Second identification information, P1... First position, PCI... Planar celestial sphere image, SS... Plane, U1... First user, U2... Second user, VS... Virtual space

Claims

1. A determination unit that determines whether the first terminal device displays a two-dimensional image or a three-dimensional image based on first identification information indicating the type of the first terminal device possessed by the first user; A first display control unit that causes the first terminal device to display a planar celestial sphere image in which at least a partial region of a celestial sphere indicating the range of the entire virtual space shared by a plurality of users including the first user and the second user is represented in a planar manner when it is determined by the determination unit that the first terminal device displays a two-dimensional image; A display control device comprising the same.

2. The determination unit determines whether the second terminal device displays a two-dimensional image or a three-dimensional image based on second identification information indicating the type of the second terminal device possessed by the second user, A content information acquisition unit that acquires position information indicating the first position and image information indicating an image of the content from the first terminal device when the first user arranges the content to be shared at the first position on the planar celestial sphere image, A second display control unit that causes the second terminal device to display a three-dimensional space image in which the content is arranged on the surface of the celestial sphere based on the position information and the image information when it is determined by the determination unit that the second terminal device displays a three-dimensional image; The display control device according to claim 1, comprising the same.

3. The second display control unit, determines a position where the content is arranged on the surface of the celestial sphere based on the relationship between the first position indicated by the position information and the positions of other content arranged on the planar celestial sphere image, determines the size of the content based on the size of the image indicated by the image information and the sizes of the other content, and causes the second terminal device to display the three-dimensional space image in which the content is arranged on the surface of the celestial sphere based on the determined position where the content is arranged on the surface of the celestial sphere and the determined size of the content; The display control device according to claim 2.

4. The second display control unit determines the orientation in which the content is arranged in the virtual space according to the posture of the second user, and causes the second terminal device to display the space image based on the determined position where the content is arranged on the surface of the celestial sphere, the determined size of the content, and the determined orientation in which the content is arranged; The display control device according to claim 3.

5. The planar celestial sphere image is an image of at least a partial area of a planar image obtained by projecting and developing the celestial sphere onto either a cylinder or a cone. The display control device according to claim 1.

6. When the first display control unit determines, based on the determination by the determination unit, that the first terminal device displays a two-dimensional image, the first display control unit scrolls the planar celestial sphere image displayed on the first terminal device by a specific operation of the first user. The display control device according to claim 5.

7. The planar celestial sphere image is a circular image obtained by overlooking the entire celestial sphere from either above or below the celestial sphere. The first display control unit causes the planar celestial sphere image to be displayed on the first terminal device such that the positional relationship of the content displayed in the planar celestial sphere image with respect to the longitude of the celestial sphere is maintained, and the content is arranged closer to the outer side in the radial direction of the planar celestial sphere image as the content is arranged on either the upper or lower side of the celestial sphere. The display control device according to claim 1.

8. When the first user arranges content to be shared at a first position on the planar celestial sphere image, the first display control unit enlarges the content as the first user arranges the content closer to the outer side in the radial direction of the planar celestial sphere image. The display control device according to claim 7.

9. Based on first identification information indicating the type of the first terminal device possessed by the first user, determine whether the first terminal device displays a two-dimensional image or a three-dimensional image. When it is determined that the first terminal device displays a two-dimensional image, cause the first terminal device to display a planar celestial sphere image in which at least a partial area of the celestial sphere indicating the entire range of the virtual space shared by a plurality of users including the first user and the second user is represented in a planar manner. Display control method.

Images