Display control device

Abstract

This display control device comprises: an acquisition unit that acquires a plurality of pieces of position information output from a plurality of positioning devices for measuring the position of a display device, and acquires a virtual object from a server; a plurality of determination units that correspond to the plurality of positioning devices on a one-to-one basis and each determine whether or not the acquisition unit has acquired corresponding one of the plurality of pieces of position information; and a display control unit that displays the virtual object acquired by the acquisition unit from the server on the display device on the basis of the results of determination by the plurality of determination units.

Description

Technical Field

[0004] , , , , , , , , ,

[0005] , , , , ,

[0001] The present invention relates to a display control device. In particular, the present invention relates to a display control device that causes a display device to display a virtual space including virtual objects based on position information.

Background Art

[0002] A display control device using AR (Augmented Reality) technology causes a display device to display an extended reality space in which the real space is virtually extended. When the display control device displays content related to facilities existing particularly around the user of the display device in the extended reality space, it may use the position information acquired by a positioning device.

[0003] For example, Patent Document 1 discloses an AR platform system that creates display information to be displayed in an AR space and then transmits the display information to a device used by an information user. In this AR platform system, a device used by an information provider transmits position information measured by a positioning device provided in itself to the platform. When a device used by an information user outputs a request for requesting display information to the platform, the platform searches a database in which the position information is stored and then outputs the display information to the device used by the information user.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] When a display device that displays an AR space uses position information acquired from a positioning device, the accuracy of the position information and the places where the position information can be used differ depending on the type of the positioning device.

[0006] Therefore, the present invention aims to provide a display control device that changes the method of controlling the display of a virtual object according to the type of positioning device that acquired the location information when displaying a virtual object using location information. [Means for solving the problem]

[0007] A display control device according to a preferred embodiment of the present invention is a display control device comprising: an acquisition unit that acquires a plurality of positioning devices, each of which positions the location of a display device, and acquires a virtual object from a server; a plurality of determination units that correspond one-to-one with the plurality of positioning devices and determine whether each of the plurality of positioning devices has been acquired by the acquisition unit; and a display control unit that causes the virtual object acquired by the acquisition unit from the server to be displayed on the display device based on the determination results of the plurality of determination units. [Effects of the Invention]

[0008] According to the present invention, when displaying a virtual object using location information, the method for controlling the display of the virtual object can be changed depending on the type of positioning device that acquired the location information. [Brief explanation of the drawing]

[0009] [Figure 1] A diagram showing the overall configuration of Information Processing System 1. [Figure 2] A block diagram showing an example configuration of the location information server 20. [Figure 3] A block diagram showing an example configuration of content server 30. [Figure 4] A block diagram showing an example of the configuration of a content database CD. [Figure 5] An explanatory diagram showing an example of a second virtual object A. [Figure 6] An explanatory diagram showing an example of the first virtual object B. [Figure 7] A block diagram showing an example configuration of terminal device 10-K. [Figure 8] A flowchart illustrating the operation of terminal device 10-K. [Figure 9] A block diagram showing an example configuration of content server 30A. [Figure 10] A flowchart illustrating the operation of terminal device 10A-K. [Modes for carrying out the invention]

[0010] 1: First Embodiment The configuration of the information processing system 1, including the terminal device 10 as a display control device according to the first embodiment of the present invention, will be described below with reference to Figures 1 to 8.

[0011] 1-1: Configuration of the First Embodiment 1-1-1: Overall structure Figure 1 shows the overall configuration of the information processing system 1. As shown in Figure 1, the information processing system 1 comprises terminal devices 10-1, 10-2, ... 10-K, ... 10-J, a location information server 20, and a content server 30. J is an integer greater than or equal to 1. K is an integer between 1 and J. In this embodiment, terminal devices 10-1 to 10-J have the same configuration. However, terminal devices with different configurations may be included.

[0012] In the information processing system 1, terminal devices 10-1 to 10-J, location information server 20, and content server 30 are connected to each other via the communication network NET, enabling communication between them. In Figure 1, user U is assumed to be using terminal device 10-K.

[0013] The location information server 20 provides location information to terminal devices 10-1 to 10-J. Specifically, as described later, terminal devices 10-1 to 10-J are equipped with VPS devices 13. The location information server 20 generates VPS information based on image information acquired from terminal devices 10-1 to 10-J. Furthermore, the location information server 20 provides the generated VPS information to terminal devices 10-1 to 10-J as first location information.

[0014] The content server 30 provides various data and cloud services to the terminal devices 10-1 to 10-J via the communication network NET. In particular, the content server 30 provides various contents displayed in the AR space to the terminal devices 10-1 to 10-J.

[0015] The terminal device 10-K causes a virtual object arranged in the augmented reality space or the mixed reality space to be displayed on the display 17 provided in the terminal device 10-K or on AR glasses or MR (Mixed Reality) glasses connected to the terminal device 10-K and worn by the user U on the head. The virtual object is, for example, a virtual object indicating data such as a still image, a moving image, a 3DCG model, an HTML file, and a text file, and a virtual object indicating an application. Here, examples of the text file include a memo, a source code, a diary, and a recipe. Examples of the application include a browser, an application for using SNS, and an application for generating a document file. Note that the terminal device 10-K is preferably a mobile terminal device such as a smartphone and a tablet.

[0016] 1-1-2: Configuration of the Location Information Server FIG. 2 is a block diagram showing a configuration example of the location information server 20. The location information server 20 includes a processing device 21, a storage device 22, a communication device 23, a display 24, and an input device 25. Each element of the location information server 20 is interconnected using one or more buses for communicating information.

[0017] The processing device 21 is a processor that controls the entire position information server 20. Also, the processing device 21 is configured using, for example, one or more chips. The processing device 21 is configured using, for example, a central processing unit (CPU) that includes an interface with peripheral devices, an arithmetic unit, registers, and the like. Note that part or all of the functions of the processing device 21 may be realized using hardware such as DSP, ASIC, PLD, and FPGA. The processing device 21 executes various processes in parallel or sequentially.

[0018] The storage device 22 is a recording medium that can be read from and written to by the processing device 21. Also, the storage device 22 stores a plurality of programs including the control program PR2 executed by the processing device 21.

[0019] Also, the storage device 22 stores a 3D map database MD used when calculating the first position information. The 3D map database MD is a database of 3D maps. As will be described later, the VPS device 13 provided in the terminal device 10-K outputs image information indicating an image of the scenery in front of the user U captured by the imaging device 15 also provided in the terminal device 10-K to the position information server 20. A calculation unit 212 (to be described later) provided in the position information server 20 collates the image information with the 3D map stored in the 3D map database MD and calculates the position of the user U in the real space and the direction in which the user U views the real space.

[0020] The communication device 23 is hardware acting as a transmitting and receiving device for communicating with other devices. The communication device 23 is also called, for example, a network device, network controller, network card, or communication module. The communication device 23 may be equipped with a connector for wired connection and an interface circuit corresponding to the connector. The communication device 23 may also be equipped with a wireless communication interface. Examples of connectors and interface circuits for wired connection include products compliant with wired LAN, IEEE1394, and USB. Examples of wireless communication interfaces include products compliant with wireless LAN and Bluetooth®.

[0021] The display 24 is a device that displays images and text information. The display 24 displays various images under the control of the processing unit 21. For example, various display panels such as liquid crystal display panels and organic EL display panels are preferably used as the display 24.

[0022] The input device 25 is a device that receives operations from the administrator of the information processing system 1. For example, the input device 25 is configured to include a keyboard, touchpad, touch panel, or pointing device such as a mouse. If the input device 25 is configured to include a touch panel, it may also function as the display 24.

[0023] The processing unit 21, for example, reads and executes the control program PR2 from the storage device 22. As a result, the processing unit 21 functions as an acquisition unit 211, a calculation unit 212, and an output unit 213.

[0024] The acquisition unit 211 acquires image information from the terminal device 10-K, which shows an image of the scenery in front of the user U, captured by the imaging device 15 installed in the terminal device 10-K.

[0025] The calculation unit 212 compares the image information acquired by the acquisition unit 211 with a three-dimensional map stored in the 3D map database MD stored in the storage device 22, and calculates the position of user U in real space and the direction in which user U is visually viewing real space. More specifically, the calculation unit 212 extracts multiple feature points from the image shown by the above image information. The calculation unit 212 also compares the extracted feature points with feature points included in the three-dimensional map. Based on the results of this comparison, the calculation unit 212 calculates the position of user U in real space and the direction in which user U is visually viewing real space.

[0026] The output unit 213 outputs to the terminal device 10-K the position of user U in real space and the direction in which user U is visually viewing real space, which have been calculated by the calculation unit 212.

[0027] 1-1-3: Content Server Configuration Figure 3 is a block diagram showing an example configuration of a content server 30. The content server 30 comprises a processing unit 31, a storage device 32, a communication device 33, a display 34, and an input device 35. Each element of the content server 30 is interconnected using one or more buses for communicating information.

[0028] The processing unit 31 is a processor that controls the entire content server 30. The processing unit 31 is configured using, for example, one or more chips. The processing unit 31 is configured using, for example, a central processing unit (CPU) that includes interfaces with peripheral devices, an arithmetic unit, and registers. Some or all of the functions of the processing unit 31 may be implemented using hardware such as a DSP, ASIC, PLD, and FPGA. The processing unit 31 executes various processes in parallel or sequentially.

[0029] The storage device 32 is a recording medium that can be read and written to by the processing device 31. The storage device 32 also stores multiple programs, including the control program PR3 executed by the processing device 31.

[0030] Furthermore, the storage device 32 stores a content database CD that contains content to be provided to the terminal device 10-K.

[0031] Figure 4 is a block diagram showing an example of the configuration of a content database CD. The content database CD stores content data 321A to content data 321N as data indicating the content to be provided to the terminal device 10-K. The number of these data items from content data 321A to content data 321N can be any number. For example, content data 321A includes first virtual object data 321A-1 and second virtual object data 321A-2. The number of each of the first virtual object data 321A-1 and second virtual object data 321A-2 included in content data 321A can also be any number.

[0032] As described later, the acquisition unit 311 acquires VPS information as first location information from the terminal device 10-K. The acquisition unit 311 also acquires GPS information as second location information from the terminal device 10-K. The first virtual object data 321A-1 is data indicating the first virtual object B, which the output unit 313 (described later) transmits to the terminal device 10-K when the acquisition unit 311 acquires the first location information. This first virtual object B corresponds to the first location information. On the other hand, the second virtual object data 321A-2 is data indicating the second virtual object A, which the output unit 313 (described later) transmits to the terminal device 10-K when the acquisition unit 311 acquires second location information instead of first location information. This second virtual object A corresponds to second location information.

[0033] Figure 5 is an explanatory diagram showing an example of a second virtual object A. Here, the real space RS is displayed on the display 17 of the terminal device 10-K, or on either the AR glasses or MR glasses connected to the terminal device 10-K, and the second virtual objects A1 to A3 are superimposed on the real space RS. In other words, the second virtual objects A1 to A3 are superimposed on the real space RS to constitute an augmented reality space or a mixed reality space. In Figure 5, the second virtual objects A1 and A2 are icons. When user U clicks on an icon on the display 17 or selects an icon in the augmented reality space displayed on the AR glasses, information about the equipment located below the icon is displayed. The second virtual object A3 is a text box. The second virtual object A3 is a text box that describes what kind of equipment is located below it. In the example shown in Figure 5, these icons and text boxes are two-dimensional images. Furthermore, the display positions of the second virtual objects A1 to A3 only roughly indicate the location of the equipment represented by each of them. The reason for this rough display is that the second virtual objects A1 to A3 correspond to GPS information, which is the second location information, and GPS information is expected to have an error of about 10m. As described above, the second virtual objects A1 to A3 are simple icons or text boxes and only explain the category of equipment represented by them.

[0034] Figure 6 is an explanatory diagram showing an example of the first virtual object B. Here, the real space RS is displayed on the display 17 of the terminal device 10-K, or on either the AR glasses or MR glasses connected to the terminal device 10-K, and the first virtual objects B1 to B2 are superimposed on the real space RS. In other words, the first virtual objects B1 to B2 are superimposed on the real space RS to constitute an augmented reality space or a mixed reality space. The first virtual object B1 is a floor guide of the facility indicated by the first virtual object B1. The floor guide is a three-dimensional image that shows detailed information about the floors included in the facility using both images and text. The first virtual object B2 is a virtual sign. The first virtual object B2 extends in the width direction of the building and is displayed to coincide with its position in the width direction of the building. The reason for this precision in the display position is that the first virtual objects B1 to B2 correspond to the VPS information, which is the first position information, and the VPS information is expected to have an error of at most about 1m. In the example shown in Figure 6, the first virtual objects B1 and B2 are three-dimensional images that display details of the available information.

[0035] In the augmented reality space or mixed reality space displayed by the terminal device 10-K, the virtual objects superimposed on the real space RS include the first virtual objects B1-B2 and the second virtual objects A1-A3. The terminal device 10-K switches between displaying the first virtual objects B1-B2 or the second virtual objects A1-A3 as virtual objects, based on whether the acquired location information is first location information or second location information.

[0036] In the examples shown in Figures 5 and 6, comparing the first virtual objects B1-B2 with the second virtual objects A1-A3, as described above, the first virtual objects B1-B2 are three-dimensional images, while the second virtual objects A1-A3 are two-dimensional icons or text boxes. In other words, the first virtual objects B1-B2 and the second virtual objects A1-A3 are of different types. Furthermore, the information displayed by the first virtual objects B1-B2 is more detailed than the information displayed by the second virtual objects A1-A3. Specifically, the images displayed by the first virtual objects B1-B2 contain more information, both in terms of appearance and in terms of the information conveyed to user U regarding the equipment, than the icons or text boxes displayed by the second virtual object A1-A3. In addition, the first virtual objects B1-B2 are displayed at a pinpoint location relative to the equipment corresponding to the first virtual objects B1-B2, taking into account the actual building shape and size. On the other hand, the second virtual objects A1 to A3 are displayed in a position that roughly indicates the location of the equipment they correspond to. In other words, the accuracy of the display position relative to the real world differs between the first virtual objects B1 to B2 and the second virtual objects A1 to A3.

[0037] Furthermore, although not shown in Figures 5 and 6, the terminal device 10-K can utilize more accurate coordinates, for example, when users share the first virtual objects B1-B2. Moreover, in a situation where user U needs navigation to a predetermined facility, if the terminal device 10-K uses the second virtual objects A1-A3, it only displays a simplified route using arrows indicating the start and end points of the route. On the other hand, if the terminal device 10-K uses the first virtual objects B1-B2, it can superimpose a more detailed route onto the real world.

[0038] Returning to Figure 3, the communication device 33 is hardware acting as a transmitting and receiving device for communicating with other devices. The communication device 33 is also called, for example, a network device, network controller, network card, or communication module. The communication device 33 may be equipped with a connector for wired connection and an interface circuit corresponding to the connector. The communication device 33 may also be equipped with a wireless communication interface. Examples of connectors and interface circuits for wired connection include products compliant with wired LAN, IEEE 1394, and USB. Examples of wireless communication interfaces include products compliant with wireless LAN and Bluetooth®.

[0039] The display 34 is a device that displays images and text information. The display 34 displays various images under the control of the processing unit 31. For example, various display panels such as liquid crystal display panels and organic EL display panels are preferably used as the display 34.

[0040] The input device 35 is a device that receives operations from the administrator of the information processing system 1. For example, the input device 35 is configured to include a keyboard, touchpad, touch panel, or pointing device such as a mouse. If the input device 35 is configured to include a touch panel, it may also function as the display 34.

[0041] The processing unit 31, for example, reads and executes the control program PR3 from the storage device 32. As a result, the processing unit 31 functions as an acquisition unit 311, a determination unit 312, and an output unit 313.

[0042] The acquisition unit 311 acquires location information from the terminal device 10-K via the communication device 33.

[0043] The determination unit 312 determines whether the location information acquired by the acquisition unit 311 from the terminal device 10-K is first location information corresponding to VPS information or second location information corresponding to GPS information.

[0044] If the determination result of the determination unit 312 is the first location information, the output unit 313 reads one of the first virtual object data 321A-1 to 312N-1 corresponding to the first location information from the content database CD. Here, "one of the first virtual object data 321A-1 to 312N-1 corresponding to the first location information" means "one of the first virtual object data 321A-1 to 312N-1 corresponding to equipment located within a predetermined range centered on the location indicated by the first location information." The output unit 313 also transmits the first virtual object B, indicated by one of the first virtual object data 321A-1 to 312N-1 read from the content database CD, to the terminal device 10-K.

[0045] On the other hand, if the determination result of the determination unit 312 is second location information, the output unit 313 reads one of the second virtual object data 321A-2 to 312N-2 corresponding to the second location information from the content database CD. Here, "one of the second virtual object data 321A-2 to 312N-2 corresponding to the second location information" means "one of the second virtual object data 321A-2 to 312N-2 corresponding to equipment located within a predetermined range centered on the location indicated by the second location information." The output unit 313 also transmits the second virtual object A, indicated by one of the second virtual object data 321A-2 to 312N-2 read from the content database CD, to the terminal device 10-K.

[0046] 1-1-4: Terminal device configuration Figure 7 is a block diagram showing an example configuration of terminal device 10-K. Terminal device 10-K comprises a processing unit 11, a storage device 12, a VPS device 13, a GPS device 14, an imaging device 15, a communication device 16, a display 17, an input device 18, and an inertial sensor 19. Each element of terminal device 10-K is interconnected using one or more buses for communicating information.

[0047] The processing unit 11 is a processor that controls the entire terminal device 10-K. The processing unit 11 is also configured using, for example, one or more chips. The processing unit 11 is configured using, for example, a central processing unit (CPU) that includes interfaces with peripheral devices, an arithmetic unit, and registers. Some or all of the functions of the processing unit 11 may be implemented using hardware such as a DSP, ASIC, PLD, and FPGA. The processing unit 21 executes various processes in parallel or sequentially.

[0048] The storage device 12 is a recording medium that can be read and written to by the processing device 11. The storage device 12 also stores multiple programs, including the control program PR1 executed by the processing device 11. The storage device 12 may also store image information indicating the image displayed on the display 17.

[0049] The VPS device 13 acquires VPS information as first location information from the location information server 20. More specifically, the VPS device 13 acquires image information from the imaging device 15 (described later) that shows an image of the scenery in front of user U. The VPS device 13 also transmits the image information acquired from the imaging device 15 to the location information server 20 via the communication device 16. Furthermore, the VPS device 13 acquires VPS information from the location information server 20 via the communication device 16. This VPS information includes the location of user U in real space and the direction in which user U is looking at real space. Note that the VPS device 13 is an example of a first positioning device. The VPS information acquired by the VPS device 13 is first location information that indicates the location of the terminal device 10-K, and by extension, the location of the display 17 (described later) or user U.

[0050] The GPS device 14 receives radio waves from multiple satellites. The GPS device 14 also generates GPS information as second position information from the received radio waves. The second position information can be in any format as long as it can identify the location. The second position information indicates, for example, the latitude and longitude of the terminal device 10-K. As an example, the GPS information as second position information is obtained from the GPS device 14. However, the terminal device 10-K may acquire the second position information by any method. The acquired second position information is output to the processing device 11. Note that the GPS device 14 is an example of a second positioning device. The GPS information generated by the GPS device 14 is second position information that indicates the location of the terminal device 10-K, and by extension, the location of the display 17 or user U described later.

[0051] As described above, the VPS device 13 as the first positioning device and the GPS device 14 as the second positioning device differ from each other in at least one of their measurement accuracy and positioning method.

[0052] The imaging device 15 outputs imaging information obtained by imaging the external environment. The imaging device 15 also includes, for example, a lens, an image sensor, an amplifier, and an AD converter. Light focused through the lens is converted by the image sensor into an analog imaging signal. The amplifier amplifies the imaging signal and outputs it to the AD converter. The AD converter converts the amplified analog imaging signal into digital imaging information. The converted imaging information is output to the processing unit 11 and the VPS device 13. As described later, if the terminal device 10-K uses AR glasses or MR glasses connected to the terminal device 10-K instead of having a display 17, the terminal device 10-K may use the imaging device provided in the AR glasses or MR glasses instead of the imaging device 15.

[0053] The communication device 16 is hardware acting as a transmitting and receiving device for communicating with other devices. The communication device 16 is also called, for example, a network device, network controller, network card, or communication module. The communication device 16 may be equipped with a connector for wired connection and an interface circuit corresponding to the connector. The communication device 16 may also be equipped with a wireless communication interface. Examples of connectors and interface circuits for wired connection include products compliant with wired LAN, IEEE 1394, and USB. Examples of wireless communication interfaces include products compliant with wireless LAN and Bluetooth®.

[0054] The display 17 is a device that displays images and text information. The display 17 displays various images under the control of the processing unit 11. For example, various display panels such as liquid crystal display panels and organic EL (Electro-Luminescence) display panels are suitably used as the display 17. Note that if either AR glasses or MR glasses are connected to the terminal device 10-K, the display 17 does not have to be an essential component. Specifically, the terminal device 10-K may be configured without a display 17 by using the AR glasses or MR glasses as the display 17. The display 17, AR glasses, and MR glasses are examples of display devices.

[0055] The input device 18 accepts input from user U. For example, the input device 18 includes a keyboard, touchpad, touch panel, or pointing device such as a mouse. If the input device 18 includes a touch panel, it may also function as the display 17.

[0056] The inertial sensor 19 is a sensor that detects inertial force. The inertial sensor 19 includes, for example, one or more sensors from among an acceleration sensor, an angular velocity sensor, and a gyroscope sensor. The processing unit 11 detects the orientation of the terminal device 10-K based on the output information of the inertial sensor 19. Furthermore, based on the orientation of the terminal device 10-K, the processing unit 11 accepts the selection of one or more of the second virtual objects A1-A3 and the first virtual objects B1-B2, the input of characters, and the input of instructions in the augmented reality space or mixed reality space. For example, when user U operates the input device 18 with the central axis of the terminal device 10-K pointed towards a predetermined area in the augmented reality space or mixed reality space, the second virtual objects A1-A3 or the first virtual objects B1-B2 placed in the predetermined area are selected. User U's operation on the input device 18 is, for example, a double tap. In this way, by operating the terminal device 10-K, user U can select one or more of the second virtual objects A1-A3 and the first virtual objects B1-B2 without having to look at the input device 18 of the terminal device 10-K.

[0057] The processing unit 11 reads the control program PR1 from the storage device 12 and executes it. As a result, the processing unit 11 functions as an acquisition unit 111, a first determination unit 112, a second determination unit 113, an output unit 114, and a display control unit 115.

[0058] The acquisition unit 111 acquires VPS information as first position information from the VPS device 13, which acts as the first positioning device. The acquisition unit 111 also acquires GPS information as second position information from the GPS device 14, which acts as the second positioning device.

[0059] The acquisition unit 111 may or may not be able to acquire VPS information from the VPS device 13.

[0060] As described above, the VPS device 13 transmits image information to the location information server 20 that shows an image of the scenery in front of user U, captured by the imaging device 15. The location information server 20 extracts multiple feature points from the image shown by the image information and compares the extracted feature points with feature points included in the 3D map. Subsequently, the location information server 20 calculates user U's position in real space and the direction in which user U is looking at real space based on the results of the feature point comparison. However, if the scenery in front of user U is, for example, a space without patterns, a place with few visual features such as a grassland, a scenery that changes with season, weather, and time, or a scenery with the same pattern continuing, such as stairs, cobblestones, and lattice doors, the location information server 20 cannot extract feature points from the image of that scenery. In this case, even if the VPS device 13 transmits image information showing an image of the scenery in front of user U to the location information server 20, VPS information cannot be obtained. Therefore, the acquisition unit 111 may or may not be able to acquire VPS information from the VPS device 13.

[0061] Similarly, the acquisition unit 111 may or may not be able to acquire GPS information from the GPS device 14. As described above, the GPS device 14 receives radio waves from multiple satellites. The GPS device 14 also generates location information from the received radio waves. Therefore, if the radio wave environment is poor, the GPS device 14 cannot generate GPS information. Consequently, the acquisition unit 111 may or may not be able to acquire GPS information from the GPS device 14.

[0062] Comparing VPS information and GPS information, VPS information offers higher accuracy as location data. Therefore, services that provide AR or MR information using VPS information can offer services with higher accuracy location data compared to services that use GPS information.

[0063] On the other hand, the locations where VPS information can be used are more limited than those where GPS information can be used. Therefore, services that provide AR or MR information using GPS information can be deployed on a wider scale compared to services that use VPS information.

[0064] Furthermore, as will be described later, the acquisition unit 111 acquires virtual objects from the content server 30.

[0065] The first determination unit 112 determines whether the acquisition unit 111 was able to acquire VPS information as first location information.

[0066] The second determination unit 113 determines whether the acquisition unit 111 was able to acquire GPS information as second location information.

[0067] The output unit 114 transmits either the first location information or the second location information to the content server 30 via the communication device 16, based on at least one of the determination results of the first determination unit 112 and the determination results of the second determination unit 113. More specifically, if the acquisition unit 111 determines that it has acquired VPS information as the first location information, the output unit 114 transmits the VPS information as the first location information to the content server 30. On the other hand, if the acquisition unit 111 determines that it has not acquired VPS information as the first location information but has acquired GPS information as the second location information, the output unit 114 outputs the GPS information as the second location information to the content server 30.

[0068] As described above, when the content server 30 acquires VPS information as first location information, it outputs the first virtual object B, indicated by the first virtual object data corresponding to the acquired VPS information from among the first virtual object data 321A-1 to 321N-1, to the terminal device 10-K. On the other hand, when the content server 30 acquires GPS information as second location information, it outputs the second virtual object A, indicated by the second virtual object data corresponding to the acquired GPS information from among the second virtual object data 321A-2 to 321N-2, to the terminal device 10-K. The first virtual object B or the second virtual object A output from the content server 30 is acquired by the acquisition unit 111.

[0069] The display control unit 115 causes the first virtual object B or the second virtual object A acquired by the acquisition unit 111 to be displayed on the display 17. If the terminal device 10-K is equipped with either AR glasses or MR glasses connected to the terminal device 10-K instead of the display 17, the display control unit 115 causes the first virtual object B or the second virtual object A to be displayed on either the AR glasses or the MR glasses.

[0070] In other words, the display control unit 115 causes the virtual object acquired by the acquisition unit 111 from the content server 30 to be displayed on one of the display devices: the display 17, AR glasses, or MR glasses, based on the determination result of the first determination unit 112 and the determination result of the second determination unit 113.

[0071] As a result, since the terminal device 10-K has the above configuration, when displaying a virtual object using location information, the method of controlling the display of the virtual object can be changed according to the type of positioning device that acquired the location information.

[0072] If the determination result of the first determination unit 112 is positive, the display control unit 115 displays the first virtual object B on the display device. If the determination result of the first determination unit 112 is negative and the determination result of the second determination unit 113 is positive, the display control unit 115 displays the second virtual object A on the display device.

[0073] In particular, when the second virtual object A is displayed on one of the display devices, such as the display 17, AR glasses, or MR glasses, and the determination result of the first determination unit 112 changes from negative to positive, the display control unit 115 preferably displays the first virtual object B on the display device instead of the second virtual object A.

[0074] As a result, if terminal device 10-K acquires first position information while displaying second virtual object A on the display device, it switches to displaying first virtual object B corresponding to the first position information.

[0075] Furthermore, the display control unit 115 may, in particular when the determination result of the first determination unit 112 is positive, display the virtual object on one of the display devices among the display 17, AR glasses, and MR glasses based on the first position information and user information relating to user U. Here, "user information relating to user U" refers to, for example, information relating to user U's actions in the real space RS. Also, "information relating to user U's actions" refers to, for example, information relating to user U's movement.

[0076] For example, in a situation where multiple second virtual objects A relating to multiple facilities located within a predetermined distance from user U are displayed, if the acquisition unit 111 acquires VPS information, and multiple detailed routes from user U's current location to the multiple facilities are displayed, the display content on the display device becomes cluttered. For this reason, the display control unit 115 may select only one route, taking into account user U's direction of movement, and display only one detailed route on the display device.

[0077] Alternatively, when the acquisition unit 111 acquires VPS information, it can display multiple first virtual objects B relating to multiple facilities within a predetermined distance from user U. However, if user U is simply passing through the locations indicated by the VPS information at high speed, the display control unit 115 may display multiple second virtual objects A instead of the first virtual objects B.

[0078] As a result, the terminal device 10-K can display virtual objects on the display device in accordance with the actions of user U of the terminal device 10-K.

[0079] Furthermore, as described above, the first virtual object B and the second virtual object A differ in their type, the level of detail of the information they represent, and the accuracy of the display position of the virtual object superimposed on the real space. In other words, the display control unit 115 controls the type of virtual object to be displayed, the level of detail of the information it represents, and the accuracy of the display position of the virtual object in the real space by displaying either the first virtual object B or the second virtual object A on the display device.

[0080] As a result, the terminal device 10-K can change the display mode of the virtual object depending on whether it has acquired the first location information or the second location information.

[0081] Furthermore, when the acquisition unit 111 acquires VPS information as first position information from the VPS device 13, the acquisition unit 111 acquires visual information related to the direction in which user U is visually viewing the real space, which is included in the VPS information. The display control unit 115 may use this visual information to display a virtual object, in particular the first virtual object B, on one of the display devices, the display 17, AR glasses, or MR glasses.

[0082] As a result, the terminal device 10-K can display a virtual object on the display device, taking into account the direction in which the user U of the terminal device 10-K is looking.

[0083] 1-2: Operation of the First Embodiment Figure 8 is a flowchart illustrating the operation of the terminal device 10-K included in the information processing system 1 according to the first embodiment. The operation of the terminal device 10-K will be described below with reference to Figure 8.

[0084] In step S1, the processing unit 11 provided in the terminal device 10-K functions as a first determination unit 112. The processing unit 11 determines whether the acquisition unit 111 has acquired the first position information output from the VPS device 13, which is the first positioning device. If the determination result is affirmative, the processing unit 11 executes the process in step S2. If the determination result is negative, the processing unit 11 executes the process in step S5.

[0085] In step S2, the processing unit 11 in the terminal device 10-K functions as an output unit 114. The processing unit 11 transmits the first location information to the content server 30.

[0086] In step S3, the processing unit 11 in the terminal device 10-K functions as an acquisition unit 111. The processing unit 11 acquires from the content server 30 the first virtual object B indicated by the first virtual object data corresponding to the first location information transmitted in step S2, from among the first virtual object data 321A-1 to 321N-1.

[0087] In step S4, the processing unit 11 in the terminal device 10-K functions as a display control unit 115. The processing unit 11 displays the first virtual object B acquired in step S3 on one of the display devices: the display 17, AR glasses, or MR glasses. After that, the processing unit 11 executes the process of step S1.

[0088] In step S5, the processing unit 11 in the terminal device 10-K functions as a second determination unit 113. The processing unit 11 determines whether the acquisition unit 111 has acquired the second position information output from the GPS device 14, which is the second positioning device. If the determination result is positive, the processing unit 11 executes the process in step S6. If the determination result is negative, the processing unit 11 executes the process in step S1.

[0089] In step S6, the processing unit 11 in the terminal device 10-K functions as an output unit 114. The processing unit 11 transmits the second location information to the content server 30.

[0090] In step S7, the processing unit 11 in the terminal device 10-K functions as an acquisition unit 111. The processing unit 11 acquires from the content server 30 the second virtual object A indicated by the second virtual object data corresponding to the second location information transmitted in step S6, from among the second virtual object data 321A-2 to 321N-2.

[0091] In step S8, the processing unit 11 in the terminal device 10-K functions as a display control unit 115. The processing unit 11 displays the second virtual object A acquired in step S7 on one of the display devices: the display 17, the AR glasses, or the MR glasses. After that, the processing unit 11 executes the process of step S1.

[0092] 1-3: Effects of the First Embodiment According to the above description, the terminal device 10-K as a display control device includes an acquisition unit 111. The acquisition unit 111 acquires multiple location information and virtual objects, each output from multiple positioning devices that determine the position of the display 17, AR glasses, or MR glasses, which are display devices. More specifically, the acquisition unit 111 acquires first location information output from a first positioning device that determines the position of the display 17, AR glasses, or MR glasses, which are display devices. The acquisition unit 111 also acquires GPS information as second location information output from a second positioning device that determines the position of the above-mentioned display device. The terminal device 10-K also includes multiple determination units. These determination units determine whether the acquisition unit 111 has acquired each of the multiple location information. More specifically, the terminal device 10-K includes a first determination unit 112 and a second determination unit 113. The first determination unit 112 determines whether the acquisition unit 111 has acquired the first location information. The second determination unit 113 determines whether the acquisition unit 111 has determined the second location information. The terminal device 10-K also includes a display control unit 115. The display control unit 115 displays the virtual object acquired from the content server 30 on the display device based on the determination results of the multiple determination units. More specifically, the display control unit 115 displays the virtual object acquired from the content server 30 on the display device based on the determination result of the first determination unit 112 and the determination result of the second determination unit 113.

[0093] Since the terminal device 10-K has the above configuration, when displaying a virtual object using location information, the method of controlling the display of the virtual object can be changed according to the type of positioning device that acquired the location information. For example, when the terminal device 10-K acquires VPS information as first location information output from the VPS device 13 as first positioning device, and GPS information as second location information output from the GPS device 14 as second positioning device, it can display a virtual object corresponding to either the VPS information or the GPS information, depending on the acquisition status.

[0094] Furthermore, according to the above explanation, in the terminal device 10-K, the display control unit 115 controls at least one of the following based on the determination results of the multiple determination units: the type of virtual object, the level of detail of the information shown by the virtual object, and the accuracy of the display position of the virtual object superimposed on the real space relative to the real space. More specifically, in the terminal device 10-K, the display control unit controls at least one of the following based on the determination results of the first determination unit 112 and the determination results of the second determination unit 113: the type of virtual object, the level of detail of the information shown by the virtual object, and the accuracy of the display position of the virtual object superimposed on the real space relative to the real space.

[0095] Since the terminal device 10-K has the above configuration, it can change the display mode of the virtual object depending on whether the first location information or the second location information is acquired. For example, if the first location information is VPS information and the second location information is GPS information, the terminal device 10-K can, when it is able to acquire the first location information, display a virtual object with more information at a position precisely aligned with the real world, compared to when it is able to acquire the second location information.

[0096] Furthermore, according to the above explanation, in terminal device 10-K, the above-mentioned multiple measuring devices, specifically the first positioning device and the second positioning device, differ from each other in at least one of their measurement accuracy and positioning method.

[0097] Since the terminal device 10-K has the above configuration, it can be equipped with multiple different types of positioning devices, such as a VPS device and a GPS device. Furthermore, the terminal device 10-K can display virtual objects according to at least one of the measurement accuracy and positioning method of the measurements obtained from the positioning devices.

[0098] Furthermore, according to the above explanation, in the terminal device 10-K, the acquisition unit 111 acquires visual information regarding the direction in which the user of the display device is visually viewing the real space RS. The display control unit 115 uses the above visual information to display a virtual object on the display device.

[0099] Since the terminal device 10-K has the above configuration, the virtual object can be displayed on the display device as a result of taking into account the direction in which the user U of the terminal device 10-K is looking.

[0100] Furthermore, according to the above explanation, in terminal device 10-K, the above-mentioned multiple location information includes first location information. The multiple determination units include a first determination unit 112 that determines whether or not the first location information has been acquired. If the determination result of the first determination unit 112 is affirmative, the display control unit 115 displays a virtual object based on the first location information and user information relating to the user of the above-mentioned display device.

[0101] Since the terminal device 10-K has the above configuration, for example, it can display virtual objects on the display device in accordance with the actions of user U of the terminal device 10-K.

[0102] Furthermore, according to the above explanation, in terminal device 10-K, the above-mentioned plurality of location information includes first location information and second location information. The plurality of determination units include a first determination unit 112 that determines whether or not the first location information has been acquired. The virtual object includes a first virtual object B corresponding to the first location information and a second virtual object A corresponding to the second location information. The acquisition unit 111 acquires the first virtual object B and the second virtual object A. When the second virtual object A is displayed on the display device, the display control unit 115, if the determination result of the first determination unit 112 transitions from negative to positive, causes the first virtual object B to be displayed on the display device instead of the second virtual object A.

[0103] Since terminal device 10-K has the above configuration, if first position information is acquired while the second virtual object A is being displayed on the display device, it can switch to displaying the first virtual object B corresponding to the first position information.

[0104] 2: Second Embodiment Hereinafter, the configuration of the information processing system 1A, which includes a terminal device 10A-K as a display control device according to the second embodiment of the present invention, will be described with reference to Figures 9 to 10. In the following description, for the purpose of simplifying the explanation, the same reference numerals will be used for components of the information processing system 1A according to the second embodiment that are the same as those of the information processing system 1 according to the first embodiment, and their descriptions may be omitted.

[0105] 2-1: Configuration of the second embodiment 2-1-1: Overall Structure The information processing system 1A according to the second embodiment of the present invention differs from the information processing system 1 according to the first embodiment in that it includes a terminal device 10A instead of a terminal device 10, and a content server 30A instead of a content server 30. In all other respects, the overall configuration of the information processing system 1A is the same as the overall configuration of the information processing system 1 according to the first embodiment shown in Figure 1, so its illustration and description are omitted.

[0106] In the information processing system 1 according to the first embodiment, terminal device 10-K transmitted VPS information as first location information or GPS information as second location information to content server 30. When terminal device 10-K transmitted VPS information as first location information to content server 30, it obtained first virtual object B from content server 30, which is indicated by the first virtual object data corresponding to the VPS information from among the first virtual object data 321A-1 to 321N-1. On the other hand, when terminal device 10-K transmitted GPS information as second location information to content server 30, it obtained second virtual object A from content server 30, which is indicated by the second virtual object data corresponding to the GPS information from among the second virtual object data 321A-2 to 321N-2.

[0107] On the other hand, in the information processing system 1A according to the second embodiment, the terminal device 10A-K transmits location information to the content server 30, which includes at least one of VPS information as first location information and GPS information as second location information. The terminal device 10A-K also acquires content data 321 corresponding to the location information from content data 321A to 321N, which includes both first virtual object data and second virtual object data. Subsequently, the terminal device 10A-K displays either the first virtual object B or the second virtual object A on the display device based on the determination result of the first determination unit 112 and the determination result of the second determination unit 113.

[0108] 2-1-2: Terminal device configuration Unlike terminal device 10-K, terminal device 10A-K is equipped with a processing unit 11A instead of processing unit 11, and a storage device 12A instead of storage device 12.

[0109] Unlike the storage device 12, the storage device 12A stores control program PR1A instead of control program PR1. Unlike the processing device 11, the processing device 11A includes an acquisition unit 111A instead of an acquisition unit 111, an output unit 114A instead of an output unit 114, and a display control unit 115A instead of a display control unit 115. In other respects, the configuration of the terminal device 10A-K is the same as the configuration of the terminal device 10-K shown in Figure 7, so its illustration is omitted.

[0110] The output unit 114A transmits location information, including at least one of the first location information and the second location information, to the content server 30A via the communication device 16.

[0111] The acquisition unit 111A acquires content data 321 from the content server 30A, from among the content data 321A to 321N, that corresponds to the location information transmitted by the output unit 114A. Here, "content data 321 that corresponds to the location information transmitted by the output unit 114A" means "content data 321 that corresponds to equipment located within a predetermined range centered on the location indicated by the location information." The content data 321 includes first virtual object data and second virtual object data. That is, the acquisition unit 111A acquires both the first virtual object B indicated by the first virtual object data and the second virtual object A indicated by the second virtual object data from the content server 30A.

[0112] If the determination result of the first determination unit 112 is positive, the display control unit 115A causes the first virtual object B to be displayed on the display 17 or on either the AR glasses or MR glasses connected to the terminal device 10A-K. On the other hand, if the determination result of the first determination unit 112 is negative and the determination result of the second determination unit 113 is positive, the display control unit 115A causes the second virtual object A to be displayed on the above-mentioned display device.

[0113] As a result, terminal device 10A-K acquires both the first virtual object B and the second virtual object A from content server 30A in parallel, and switches between the first virtual object B and the second virtual object A to display, depending on whether the first location information and the second location information can be acquired.

[0114] 2-1-3: Content Server Configuration Figure 9 is a block diagram showing an example configuration of content server 30A. Unlike content server 30, content server 30A is equipped with a processing unit 31A instead of processing unit 31, and a storage device 32A instead of storage device 32.

[0115] Unlike the storage device 32, the storage device 32A stores the control program PR3A instead of the control program PR3.

[0116] The processing unit 31A includes an acquisition unit 311A ​​in place of the acquisition unit 311 in the processing unit 31, and an output unit 313A in place of the output unit 313. Furthermore, the processing unit 31A does not require the determination unit 312 provided in the processing unit 31 as an essential component.

[0117] The acquisition unit 311A ​​acquires location information, including at least one of the first location information and the second location information, from the terminal device 10A-K via the communication device 33.

[0118] The output unit 313A transmits content data 321, which corresponds to the location information acquired by the acquisition unit 311A, from among the content data 321A to 321N, to the terminal device 10A-K via the communication device 33.

[0119] 2-2: Operation of the second embodiment Figure 10 is a flowchart showing the operation of the terminal device 10A-K included in the information processing system 1A according to the second embodiment. The operation of the terminal device 10A-K will be described below with reference to Figure 10.

[0120] In step S11, the processing unit 11A provided in the terminal device 10A-K functions as an output unit 114A. The processing unit 11A transmits location information, which includes at least one of the first location information and the second location information, to the content server 30A.

[0121] In step S12, the processing unit 11A in the terminal device 10A-K functions as an acquisition unit 111A. The processing unit 11A acquires content data 321 from the content server 30A, from among the content data 321A to 321N, which corresponds to the location information transmitted in step S11.

[0122] In step S13, the processing unit 11A provided in the terminal device 10A-K functions as the first determination unit 112. The processing unit 11A determines whether the acquisition unit 111A has acquired the first position information output from the VPS device 13, which is the first positioning device. If the determination result is affirmative, the processing unit 11A executes the process in step S14. If the determination result is negative, the processing unit 11A executes the process in step S15.

[0123] In step S14, the processing unit 11A in the terminal device 10A-K functions as a display control unit 115A. The processing unit 11A causes the first virtual object B, indicated by the first virtual object data included in the content data 321 acquired in step S12, to be displayed on one of the display devices: the display 17, AR glasses, or MR glasses. Subsequently, the processing unit 11A executes the process of step S11.

[0124] In step S15, the processing unit 11A provided in the terminal device 10A-K functions as a second determination unit 113. The processing unit 11A determines whether the acquisition unit 111A has acquired the second position information output from the GPS device 14, which is the second positioning device. If the determination result is positive, the processing unit 11A executes the process in step S16. If the determination result is negative, the processing unit 11A executes the process in step S11.

[0125] In step S16, the processing unit 11A in the terminal device 10A-K functions as a display control unit 115A. The processing unit 11A causes the second virtual object A, indicated by the second virtual object data included in the content data 321 acquired in step S12, to be displayed on one of the display devices: the display 17, AR glasses, or MR glasses. Subsequently, the processing unit 11A executes the process of step S11.

[0126] 2-3: Effects of the second embodiment According to the above description, in the terminal device 10A-K as a display control device, the above-mentioned plurality of location information includes first location information and second location information. The above-mentioned plurality of determination units include a first determination unit 112 that determines whether or not the first location information has been acquired, and a second determination unit 113 that determines whether or not the second location information has been acquired. The virtual object includes a first virtual object B corresponding to the first location information and a second virtual object A corresponding to the second location information. The acquisition unit 111A acquires the first virtual object B and the second virtual object A. If the determination result of the first determination unit 112 is positive, the display control unit 115A displays the first virtual object B on the display device. If the determination result of the first determination unit 112 is negative and the determination result of the second determination unit 113 is positive, the display control unit 115A displays the second virtual object A on the display device.

[0127] Since the terminal device 10A-K has the above configuration, it can acquire both the first virtual object B and the second virtual object A from the content server 30A in parallel, and switch between the first virtual object B and the second virtual object A to display, depending on whether the first location information and the second location information can be acquired.

[0128] 3: Variant This disclosure is not limited to the embodiments illustrated above. Specific variations are illustrated below. Two or more embodiments arbitrarily selected from the following examples may be combined.

[0129] 3-1: Variation 1 In the first embodiment, the terminal device 10-K was equipped with two positioning devices: a VPS device 13 and a GPS device 14. The terminal device 10-K was also equipped with a first determination unit 112 and a second determination unit 113, each corresponding to one of these two positioning devices. However, the number of positioning devices equipped in the terminal device 10-K is not limited to two, and may be three or more.

[0130] For example, terminal device 10-K may include two VPS devices and one GPS device. In this case, terminal device 10-K determines, for example, whether it was able to obtain the first location information from the VPS device with higher accuracy among the two VPS devices. If it was not able to obtain the first location information, terminal device 10-K determines whether it was able to obtain the second location information from the VPS device with lower accuracy among the two VPS devices. If it was not able to obtain both the first and second location information, terminal device 10-K obtains the third location information from the GPS device. Terminal device 10-K outputs the location information it was able to obtain to the content server 30 and obtains a virtual object from the content server 30 that corresponds to the type of location information output.

[0131] 4: Other (1) In the embodiments described above, the storage devices 12 and 12A, storage device 22, and storage devices 32 and 32A are exemplified by ROM and RAM, but can also be flexible disks, magneto-optical disks (e.g., compact disks, digital multipurpose disks, Blu-ray® disks), smart cards, flash memory devices (e.g., cards, sticks, key drives), CD-ROMs (Compact Disc-ROMs), registers, removable disks, hard disks, floppy® disks, magnetic strips, databases, servers, and other suitable storage media. The program may also be transmitted from a network via a telecommunications line. The program may also be transmitted from a communication network NET via a telecommunications line.

[0132] (2) In the embodiments described above, the information, signals, etc. may be represented using any of the various different techniques. For example, the data, instructions, commands, information, signals, bits, symbols, chips, etc. that may be mentioned throughout the above description may be represented by voltage, current, electromagnetic waves, magnetic fields or magnetic particles, optical fields or photons, or any combination thereof.

[0133] (3) In the embodiments described above, the input and output information may be stored in a specific location (e.g., memory) or managed using a management table. The input and output information may be overwritten, updated, or appended to. The output information may be deleted. The input information may be transmitted to other devices.

[0134] (4) In the embodiments described above, the determination may be made by a value represented using 1 bit (0 or 1), by a boolean value (true or false), or by a numerical comparison (for example, a comparison with a predetermined value).

[0135] (5) The processing procedures, sequences, flowcharts, etc., exemplified in the embodiments described above may be rearranged in order, as long as they do not contradict each other. For example, the methods described in this disclosure present various step elements using an exemplary order and are not limited to the specific order presented.

[0136] (6) Each function illustrated in Figures 1 to 10 is implemented by any combination of at least one of hardware and software. Furthermore, the method of implementing each functional block is not particularly limited. That is, each functional block may be implemented using one device that is physically or logically coupled, or it may be implemented using two or more physically or logically separated devices that are directly or indirectly connected (for example, using wired or wireless connections). A functional block may also be implemented by combining the above one device or the above multiple devices with software.

[0137] (7) The programs illustrated in the embodiments described above should be broadly interpreted to mean instructions, instruction sets, code, code segments, program code, programs, subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executable files, execution threads, procedures, functions, etc., whether they are called software, firmware, middleware, microcode, hardware description languages ​​or by other names.

[0138] Furthermore, software, instructions, information, etc., may be transmitted and received via a transmission medium. For example, if software is transmitted from a website, server, or other remote source using at least one of wired technology (such as coaxial cable, fiber optic cable, twisted pair, or digital subscriber line (DSL)) and wireless technology (such as infrared or microwave), then at least one of these wired and wireless technologies is included in the definition of a transmission medium.

[0139] (8) In each of the above-mentioned forms, the terms “system” and “network” shall be used interchangeably.

[0140] (9) The information, parameters, etc. described in this disclosure may be expressed using absolute values, relative values ​​from a given value, or other corresponding information.

[0141] (10) In the embodiments described above, the terminal devices 10-1 to 10-J, terminal devices 10A-1 to 10A-J, location information server 20, and content servers 30 to 30A may be mobile stations (MS). A mobile station may also be referred to by those skilled in the art as a subscriber station, mobile unit, subscriber unit, wireless unit, remote unit, mobile device, wireless device, wireless communication device, remote device, mobile subscriber station, access terminal, mobile terminal, wireless terminal, remote terminal, handset, user agent, mobile client, client, or several other appropriate terms. In this disclosure, terms such as "mobile station," "user terminal," "user equipment (UE)," and "terminal" may be used interchangeably.

[0142] (11) In the embodiments described above, the terms “connected,” “coupled,” or any variation thereof means any direct or indirect connection or coupling between two or more elements, and may include the presence of one or more intermediate elements between two elements that are “connected” or “coupled” with each other. The coupling or connection between elements may be a physical coupling or connection, a logical coupling or connection, or a combination thereof. For example, “connection” may be reinterpreted as “access.” As used in this disclosure, two elements are considered to be “connected” or “coupled” with each other using at least one of one or more wires, cables and printed electrical connections, and, in some non-limiting and non-exclusive examples, electromagnetic energy having wavelengths in the radio frequency domain, microwave domain and optical (both visible and invisible) domain.

[0143] (12) In the embodiments described above, the phrase “based on” does not mean “based solely on” unless otherwise specified. In other words, the phrase “based on” means both “based solely on” and “based at least on.”

[0144] (13) The terms “determining” and “determining” as used in this disclosure may encompass a wide variety of actions. “Determining” may include, for example, judging, calculating, computing, processing, deriving, investigating, looking up, searching, inquiry (e.g., searching in a table, database or other data structure), and ascertaining. “Determining” may also include, for example, receiving (e.g., receiving information), transmitting (e.g., sending information), input, output, and accessing (e.g., accessing data in memory). Furthermore, "judgment" and "decision" can include considering something as having been "judged" or "decided" after resolving, selecting, choosing, establishing, comparing, etc. In other words, "judgment" and "decision" can include considering something as having been "judged" or "decided" after some action. Also, "judgment (decision)" can be reinterpreted as "assuming," "expecting," "considering," etc.

[0145] (14) Where the terms “include,” “including,” and variations thereof are used in the embodiments described above, these terms are intended to be inclusive, as is the term “comprising.” Furthermore, the term “or” as used in this disclosure is not intended to be exclusive OR.

[0146] (15) In the present disclosure, if articles are added by translation, such as a, an, and the in English, the present disclosure may include the fact that the noun following these articles is plural.

[0147] (16) In this disclosure, the term “A and B are different” may mean “A and B are different from each other.” The term may also mean “A and B are each different from C.” Terms such as “separate” and “combine” may be interpreted in the same way as “different.”

[0148] (17) Each aspect / embodiment described herein may be used individually, in combination, or switched between as needed in practice. Furthermore, notification of certain information (e.g., notification that "X is") is not limited to explicit notification, but may also be implicit (e.g., by not providing such notification).

[0149] Although the present disclosure has been described in detail above, it will be clear to those skilled in the art that the present disclosure is not limited to the embodiments described herein. The present disclosure can be implemented in modified and altered forms without departing from the intent and scope of the present disclosure as defined by the claims. Accordingly, the descriptions in the present disclosure are illustrative and not restrictive in any way. [Explanation of Symbols]

[0150] 1, 1A... Information processing system, 10, 10A... Terminal device, 11, 11A... Processing device, 12, 12A... Storage device, 13... VPS device, 14... GPS device, 15... Imaging device, 16... Communication device, 17... Display, 18... Input device, 19... Inertial sensor, 20... Location information server, 21... Processing device, 22... Storage device, 23... Communication device, 24... Display, 25... Input device, 30~30A... Content server, 31, 31A... Processing device, 32, 32A... Storage device, 33... Communication Signal device, 34…Display, 35…Input device, 111, 111A…Acquisition unit, 112…First determination unit, 113…Second determination unit, 114, 114A…Output unit, 115, 115A…Display control unit, 211…Acquisition unit, 212…Calculation unit, 213…Output unit, 311, 311A…Acquisition unit, 312…Determination unit, 313, 313A…Output unit, 321…Content data, A, A1~A3…Second virtual object, B, B1~B2…First virtual object, PR1~PR3A…Control program

Claims

1. The acquisition unit acquires multiple location information outputs from multiple positioning devices, each of which determines the position of a display device, and also acquires virtual objects from a server. A plurality of determination units, each corresponding one-to-one with the plurality of positioning devices, determine whether or not each of the plurality of location information has been acquired by the acquisition unit, The system includes a display control unit that causes the virtual object acquired by the acquisition unit from the server to be displayed on the display device based on the determination results of the plurality of determination units, The display control unit switches at least one of the following based on the determination results of the plurality of determination units: the type of virtual object, the level of detail of the information shown by the virtual object, and the accuracy of the display position of the virtual object superimposed on the real space relative to the real space. The type of the virtual object is related to whether it is a two-dimensional image icon or text box, or a three-dimensional image. If the determination result indicates that VPS information as first position information has been acquired, the display control unit displays a 3D image with a relatively large amount of information as the virtual object. When the determination result indicates that GPS information as second location information has been acquired, the display control unit displays a two-dimensional image icon or text box with relatively less information as the virtual object, in this display control device.

2. The display control device according to claim 1, wherein at least one of the measurement accuracy and positioning method of the plurality of positioning devices is different from one another.

3. The acquisition unit acquires multiple location information outputs from multiple positioning devices, each of which determines the position of a display device, and also acquires virtual objects from a server. A plurality of determination units, each corresponding one-to-one with the plurality of positioning devices, determine whether or not each of the plurality of location information has been acquired by the acquisition unit, The system includes a display control unit that causes the virtual object acquired by the acquisition unit from the server to be displayed on the display device based on the determination results of the plurality of determination units, The aforementioned plurality of positioning devices include a first positioning device and a second positioning device, The plurality of location information includes first location information output from the first positioning device and second location information output from the second positioning device. The first positioning device and the second positioning device differ from each other in at least one of their measurement accuracy and positioning method. The plurality of determination units include a first determination unit that determines whether or not the first position information has been acquired. The virtual object includes a first virtual object corresponding to the first location information and a second virtual object corresponding to the second location information. The display control unit is a display control device that, when the second virtual object is displayed on the display device, causes the first virtual object to be displayed on the display device in place of the second virtual object when the determination result of the first determination unit transitions from negative to positive.

Images