Display Control Device

Abstract

In the present invention, an acquisition unit acquires a captured image of a region including the field of view range of a user in a real space. On the basis of the captured image, the detection unit detects the quantity of at least one real object located in the field of view range. A determination unit determines the quantity of at least one virtual object, from among the virtual objects of which there is at least one and which are associated with the field of view range, displayed so as to overlap in the field of view range, said determination being made on the basis of the quantity of the at least one real object.

Description

[Technical Field]

[0001] The present invention relates to a display control device. [Background technology]

[0002] Conventionally, XR (Extended Reality) technology, represented by AR (Augmented Reality), VR (Virtual Reality), and MR (Mixed Reality), has become widespread. For example, Patent Document 1 below relates to a technology for allowing a user to comfortably experience AR technology. Virtual objects are displayed while the user is standing still, and the display of the virtual objects is stopped while the user is walking. In this case, if all the virtual objects disappear at once, the user will feel uncomfortable, so multiple virtual objects are moved out of the field of view in sequence. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2019-101743 Summary of the Invention [Problem to be solved by the invention]

[0004] While displaying virtual objects using XR technology is useful for users, there are cases where it is desirable to limit the number of virtual objects displayed depending on the user's surroundings. Specifically, for example, if a large number of virtual objects are displayed in a situation where the user's surroundings are crowded and the user needs to pay attention to walking, the user may find the virtual objects bothersome. The above-mentioned conventional technology switches whether or not to display virtual objects when triggered by a change in the user's behavior, but does not change the display of virtual objects to match the user's surroundings.

[0005] An object of the present invention is to display an appropriate amount of virtual objects in accordance with the user's surroundings. [Means for solving the problem]

[0006] A display control device according to one embodiment of the present invention includes an acquisition unit that acquires an image of an area in real space that includes a user's field of view; a detection unit that detects an amount of at least one real object located in the field of view based on the image; and a determination unit that determines an amount of at least one virtual object to be superimposed on the field of view, from among at least one virtual object associated with the field of view, based on the amount of the at least one real object. [Effects of the Invention]

[0007] According to one aspect of the present invention, an appropriate amount of virtual objects is displayed in accordance with the user's surroundings. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a block diagram showing a configuration of a system 1 according to an embodiment. [Figure 2] FIG. 2 is a block diagram showing the configuration of a terminal device 10. [Figure 3] FIG. 2 is a block diagram showing the configuration of a server 20. [Figure 4A] FIG. 2 is a schematic diagram showing an example of a captured image P. [Figure 4B] 2 is a schematic diagram showing an example of a visual field U of a user visually recognized through a terminal device 10. FIG. [Figure 5A] FIG. 2 is a schematic diagram showing an example of a captured image P. [Figure 5B] 2 is a schematic diagram showing an example of a visual field U of a user visually recognized through a terminal device 10. FIG. [Figure 6A] FIG. 2 is a schematic diagram showing an example of a captured image P. [Figure 6B] 2 is a schematic diagram showing an example of a visual field U of a user visually recognized through a terminal device 10. FIG. [Figure 7A] FIG. 2 is a schematic diagram showing an example of a captured image P. [Figure 7B] 2 is a schematic diagram showing an example of a visual field U of a user visually recognized through a terminal device 10. FIG. [Figure 8A] FIG. 2 is a schematic diagram showing an example of a captured image P. [Figure 8B] 2 is a schematic diagram showing an example of a visual field U of a user visually recognized through a terminal device 10. FIG. [Figure 9] 10 is a flowchart showing the operation of the processing device 108. DETAILED DESCRIPTION OF THE INVENTION

[0009] A. Embodiment A-1. System Configuration FIG. 1 is a block diagram showing the configuration of a system 1 according to an embodiment. The system 1 includes a terminal device 10 and a server 20. The terminal device 10 is an example of a display control device. The terminal device 10 and the server 20 are connected via a communication network N. Although FIG. 1 shows only one terminal device 10, the system 1 can include any number of terminal devices 10.

[0010] In this embodiment, the system 1 is a system that uses AR technology to present various types of information to a user holding a terminal device 10. AR technology is a technology that displays a virtual object V (see FIG. 4B, etc.) superimposed on real space, allowing the user to visually recognize the virtual object V as if it exists in real space. That is, the terminal device 10 displays the virtual object V associated with real space to the user. The virtual object V is, for example, a still image, a video, a 3DCG model, text, etc. Note that the terminal device 10 may output other types of information, such as audio information, when displaying the virtual object V.

[0011] The terminal device 10 is, for example, a see-through head-mounted display or a mobile information processing terminal such as a smartphone or tablet. In this embodiment, the terminal device 10 is assumed to be a see-through head-mounted display. The server 20 stores a plurality of virtual object data D (see FIG. 3 ) for displaying a virtual object V on the terminal device 10. Each piece of virtual object data D corresponds one-to-one to a different virtual object V. The terminal device 10 receives the virtual object data D from the server 20 and displays the virtual object V corresponding to the virtual object data D.

[0012] A-2. Terminal device 10 2 is a block diagram showing the configuration of the terminal device 10. The shape of the terminal device 10 is similar to that of ordinary eyeglasses, for example. The terminal device 10 has a left lens placed in front of the user's left eye, a right lens placed in front of the user's right eye, and a frame that supports the left and right lenses. The frame has a bridge provided between the left and right lenses and a pair of temples that rest on the left and right ears.

[0013] The terminal device 10 includes a projection device 101, an imaging device 102, a communication device 103, a GPS device 104, a storage device 107, a processing device 108, and a bus 109. Each component shown in FIG. 2 is stored in a frame, for example. The projection device 101, the imaging device 102, the communication device 103, the GPS device 104, the storage device 107, and the processing device 108 are interconnected by a bus 109 for communicating information. The bus 109 may be configured using a single bus, or may be configured using different buses between each element of the device, etc.

[0014] The projection device 101 includes left and right lenses, a display panel, and optical members. The display panel and optical members are housed in, for example, a frame. A pair of display panels and optical members may be provided, one on each side, corresponding to the left and right lenses. The projection device 101 displays a projected image of the virtual object V on the display panel based on control from the processing device 108. The display panel is, for example, a liquid crystal panel or an organic EL (Electro Luminescence) panel. The optical members guide light emitted from the display panel to the left and right lenses.

[0015] Each of the left and right lenses has a half mirror. The half mirrors in the left and right lenses transmit light representing real space, thereby guiding the light representing real space to the user's eyes. The half mirrors in the left and right lenses also reflect light representing virtual object V, which is guided by the optical member, toward the user's eyes. When the light of real space that has passed through the half mirror and the light representing virtual object V that has been reflected by the half mirror are incident on the user's eyes, the user perceives virtual object V as being located in real space. In other words, the left and right lenses function as a transmissive display.

[0016] The imaging device 102 captures an image of a subject and outputs captured image information indicating the captured image (hereinafter referred to as a "captured image P"). The imaging device 102 has, for example, an imaging optical system and an imaging element. The imaging optical system is an optical system including at least one imaging lens. The imaging lens is arranged, for example, toward the bridge described above, with the user's field of view U facing that direction. Therefore, the imaging device 102 captures an area in real space that includes the user's field of view U. The captured image P of the imaging device 102 is an image captured of an area in real space that includes the user's field of view U. In this embodiment, the imaging range of the imaging device 102, i.e., the range captured in the captured image P of the imaging device 102, is assumed to match the user's field of view U. The imaging optical system may include various optical elements such as a prism, or may include a zoom lens, a focus lens, or the like. The imaging element is, for example, a charge coupled device (CCD) image sensor or a complementary metal oxide semiconductor (CMOS) image sensor.

[0017] The correspondence between each pixel of the captured image P captured by the imaging device 102 and each pixel of the transmissive displays realized by the left and right lenses is calibrated in advance. That is, the position of an object captured in the captured image P on the left and right lenses is known from the perspective of the user wearing the terminal device 10. Therefore, the display control unit 115, which will be described later, can project a virtual object V, the display position of which is determined based on the captured image P, onto the left and right lenses.

[0018] The communication device 103 communicates with the server 20 using wireless communication or wired communication. In this embodiment, the communication device 103 has an interface connectable to a communication network N, and communicates with a communication device 203 (see FIG. 3) of the server 20 via the communication network N.

[0019] The GPS device 104 receives radio waves from multiple satellites and generates terminal location information indicating the location of the terminal device 10 from the received radio waves. The terminal location information may be in any format as long as it can identify the location in real space. In this embodiment, latitude and longitude are used as the terminal location information. Note that the terminal location information may be obtained using means other than the GPS device 104. For example, a beacon or the like installed in the facility may transmit information identifying the name of the facility where the terminal device 10 is located and its location within the facility. The terminal location information is transmitted to the server 20 by the communication device 103 via the communication network N.

[0020] In addition, instead of or in addition to the GPS device 104, sensors such as a geomagnetic sensor, an acceleration sensor, an angular acceleration sensor, or an inertial measurement unit (IMU) may detect the position and attitude of the terminal device 10.

[0021] The storage device 107 is a recording medium readable by the processing device 108. The storage device 107 includes, for example, a nonvolatile memory and a volatile memory. The nonvolatile memory is, for example, a ROM (Read Only Memory), an EPROM (Erasable Programmable Read Only Memory), and an EEPROM (Electrically Erasable Programmable Read Only Memory). The volatile memory is, for example, a RAM (Random Access Memory). The storage device 107 stores a program PG1. The program PG1 is a program for operating the terminal device 10.

[0022] The processing device 108 includes one or more central processing units (CPUs). The one or more CPUs are examples of one or more processors. Each of the processor and the CPU is an example of a computer.

[0023] The processing device 108 reads the program PG1 from the storage device 107. By executing the program PG1, the processing device 108 functions as a first acquisition unit 111, a second acquisition unit 112, a detection unit 113, a determination unit 114, and a display control unit 115. At least one of the first acquisition unit 111, the second acquisition unit 112, the detection unit 113, the determination unit 114, and the display control unit 115 may be configured by a circuit such as a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), or an FPGA (Field Programmable Gate Array). Details of the first acquisition unit 111, the second acquisition unit 112, the detection unit 113, the determination unit 114, and the display control unit 115 will be described later.

[0024] Note that, when the terminal device 10 is a mobile information processing terminal such as a smartphone or a tablet, the terminal device 10 includes a display instead of the projection device 101. The terminal device 10 displays a captured image P captured by the imaging device 102 on the display. The terminal device 10 displays a virtual object V corresponding to virtual object data D acquired from the server 20, superimposed on the captured image P displayed on the display.

[0025] A-3. Server 20 3 is a block diagram showing the configuration of server 20. Server 20 includes a communication device 203, a storage device 205, a processing device 206, and a bus 207. Communication device 203, storage device 205, and processing device 206 are interconnected by bus 207 for communicating information. Bus 207 may be configured using a single bus, or may be configured using different buses between each device.

[0026] The communication device 203 communicates with the terminal device 10 using wireless communication or wired communication. In this embodiment, the communication device 203 has an interface connectable to a communication network N, and communicates with the terminal device 10 via the communication network N.

[0027] The storage device 205 is a recording medium readable by the processing device 206. The storage device 205 includes, for example, a nonvolatile memory and a volatile memory. The nonvolatile memory is, for example, a ROM, an EPROM, and an EEPROM. The volatile memory is, for example, a RAM. The storage device 205 stores a program PG2 and multiple pieces of virtual object data D.

[0028] The program PG2 is a program for operating the server 20. The virtual object data D is data for outputting a virtual object V on the terminal device 10. Each of the multiple virtual object data D corresponds to a different virtual object V. Each virtual object data D is associated with object position information indicating the position in real space where the virtual object V based on the virtual object data D is displayed. Note that when the same virtual object V is displayed in multiple locations in real space, for example, multiple pieces of object position information are associated with one virtual object data D.

[0029] Processing unit 206 includes one or more CPUs. The one or more CPUs are examples of one or more processors. Each of a processor and a CPU is an example of a computer.

[0030] The processing device 206 reads the program PG2 from the storage device 205. The processing device 206 executes the program PG2 to function as an operation control unit 210. The operation control unit 210 may be configured by circuits such as a DSP, an ASIC, a PLD, and an FPGA.

[0031] The operation control unit 210 controls the operation of the server 20. For example, the operation control unit 210 acquires terminal location information indicating the location of the terminal device 10 from the terminal device 10. Specifically, the operation control unit 210 receives the terminal location information via the communication network N using, for example, the communication device 203. The operation control unit 210 selects virtual object data D to be transmitted to the terminal device 10 based on the terminal location information. Specifically, the operation control unit 210 selects, from among multiple pieces of virtual object data D, virtual object data D whose position indicated by the object location information and whose position indicated by the terminal location information is within a predetermined distance, as the virtual object data D to be transmitted to the terminal device 10. Furthermore, the operation control unit 210 transmits the selected virtual object data D to the terminal device 10. Specifically, the operation control unit 210 transmits the virtual object data D to the terminal device 10 via the communication network N using, for example, the communication device 203.

[0032] A-4. Details of the processing device 108 Next, the first acquisition unit 111, second acquisition unit 112, detection unit 113, determination unit 114, and display control unit 115, which are realized by the processing device 108 executing the program PG1, will be described in detail.

[0033] The first acquisition unit 111 acquires virtual object data D from the server 20. The first acquisition unit 111 controls the communication device 103 to transmit terminal location information generated by, for example, the GPS device 104 to the server 20. The server 20 that has received the terminal location information selects the virtual object data D based on the terminal location information, as described above, and transmits the selected virtual object data D to the terminal device 10. The first acquisition unit 111 acquires the virtual object data D received by the communication device 103.

[0034] The second acquisition unit 112 acquires a captured image P of an area in real space that includes the user's field of view U. The second acquisition unit 112 is an example of an acquisition unit. In this embodiment, the second acquisition unit 112 acquires a captured image P captured by the imaging device 102.

[0035] The detection unit 113 detects the amount of at least one real object R located in the field of view U based on the captured image P. The detection unit 113 extracts the real object R appearing in the captured image P using, for example, image analysis technology, and detects the amount of the real object R. In this embodiment, the range appearing in the captured image P matches the user's field of view U, so the amount of the real object R appearing in the captured image P is the amount of the real object R located in the field of view U. The amount of at least one real object R detected by the detection unit 113 is the number of at least one real object R, or the proportion of the field of view U that the at least one real object R occupies. The proportion of the field of view U that the real object R occupies may also be rephrased as the area of ​​the field of view U (captured image P) that the real object R occupies.

[0036] The detection unit 113 may use image recognition technology, which is one of image analysis technologies, to determine the type of each real object R appearing in the captured image P. The type of real object R may be, for example, a building, a tree, a person, a vehicle, etc. In particular, real objects R whose positions do not change, such as buildings and trees, may be classified as fixed objects, and real objects R whose positions do change, such as people and vehicles, may be classified as moving objects. That is, the detection unit 113 may detect at least one fixed object among the real objects R whose position does not change in real space. Alternatively, the detection unit 113 may detect at least one moving object whose position changes in real space.

[0037] 4A, 5A, 6A, 7A, and 8A are schematic diagrams showing an example of a captured image P. FIG. 4A shows a captured image P1, which is an example of the captured image P. The captured image P1 shows three-story buildings R1 to R7 and people R8 to R11 as real objects R. Therefore, the detection unit 113 detects that there are 11 real objects R in the user's field of view U. Also, in FIG. 4A, the proportion of the captured image P1 occupied by the real objects R is approximately two-thirds. Therefore, the detection unit 113 detects that the proportion of the user's field of view U occupied by the real objects R is approximately two-thirds.

[0038] It should be noted that the unit of counting a real object R as one object is arbitrary. Specifically, for example, a bag carried by person R9 may be counted as one object, or windows and doors provided in buildings R1 to R7 may be counted as one object. The unit of counting a real object R as one object may be determined, for example, by an administrator who manages virtual objects V. Furthermore, the type of object to be counted as a real object R may also be determined, for example, by an administrator who manages virtual objects V. For example, a road shown in captured image P1 may be counted as one real object R.

[0039] 5A shows a captured image P2, which is an example of the captured image P. The captured image P2 shows buildings R1 to R7 and people R8 to R19 as real objects R. Therefore, the detection unit 113 detects that there are 19 real objects R in the user's field of view U. That is, when the captured image P2 is compared with the captured image P1, the captured image P2 has eight more real objects R. Furthermore, because the number of real objects R is eight more, the proportion of the real objects R that occupies the captured image P2 in FIG. 5A is greater than the proportion of the real objects R that occupies the captured image P1 in FIG. 4A.

[0040] FIG. 6A shows a captured image P3, which is an example of the captured image P. Similar to the captured image P1 shown in FIG. 4A, the captured image P3 includes buildings R1 to R7 and people R8 to R11. However, in the captured image P3, the buildings R1 to R6 are high-rise and occupy a larger area on the image than the captured image P1 shown in FIG. 4A. That is, in the captured image P3 shown in FIG. 6A, the real object R occupies a larger proportion of the user's visual field U than in the captured image P1 shown in FIG. 4A. Specifically, the proportion of the real object R in the captured image P3 is approximately three-quarters. The detection unit 113 detects that the proportion of the user's visual field U that the real object R occupies is approximately three-quarters.

[0041] 7A shows a captured image P4, which is an example of the captured image P. The captured image P4 shows buildings R1 to R3, R5, and R6 and people R9 to R11 as real objects R. Therefore, the detection unit 113 detects that there are eight real objects R in the user's field of view U. That is, when the captured image P4 is compared with the captured image P1, the captured image P4 has four fewer real objects R. Furthermore, because the number of real objects R is four fewer, the proportion of the real objects R that occupies the captured image P4 in FIG. 7A is smaller than the proportion of the real objects R that occupies the captured image P1 in FIG. 4A.

[0042] FIG. 8A shows a captured image P5, which is an example of the captured image P. Similar to the captured image P1 shown in FIG. 4A, the captured image P5 includes buildings R1 to R7 and people R8 to R11. However, in the captured image P5, the buildings R1 to R6 are two-story buildings, and their area in the image is smaller than that of the captured image P1 shown in FIG. 4A. That is, in the captured image P5 shown in FIG. 8A, the proportion of the real object R in the user's visual field U is smaller than that of the captured image P1 shown in FIG. 4A. Specifically, the proportion of the real object R in the captured image P4 is about half. The detection unit 113 detects that the proportion of the real object R in the user's visual field U is about half.

[0043] The determination unit 114 determines the amount of at least one virtual object V to be superimposed on the field of view U, out of the at least one virtual object V associated with the field of view U, based on the amount of at least one real object R in the user's field of view U. A virtual object V associated with the field of view U is a virtual object V whose position indicated by the object position information is included in the field of view U. The amount of at least one virtual object V determined by the determination unit 114 is the number of at least one virtual object V to be superimposed on the field of view U, or the proportion of the field of view U that is occupied by the at least one virtual object V to be superimposed on the field of view U. The proportion of the field of view U that the virtual object V occupies may also be rephrased as the area that the virtual object V occupies in the field of view U.

[0044] In the conventional technology, of the virtual objects V corresponding to the virtual object data D acquired by the first acquisition unit 111, all of the virtual objects V associated with the user's field of view U are displayed. Meanwhile, the determination unit 114 determines the number of virtual objects V to actually display based on the number of real objects R within the user's field of view U. Specifically, the determination unit 114 reduces the number of virtual objects V to display to the user as the number of real objects R within the user's field of view U increases, and increases the number of virtual objects V to display to the user as the number of real objects R located within the field of view U decreases.

[0045] Below, with reference to FIG. 4B, we will explain [1] the case where the amount of real objects R is relatively large and [2] the case where the amount of real objects R is relatively small. FIGS. 4B, 5B, 6B, 7B, and 8B are schematic diagrams showing examples of a user's visual field U visually recognized via terminal device 10. In FIGS. 4B, 5B, 6B, 7B, and 8B, the reference numerals for real objects R are omitted to ensure visibility. In addition, in FIGS. 4B, 5B, 6B, 7B, and 8B, virtual objects V are indicated by shading.

[0046] In the field of view U1 shown in FIG. 4B, virtual objects V1 to V5 are displayed together with a real space corresponding to the captured image P1 shown in FIG. 4A. Virtual object V1 is an image including text providing directions to a cafe inside building R1. Virtual object V2 is an image of a character. Virtual object V3 is an image of a new bicycle. Virtual object V4 is an image including text providing an explanation of the bicycle of virtual object V3. Virtual object V5 is an image of a bird.

[0047] [1] When the amount of real objects R is relatively large [1-1] When there are many real objects R FIG. 5B is a diagram showing a user's field of view U2 corresponding to the captured image P2 in FIG. 5A. As described above, FIG. 5A has a larger number of real objects R than FIG. 4A. Therefore, the determination unit 114 determines to display fewer virtual objects V in the real space corresponding to FIG. 5A than in FIG. 4A. For example, the determination unit 114 determines to display virtual objects V1, V4, and V5 as shown in FIG. 5B. Compared to FIG. 4B, the number of virtual objects V displayed in the field of view U2 shown in FIG. 5B is two fewer.

[0048] The relationship between the number of real objects R in the user's field of view U and the number of displayed virtual objects V may be fixed. For example, if the number of real objects R in the user's field of view U is Nr and the number of displayed virtual objects V is Nv, Nv may be defined as a function of Nr.

[0049] Furthermore, the relationship between the number of real objects R in the user's field of view U and the number of virtual objects V to be displayed may be adjusted taking into consideration at least one of, for example, weather conditions (presence or absence of precipitation, sky brightness, backlit or not, etc.), time (ambient brightness), and whether the user is moving. For example, when there is precipitation, the number of virtual objects V to be displayed may be reduced compared to when there is no precipitation. Similarly, when the sky brightness is low, there is backlight, the ambient brightness is low, or the user is moving, the number of virtual objects V to be displayed may be reduced compared to other cases. That is, the detection unit 113 further detects at least one of the weather conditions in the field of view U, the current time, and whether the user is moving. The determination unit 114 determines the number of at least one virtual object V to be displayed to the user based on at least one of the weather conditions, the current time, and whether the user is moving.

[0050] In this way, when the number of real objects R in the user's field of view U is large, the determination unit 114 reduces the number of virtual objects V displayed to the user. This ensures the visibility of the real objects R. Furthermore, if there are too many objects that the user needs to pay attention to, the user's attention may be distracted. Changing the number of virtual objects V to be displayed based on the number of real objects R improves the usefulness of displaying the virtual objects V.

[0051] [1-2] When the proportion of the real object R in the user's field of view U is relatively large Fig. 6B is a diagram showing a user's field of view range U3 corresponding to the captured image P3 in Fig. 6A. As described above, in the captured image P3 shown in Fig. 6A, the proportion of the real object R occupying the user's field of view range U is larger than in the captured image P1 shown in Fig. 4A. Therefore, the determination unit 114 displays the virtual object V in the real space corresponding to Fig. 6A with an area smaller than that in Fig. 4A, thereby reducing the proportion of the virtual object V occupying the user's field of view range U.

[0052] Specifically, the determination unit 114 determines to display virtual objects V1 to V5, for example, as shown in FIG. 6B. Among these, virtual objects V1 and V4 have a smaller amount of text and a smaller display area compared to FIG. 4B. Such a display can be realized, for example, by including multiple text sentences according to the display area in the virtual object data D corresponding to virtual object V1 and the virtual object data D corresponding to virtual object V4. The determination unit 114 can change the display area of ​​virtual objects V1 and V4 by determining which of the multiple text sentences to display.

[0053] 6B, the display of the character of virtual object V2 is also smaller than that of FIG. 4B. In this way, the determination unit 114 may change the proportion of the virtual object V that occupies the user's field of view U by changing the display size of the virtual object V. Furthermore, the determination unit 114 may reduce the proportion of the field of view U3 that the virtual object V occupies by reducing the number of virtual objects V, as in [1-1], for example. Furthermore, with regard to virtual objects V1 and V4, the determination unit 114 may reduce the proportion of the field of view U3 that the virtual object V occupies by reducing the font size of the text, rather than reducing the amount of text.

[0054] As in [1-1], the relationship between the proportion of the field of view U that the real object R occupies and the proportion of the user's field of view U that the virtual object V occupies may be fixed, or may be adjusted taking into account at least one of weather conditions, time of day, or whether the user is moving.

[0055] In this way, when the proportion of the user's field of view U occupied by the real object R is large, the determination unit 114 reduces the proportion of the user's field of view U occupied by the virtual object V. This ensures the visibility of the real object R. Also, in FIG. 6B , the number of virtual objects V is not increased or decreased, but the size of the virtual objects V is changed, thereby reducing the proportion of the user's field of view U occupied by the virtual objects V. This ensures a certain degree of fairness in the display of the virtual objects V. This method is effective, for example, when the virtual object V is an advertisement.

[0056] [2] When the amount of real objects R is relatively small [2-1] When the number of real objects R is small Fig. 7B is a diagram showing a user's visual field range U4 corresponding to the captured image P4 of Fig. 7A. As described above, Fig. 7A has a smaller number of real objects R than Fig. 4A. Therefore, the determination unit 114 determines that a larger number of virtual objects V should be displayed in the real space corresponding to Fig. 7A than in Fig. 4A. For example, the determination unit 114 determines that virtual objects V1 to V8 should be displayed as shown in Fig. 7B.

[0057] Compared to FIG. 4B, there are three more virtual objects V displayed in the field of view U4 shown in FIG. 7B. Virtual objects V1 to V5 are also displayed in FIG. 4B, while virtual objects V6 to V8 are only displayed in FIG. 7B. Virtual object V6 is an image of a bird, just like virtual object V5. Virtual object V7 is an image of a large tree structure. Virtual object V8 is an image including text providing guidance about the tree structure.

[0058] In this way, when the number of real objects R in the user's field of view U is small, the determination unit 114 increases the number of virtual objects V displayed to the user. This makes it possible to display more virtual objects V, thereby widening the range of expression using the virtual objects V.

[0059] [2-2] When the proportion of the real object R in the user's field of view U is relatively small Fig. 8B is a diagram showing a user's field of view range U5 corresponding to the captured image P5 in Fig. 8A. As described above, in the captured image P5 shown in Fig. 8A, the proportion of the field of view U occupied by the real object R is smaller than in the captured image P1 shown in Fig. 4A. Therefore, the determination unit 114 displays the virtual object V in the real space corresponding to Fig. 8A with an area larger than that in Fig. 4A, thereby increasing the proportion of the field of view U occupied by the virtual object V.

[0060] Specifically, the determination unit 114 determines to display virtual objects V1 to V5, for example, as shown in Fig. 8B. Of these, virtual objects V1 and V4 have a larger amount of text and a larger display area than those shown in Fig. 4B. This type of display can be realized by including multiple text sentences corresponding to the display area in the virtual object data D corresponding to virtual object V1 and the virtual object data D corresponding to virtual object V4, as in [1-2].

[0061] 8B, the display of the character, which is virtual object V2, is also larger than in FIG. 4B. In this way, the determination unit 114 may change the proportion of the field of view U that the virtual object V occupies by changing the display size of the virtual object V. Furthermore, the determination unit 114 may increase the proportion of the field of view U that the virtual object V occupies by increasing the number of virtual objects V displayed to the user, as in [2-1], for example. Furthermore, the determination unit 114 may increase the proportion of the field of view U that the virtual object V occupies by increasing the font size of the text for virtual objects V1 and V4, rather than increasing the amount of text.

[0062] In this way, when the proportion of the real object R that occupies the user's field of view U is small, the determination unit 114 increases the proportion of the virtual object V that occupies the user's field of view U. This makes it possible to display the virtual object V larger, thereby widening the range of expression using the virtual object V.

[0063] Next, a method for selecting a virtual object V to be displayed in the user's field of view U will be described. As an example, the determination unit 114 may reduce the amount of at least one virtual object V to be displayed in an area of ​​the field of view U where the amount of at least one real object R is greater than in other areas, compared to other areas. An area with a greater amount of real objects R is an area where there are many targets that the user must view. If an additional virtual object V is displayed in such an area, the user may feel annoyed. Therefore, the determination unit 114 may exclude, from the display targets, a virtual object V whose display position overlaps with an area with a greater amount of real objects R.

[0064] 5B, for example, many real objects R of people are located in the lower part (on the road) of the user's field of view U2. In this case, the determination unit 114 determines not to display virtual objects V2 and V3 located in the lower part (on the road) of the user's field of view U2. This prevents the virtual object V from being displayed in an area where many real objects R are located, thereby improving the visibility of the real object R.

[0065] Alternatively, the determination unit 114 may reduce the number of at least one virtual object V displayed in an area of ​​the field of view U where the number of at least one moving object is greater than in other areas, compared to other areas. As described above, a moving object is a real object R whose position changes, such as a person or a vehicle. Unlike fixed objects, moving objects change position, so the user needs to pay close attention to their movement. If a virtual object V is displayed overlapping a moving object, the user may find it annoying. Therefore, the determination unit 114 may exclude a virtual object V whose display position overlaps with a moving object from the display targets.

[0066] 5B, for example, many of the people R8 to R19, which are moving objects, are located on the lower side (on the road) of the user's field of view U2. In this case, the determination unit 114 determines not to display the virtual objects V2 and V3 located on the lower side (on the road) of the user's field of view U2. This prevents the virtual object V from being displayed in an area where many moving objects are located, thereby improving the visibility of the moving objects.

[0067] Alternatively, the determination unit 114 may determine the virtual objects V to be displayed in the field of view U as follows: (A) When the same virtual object V is displayed in multiple locations in the user's field of view U, the determination unit 114 reduces the amount of the virtual object V. (B) The determination unit 114 reduces the amount of the virtual object V in order from the virtual object V that is farthest from the user or the virtual object V that is closest to the user. (C) The determination unit 114 reduces the amount of the virtual object V in order from the virtual object V that is large in display size or the virtual object V that is small in display size. (D) The determination unit 114 determines the virtual object V whose amount is to be reduced based on the user's attribute information or the area in which the user is located. (E) The determination unit 114 determines the virtual object V whose amount is to be reduced based on the type of virtual object V (for example, whether it is text or an image, or if the virtual object V is an advertisement, the product that is the advertisement target, etc.).

[0068] Furthermore, in the above description, an example has been given in which the amount of virtual objects V is determined based on the amount of real objects R. However, for example, the transparency of the virtual objects V may be changed based on the amount of real objects R. In this case, for example, when the amount of real objects R is large, the transparency of the virtual objects V is increased, making the real objects R relatively more visible. On the other hand, when the amount of real objects R is small, the transparency of the virtual objects V is decreased, making the virtual objects V relatively more visible.

[0069] 2 causes the projection device 101 to display the amount of virtual object V determined by the determination unit 114. As described above, the projection device 101 causes the left and right lenses to display the virtual object V corresponding to the virtual object data D. The user perceives the virtual object V as if it actually exists in the surrounding real space.

[0070] A-5. Operation of the processing device 108 9 is a flowchart showing the operation of the processing device 108. The processing device 108 functions as the first acquisition unit 111 and acquires virtual object data D from the server 20 (step S100). As described above, the processing device 108 transmits the terminal position information generated by the GPS device 104 to the server 20, and receives the virtual object data D selected and transmitted by the server 20 based on the terminal position information.

[0071] The processing device 108 functions as the second acquisition unit 112 and acquires a captured image P captured by the imaging device 102 (step S101). The processing device 108 functions as the detection unit 113 and detects a real object R located in the user's field of view U based on the captured image P (step S102). The processing device 108 functions as the determination unit 114 and determines the amount of virtual object V to be superimposed on the field of view U based on the amount of real object R in the user's field of view U (step S103). The processing device 108 functions as the display control unit 115 and causes the projection device 101 to display the amount of virtual object V determined by the determination unit 114 (step S104). The processing device 108 returns to step S100 and repeats the subsequent processes.

[0072] A-6. Summary of embodiments As described above, according to the embodiment, the terminal device 10 determines the amount of virtual objects V to be superimposed on the user's field of view U based on the amount of real objects R located in the user's field of view U. Therefore, the amount of virtual objects V to be superimposed on the user's field of view U can be maintained within an appropriate range in accordance with the situation around the user, thereby improving the usefulness of the display of the virtual objects V.

[0073] Furthermore, based on the number of real objects R located in the user's field of view U or the proportion of the field of view U occupied by the real objects R, the terminal device 10 determines the number of virtual objects V to be superimposed on the field of view U or the proportion of the field of view U occupied by the virtual objects V. This ensures visibility of the real objects R from the user's perspective.

[0074] Furthermore, the terminal device 10 reduces the amount of virtual objects V displayed in an area of ​​the field of view U where the amount of real objects R is greater than in other areas, compared to other areas. This avoids displaying virtual objects V in an area where there are many objects that the user should view, improving user convenience.

[0075] Furthermore, the terminal device 10 reduces the number of virtual objects V displayed in an area of ​​the visual field U where the number of moving objects is greater than in other areas, compared to other areas. This ensures visibility of moving objects whose movements the user needs to pay close attention to, improving user convenience.

[0076] Furthermore, the terminal device 10 determines the amount of virtual objects V to be superimposed and displayed in the user's field of view U based on at least one of weather conditions, the current time, and whether the user is moving. Thus, the amount of virtual objects V to be superimposed and displayed in the user's field of view U reflects the surrounding environment, thereby improving the usefulness of displaying the virtual objects V.

[0077] B: Modified example The following are variations of the above-described embodiment. Two or more variations arbitrarily selected from the following variations may be combined as appropriate within the scope of not mutually contradicting each other.

[0078] B1: First modified example In the above-described embodiment, the position information generated by the GPS device 104 is used as the terminal position information indicating the position of the terminal device 10. However, instead of or in addition to the GPS device 104, the position and attitude of the terminal device 10 may be detected by sensors such as the geomagnetic sensor, acceleration sensor, angular acceleration sensor, or inertial measurement unit.

[0079] In the above-described embodiment, the server 20 identifies the virtual object data D to be transmitted to the terminal device 10 using terminal position information. However, the present invention is not limited to this. The virtual object data D to be transmitted to the terminal device 10 may be identified using a captured image P captured by the imaging device 102 of the terminal device 10. In this case, the server 20 associates, for example, a model indicating the shape of the real object R placed in real space in advance with the position information of the real object R. The server 20 matches the shape of the real object R shown in the captured image with the shape of the model to identify the position of the terminal device 10, and identifies the virtual object data D to be transmitted to the terminal device 10. Alternatively, for example, a marker indicating the position information of the location may be placed in real space in advance, and the server 20 may obtain the position information by detecting the marker from the captured image P.

[0080] B2: Second variant In the above-described embodiment, the terminal device 10 is configured only as an eyeglass-type terminal device. However, the terminal device 10 may include an eyeglass-type terminal device and a portable terminal device such as a smartphone, a tablet device, or a laptop computer. In this case, the eyeglass-type terminal device and the portable terminal device are connected to each other. When the terminal device 10 includes a portable terminal device, some or all of the functions of the first acquisition unit 111, the second acquisition unit 112, the detection unit 113, the determination unit 114, and the display control unit 115 may be performed by the portable terminal device.

[0081] B3: Third variant In the above-described embodiment, the terminal device 10 determines the virtual object V to be superimposed and displayed in the user's field of view U. However, this is not limiting, and for example, the server 20 may determine the virtual object V to be superimposed and displayed in the user's field of view U. That is, the server 20 may function as a display control device. In this case, the processing device 206 of the server 20 realizes the functions of the second acquisition unit 112, the detection unit 113, and the determination unit 114. Furthermore, the processing device 206 of the server 20 realizes the function of a transmission control unit that transmits the amount of virtual object V determined by the determination unit 114 to the terminal device 10. According to the third modification, the processing load on the terminal device 10 can be reduced.

[0082] C:Other (1-1) The block diagrams used to explain the above embodiments show functional blocks. These functional blocks (components) are realized by any combination of at least one of hardware and software. Furthermore, the method for realizing each functional block is not particularly limited. That is, each functional block may be realized using a single device that is physically or logically coupled, or may be realized using two or more physically or logically separated devices that are directly or indirectly connected (for example, using wires, wirelessly, etc.) and these multiple devices. The functional block may also be realized by combining the single device or multiple devices with software. Functions include, but are not limited to, judgment, determination, judgment, calculation, computation, processing, derivation, investigation, search, confirmation, reception, transmission, output, access, resolution, selection, election, establishment, comparison, assumption, expectation, consideration, broadcasting, notifying, communicating, forwarding, configuring, reconfiguring, allocating, mapping, and assignment. For example, a functional block (component) that performs a transmission function is called a transmitting unit or transmitter. As mentioned above, there are no particular limitations on how these functions are implemented.

[0083] (1-2) Notification of information is not limited to the aspects / embodiments described in the present disclosure and may be performed using other methods. For example, notification of information may be performed by physical layer signaling (e.g., Downlink Control Information (DCI), Uplink Control Information (UCI)), higher layer signaling (e.g., Radio Resource Control (RRC) signaling, Medium Access Control (MAC) signaling, broadcast information (Master Information Block (MIB), System Information Block (SIB))), other signals, or a combination thereof. Furthermore, RRC signaling may be referred to as an RRC message, and may be, for example, an RRC Connection Setup message, an RRC Connection Reconfiguration message, or the like.

[0084] (1-3) Each aspect / embodiment described in the present disclosure may be implemented using a standard technology such as LTE (Long Term Evolution), LTE-Advanced (LTE-A), SUPER 3G, IMT-Advanced, 4G (4th generation mobile communication system), 5G (5th generation mobile communication system), 6th generation mobile communication system (6G), xth generation mobile communication system (xG) (xG (x is, for example, an integer or a decimal number)), FRA (Future Radio Access), NR (new Radio), New radio access (NX), Future generation radio access (FX), W-CDMA (registered trademark), GSM (registered trademark), CDMA2000, UMB (Ultra Mobile Broadband), IEEE 802.11 (Wi-Fi (registered trademark)), IEEE 802.16 (WiMAX (registered trademark)), IEEE 802.20, UWB (Ultra-Wide The present invention may be applied to at least one of systems that use the LTE Band, Bluetooth (registered trademark), or other appropriate systems, and next-generation systems that are expanded, modified, created, or defined based on these. It may also be applied to a combination of multiple systems (e.g., a combination of at least one of LTE and LTE-A with 5G).

[0085] (1-4) The order of the procedures, sequences, flowcharts, etc. of each aspect / embodiment described in this disclosure may be changed unless it is consistent. For example, the methods described in this disclosure present elements of various steps using an example order and are not limited to the particular order presented.

[0086] (1-5) In the present disclosure, a specific operation that is described as being performed by a base station may be performed by its upper node in some cases. In a network consisting of one or more network nodes having a base station, it is clear that various operations performed for communication with a terminal may be performed by at least one of the base station and another network node other than the base station (for example, an MME or an S-GW, etc., but is not limited to these). Although the above example illustrates a case where there is one other network node other than the base station, a combination of multiple other network nodes (for example, an MME and an S-GW) may also be used.

[0087] (1-6) Information, etc. (see 2-2) can be output from a higher layer (or a lower layer) to a lower layer (or a higher layer). It may be input / output via multiple network nodes.

[0088] (1-7) Input and output information may be stored in a specific location (for example, memory) or may be managed using a management table. Input and output information may be overwritten, updated, or added to. Output information may be deleted. Input information may be sent to another device.

[0089] (1-8) The determination may be made based on a value represented by one bit (0 or 1), a Boolean (true or false), or a numerical comparison (e.g., comparison with a predetermined value).

[0090] (1-9) Each aspect / embodiment described in this disclosure may be used alone, in combination, or switched depending on the implementation. Notification of predetermined information (e.g., notification that "X is true") is not limited to explicit notification, but may be implicit (e.g., not notifying the predetermined information).

[0091] Although the present disclosure has been described in detail above, it is clear to those skilled in the art that the present disclosure is not limited to the embodiments described herein. The present disclosure can be implemented in modified and altered forms without departing from the spirit and scope of the present disclosure as defined by the claims. Therefore, the description of the present disclosure is intended to be illustrative and does not have any limiting meaning on the present disclosure.

[0092] (2-1) Software shall be construed broadly to mean instructions, instruction sets, code, code segments, program code, programs, subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executable files, threads of execution, procedures, functions, etc., whether referred to as software, firmware, middleware, microcode, hardware description language, or otherwise. Software, instructions, information, etc. may also be transmitted or received over a transmission medium. For example, if software is transmitted from a website, server, or other remote source using wired technologies (such as coaxial cable, fiber optic cable, twisted pair, Digital Subscriber Line (DSL)), and / or wireless technologies (such as infrared, microwave), then these wired and / or wireless technologies are included within the definition of transmission media.

[0093] (2-2) Information, signals, etc. described in this disclosure may be represented using any of a variety of different technologies. For example, data, instructions, commands, information, signals, bits, symbols, chips, etc. that may be referred to throughout the above description may be represented by voltage, current, electromagnetic waves, magnetic fields or magnetic particles, optical fields or photons, or any combination thereof. Terms described in this disclosure and terms necessary for understanding this disclosure may be replaced with terms having the same or similar meanings. For example, at least one of a channel and a symbol may be a signal (signaling). A signal may also be a message. A component carrier (CC) may also be called a carrier frequency, a cell, a frequency carrier, etc.

[0094] (2-3) As used in this disclosure, the terms "system" and "network" are used interchangeably.

[0095] (2-4) Furthermore, the information, parameters, etc. described in the present disclosure may be expressed using absolute values, relative values ​​from a predetermined value, or other corresponding information. For example, radio resources may be indicated by an index. The names used for the above-described parameters are not limiting in any way. Furthermore, mathematical formulas, etc. using these parameters may differ from those explicitly disclosed in the present disclosure. Various channels (e.g., PUCCH, PDCCH, etc.) and information elements may be identified by any suitable names, and therefore the various names assigned to these various channels and information elements are not limiting in any way.

[0096] (2-5) In the present disclosure, terms such as “base station (BS),” “radio base station,” “fixed station,” “NodeB,” “eNodeB (eNB),” “gNodeB (gNB),” “access point,” “transmission point,” “reception point,” “transmission / reception point,” “cell,” “sector,” “cell group,” “carrier,” and “component carrier” may be used interchangeably. A base station may also be referred to by terms such as a macrocell, a small cell, a femtocell, and a picocell. A base station can accommodate one or multiple (e.g., three) cells. When a base station accommodates multiple cells, the entire coverage area of ​​the base station can be divided into multiple smaller areas, and each smaller area can be provided with communication service by a base station subsystem (e.g., an indoor small base station (RRH: Remote Radio Head)). The term “cell” or “sector” refers to a part or the entire coverage area of ​​at least one of the base station and the base station subsystem that provides communication service within this coverage. In the present disclosure, the base station transmitting information to a terminal may be interpreted as the base station instructing the terminal to control or operate based on the information.

[0097] (2-6) In this disclosure, terms such as "Mobile Station (MS)," "user terminal," "User Equipment (UE)," "terminal," etc. may be used interchangeably. A mobile station may also be referred to by those skilled in the art as a subscriber station, mobile unit, subscriber unit, wireless unit, remote unit, mobile device, wireless device, wireless communication device, remote device, mobile subscriber station, access terminal, mobile terminal, wireless terminal, remote terminal, handset, user agent, mobile client, client, or some other suitable terminology.

[0098] (2-7) At least one of the base station and the mobile station may be referred to as a transmitting device, a receiving device, a communication device, etc. At least one of the base station and the mobile station may be a device mounted on a mobile object, the mobile object itself, etc. The mobile object refers to a movable object, and may move at any speed. Naturally, this also includes cases where the mobile object is stationary. Examples of the mobile object include, but are not limited to, vehicles, transport vehicles, automobiles, motorcycles, bicycles, connected cars, excavators, bulldozers, wheel loaders, dump trucks, forklifts, trains, buses, handcars, rickshaws, ships and other watercraft, airplanes, rockets, satellites, drones (registered trademark), multicopters, quadcopters, balloons, and objects mounted thereon. The mobile object may also be a mobile object that moves autonomously based on an operational command. It may be a vehicle (e.g., a car, an airplane, etc.), an unmanned mobile object (e.g., a drone, an autonomous vehicle, etc.), or a robot (manned or unmanned). Note that at least one of the base station and the mobile station may include devices that do not necessarily move during communication operation. For example, at least one of the base station and the mobile station may be an IoT (Internet of Things) device such as a sensor. Furthermore, the base station in the present disclosure may be interpreted as a user terminal. For example, the aspects / embodiments of the present disclosure may be applied to a configuration in which communication between a base station and a user terminal is replaced with communication between multiple user terminals (which may be referred to as, for example, Device-to-Device (D2D) or Vehicle-to-Everything (V2X)). In this case, the user terminal may be configured to have the functions possessed by the above-mentioned base station. Furthermore, terms such as "uplink" and "downlink" may be interpreted as terms corresponding to communication between terminals (for example, "side"). For example, terms such as an uplink channel and a downlink channel may be interpreted as a side channel. Similarly, the user terminal in the present disclosure may be interpreted as a base station. In this case, the base station may be configured to have the functions possessed by the above-mentioned user terminal.

[0099] (3-1) As used in this disclosure, the terms "determining" and "determining" may encompass a wide variety of actions. "Determining" and "determining" may include, for example, judging, calculating, computing, processing, deriving, investigating, looking up, searching, inquiring (e.g., searching a table, database, or other data structure), ascertaining, and the like. Also, "determining" and "determining" may include receiving (e.g., receiving information), transmitting (e.g., sending information), input, output, accessing (e.g., accessing data in memory), and the like. Furthermore, "judgment" and "decision" can include regarding resolving, selecting, choosing, establishing, comparing, etc. as having been "judged" or "decided." In other words, "judgment" and "decision" can include regarding some action as having been "judged" or "decided." Furthermore, "judgment (decision)" can be interpreted as "assuming," "expecting," "considering," etc.

[0100] (3-2) The terms "connected," "coupled," or any variation thereof, refer to any direct or indirect connection or coupling between two or more elements, and may include the presence of one or more intermediate elements between two elements that are "connected" or "coupled" to each other. The coupling or connection between elements may be physical, logical, or a combination thereof. For example, "connected" may be read as "access." As used in this disclosure, two elements may be considered to be "connected" or "coupled" to each other using at least one of one or more wires, cables, and printed electrical connections, as well as electromagnetic energy having wavelengths in the radio frequency range, microwave range, and optical (both visible and invisible) range, as some non-limiting and non-exhaustive examples.

[0101] (3-3) The reference signal may be abbreviated as RS (Reference Signal) or may be called a pilot depending on the applicable standard.

[0102] (3-4) As used in this disclosure, the phrase "based on" does not mean "based only on," unless otherwise specified. In other words, the phrase "based on" means both "based only on" and "based at least on."

[0103] (3-5) Any reference to an element using a designation such as "first," "second," etc., used in this disclosure does not generally limit the quantity or order of those elements. These designations may be used in this disclosure as a convenient way to distinguish between two or more elements. Thus, a reference to a first and a second element does not imply that only two elements may be employed or that the first element must in some way precede the second element.

[0104] (3-6) The "means" in the configuration of each of the above devices may be replaced with "part," "circuit," "device," etc.

[0105] (3-7) When "include," "including," and variations thereof are used in this disclosure, these terms are intended to be inclusive, similar to the term "comprising." Furthermore, when used in this disclosure, the term "or" is not intended to be an exclusive or.

[0106] (3-8) In this disclosure, when articles are added by translation, such as a, an, and the in English, the disclosure may include that the nouns following these articles are plural.

[0107] (3-9) In the present disclosure, the term "A and B are different" may mean "A and B are different from each other." The term may also mean "A and B are each different from C." Terms such as "separate" and "combined" may also be interpreted in the same way as "different."

[0108] (4) It is clear to those skilled in the art that the present invention is not limited to the embodiments described in this specification. The present invention can be implemented in modified and altered forms without departing from the spirit and scope of the present invention as defined by the claims. Therefore, the description in this specification is intended as an illustrative explanation and does not have any limiting meaning on the present invention. Furthermore, multiple embodiments selected from the embodiments exemplified in this specification may be combined.

[0109] (5) In this specification, "at least one of A and B" or "at least one of A or B" means "(A), (B), or (A and B)." That is, "at least one of A and B" is rephrase as "one or more of A and B" or "at least one selected from the group of A and B." "at least one of A, B and C" or "at least one of A, B or C" means "(A), (B), (C), (A and B), (A and C), (B and C), or (A, B and C)." That is, "at least one of A, B, and C" can be rephrased as "one or more of A, B, and C" or "at least one selected from the group of A, B, and C." [Explanation of symbols]

[0110] 1...system, 10...terminal device, 20...server, 101...projection device, 102...imaging device, 103...communication device, 104...GPS device, 107...storage device, 108...processing device, 111...first acquisition unit, 112...second acquisition unit, 113...detection unit, 114...determination unit, 115...display control unit, D...virtual object data, N...communication network, P (P1 to P5)...captured image, R (R1 to R19)...real object, U (U1 to U5)...field of view range, V (V1 to V8)...virtual object.

Claims

1. an acquisition unit that acquires a captured image of an area in real space that includes a user's field of view; a detection unit that detects an amount of at least one real object located in the field of view range based on the captured image; a determination unit that determines an amount of at least one virtual object to be superimposed on the field of view, from among the at least one virtual object associated with the field of view, based on the amount of the at least one real object; the detection unit detects, among the real objects, at least one moving object whose position in the real space changes and at least one fixed object whose position in the real space does not change; the field of view includes a first area in which the at least one moving object is located and a second area in which the at least one fixed object is located; each of the virtual objects is associated with object position information indicating a position in the real space where the virtual object is to be displayed; the determination unit reduces the amount of at least one virtual object superimposed and displayed in the first area compared to the amount in the second area by not displaying a virtual object whose position indicated by the object position information is included in the first area. Display control device.

2. the amount of the at least one real object detected by the detection unit is the number of the at least one real object or a proportion of the field of view occupied by the at least one real object; the amount of the at least one virtual object determined by the determination unit is the number of the at least one virtual object to be superimposed and displayed in the field of view, or the proportion of the field of view occupied by the at least one virtual object to be superimposed and displayed in the field of view; The display control device according to claim 1.

3. the determination unit reduces the amount of the at least one virtual object to be superimposed and displayed in a region of the second region where the amount of the at least one real object is greater than in other regions, compared to the other regions. The display control device according to claim 1.

4. the detection unit further detects at least one of weather conditions in the field of view, a current time, and whether the user is moving; the determination unit determines an amount of the at least one virtual object to be superimposed and displayed in the field of view based on at least one of the weather conditions, the current time, and whether the user is moving. The display control device according to claim 1.

Images