Display control device

Abstract

A mobile device that is an aspect of a display control device according to the present disclosure communicates with a transmission-type display device mounted on the head of a user, thereby controlling the display of a virtual object on the transmission-type display device. The mobile device is provided with a calculation unit and a display control unit. The calculation unit calculates, on the basis of the walking speed of the user, the degree of concentration of the user on the virtual object displayed on the transmission-type display device. The display control unit controls display of the virtual object on the transmission-type display device on the basis of the degree of concentration of the user calculated by the calculation unit.

Description

Technical Field

[0001] The present invention relates to a display control device that controls the display of virtual objects.

Background Art

[0002] A transmissive display device that superimposes and displays a virtual object representing additional information such as a description text about an object (hereinafter, a real object) existing in a real-world view in the real space is generally known. Among the transmissive display devices, there are HMD devices (Head Mounted Display), AR (Augmented Reality) glasses, MR (Mixed Reality) glasses, etc., and virtual objects are displayed superimposed on the real space without blocking the user's field of view. As a usage method of the transmissive display device, it is possible to walk while looking at the virtual object displayed on the transmissive display device. However, in such a usage method, since the user's attention (line of sight) is too focused on the virtual object, it is not preferable from the viewpoint of ensuring safety. Therefore, a technique for restricting the information displayed on the transmissive display device based on the movement level of the user wearing the transmissive display device has been proposed (for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the technology disclosed in Patent Document 1, the information displayed is restricted according to the level of user movement (specifically, movement speed) of the transparent display device, regardless of whether the user's attention is focused on the information displayed on the transparent display device. Therefore, the technology disclosed in Patent Document 1 has the problem that unnecessary restrictions may be placed on the display of information on the transparent display device. [Means for solving the problem]

[0005] A virtual object display control device according to a preferred embodiment of the present disclosure comprises a calculation unit and a display control unit. The calculation unit calculates the degree of the user's concentration on a virtual object displayed on a transparent display device worn on the user's head, based on the user's walking speed. The display control unit controls the display of the virtual object on the transparent display device based on the degree of concentration. [Effects of the Invention]

[0006] According to this disclosure, the display of virtual objects is controlled based on the user's level of attention to the virtual objects displayed on the display device, thereby preventing users from becoming overly focused on the display of virtual objects while avoiding unnecessary display restrictions. [Brief explanation of the drawing]

[0007] [Figure 1] This is a block diagram showing an example configuration of a display system 1 including a portable device 10 according to one embodiment of the display control device of the present disclosure. [Figure 2] This figure shows an example of a real-space image corresponding to user U's field of view. [Figure 3] This figure shows an example of an image in which a virtual object is superimposed on real space. [Figure 4] This is a block diagram showing an example configuration of a mobile device 10. [Figure 5] This flowchart shows the flow of the display control method executed by the processing unit 18 of the mobile device 10 according to program PR1. [Figure 6]This block diagram shows an example configuration of the eyeglass-type display device 20. [Modes for carrying out the invention]

[0008] (A. Embodiment) Figure 1 is a block diagram showing an example configuration of a display system 1 including a portable device 10 according to one embodiment of the display control device of the present disclosure. As shown in Figure 1, the display system 1 includes a glasses-type display device 20 in addition to the portable device 10.

[0009] The glasses-type display device 20 is an example of a transparent display device worn on the head of user U. The glasses-type display device 20 displays virtual objects that do not exist in real space without obstructing the field of view of user U wearing the glasses-type display device 20. The glasses-type display device 20 is equipped with an imaging device (camera). The glasses-type display device 20 worn by user U captures images of user U's field of view (the field of view of the glasses-type display device 20) using the imaging device.

[0010] The portable device 10 is, for example, a smartphone. The portable device 10 is not limited to a smartphone; for example, it may be a tablet or a notebook personal computer. The portable device 10 is worn on the user U's body together with the glasses-type display device 20. The portable device 10 is worn on the user U's body by hanging it around the neck using a strap or the like. The portable device 10 is connected to the glasses-type display device 20 by a wire. The portable device 10 may also be connected to the glasses-type display device 20 wirelessly. The portable device 10 acquires image data representing the image captured by the glasses-type display device 20 from the glasses-type display device 20.

[0011] Furthermore, the mobile device 10 communicates with the management device 30 via a communication line NW. The mobile device 10 transmits image data acquired from the glasses-type display device 20 to the management device 30. The management device 30 is a server device that provides self-position recognition services and content management services in AR.

[0012] The self-localization service refers to a service that determines the position of the glasses-type display device 20 in a global coordinate system based on images captured by the imaging device of the glasses-type display device 20. Specific implementation methods for the self-localization service include using AR tags or utilizing the distribution of feature points extracted from images, such as SLAM (Simultaneous Localization and Mapping). The content management service refers to a service that distributes information about virtual objects to the glasses-type display device 20. Virtual objects correspond to real objects visible from the position of the glasses-type display device 20 in a global coordinate system.

[0013] In this embodiment, various virtual objects are provided, and each virtual object corresponds to a real object visible from a given position in the global coordinate system. The management device 30 has pre-stored virtual object information and area information corresponding to each virtual object. The virtual object information represents the image of the virtual object. The area information indicates the position and size of the display area where the virtual object is displayed. The management device 30 receives image data captured by the glasses-type display device 20 from the mobile device 10 via the communication line NW, and identifies the position of the glasses-type display device 20 based on the received image data. The management device 30 then transmits the virtual object information and area information corresponding to the identified position to the mobile device 10. The mobile device 10 displays the image of the virtual object on the glasses-type display device 20 according to the virtual object information and area information received from the management device 30. As a result, the virtual object is superimposed on real space in the eyes of user U.

[0014] In this embodiment, the real space is a streetscape in a tourist area. In this embodiment, the real object is, for example, a shop in the streetscape. Figure 2 is a diagram showing an example of an image G1 of the real space corresponding to the user U's field of view. In this embodiment, the virtual object is an image containing a string of text describing the goods, etc., handled by the shop. Figure 3 is a diagram showing an example of an image G2 seen by user U through the glasses-type display device 20. In the image G2 shown in Figure 3, the virtual object, which is superimposed on the streetscape of the tourist area, is drawn with dotted lines.

[0015] Figure 4 is a block diagram showing an example configuration of a portable device 10. As shown in Figure 4, the portable device 10 includes an input device 11, an output device 12, a communication device 14, a communication device 15, a storage device 17, a processing device 18, and a bus 19. The components of the portable device 10 (input device 11, output device 12, communication device 14, communication device 15, storage device 17, and processing device 18) are interconnected by a bus 19 for communicating information. The bus 19 may be configured using a single bus, or different buses may be configured for each device.

[0016] The input device 11 includes a touch panel. The input device 11 may also include multiple operation keys in addition to the touch panel. The input device 11 may also include multiple operation keys without a touch panel. The input device 11 accepts operations performed by user U. The output device 12 includes a display panel. The touch panel of the input device 11 is stacked on top of the display panel of the output device 12. The output device 12 displays various information.

[0017] The communication device 14 is a hardware device for communicating with the management device 30 via the communication line NW. The communication device 14 is also called, for example, a network device, a network controller, a network card, or a communication module. The communication device 14 transmits the image data given from the processing device 18 to the management device 30. Also, the communication device 14 supplies the virtual object information and the area information received from the management device 30 to the processing device 18. Note that the communication device 14 may communicate with the management device 30 without going through the communication line NW.

[0018] The communication device 15 is a hardware device for communicating with the glasses-type display device 20 by wire. The communication device 15 supplies the data received from the glasses-type display device 20 to the processing device 18. Also, the communication device 15 transmits the image data given from the processing device 18 to the glasses-type display device 20. Note that the communication device 15 may communicate with the glasses-type display device 20 wirelessly.

[0019] The storage device 17 is a recording medium readable by the processing device 18. The storage device 17 includes, for example, a non-volatile memory and a volatile memory. The non-volatile memory is, for example, a ROM (Read Only Memory), an EPROM (Erasable Programmable Read Only Memory), and an EEPROM (Electrically Erasable Programmable Read Only Memory). The volatile memory is, for example, a RAM (Random Access Memory). A program PR1 for causing the processing device 18 to execute the display control method of the present disclosure is stored in advance in the storage device 17.

[0020] The processing device 18 includes one or more CPUs (Central Processing Units). The one or more CPUs are an example of one or more processors. Each of the processor and the CPU is an example of a computer. The processing device 18 reads the program PR1 from the storage device 17. The processing device 18 operating according to the program PR1 transmits the image data received from the glasses-type display device 20 to the management device 30 using the communication device 14. Also, the processing device 18 operating according to the program PR1 functions as the measurement unit 181, the determination unit 182, the calculation unit 183, and the display control unit 184 shown in FIG. 4. That is, the measurement unit 181, the determination unit 182, the calculation unit 183, and the display control unit 184 in FIG. 4 are software modules realized by operating the processing device 18 according to software.

[0021] The measurement unit 181 measures the walking speed of the user U wearing the glasses-type display device 20. In the present embodiment, the glasses-type display device 20 transmits acceleration data to the portable device 10. The acceleration data represents the accelerations in the following three directions. The first is the acceleration in the direction along the vertical axis (hereinafter, the Z-axis). The second is the acceleration along the axis orthogonal to the vertical axis (hereinafter, the X-axis). The third is the acceleration in the direction along the axis orthogonal to the vertical axis and orthogonal to the X-axis (hereinafter, the Y-axis). The acceleration data transmitted from the glasses-type display device 20 to the portable device 10 is received by the communication device 15. The measurement unit 181 measures the walking speed of the user U based on the acceleration data received by the communication device 15.

[0022] More specifically, the measurement unit 181 first identifies the direction of the gravitational acceleration (that is, the direction of the Z-axis) based on the acceleration data received by the communication device 15. When the acceleration in the Z-axis direction changes within a predetermined period, the measurement unit 181 determines that the user U is walking. When it is determined that the user U is walking, the measurement unit 181 calculates the absolute value of the combined acceleration obtained by combining the acceleration in the X-axis direction and the acceleration in the Y-axis direction based on the acceleration data. Then, the measurement unit 181 calculates the walking speed of the user by integrating the absolute value of the combined acceleration.

[0023] The determination unit 182 determines whether the walking speed measured by the measurement unit 181 falls below a first threshold (walking speed < first threshold). In this embodiment, the first threshold is, for example, the average value of walking speeds measured when multiple sample users walk while looking at a virtual object. However, the first threshold is not limited to the average value of walking speeds for multiple sample users. The first threshold may be the actual measured value of user U's walking speed. In this case, for example, the tutorial of the glasses-type display device 20 is used to measure user U's walking speed. During the execution of the tutorial, the actual measured value of user U's walking speed measured when user U walks while looking at a virtual object displayed on the glasses-type display device 20 is set as the first threshold.

[0024] The calculation unit 183 calculates the user U's level of concentration based on the user U's walking speed. The user's level of concentration refers to the degree of the user U's attention to the virtual object displayed on the glasses-type display device 20 (i.e., the degree to which the user is concentrating on the virtual object). In this embodiment, the user U's level of concentration is, for example, a positive value, and a larger value indicates a higher level of concentration on the user U. The reason why the user U's level of concentration on the virtual object can be calculated based on the user U's walking speed is as follows.

[0025] For example, if user U is hurrying to their destination without paying attention to the virtual object displayed on the glasses-type display device 20, user U will tend to walk at a brisk pace, and their walking speed will often exceed the first threshold. On the other hand, if user U is paying attention to the virtual object while walking, user U will tend to walk at a slower pace, and their walking speed will often fall below the first threshold. Since there is a correlation between user U's level of concentration on the virtual object displayed on the glasses-type display device 20 and their walking speed, user U's level of concentration can be calculated based on their walking speed.

[0026] In this embodiment, the calculation unit 183 calculates the concentration level of user U based on the difference between the walking speed measured by the measurement unit 181 and the first threshold, if the determination result by the determination unit 182 is positive, that is, if the walking speed measured by the measurement unit 181 is below the first threshold. In this embodiment, the calculation unit 183 calculates a larger concentration level the greater the difference between the walking speed measured by the measurement unit 181 and the first threshold. That is, the first concentration level calculated by the calculation unit 183 when the difference between the walking speed measured by the measurement unit 181 and the first threshold is a first value is greater than the second concentration level calculated by the calculation unit 183 when the difference between the walking speed measured by the measurement unit 181 and the first threshold is a second value (a value smaller than the first value). As mentioned above, the more attention is directed towards the virtual object displayed on the glasses-type display device 20, the slower the walking speed of the user using the glasses-type display device 20 tends to be.

[0027] The display control unit 184 controls the display of virtual objects on the glasses-type display device 20. The display control unit 184 performs different processing depending on whether the determination result from the determination unit 182 is positive or negative.

[0028] If the determination result by the determination unit 182 is negative, the display control unit 184 generates image data representing the superimposed image. The superimposed image is an image in which the image indicated by the virtual object information is placed in the area indicated by the area information. The virtual object information and area information are received from the management device 30 by the portable device 10. The display control unit 184 then transmits the image data to the glasses-type display device 20, causing the superimposed image to be displayed on the glasses-type display device 20.

[0029] If the determination result by the determination unit 182 is positive, the display control unit 184 controls the display of the virtual object based on the concentration level of user U calculated by the calculation unit 183. More specifically, if the determination result by the determination unit 182 is positive, the display control unit 184 determines whether the concentration level of user U calculated by the calculation unit 183 exceeds the second threshold (user concentration level > second threshold). If the concentration level of user U calculated by the calculation unit 183 is less than or equal to the second threshold, the display control unit 184 displays the superimposed image on the glasses-type display device 20. If the concentration level of user U calculated by the calculation unit 183 is greater than the second threshold, the display control unit 184 stops generating and transmitting image data representing the superimposed image. As a result, the virtual object is not displayed on the glasses-type display device 20.

[0030] Furthermore, the processing unit 18, which operates according to program PR1, executes the display method shown in Figure 5 each time it receives acceleration data from the communication device 15. As shown in Figure 5, this display method includes the processes of steps SA110 to SA150.

[0031] In step SA110, the processing unit 18 functions as a measurement unit 181. In step SA110, the processing unit 18 measures the walking speed of user U, who is wearing the glasses-type display device 20, based on the acceleration data received by the communication device 15.

[0032] In step SA120, the processing unit 18 functions as a determination unit 182. In step SA120, the processing unit 18 determines whether the walking speed measured in step SA110 is below the first threshold. If the walking speed measured in step SA110 is above the first threshold, the determination result of step SA120 is "No (negative)", and the process of step SA130 is executed. If the walking speed measured in step SA110 is below the first threshold, the determination result of step SA120 is "Yes (affirmative)", and the processes of steps SA140 and SA150 are executed.

[0033] In step SA130, the processing unit 18 functions as a display control unit 184. In step SA130, the processing unit 18 generates image data representing the superimposed image. The processing unit 18 then transmits this image data to the glasses-type display device 20, causing the glasses-type display device 20 to display the superimposed image.

[0034] In step SA140, the processing unit 18 functions as a calculation unit 183. In step SA140, the processing unit 18 calculates the concentration level of user U based on the walking speed measured in step SA110. In step SA150, which follows step SA140, the processing unit 18 functions as a display control unit 184. In step SA150, the processing unit 18 controls the display of virtual objects on the glasses-type display device 20 based on the concentration level of user U calculated in step SA140. More specifically, in step SA150, the processing unit 18 determines whether the concentration level of user U calculated in step SA140 exceeds a second threshold. If the concentration level of user U calculated in step SA140 is less than or equal to the second threshold, the processing unit 18 displays the superimposed image on the glasses-type display device 20. If the concentration level of user U calculated in step SA140 is greater than the second threshold, the processing unit 18 stops displaying the superimposed image.

[0035] Figure 6 is a block diagram showing an example configuration of a spectacle-type display device 20. The spectacle-type display device 20 includes a display unit 2a, a communication device 2b, an imaging device 2c, an acceleration sensor 2g, a storage device 2d, a processing device 2e, and a bus 2f. The components of the spectacle-type display device 20 (display unit 2a, communication device 2b, imaging device 2c, acceleration sensor 2g, storage device 2d, and processing device 2e) are interconnected by a bus 2f for communicating information. The bus 2f may be configured using a single bus, or different buses may be configured between elements such as devices.

[0036] The display unit 2a is transmissive. Light in the field of view of the glasses-type display device 20 (display unit 2a) passes through the display unit 2a. The display unit 2a displays superimposed images under the control of the portable device 10. When user U wears the glasses-type display device 20, the display unit 2a is positioned in front of user U's left and right eyes. When an image of a virtual object appears in real space while user U is wearing the glasses-type display device 20, they can see it.

[0037] More specifically, the display unit 2a includes a lens for the left eye, a display panel for the left eye, an optical element for the left eye, a lens for the right eye, a display panel for the right eye, and an optical element for the right eye. The display panel for the left eye and the display panel for the right eye are, for example, liquid crystal panels or organic EL (Electro-Luminescence) panels. The display panel for the left eye displays a superimposed image represented by image data provided from the portable device 10. The optical element for the left eye is an optical element that guides light emitted from the display panel for the left eye to the lens for the left eye. Similarly, the display panel for the right eye displays a superimposed image represented by image data provided from the portable device 10. The optical element for the right eye is an optical element that guides light emitted from the display panel for the right eye to the lens for the right eye.

[0038] Each of the lenses, one for the left eye and one for the right eye, has a half-mirror. The half-mirror in the left eye lens transmits light representing real space, guiding it to the user U's left eye. The half-mirror in the left eye lens also reflects the light guided by the left eye's optical component back to the user U's left eye. The half-mirror in the right eye lens transmits light representing real space, guiding it to the user U's right eye. The half-mirror in the right eye lens reflects the light guided by the right eye's optical component back to the user U's right eye.

[0039] Communication device 2b is a hardware device for communicating with the mobile device 10 via a wired connection. Communication device 2b may also communicate with the mobile device 10 wirelessly.

[0040] The spectacle-type display device 20 has a spectacle-type frame that supports lenses for the left eye and the right eye, and the imaging device 2c is installed on the bridge of the frame. The imaging device 2c captures an image of its field of view. The imaging device 2c outputs image data representing the captured image to the processing device 2e.

[0041] The acceleration sensor 2g is a three-axis acceleration sensor that detects acceleration in the X, Y, and Z axes at regular intervals. The acceleration sensor 2g outputs acceleration data representing acceleration in the X, Y, and Z axes to the processing unit 2e at regular intervals.

[0042] The storage device 2d is a recording medium readable by the processing device 2e. Like the storage device 17, the storage device 2d includes non-volatile memory and volatile memory. The storage device 2d stores program PR2. The processing device 2e includes one or more CPUs. The processing device 2e reads program PR2 from the storage device 2d. The processing device 2e functions as the operation control unit 2e1 by executing program PR2.

[0043] The motion control unit 2e1 controls the glasses-type display device 20. The motion control unit 2e1 transmits image data output from the imaging device 2c to the portable device 10 using the communication device 2b. The motion control unit 2e1 also transmits acceleration data output from the acceleration sensor 2g to the portable device 10 using the communication device 2b. Furthermore, the motion control unit 2e1 supplies image data received from the portable device 10 via the communication device 2b to the display unit 2a. The display unit 2a displays the image represented by the image data supplied by the motion control unit 2e1. As described above, the image data transmitted from the portable device 10 to the glasses-type display device 20 represents the superimposed image described above. Since the superimposed image is displayed on the display unit 2a, the user U sees an image of real space with virtual objects superimposed on it.

[0044] For example, if the walking speed of user U wearing the glasses-type display device 20 exceeds the first threshold, the determination result of step SA120 in the display control method executed by the mobile device 10 becomes "No," and the process of step SA130 is executed. As a result, image data representing the superimposed image is transmitted from the mobile device 10 to the glasses-type display device 20, and the superimposed image is displayed on the display unit 2a of the glasses-type display device 20. Therefore, to user U's eyes, a real space with virtual objects superimposed is projected, as shown in image G2 in Figure 3.

[0045] In response to this, if user U's concentration on the virtual object wearing the glasses-type display device 20 increases and the walking speed falls below the first threshold, the judgment result of step SA120 becomes "Yes" and the processing of steps SA140 and SA150 is executed. Even when the walking speed is below the first threshold, if the concentration level of user U calculated in step SA140 is below the second threshold, the superimposed image is displayed on the display unit 2a of the glasses-type display device 20, so that user U's eyes see the real space with the virtual object superimposed, as shown in image G2 in Figure 3. If user U's concentration on the virtual object increases further and user U's walking speed slows down even more, the concentration level of user U calculated in step SA140 exceeds the second threshold, and the superimposed image is no longer displayed. As a result, user U's eyes do not see the virtual object, as shown in image G1 in Figure 2.

[0046] As described above, according to this embodiment, the display of virtual objects is controlled according to the degree of concentration of the user U on the virtual objects displayed on the glasses-type display device 20. This prevents the user U from becoming excessively focused on the display of virtual objects while avoiding unnecessary display restrictions.

[0047] (B: Transformation) This disclosure is not limited to the embodiments illustrated above. Specific variations are as follows. Two or more embodiments arbitrarily selected from the following examples may be combined. (B-1: Torture 1) In the above embodiment, the display control unit 184 restricts the display of virtual objects by stopping the display of virtual objects when the concentration level of user U calculated by the calculation unit 183 exceeds the second threshold. However, the display control unit 184 may also display a message warning of excessive concentration on virtual objects on the glasses-type display device 20 in addition to the virtual objects when the concentration level of user U calculated by the calculation unit 183 exceeds the second threshold. In short, the display control unit 184 only needs to be able to control the display of virtual objects on the glasses-type display device 20 based on the concentration level of user U calculated by the calculation unit 183.

[0048] (B-2: Variation 2) In the above embodiment, the measurement unit 181 calculated the walking speed of user U by integrating the combined acceleration obtained by combining the acceleration in the X-axis direction and the acceleration in the Y-axis direction. However, the measurement unit 181 may also determine the walking speed of user U by using a pre-prepared table. Specifically, the table has multiple records. Each of the multiple records includes a walking speed within a certain range and the periodic fluctuation amplitude of the acceleration in the Z-axis direction obtained when user U walks at that walking speed. The table is pre-stored in the storage device 17. The measurement unit 181 receives acceleration data from the glasses-type display device 20 and determines the walking speed of user U by reading the walking speed corresponding to the fluctuation amplitude of the acceleration in the Z-axis direction represented by the acceleration data from the table.

[0049] (B-3: Modification 3) In the above embodiment, the glasses-type display device 20 is equipped with a three-axis acceleration sensor, and the measurement unit 181 determines the user's walking speed based on the output data of the acceleration sensor. However, when a moving image is captured by the imaging device 2c, the measurement unit 181 may measure the user's walking speed based on the moving image captured by the imaging device 2c. For example, the measurement unit 181 may determine the walking speed of user U wearing the glasses-type display device 20 by referring to a pre-prepared table. Specifically, the table has multiple records. Each of the multiple records includes a walking speed within a certain range and the Z-axis shake range of the moving image obtained by capturing the image while user U is walking at that walking speed. The measurement unit 181 determines the user U's walking speed by reading the walking speed corresponding to the Z-axis shake range of the moving image captured by the imaging device 2c from the table. Alternatively, the measurement unit 181 may determine whether or not user U is walking based on the vertical image shake range for each frame of the moving image captured by the imaging device 2c. If it is determined that user U is walking, the walking speed may be determined based on the change in size across each frame of an object of known size, such as a road sign or a vehicle's license plate. When determining the user's walking speed based on a moving image captured by the imaging device 2c, the acceleration sensor can be omitted.

[0050] (B-4: Modification 4) Instead of an acceleration sensor, a GPS (Global Positioning System, Global Positioning Satellite) receiver may be provided in the glasses-type display device 20, and the measurement unit 181 may determine the user's walking speed based on the output data of the GPS receiver. For example, the measurement unit 181 determines whether or not user U is walking based on the amount of image blur in the Z-axis direction for each frame of the moving image captured by the imaging device 2c. If it is determined that user U is walking, the measurement unit 181 calculates the user's travel distance based on the first position information acquired by the GPS receiver at time t1 and the second position information acquired by the GPS receiver at time t2, which is later than time t1, and sets the value obtained by dividing this travel distance by t2-t1 as the walking speed.

[0051] (B-5: Variation 5) In the above embodiment, program PR1 was stored in the storage device 17 of the portable device 10, but program PR1 may be manufactured or sold as a standalone product. When selling program PR1, methods for providing program PR1 to buyers include distributing a computer-readable recording medium such as a flash ROM on which program PR1 is written, or distributing the recording medium by download via a telecommunications line.

[0052] (B-6: Torture 6) In the above embodiment, the measurement unit 181, determination unit 182, calculation unit 183, and display control unit 184 were software modules. However, one, more, or all of the measurement unit 181, determination unit 182, calculation unit 183, and display control unit 184 may be hardware modules. Specific examples of hardware modules include DSP (Digital Signal Processor), ASIC (Application Specific Integrated Circuit), PLD (Programmable Logic Device), FPGA (Field Programmable Gate Array), etc.

[0053] (B-7: Variation 7) In the above embodiment, the portable device 10 had a measurement unit 181, a determination unit 182, a calculation unit 183, and a display control unit 184. However, the measurement unit 181 may be provided in the glasses-type display device 20, and data representing walking speed may be supplied from the glasses-type display device 20 to the portable device 10. Also, the determination unit 182 may be omitted. In short, the display control device that controls the display of virtual objects in the glasses-type display device 20 only needs to include a calculation unit 183 and a display control unit 184.

[0054] (C: Other) (1) In the embodiments described above, ROM and RAM were given as examples of storage devices 17 and 2d, but storage devices 17 and 2d may be flexible disks, magneto-optical disks (e.g., compact disks, digital multipurpose disks, Blu-ray® disks), smart cards, flash memory devices (e.g., cards, sticks, key drives), CD-ROMs (Compact Disc-ROMs), registers, removable disks, hard disks, floppy® disks, magnetic strips, databases, servers, or other suitable storage media.

[0055] (2) In the embodiments described above, the information, signals, etc. may be represented using any of the various different technologies. For example, the data, instructions, commands, information, signals, bits, symbols, chips, etc. that may be mentioned throughout the above description may be represented by voltage, current, electromagnetic waves, magnetic fields or magnetic particles, optical fields or photons, or any combination thereof.

[0056] (3) In the embodiments described above, the input and output information may be stored in a specific location (e.g., memory) or managed using a management table. The input and output information may be overwritten, updated, or appended to. The output information may be deleted. The input information may be transmitted to other devices.

[0057] (4) In the embodiments described above, the determination may be made by a value represented by 1 bit (0 or 1), by a boolean value (true or false), or by a numerical comparison (for example, a comparison with a predetermined value).

[0058] (5) The processing procedures, sequences, flowcharts, etc., exemplified in the embodiments described above may be reordered, as long as they do not contradict each other. For example, in the methods described herein, the elements of various steps are presented using an exemplary order and are not limited to the specific order presented.

[0059] (6) Each function illustrated in Figure 4 is implemented by any combination of at least one of hardware and software. Furthermore, the method of implementing each function block is not particularly limited. That is, each function block may be implemented using one device that is physically or logically coupled, or it may be implemented using two or more physically or logically separated devices that are directly or indirectly connected (for example, using wired, wireless, etc.). A function block may also be implemented by combining the above one device or the above multiple devices with software.

[0060] (7) In the embodiments described above, the program should be interpreted broadly to mean instructions, instruction sets, code, code segments, program code, programs, subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executable files, execution threads, procedures, functions, etc., whether the software is called software, firmware, middleware, microcode, hardware description language or by any other name.

[0061] Furthermore, software, instructions, information, etc., may be transmitted and received via a transmission medium. For example, if software is transmitted from a website, server, or other remote source using at least one of wired technology (coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL), etc.) and wireless technology (infrared, microwave, etc.), at least one of these wired and wireless technologies is included in the definition of a transmission medium.

[0062] (8) In each of the above-mentioned forms, the terms “system” and “network” shall be used interchangeably.

[0063] (9) The information, parameters, etc. described in this disclosure may be expressed using absolute values, relative values ​​from a given value, or other corresponding information.

[0064] (10) In the embodiments described above, the portable device may be a Mobile Station (MS). A Mobile Station may also be referred to by those skilled in the art as a subscriber station, mobile unit, subscriber unit, wireless unit, remote unit, mobile device, wireless device, wireless communication device, remote device, mobile subscriber station, access terminal, mobile terminal, wireless terminal, remote terminal, handset, user agent, mobile client, client, or several other appropriate terms. In this disclosure, terms such as “Mobile Station,” “User Terminal,” “User Equipment (UE),” and “Terminal” may be used interchangeably.

[0065] (11) In the embodiments described above, the terms “connected,” “coupled,” or any variation thereof, mean any direct or indirect connection or coupling between two or more elements, and may include the presence of one or more intermediate elements between two elements that are “connected” or “coupled” with each other. The coupling or connection between elements may be physical, logical, or a combination thereof. For example, “connection” may be read as “access.” As used in this disclosure, two elements may be considered to be “connected” or “coupled” with each other using at least one of one or more wires, cables, and printed electrical connections, and, in some non-limiting and non-exclusive examples, electromagnetic energy having wavelengths in the radio frequency domain, microwave domain, and optical (both visible and invisible) domain.

[0066] (12) In the embodiments described above, the phrase “based on” does not mean “based solely on” unless otherwise specified. In other words, the phrase “based on” means both “based solely on” and “based at least on.”

[0067] (13) The terms “determining” and “determining” as used in this disclosure may encompass a wide variety of actions. “Determining” may include, for example, judging, calculating, computing, processing, deriving, investigating, looking up, searching, inquiry (e.g., searching in a table, database or other data structure), ascertaining, etc. “Determining” may also include receiving (e.g., receiving information), transmitting (e.g., sending information), input, output, accessing (e.g., accessing data in memory), etc. Furthermore, "judgment" and "decision" can include considering something as having been "judged" or "decided" after resolving, selecting, choosing, establishing, comparing, etc. In other words, "judgment" and "decision" can include considering something as having been "judged" or "decided" after some action. Also, "judgment (decision)" can be reinterpreted as "assuming," "expecting," "considering," etc.

[0068] (14) Where the terms “include,” “including,” and variations thereof are used in the embodiments described above, these terms are intended to be inclusive, as is the term “comprising.” Furthermore, the term “or” as used in this disclosure is not intended to be exclusive OR.

[0069] (15) In the present disclosure, if articles are added by translation, such as a, an, and the in English, the present disclosure may include the fact that the noun following these articles is plural.

[0070] (16) In this disclosure, the term “A and B are different” may mean “A and B are different from each other.” The term may also mean “A and B are each different from C.” Terms such as “separate” and “combine” may be interpreted in the same way as “different.”

[0071] (17) Each aspect / embodiment described herein may be used individually, in combination, or switched between as needed in practice. Furthermore, notification of certain information (e.g., notification that "X is") is not limited to explicit notification, but may also be implicit (e.g., by not providing such notification).

[0072] (D: Aspects as understood from the above-described forms or modifications) Although the present disclosure has been described in detail above, it will be clear to those skilled in the art that the present disclosure is not limited to the embodiments described herein. The present disclosure can be implemented in modified and altered forms without departing from the spirit and scope of the present disclosure as defined by the claims. Accordingly, the descriptions in the present disclosure are for illustrative purposes only and are not intended to be restrictive in any way. The following forms can be understood from at least one of the embodiments or modifications described above.

[0073] The display control device according to the first embodiment comprises a calculation unit 183 and a display control unit 184. The calculation unit 183 calculates the degree of concentration of user U on a virtual object displayed on a transparent display device worn on the user U's head, based on the user's walking speed. The display control unit 184 controls the display of the virtual object on the transparent display device based on the user's concentration level calculated by the calculation unit 183. The portable device 10 is an example of the display control device of the present disclosure. The glasses-type display device 20 is an example of a transparent display device in the present disclosure. According to the display control device of the first embodiment, since the display of the virtual object is controlled based on the user's concentration level on the virtual object displayed on the transparent display device, it is possible to prevent the user from concentrating excessively on the display of the virtual object while avoiding unnecessary display restrictions.

[0074] The display control device according to the second embodiment (an example of the first embodiment) may further include a measuring unit 181 for measuring the user's walking speed. The display control device according to the second embodiment can control the display of virtual objects according to the level of concentration calculated based on the walking speed measured by the measuring unit 181.

[0075] A display control device according to a third embodiment (an example of the first embodiment) may include a determination unit 182 that determines whether the user's walking speed is below a first threshold. In the display control device according to the third embodiment, a calculation unit 183 may calculate the user's level of concentration based on the difference between the first threshold and the user's walking speed when the determination result by the determination unit 182 is positive (i.e., the walking speed is below the first threshold). Furthermore, in the display control device according to the third embodiment, a display control unit 184 may restrict the display of virtual objects on the display device based on the user's level of concentration calculated by the calculation unit 183 when the determination result by the determination unit 182 is positive. The display control device according to the third embodiment can restrict the display of virtual objects on the display device based on the user's level of concentration calculated by the calculation unit 183 when the user's walking speed is below a first threshold.

[0076] In the display control device according to the fourth embodiment (an example of the first embodiment), the display control unit 184 may restrict the display of virtual objects on the transparent display device when the user concentration level calculated by the calculation unit 183 exceeds a second threshold. The display control device according to the fourth embodiment can restrict the display of virtual objects on the transparent display device when the user concentration level calculated based on the user's walking speed exceeds a second threshold. [Explanation of symbols]

[0077] 1...Display system, 10...Portable device, 20...Eyeglass-type display device, 11...Input device, 12...Output device, 14,15,2b...Communication device, 17,2d...Storage device, 18,2e...Processing device, 181...Measurement unit, 182...Determination unit, 183...Calculation unit, 184...Display control unit, 19,2f...Bus, 2a...Display unit, 2g...Accelerometer, 2e1...Motion control unit, PR1,PR2...Program.

Claims

1. A calculation unit calculates the degree of the user's concentration on a virtual object displayed on a transparent display device worn on the user's head, based on the user's walking speed. A display control unit controls the display of the virtual object on the transparent display device based on the user's level of concentration, A display control device comprising:

2. The display control device according to claim 1, further comprising a measuring unit for measuring the walking speed of the user.

3. The system further includes a determination unit that determines whether the walking speed falls below a first threshold, The calculation unit calculates the user's level of concentration based on the difference between the walking speed and the first threshold when the walking speed falls below the first threshold. The display control unit restricts the display of the virtual object on the transparent display device based on the user's level of concentration when the walking speed falls below a first threshold. The display control device according to claim 1.

4. The display control device according to claim 3, wherein the first threshold value is set to the measured value of the walking speed of the user while walking while looking at the virtual object displayed on the transparent display device in the tutorial of the transparent display device.

5. The display control unit restricts the display of the virtual object on the transparent display device when the user's level of concentration exceeds a second threshold. The display control device according to claim 1.

Images