Device and method

Abstract

This device comprises: an imaging unit that images a field-of-view region of a user; a display unit that displays an image corresponding to the field-of-view region imaged by the imaging unit; a recognition unit that recognizes the body of the user in the field-of-view region imaged by the imaging unit; and a display control unit that controls a virtual object so as to overlap the body recognized by the recognition unit. The display control unit does not display an image that depicts the body at the position of the body recognized by the recognition unit.

Description

Apparatus and method

[0001] The present disclosure relates to an apparatus and method for displaying images.

[0002] Patent Literature 1 discloses a technology relating to virtual reality display, in which a virtual image of an input interface (an example of a virtual object) is displayed at a predetermined position on the user's body.

[0003] Special Publication No. 2006-506737

[0004] In the above-described technology, when operating an input interface, a user can feel a tactile sensation caused by a part of the body (e.g., a fingertip) touching the input interface. However, since the input interface is displayed on another part of the body, the user also feels a tactile sensation caused by this other part. In this case, the tactile sensation caused by the operating part of the body may be relatively reduced.

[0005] The present disclosure aims to provide an apparatus and method for improving the tactile sensation when touching a virtual object.

[0006] An apparatus according to one aspect of the present disclosure includes an imaging unit that images a user's field of view, a display unit that displays an image corresponding to the field of view imaged by the imaging unit, a recognition unit that recognizes the user's body in the field of view imaged by the imaging unit, and a display control unit that controls a virtual object to be superimposed on the body recognized by the recognition unit. The display control unit hides the image showing the body at the position of the body recognized by the recognition unit.

[0007] In the above device, a virtual object is superimposed on the position of the user's body recognized by the recognition unit, allowing the user to feel a tactile sensation when touching the virtual object. Meanwhile, an image representing the user's body is hidden at the position of the user's body where the virtual object is superimposed. In this case, when touching the virtual object, there is no visual recognition that the body on which the virtual object is superimposed has been touched, and therefore the sensation of touching the body on which the virtual object is superimposed is unlikely to occur. In other words, the sensation of the touching side is relatively stronger between the touching side and the touched side. Therefore, the tactile sensation when touching the virtual object can be improved.

[0008] According to one aspect of the present disclosure, it is possible to provide an apparatus and a method for improving the tactile sensation when touching a virtual object.

[0009] FIG. 1 is a schematic diagram showing an example of an image display device. FIG. 2 is a diagram showing a schematic example of an image viewed by a user on the example of an image display device. FIG. 3 is a diagram showing a schematic example of an image viewed by a user on the example of an image display device. FIG. 4 is a diagram showing a schematic example of an image viewed by a user on the example of an image display device. FIG. 5 is a diagram showing a schematic example of an image viewed by a user on the example of an image display device. FIG. 6 is a diagram showing a schematic example of an actual situation corresponding to FIG. 5. FIG. 7 is a flow chart for explaining processing of the example of an image display device. FIG. 8 is a diagram showing an example of a device constituting an image construction device.

[0010] Hereinafter, exemplary embodiments will be described in detail with reference to the accompanying drawings. In the description of the drawings, the same or equivalent elements are designated by the same reference numerals, and redundant description will be omitted.

[0011] FIG. 1 is a schematic diagram showing the configuration of an example image display device. The image display device 10 (device) can constitute a system that provides a user with an experience of mixed reality (MR) or augmented reality (AR) by providing the user with an image in which a virtual object is displayed together with a real space. A virtual object is a virtual object that does not actually exist in the displayed space. Note that the example image display device 10 can also provide the user with a virtual reality (VR) experience by providing the user with a virtual space that does not include a real space.

[0012] An example of the image display device 10 presents mixed reality to a user. The form of the image display device 10 is not limited to a specific form. As an example, the image display device 10 may be a wearable device worn on the user's head. Examples of the wearable device include head-mounted displays (HMDs) such as eyeglass-type devices (e.g., smart glasses such as MR glasses), goggle-type devices, and hat-type devices. The wearable device may include a remote control as an input device.

[0013] The image display device 10 includes at least an imaging unit 11 , a recognition unit 12 , a display unit 13 , a display control unit 15 , and an input determination unit 17 .

[0014] The imaging unit 11 captures an image of the user's field of view. The field of view is an area in front of the user wearing the image display device 10, and corresponds to the range of vision seen by the user when the user is not wearing the image display device 10. The imaging unit 11 may include, for example, a camera (image sensor). The imaging unit 11 is arranged as part of the wearable device so as to acquire an image of real space corresponding to the user's line of sight. For example, the imaging unit 11 is provided on the front part of the wearable device and acquires an image in front of the user's line of sight in real time. The imaging unit 11 may include a depth sensor. The depth sensor measures the distance to each object shown in the image acquired by the imaging unit 11. This makes it possible to acquire three-dimensional information of real space and to position and display virtual objects based on that information.

[0015] The recognition unit 12 recognizes the user's body in the field of view captured by the imaging unit 11. For example, the recognition unit 12 acquires three-dimensional information (e.g., shape, position, orientation, etc.) of at least a part of the user's body present in the field of view. In one example, the recognition unit 12 recognizes (detects) the user's hands and arms present in the field of view and tracks the movements of the recognized hands and arms. The recognition unit 12 may acquire three-dimensional information of the hands using so-called hand tracking technology.

[0016] The display unit 13 displays an image corresponding to the field of view captured by the imaging unit 11. The display unit 13 is, for example, a display disposed in front of both eyes of the user. The display unit 13 may be configured, for example, with a liquid crystal display element, an organic EL (Electro Luminescence) element, or the like. The display unit 13 may have separate right-eye displays disposed in front of the user's right eye and left-eye displays disposed in front of the user's left eye.

[0017] For example, the display unit 13 may be configured with a video see-through display and may display in real time the images acquired by the imaging unit 11. The display unit 13 may also process and display the images acquired by the imaging unit 11. When a virtual reality is presented to the user, the display unit 13 may display a pre-stored image of a virtual three-dimensional space in accordance with a change in the orientation of the field of view imaged by the imaging unit 11.

[0018] Furthermore, the display unit 13 displays an image (body image) corresponding to the user's body recognized by the recognition unit 12. In one example, the display unit 13 displays an image corresponding to the user's hand or the like when the user's hand or the like is present within the field of view. The image corresponding to the hand or the like may be a real-time image of the hand or the like acquired by the imaging unit 11.

[0019] The display control unit 15 controls the body image displayed by the display unit 13. The display control unit 15 also controls the virtual object to be superimposed on the user's body recognized by the recognition unit 12, and outputs information about the virtual object to the display unit 13. The display unit 13 displays the image of the virtual object based on the information from the display control unit 15. In one example, the virtual object may be an input interface for receiving an input operation from the user.

[0020] The input determination unit 17 determines an input operation from the user with respect to a virtual object serving as an input interface. The input operation may be a movement of the user's fingers with respect to the virtual object. In one example, the input determination unit 17 may determine that an input operation has been performed when the user's body (e.g., a fingertip) comes into contact with the virtual object.

[0021] The display control unit 15 and the like will be described in further detail. Figures 2 to 5 are diagrams schematically showing examples of images viewed by a user on an example image display device. Figure 6 is a diagram schematically showing an actual situation corresponding to Figure 5.

[0022] 2 shows a state in which the user's right and left hands are present within the field of view 30. As shown in Fig. 2, the display control unit 15 can display a left hand image LH and a right hand image RH, which are body images corresponding to the user's right and left hands, respectively, at the actual positions of the user's right and left hands. The left hand image LH and the right hand image RH may be displayed based on the user's actual left and right hands recognized by the recognition unit 12.

[0023] The display control unit 15 displays the virtual object 35 as an input interface when a preset condition is satisfied. For example, the virtual object 35 may be displayed when the user performs a predetermined switching operation for displaying the virtual object 35. The switching operation may be a voice operation, a gesture operation, a button operation, or the like.

[0024] In one example, the display control unit 15 displays a virtual object 35 when the user's left hand is located in the switching area. The switching area 31 is a part of the field of view 30 and is set in advance. In the illustrated example, the switching area 31 is roughly the upper half of the field of view 30, but the switching area 31 may be set arbitrarily by the user. For example, the switching area may be one of the fields of view 30 divided into left and right halves, or one of the fields of view 30 divided diagonally.

[0025] The display control unit 15 displays the virtual object 35 so as to be superimposed on the body of the user present in the switching area 31. The display control unit 15 may geometrically position the virtual object 35 based on the three-dimensional information of the hand acquired by the recognition unit 12. In the example of Fig. 3, the virtual object 35 is shown as a numeric keypad, which is an example of an input interface. The position of the surface of the displayed virtual object may coincide with the position of the surface of the user's body that is superimposed.

[0026] The display control unit 15 hides the image showing the user's body recognized by the recognition unit 12 at the position where the virtual object 35 is superimposed. In Fig. 3 , the virtual object 35 is superimposed on the user's actual left hand LHR located within the switching area 31, but in this case, an image showing the user's left hand LHR is not displayed at the position where the virtual object 35 is superimposed. The left hand LHR shown in Fig. 3 with a dashed line is not actually displayed.

[0027] The display control unit 15 may perform a masking process to hide the user's body recognized by the recognition unit 12. As an example, the display control unit 15 may acquire a background image of an area including the left hand LHR as a masking image based on three-dimensional information of real space acquired by the imaging unit 11. The display control unit 15 displays the acquired masking image in front of the left hand LHR to hide the image of the left hand in its actual position.

[0028] The display control unit 15 displays an image of the body at a position that is shifted a certain distance from the position of the body on which the virtual object 35 is superimposed. For example, the display control unit 15 may display an image of the body on which the virtual object 35 is superimposed at a position adjacent to the virtual object 35. In the illustrated example, a virtual left hand image LHV representing the left hand LHR is displayed at a position adjacent to and below the position of the actual left hand LHR on which the virtual object 35 is superimposed.

[0029] When the user moves the left hand LHR on which the virtual object 35 is superimposed, the display control unit 15 causes the display position of the virtual object 35 to follow the position of the left hand LHR. For example, when the left hand LHR moves from the state in FIG. 3 to the state in FIG. 4, the display control unit 15 moves the virtual object 35 so that the relative positional relationship between the left hand LHR and the virtual object 35 is maintained. In the illustrated example, the position and angle of the virtual object 35 are changed in accordance with the movement of the left hand LHR. Note that the type of virtual object 35 displayed may be changed depending on the orientation of the hand. For example, a keyboard (not shown) may be displayed when the hand is oriented horizontally as in FIG. 3, and a numeric keypad may be displayed when the hand is oriented vertically as in FIG. 4.

[0030] Furthermore, when the user moves the actual left hand LHR, the display control unit 15 controls the position of the displayed virtual left hand image LHV so that the displayed virtual left hand image LHV maintains a state adjacent to the actual left hand LHR. For example, when the left hand LHR moves from the state in Fig. 3 to the state in Fig. 4, the display control unit 15 may move the displayed left hand image LHV so that it moves in the same manner as the actual left hand LHR. Furthermore, when the size of the left hand image LHV changes as the left hand moves forward or backward, the size of the displayed virtual object 35 may be changed in conjunction with the size of the left hand image LHV (the relative size of the left hand in the field of view 30).

[0031] 5 is a diagram showing an input operation on a virtual object 35 serving as an input interface. The input determination unit 17 determines whether an input operation has been performed on the virtual object 35. In one example, it is determined that an input operation has been performed when a part of the user's body other than the part on which the virtual object 35 is superimposed comes into contact with the virtual object 35. In the illustrated example, three-dimensional information of the right hand image RH is acquired, and the input determination unit 17 determines, for example, whether the index finger of the right hand image RH has come into contact with the virtual object 35. The input determination unit 17 determines which part of the virtual object 35 the right hand image RH has come into contact with, and determines the input content according to the determination result.

[0032] Fig. 6 is a diagram showing the relationship between the actual left hand and right hand when an input operation is being performed, and corresponds to the state in Fig. 5. That is, in Fig. 6, the user's actual left hand LHR and right hand RHR are depicted, but the virtual object 35, left hand image LHV, and right hand image RH are not depicted. As shown in Fig. 6, when an input operation is being performed on the virtual object 35, another part of the user's body (the right hand RHR in the illustrated example) is in contact with the body on which the virtual object 35 is superimposed (the left hand LHR in the illustrated example).

[0033] Next, a control flow of the input interface (virtual object) in the image display device 10 will be described with further reference to Fig. 7. As an example, a case where a virtual object 35 is superimposed on the user's left hand will be described.

[0034] First, the imaging unit 11 of the image display device 10 held (worn) by the user captures an image of the real space, and an image corresponding to the captured space is displayed on the display unit 13. At this time, the recognition unit 12 recognizes the user's body (left hand, right hand) present within the field of view 30 (step S1).

[0035] The display control unit 14 determines whether or not the user has performed a switching operation to display the input interface. In one example, the display control unit 14 determines whether or not the user has positioned their body in the switching area 31 (step S2). For example, the display control unit 14 determines whether or not the user's left hand image LH or right hand image RH is in the switching area 31.

[0036] When the user performs a switching operation to display the input interface, specifically, when the user's body is located within the switching area 31, the display control unit 14 displays the virtual object 35, which is the input interface (step S3). When multiple hands (arms) are present within the switching area 31, the display control unit 14 displays the virtual object 35 so that it is superimposed on one of the hands. For example, the display control unit 14 may display the virtual object 35 on the hand closest to the user. Alternatively, the user's hands may be registered in advance, and the virtual object 35 may be displayed when the registered user's hand is recognized. Alternatively, the display control unit 14 may display the virtual object 35 on the hand when the recognition unit 12 recognizes that the user's hand is in a predetermined state (e.g., a horizontal state or a vertical state).

[0037] When the user's left hand and right hand are present within the switching region 31, the display control unit 14 may switch the hand on which the virtual object 35 is superimposed, based on an operation such as a gesture by the user. For example, when the virtual object 35 is superimposed on the left hand, the target on which the virtual object 35 is superimposed may be switched from the left hand to the right hand by moving the left hand out of the switching region 31 and positioning the right hand within the switching region 31.

[0038] Furthermore, the display control unit 14 hides the image showing the body on which the virtual object 35 is superimposed at the position of the body recognized by the recognition unit 12 (step S4). For example, when augmented reality is provided, the left hand on which the virtual object 35 is superimposed is masked, thereby hiding the body.

[0039] The display control unit 14 displays the virtual left hand image LHV at a position different from the position of the actual left hand LHR (step S5). In the user's field of vision, the user's left hand appears to be in a position different from the actual position of the left hand. The input determination unit 17 determines whether an input operation is performed on a virtual object 35 serving as an input interface displayed in the field of view 30 (step S6). For example, when the user's right hand image RH comes into contact with the virtual object 35, the input determination unit 17 accepts the input. In this case, the user's actual right hand is in contact with the user's actual left hand.

[0040] As described above, image display device 10 according to one aspect of the present disclosure includes imaging unit 11 that captures an image of user's field of view 30, display unit 13 that displays an image corresponding to field of view 30 captured by imaging unit 11, recognition unit 12 that recognizes the user's body in field of view 30 captured by imaging unit 11, and display control unit 15 that controls virtual object 35 to be superimposed on the body recognized by recognition unit 12. Display control unit 15 hides the image showing the body at the position of the body recognized by recognition unit 12.

[0041] In the above-described device, the virtual object 35 is superimposed on the position of the user's body recognized by the recognition unit 12, allowing the user to feel a tactile sensation when touching the virtual object 35. Meanwhile, an image representing the user's body is hidden at the position of the user's body where the virtual object 35 is superimposed. In this case, when the virtual object 35 is touched, the user does not visually recognize that the body on which the virtual object 35 is superimposed has been touched, and therefore the user is unlikely to feel that the body on which the virtual object 35 is superimposed has been touched. In other words, the sensation felt by the touching side is relatively stronger than that felt by the touching side. Therefore, the tactile sensation felt when touching the virtual object 35 can be improved.

[0042] The display control unit 15 may display an image (left hand image LHV) representing the actual body (left hand) at a position shifted a certain distance from the position of the actual body. In this configuration, when the virtual object 35 is touched, the user visually recognizes that the virtual object 35 is being touched at a position distant from the visible body (virtual left hand image LHV), which further reduces the sensation that the actual body (left hand) on which the virtual object 35 is superimposed is being touched.

[0043] The display control unit 15 may display an image showing a body (left hand image LHV) in a position adjacent to the virtual object 35. In this configuration, the image showing a virtual body (left hand image LHV) is displayed in a position close to the actual body (left hand), thereby reducing the sense of discomfort felt by the user.

[0044] The virtual object 35 may be an input interface. It is known that when a virtual input interface is displayed, errors are likely to occur in input operations if a sense of touch is not provided. In the above configuration, providing a sense of touch can reduce the occurrence of errors in input operations. The virtual object may be something other than an input interface. The virtual object may be any object that the user can touch. For example, a virtual object may be set with the purpose of experiencing the various sensations of human skin (temperature, pain, etc.). For example, if a virtual object representing an animal is superimposed on a part of the user's body, the user who touches the virtual object can experience a temperature sensation similar to touching an animal.

[0045] Note that the user can also naturally feel the sensation of being touched by the body on which the virtual object 35 is superimposed, although this sensation is relatively smaller than the sensation felt by the touching side. In this case, the user can feel the sensation of how the virtual object is being touched. In other words, the user's perception function can be expanded. For example, if the virtual object is an input interface, the user can feel the sensation of how the input interface is being touched. Furthermore, if the virtual object is an animal, the user can feel the sensation of how the animal is being touched.

[0046] The position of the surface of the virtual object 35 may coincide with the position of the surface of the body on which the virtual object 35 is superimposed. In this configuration, when the user touches the virtual object 35, the user can reliably touch the body on which the virtual object 35 is superimposed.

[0047] The field of view 30 may include a switching area 31 that is narrower than the field of view 30, and the display control unit 15 may control the virtual object 35 to be superimposed on the body recognized by the recognition unit 12 when the body is in the switching area 31. In this configuration, the virtual object 35 can be switched between being displayed and not displayed.

[0048] The display control unit 15 may change the type of virtual object 35 depending on the body posture. In this configuration, the virtual object 35 to be displayed can be changed according to the user's will.

[0049] The block diagrams used to explain the above embodiments show functional blocks. These functional blocks (components) are realized by any combination of at least one of hardware and software. Furthermore, the method for realizing each functional block is not particularly limited. That is, each functional block may be realized using a single device that is physically or logically coupled, or may be realized using two or more physically or logically separated devices that are directly or indirectly connected (e.g., wired, wireless, etc.) and these multiple devices. The functional block may also be realized by combining software with the single device or multiple devices.

[0050] Functions include, but are not limited to, judgment, determination, assessment, calculation, computation, processing, derivation, investigation, search, confirmation, reception, transmission, output, access, resolution, selection, selection, establishment, comparison, assumption, expectation, consideration, broadcasting, notifying, communicating, forwarding, configuring, reconfiguring, allocating, mapping, and assignment. For example, a functional block (component) that performs transmission is called a transmitting unit or transmitter. As mentioned above, there are no particular limitations on how these functions are implemented.

[0051] For example, the image display device 10 according to an embodiment of the present disclosure may function as a computer that performs the processing of the present disclosure. Fig. 8 is a diagram showing an example of the hardware configuration of the image display device 10 according to an embodiment of the present disclosure. The image display device 10 described above may be physically configured as a computer device including a processor 1001, a memory 1002, a storage 1003, a communication device 1004, an input device 1005, an output device 1006, a bus 1007, etc.

[0052] In the following description, the term "apparatus" can be interpreted as a circuit, a device, a unit, etc. The hardware configuration of the image display device 10 may be configured to include one or more of the devices shown in the drawings, or may be configured to exclude some of the devices.

[0053] Each function of the image display device 10 is realized by loading specified software (programs) onto hardware such as the processor 1001 and memory 1002, causing the processor 1001 to perform calculations, control communication via the communication device 1004, and control at least one of reading and writing data in the memory 1002 and storage 1003.

[0054] The processor 1001 controls the entire computer by running, for example, an operating system. The processor 1001 may be configured by a central processing unit (CPU) including an interface with peripheral devices, a control device, an arithmetic unit, a register, etc. For example, the above-mentioned display control unit 15 and the like may be realized by the processor 1001.

[0055] The processor 1001 also reads programs (program codes), software modules, data, etc. from at least one of the storage 1003 and the communication device 1004 into the memory 1002 and executes various processes in accordance with these programs. The programs used are those that cause a computer to execute at least some of the operations described in the above-described embodiments. For example, the display control unit 15 may be implemented by a control program stored in the memory 1002 and running on the processor 1001, and similar implementations may be made for other functional blocks. While the above-described various processes have been described as being executed by one processor 1001, they may also be executed simultaneously or sequentially by two or more processors 1001. The processor 1001 may be implemented by one or more chips. The programs may also be transmitted from a network via a telecommunications line.

[0056] The memory 1002 is a computer-readable recording medium and may be configured by, for example, at least one of a read-only memory (ROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a random access memory (RAM), etc. The memory 1002 may also be called a register, a cache, a main memory (primary storage device), etc. The memory 1002 can store executable programs (program codes), software modules, etc. for implementing a wireless communication method according to an embodiment of the present disclosure.

[0057] Storage 1003 is a computer-readable recording medium, and may be composed of at least one of, for example, an optical disk such as a CD-ROM (Compact Disc ROM), a hard disk drive, a flexible disk, a magneto-optical disk (e.g., a compact disk, a digital versatile disk, a Blu-ray (registered trademark) disk), a smart card, a flash memory (e.g., a card, a stick, a key drive), a floppy (registered trademark) disk, a magnetic strip, etc. Storage 1003 may also be referred to as an auxiliary storage device. The above-mentioned storage medium may be, for example, a database, a server, or other appropriate medium including at least one of memory 1002 and storage 1003.

[0058] The communication device 1004 is hardware (transmission / reception device) for communicating between computers via at least one of a wired network and a wireless network, and is also referred to as, for example, a network device, a network controller, a network card, a communication module, etc. The communication device 1004 may be configured to include a high-frequency switch, a duplexer, a filter, a frequency synthesizer, etc. to realize at least one of frequency division duplex (FDD) and time division duplex (TDD).

[0059] The input device 1005 is an input device (e.g., a keyboard, a mouse, a microphone, a switch, a button, a sensor, etc.) that receives input from the outside. The output device 1006 is an output device (e.g., a display, a speaker, an LED lamp, etc.) that outputs to the outside. Note that the input device 1005 and the output device 1006 may be integrated into one device (e.g., a touch panel).

[0060] Furthermore, each device, such as the processor 1001 and the memory 1002, is connected by a bus 1007 for communicating information. The bus 1007 may be configured using a single bus, or may be configured using different buses between each device.

[0061] Furthermore, the image display device 10 may be configured to include hardware such as a microprocessor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a programmable logic device (PLD), or a field programmable gate array (FPGA), and some or all of the functional blocks may be realized by the hardware. For example, the processor 1001 may be implemented using at least one of these pieces of hardware.

[0062] Notification of information is not limited to the aspects / embodiments described in this disclosure, and may be performed using other methods.

[0063] The order of the procedures, sequences, flowcharts, etc. of each aspect / embodiment described in this disclosure may be changed unless it is consistent. For example, the methods described in this disclosure present elements of various steps using an example order, and are not limited to the particular order presented.

[0064] Input and output information may be stored in a specific location (for example, memory) or may be managed using a management table. Input and output information may be overwritten, updated, or added to. Output information may be deleted. Input information may be sent to another device.

[0065] The determination may be made based on a value represented by one bit (0 or 1), a Boolean value (true or false), or a numerical comparison (e.g., comparison with a predetermined value).

[0066] The aspects / embodiments described in this disclosure may be used alone, in combination, or switched depending on the implementation. Notification of predetermined information (e.g., notification that "X is true") is not limited to explicit notification, but may be implicit (e.g., not notifying the predetermined information).

[0067] Although the present disclosure has been described in detail above, it is clear to those skilled in the art that the present disclosure is not limited to the embodiments described herein. The present disclosure can be implemented in modified and altered forms without departing from the spirit and scope of the present disclosure as defined by the claims. Therefore, the description of the present disclosure is intended to be illustrative and does not have any limiting meaning on the present disclosure.

[0068] Software shall be construed broadly to mean instructions, instruction sets, code, code segments, program code, programs, subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executable files, threads of execution, procedures, functions, etc., whether referred to as software, firmware, middleware, microcode, hardware description language, or otherwise.

[0069] Software, instructions, information, etc. may also be transmitted or received over a transmission medium. For example, if software is transmitted from a website, server, or other remote source using wired technologies (such as coaxial cable, fiber optic cable, twisted pair, Digital Subscriber Line (DSL)), and / or wireless technologies (such as infrared, microwave), then these wired and / or wireless technologies are included within the definition of transmission media.

[0070] The information, signals, etc. described in this disclosure may be represented using any of a variety of different technologies. For example, data, instructions, commands, information, signals, bits, symbols, chips, etc. that may be referred to throughout the above description may be represented by voltages, currents, electromagnetic waves, magnetic fields or magnetic particles, optical fields or photons, or any combination thereof.

[0071] In addition, terms explained in this disclosure and terms necessary for understanding this disclosure may be replaced with terms having the same or similar meanings.

[0072] As used in this disclosure, the terms "system" and "network" are used interchangeably.

[0073] Furthermore, the information, parameters, etc. described in this disclosure may be expressed using absolute values, may be expressed using relative values ​​from a predetermined value, or may be expressed using other corresponding information.

[0074] The names used for the above parameters are not limiting in any way, and furthermore, the mathematical formulas etc. using these parameters may differ from those explicitly disclosed in this disclosure.

[0075] As used in this disclosure, the terms "determining" and "determining" may encompass a wide variety of actions. "Determining" and "determining" may include, for example, judging, calculating, computing, processing, deriving, investigating, looking up, searching, inquiring (e.g., searching a table, database, or other data structure), ascertaining, and the like. "Determining" and "determining" may also include receiving (e.g., receiving information), transmitting (e.g., sending information), input, output, accessing (e.g., accessing data in memory), and the like, all of which are considered to be "determining." "Determining" and "determining" may also include resolving, selecting, choosing, establishing, comparing, and the like, all of which are considered to be "determining." In other words, "judgment" and "decision" can include regarding some action as having been "judged" or "decided." Also, "judgment (decision)" can be interpreted as "assuming," "expecting," "considering," etc.

[0076] The terms "connected," "coupled," or any variation thereof, refer to any direct or indirect connection or coupling between two or more elements, and may include the presence of one or more intermediate elements between two elements that are "connected" or "coupled" to each other. The coupling or connection between elements may be physical, logical, or a combination thereof. For example, "connected" may be read as "access." As used in this disclosure, two elements may be considered to be "connected" or "coupled" to each other using one or more wires, cables, and / or printed electrical connections, as well as electromagnetic energy having wavelengths in the radio frequency range, microwave range, and optical (both visible and invisible) range, as some non-limiting and non-exhaustive examples.

[0077] As used in this disclosure, the phrase "based on" does not mean "based only on," unless expressly stated otherwise. In other words, the phrase "based on" means both "based only on" and "based at least on."

[0078] As used in this disclosure, any reference to an element using a designation such as "first," "second," etc. does not generally limit the quantity or order of those elements. These designations may be used in this disclosure as a convenient method of distinguishing between two or more elements. Thus, a reference to a first and a second element does not imply that only two elements may be employed or that the first element must in some way precede the second element.

[0079] The "unit" in the configuration of each of the above devices may be replaced with "means," "circuit," "device," etc.

[0080] When the terms "include," "including," and variations thereof are used in this disclosure, these terms are intended to be inclusive, similar to the term "comprising." Furthermore, when the term "or" is used in this disclosure, it is not intended to be an exclusive or.

[0081] In this disclosure, where articles are added by translation, such as a, an, and the in English, the disclosure may include that the nouns following these articles are in the plural form.

[0082] In the present disclosure, the term "A and B are different" may mean "A and B are different from each other." The term may also mean "A and B are each different from C." Terms such as "separate" and "coupled" may also be interpreted in the same way as "different."

[0083] 10...image display device (device), 11...imaging unit, 12...recognition unit, 13...display unit, 15...display control unit.

Claims

1. A device comprising: an imaging unit that images a user's field of view; a display unit that displays an image corresponding to the field of view imaged by the imaging unit; a recognition unit that recognizes the user's body in the field of view imaged by the imaging unit; and a display control unit that controls a virtual object to be superimposed on the body recognized by the recognition unit, wherein the display control unit hides an image showing the body at the position of the body recognized by the recognition unit.

2. The device according to claim 1, wherein the display control unit displays the image showing the body at a position offset by a fixed distance from the position of the body.

3. The device according to claim 1, wherein the display control unit displays the image showing the body in a position adjacent to the virtual object.

4. The device of claim 1, wherein the virtual object is an input interface.

5. The device according to claim 4, wherein the position of the surface of the virtual object coincides with the position of the surface of the body on which the virtual object is superimposed.

6. The device described in claim 1, wherein the field of view includes a switching area narrower than the field of view, and the display control unit controls the virtual object to be superimposed on the body recognized by the recognition unit when the body is in the switching area.

7. The device according to claim 1, wherein the display control unit changes the type of the virtual object depending on the posture of the body.

8. A method comprising the steps of: capturing an image of a user's field of view; recognizing the user's body in the captured field of view; displaying a virtual object so as to be superimposed on the recognized body; and hiding an image showing the body at the position of the body.

Images