Augmented reality implementation device having function of virtual image output control based on head-part shape detection, and method for head-part shape detection-based virtual image output control of augmented reality implementation device

Abstract

The objective of the present invention is to provide an augmented reality implementation device having a function of virtual image output control based on head-part shape detection, and a method for head-part shape detection-based virtual image output control of an augmented reality implementation device by using same, the device comprising: an optical lens for transmitting, to the pupil of a user, image light that forms a virtual image; a display module for emitting, toward the optical lens, the image light that forms the virtual image; a detection sensor which is disposed to be adjacent to a preset detection area from among respective areas of the head part of the user, and which detects the shape of the detection area so as to generate different sensing values according to the shape of the detection area; a memory for storing a program including one or more instructions; and a processor for executing the one or more instructions of the program stored in the memory, wherein the processor generates first image data representing a first virtual image, receives the sensing values from the detection sensor, determines, on the basis of the sensing values, whether a user operation command is input, generates second image data representing a second virtual image when the user operation command is input, and causes the display module to emit, on the basis of the first image data or the second image data, toward the optical lens, image light that forms the first virtual image or image light that forms the second virtual image.

Description

Augmented reality implementation device having a virtual image output control function based on head shape detection and a virtual image output control method of the augmented reality implementation device based on head shape detection

[0001] The present invention relates to an augmented reality implementation device having a virtual image output control function based on head shape detection, and a method for controlling the virtual image output of an augmented reality implementation device based on head shape detection. More specifically, the invention relates to an augmented reality implementation device and a virtual image output control method configured to detect the shape of a preset detection area among each region of a user's head and to control the virtual image light output operation of a display module according to the shape of the detection area.

[0002] This application claims priority based on Korean Patent Application No. 10-2024-0125058 filed on September 12, 2024, and all contents described in the specification and drawings of said application are incorporated into this application.

[0003] Augmented Reality (AR) refers to a technology that simultaneously provides users with augmented virtual image information from the visual information of the real world by overlaying virtual images provided by a computer, etc., onto actual images of the real world, as is well known.

[0004] Devices that provide augmented reality to users include augmented reality glasses as a representative example, and conventionally, eye tracking methods are mainly used to control the output of virtual images of augmented reality glasses.

[0005] However, in order to control augmented reality glasses through eye tracking, cameras and various sensor devices must be installed in the augmented reality glasses, and consequently, the overall weight of the augmented reality glasses increases excessively, which causes a problem of placing a burden on the user when wearing the augmented reality glasses.

[0006] Furthermore, because cameras and various sensor devices are used, the power consumption of augmented reality glasses increases, and consequently, the battery capacity also increases, which leads to the problem of the weight of the augmented reality glasses increasing further.

[0007] Accordingly, the present invention has been devised from the aforementioned background and aims to provide an augmented reality implementation device and a method for controlling the virtual image output of an augmented reality implementation device, configured to control virtual image output through a simple contact sensor, etc., without using a camera and various sensor devices.

[0008] In addition, the purpose is to provide an augmented reality implementation device configured to detect the shape of a head part through a sensing sensor such as a contact sensor and to enable control of virtual image output based thereon, and a method for controlling the virtual image output of the augmented reality implementation device.

[0009] To achieve this purpose, one embodiment of the present invention comprises: an optical lens configured to transmit image light constituting a virtual image to the user's pupil; a display module configured to emit image light constituting the virtual image toward the optical lens; a sensing sensor configured to be positioned adjacent to a preset sensing area among each region of the user's head, and to detect the shape of the sensing area and generate different sensing values ​​according to the shape of the sensing area; and a memory for storing a program including one or more commands. The present invention provides an augmented reality implementation device having a virtual image output control function based on head shape detection, comprising a processor configured to execute one or more instructions of a program stored in the memory, wherein the processor generates first image data representing a first virtual image, receives a sensing value from the sensing sensor, determines whether a user operation command is input based on the sensing value, and if the user operation command is input, generates second image data representing a second virtual image, and causes the display module to emit an image light constituting the first virtual image or an image light constituting the second virtual image toward the optical lens based on the first image data or the second image data.

[0010] Additionally, a method for controlling the output of a virtual image of an augmented reality implementation device based on head shape detection is provided, wherein the device is configured to transmit image light constituting a virtual image emitted by a display module to the user's pupil through an optical lens, the method comprises generating first image data representing a first virtual image, receiving a sensing value from a sensing sensor configured to be positioned adjacent to a preset sensing area among the regions of the user's head region and to detect the shape of the sensing area and generate different sensing values ​​according to the shape of the sensing area, determining whether a user operation command is input based on the sensing value, and if the user operation command is input, generating second image data representing a second virtual image, and causing the display module to emit image light constituting the first virtual image or image light constituting the second virtual image toward the optical lens based on the first image data or the second image data.

[0011] According to the present invention, by configuring the head shape to be detected through a simple sensing sensor such as a contact sensor and to control the virtual image output of an augmented reality implementation device based thereon, it is possible to control the virtual image output of an augmented reality implementation device without using a camera and various sensors, and accordingly, the configuration of the augmented reality implementation device can be simplified, thereby reducing the weight and power consumption of the augmented reality implementation device.

[0012] However, the effects of the present invention are not limited to the effects mentioned above and may be extended in various ways without departing from the spirit and scope of the present invention.

[0013] FIG. 1 is a drawing showing a user wearing an augmented reality implementation device according to exemplary embodiments.

[0014] FIG. 2 is a perspective view showing the structure of an augmented reality implementation device according to exemplary embodiments.

[0015] FIG. 3 is a block diagram showing the configuration of an augmented reality implementation device according to exemplary embodiments.

[0016] Figure 4 is a perspective view showing the detailed configuration of the optical lens of Figure 3.

[0017] FIG. 5 is a diagram illustrating the principle of transmitting image light constituting a real object image light and a virtual image to a user's eye by an optical lens and a display module according to exemplary embodiments.

[0018] FIG. 6 is a diagram showing a detection area that is the detection target of a detection sensor according to exemplary embodiments.

[0019] FIG. 7 is a diagram showing the arrangement relationship between the sensing sensor and the sensing area when a user wears an augmented reality implementation device according to exemplary embodiments.

[0020] FIG. 8 is a drawing showing a form in which a sensing sensor is mounted on the temple of an augmented reality implementation device according to exemplary embodiments.

[0021] FIG. 9 is a diagram showing the arrangement relationship between the first sensing sensor and the second sensing sensor and the first sensing area and the second sensing area when a user wears an augmented reality implementation device according to exemplary embodiments.

[0022] FIGS. 10 to 12 are drawings illustrating augmented reality screens provided to a user through virtual image output of an augmented reality implementation device according to exemplary embodiments.

[0023] FIGS. 13 and 14 are flowcharts illustrating a method for controlling virtual image output of an augmented reality implementation device based on head shape detection according to exemplary embodiments.

[0024] [Explanation of the symbol]

[0025] 10: Augmented reality implementation device

[0026] 100 : Optical lens

[0027] 200 : Display module

[0028] 300 : Detection sensor

[0029] 400: Communication module

[0030] 500 : Processor

[0031] 600 : Memory

[0032] 700 : Power module

[0033] The terms used in the embodiments of this specification have been selected to be as widely used as possible, taking into account the functions of the present invention; however, these terms may vary depending on the intent of those skilled in the art, case law, the emergence of new technologies, etc. Additionally, in specific cases, terms have been arbitrarily selected by the applicant, and in such cases, their meanings will be described in detail in the description section of the relevant embodiments. Therefore, terms used in this specification should be defined not merely by their names, but based on their meanings and the overall content of the present invention.

[0034] Singular expressions may include plural expressions unless the context clearly indicates otherwise. Terms used herein, including technical or scientific terms, may have the same meaning as generally understood by those skilled in the art as described in this specification.

[0035] In the entire invention, when a part is described as "comprising" a certain component, this means that, unless specifically stated otherwise, it does not exclude other components but may include additional components. Furthermore, terms such as "...part," "...module," etc., as used in this specification refer to a unit that processes at least one function or operation, and this may be implemented in hardware or software, or as a combination of hardware and software.

[0036] As used herein, the expression “configured to” may be replaced, depending on the context, with, for example, “suitable for,” “having the capacity to,” “designed to,” “adapted to,” “made to,” or “capable of.” The term “configured to” may not necessarily mean only “specifically designed to” in hardware. Instead, in some situations, the expression “system configured to” may mean that the system is “capable of” in conjunction with other devices or components. For example, the phrase “processor configured to perform A, B, and C” may mean a dedicated processor for performing the said operations (e.g., an embedded processor), or a generic-purpose processor (e.g., a CPU or an application processor) capable of performing said operations by executing one or more software programs stored in memory.

[0037] In addition, when a component in the present invention is described as being "connected" or "connected" to another component, it should be understood that the component may be directly connected to or directly connected to another component, but unless otherwise specifically stated, it may also be connected or connected through another component in between.

[0038] In the present invention, 'Augmented Reality (AR)' refers to displaying virtual images together within the physical environment space of the real world.

[0039] In addition, the term 'Augmented Reality Implementation Device' refers to a device capable of implementing augmented reality, and generally includes augmented reality glasses in the form of glasses worn by a user on the head, a head-mounted display apparatus (HMD) worn on the head, and an augmented reality helmet worn on the head.

[0040] Meanwhile, a 'real world object' refers to objects that actually exist in the real world; for example, a real world object may be various objects such as electronic devices perceived by the user through an augmented reality implementation device, or parts of the user's body such as a hand.

[0041] Additionally, a 'virtual image' is an image generated through an augmented reality implementation device and may include both static and dynamic images. Such virtual images may be perceived by the user along with real-world objects by the augmented reality implementation device. The virtual image may be an image representing information about real-world objects, control menus for manipulating real-world objects, etc. Additionally, the virtual image may be an image representing information about the operation of the augmented reality implementation device, control menus for the augmented reality implementation device, etc. Furthermore, the virtual image may be an image such as a guide line extending from a real-world object, such as a user's hand. The virtual image may include, for example, at least one selected from characters, numbers, symbols, icons, images, and animations.

[0042] Embodiments of the present invention are described below with reference to the attached drawings so that those skilled in the art can easily implement them. However, the present invention may be embodied in various different forms and is not limited to the embodiments described herein.

[0043] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the attached drawings.

[0044] FIG. 1 is a drawing showing a user wearing an augmented reality implementation device according to exemplary embodiments.

[0045] Referring to FIG. 1, a user can be provided with an augmented reality environment in which a virtual image (VI) is displayed in a real scene containing a real object (RO) through an augmented reality implementation device (10). At this time, the user can control the output of the virtual image (VI) of the augmented reality implementation device (10) by moving specific muscles of the head to change the shape of a pre-set detection area (A) among each area of ​​the head.

[0046] At this time, the pre-set detection area (A) may be the temporal region between the user's eyes and ears among the parts of the user's head. For example, the pre-set detection area (A) may be the temple region among the parts of the user's head.

[0047] The user can contract or stretch the temporalis muscle, which is located in the temporal region between the user's eyes and ears, through actions such as squinting or clenching teeth, and accordingly, the shape of the temporal region between the user's eyes and ears may change.

[0048] The augmented reality implementation device (10) may be configured to detect the shape of a preset detection area (A) and to control the virtual image light output operation of a display module based on the shape of the detection area (A). For example, the augmented reality implementation device (10) may be equipped with a detection sensor (300) capable of detecting the shape of a preset detection area (A) among each area of ​​the user's head.

[0049] At this time, when the augmented reality implementation device (10) is equipped with augmented reality glasses in the form of glasses that can be worn on the user's head, the sensing sensor (300) can be mounted on the temple (arm of the glasses) of the augmented reality glasses. In this way, when the sensing sensor (300) is mounted on the temple of the augmented reality glasses, when the user wears the augmented reality glasses, the sensing sensor (300) can be positioned in the user's temporal region, and the sensing sensor (300) can detect the shape of the user's temporal region. The sensing sensor (300) can be mounted on the inside and / or outside of the temple.

[0050] Meanwhile, the augmented reality implementation device (10) can determine whether a user operation command regarding the output of a virtual image (VI) is input based on the sensing value generated by the sensing sensor (300).

[0051] Additionally, the augmented reality implementation device (10) can change the output state of the virtual image (VI) provided to the user when it is determined that a user operation command has been input. For example, if the virtual image (VI) output by the augmented reality implementation device (10) is a video, the augmented reality implementation device (10) can output a video in a static state when it is determined that a user operation command has been input while outputting a video in a playback state.

[0052] Accordingly, while receiving a video in a playback state from the augmented reality implementation device (10), the user can change the video in a playback state to a stopped state by inputting a user operation command to the augmented reality implementation device (10) by performing actions such as squinting.

[0053] In another example, when the virtual image (VI) output by the augmented reality implementation device (10) is a video, if the augmented reality implementation device (10) determines that a user's operation command has been input while outputting the video in a playback state, it may output a video in a playback state at a time after a preset time from the video playback point, or output a video in a playback state at a time before a preset time from the video playback point.

[0054] Accordingly, while receiving a video in a playback state from the augmented reality implementation device (10), the user can input a user operation command to the augmented reality implementation device (10) by performing actions such as squinting, thereby playing the video from a point in time after a preset time or playing the video from a point in time before a preset time.

[0055] In another example, when the virtual image (VI) output by the augmented reality implementation device (10) is a video, the augmented reality implementation device (10) can adjust the playback speed of the video when it determines that a user's operation command has been entered while outputting the video in a playback state.

[0056] In addition to the examples described above, the user can change the output state of the virtual image (VI) of the augmented reality implementation device (10) in various ways by inputting a user operation command to the augmented reality implementation device (10) by performing actions such as squinting while receiving a video in a playback state from the augmented reality implementation device (10).

[0057] Meanwhile, the augmented reality implementation device (10) may be equipped with a pair of sensing sensors (300) positioned respectively in the right and left regions of the user's head. Each of the pair of sensing sensors (300) may be configured to detect the shape of a pre-set sensing region (A) on the right and left sides of the user's head, respectively.

[0058] The augmented reality implementation device (10) can determine whether a user operation command regarding the output of a virtual image (VI) is input based on the sensing values ​​generated by a pair of sensing sensors (300). At this time, the augmented reality implementation device (10) can determine that different user operation commands are input from the user depending on each sensing value received from the pair of sensing sensors (300).

[0059] Accordingly, the user can input different user operation commands to the augmented reality implementation device (10) by performing actions such as squinting only the right eye, squinting only the left eye, or squinting both eyes.

[0060] As described above, the user can control the virtual image output of the augmented reality implementation device (10) by moving specific muscles of the head to change the shape of the preset detection area (A) among each area of ​​the head.

[0061] FIG. 2 is a perspective view showing the structure of an augmented reality implementation device according to exemplary embodiments.

[0062] In exemplary embodiments, the augmented reality implementing device (10) may be an augmented reality glasses in the form of glasses worn on the user's head. Also, in exemplary embodiments, the augmented reality implementing device (10) may be a head-mounted display apparatus (HMD) or an augmented reality helmet worn on the user's head.

[0063] Referring to FIG. 2, when the augmented reality implementation device (10) is an augmented reality glass in the form of glasses, the augmented reality implementation device (10) may include a frame member (50), an optical lens (100), a display module (200), a sensing sensor (300), a communication module (400), a processor (500), a memory (600), and a power module (700).

[0064] First, the frame member (50) may include a front frame (51) and a temple (53).

[0065] The front frame (51) may be provided in a form that completely surrounds the circumference of the lens, similar to a standard pair of glasses. Additionally, the front frame (51) may be provided in a form that surrounds only a part of the lens.

[0066] The temples (53) may be provided in the form of a pair of eyeglass arms. Additionally, the temples (53) may be rotatably connected to the front frame (51). In this way, the temples (53) may be provided to be foldable relative to the front frame (51) by being rotatably connected to the front frame (51).

[0067] An optical lens (100), a display module (200), a detection sensor (300), a communication module (400), a processor (500), a memory (600), and a power module (700) may be placed on at least one selected from the front frame (51) and the temple (53).

[0068] In exemplary embodiments, at least a portion of the outer edge of the optical lens (100) may be attached to the front frame (51). In exemplary embodiments, only the upper portion of the outer edge of the optical lens (100) may be attached to the front frame (51).

[0069] The optical lens (100) may have a right eye optical lens (100R) and a left eye optical lens (100L), and the right eye optical lens (100R) and the left eye optical lens (100L) may each be configured identically. The right eye optical lens (100R) may be attached to the right side of the front frame (51), and the left eye optical lens (100L) may be attached to the left side of the front frame (51). However, this is exemplary, and the front frame (51) may be configured in two parts to correspond to the left eye optical lens (100L) and the right eye optical lens (100R), respectively. In this case, the augmented reality implementation device (10) may be configured with the right eye optical lens (100R) and the left eye optical lens (100L) each attached to a separate front frame (51).

[0070] In exemplary embodiments, the display module (200) may be placed inside the front frame (51). The display module (200) may be placed on the upper part of the front frame (51) and configured to emit image light that forms a virtual image from the upper to the lower direction of the optical lens (100).

[0071] The display module (200) may have a right eye display module (200R) and a left eye display module (200L), and the right eye display module (200R) and the left eye display module (200L) may each be configured identically. At this time, the right eye display module (200R) may be placed on the right side of the front frame (51), and the left eye display module (200L) may be placed on the left side of the front frame (51).

[0072] In exemplary embodiments, the sensing sensor (300) may be placed on the temple (53). In this case, a portion of the sensing sensor (300) may be placed on the front frame (51).

[0073] The sensing sensor (300) may be positioned on the inner side of the temple (53) so that the sensing portion faces the user's head portion. The sensing sensor (300) may be configured to detect the shape of a preset sensing area (A) among each part of the user's head portion in a contact or non-contact manner.

[0074] The detection sensor (300) may include a first detection sensor (310) positioned in the right area of ​​the user's head and a second detection sensor (320) positioned in the left area of ​​the user's head. The first detection sensor (310) and the second detection sensor (320) may each be provided as the same sensor or as different sensors. In this case, the first detection sensor (310) may be positioned on the right temple (53), and the second detection sensor (320) may be positioned on the left temple (53).

[0075] In exemplary embodiments, the communication module (400), processor (500), memory (600), and power module (700) may be placed in at least one selected from the front frame (51) or the temple (53).

[0076] The detailed configuration and function of the optical lens (100), display module (200), detection sensor (300), communication module (400), processor (500), memory (600), and power module (700) constituting the augmented reality implementation device (10) will be explained with reference to FIG. 3.

[0077] Below, the configuration and functions of the augmented reality implementation device (10) are described in detail.

[0078] FIG. 3 is a block diagram showing the configuration of an augmented reality implementation device according to exemplary embodiments. FIG. 4 is a perspective view showing the detailed configuration of the optical lens of FIG. 3. FIG. 5 is a diagram showing the principle of transmitting image light constituting a real object image light and a virtual image to the user's pupil by the optical lens and display module according to exemplary embodiments. FIG. 6 is a diagram showing the detection area that is the detection target of the detection sensor according to exemplary embodiments. FIG. 7 is a diagram showing the arrangement relationship between the detection sensor and the detection area when a user wears the augmented reality implementation device according to exemplary embodiments. FIG. 8 is a diagram showing the form in which the detection sensor is mounted on the temple of the augmented reality implementation device according to exemplary embodiments. FIG. 9 is a diagram showing the arrangement relationship between the first detection sensor and the second detection sensor and the first detection area and the second detection area when a user wears the augmented reality implementation device according to exemplary embodiments. FIG. 10 to 12 are diagrams showing an augmented reality screen provided to the user through the virtual image output of the augmented reality implementation device according to exemplary embodiments.

[0079] Referring to FIGS. 3 to 12, the augmented reality implementation device (10) may include an optical lens (100), a display module (200), a sensing sensor (300), a communication module (400), a processor (500), a memory (600), and a power module (700). However, the components of the augmented reality implementation device (10) according to the present invention are not limited to those shown in FIG. 3, and may include additional components shown in FIG. 3.

[0080] First, an optical lens (100) is configured to transmit real object image light (RL) emitted from a real object and image light (VL) constituting a virtual image emitted from a display module (200) to the user's pupil (P).

[0081] As shown in FIG. 4, the optical lens (100) may have a shape such as a circle or a rectangle overall, and the optical lens (100) may have a first surface (101) and a second surface (103) arranged to face each other.

[0082] Here, based on the case where the user wears the augmented reality implementation device (10) on the head, the first surface (101) of the optical lens (100) may be a surface positioned on the side of the real object, and the second surface (103) may be a surface positioned on the side of the user's pupil (P).

[0083] Meanwhile, the optical lens (100) may include an optical element (110).

[0084] The optical lens (100) may be made of a transparent glass or plastic material and configured to transmit real object image light (RL) emitted from a real object to the user's pupil (P). Additionally, the optical lens (100) may be configured to transmit image light (VL) constituting a virtual image transmitted from an optical element (110) to the user's pupil (P).

[0085] The optical element (110) can be used without limitation as long as it is a reflective element capable of reflecting image light. For example, the optical element (110) may be a mirror with a reflectivity of 100% that reflects all of the image light, but it may also be provided in the form of a semi-mirror having a transmittance that transmits only some of the image light. In addition, the optical element (110) may be selected as various optical refractive elements or diffractive elements, such as a diffractive optical element or a holographic optical element. The optical element (110) may be composed of at least one combination of a reflective element, a refractive element, and a diffractive element.

[0086] Meanwhile, the optical element (110) may be embedded and disposed inside the optical lens (100). The optical element (110) may be configured to reflect image light (VL) constituting a virtual image emitted from the display module (200) and transmit it to the user's pupil (P).

[0087] Here, the optical element (110) may include a first optical element (111) and a second optical element (113).

[0088] In exemplary embodiments, the first optical element (111) may have a bar shape having a predetermined width and length. In exemplary embodiments, the width of the first optical element (111) may be formed to be 8 mm or less, more preferably 4 mm or less.

[0089] The first optical element (111) can be embedded in the lower part inside the optical lens (100) and arranged along the length direction of the optical lens (100).

[0090] In exemplary embodiments, the first optical element (111) may be positioned such that its reflective surface faces the first surface (101) of the optical lens (100), and the first optical element (111) may be configured to reflect image light (VL) constituting a virtual image incident from the first surface (101) of the optical lens (100) and emit it toward the first surface (101) of the optical lens (100).

[0091] Next, the second optical element (113) may have a bar shape, a circular shape, or an elliptical shape. Additionally, there may be multiple second optical elements (113). Additionally, the second optical element (113) may be formed in the shape of a mirror bar.

[0092] In exemplary embodiments, the size of each of the plurality of second optical elements (113) may be formed to be 8 mm or less, more preferably 4 mm or less. Here, the size of the second optical element (113) may refer to the shortest length between any two points on the edge boundary line of the second optical element (113).

[0093] A plurality of second optical elements (113) may each be embedded and disposed inside the optical lens (100), and a plurality of second optical elements (113) may each be disposed above the first optical element (111), but spaced apart from the first optical element (111) by a predetermined distance. In this case, if the second optical element (113) is formed in the shape of a mirror bar, the second optical element (113) may be disposed along the same length direction as the length direction of the first optical element (111) described above.

[0094] At this time, each of the plurality of second optical elements (113) may be arranged such that a reflective surface faces the second surface (103) of the optical lens (100), and each of the plurality of second optical elements (113) may be configured to reflect image light (VL) constituting a virtual image incident from the first optical element (111) or the first surface (101) of the optical lens (100) and emit it toward the user's pupil (P).

[0095] The process of transmitting the image light (VL) constituting the virtual image emitted from the display module (200) to the user's pupil (P) through the first optical element (111) and the second optical element (113) will be explained in detail with reference to FIG. 5.

[0096] Next, the display module (200) can generate image light (VL) that constitutes a virtual image and can be configured to emit the generated image light toward an optical lens (100).

[0097] In exemplary embodiments, the display module (200) may be positioned on the upper part of the optical lens (100) in a manner such that it is mounted on a holder (not shown) mounted on the upper part of the optical lens (100). Alternatively, the display module (200) may be positioned inside the frame portion (51) in a manner such that it is directly coupled to the frame portion (51) (see FIG. 2).

[0098] For example, the display module (200) may include an LED (Light Emitting Diodes) display device, an OLED (Organic Light Emitting Diodes) display device, and a micro display device.

[0099] The display module (200) can receive image data representing a virtual image from the processor (500), generate image light (VL) that constitutes the virtual image based on the received image data, and emit the generated image light (VL) that constitutes the virtual image toward the optical lens (100).

[0100] In exemplary embodiments, the processor (500) may provide image data including pixel values ​​for a plurality of pixels representing a virtual image to the display module (200), and the display module (200) may generate image light representing a virtual image by controlling a light source according to the pixel value of each of the plurality of pixels.

[0101] A specific method of the display module (200) emitting image light (VL) that forms a virtual image to the optical lens (100) will be explained in detail with reference to FIG. 5.

[0102] As illustrated in FIG. 5, a display module (200) may be positioned on top of an optical lens (100). The display module (200) may emit image light (VL) that forms a virtual image toward a first surface (101) of the optical lens (100). The image light (VL) that forms a virtual image emitted toward the first surface (101) of the optical lens (100) may be totally reflected from the first surface (101) of the optical lens (100) and transmitted to a first optical element (111). At this time, the first optical element (111) may be positioned so as to reflect back toward the first surface (101) of the optical lens (100) the image light (VL) that forms a virtual image and is incident after being totally reflected from the first surface (101) of the optical lens (100). Accordingly, the image light (VL) constituting the virtual image transmitted to the first optical element (111) can be reflected by the first optical element (111) and emitted toward the first surface (101) of the optical lens (100).

[0103] Subsequently, the image light (VL) constituting the virtual image emitted toward the first surface (101) of the optical lens (100) can be totally reflected from the first surface (101) of the optical lens (100) and transmitted to the second optical element (113). At this time, the second optical element (113) can be positioned so as to reflect the image light (VL) constituting the virtual image, which is incident by total reflection from the first surface (101), toward the user's pupil (P). Accordingly, the image light (VL) constituting the virtual image transmitted to the second optical element (113) can be reflected by the second optical element (113) and emitted toward the user's pupil (P). The user can perceive the virtual image through the image light (VL) constituting the virtual image incident on the pupil (P).

[0104] Here, the size of the second optical element (113) can be formed to be 8 mm or less or 4 mm or less, which is smaller than the size of a human pupil. Accordingly, the depth of field of light incident on the user's pupil (P) through the second optical element (113) can be very deep. Accordingly, when the user changes the focal length of the real world while gazing at the real world, a pinhole effect can be generated that causes the virtual image to always be perceived as being in focus regardless of the change in focal length.

[0105] Next, the sensing sensor (300) may be positioned adjacent to a preset sensing area (A) among the areas of the user's head, and may be configured to detect the shape of the preset sensing area (A) and generate different sensing values ​​according to the shape of the sensing area (A).

[0106] First, with reference to FIG. 6, a preset detection area (A) among the areas of the user's head that are the detection targets of the detection sensor (300) will be described.

[0107] Among the regions of the user's head, the pre-set detection region (A) may be the temporal region between the user's eyes and ears. For example, the pre-set detection region (A) may be the temple region among the regions of the user's head.

[0108] The user can contract or stretch the temporalis muscle, etc. located in the temporal region between the user's eyes and ears, through actions such as squinting, clenching teeth, or opening the mouth, and accordingly, the shape of the temporal region between the user's eyes and ears may change.

[0109] Meanwhile, the previously set detection area (A) may include a first detection area (A1) positioned in the right area of ​​the user's head and a second detection area (A2) positioned in the left area of ​​the user's head, and the first detection area (A1) and the second detection area (A2) may each be the temporal area between the user's eyes and ears or the temple area.

[0110] In addition, the pre-set detection area (A) may be the user's eye area. Accordingly, the pre-set detection area (A) may include the user's temporal area and the user's eye area.

[0111] The present invention is characterized by setting the temporal region of the user's head as described above as a detection region (A), and configuring the detection sensor (300) to detect changes in the shape of the temporal region according to the user's muscle movements, and determining whether the user has entered an operation command based on the detected shape of the temporal region.

[0112] At this time, the user's eye area may be included in the detection area (A), and the detection sensor (300) may be configured to detect changes in the shape of the eye area according to the user's eyelid movement, and may be configured to determine whether the user has entered an operation command based on the shape of the detected eye area.

[0113] Next, the detection sensor (300) is positioned adjacent to the previously set detection area (A) described above and is configured to detect the shape of the previously set detection area (A).

[0114] In exemplary embodiments, as illustrated in FIG. 7, the sensing sensor (300) may be mounted on the temple (53) of the aforementioned frame member (50). For example, the sensing sensor (300) may be mounted on the inner side of the temple (53) and positioned adjacent to a pre-set sensing area (A). Additionally, a portion of the sensing sensor (300) may be embedded within the temple (53), and the sensing portion may be positioned so as to be exposed outside the temple (53).

[0115] Alternatively, the detection sensor (300) may be mounted on the front frame (51) of the frame member (50). For example, the detection sensor (300) may be mounted on the front frame (51) of the frame member (50) and positioned adjacent to the eye area among the preset detection areas (A) to detect changes in the shape of the eye area.

[0116] That is, if the preset detection area (A) includes the user's temporal region and the user's eye region, the detection sensor (300) may include a detection sensor (300) positioned adjacent to the user's temporal region within the preset detection area (A) to detect the shape of the user's temporal region, and a detection sensor (300) positioned adjacent to the user's eye region within the preset detection area (A) to detect the shape of the user's eye region.

[0117] Here, since the temple (53) of the frame member (50) is a component basically provided in the glass-type augmented reality device, when the detection sensor (300) is mounted on the temple (53) in this way, a separate member for installing the detection sensor (300) is not required. In addition, since the temple (53) is positioned adjacent to the user's temporal region when the user wears the augmented reality implementation device (10), when the detection sensor (300) is mounted on the temple (53), it can be positioned adjacent to the user's temporal region, which is a pre-set detection area (A).

[0118] In exemplary embodiments, as shown in FIG. 8, the temple (53) is provided with a sensor mounting portion (53a), and a sensing sensor (300) can be coupled to the sensor mounting portion (53a).

[0119] At this time, the detection sensor (300) may be configured to move in the thickness direction of the temple (53). By configuring the detection sensor (300) to move in the thickness direction of the temple (53) in this manner, the detection sensor (300) may move closer to a pre-set detection area (A) or move away from a pre-set detection area (A).

[0120] For example, as shown in FIG. 8, the sensing sensor (300) may be configured to move in the thickness direction of the temple (53) by means of the sensor mounting portion (53a).

[0121] Specifically, the sensor mounting portion (53a) may include a seating portion (53a-1), a screw (53a-2), and an adjustment portion (53a-3).

[0122] First, the mounting portion (53a-1) is formed to allow the detection sensor (300) to be coupled thereto, and the mounting portion (53a-1) may be formed so that the detection sensor (300) can be detached therefrom. For example, the mounting portion (53a-1) may be formed to allow the detection sensor (300) to be coupled by means of a press-fit method, a locking method, etc. Accordingly, the detection sensor (300) may be provided to be coupled to or detached from the mounting portion (53a-1).

[0123] Additionally, the mounting portion (53a-1) may be formed to allow the sensing sensor (300) to move along the longitudinal direction of the temple (53). For example, the mounting portion (53a-1) may allow the sensing sensor (300) to be slidably coupled.

[0124] In this way, the sensing sensor (300) is configured to move along the longitudinal direction of the temple (53) while coupled to the mounting portion (53-1a), thereby allowing the position of the sensing sensor (300) to be changed according to the shape of the user's head.

[0125] Next, the screw (53a-2) may be provided to be coupled to the seating portion (53a-1) to move the seating portion (53a-1) by rotation in one direction or the opposite direction. For example, a screw coupling portion (53a-11) in the form of a female screw corresponding to the thread shape of the screw (53a-2) may be formed in the seating portion (53a-1). At this time, the seating portion (53a-1) may be coupled to the inside of the temple (53) so as to be slidably movable within the temple (53) without rotating together with the screw (53a-2). Accordingly, the seating portion (53a-1) may be provided to be pulled out from the inside of the temple (53) or pulled into the inside of the temple (53) as the screw (53a-2) rotates in one direction or the opposite direction while the screw (53a-2) is screw-coupled to the screw coupling portion (53a-11).

[0126] Additionally, an adjustment part (53a-3) may be provided at the end of the screw (53a-2). For example, the adjustment part (53a-3) may be formed in the shape of a disc so that the user can rotate it.

[0127] The user can rotate the screw (53a-2) by rotating the adjustment part (53a-3), and as the screw (53a-2) rotates, the mounting part (53a-1) screw-coupled to the screw (53a-2) can be moved.

[0128] Here, when the adjustment part (53a-3) is rotated in one direction, the seating part (53a-1) moves in a direction that moves closer to the user's head, and when the adjustment part (53a-3) is rotated in the opposite direction, the seating part (53a-1) can be formed to move away from the user's head.

[0129] In this way, by forming the mounting portion (53a-1) so that it can be moved by the operation of the control portion (53a-3), the sensing sensor (300) mounted on the mounting portion (53a-1) can also be formed to move in a direction closer to the user's head or in a direction further away from the user's head by the operation of the control portion (53a-3).

[0130] Since the size of the head part varies for each user, the detection sensor (300) can be moved by operating the adjustment part (53a-3) as described above, thereby allowing the detection sensor (300) to be appropriately positioned according to the size of the head part for each user.

[0131] Meanwhile, the sensing sensor (300) may be provided as a contact type sensor or a non-contact type sensor and may be provided to generate different sensing values ​​depending on the shape of the sensing area (A).

[0132] For example, the sensing sensor (300) may be provided as a pressure sensor that is positioned to contact the sensing area (A) and is configured to generate a sensing value corresponding to the pressure applied according to the shape of the sensing area (A).

[0133] As mentioned above, the temporal region between the user's eyes and ears can change shape due to actions such as the user squinting or clenching their teeth.

[0134] In the case where the sensing sensor (300) is equipped as a pressure sensor, when the shape of the temporal region changes due to the user's actions such as squinting or clenching teeth, the pressure applied to the sensing sensor (300) varies depending on the shape of the temporal region, so the sensing value generated by the sensing sensor (300) can also vary.

[0135] As another example, the sensing sensor (300) may be provided as a capacitive touch sensor that is positioned to contact the sensing area (A) and is configured to generate a sensing value corresponding to the amount of change in electromotive force according to the shape of the sensing area (A).

[0136] In the case where the sensing sensor (300) is equipped as a capacitive touch sensor, when the shape of the temporal region changes due to actions such as squinting or clenching teeth, the area of ​​the temporal region that contacts the sensing sensor (300) or the shape of the temporal region that contacts the sensing sensor (300) is different, and accordingly, the amount of change in the electromotive force of the sensing sensor (300) is also different, so the sensing value generated by the sensing sensor (300) can also be different.

[0137] As another example, the sensing sensor (300) may be provided as a distance sensor that is positioned so as not to contact the sensing area (A) and is configured to generate a sensing value corresponding to the distance between the sensing area (A) and the sensing sensor (300) according to the shape of the sensing area (A). For example, the sensing sensor (300) may be provided as a laser distance sensor, an ultrasonic distance sensor, etc.

[0138] In the case where the sensing sensor (300) is equipped as a distance sensor, when the shape of the temporal region changes due to actions such as the user squinting or clenching their teeth, the distance between the sensing part of the sensing sensor (300) and the user's temporal region varies, so the sensing value generated by the sensing sensor (300) may also vary.

[0139] As another example, the sensing sensor (300) may be provided as an image sensor or an infrared sensor that is positioned to be non-contact with the sensing area (A) and is configured to generate a sensing value according to the shape of the sensing area (A). Accordingly, the sensing sensor (300) may be configured to detect the movement of the eyelid in the eye area among the preset sensing areas (A) and generate different sensing values ​​according to the shape of the eye area.

[0140] As described above, the sensing sensor (300) may be provided as a contact type sensor or a non-contact type sensor and may be provided to generate different sensing values ​​depending on the shape of the sensing area (A). The sensing value generated by the sensing sensor (300) may be transmitted to a processor (500) described later, and the processor (500) may determine whether a user operation command is input based on the transmitted sensing value.

[0141] Meanwhile, as illustrated in FIG. 9, the sensing sensor (300) may include a first sensing sensor (310) placed in the right area of ​​the user's head and a second sensing sensor (320) placed in the left area of ​​the user's head.

[0142] The first sensing sensor (310) may be mounted on the right temple (53) of a pair of temples (53) and positioned adjacent to the first sensing area (A1) located in the right area of ​​the user's head. Additionally, the first sensing sensor (310) may be configured to detect the shape of the first sensing area (A1) and generate different first sensing values ​​according to the shape of the first sensing area (A1). As described above, the first sensing sensor (310) may be configured as a contact-type sensor or a non-contact-type sensor capable of detecting the shape of the first sensing area (A1).

[0143] The second sensing sensor (320) may be mounted on the left temple (53) of a pair of temples (53) and positioned adjacent to the second sensing area (A2) located in the right area of ​​the user's head. Additionally, the second sensing sensor (320) may be configured to detect the shape of the second sensing area (A2) and generate different second sensing values ​​depending on the shape of the second sensing area (A2). Similar to the first sensing sensor (310), the second sensing sensor (320) may be configured as a contact-type sensor or a non-contact-type sensor capable of detecting the shape of the second sensing area (A2).

[0144] Meanwhile, the first sensing value generated by the first sensing sensor (310) and the second sensing value generated by the second sensing sensor (320) can each be transmitted to the processor (500), and the processor (500) can determine whether a user operation command is input based on the transmitted first sensing value and second sensing value.

[0145] Meanwhile, if the first detection area (A1) that has been set includes the user's right temporal area and the user's right eye area, the first detection sensor (310) may include a first detection sensor (310) positioned adjacent to the user's right temporal area and a first detection sensor (310) positioned adjacent to the user's right eye area.

[0146] Additionally, if the previously set second detection area (A2) includes the user's left temporal area and the user's left eye area, the second detection sensor (320) may include a second detection sensor (320) positioned adjacent to the user's left temporal area and a second detection sensor (320) positioned adjacent to the user's left eye area.

[0147] Next, the communication module (400) can support the establishment of a wired or wireless communication channel between the augmented reality implementation device (10) and an external electronic device, and the performance of reception through the established communication channel.

[0148] In exemplary embodiments, the communication module (400) may be configured to communicate with the user terminal (20) in a wired or wireless manner.

[0149] The communication module (400) can receive predetermined content data from a user terminal (20) and transmit the received content data to a processor (500). Additionally, the communication module (400) can be configured to receive a user operation command from the processor (500) and transmit the received user operation command to the user terminal (20).

[0150] In exemplary embodiments, the communication module (400) may include a wireless communication module or a wired communication module. The communication module (400) may communicate with an external electronic device through at least one network using the wireless communication module or the wired communication module. For example, the wireless communication module may include a cellular communication module, a short-range wireless communication module, or a GNSS (global navigation satellite system) communication module. The wired communication module may include a LAN (local area network) communication module or a power line communication module.

[0151] Next, the processor (500) can execute one or more instructions or program code stored in memory (600) and can perform functions or operations corresponding to the instructions or program code.

[0152] The processor (500) may be electrically or physically connected to the display module (200), the detection sensor (300), and the communication module (400). The processor (500) may control the overall operation of the display module (200), the detection sensor (300), and the communication module (400) by executing one or more instructions or program code stored in the memory (600).

[0153] A processor (500) may refer to a data processing device embedded in hardware having a physically structured circuit to perform a function expressed by instructions or program code. For example, the processor (500) may include, but is not limited to, a Central Processing Unit, a microprocessor, a Graphic Processing Unit, an Application Processor (AP), Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), and Field Programmable Gate Arrays (FPGAs).

[0154] Although FIG. 3 illustrates the processor (500) as being composed of a single device, it is not limited thereto. In exemplary embodiments, the processor (500) may be composed of one or more multiple devices.

[0155] Next, the memory (600) may store instructions and program code that can be read by the processor (500). For example, the memory (600) may include a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), RAM (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), Mask ROM, Flash ROM, etc.), a hard disk drive (HDD), or a solid-state drive (SSD).

[0156] Instructions or program code stored in memory (600) can be implemented in a programming or scripting language such as C, C++, Java, assembler, etc.

[0157] The memory (600) may store at least one software module containing instructions or program code. Each software module is executed by the processor (500) to enable the augmented reality implementation device (10) to perform a predetermined operation or function.

[0158] In exemplary embodiments, the memory (600) may store an image data generation module (610), an operation command input determination module (620), and a user setting module (630), but is not limited thereto, and may store some of these or additionally store other software modules.

[0159] As described above, the processor (500) can implement the following embodiments by executing software modules stored in memory (600).

[0160] First, the processor (500) can execute an image data generation module (610) stored in memory (600), and the processor (500) can generate image data representing various forms of virtual images (VI) by executing instructions or program code included in the image data generation module (610).

[0161] The image data generation module (610) may include instructions or program code regarding an algorithm for generating image data that includes pixel values ​​for multiple pixels. The processor (500) may execute the instructions or program code included in the image data generation module (610) and generate image data that represents various forms of virtual images (VI).

[0162] According to exemplary embodiments, the processor (500) can generate image data representing a virtual image (VI) that is a video. Additionally, the processor (500) can generate image data representing a virtual image (VI) that is a still image, such as a photograph.

[0163] Meanwhile, the processor (500) can generate first image data representing a first virtual image (VI-1), and when it is determined by the operation command input determination module (620) described later that a user operation command has been input, it can generate second image data representing a second virtual image (VI-2).

[0164] The processor (500) can generate image data representing a virtual image (VI) that is a video, and the processor (500) can generate first image data and second image data representing a first virtual image (VI-1) and a second virtual image (VI-2) that are videos in different states, respectively, according to the input of a user operation command.

[0165] In exemplary embodiments, the processor (500) may generate first image data representing a first virtual image (VI-1) which is a video in a playback state, and generate second image data representing a second virtual image (VI-2) which is a video in a still state. Accordingly, the first virtual image (VI-1) represented by the first image data may be a video in a playback state, and the second virtual image (VI-2) represented by the second image data may be a video in a still state.

[0166] At this time, the processor (500) can generate first image data representing a first virtual image (VI-1) which is a video in a playback state, and when it is determined that a user operation command has been input, it can generate second image data representing a second virtual image (VI-2) which is a video in a still state.

[0167] Accordingly, as illustrated in FIG. 10, when the first virtual image (VI-1), which is a video in a playback state, is being displayed to the user, if the user inputs an operation command, the second virtual image (VI-2), which is a video in a still state, can be displayed to the user.

[0168] Additionally, the processor (500) may generate first image data representing a first virtual image (VI-1) which is a video in a still state, and second image data representing a second virtual image (VI-2) which is a video in a playback state. Accordingly, the first virtual image (VI-1) represented by the first image data may be a video in a still state, and the second virtual image (VI-2) represented by the second image data may be a video in a playback state.

[0169] At this time, the processor (500) may generate second image data representing a second virtual image (VI-2) representing a video in a playback state when it is determined that a user operation command has been input while generating first image data representing a first virtual image (VI-1) representing a video in a static state.

[0170] The processor (500) can transmit the generated first image data or second image data to the display module (200), and the display module (200) can emit image light constituting the first virtual image (VI-1) or image light constituting the second virtual image (VI-2) toward the optical lens (100) based on the first image data or second image data received from the processor (500). Here, the image light constituting the first virtual image (VI-1) or image light constituting the second virtual image (VI-2) emitted toward the optical lens (100) can be transmitted to the user through the optical lens (100).

[0171] As described above, the user can input a user operation command by changing the shape of a preset detection area (A) through an action such as squinting, while receiving a first virtual image (VI-1), which is a video in a playback state represented by the first image data through the optical lens (100), and when the user operation command is input, the user can receive a second virtual image (VI-2), which is a video in a still state.

[0172] Additionally, while the user is receiving a first virtual image (VI-1), which is a still image expressed by the first image data through the optical lens (100), the user can input a user operation command by changing the shape of a preset detection area (A) through actions such as squinting, and when the user operation command is input, the user can receive a second virtual image (VI-2), which is a video in a playback state.

[0173] That is, the user can change the shape of the pre-set detection area (A) by changing the shape of the detection area (A) through actions such as squinting, and input user operation commands, thereby changing the video in a playback state provided through the optical lens (100) to a stopped state or changing the video in a stopped state to a playback state.

[0174] As another example, the processor (500) may generate first image data representing a first virtual image (VI-1) which is a video in a playback state, and generate second image data representing a second virtual image (VI-2) which is a video in a playback state at a time after a preset time from the playback time of the first virtual image (VI-1). Accordingly, the first virtual image (VI-1) represented by the first image data is a video in a playback state, and the second virtual image (VI-2) represented by the second image data may be a video in a playback state at a time after a preset time from the playback time of the first virtual image (VI-1).

[0175] At this time, when the processor (500) is generating first image data representing a first virtual image (VI-1) which is a video in a playback state, if it is determined that a user operation command has been entered, it can generate second image data representing a second virtual image (VI-2) which is a video in a playback state at a time after a preset time from the playback time of the first virtual image (VI-1).

[0176] Accordingly, as illustrated in FIG. 11, when a first virtual image (VI-1), which is a video in a playback state, is being displayed to the user, if the user inputs an operation command, a second virtual image (VI-2), which is a video in a playback state at a time after a preset time from the playback start time of the first virtual image (VI-1), can be displayed to the user. The operation command may be input by squinting the eyes multiple times, squinting the eyes for a preset time or longer, or selectively squinting the left or right eye.

[0177] Additionally, the processor (500) may generate first image data representing a first virtual image (VI-1) which is a video in a playback state, and generate second image data representing a second virtual image (VI-2) which is a video in a playback state at a time prior to a preset time from the playback time of the first virtual image (VI-1). Accordingly, the first virtual image (VI-1) represented by the first image data is a video in a playback state, and the second virtual image (VI-2) represented by the second image data may be a video in a playback state at a time prior to a preset time from the playback time of the first virtual image (VI-1).

[0178] At this time, when the processor (500) is generating first image data representing a first virtual image (VI-1) which is a video in a playback state, if it is determined that a user operation command has been entered, it can generate second image data representing a second virtual image (VI-2) which is a video in a playback state at a time prior to a preset time from the playback time of the first virtual image (VI-1).

[0179] As described above, the user can input a user operation command by changing the shape of a preset detection area (A) through an action such as squinting, while receiving a first virtual image (VI-1), which is a video of a playback state expressed by the first image data through the optical lens (100). When a user operation command is input, the user can receive a second virtual image (VI-2), which is a video of a playback state at a time after a preset time from the playback point of the first virtual image (VI-1).

[0180] Additionally, while the user is receiving a first virtual image (VI-1), which is a video of a playback state represented by the first image data through the optical lens (100), the user can input a user operation command by changing the shape of a preset detection area (A) through actions such as squinting, and when a user operation command is input, the user can receive a second virtual image (VI-2), which is a video of a playback state at a preset time earlier than the playback time of the first virtual image (VI-1).

[0181] That is, by changing the shape of the preset detection area (A) through actions such as squinting, the user can input a user operation command, thereby causing the video in the playback state provided through the optical lens (100) to be played from a point in time after the preset time or from a point in time before the preset time.

[0182] As another example, the processor (500) may generate first image data representing a first virtual image (VI-1) which is a video in a constant speed playback state, and generate second image data representing a second virtual image (VI-2) which is a video in a multi-speed playback state. Accordingly, the first virtual image (VI-1) represented by the first image data may be a video in a constant speed playback state, and the second virtual image (VI-2) represented by the second image data may be a video in a multi-speed playback state.

[0183] Here, the processor (600) can generate second image data representing a second virtual image (VI-2) which is a video in an N-speed playback state. In this case, N may be a positive number greater than 1. Additionally, the processor (600) can generate second image data representing a second virtual image (VI-2) which is a video in an M-speed playback state. In this case, M may be a positive number less than 1.

[0184] That is, the processor (600) can generate second image data representing a second virtual image (VI-2) that is a video in a fast playback state, or generate second image data representing a second virtual image (VI-2) that is a video in a slow playback state. Accordingly, the second virtual image (VI-2) represented by the second image data may be either a video in a fast playback state or a video in a slow playback state.

[0185] At this time, the processor (500) may generate first image data representing a first virtual image (VI-1) which is a video in a constant speed playback state, and when it is determined that a user operation command has been input, generate second image data representing a second virtual image (VI-2) which is a video in a multi-speed playback state.

[0186] Accordingly, as shown in FIG. 12, when a first virtual image (VI-1), which is a video in a constant speed playback state, is being displayed to the user, if the user inputs an operation command, a second virtual image (VI-2), which is a video in a multi-speed playback state, can be displayed to the user.

[0187] As described above, the user can input a user operation command by changing the shape of a preset detection area (A) through an action such as squinting, while receiving a first virtual image (VI-1), which is a video in a constant speed playback state represented by the first image data through the optical lens (100), and when the user operation command is input, the user can receive a second virtual image (VI-2), which is a video in a multi-speed playback state.

[0188] That is, the user can change the shape of the pre-set detection area (A) by changing the shape of the detection area (A) through actions such as squinting, and input a user operation command, thereby changing the video in a constant speed playback state provided through the optical lens (100) to a speed playback state.

[0189] As described above, the user can change the output state of the virtual image (VI), which is a video provided through the optical lens (100), by changing the shape of the pre-set detection area (A) through actions such as squinting, and inputting user operation commands.

[0190] Meanwhile, although the above description has focused on the case where the processor (500) generates image data representing a virtual image (VI) that is a video, the processor (500) can generate image data representing a virtual image (VI) that is a still image, and the processor (600) can generate first image data and second image data representing different still images, such as a first virtual image (VI-1) and a second virtual image (VI-2), respectively, according to the input of a user operation command.

[0191] Meanwhile, the processor (500) can receive content data received by the communication module (400) from the user terminal (20). At this time, the processor (500) can generate image data representing a virtual image (VI) based on the content data received from the communication module (400).

[0192] For example, the processor (500) can generate image data that represents a virtual image (VI) identical to the content being output to the user terminal (20). Accordingly, the content being output from the user terminal (20) can be configured to be synchronized and output to the augmented reality implementation device (10).

[0193] At this time, the user can change the shape of the pre-set detection area (A) by making movements such as squinting, thereby inputting a user operation command, and thus change the output state of the content output synchronized with the user terminal (20), and the content with the changed output state can also be output synchronized with the user terminal (20).

[0194] Next, the processor (500) can execute an operation input determination module (620) stored in memory (600), and the processor (500) can receive a sensing value from the detection sensor (300) by executing instructions or program code included in the operation command input determination module (620), and determine whether a user operation command is input based on the received sensing value.

[0195] In exemplary embodiments, the processor (500) may determine that a user operation command has been entered if the sensing value received from the sensing sensor (300) corresponds to a preset operation reference value.

[0196] For example, the processor (500) can determine that a user operation command has been entered if the sensing value received from the sensing sensor (300) corresponds to a value within a preset operation reference value range.

[0197] As described above, the sensing sensor (300) may be provided as a contact type sensor or a non-contact type sensor and may be provided to generate different sensing values ​​according to the shape of a preset sensing area (A). For example, the sensing value generated corresponding to the shape of the sensing area (A) when the user performs a normal eye-blinking motion and the sensing value generated corresponding to the shape of the sensing area (A) when the user performs a squinting motion with the intention of inputting a user operation command may be different from each other.

[0198] At this time, depending on the setting of the operation reference value, the sensing value generated in correspondence with the shape of the detection area (A) when the user performs the action of blinking their eyes as usual may not correspond to a value within the pre-set operation reference value range, and in such a case, the processor (500) may determine that the user operation command has not been input.

[0199] In contrast, when a user squints their eyes with the intention of inputting a user operation command, the sensing value generated in response to the shape of the detection area (A) may correspond to a value within a pre-set operation reference value range, and in such cases, the processor (500) may determine that a user operation command has been input.

[0200] Accordingly, even if the shape of the detection area (A) changes due to the user blinking their eyes normally, it may be determined that no user operation command has been entered, and conversely, if the shape of the detection area (A) changes due to the user squinting their eyes with the intention of entering a user operation command, it may be determined that a user operation command has been entered.

[0201] Meanwhile, the operation reference values ​​may be set to multiple values, and the processor (500) determines that a user operation command has been input when the sensing value corresponds to any one of the multiple operation reference values, and may determine that different user operation commands have been input depending on which of the multiple previously set operation reference values ​​the sensing value corresponds to.

[0202] For example, the operation reference value may be set to a plurality of values ​​including a first operation reference value and a second operation reference value different from the first operation reference value, and the processor (500) may determine that a first user operation command has been input when the sensing value input from the sensing sensor (300) corresponds to the first operation reference value, and determine that a second user operation command different from the first user operation command has been input when the sensing value input from the sensing sensor (300) corresponds to the second operation reference value.

[0203] As described above, the sensing sensor (300) may be provided as a contact type sensor or a non-contact type sensor and may be provided to generate different sensing values ​​according to the shape of a preset sensing area (A). For example, the sensing value generated in response to the shape of the sensing area (A) when a user squints their eyes with the intention of inputting a user operation command and the sensing value generated in response to the shape of the sensing area (A) when a user clenches their teeth with the intention of inputting a user operation command may be different from each other.

[0204] At this time, when a user takes different actions to change the shape of the detection area (A) with the intention of inputting a user operation command, the processor (500) can determine that different user operation commands are input by the user according to the setting of each of the multiple operation reference values.

[0205] For example, depending on the setting of each of the multiple operation reference values, the sensing value generated in correspondence with the shape of the detection area (A) when the user takes a squinting motion with the intention of inputting a user operation command may correspond to a value within the range of the first operation reference value set in advance, and in such a case, the processor (500) may determine that the first user operation command has been input.

[0206] Additionally, the sensing value generated in correspondence with the shape of the detection area (A) when the user performs the action of clenching teeth with the intention of inputting a user operation command may correspond to a value within the range of the second operation reference value set in advance, and in such a case, the processor (500) may determine that the second user operation command has been input.

[0207] Accordingly, the user can input various user operation commands to the augmented reality implementation device (10) by taking different actions with the intention of inputting user operation commands.

[0208] Meanwhile, as described above, if the pre-set detection area (A) includes the user's temporal region and the user's eye region, the processor (500) can determine that a user operation command has been input if the sensing value received from the detection sensor (300) positioned adjacent to the user's temporal region and detecting the shape of the user's temporal region corresponds to a pre-set operation reference value, and the sensing value received from the detection sensor (300) positioned adjacent to the user's eye region and detecting the shape of the user's eye region corresponds to a pre-set operation reference value.

[0209] For example, even if the user did not intend to input a user operation command, a sensing value corresponding to a preset operation reference value may be input from a sensing sensor (300) positioned adjacent to the user's temporal region and detecting the shape of the user's temporal region. Therefore, the processor (500) may determine that a user operation command has been input only when the sensing value received from the sensing sensor (300) positioned adjacent to the user's temporal region and detecting the shape of the user's temporal region corresponds to a preset operation reference value, even if a sensing value corresponding to a preset operation reference value is input from the sensing sensor (300) positioned adjacent to the user's eye region and detecting the shape of the user's eye region.

[0210] Next, the processor (500) can determine that a user operation command has been entered if the time at which a sensing value corresponding to a preset operation reference value is entered corresponds to the preset operation command input time.

[0211] For example, the processor (500) can determine that a user operation command has been entered if the time at which a sensing value corresponding to a preset operation reference value is entered corresponds to a time within a preset operation command input time range.

[0212] At this time, the processor (500) can determine that a user operation command has been entered if the sensing value received from the sensing sensor (300) corresponds to a preset operation reference value, and the time at which the sensing value corresponding to the preset operation reference value is entered corresponds to a preset operation command input time.

[0213] For example, the processor (500) can determine that a user operation command has been entered if the sensing value received from the sensing sensor (300) corresponds to a value within a preset operation reference value range, and the time at which the sensing value corresponding to the preset operation reference value is entered corresponds to a time within a preset operation command input time range.

[0214] That is, the processor (500) may not determine that a user operation command has been input even if the sensing value received from the sensing sensor (300) corresponds to a value within a preset operation reference value range, if the time at which the sensing value corresponding to the preset operation reference value is input does not correspond to a time within a preset operation command input time range.

[0215] Meanwhile, the processor (500) can determine that different user operation commands have been input depending on the time at which a sensing value corresponding to a preset operation reference value is input.

[0216] In exemplary embodiments, the operation command input time may be set to multiple times, and the processor (500) determines that a user operation command has been input when the time at which a sensing value corresponding to a preset operation reference value is input corresponds to any one of the multiple operation command input times, and among the multiple preset operation command input times, it may determine that different user operation commands have been input according to any one of the operation command input times at which the time at which a sensing value corresponding to a preset operation reference value is input corresponds.

[0217] For example, the operation command input time may be set to a plurality of times, including a first operation command input time and a second operation command input time different from the first operation command input time, and the processor (500) may determine that a first user operation command has been input if the time at which a sensing value corresponding to a preset operation reference value is input corresponds to the first operation command input time, and determine that a second user operation command has been input if the time at which a sensing value corresponding to a preset operation reference value is input corresponds to the second operation command input time.

[0218] The user may take different times to perform an action that changes the shape of a pre-set detection area (A) with the intention of inputting a user operation command, and in such cases, the processor (500) may determine that different user operation commands are input by the user according to the setting of each of the multiple operation command input times.

[0219] For example, depending on the setting of each of the multiple operation command input times, if the time during which the user squints their eyes with the intention of inputting a user operation command is maintained as the first time, the first time may correspond to a value within the pre-set first operation command input time range, and in such a case, the processor (500) may determine that the first user operation command has been input.

[0220] Additionally, if the time during which the user squints their eyes with the intention of inputting a user operation command is maintained as the second time, the second time may correspond to a value within the pre-set range of the second operation command input time, and in such a case, the processor (500) may determine that the second user operation command has been input.

[0221] Accordingly, the user can input various user operation commands to the augmented reality implementation device (10) by performing actions intended to input user operation commands at different times.

[0222] Meanwhile, the operation reference value and the operation command input time can each be set to multiple values, and the processor (500) can determine that different user operation commands have been input according to the operation reference value corresponding to the sensing value input from the detection sensor (300) and the time at which the sensing value corresponding to the operation reference value is input.

[0223] For example, the operation reference values ​​may be set to a plurality of values ​​including a first operation reference value and a second operation reference value different from the first operation reference value, and the operation command input time may be set to a plurality of values ​​including a first operation command input time and a second operation command input time different from the first operation command input time.

[0224] At this time, the processor (500) can determine that a first user operation command has been entered if the sensing value input from the sensing sensor (300) corresponds to a first operation reference value, and the time at which the sensing value corresponding to the first operation reference value is input corresponds to the time at which a first operation command is input.

[0225] Additionally, the processor (500) can determine that a second user operation command has been input if the sensing value input from the sensing sensor (300) corresponds to a first operation reference value, and the time at which the sensing value corresponding to the first operation reference value is input corresponds to a second operation command input time.

[0226] Additionally, the processor (500) can determine that a third user operation command has been input if the sensing value input from the sensing sensor (300) corresponds to a second operation reference value, and the time at which the sensing value corresponding to the second operation reference value is input corresponds to the time at which the first operation command is input.

[0227] Additionally, the processor (500) can determine that a fourth user operation command has been entered if the sensing value input from the sensing sensor (300) corresponds to a second operation reference value, and the time at which the sensing value corresponding to the second operation reference value is input corresponds to the time at which the second operation command is input.

[0228] Accordingly, the user can input various user operation commands to the augmented reality implementation device (10) by performing different actions with the intention of inputting user operation commands and performing the corresponding actions for different periods of time for each action.

[0229] Next, as described above, the detection sensor (300) may include a first detection sensor (310) and a second detection sensor (320).

[0230] Specifically, the first sensing sensor (310) may be positioned adjacent to a first sensing area (A1) located in the right area of ​​the user's head, and may be configured to detect the shape of the first sensing area (A1) and generate different first sensing values ​​according to the shape of the first sensing area (A1).

[0231] Additionally, the second sensing sensor (320) may be positioned adjacent to the second sensing area (A2) located in the left area of ​​the user's head, and may be configured to detect the shape of the second sensing area (A2) and generate different second sensing values ​​according to the shape of the second sensing area (A2).

[0232] Here, the processor (500) receives a first sensing value and a second sensing value from each of the first sensing sensor (310) and the second sensing sensor (320), and can determine whether a user operation command is input based on the first sensing value and the second sensing value.

[0233] In exemplary embodiments, the processor (500) may determine that a first user operation command has been input when the first sensing value received from the first sensing sensor (310) corresponds to a first operation reference value that has been pre-set.

[0234] Additionally, the processor (500) can determine that a second user operation command has been input if the second sensing value received from the second sensing sensor (320) corresponds to a pre-set second operation reference value.

[0235] Additionally, the processor (500) can determine that a third user operation command has been input if the first sensing value received from the first sensing sensor (310) corresponds to a pre-set third-1 operation reference value, and the second sensing value received from the second sensing sensor (320) corresponds to a pre-set third-2 operation reference value.

[0236] At this time, the processor (500) determines the first user operation command, the second user operation command, and the third user operation command as different user operation commands, and for each of the first user operation command, the second user operation command, and the third user operation command, it can generate different second image data through the aforementioned image data generation module (610).

[0237] For example, when the processor (500) is generating first image data representing a first virtual image (VI-1) which is a video in a playback state, and it is determined that a first user operation command has been entered, it may generate second image data representing a second virtual image (VI-2) which is a video in a playback state at a time after a preset time from the playback time of the first virtual image (VI-1).

[0238] Additionally, when the processor (500) is generating first image data representing a first virtual image (VI-1) which is a video in a playback state, if it is determined that a second user operation command has been input, it can generate second image data representing a second virtual image (VI-2) which is a video in a playback state at a time prior to a preset time from the playback time of the first virtual image (VI-1).

[0239] In another example, the processor (500) may generate first image data representing a first virtual image (VI-1) which is a video in a constant speed playback state, and when it is determined that a first user operation command has been input, generate second image data representing a second virtual image (VI-2) which is a video in an N-speed playback state (wherein N is a positive number greater than 1).

[0240] Additionally, when the processor (500) is generating first image data representing a first virtual image (VI-1) which is a video in a dependent playback state, if it is determined that a second user operation command has been input, it may generate second image data representing a second virtual image (VI-2) which is a video in an M-speed playback state (wherein M is a positive number less than 1).

[0241] Additionally, when the processor (500) is generating first image data representing a first virtual image (VI-1) which is a video in a playback state, if it is determined that a third user operation command has been input, it can generate second image data representing a second virtual image (VI-2) which is a video in a still state.

[0242] Accordingly, the user can input various user operation commands to the augmented reality implementation device (10) by performing actions intended to input user operation commands to the right head portion and the left head portion of the user, respectively.

[0243] Meanwhile, as described above, the processor (500) can determine that a user operation command has been entered if the time at which a sensing value corresponding to a preset operation reference value is entered corresponds to a preset operation command input time.

[0244] Accordingly, the processor (500) can determine that a first user operation command has been entered if the time at which a first sensing value corresponding to a first operation reference value is entered corresponds to a first operation command input time that has been set.

[0245] That is, the processor (500) can determine that a first user operation command has been entered if the first sensing value received from the first sensing sensor (310) corresponds to a value within a preset first operation reference value range, and the time at which the first sensing value corresponding to the preset first operation reference value is entered corresponds to a time within a preset first operation command input time range.

[0246] Additionally, the processor (500) can determine that a second user operation command has been entered if the time at which a second sensing value corresponding to a previously set second operation reference value is entered corresponds to a previously set second operation command input time.

[0247] That is, the processor (500) can determine that a second user operation command has been entered if the second sensing value received from the second sensing sensor (320) corresponds to a value within a pre-set second operation reference value range, and the time at which the second sensing value corresponding to the pre-set second operation reference value is entered corresponds to a time within a pre-set second operation command input time range.

[0248] Additionally, the processor (500) can determine that a third user operation command has been entered if the time at which a first sensing value corresponding to a previously set third-1 operation reference value is entered corresponds to a previously set third-1 operation command input time, and the time at which a second sensing value corresponding to a previously set third-2 operation reference value is entered corresponds to a previously set third-2 operation command input time.

[0249] That is, the processor (500) can determine that a third user operation command has been input if the first sensing value received from the first sensing sensor (310) corresponds to a value within the pre-set 3-1 operation reference value range, and the time at which the first sensing value corresponding to the pre-set 3-1 operation reference value is input corresponds to a time within the pre-set 3-1 operation command input time range, and the second sensing value received from the second sensing sensor (320) corresponds to a value within the pre-set 3-2 operation reference value range, and the time at which the second sensing value corresponding to the pre-set 3-2 operation reference value is input corresponds to a time within the pre-set 3-2 operation command input time range.

[0250] At this time, as described above, the processor (500) determines the first user operation command, the second user operation command, and the third user operation command as different user operation commands, and for each of the first user operation command, the second user operation command, and the third user operation command, it can generate different second image data through the image data generation module (610) described above.

[0251] Accordingly, the user can input various user operation commands to the augmented reality implementation device (10) by performing actions intended to input user operation commands to the right head part and the left head part of the user, respectively, for a predetermined period of time.

[0252] For example, the user can change the shape of a preset detection area (A) by squinting the right eye for a preset time or longer and input a first user operation command, thereby changing the video in a constant speed playback state provided through the optical lens (100) to an N-speed playback state (wherein N is a positive number greater than 1).

[0253] That is, the processor (500) may generate second image data representing a second virtual image (VI-2) representing a video in a constant speed playback state, when it is determined that a first user operation command has been entered because the time at which a first sensing value corresponding to a preset first operation reference value is input corresponds to a preset first operation command input time (wherein N is a positive number greater than 1).

[0254] Additionally, the user can change the shape of the preset detection area (A) by squinting the left eye for a preset time or longer and input a second user operation command, thereby changing the video in a constant speed playback state provided through the optical lens (100) to an M-speed playback state (wherein M is a positive number less than 1). That is, while the processor (500) is generating first image data representing a first virtual image (VI-1) which is a video in a constant speed playback state, if it is determined that a second user operation command has been input because the time at which a second sensing value corresponding to a preset second operation reference value is input corresponds to a preset second operation command input time, the processor (500) can generate second image data representing a second virtual image (VI-2) which is a video in an M-speed playback state (wherein M is a positive number less than 1).

[0255] Meanwhile, as described above, the operation reference values ​​can be set to multiple values, and the processor (500) determines that a user operation command has been input when the sensing value corresponds to any one of the multiple operation reference values, and can determine that different user operation commands have been input depending on which of the multiple previously set operation reference values ​​the sensing value corresponds to.

[0256] Accordingly, the first operation reference value may be set to multiple values, and the processor (500) determines that a first user operation command has been input when the first sensing value corresponds to any one of the multiple first operation reference values, and may determine that a different first user operation command has been input according to any one of the multiple previously set first operation reference values ​​to which the first sensing value corresponds.

[0257] Additionally, the second operation reference value may be set to multiple values, and the processor (500) determines that a second user operation command has been input when the second sensing value corresponds to any one of the multiple second operation reference values, and may determine that a different second user operation command has been input according to any one of the multiple previously set second operation reference values ​​to which the second sensing value corresponds.

[0258] Meanwhile, as described above, the processor (500) may determine that different user operation commands have been input according to the time at which a sensing value corresponding to a preset operation reference value is input. For example, the operation command input time may be set to multiple times, and the processor (500) determines that a user operation command has been input when the time at which a sensing value corresponding to a preset operation reference value is input corresponds to any one of the multiple operation command input times. In addition, among the multiple preset operation reference values, the processor may determine that different user operation commands have been input according to any one of the operation command input times at which the time at which a sensing value corresponding to a preset operation reference value is input corresponds.

[0259] Accordingly, the processor (500) may determine that different user operation commands have been input depending on the time at which a first sensing value corresponding to a pre-set first operation reference value is input. For example, the first operation command input time may be set to multiple times, and the processor (500) determines that a first user operation command has been input when the time at which a first sensing value corresponding to a pre-set first operation reference value is input corresponds to any one of the multiple first operation command input times, and may determine that different first user operation commands have been input depending on the first operation command input time among the multiple pre-set first operation command input times that corresponds to the time at which a first sensing value corresponding to a pre-set first operation reference value is input.

[0260] Additionally, the processor (500) may determine that different user operation commands have been input according to the time at which a second sensing value corresponding to a previously set second operation reference value is input. For example, the second operation command input time may be set to multiple times, and the processor (500) determines that a second user operation command has been input when the time at which a second sensing value corresponding to a previously set second operation reference value is input corresponds to any one of the multiple second operation command input times, and may determine that different first user operation commands have been input according to any one of the multiple previously set second operation command input times at which the time at which a second sensing value corresponding to a previously set second operation reference value is input corresponds.

[0261] As described above, the user can input different user operation commands by modifying the pre-set detection area (A) through various input actions, such as grimacing with the right eye or clenching the right teeth, and the user can also input different user operation commands by modifying the pre-set detection area (A) through various input actions, such as grimacing with the left eye or clenching the left teeth.

[0262] In addition, the user can input different user operation commands depending on the duration of maintaining actions such as grimacing with the right eye or clenching the right teeth, and the user can input different user operation commands depending on the duration of maintaining actions such as grimacing with the left eye or clenching the left teeth.

[0263] In this way, the user can input different user operation commands depending on changing the shape of the first detection area (A1) or the second detection area (A2), depending on the type of operation that deforms the shape of the detection area (A), or depending on the time taken to perform the operation that deforms the shape of the detection area (A).

[0264] Meanwhile, based on various user operation commands input, the output state of the virtual image provided by the optical device (10) for augmented reality can be controlled in various ways. For example, by any one of the various user operation commands described above, the virtual image that is a video can be played or stopped, the virtual image that is a video can be played at a constant speed or at a multi-speed, or the virtual image that is a video can be played at a point in time after a preset time or at a point in time before a preset time. Meanwhile, as described above, if the preset detection area (A) includes the user's temporal area and the user's eye area, the processor (500) can determine that a user operation command has been input if the sensing value received from the detection sensor (300) that detects the shape of the user's temporal area and is positioned adjacent to the user's temporal area corresponds to a preset operation reference value, and the sensing value received from the detection sensor (300) that detects the shape of the user's eye area and is positioned adjacent to the user's eye area corresponds to a preset operation reference value.

[0265] For example, if the first detection area (A1) that has been set includes the user's right temporal region and the user's right eye region, the processor (500) can determine that the first user operation command has been entered if the first-1 sensing value received from the first detection sensor (310) that is positioned adjacent to the user's right temporal region and detects the shape of the user's right temporal region corresponds to the first-1 operation reference value that has been set, and the first-2 sensing value received from the first detection sensor (310) that is positioned adjacent to the user's right eye region and detects the shape of the user's right eye region corresponds to the first-2 operation reference value that has been set.

[0266] Additionally, if the pre-set second detection area (A2) includes the user's left temporal area and the user's left eye area, the processor (500) can determine that a second user operation command has been input if the second-1 sensing value received from the second detection sensor (310), which is positioned adjacent to the user's left temporal area and detects the shape of the user's left temporal area, corresponds to the pre-set second-1 operation reference value, and the second-2 sensing value received from the second detection sensor (320), which is positioned adjacent to the user's left eye area and detects the shape of the user's left eye area, corresponds to the pre-set second-2 operation reference value.

[0267] Additionally, if the pre-set first sensing area (A1) includes the user's right temporal region and the user's right eye region, and the pre-set second sensing area (A2) includes the user's left temporal region and the user's left eye region, the processor (500) receives a 3-11 sensing value from a first sensing sensor (310) positioned adjacent to the user's right temporal region and detecting the shape of the user's right temporal region, which corresponds to a pre-set 3-11 operation reference value, and a 3-12 sensing value received from a first sensing sensor (310) positioned adjacent to the user's right eye region and detecting the shape of the user's right eye region corresponds to a pre-set 3-12 operation reference value, and a 3-21 sensing value received from a second sensing sensor (320) positioned adjacent to the user's left temporal region and detecting the shape of the user's left temporal region corresponds to a pre-set 3-21 operation reference value, and a second sensing sensor (320) positioned adjacent to the user's left eye region and detecting the shape of the user's left eye region If the 3-22 sensing value corresponds to the 3-22 operation reference value set in advance, it can be determined that the 3rd user operation command has been entered.

[0268] In the manner described above, the processor (500) receives a sensing value from the sensing sensor (300) and can determine whether a user operation command is input based on the received sensing value. At this time, while the processor (500) is generating first image data representing a first virtual image (VI-1) through the aforementioned image data generation module (610), if it is determined that a user operation command has been input, it can generate second image data representing a second virtual image (VI-2) in a state different from the first virtual image (VI-1) based on the input user operation command.

[0269] Next, the processor (500) can execute a user setting module (630) stored in memory (600), and the processor (500) can execute a user setting mode for setting an operation reference value that serves as a criterion for determining whether to input a user operation command by executing instructions or program code included in the user setting module (630).

[0270] In exemplary embodiments, when the processor (500) receives a user setting command from a user, it executes a user setting mode for setting an operation reference value, receives a sensing value from a detection sensor (300) while in the user setting mode, and can set the received sensing value as an operation reference value.

[0271] For example, when a user uses the augmented reality implementation device (10) according to the present invention, the user may input a user setting command in a pre-set manner, and when a user setting command is input, the processor (500) may execute a user setting mode.

[0272] When the user setting mode is enabled, the user may perform actions such as squinting with the intention of inputting a user operation command, and accordingly, the sensing sensor (300) may generate a sensing value corresponding to the shape of the pre-set sensing area (A). At this time, the processor (300) may set the sensing value input from the sensing sensor (300) as an operation reference value.

[0273] In this way, by providing a setting of an operation reference value that serves as a criterion for determining whether a user operation command is input in a user setting mode, the operation reference value can be set according to the characteristics of the user using the augmented reality implementation device (10) according to the present invention.

[0274] Additionally, the processor (500) may be configured to set multiple operation reference values ​​in the manner described above, and the user may repeat the operation reference value setting process multiple times, and by moving facial muscles in different ways to generate different sensing values ​​from the detection sensor (300), the user may set multiple operation reference values ​​for inputting multiple different user operation commands.

[0275] Meanwhile, in the processor (500) user setting mode, after completing the setting for the operation reference value, the input time of the sensing value corresponding to the set operation reference value can be set as the operation command input time.

[0276] For example, in the user setting mode, the user may complete the setting of the operation reference value by performing actions such as squinting with the intention of inputting a user operation command, and then perform actions such as squinting with the intention of inputting a user operation command again for a predetermined period of time so that a sensing value corresponding to the operation reference value is generated from the detection sensor (300) for a predetermined period of time. At this time, the processor (500) may set the input time of the sensing value corresponding to the input operation reference value as the operation command input time.

[0277] Additionally, the processor (500) may be configured to set multiple operation command input times in the manner described above, and the user may repeat the operation command input time setting process described above multiple times, and by moving facial muscles at different times so that sensing values ​​corresponding to operation reference values ​​are generated from the detection sensor (300) at different times, the user may set multiple operation command input times for inputting multiple different user operation commands.

[0278] Meanwhile, user setting modes may include right setting mode, left setting mode, and both setting modes.

[0279] For example, when the right setting mode is executed by inputting a user setting command, the processor (500) receives a first sensing value from the first sensing sensor (310) and can set the received first sensing value as a first operation reference value.

[0280] Additionally, when the left setting mode is executed by inputting a user setting command, the processor (500) receives a second sensing value from the second sensing sensor (320) and can set the received second sensing value as a second operation reference value.

[0281] Additionally, when the dual setting mode is executed by inputting a user setting command, the processor (500) can receive a first sensing value from the first sensing sensor (310), set the received first sensing value as the third-1 operation reference value, receive a second sensing value from the second sensing sensor (320), and set the received second sensing value as the third-2 operation reference value.

[0282] Alternatively, without executing the two-sided setting mode, the 3-1 operation reference value may be set to be the same as the 1 operation reference value, and the 3-2 operation reference value may be set to be the same as the 2 operation reference value.

[0283] Meanwhile, in each of the right setting mode, left setting mode, and both setting modes, multiple operation reference values ​​can be set in the manner described above, and in each of the right setting mode, left setting mode, and both setting modes, multiple operation command input times can be set in the manner described above.

[0284] Next, the power module (700) may be configured to supply power to the aforementioned sensing sensor (300), communication module (400), processor (500), and memory (600). For example, the power module (700) may be configured in the form of a battery module.

[0285] At this time, the power module (700) can be controlled to turn on and off based on a user operation command. For example, when power is being supplied by the power module (700) and a user operation command as described above is input, the power module (700) can be turned off so that the augmented reality implementation device (10) is turned off.

[0286] Below, a method for controlling the virtual image output of the augmented reality implementation device of FIG. 3 based on the detection of the shape of the user's head part will be described.

[0287] FIGS. 13 and 14 are flowcharts illustrating a method for controlling virtual image output of an augmented reality implementation device based on head shape detection according to exemplary embodiments.

[0288] Referring to FIGS. 1 to 14, first, the processor (500) of the augmented reality implementation device (10) can generate first image data representing a first virtual image (VI-1) (S100).

[0289] The processor (500) can execute an image data generation module (610) stored in memory (600), and the processor (500) can generate image data representing various forms of virtual images (VI) by executing instructions or program code included in the image data generation module (610).

[0290] According to exemplary embodiments, the processor (500) can generate image data representing a virtual image (VI) that is a video. Additionally, the processor (500) can generate image data representing a virtual image (VI) that is a still image, such as a photograph.

[0291] For example, the processor (500) can generate first image data representing a first virtual image (VI-1) which is a video in a playback state. Alternatively, the processor (500) can generate first image data representing a first virtual image (VI-1) which is a video in a still state.

[0292] Additionally, the processor (500) can receive content data received by the communication module (400) from the user terminal (20). At this time, the processor (500) can generate image data representing a virtual image (VI) based on the content data received from the communication module (400).

[0293] For example, the processor (500) can generate image data that represents a virtual image (VI) identical to the content being output to the user terminal (20). Accordingly, the content being output from the user terminal (20) can be configured to be synchronized and output to the augmented reality implementation device (10).

[0294] Next, the processor (500) of the augmented reality implementation device (10) receives a sensing value from a sensing sensor that is positioned adjacent to a preset sensing area (A) among the areas of the user's head, and is configured to detect the shape of the sensing area and generate different sensing values ​​according to the shape of the sensing area, and can determine whether a user operation command is input based on the sensing value (S200).

[0295] The processor (500) can execute an operation input determination module (620) stored in memory (600), and the processor (500) can receive a sensing value from a detection sensor (300) by executing instructions or program code included in the operation command input determination module (620), and can determine whether a user operation command is input based on the received sensing value.

[0296] In exemplary embodiments, the processor (500) may determine that a user operation command has been entered if the sensing value received from the sensing sensor (300) corresponds to a preset operation reference value.

[0297] For example, the processor (500) can determine that a user operation command has been entered if the sensing value received from the sensing sensor (300) corresponds to a value within a preset operation reference value range.

[0298] At this time, the processor (500) can determine that a user operation command has been input if the pre-set detection area (A) includes the user's temporal area and the user's eye area, and the sensing value received from the detection sensor (300) positioned adjacent to the user's temporal area to detect the shape of the user's temporal area corresponds to a pre-set operation reference value, and the sensing value received from the detection sensor (300) positioned adjacent to the user's eye area to detect the shape of the user's eye area corresponds to a pre-set operation reference value.

[0299] Here, the operation reference values ​​can be set to multiple values, and the processor (500) determines that a user operation command has been input when the sensing value corresponds to any one of the multiple operation reference values, and can determine that different user operation commands have been input depending on which of the multiple pre-set operation reference values ​​the sensing value corresponds to.

[0300] For example, the operation reference value may be set to a plurality of values ​​including a first operation reference value and a second operation reference value different from the first operation reference value, and the processor (500) may determine that a first user operation command has been input when the sensing value input from the sensing sensor (300) corresponds to the first operation reference value, and determine that a second user operation command different from the first user operation command has been input when the sensing value input from the sensing sensor (300) corresponds to the second operation reference value.

[0301] Additionally, the processor (500) can determine that a user operation command has been entered if the time at which a sensing value corresponding to a preset operation reference value is entered corresponds to the preset operation command input time.

[0302] For example, the processor (500) can determine that a user operation command has been entered if the time at which a sensing value corresponding to a preset operation reference value is entered corresponds to a time within a preset operation command input time range.

[0303] At this time, the processor (500) can determine that a user operation command has been entered if the sensing value received from the sensing sensor (300) corresponds to a preset operation reference value, and the time at which the sensing value corresponding to the preset operation reference value is entered corresponds to a preset operation command input time.

[0304] Meanwhile, the processor (500) can determine that different user operation commands have been input depending on the time at which a sensing value corresponding to a preset operation reference value is input.

[0305] In exemplary embodiments, the operation command input time may be set to a plurality of times, and the processor (500) determines that a user operation command has been input when the time at which a sensing value corresponding to a preset operation reference value is input corresponds to any one of the plurality of operation command input times, and may determine that different user operation commands have been input according to any one of the plurality of preset operation command input times at which the time at which a sensing value corresponding to a preset operation reference value is input corresponds.

[0306] For example, the operation command input time may be set to a plurality of times, including a first operation command input time and a second operation command input time different from the first operation command input time, and the processor (500) may determine that a first user operation command has been input if the time at which a sensing value corresponding to a preset operation reference value is input corresponds to the first operation command input time, and determine that a second user operation command has been input if the time at which a sensing value corresponding to a preset operation reference value is input corresponds to the second operation command input time.

[0307] Meanwhile, the operation reference value and the operation command input time can each be set to multiple values, and the processor (500) can determine that different user operation commands have been input according to the operation reference value corresponding to the sensing value input from the detection sensor (300) and the time at which the sensing value corresponding to the operation reference value is input.

[0308] For example, the operation reference values ​​may be set to a plurality of values ​​including a first operation reference value and a second operation reference value different from the first operation reference value, and the operation command input time may be set to a plurality of values ​​including a first operation command input time and a second operation command input time different from the first operation command input time.

[0309] At this time, the processor (500) can determine that a first user operation command has been entered if the sensing value input from the sensing sensor (300) corresponds to a first operation reference value, and the time at which the sensing value corresponding to the first operation reference value is input corresponds to the time at which a first operation command is input.

[0310] Additionally, the processor (500) can determine that a second user operation command has been input if the sensing value input from the sensing sensor (300) corresponds to a first operation reference value, and the time at which the sensing value corresponding to the first operation reference value is input corresponds to a second operation command input time.

[0311] Additionally, the processor (500) can determine that a third user operation command has been input if the sensing value input from the sensing sensor (300) corresponds to a second operation reference value, and the time at which the sensing value corresponding to the second operation reference value is input corresponds to the time at which the first operation command is input.

[0312] Additionally, the processor (500) can determine that a fourth user operation command has been entered if the sensing value input from the sensing sensor (300) corresponds to a second operation reference value, and the time at which the sensing value corresponding to the second operation reference value is input corresponds to the time at which the second operation command is input.

[0313] Meanwhile, when the sensing sensor (300) is provided in a form including a first sensing sensor (310) and a second sensing sensor (320), the processor (500) receives a first sensing value and a second sensing value from each of the first sensing sensor (310) and the second sensing sensor (320), and can determine whether a user operation command is input based on the first sensing value and the second sensing value.

[0314] In exemplary embodiments, the processor (500) may determine that a first user operation command has been input when the first sensing value received from the first sensing sensor (310) corresponds to a first operation reference value that has been pre-set.

[0315] Additionally, the processor (500) can determine that a second user operation command has been input if the second sensing value received from the second sensing sensor (320) corresponds to a pre-set second operation reference value.

[0316] Additionally, the processor (500) can determine that a third user operation command has been input if the first sensing value received from the first sensing sensor (310) corresponds to a pre-set third-1 operation reference value, and the second sensing value received from the second sensing sensor (320) corresponds to a pre-set third-2 operation reference value.

[0317] At this time, if the first sensing area (A1) that has been set as described above includes the user's right temporal area and the user's right eye area, the processor (500) can determine that a first user operation command has been input if the first-1 sensing value received from the first sensing sensor (310) that is positioned adjacent to the user's right temporal area and detects the shape of the user's right temporal area corresponds to the first-1 operation reference value that has been set, and the first-2 sensing value received from the first sensing sensor (310) that is positioned adjacent to the user's right eye area and detects the shape of the user's right eye area corresponds to the first-2 operation reference value that has been set.

[0318] Additionally, if the pre-set second detection area (A2) includes the user's left temporal area and the user's left eye area, the processor (500) can determine that a second user operation command has been input if the second-1 sensing value received from the second detection sensor (310), which is positioned adjacent to the user's left temporal area and detects the shape of the user's left temporal area, corresponds to the pre-set second-1 operation reference value, and the second-2 sensing value received from the second detection sensor (320), which is positioned adjacent to the user's left eye area and detects the shape of the user's left eye area, corresponds to the pre-set second-2 operation reference value.

[0319] Additionally, if the pre-set first sensing area (A1) includes the user's right temporal region and the user's right eye region, and the pre-set second sensing area (A2) includes the user's left temporal region and the user's left eye region, the processor (500) receives a 3-11 sensing value from a first sensing sensor (310) positioned adjacent to the user's right temporal region and detecting the shape of the user's right temporal region, which corresponds to a pre-set 3-11 operation reference value, and a 3-12 sensing value received from a first sensing sensor (310) positioned adjacent to the user's right eye region and detecting the shape of the user's right eye region corresponds to a pre-set 3-12 operation reference value, and a 3-21 sensing value received from a second sensing sensor (320) positioned adjacent to the user's left temporal region and detecting the shape of the user's left temporal region corresponds to a pre-set 3-21 operation reference value, and a second sensing sensor (320) positioned adjacent to the user's left eye region and detecting the shape of the user's left eye region If the 3-22 sensing value corresponds to the 3-22 operation reference value set in advance, it can be determined that the 3rd user operation command has been entered.

[0320] Meanwhile, the processor (500) can determine that a first user operation command has been entered if the time at which a first sensing value corresponding to a first operation reference value is entered corresponds to a first operation command input time that has been set.

[0321] Additionally, the processor (500) can determine that a second user operation command has been entered if the time at which a second sensing value corresponding to a previously set second operation reference value is entered corresponds to a previously set second operation command input time.

[0322] The processor (500) can determine that a third user operation command has been entered if the time at which a first sensing value corresponding to a previously set third-1 operation reference value is entered corresponds to the time at which a previously set third-1 operation command is entered, and the time at which a second sensing value corresponding to a previously set third-2 operation reference value is entered corresponds to the time at which a previously set third-2 operation command is entered.

[0323] Accordingly, the user can input various user operation commands to the augmented reality implementation device (10) by performing actions intended to input user operation commands to the right head part and the left head part of the user, respectively, for a predetermined period of time.

[0324] For example, the user can change the shape of a preset detection area (A) by squinting the right eye for a preset time or longer and input a first user operation command, thereby changing the video in a constant speed playback state provided through the optical lens (100) to an N-speed playback state (wherein N is a positive number greater than 1).

[0325] That is, the processor (500) may generate second image data representing a second virtual image (VI-2) representing a video in a constant speed playback state, when it is determined that a first user operation command has been entered because the time at which a first sensing value corresponding to a preset first operation reference value is input corresponds to a preset first operation command input time (wherein N is a positive number greater than 1).

[0326] Additionally, the user can change the shape of the preset detection area (A) by squinting the left eye for a preset time or longer and input a second user operation command, thereby changing the video in a constant speed playback state provided through the optical lens (100) to an M speed playback state (wherein M is a positive number less than 1).

[0327] That is, while the processor (500) is generating first image data representing a first virtual image (VI-1) which is a video in a constant speed playback state, if it is determined that a second user operation command has been entered because the time at which a second sensing value corresponding to a preset second operation reference value is input corresponds to a preset second operation command input time, the processor (500) can generate second image data representing a second virtual image (VI-2) which is a video in an M speed playback state (wherein M is a positive number less than 1).

[0328] Next, the processor (500) of the augmented reality implementation device (10) can generate second image data representing a second virtual image (VI-2) when a user operation command is input (S300).

[0329] As described above, the processor (500) can execute an image data generation module (610) stored in memory (600), and the processor (500) can generate image data representing various forms of virtual images (VI) by executing instructions or program code included in the image data generation module (610).

[0330] The processor (500) can generate image data representing a virtual image (VI) that is a video, and the processor (500) can generate first image data and second image data representing a first virtual image (VI-1) and a second virtual image (VI-2) that are videos in different states, respectively, according to the input of a user operation command.

[0331] In exemplary embodiments, the processor (500) may generate second image data representing a second virtual image (VI-2) representing a still video when it is determined that a user operation command has been input while generating first image data representing a first virtual image (VI-1) representing a video in a playback state.

[0332] Additionally, the processor (500) may generate first image data representing a first virtual image (VI-1) that is a video in a still state, and when it is determined that a user operation command has been input, generate second image data representing a second virtual image (VI-2) that is a video in a playback state.

[0333] In exemplary embodiments, when the processor (500) is generating first image data representing a first virtual image (VI-1) which is a video in a playback state, and determines that a user operation command has been entered, it may generate second image data representing a second virtual image (VI-2) which is a video in a playback state at a time after a preset time from the playback time of the first virtual image (VI-1).

[0334] Additionally, when the processor (500) is generating first image data representing a first virtual image (VI-1) which is a video in a playback state, if it is determined that a user operation command has been entered, it can generate second image data representing a second virtual image (VI-2) which is a video in a playback state at a time prior to a preset time from the playback time of the first virtual image (VI-1).

[0335] In exemplary embodiments, the processor (500) may generate second image data representing a second virtual image (VI-2) representing a video in a fast-speed playback state when it is determined that a user operation command has been input while generating first image data representing a first virtual image (VI-1) representing a video in a fast-speed playback state.

[0336] Meanwhile, the processor (500) can generate image data representing a virtual image (VI) which is a still image, and the processor (600) can generate first image data and second image data representing a first virtual image (VI-1) and a second virtual image (VI-2), which are different still images, respectively, according to the input of a user operation command.

[0337] Next, the processor (500) of the augmented reality implementation device (10) causes the display module to emit an image light constituting the first virtual image (VI-1) or an image light constituting the second virtual image (VI-2) toward the optical lens based on the first image data or the second image data (S400).

[0338] The processor (500) can transmit the generated first image data or second image data to the display module (200), and the display module (200) can emit image light constituting the first virtual image (VI-1) or image light constituting the second virtual image (VI-2) toward the optical lens (100) based on the first image data or second image data received from the processor (500). Here, the image light constituting the first virtual image (VI-1) or image light constituting the second virtual image (VI-2) emitted toward the optical lens (100) can be transmitted to the user through the optical lens (100).

[0339] Meanwhile, as illustrated in FIG. 14, the processor (500) of the augmented reality implementation device (10) can execute a user setting mode for setting an operation reference value (S51), receive a sensing value from a detection sensor (300) while in the user setting mode (S52), and set the received sensing value as an operation reference value (S53).

[0340] The processor (500) can execute a user setting module (630) stored in memory (600), and the processor (500) can execute a user setting mode for setting an operation reference value that serves as a criterion for determining whether to input a user operation command by executing instructions or program code included in the user setting module (630).

[0341] In exemplary embodiments, when the processor (500) receives a user setting command from a user, it executes a user setting mode for setting an operation reference value, receives a sensing value from a detection sensor (300) while in the user setting mode, and can set the received sensing value as an operation reference value.

[0342] Additionally, the processor (500) can repeat the process of setting operation reference values ​​multiple times to set multiple operation reference values ​​for inputting multiple different user operation commands.

[0343] In addition, in the processor (500) user setting mode, the input time of the sensing value corresponding to the set operation reference value, which is input after the setting of the operation reference value is completed, can be set as the operation command input time.

[0344] Additionally, the processor (500) can set multiple operation command input times by repeating the operation command input time setting process multiple times.

[0345] User setting modes may include right setting mode, left setting mode, and both-sided setting mode.

[0346] For example, when the right setting mode is executed by inputting a user setting command, the processor (500) receives a first sensing value from the first sensing sensor (310) and can set the received first sensing value as a first operation reference value.

[0347] Additionally, when the left setting mode is executed by inputting a user setting command, the processor (500) receives a second sensing value from the second sensing sensor (320) and can set the received second sensing value as a second operation reference value.

[0348] Additionally, when the dual setting mode is executed by inputting a user setting command, the processor (500) can receive a first sensing value from the first sensing sensor (310), set the received first sensing value as the third-1 operation reference value, receive a second sensing value from the second sensing sensor (320), and set the received second sensing value as the third-2 operation reference value.

[0349] Alternatively, without executing the two-sided setting mode, the 3-1 operation reference value may be set to be the same as the 1 operation reference value, and the 3-2 operation reference value may be set to be the same as the 2 operation reference value.

[0350] Meanwhile, in each of the right setting mode, left setting mode, and both setting modes, multiple operation reference values ​​can be set in the manner described above, and in each of the right setting mode, left setting mode, and both setting modes, multiple operation command input times can be set in the manner described above.

[0351] Although embodiments of the present invention have been illustrated and described above, the present invention is not limited to the specific embodiments described above. It is understood that various modifications can be made by those skilled in the art without departing from the essence of the invention as claimed in the claims, and such modifications should not be understood individually from the technical spirit or perspective of the present invention.

[0352] Although the embodiments have been described above with reference to limited examples and drawings, those skilled in the art can make various modifications and variations from the description above. For example, suitable results can be achieved even if the described techniques are performed in a different order than described, and / or the components of the described electronic device, structure, circuit, etc. are combined or assembled in a form different from described, or replaced or substituted by other components or equivalents.

Claims

1. An optical lens configured to transmit image light constituting a virtual image to the user's pupil; A display module configured to emit image light constituting the virtual image toward the optical lens; A sensing sensor configured to be positioned adjacent to a preset sensing area among each region of the user's head, and to detect the shape of the sensing area and generate different sensing values ​​according to the shape of the sensing area; Memory for storing a program containing one or more instructions; and It includes a processor configured to execute one or more instructions of a program stored in the memory, and The above processor is, First image data representing a first virtual image is generated, and The sensing value is received from the above-mentioned sensing sensor, and based on the sensing value, it is determined whether a user operation command is input. When the above user operation command is entered, second image data representing a second virtual image is generated, and An augmented reality implementation device having a virtual image output control function based on head shape detection, wherein the display module emits an image light constituting the first virtual image or an image light constituting the second virtual image toward the optical lens based on the first image data or the second image data.

2. In Paragraph 1, The above detection area is, An augmented reality implementation device having a virtual image output control function based on head shape detection, which is the temporal region between the user's eyes and ears.

3. In Paragraph 1, The above detection sensor is, An augmented reality implementation device having a virtual image output control function based on head shape detection, wherein the pressure sensor is positioned to contact the above-mentioned sensing area and is configured to generate a sensing value corresponding to the pressure applied according to the shape of the above-mentioned sensing area.

4. In Paragraph 1, The above detection sensor is, An augmented reality implementation device having a virtual image output control function based on head shape detection, wherein the capacitive touch sensor is positioned to contact the above-mentioned sensing area and is configured to generate a sensing value corresponding to a change in electromotive force according to the shape of the above-mentioned sensing area.

5. In Paragraph 1, A front frame coupled to at least a portion of the optical lens and The frame member further comprises a frame member coupled to the front frame and including a temple extending from the front frame. The above detection sensor is, An augmented reality implementation device having a virtual image output control function based on head shape detection, coupled to the above-mentioned temple and positioned adjacent to the above-mentioned detection area.

6. In Paragraph 1, The above processor is, An augmented reality implementation device having a virtual image output control function based on head shape detection, which determines that a user operation command has been input when the above-mentioned sensing value corresponds to a preset operation reference value.

7. In Paragraph 6, The above operation reference values ​​are set in multiple numbers, and The above processor is, If the above sensing value corresponds to any one of the above plurality of operation reference values, it is determined that the above user operation command has been entered, An augmented reality implementation device having a virtual image output control function based on head shape detection, which determines that different user operation commands have been input according to one of the operation reference values ​​to which the sensing value corresponds among the plurality of operation reference values.

8. In Paragraph 6, The above processor is, An augmented reality implementation device having a virtual image output control function based on head shape detection, which determines that a user operation command has been input when the time at which the sensing value corresponding to the above operation reference value is input corresponds to a preset operation command input time.

9. In Paragraph 6, The above processor is, It is configured to execute a user setting mode for setting the above-mentioned operation reference value, and In the above user setting mode state, the sensing value is received from the detection sensor, and An augmented reality implementation device having a virtual image output control function based on head shape detection, which sets the input sensing value as the operation reference value.

10. In Paragraph 1, The virtual image above is a video, and The first virtual image above is a video in a playback state or a video in a still state, and If the first virtual image is a video in a playback state, the second virtual image is a video in a still state, and An augmented reality implementation device having a virtual image output control function based on head shape detection, wherein when the first virtual image is a still video, the second virtual image is a video in a playback state.

11. In Paragraph 1, The virtual image above is a video, and The above first virtual image is a video in a constant speed playback state, and The above second virtual image is a video in a speed-playback state, and the augmented reality implementation device has a virtual image output control function based on head shape detection.

12. In Paragraph 1, The above detection area is, A first sensing area positioned in the right area of ​​the user's head and It includes a second sensing area positioned in the left area of ​​the user's head, and The above detection sensor is, A first sensing sensor disposed adjacent to the first sensing area and configured to detect the shape of the first sensing area and generate different first sensing values ​​according to the shape of the first sensing area, and It includes a second sensing sensor positioned adjacent to the second sensing area and configured to detect the shape of the second sensing area and generate different second sensing values ​​according to the shape of the second sensing area. The above processor is, The first sensing value and the second sensing value are received from each of the first sensing sensor and the second sensing sensor, respectively, and An augmented reality implementation device having a virtual image output control function based on head shape detection, which determines whether the user operation command is input based on the first sensing value and the second sensing value.

13. In Paragraph 12, The above processor is, If the first sensing value corresponds to a pre-set first operation reference value, it is determined that a first user operation command has been entered, and If the above second sensing value corresponds to a pre-set second operation reference value, it is determined that a second user operation command has been entered, and If the first sensing value corresponds to the pre-set 3-1 operation reference value and the second sensing value corresponds to the pre-set 3-2 operation reference value, it is determined that a third user operation command has been input. An augmented reality implementation device having a virtual image output control function based on head shape detection, which generates different second image data for each of the first user operation command, the second user operation command, and the third user operation command.

14. A method for controlling the output of a virtual image of an augmented reality implementation device configured to transmit image light constituting a virtual image emitted by a display module to the user's pupil through an optical lens, wherein First image data representing a first virtual image is generated, and A sensing value is received from a sensing sensor that is positioned adjacent to a preset sensing area among each area of ​​the user's head, detects the shape of the sensing area, and generates different sensing values ​​according to the shape of the sensing area, and determines whether a user operation command is input based on the sensing value. When the above user operation command is entered, second image data representing a second virtual image is generated, and A method for controlling virtual image output of an augmented reality implementation device based on head shape detection, wherein a display module emits an image light constituting the first virtual image or an image light constituting the second virtual image toward the optical lens based on the first image data or the second image data.

15. In Paragraph 14, The above detection area is, A method for controlling virtual image output of an augmented reality implementation device based on head shape detection, which is the temporal region between the user's eyes and ears.

16. In Paragraph 14, The above detection sensor is, A method for controlling the output of a virtual image of an augmented reality implementation device based on head shape detection, wherein the pressure sensor is positioned to contact the above-mentioned sensing area and is configured to generate a sensing value corresponding to the pressure applied according to the shape of the above-mentioned sensing area.

17. In Paragraph 14, The above detection sensor is, A method for controlling the output of a virtual image of an augmented reality implementation device based on head shape detection, wherein the capacitive touch sensor is positioned to contact the above-mentioned sensing area and is configured to generate a sensing value corresponding to a change in electromotive force according to the shape of the above-mentioned sensing area.

18. In Paragraph 14, The above augmented reality implementation device is, A front frame coupled to at least a portion of the optical lens and A frame member comprising a temple that is coupled to the front frame and extends from the front frame, and The above detection sensor is, A method for controlling the output of a virtual image of an augmented reality implementation device based on head shape detection, which is coupled to the above-mentioned temple and positioned adjacent to the above-mentioned detection area.

19. In Paragraph 14, Determining whether the above user operation command is input is, A method for controlling the output of a virtual image of an augmented reality implementation device based on head shape detection, wherein the user operation command is determined to have been input when the above-mentioned sensing value corresponds to a preset operation reference value.

20. In Paragraph 19, The above operation reference values ​​are set in multiple numbers, and Determining whether the above user operation command is input is, If the above sensing value corresponds to any one of the above plurality of operation reference values, it is determined that the above user operation command has been entered, A method for controlling the output of a virtual image of an augmented reality implementation device based on head shape detection, wherein, according to one of the plurality of operation reference values ​​to which the sensing value corresponds, different user operation commands are determined to have been input.

21. In Paragraph 19, Determining whether the above user operation command is input is, A method for controlling the output of a virtual image of an augmented reality implementation device based on head shape detection, wherein the user operation command is determined to have been input when the time at which the sensing value corresponding to the above operation reference value is input corresponds to a preset operation command input time.

22. In Paragraph 19, Execute a user setting mode to set the above operation reference value, and In the above user setting mode state, the sensing value is received from the detection sensor, and A method for controlling the output of a virtual image of an augmented reality implementation device based on head shape detection, further comprising setting the input sensing value as the operation reference value.

23. In Paragraph 14, The virtual image above is a video, and The first virtual image above is a video in a playback state or a video in a still state, and If the first virtual image is a video in a playback state, the second virtual image is a video in a still state, and A method for controlling virtual image output of an augmented reality implementation device based on head shape detection, wherein when the first virtual image is a video in a still state, the second virtual image is a video in a playback state.

24. In Paragraph 14, The virtual image above is a video, and The above first virtual image is a video in a constant speed playback state, and A method for controlling the output of a virtual image of an augmented reality implementation device based on head shape detection, wherein the second virtual image is a video in a speed-up playback state.

25. In Paragraph 14, The above detection area is, A first sensing area positioned in the right area of ​​the user's head and It includes a second sensing area positioned in the left area of ​​the user's head, and The above detection sensor is, A first sensing sensor disposed adjacent to the first sensing area and configured to detect the shape of the first sensing area and generate different first sensing values ​​according to the shape of the first sensing area, and It includes a second sensing sensor positioned adjacent to the second sensing area and configured to detect the shape of the second sensing area and generate different second sensing values ​​according to the shape of the second sensing area. Determining whether the above user operation command is input is, The first sensing value and the second sensing value are received from each of the first sensing sensor and the second sensing sensor, respectively, and A method for controlling a virtual image output of an augmented reality implementation device based on head shape detection, comprising determining whether the user operation command is input based on the first sensing value and the second sensing value.

26. In Paragraph 25, Determining whether the above user operation command is input is, If the first sensing value corresponds to a pre-set first operation reference value, it is determined that a first user operation command has been entered, and If the above second sensing value corresponds to a pre-set second operation reference value, it is determined that a second user operation command has been entered, and It includes determining that a third user operation command has been input when the first sensing value corresponds to a pre-set third-1 operation reference value and the second sensing value corresponds to a pre-set third-2 operation reference value. Generating the above second image data is, A method for controlling virtual image output of an augmented reality implementation device based on head shape detection, wherein different second image data is generated for each of the first user operation command, the second user operation command, and the third user operation command.

Images