Head mounted device and operating method for head mounted device

TWI935325BActive Publication Date: 2026-08-11INNOLUX CORP
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
TW112135434
Authority / Receiving Office
TW · TW
Patent Type
Patents
Current Assignee / Owner
Priority Date
2023-02-22
Filing Date
2023-09-18
Publication Date
2026-08-11
Estimated Expiration
2043-09-17

Smart Images

  • Figure TWG2TB001905260_001
    Figure TWG2TB001905260_001
  • Figure TWG2TB001905260_002
    Figure TWG2TB001905260_002
  • Figure TWG2TB001905260_003
    Figure TWG2TB001905260_003
Patent Text Reader

Abstract

This disclosure provides a head-mounted device and a method for operating the head-mounted device. The head-mounted device includes a display unit, a first sensing device, and a second sensing device. The display unit displays an image. The first sensing device detects whether there is an object within a specific range that could pose a hazard to the user. The second sensing device captures an image of the object, thereby enabling the display unit to display the object image.
Need to check novelty before this filing date? Find Prior Art

Description

Head-mounted device and method for operating a head-mounted device The present invention relates to an electronic device and a method for operating an electronic device, and more particularly to a head-mounted device and a method for operating a head-mounted device. A user can enjoy audio-visual entertainment or play games through a head-mounted device. The head-mounted device is, for example, a head-mounted display. When a user enjoys audio-visual entertainment or plays games through a head-mounted device, the user cannot know the situation of the environment around the user. It can be seen therefrom that a user who is using a head-mounted device does not know that the user himself may be exposed to danger. Therefore, how to provide a head-mounted device that can detect an object that may cause harm to the user is one of the research focuses of those skilled in the art. The present disclosure provides a head-mounted device and a method for operating a head-mounted device that can detect an object that may cause harm to the user. According to an embodiment of the present disclosure, a head-mounted device is worn on a user and provides an image to the user. The head-mounted device includes a display unit, a first sensing device, and a second sensing device. The display unit displays an image. The first sensing device detects whether there is an object that may cause harm to the user within a specific range. The second sensing device captures an object image of the object, so that the display unit displays the object image. According to an embodiment of the present disclosure, a method of operation is for a head-mounted device. The head-mounted device is worn on a user and provides an image to the user. The head-mounted device includes a display unit, a first sensing device, and a second sensing device. The method of operation includes: detecting, by the first sensing device, whether there is an object that may cause harm to the user within a specific range; when it is detected that there is an object that may cause harm to the user within the specific range, capturing, by the second sensing device, an object image of the object; and controlling the display unit to display the object image. Based on the above, the present disclosure detects, by the first sensing device, whether there is an object that may cause harm to the user within a specific range, and when it is detected that there is an object that may cause harm to the user within the specific range, the display unit displays the object image of the object. In this way, the head-mounted device can know that there is an object that may cause harm to the user within a specific range, and display the object image of the object through the display unit. The safety performance of using the head-mounted device can be improved. The present disclosure can be understood by referring to the following detailed description taken in conjunction with the accompanying drawings as described below. It should be noted that, for the purpose of clear illustration and easy understanding by the reader, each of the drawings of the present disclosure shows a part of the electronic device, and some elements in each of the drawings may not be drawn to scale. In addition, the number and size of each device shown in the drawings are only illustrative and are not intended to limit the scope of the present disclosure. Certain terms are used throughout the description and the following claims to refer to specific components. As those skilled in the art will appreciate, electronic device manufacturers may refer to components by different names. This document is not intended to distinguish between components that have different names but the same functions. In the following description and in the claims, the terms "comprising", "including", and "having" are used in an open-ended manner and should therefore be interpreted to mean "including but not limited to...". Thus, when the terms "comprising", "including", and / or "having" are used in the description of the present disclosure, it will indicate the presence of the corresponding features, regions, steps, operations, and / or components, but not limited to the presence of one or more of the corresponding features, regions, steps, operations, and / or components. It should be understood that when an element is referred to as being "coupled to", "connected to", or "conducted to" another element, the element can be directly connected to the other element and can directly establish an electrical connection, or there may be intermediate elements between these elements for relaying the electrical connection (indirect electrical connection). In contrast, when an element is referred to as being "directly coupled to", "directly conducted to", or "directly connected to" another element, there are no intermediate components. Although terms such as first, second, third, etc. may be used to describe different constituent elements, such constituent elements are not limited by these terms. The terms are only used to distinguish the constituent elements in the specification from other constituent elements. The claims may not use the same terms but may use terms such as first, second, third, etc. relative to the order of the elements claimed. Thus, in the following description, the first constituent element may be the second constituent element in the claims. The electronic device disclosed herein may include a display unit, an antenna device, a sensing device, a light-emitting device, a touch display, a curved display, or a free shape display, but is not limited thereto. The electronic device may include a foldable or flexible electronic device. The electronic device may, for example, include liquid crystal, light-emitting diode, quantum dot (QD), fluorescence, phosphor, other suitable display media, or a combination of the above materials, but is not limited thereto. The light-emitting diode may, for example, include an organic light-emitting diode (OLED), a mini light-emitting diode, a micro light-emitting diode, or a quantum dot light-emitting diode (which may include QLED, QDLED), or other suitable materials, or a combination of the above, but is not limited thereto. The display device may, for example, include a tiled display device, but is not limited thereto. The antenna device may, for example, be a liquid crystal antenna, but is not limited thereto. The antenna device may, for example, include an antenna tiling device, but is not limited thereto. It should be noted that the electronic device may be any permutation and combination of the foregoing, but is not limited thereto. In addition, the shape of the electronic device may be rectangular, circular, polygonal, a shape with curved edges, or other suitable shapes. The electronic device may have peripheral systems such as a driving system, a control system, a light source system, etc. to support the display device, the antenna device, or the tiling device, but the present disclosure is not limited thereto. The sensing device may include a camera, an infrared sensor, a fingerprint sensor, etc., and the present disclosure is not limited thereto. In some embodiments, the sensing device may further include a flash, an infrared (IR) light source, other sensors, electronic components, or a combination of the above, but is not limited thereto. In the present disclosure, embodiments use "pixel" or "pixel unit" as the unit for describing a specific area containing at least one functional circuit for at least one specific function. The area of a "pixel" depends on the unit used to provide a specific function, and adjacent pixels may share the same part or conductor, but may also include its own specific part therein. For example, adjacent pixels may share the same scan line or the same data line, but a pixel may also have its own transistor or capacitor. It should be noted that the technical features in the following different embodiments may be replaced, recombined, or mixed with each other without departing from the spirit of the present disclosure to form another embodiment. Please refer to FIG. 1 and FIG. 2 simultaneously. FIG. 1 is a usage scenario diagram of a head-mounted device according to an embodiment of the present disclosure. FIG. 2 is a schematic diagram of the head-mounted device according to an embodiment of the present disclosure. In this embodiment, the head-mounted device (HMD) 100 is worn on the user U and provides an image IMG to the user U. The head-mounted device 100 is, for example, any form of head-mounted display device. In this embodiment, the head-mounted device 100 includes a display unit 110, a first sensing device 120, and a second sensing device 130. The display unit 110 displays the image IMG. The first sensing device 120 detects whether there is an object OBJ that poses a hazard to the user U within a specific range PR. The second sensing device 130 captures an object image OIMG of the object OBJ, so that the display unit 110 displays the object image OIMG. Please refer to FIG. 1, FIG. 2, and FIG. 3 simultaneously. FIG. 3 is a flowchart of an operation method according to an embodiment of the present disclosure. In this embodiment, the operation method S100 is used for the head-mounted device 100. The operation method S100 includes steps S110 to S130. The user U wears the head-mounted device 100 to enjoy audio-visual entertainment or play games. The first sensing device 120 starts to detect the environment around the user U. During use, the first sensing device 120 detects in step S110 whether there is an object OBJ that may pose a hazard to the user U within a specific range PR. When the first sensing device 120 detects an object OBJ that poses a hazard to the user U within the specific range PR, the second sensing device 130 captures an object image OIMG of the object OBJ in step S120. Next, the head-mounted device 100 controls the display unit 110 to display the object image OIMG of the object OBJ in step S130. After step S130, the operation method S100 returns to the operation of step S110. It is worth mentioning here that during use, the head-mounted device 100 can detect an object OBJ that poses a hazard to the user within a specific range PR and display the object image OIMG through the display unit 110. In this way, the safety performance of using the head-mounted device 100 can be improved. On the other hand, in step S110, when the first sensing device 120 does not detect an object OBJ that poses a hazard to the user U within the specific range PR, the first sensing device 120 continues to detect in step S110 whether there is an object OBJ that may pose a hazard to the user U within the specific range PR. In this embodiment, the first sensing device 120 is an infrared light detection device. The first sensing device 120 is, for example, a long-wave infrared (LWIR) detection device. The specific range PR may be a limb movement range centered on the user U (however, the present disclosure is not limited thereto). Therefore, the limb movement range of the user U is set as the specific range PR. The specific range PR can move as the user U moves. In this embodiment, the area of the specific range PR can be determined according to the detection distance of the first sensing device 120, or the user U can set the area range of the specific range PR in the head-mounted device 100 by himself / herself. In this embodiment, the head-mounted device 100 can analyze the infrared light data IRD corresponding to the infrared light image IRIMG captured by the first sensing device 120 for the infrared light image IRIMG. For example, the head-mounted device 100 further includes a processor 140. The processor 140 is coupled to the display unit 110, the first sensing device 120, and the second sensing device 130. The head-mounted device 100 can use the processor 140 to detect whether there is an object OBJ in the infrared light image IRIMG that may cause harm to the user U. The object OBJ may be a pet, a person, a heat source, or an obstacle, but the present disclosure is not limited thereto. The obstacle may be, for example, furniture or a wall. When it is determined that there is an object OBJ in the infrared light image IRIMG that causes harm to the user U, it means that there is an object OBJ in the specific range PR that causes harm to the user U. Therefore, the processor 140 notifies the second sensing device 130 to capture the object image OIMG of the object OBJ, and controls the display unit 110 to display the object image OIMG of the object OBJ. It should be noted that the head-mounted device 100 preferentially uses the first sensing device 120 to detect the environment around the user U. Therefore, the infrared light image IRIMG shows the contours of the objects around the user U, rather than showing the true visual appearance of the objects around the user U. Therefore, the environment around the user U will not be leaked. The privacy of the user U can be protected. The color interference of the ambient light can be reduced. In addition, in the case of dim environment, the head-mounted device 100 can also determine whether there is an object OBJ in the specific range PR that causes harm to the user. In this embodiment, the head-mounted device 100 can communicate with the external device ED either wired or wirelessly. The external device ED can be, for example, an electronic device with computing capabilities such as a server, a host computer, a desktop computer, a laptop computer, a tablet computer, or a smart phone. The external device ED receives the infrared light image IRIMG. The external device ED determines whether there is an object OBJ in the infrared light image IRIMG that may pose a hazard to the user U. When it is determined that there is an object OBJ in the infrared light image IRIMG that poses a hazard to the user U, the external device ED notifies the second sensing device 130 to capture the object image OIMG of the object OBJ, and controls the display unit 110 to display the object image OIMG of the object OBJ. In some embodiments, the external device ED includes a circuit similar to the function of the processor 140. The processor 140 is, for example, a central processing unit (CPU), or other programmable general-purpose or special-purpose microprocessors, digital signal processors (DSPs), programmable controllers, application specific integrated circuits (ASICs), programmable logic devices (PLDs), or other similar devices, or a combination of these devices, which can load and execute computer programs. The second sensing device 130 can be any form of visible light image capturing device (although the present disclosure is not limited thereto). The second sensing device 130 can be implemented, for example, by a charge coupled device (CCD) or an under-display image capturing device (although the present disclosure is not limited thereto). In some embodiments, the processor 140 can be disposed inside the head-mounted device 100 for the first sensing, or the processor 140 can be disposed on other electronic devices. The head-mounted device 100 can transmit data to the processor 140 for processing through data transmission. Therefore, the first sensing device 120 itself can determine whether there is an object OBJ in the infrared light image IRIMG that may pose a hazard to the user U without the need of an external device, notify the second sensing device 130 to capture the object image OIMG of the object OBJ, and control the display unit 110 to display the object image OIMG of the object OBJ. Please refer to FIG. 2 and FIG. 4 simultaneously. FIG. 4 is a schematic diagram of a processor according to an embodiment of the present disclosure. In this embodiment, the processor 140 includes an imaging circuit 141, an analysis circuit 142, and a notification circuit 143. The imaging circuit 141 receives the infrared light data IRD from the first sensing device 120 and renders the infrared light data IRD as an infrared light image IRIMG. The infrared light image IRIMG can show the contours and temperatures of heat sources around the user U. The analysis circuit 142 is coupled to the imaging circuit 141 and the notification circuit 143. The analysis circuit 142 receives the infrared light image IRIMG and analyzes the infrared light image IRIMG to determine whether there is an object OBJ that poses a hazard to the user U within a specific range PR. When there is an object OBJ that poses a hazard to the user U within the specific range PR, the analysis circuit 142 controls the notification circuit 143 to provide a notification signal SN. Accordingly, the second sensing device 130 captures an object image OIMG of the object OBJ in response to the notification signal SN. The display unit 110 displays the object image OIMG of the object OBJ. Please refer to FIG. 1, FIG. 2, and FIG. 5 simultaneously. FIG. 5 is a flowchart of an operation method according to another embodiment of the present disclosure. The operation method S200 is for the head-mounted device 100. The operation method S200 includes steps S210 to S270. The first sensing device 120 detects the surroundings of the user U in step S210. For example, in step S210, the first sensing device 120 detects the surroundings of the user U to provide the infrared light data IRD corresponding to the infrared light image IRIMG. In step S220, the processor 140 determines whether there is an object OBJ that may pose a hazard to the user U within the specific range PR. For example, in step S220, the processor 140 can use the infrared light data IRD to determine whether there is an object OBJ within the specific range PR. When the object OBJ is outside the specific range PR, the operation method S200 returns to the operation of step S210. In addition, when the object OBJ is outside the specific range PR, the processor 140 stops providing the notification signal SN. On the other hand, when the object OBJ is within the specific range PR, the processor 140 further determines the movement of the object OBJ within the specific range PR in step S230. In step S230, when the object OBJ within the specific range PR is moving away from the user U, the processor 140 determines that the object OBJ moving away from the user U will not pose a hazard to the user U. For example, the processor 140 determines that the contour of the infrared light image IRIMG within the specific range PR is rapidly shrinking. Therefore, the operation method S200 returns to the operation of step S210. In addition, when the object OBJ within the specific range PR moves away from the user U, the processor 140 stops providing the notification signal SN. In step S230, when the object OBJ within the specific range PR is approaching the user U, the processor 140 determines that the object OBJ approaching the user U will pose a hazard to the user U. For example, the processor 140 determines that the contour of the infrared light image IRIMG within the specific range PR is rapidly expanding. Therefore, the processor 140 provides the notification signal SN in step S240. Accordingly, the head-mounted device 100 alerts the user U based on the notification signal SN. For example, the display unit 110 can provide a warning light signal. When the moving speed of the object OBJ approaching the user U increases, the warning light signal becomes more prominent. For example, the blinking frequency or brightness of the warning light signal increases). In some embodiments, the head-mounted device 100 can provide a warning sound to alert the user U in step S240. When the moving speed of the object OBJ approaching the user U increases, the warning sound becomes more prominent. For example, the rhythm of the warning sound speeds up or the volume increases. In addition, in step S240, the second sensing device 130 captures the object image OIMG of the object OBJ in response to the notification signal SN. The display unit 110 displays the object image OIMG of the object OBJ. In step S250, the warning provided by the head-mounted device 100 is adjusted or cancelled. For example, when the user U learns through the display unit 110 that the object OBJ is approaching, the user U can move away from the object OBJ or move the object OBJ to a safe area. Accordingly, the user U cancels the warning through the head-mounted device 100. For example, when the user U learns through the display unit 110 that the approaching object OBJ will not pose a hazard, the user U adjusts the warning conditions through the head-mounted device 100. Therefore, the processor 140 can learn the infrared light image of the object OBJ that does not pose a hazard. For example, when the user U learns through the display unit 110 that the specific range PR needs to be adjusted, the user U adjusts the specific range PR through the head-mounted device 100. Accordingly, the warning conditions are also adjusted. After step S250, the operation method S200 returns to the operation of step S210. In step S230, when the object OBJ within the specific range PR does not approach or move away from the user U, it means that the object OBJ stays around the user U without moving. For example, the processor 140 determines that the size of the contour of the infrared light image IRIMG within the specific range PR has not changed. Therefore, the processor 140 provides a notification signal SN in step S260. The second sensing device 130 captures the object image OIMG of the object OBJ in response to the notification signal SN. The display unit 110 displays the object image OIMG of the object OBJ. In addition, the head-mounted device 100 alerts the user U based on the notification signal SN. In step S270, when the object OBJ continues to stay, the user U can selectively cancel the alert provided by the head-mounted device 100 for the object OBJ. After step S270, the operation method S200 returns to the operation of step S210. Please refer to FIGS. 1, 2, and 6 simultaneously. FIG. 6 is a flowchart of an operation method according to an embodiment of the present disclosure. The operation method S300 is for the head-mounted device 100. The operation method S300 includes steps S310 to S350. The first sensing device 120 detects the surroundings of the user U in step S310. For example, in step S310, the first sensing device 120 detects the surroundings of the user U, for example, to provide infrared light data IRD corresponding to the infrared light image IRIMG. In step S320, the processor 140 determines whether there is a high-temperature area around the user U. The high-temperature area is, for example, a heat source having a temperature greater than a predetermined temperature. In step S320, the processor 140 can use the infrared light data IRD to determine whether there is a high-temperature area around the user U. When there is no high-temperature area around the user U, the operation method S300 returns to the operation of step S310. On the other hand, when there is a high-temperature area around the user U, the processor 140 further determines the change of the high-temperature area in step S330. In step S330, when the high-temperature area does not change over time, it means that the high-temperature area may be a fixed heat source (such as a heater or an electric lamp). Therefore, the processor 140 does not provide a notification signal SN. The operation method S300 returns to the operation of step S310. In step S330, when the area of the high-temperature area increases over time, it means that the heat source is gradually approaching the user U or the heat source is expanding. Therefore, the processor 140 provides a notification signal SN in step S340. Therefore, the head-mounted device 100 alerts the user U based on the notification signal SN. The second sensing device 130 captures the surrounding image in response to the notification signal SN. The display unit 110 displays the surrounding image. In addition, when the temperature in the high-temperature area rises rapidly, the processor 140 also provides a notification signal SN in step S340. The head-mounted device 100 alerts the user U. The second sensing device 130 captures the surrounding image. The display unit 110 displays the surrounding image. Please refer to FIG. 1 and FIG. 7 simultaneously. FIG. 7 is a schematic diagram of a head-mounted device according to an embodiment of the present disclosure. FIG. 7 shows schematic diagrams of the head-mounted device 200 at different viewing angles. In this embodiment, the head-mounted device 200 includes a display unit (not shown), a first sensing device 220, a second sensing device 230, a headband 250, and an eyepiece 260. The display unit is disposed on the eyepiece 260. The head-mounted device 200 can be worn on the head of the user U through the headband 250. The first sensing device 220 includes first sensors 220_1 and 220_2. The second sensing device 230 includes second sensors 230_1 to 230_4. In this embodiment, the first sensors 220_1 and 220_2 are disposed on the headband 250 and the eyepiece 260. The second sensors 230_1 to 230_4 are disposed on the headband 250 and the eyepiece 260. Taking this embodiment as an example, the first sensor 220_1 is disposed on the front surface of the eyepiece 260. The first sensor 220_2 is disposed on the headband 250. When the user U wears the head-mounted device 200, the first sensor 220_1 detects forward towards the user U. The first sensor 220_2 detects backward towards the user U. The second sensor 230_1 is disposed on the front surface of the eyepiece 260. The second sensor 230_2 is disposed on the headband 250. The second sensor 230_3 is disposed on the left side surface of the eyepiece 260. The second sensor 230_4 is disposed on the right side surface of the eyepiece 260. Taking this embodiment as an example, the detectable angles (or viewing angles) of the first sensors 220_1 and 220_2 are approximately 180˚. The detectable angles of the second sensors 230_1 to 230_4 can reach approximately 120˚. Based on the setting in FIG. 7, the first sensing device 220 can detect the infrared light image around the user U. The second sensing device 230 can capture the visible light image around the user U. This embodiment takes two first sensors 220_1 and 220_2 and four second sensors 230_1 to 230_4 as examples, but the present disclosure is not limited thereto. The present disclosure can determine the setting positions and the number of the first sensors based on the detectable angle and / or the detection wavelength of the first sensors. The present disclosure can determine the setting positions and the number of the second sensors based on the detectable angle of the second sensors. Please refer to FIG. 1 and FIG. 8 simultaneously. FIG. 8 is a schematic diagram of a head-mounted device according to an embodiment of the present disclosure. In this embodiment, the head-mounted device 200' includes a display unit (not shown), a first sensing device 220, a second sensing device 230, a headband 250, and an eyepatch 260. The first sensing device 220 includes first sensors 220_1 and 220_2. The second sensing device 230 includes second sensors 230_1 to 230_5. Taking this embodiment as an example, the first sensor 220_1 is disposed on the front surface of the eyepatch 260. The first sensor 220_2 is disposed on the headband 250. When the user U wears the head-mounted device 200, the first sensor 220_1 detects forward towards the user U. The first sensor 220_2 detects backward towards the user U. The second sensors 230_1 and 230_2 are disposed on the front surface of the eyepatch 260. The second sensor 230_1 is disposed at a position of the eyepatch 260 corresponding to the left eye of the user U. The second sensor 230_2 is disposed at a position of the eyepatch 260 corresponding to the right eye of the user U. The second sensor 230_3 is disposed on the headband 250. The second sensor 230_4 is disposed on the right side surface of the eyepatch 260. The second sensor 230_5 is disposed on the left side surface of the eyepatch 260. Based on the arrangement in FIG. 8, the first sensing device 220 can detect the infrared light image around the user U. The second sensing device 230 can capture the visible light image around the user U. In addition, it should be noted that the setting positions of the second sensors 230_1 and 230_2 correspond to the positions of the user U's two eyes. The visible light images captured by the second sensors 230_1 and 230_2 contribute to generating a 3D stereoscopic image. Please refer to FIG. 9. FIG. 9 is a schematic diagram of the display unit and the first sensor according to an embodiment of the present disclosure. In this embodiment, FIG. 9 shows the display unit 210 and the first sensor 220_1. In this embodiment, the display unit 210 includes a plurality of display pixels PD and a substrate SB. The plurality of display pixels PD are disposed on the substrate SB. The first sensor 220_1 includes a plurality of sensing pixels PS. The plurality of sensing pixels PS can be arranged in an array on the substrate SB. In other words, the first sensor 220_1 and the plurality of display pixels PD of the display unit 210 are disposed on the same substrate SB. In this embodiment, the display unit 210 is a transparent display panel. The substrate SB may be a glass substrate (although the present disclosure is not limited thereto). In some embodiments, the substrate SB may be a flexible substrate. In this embodiment, the layout positions of the plurality of display pixels PD are substantially the same as the layout positions of the plurality of sensing pixels PS. In addition, the size positions of the plurality of display pixels PD are substantially the same as the sizes of the plurality of sensing pixels PS. Therefore, the corresponding regions between the plurality of display pixels PD and between the plurality of sensing pixels PS may have transparency. In this embodiment, the transparency of the display unit 210 is adjusted so that a user can view the external environment through the display unit 210. In this way, the user can view the external environment without removing the head-mounted device. In this embodiment, the plurality of sensing pixels PS are each a micro electro mechanical (MEM) structure. The plurality of sensing pixels PS may each include foot pads PAD1, PAD2, a resistor structure CN, and a sensing structure SL. The resistor structure CN is electrically connected to the foot pads PAD1 and PAD2. The sensing structure SL partially covers and contacts the resistor structure CN. The sensing structure SL can change the impedance value of the resistor structure CN according to infrared light. The sensing structure SL may be a heat absorption structure, a metal, or a material that easily absorbs infrared light bands. The first sensor 220_1 provides infrared light data corresponding to the infrared light image (the infrared light data IRD of the infrared light image IRIMG shown in FIG. 2) according to the change in the impedance value. The first sensor 220_1 can receive, for example, the signal current generated by the sensing pixel PS due to impedance change through the foot pads PAD1 and PAD2. Please refer to FIG. 9 and FIG. 10 simultaneously. FIG. 10 is a schematic diagram of a display unit and a first sensor according to an embodiment of the present disclosure. In this embodiment, FIG. 10 shows the display unit 210 and the first sensor 220_1. The first sensor 220_1 is attached to the display unit 210. For example, the plurality of display pixels PD are disposed on a first side of the substrate SB. The first sensor 220_1 is attached to a second side of the substrate SB. The second side is opposite to the first side. The positions of the plurality of display pixels PD correspond to the positions of the plurality of sensing pixels PS. Therefore, the region between the plurality of display pixels PD has transparency. Please refer to FIG. 7 and FIG. 11 simultaneously. FIG. 11 is a schematic diagram of a display unit and a mask according to an embodiment of the present disclosure. In this embodiment, the head-mounted device 200 further includes a mask 270. The display unit 210 is a transparent display panel. The mask 270 is operated to cover the display unit 210. Therefore, the mask 270 can block the light L from the external environment. The immersion experience of the head-mounted device 200 can be enhanced. On the other hand, the mask 270 is moved so as not to cover the display unit 210. The light L from the external environment penetrates the display unit 210. Therefore, the user can view the external environment through the display unit 210. Please refer to FIG. 9 and FIG. 12A simultaneously. FIG. 12A is a schematic diagram of a display unit, a first sensor, and a mask according to an embodiment of the present disclosure. In this embodiment, the head-mounted device 200 further includes a mask 270. The display unit 210 is a transparent display panel. The first sensor 220_1 is attached to the display unit 210. There may be transparency between the plurality of display pixels PD and the plurality of sensing pixels PS. The light L from the external environment can penetrate the first sensor 220_1 and the display unit 210. In this embodiment, the mask 270 is operated to cover the display unit 210 and the first sensor 220_1, thereby blocking the light L from the external environment. Therefore, the immersion experience of the head-mounted device 200 can be enhanced. On the other hand, the mask 270 is moved so as not to cover the display unit 210. The light L from the external environment penetrates the display unit 210 and the first sensor 220_1. Therefore, the user can view the external environment through the display unit 210 and the first sensor 220_1. Please refer to FIG. 9 and FIG. 12B simultaneously. FIG. 12B is a schematic diagram of a display unit, a first sensor, and a mask according to an embodiment of the present disclosure. In this embodiment, the display unit 210 is a transparent display panel. The first sensor 220_1 is not attached to the display unit 210. However, the positions of the plurality of display pixels PD correspond to the positions of the plurality of sensing pixels PS. Therefore, the light L from the external environment can still penetrate the first sensor 220_1 and the display unit 210. When the mask 270 is operated to cover the display unit 210, the mask 270 is located between the first sensor 220_1 and the display unit 210. The mask 270 can block the light L from the external environment. The immersion experience of the head-mounted device 200 can be enhanced. On the other hand, the mask 270 is moved so as not to cover the display unit 210. The light L from the external environment penetrates the display unit 210. Therefore, the user can view the external environment through the display unit 210 and the first sensor 220_1. In summary, the first sensing device detects whether there is an object that poses a hazard to the user within a specific range. When an object that poses a hazard to the user is detected within the specific range, the display unit displays the object image of the object. In this way, the head-mounted device can know that there is an object that poses a hazard to the user within the specific range and display the object image of the object through the display unit. The safety performance of the head-mounted device can be improved. In addition, in one embodiment, the first sensing device is an infrared light detection device. The head-mounted device preferentially uses the first sensing device to detect the environment around the user. The infrared light image shows the outline of the objects around the user, rather than the true visual appearance of the objects around the user. Therefore, the environment around the user will not be leaked. The privacy of the user can be protected. In addition, in a dim environment, the head-mounted device can also determine whether there is an object that poses a hazard to the user within the specific range. Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present disclosure and are not intended to limit them. Although the present disclosure has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements on some or all of the technical features. And these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the embodiments of the present disclosure. 100, 200, 200’: Head-mounted device 110, 210: Display unit 120, 220: First sensing device 130, 230: Second sensing device 140: Processor 141: Image circuit 142: Analysis circuit 143: Notification circuit 220_1, 220_2: First sensor 230_1~230_5: Second sensor 250: Headband 260: Eyecup 270: Mask CN: Resistance structure ED: External device IMG: Image IRD: Infrared light data IRIMG: Infrared light image L: Light of the external environment OBJ: Object OIMG: Object image PAD1, PAD2: Foot pad PD: Display pixel PR: Specific range PS: Sensing pixel S100, S200, S300: Operating method S110~S130, S210~S270, S310~S340: Steps SB: Substrate SL: Induction structure SN: Notification signal U: User FIG. 1 is a usage scenario diagram of a head-mounted device according to an embodiment of the present disclosure. FIG. 2 is a schematic diagram of a head-mounted device according to an embodiment of the present disclosure. FIG. 3 is a flowchart of an operation method according to an embodiment of the present disclosure. FIG. 4 is a schematic diagram of a processor according to an embodiment of the present disclosure. FIG. 5 is a flowchart of an operation method according to an embodiment of the present disclosure. FIG. 6 is a flowchart of an operation method according to an embodiment of the present disclosure. FIG. 7 is a schematic diagram of a head-mounted device according to an embodiment of the present disclosure. FIG. 8 is a schematic diagram of a head-mounted device according to an embodiment of the present disclosure. FIG. 9 is a schematic diagram of a display unit and a first sensor according to an embodiment of the present disclosure. FIG. 10 is a schematic diagram of a display unit and a first sensor according to an embodiment of the present disclosure. FIG. 11 is a schematic diagram of a display unit and a mask according to an embodiment of the present disclosure. FIGS. 12A and 12B are schematic diagrams of a display unit, a first sensor, and a mask according to an embodiment of the present disclosure, respectively. 100: Head-mounted device 110: Display unit 120: First sensing device 130: Second sensing device 140: Processor IMG: Image IRD: Infrared light data IRIMG: Infrared light image OIMG: Object image PR: Specific range SN: Notification signal

Claims

1. A head-mounted device, wherein the head-mounted device is worn on a user and provides an image to the user, wherein the head-mounted device comprises: A display unit is configured to display the image; A first sensing device is configured to detect a specific range to generate an infrared light image; A processor, coupled to the first sensing device and the display unit, is configured to determine whether there is an object in the infrared light image that poses a hazard to the user, wherein the object is at least one of a pet, a person, a heat source, and an obstacle approaching the user; A second sensing device configured to capture an object image of the object, thereby causing the display unit to display the object image; a headband; and an eye mask, wherein the first sensing device includes a plurality of first sensors, the second sensing device includes a plurality of second sensors, the plurality of first sensors being disposed on the headband and the eye mask, and the plurality of second sensors being disposed on the headband and the eye mask.

2. The head-mounted device as claimed in claim 1, wherein the first sensing device is an infrared light detection device.

3. The head-mounted device as claimed in claim 1, wherein the user's range of motion is set to the specific range.

4. The head-mounted device as claimed in claim 1, wherein: One of the second sensors is positioned on the goggles at the location corresponding to the user's left eye, and the other of the second sensors is positioned on the goggles at the location corresponding to the user's right eye.

5. The head-mounted device as claimed in claim 1, wherein at least one of the plurality of first sensors and the plurality of display pixels of the display unit are disposed on the same substrate.

6. The head-mounted device as claimed in claim 1, wherein at least one of the plurality of first sensors is attached to the display unit.

7. The head-mounted device as claimed in claim 1, wherein: The display unit is a transparent display panel, and the transparency of the display unit is adjusted so that the user can view the external environment through the display unit.

8. The head-mounted device as claimed in claim 7, wherein the head-mounted device further comprises: A mask is operated to cover the display unit to block light from the external environment, and is moved to not cover the display unit so that the light from the external environment can pass through the display unit.

9. A method of operating a head-mounted device, wherein the head-mounted device is worn on a user and provides an image to the user, wherein the head-mounted device includes a display unit, a first sensing device, a processor, a second sensing device, a headband, and an eye mask, wherein the method of operating the device includes: The first sensing device detects a specific range to generate an infrared image; The processor determines whether there is an object in the infrared image that poses a hazard to the user, wherein the object is at least one of a pet, a person, a heat source, and an obstacle approaching the user; when an object posing a hazard to the user is detected within a specific range, the second sensing device captures an image of the object; and the display unit is controlled to display the image of the object, wherein the first sensing device includes a plurality of first sensors, the second sensing device includes a plurality of second sensors, the plurality of first sensors are disposed on the headband and the goggles, and the plurality of second sensors are disposed on the headband and the goggles.

Citation Information

Patent Citations

  • Camera-based security mechanisms for head-mounted display users

    CN105705210B

  • VR (virtual reality) equipment with obstacle prompting function

    CN107967063A

  • Six-degree-of-freedom VR glasses

    CN112085777A

  • Shield maintenance assisting method and system based on AR technology

    CN113570732A

  • Systems and methods for generating dynamic obstacle collision warnings for head-mounted displays

    TW202113428A