Wearable display apparatus and control method thereof

Abstract

A wearable display apparatus according to one embodiment of the present invention comprises: a communication unit which receives ultrasonic image data; a display unit which overlaps at least a portion of a lens unit and displays the ultrasonic image data as an ultrasonic image; and a control unit electrically connected to the lens unit, the communication unit, and the display unit, wherein the control unit can control at least one of the brightness or color of the display unit on the basis of image characteristics of the ultrasonic image data, and control the opacity of the lens unit on the basis of the position of a virtual region in which the ultrasonic image is displayed.

Description

Wearable display device and method for controlling the display device

[0001] The disclosed invention relates to a wearable display device and a control method thereof, and more specifically, to an invention relating to an Augmented Reality (AR) wearable display device capable of overlapping and displaying virtual elements on the real world, and a control method thereof.

[0002] In general, a display device is a type of output device that converts acquired or stored electrical information into visual information and displays it to the user, and is used in various fields such as homes and businesses.

[0003] A display device includes a light source module for converting electrical information into visual information, and the light source module includes a plurality of light sources for independently emitting light. Each of the plurality of light sources includes, for example, a light emitting diode (LED) or an organic light emitting diode (OLED).

[0004] As technology advances, display devices are being proposed in various forms, such as wearable displays implemented in the form of glasses that can be worn by users.

[0005] Wearable display devices have been actively used in the medical field due to their ability to project virtual elements or provide information into the user's field of vision. However, the display's brightness and color are not adjusted in sync with the virtual image being output, making it difficult to view the virtual image clearly. Furthermore, the lens's transparency cannot be adjusted, making it difficult to simultaneously view the virtual image and the real world.

[0006] The disclosed invention aims to eliminate user inconvenience in viewing a real view and a virtual image simultaneously by adjusting the brightness and color of a display unit based on the image characteristics of ultrasonic image data and adjusting the opacity of a lens unit depending on the position where the ultrasonic image is displayed.

[0007] A wearable display device according to one embodiment includes: a lens unit; a communication unit that receives ultrasound image data; a display unit that overlaps at least a portion of the lens unit and displays the ultrasound image data as an ultrasound image; and a control unit that is electrically connected to the lens unit, the communication unit, and the display unit, and controls at least one of brightness or color of the display unit based on an image characteristic of the ultrasound image data and controls opacity of the lens unit based on a position at which the ultrasound image is displayed.

[0008] A method for controlling a wearable display device according to one embodiment includes the steps of: receiving ultrasonic image data; extracting image characteristics from the ultrasonic image data; controlling at least one of brightness or color of a display unit based on the image characteristics of the ultrasonic image data; and controlling opacity of a lens unit based on a position at which an ultrasonic image is displayed.

[0009] According to the disclosed wearable display and its control method, visibility can be improved and user convenience can be ensured by adjusting the brightness and color of the display unit based on image characteristics and surrounding environmental characteristics and adjusting the opacity of the lens unit based on the location of the virtual area, which is the portion displaying the ultrasound image and object.

[0010] FIG. 1 is a diagram illustrating a wearable display device communicating with an ultrasonic imaging device according to one embodiment.

[0011] FIG. 2 is a perspective view showing the exterior of a wearable display according to one embodiment.

[0012] Figure 3 is a control block diagram for controlling a wearable display device.

[0013] FIG. 4 is a diagram for explaining an operating principle for simultaneously viewing an ultrasound image and a reality view on a wearable display device according to one embodiment.

[0014] Figure 5 is a drawing showing the structure of the display unit.

[0015] FIG. 6 is a diagram illustrating a field of view when a user uses a wearable device according to one embodiment.

[0016] FIG. 7 is a diagram illustrating a virtual area displayed in a field of view by a display unit according to one embodiment.

[0017] FIG. 8 is a diagram illustrating a virtual area displayed in a field of view by a display unit according to another embodiment.

[0018] FIG. 9 is a diagram according to one embodiment for explaining the black and white ratio among the image characteristics of an ultrasound image.

[0019] Fig. 10 is a drawing according to another embodiment for explaining the black and white ratio among the image characteristics of an ultrasound image.

[0020] FIG. 11 is a drawing for explaining contrast among image characteristics of an ultrasound image according to one embodiment.

[0021] Figure 12 is a drawing that corresponds the segments of the field of view and the lens section.

[0022] Figure 13 is a drawing for explaining extracting a segment corresponding to a segmentation area corresponding to a virtual area.

[0023] FIG. 14 is a diagram illustrating a plurality of objects constituting a virtual area according to one embodiment.

[0024] FIG. 15 is a diagram illustrating a plurality of objects constituting a virtual area according to another embodiment.

[0025] Figure 16 is a flowchart for explaining a control sequence in which a control unit adjusts the brightness of a display unit based on the characteristics of an ultrasound image.

[0026] Figure 17 is a flowchart for explaining a control sequence in which a control unit adjusts the brightness of a display unit based on the characteristics of an image and the characteristics of the surrounding environment.

[0027] Figure 18 is a drawing for explaining the order in which the control unit adjusts the color displayed by the display unit based on the image characteristics and the surrounding environment characteristics.

[0028] Figure 19 is a drawing for explaining the sequence of partially adjusting the opacity of the lens part based on the location of the virtual area where the ultrasound image is displayed.

[0029] Figure 20 is a drawing for explaining the order of partially adjusting the opacity of the lens part based on the position at which the object constituting the virtual area is displayed.

[0030] The embodiments described in this specification and the configurations illustrated in the drawings are merely preferred examples of the disclosed invention, and there may be various modified examples that can replace the embodiments and drawings of this specification at the time of filing of this application.

[0031] The terminology used herein is for the purpose of describing embodiments only and is not intended to limit and / or restrict the disclosed invention.

[0032] For example, in this specification, a singular expression may include a plural expression unless the context clearly indicates otherwise.

[0033] In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" may include any one of the items listed together in that phrase, or all possible combinations thereof.

[0034] The term "and / or" includes any combination of a plurality of related described elements or any one of a plurality of related described elements.

[0035] Terms such as "first," "second," or "first" or "second" may be used simply to distinguish one component from another and do not qualify the components in any other respect (e.g., importance or order).

[0036] When a component (e.g., a first component) is referred to as being "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0037] The terms "include" or "have" are intended to specify the presence of a feature, number, step, operation, component, part or combination thereof described in this document, but do not preclude the presence or addition of one or more other features, numbers, steps, operations, components, parts or combinations thereof.

[0038] When a component is said to be “connected,” “coupled,” “supported,” or “in contact with” another component, this includes not only cases where the components are directly connected, coupled, supported, or in contact, but also cases where the components are indirectly connected, coupled, supported, or in contact through a third component.

[0039] When we say that a component is "on" another component, this includes not only cases where the component is in contact with the other component, but also cases where there is another component between the two components.

[0040] Additionally, terms such as "~part", "~device", "~block", "~absence", and "~module" may refer to a unit that processes at least one function or operation. For example, the terms may refer to at least one hardware such as an FPGA (field-programmable gate array) / ASIC (application specific integrated circuit), at least one software stored in a memory, or at least one process processed by a processor.

[0041] Hereinafter, a wearable display device according to various embodiments will be specifically described with reference to the attached drawings.

[0042] FIG. 1 is a drawing illustrating a wearable display device (1) communicating with an ultrasonic imaging device (2) according to one embodiment.

[0043] Referring to FIG. 1, an ultrasonic imaging device (2) according to one embodiment may include a main body (M) and a probe (P).

[0044] The main body (M) may include a control panel (100), and may receive commands for operating the ultrasonic imaging device (2) from a user through the control panel (100).

[0045] When the main body (M) receives various control commands from the user, it can apply a transmission pulse to the probe (P) so that ultrasonic waves are transmitted from the probe (P). The ultrasonic waves transmitted from the probe (P) can be reflected from the target object and incident on the probe (P).

[0046] At this time, the main body (M) can convert the ultrasonic signal incident on the probe (P) into an analog / digital signal and acquire ultrasonic data.

[0047] The main body (M) can receive ultrasound data and acquire and process ultrasound image data through an image processing process to generate an A-mode image, a B-mode image, a D-mode image, an E-mode image, an M-mode image, a Doppler image, a 3D ultrasound image, and / or a 4D ultrasound image based on the received ultrasound data.

[0048] The main body (M) can transmit the processed ultrasound image data to a display (200) or wearable display (1) constituting the main body (M).

[0049] Meanwhile, the appearance of the main body (M) according to one embodiment is not limited to the example of FIG. 1, and the main body (M) may also be implemented in a portable form. If the main body (M) is implemented in a portable form, it may have a shape similar to a laptop computer, PDA, tablet PC, etc.

[0050] The probe (P) is connected to the main body (M) of the ultrasonic imaging device (2) via a cable or wirelessly, and can receive various signals necessary for controlling the probe (P) from the main body (M).

[0051] A series of operations performed in the main body (M) may be performed in the probe (P). For example, although the conversion of an ultrasonic signal into an analog / digital signal has been described as being performed in the main body (M) of the ultrasonic imaging device (2), it may also be performed by the probe (P). In this case, the probe (P) may transmit an analog signal or a digital signal corresponding to the ultrasonic echo signal to the main body (200).

[0052] The probe (P) may be one of a matrix probe, a curved array probe, a phased array probe, a volume probe, an endocavity probe, a convex probe, or a 3D probe, or may be a type of probe other than the above-mentioned probes.

[0053] A wearable display device (1) can be connected wirelessly or wired to an ultrasound imaging device (2) or a wireless probe (not shown), and can display an ultrasound image based on received ultrasound image data. The ultrasound image can include at least one of audio and video. For example, a 2D ultrasound image or a 3D rendered image can be displayed. A specific configuration of the wearable display (1) will be described later with reference to FIG. 2.

[0054] Fig. 2 is a perspective view showing the exterior of a wearable display device (1) according to one embodiment.

[0055] Referring to FIG. 2, a wearable display device (1) may be implemented in the shape of glasses, and may be configured to be worn on a user's ears, and may include a front frame (10) that accommodates a plurality of components for simultaneously viewing an ultrasound image and a reality view, a temple frame (11) that can be folded or unfolded, a lens unit (400) that is supported by the front frame (10) and covers the user's left and right eyes, and a display unit (300) that overlaps at least a portion of the lens unit (400) and displays an ultrasound image.

[0056] The real view refers to an image that appears on the retina of the user's eye when external light passes through the display unit (300) and lens unit (400) when the user wears the wearable display device (2).

[0057] The front frame (10) forms the outer appearance of the wearable display device (1). The front frame (10) is not limited to that illustrated in FIG. 2, and its material and shape are not limited. The front frame (10) may include a camera (700) capable of photographing the inspection target or the surrounding environment.

[0058] The temple frame (11) is foldable and unfoldable for mounting the wearable display device (1) on the user's body. Its shape and material are not limited to those illustrated in Fig. 2.

[0059] The temple frame (11) may be provided with components for outputting images and sounds from a wearable display device (1) within it. For example, the temple frame (11) may include a speaker (not shown) for outputting sounds or a sensor unit (700, not shown) including various sensors for detecting characteristics of the surrounding environment.

[0060] The temple frame (11) is positioned on the user's ear, so that the display unit (300) and lens unit (400) can be positioned at a fixed position on the user's face. Even if the user turns their head or moves during an ultrasound examination, the ultrasound image can be displayed at a fixed position from the user's face.

[0061] The display unit (300) can be assembled with the front frame (10) to display an ultrasound image. The display unit (300) can be implemented by various types of display panels, such as an LCD panel (Liquid Crystal Display Panel, LCD Panel), an LED panel (Light Emitting Diode Panel, LED Panel), or an OLED panel (Organic Light Emitting Diode Panel, OLED Panel). The display unit (300) can be implemented as a transparent display.

[0062] The lens unit (400) may include a lens made of a transparent material to allow light transmission, a thin film that comes into contact with the lens and includes an electrochromic material for controlling the opacity of the lens, a voltage control circuit for controlling the voltage applied to the thin film for controlling the opacity, and a voltage supply device. As the electrochromic material, P2HT (Poly(2,5-dihydrothieno[3,4-b][1,4]dioxin)) or MEH-PPV (Poly[2-methoxy-5-(2-ethylhexyloxy)-1,4-phenylenevinylene]) may be used.

[0063] Additionally, it may include a safety protection device to protect the lens from excessive pressure or high temperature and ensure the safety of the user.

[0064] Fig. 3 is a control block diagram for controlling a wearable display device (1).

[0065] Referring to FIG. 3, a wearable display device (10) may include a display unit (300) that displays an ultrasound image, a lens unit (400) that can partially adjust opacity, a main body (M), a probe (P), and a communication unit (500) that can transmit and receive data by communicating with other devices, and a control unit (600).

[0066] Additionally, it may further include a camera (700) for capturing images of the surrounding environment, and a sensor unit (800) for detecting the illuminance of the surrounding environment, the color of the structure, the complexity, etc.

[0067] The display unit (300) may include a plurality of pixels that serve as units for displaying images. Each pixel outputs an optical signal, and an ultrasound image may be displayed on the display unit (300) by combining the optical signals output by each pixel.

[0068] Specifically, in order to emit light of various brightnesses, each of the plurality of pixels may include a configuration capable of directly emitting light from the pixel (e.g., an organic light-emitting diode panel) or a configuration capable of transmitting or blocking light emitted by a backlight unit or the like (e.g., a liquid crystal panel).

[0069] Additionally, each of the plurality of pixels may include a plurality of sub-pixels to emit light of various colors, and the sub-pixels may include a red sub-pixel capable of emitting red light, a green sub-pixel capable of emitting green light, and a blue sub-pixel capable of emitting blue light.

[0070] At this time, the RGB values ​​of the subpixels can generally be expressed as integers from 0 to 255. Each red (R), green (G), and blue (B) subpixel can have one of the values ​​from 0 to 255, which can be used to express various color combinations.

[0071] The display unit (300) projects an ultrasonic image onto the user's eyes based on the ultrasonic image data received by the communication unit (500). The principle by which the display unit (300) displays an image will be described later with reference to FIG. 5.

[0072] The lens unit (400) can partially control the opacity of external light transmitted into the user's eyes by arranging electrochromic materials in each region and connecting circuits to each region to apply different voltages to each location. Electrochromic materials can change the alignment of molecules or particles or change their structure when exposed to an electric field between liquid crystal materials or electrodes, thereby changing the light transmission or reflection characteristics.

[0073] Based on the aforementioned principle, the opacity can be partially adjusted depending on the position at which the ultrasound image is displayed in the field of view, as described below with reference to FIGS. 12 and 13.

[0074] At this time, the field of view (FOV) represents the range of the virtual area recognized when the user wears and uses the wearable device (1).

[0075] The communication unit (500) can perform two-way communication with various devices via wired or wireless means. For example, wireless communication is performed according to two-way RF wireless communication standards such as RF (radio frequency), Bluetooth, and Wi-Fi.

[0076] The communication unit (500) may include an image receiving unit capable of receiving ultrasonic image data from an ultrasonic diagnostic device (2) or probe (P).

[0077] The control unit (600) is electrically connected to the display unit (300), the lens unit (400), the communication unit (500), and other components. The control unit (600) may include a processor (601) that controls the operation of the display unit (300) or the lens unit (400) based on ultrasonic image data received from the communication unit (500), and a storage unit (602) that stores data received from the main body (M), the probe (P), or other devices and data regarding initial settings. The type of data is not limited.

[0078] The control unit (600) including the processor (601) can adjust the brightness or color of the display unit (300) based on the ultrasonic image data received by the communication unit (500). In addition, the control unit (600) including the processor (601) can extract a segment of the lens unit (400) corresponding to a distinct area where the ultrasonic image is displayed in the field of view, and adjust the opacity only for the extracted segment.

[0079] The control unit (600) can control the display unit (300) and the lens unit (400) simultaneously or separately. Additionally, the control unit (600) can also control the on / off and operation mode of the camera (700) or the sensor unit (800).

[0080] The control unit (600) can determine whether the inspection is finished based on the power on / off data of the ultrasonic diagnostic device (2) received by the communication unit (500) or the position data by the gyro sensor of the probe (P).

[0081] The power supply unit (900) provides power for the operation of the components of the wearable display device (1). The power supply unit (900) is not limited, but is preferably implemented as a rechargeable secondary battery for the user's activity. The power supply unit (900) can be controlled by the control unit (600) to determine whether power is supplied to each component of the wearable display device (1), the magnitude of the output voltage, etc.

[0082] In the following description, only the right eye of the user is displayed and the description is based on the right eye. However, since the structure related to the user's right eye and the structure related to the user's left eye in the display unit (300) are mutually symmetrical, the present disclosure is not limited thereto and can be equally applied to the left eye. Therefore, for convenience, the description is based on the right eye.

[0083] FIG. 4 is a drawing for explaining an operating principle for simultaneously viewing an ultrasound image and a reality view on a wearable display device (1) according to one embodiment.

[0084] Referring to FIG. 4, the display unit (300) overlaps at least a portion of the lens unit (400) and may be located on one of the two sides of the lens unit (400) that is closer to the user's eyes.

[0085] External light passes through the lens unit (400) and reaches the user's eyes. If the display unit (300) is implemented as a transparent display, it can pass through both the lens unit (400) and the display unit (300) and reach the user's eyes. The light reaching the user's eyes is focused on the user's retina, allowing the user to see a realistic view.

[0086] At this time, the display unit (300) can display an ultrasonic image in front of the user based on ultrasonic image data received through the communication unit (500), and the principle thereof will be described in detail later with reference to FIG. 5.

[0087] This allows the user to view the real view and the ultrasound image simultaneously, thereby increasing efficiency and convenience by eliminating the need to turn the head or move the seat to alternately view the display (200) located on the main body (M) and the object.

[0088] Referring to FIG. 5 below, the structure of the display unit (300) and the principle by which the display unit (300) displays an ultrasound image are described together.

[0089] Figure 5 is a drawing showing the structure of the display unit (300).

[0090] According to FIG. 5, the display unit (300) may include a display element (301), a first mirror (302), and a second mirror (303). The present disclosure describes the display element (301) as being located within the display unit (300), but may also be located in the temple frame (11). In addition, the present disclosure describes the display unit including the first mirror (302) and the second mirror (303), but is not limited thereto and may include more mirrors and components.

[0091] The display element (301) includes a liquid crystal panel and displays an image based on ultrasonic image data received from the communication unit (500). The display element (301) can be implemented as an LCD panel or an OLED panel, and may further include a TFT (Thin-Film Transistor) as needed.

[0092] The first mirror (302) is located inside the display unit (300) at a position away from the user's line of sight. The first mirror (302) can totally reflect the image displayed on the display element (301).

[0093] The second mirror (303) can be implemented as semi-transparent, positioned so that the line of sight passes through the second mirror, and causes an image to be formed on the second mirror (303) by at least a portion of the light incident from the first mirror (302).

[0094] At this time, the user can recognize the image formed on the second mirror (303).

[0095] Hereinafter, based on the aforementioned content, the field of view range that a user can see while wearing a wearable device (1) will be described with reference to FIGS. 6 to 9.

[0096] FIG. 6 is a drawing illustrating a field of view (60) when a user uses a wearable device (1) according to one embodiment.

[0097] As described above, the field of view (FOV) indicates the range of the real view perceived when a user wears and uses a wearable device (1).

[0098] Specifically, referring to FIG. 6, the field of view (60) may mean an area including both a real area (60A), which is an area occupied by a real view perceived by a user, and a virtual area (60B), which is an area where an ultrasound image displayed by a display unit (300) is displayed overlapping the real area (60A).

[0099] In this disclosure, the field of view (60) is illustrated as a square for convenience of explanation, but this is only an example and is not limited to the disclosure.

[0100] FIG. 7 is a drawing illustrating a virtual area (60B) displayed in the field of view by the display unit (300) according to one embodiment.

[0101] FIG. 8 is a drawing illustrating a virtual area (60B) displayed in the field of view by the display unit (300) according to another embodiment.

[0102] The appearance of the virtual area (60B) displayed in the field of view may vary.

[0103] According to one embodiment, as shown in FIG. 7, it can be displayed in a rectangular shape including an area (7A) that indicates the state of the object through a difference in brightness based on the intensity of the ultrasonic waves reflected from the object, and an area (7B) located outside the area and displayed in black.

[0104] According to another embodiment, only the area (8A) indicating the state of the object through a difference in brightness may be displayed, as illustrated in FIG. 7A of FIG. 7 corresponds to 8A of FIG. 8 . The area (8A) indicating the state of the object is not limited to the shape illustrated in the present disclosure. For example, it may be square.

[0105] Although the present disclosure only describes the aforementioned embodiments, these are merely examples and are not limited to the aforementioned embodiments. Specifically, 7A may display color ultrasound images, 3D rendered images, 3D / 4D ultrasound images, etc., and 7B may include at least one component to assist in examination and diagnosis, as described below with reference to FIGS. 14 and 15.

[0106] The above has described various aspects of the field of view perceived by the user through the wearable display device (1) and the virtual area (60B) displayed by the display unit (300) and constituting the field of view. Below, the principle of controlling the brightness or color of the display unit (300) based on the image characteristics of ultrasonic image data will be described with reference to FIGS. 9 to 11.

[0107] Image characteristics are characteristics that serve as parameters in image processing of ultrasound images and may include black and white ratio, contrast, or color.

[0108] FIG. 9 is a diagram according to one embodiment for explaining the black and white ratio among the image characteristics of an ultrasound image.

[0109] Fig. 10 is a drawing according to another embodiment for explaining the black and white ratio among the image characteristics of an ultrasound image.

[0110] Among the image characteristics, the black-to-white ratio is a numerical representation of the ratio of black to white expressed throughout the image. It primarily represents the number of white pixels relative to the number of black pixels among the pixels composing the entire screen, and is used to measure the relative size of black and white in an image. The black-to-white ratio can be set to a value between 0 and 1, and a larger value (i.e., a value closer to 1) can be interpreted to mean that there is a relatively larger portion of the image that is white.

[0111] This disclosure is only an example, and the black-to-white ratio can be defined as the number of pixels displaying black relative to the number of pixels displaying white, with a larger value meaning a relatively larger portion displaying black.

[0112] Referring to Figure 9, since there are more parts displayed in black than parts displayed in white within the image, the black-to-white ratio may have a value close to 0, with a relatively low proportion of white.

[0113] On the other hand, referring to FIG. 10, since there are more parts displayed in white than parts displayed in black within the image, the black-to-white ratio can have a value close to 1, with a relatively high proportion of black.

[0114] If the black and white ratio is relatively close to 0, the number of pixels displaying black in the image is relatively large, so the brightness of the display unit (300) can be made relatively brighter to improve visibility.

[0115] Conversely, if the black and white ratio is relatively close to 1, the number of pixels displaying white in the image is relatively large, so the brightness of the display unit (300) can be made relatively dark to prevent the part displaying white from being blown out by strong light.

[0116] Specifically, the principle of controlling the brightness of the display unit (300) may vary depending on the type of display panel on which the display unit (300) is implemented.

[0117] When the display unit (300) includes an LCD panel, the control unit (600) can control the intensity of light emitted from the backlight by controlling the output of the voltage applied to the backlight.

[0118] In other words, if the black and white ratio, which is an image characteristic extracted from the ultrasound image data, is close to 0, the control unit (600) can increase the output of the voltage applied to the backlight to increase the intensity of the light emitted from the backlight, and if the black and white ratio is close to 1, the control unit (600) can decrease the output of the voltage applied to the backlight to decrease the intensity of the light emitted from the backlight.

[0119] When the display unit (300) includes an OLED panel, the average brightness can be controlled by controlling the output of the current applied to the light-emitting unit (e.g., organic light-emitting layer) of each pixel, or by controlling the time at which the display unit (300) is turned on and off in PWM (Pulse Width Modulation).

[0120] In other words, if the black and white ratio, which is an image characteristic extracted from the ultrasound image data, is close to 0, the control unit (600) can increase the current value applied to the light-emitting unit of each pixel or increase the on time of the display unit (300) longer than the off time to increase the average brightness.

[0121] On the other hand, if the black and white ratio, which is an image characteristic extracted from the ultrasound image data, is close to 1, the control unit (600) can make the current value applied to the light-emitting unit of each pixel smaller or increase the time that the display unit (300) is off longer than the time that it is on to increase the average brightness.

[0122] Fig. 11 is a drawing according to one embodiment for explaining contrast among image characteristics of an ultrasound image.

[0123] Contrast refers to the difference or contrast in brightness expressed in an ultrasound image. Contrast can be expressed by measuring the difference or contrast in brightness between adjacent pixels or structures in the image. A high contrast indicates a high black-and-white contrast between adjacent pixels or structures, which is different from the black-and-white ratio, which measures the overall ratio of black to white in the image.

[0124] Referring to Figure 11, it can be seen that there is a contrast between adjacent portions 100A (e.g., a portion where the shape of a fetus is displayed) and portion 100B (e.g., a portion where amniotic fluid surrounds a fetus) due to a difference in brightness.

[0125] As the contrast increases, the overall brightness of the display unit (300) becomes brighter, causing problems in which bright areas are not clearly visible, and the overall brightness of the display unit (300) becomes darker, causing problems in which dark areas are not clearly visible. This can also degrade the quality of examinations that require the examination of very fine features, such as fetal ultrasound. Therefore, it is necessary to partially adjust the brightness of the display unit (300).

[0126] At this time, the control unit (600) can darken the brightness of the display unit (300) in the bright part and brighten the brightness of the display unit (300) in the dark part based on the contrast of the ultrasonic image. That is, referring to FIG. 11, the control unit (600) can darken the partial brightness of the display unit (300) in the 100A part and brighten the partial brightness of the display unit (300) in the 100B part.

[0127] For example, if the display unit (300) is implemented as an OLED panel, the brightness can be partially controlled by individually controlling the light emission of each pixel that has the characteristic of being able to emit light independently. To this end, the light emission of the OLED pixel can be increased or decreased by controlling the voltage applied to each pixel.

[0128] According to another embodiment, the brightness of the display unit (300) can be adjusted based on ultrasound image characteristics and surrounding environmental characteristics. The surrounding environmental characteristics may include surrounding environmental illuminance or surrounding environmental complexity.

[0129] The wearable display device (1) can detect the ambient environmental illuminance by the sensor unit (800).

[0130] The sensor unit (800) may include a light detection sensor such as a photodiode. The sensor unit (800) has the property of detecting light and converting it into an electrical signal, so that when the amount of ambient light increases, the size of the electrical signal output from the sensor unit (800) may also increase. In addition, a specific signal may be output only when the ambient illuminance exceeds a set illuminance threshold.

[0131] The present disclosure discloses a camera (700) and a sensor unit (800) as separate components, and the sensor unit (800) is built into the camera (700) so that the camera (700) can detect the surrounding environmental illuminance.

[0132] The wearable display device (1) can detect the complexity of its surrounding environment through a sensor unit (800). This can be accomplished using various sensors, such as a laser scanner or an ultrasonic sensor. These sensors can measure the distance to structures constituting the surrounding environment, the shape or characteristics of the structures, or detect the movements of people.

[0133] The control unit (600) can adjust the brightness of the display unit (300) by taking into account both image characteristics such as black and white ratio and contrast and surrounding environmental characteristics such as surrounding environmental illuminance and surrounding environmental complexity.

[0134] If the brightness of the display unit (300) differs greatly from the illuminance of the surrounding environment, the user viewing the ultrasound image through the display unit (300) may easily feel fatigued, which may reduce the efficiency of the examination.

[0135] Therefore, when adjusting the brightness of the display unit (300) based on ultrasonic image data, it is necessary to consider the surrounding environmental illuminance.

[0136] In addition, when displaying an ultrasound image so as to overlap with a real view according to the principle described above with reference to FIG. 4, the visibility of the ultrasound image may decrease as the complexity of the surrounding environment increases.

[0137] Therefore, when adjusting the brightness of the display unit (300) based on ultrasound image data, it is necessary to consider the complexity of the surrounding environment. This will be described in detail later with reference to Fig. 17.

[0138] Above, the operating principles of each component in controlling the brightness of the display unit (300) based on image characteristics such as black and white ratio and contrast and surrounding environmental characteristics such as ambient illuminance and surrounding environmental complexity have been explained.

[0139] Below, the principle of adjusting the color displayed by the display unit (300) based on the image characteristics and surrounding environmental characteristics is described.

[0140] Image features can include the color of the ultrasound image, as represented by the ultrasound image data. Unlike grayscale ultrasound images, color ultrasound images can be implemented to visually represent flow information, such as blood flow, or to more clearly display boundaries and tissue structures.

[0141] The surrounding environment characteristics may include the surrounding environment color, and the sensor unit (800) includes an RGB sensor that recognizes the red, green, and blue values ​​of light reflected from the walls or structures of the examination room, thereby detecting the surrounding environment color.

[0142] When the background or structures of the surrounding environment are similar to the colors implemented in the color ultrasound image, a problem of reduced clarity, that is, a property that is quickly noticeable when two or more colors are contrasted, may occur.

[0143] Accordingly, the control unit (600) can adjust the RGB values ​​implemented in the pixels of the display unit (300) so that the color of the ultrasonic image displayed based on the ultrasonic image data can be implemented as a different color (e.g., a complementary color) if the wavelength of the color is within a certain nanometer (nm) from the wavelength of the color of the surrounding environment detected by the sensor unit (800).

[0144] This will be described in detail later with reference to Figure 18.

[0145] Above, the operating principles of each component for controlling the brightness or color of the display unit (300) have been described.

[0146] Hereinafter, with reference to FIGS. 12 to 15, the principle of partially controlling the opacity of the lens unit (400) will be described.

[0147] Figure 12 is a drawing that corresponds the segments of the field of view (60) and the lens unit (400).

[0148] At this time, the field of view is divided into equal parts and each divided area is defined as a separate area (11A, 12A, 21A, 22A, etc.). In this disclosure, the area is divided into 4x4, but this is only an example and should not be interpreted in a limited manner.

[0149] The lens unit (400) includes a plurality of segments (11B, 12B, 21B, 22B, etc.) that are partitioned to correspond to each distinct area of ​​the field of view, and each segment may include an electrochromic material and a circuit that can apply a separate voltage to each segment.

[0150] The control unit (600) can recognize segments of the lens unit (400) corresponding to each segmentation area. For example, the control unit (600) can recognize segment 11B corresponding to segmentation area 11A, and segment 12B corresponding to segmentation area 12A.

[0151] Figure 13 is a drawing for explaining extraction of a segment corresponding to a segmentation area corresponding to a virtual area (60B).

[0152] Referring to Fig. 13, when an ultrasound image is displayed in a field of view (60) by a display unit (300), segmented areas corresponding to a virtual area (60B) where the ultrasound image is displayed are 11A, 12A, 21A, and 22A. The processor (601) of the control unit (600) may include an image processing unit that can analyze the output image to obtain analysis information, and the image processing unit may extract segments of the lens unit (400) corresponding to the segmented areas 11A, 12A, 21A, and 22A corresponding to the virtual area (60B) where the ultrasound image is displayed, i.e., 11B, 12B, 21B, and 22B.

[0153] The control unit (600) can control the electric circuit included in the segment of the extracted lens unit (400) to apply voltage to the electrochromic material, and the opacity of the lens unit (400) can be increased by the electrochromic material.

[0154] That is, the control unit (600) can increase the opacity of the segment of the lens unit (400) corresponding to the segmented area corresponding to the virtual area (60B) so as to block external light. As external light is blocked, the segmented area where the ultrasound image is displayed is blocked from the real view, allowing the ultrasound image to be viewed more clearly, thereby improving user convenience.

[0155] The above described the operating principle of adjusting the opacity of a segment of a lens unit (400) corresponding to the entire virtual area (60B) corresponding to the portion where an ultrasound image is displayed. Below, an embodiment of adjusting the opacity of a segment of a lens unit (400) corresponding to a portion of a virtual area (60B) corresponding to the portion where an ultrasound image is displayed will be described.

[0156] As described above, the virtual area (60B) can display at least one object to assist in diagnosis and examination through the ultrasound imaging device (2).

[0157] At this time, the object is a component that constitutes the virtual area (60B), and may correspond to 7A, which is an area where an ultrasound image representing the state of the target object is displayed within the virtual area (60B), and may correspond to a number, image, etc. displayed in 7B, which is an area displayed in black outside 7A. However, the location where the object is displayed is merely an example and should not be interpreted in a limited manner. For example, the object may be displayed outside 7B.

[0158] Since objects play a crucial role in rapid and accurate diagnosis and examination, ensuring visibility significantly impacts examination quality. Therefore, it is necessary to recognize each object within the virtual area (60B) and partially adjust the opacity of the lens unit (400) based on this recognition.

[0159] The components corresponding to the object are described below with reference to FIGS. 14 and 15.

[0160] FIG. 14 is a diagram illustrating a plurality of objects constituting a virtual area (60B) according to one embodiment.

[0161] Referring to FIG. 14, the object may correspond to not only the area 7A where the ultrasound image is displayed (corresponding to 114a of FIG. 14), but also an area (114c) indicating preset, probe, or depth settings, an area (114b) indicating mode-specific settings, an area (114d) indicating a TGC curve, or an area (114e) indicating depth, focus, or selection function information.

[0162] FIG. 15 is a diagram illustrating a plurality of objects constituting a virtual area according to another embodiment.

[0163] According to FIG. 15, the object may correspond to not only 7A, which is a portion where an ultrasound image is displayed (corresponding to 115a in FIG. 15), but also another area (115b) that indicates the state of the object by measuring the speed and direction of blood flow, etc. and displaying it as a pulse wave or continuous wave, or an area (115c) that displays the direction and speed of blood flow numerically or graphically.

[0164] The components corresponding to the aforementioned objects are only examples, and all other components displayed in the virtual area (60B) may correspond to objects.

[0165] A specific method of adjusting the opacity of the lens unit (400) based on the position of the virtual area (60B) or the object constituting the virtual area (60B) by the control unit (600) is described below with reference to FIGS. 19 and 20.

[0166] Below, the control sequence in which the control unit (600) controls the display unit (300) is described.

[0167] Figure 16 is a flowchart for explaining a control sequence in which a control unit (600) adjusts display brightness based on the characteristics of an ultrasonic image.

[0168] Referring to FIG. 16, the control unit (600) can extract image characteristics such as black and white ratio or contrast from ultrasonic image data received from the communication unit (500) (1601).

[0169] The control unit (600) can determine a brightness adjustment factor value for adjusting the brightness of the display unit (300) based on the extracted image characteristics (1602). At this time, the brightness adjustment factor can include a target brightness to be achieved or a time required to reach the target brightness based on the image characteristics.

[0170] The control unit (600) adjusts the brightness of the display unit (300) based on the determined control factor (1603).

[0171] For example, if the difference between the current brightness of the display unit (300) and the target brightness is small, the user will be able to more easily adapt to the brightness change by shortening the arrival time and changing the brightness within a short period of time. Accordingly, the control unit (600) can shorten the arrival time.

[0172] On the other hand, if the difference between the current brightness of the display unit (300) and the target brightness is large, if the brightness is changed in a short period of time, it is difficult for the user to adapt to the change and he / she may easily feel fatigued, so the reaching time can be lengthened.

[0173] That is, the control unit (600) can control the brightness of the display unit (300) through multiple control factors such as target brightness or arrival time, thereby improving the performance of the wearable display device (1).

[0174] The control unit (600) can continue adjusting the brightness of the display unit (300) based on the determined adjustment factor and then terminate the brightness adjustment based on whether the inspection is completed (1604).

[0175] Figure 17 is a flowchart for explaining a control sequence in which a control unit (600) adjusts display brightness based on the characteristics of an ultrasound image and the characteristics of the surrounding environment.

[0176] Referring to FIG. 17, the control unit (600) can extract image characteristics such as black and white ratio or contrast from ultrasonic image data received from the communication unit (500) (1701).

[0177] The control unit (600) can extract ambient environment characteristics such as ambient environment illuminance or ambient environment complexity from ambient environment data received from the sensor unit (700) or camera (800) (1702).

[0178] The control unit (600) can determine a brightness control factor value for adjusting the brightness of the display unit (300) based on the extracted image characteristics and surrounding environment characteristics (1703).

[0179] For example, if the control unit (600) adjusts the brightness of the display unit (300) so that the black-and-white ratio is close to 0, the user may feel fatigued if the ambient illuminance is low. Therefore, the control unit (600) can use the detected ambient illuminance as a threshold value and adjust the target brightness only up to the threshold value.

[0180] When the control unit (600) adjusts the brightness of the display unit (300) to be darker so that the black and white ratio is close to 1, if the brightness of the display unit (300) becomes too dark in an environment with high ambient illuminance, the visibility of the ultrasound image may deteriorate and the user may feel fatigued. Therefore, the control unit (600) can use the detected ambient illuminance as a threshold value and darken the target brightness only up to the threshold value.

[0181] When the control unit (600) partially adjusts the brightness of the display unit (300) according to the contrast, when darkening the brightness of the display unit (300) in a bright part and brightening the brightness of the display unit (300) in a dark part, the brightness difference may be adjusted by taking the surrounding environmental illuminance into consideration. Since the user easily feels fatigued when the difference between the brightness of the display unit (300) and the surrounding environmental illuminance is large, the target brightness may be controlled to be adjusted only within a certain range from the reference value by using the surrounding environmental illuminance as a reference value.

[0182] In addition, when the control unit (600) adjusts the brightness of the display unit (300) based on the black and white ratio or contrast, a weight can be given to the adjustment factor in adjusting the brightness of the display unit (300) by taking into account the complexity of the surrounding environment.

[0183] For example, when the control unit (600) brightens the brightness of the display unit (300) because the black and white ratio is close to 0, a weight can be given in determining the target brightness when the complexity of the surrounding environment detected by the sensor unit (700) is high.

[0184] Additionally, the control unit (600) can determine the arrival time based on the difference between the target brightness determined as described above and the brightness of the current display unit (300).

[0185] In other words, the control unit (600) can shorten the arrival time when the difference between the current brightness of the display unit (300) and the target brightness is small, and can lengthen the arrival time when the difference between the current brightness of the display unit (300) and the target brightness is large.

[0186] The above examples are merely examples for determining the control factor values ​​and should not be construed as limiting the present disclosure.

[0187] The control unit (600) can adjust the brightness of the display unit (300) based on the determined control factor value (1704).

[0188] The control unit (600) can continue adjusting the brightness of the display unit (300) based on the determined adjustment factor and then terminate the brightness adjustment based on whether the inspection is completed (1705).

[0189] In the above, the control sequence in which the control unit (600) controls the brightness of the display unit (300) is described. In the following, the control sequence in which the control unit (600) controls the color of the display unit (300) based on image characteristics and surrounding environmental characteristics is described.

[0190] Figure 18 is a drawing for explaining the order in which the control unit (600) adjusts the color displayed by the display unit (300) based on the image characteristics and surrounding environment characteristics.

[0191] Referring to FIG. 18, the control unit (600) can extract image characteristics such as ultrasonic image color from ultrasonic image data received from the communication unit (500) (1801).

[0192] The control unit (600) can extract ambient environment characteristics, such as ambient environment color, from ambient environment data received from the sensor unit (700) or camera (800) (1802).

[0193] The control unit (600) can determine RGB output values ​​for adjusting colors displayed on the display unit (300) based on extracted image characteristics and surrounding environment characteristics (1803).

[0194] For example, if the color of the surrounding environment detected by the sensor unit (800) is red, and the wavelength of the color of the ultrasound image displayed based on the ultrasound image data is included in a certain wavelength range (e.g., 620-750 nm) from the wavelength of red, the control unit (300) can adjust the RGB value implemented in the pixel of the display unit (300) from a value implementing red (255,0,0) to a value implementing cyan, its complementary color (0,255,255).

[0195] The control unit (600) can adjust the color output from the display unit (300) based on the determined RGB output value (1804).

[0196] The control unit (600) can adjust the color output from the display unit (300) based on the determined adjustment factor and then continue adjusting the color output from the display unit (300) based on whether the inspection has been completed or end the color adjustment (1805).

[0197] Below, with reference to FIGS. 19 and 20, the control sequence in which the control unit (600) controls the lens unit (400) will be described.

[0198] FIG. 19 is a drawing for explaining the sequence of partially adjusting the opacity of the lens unit (400) based on the location of the virtual area where the ultrasound image is displayed.

[0199] The control unit (600) can extract a segmented area corresponding to the virtual area (60B) where the ultrasound image is displayed (1901).

[0200] The control unit (600) can extract a segment of the lens unit corresponding to the extracted segmented area (1902).

[0201] The control unit (600) can control the circuits constituting the segments of the extracted lens unit (400) to adjust the voltage applied to each circuit. At this time, the opacity of each segment can be adjusted as the properties of the electrochromic material change according to the applied voltage (1903).

[0202] The control unit (600) can determine whether the virtual area (60B) has moved within the field of view through the sensor unit (700) or the camera (800). If the control unit (600) determines that the ultrasonic screen has moved, it can perform a series of processes to partially adjust the opacity of the lens unit [(700)] (400) based on the position of the virtual area (60B) (1904).

[0203] If the control unit (600) determines that the ultrasound screen has not moved, it can determine whether the test has ended (1904).

[0204] The control unit (600) can continue adjusting the opacity of the lens unit (400) or end the opacity adjustment based on whether the inspection has been completed (1905).

[0205] Fig. 20 is a drawing for explaining the order of partially adjusting the opacity of the lens unit (400) based on the position at which the object constituting the virtual area (60B) is displayed.

[0206] The control unit (600) can obtain location information for at least one object constituting the virtual area (60B) through the sensor unit (700) or the camera (800) (2001).

[0207] The control unit (600) can extract a segmented area in which at least one object recognized based on location information is displayed (2002).

[0208] The control unit (600) can extract a segment of the lens unit (400) corresponding to the extracted segmented area (2003).

[0209] The control unit (600) can control the circuits constituting the segments of the extracted lens unit (400) to adjust the voltage applied to each circuit. At this time, the opacity of each segment can be adjusted as the properties of the electrochromic material change according to the applied voltage (2004).

[0210] The control unit (600) can determine whether the virtual area (60B) has moved within the field of view through the sensor unit (700) or the camera (800). In addition, the control unit (600) can determine whether an object has moved within the virtual area (60B) through the sensor unit (700) or the camera (800). If the control unit (600) determines that the ultrasonic screen or the object has moved, it can go through a series of processes of partially adjusting the opacity of the lens unit (400) based on the position of the object (2005).

[0211] The control unit (600) can determine whether the inspection is finished if it determines that the ultrasonic screen or object has not moved (2005).

[0212] The control unit (600) can continue adjusting the opacity of the lens unit (400) or terminate the opacity adjustment based on whether the inspection has been completed (2006).

[0213] According to one embodiment, a wearable display device includes: a communication unit that receives ultrasonic image data; a display unit that overlaps at least a portion of the lens unit and displays the ultrasonic image data as an ultrasonic image; and a control unit that is electrically connected to the lens unit, the communication unit, and the display unit; wherein the control unit controls at least one of brightness or color of the display unit based on an image characteristic of the ultrasonic image data, and controls opacity of the lens unit based on a location of a virtual area where the ultrasonic image is displayed.

[0214] The above image characteristics may include at least one of a black and white ratio or a contrast ratio of the ultrasound image extracted from the ultrasound image data.

[0215] The control unit can control the brightness of the display unit based on the image characteristic being a black and white ratio.

[0216] The control unit determines a brightness adjustment factor value based on the black and white ratio, and controls the brightness of the display unit based on the adjustment factor value, and the adjustment factor may include at least one of a target brightness or an arrival time.

[0217] The control unit can partially control the brightness of the display unit based on the image characteristic being contrast.

[0218] The wearable display device further includes a camera for extracting characteristics of the surrounding environment; and a sensor unit; and the control unit can control the brightness of the display unit based on the image characteristics and the characteristics of the surrounding environment.

[0219] The above ambient environment characteristics may include at least one of ambient environment illuminance or ambient environment complexity.

[0220] The wearable display device further includes a camera for extracting a color of a surrounding environment; and a sensor unit; wherein the image characteristic includes a color of a color area of ​​the ultrasound image extracted from the ultrasound image data, and the control unit can control a color displayed on the display unit based on the color of the color area and the color of the surrounding environment.

[0221] The above control unit can obtain location information at which at least one object constituting the virtual area is displayed in the field of view.

[0222] The above control unit can control the opacity of the lens unit based on the acquired position information.

[0223] A method for controlling a wearable display device according to another embodiment comprises the steps of: receiving ultrasonic image data; extracting image characteristics from the ultrasonic image data;

[0224] It may include a step of controlling at least one of brightness or color of a display unit based on the image characteristics of the ultrasound image data; and a step of controlling the opacity of a lens unit based on the position at which the ultrasound image is displayed.

[0225] The above image characteristics may include at least one of a black and white ratio or a contrast ratio of the ultrasound image extracted from the ultrasound image data.

[0226] The step of controlling the brightness of the display unit may include a step of controlling the brightness of the display unit based on the image characteristic being a black and white ratio.

[0227] The step of controlling the brightness of the display unit includes a step of determining an adjustment factor value based on the black and white ratio; and a step of controlling the brightness of the display unit based on the adjustment factor value; wherein the adjustment factor may include at least one of a target brightness or an arrival time.

[0228] The step of controlling the brightness of the display unit may include a step of partially controlling the brightness of the display unit based on the image characteristic being contrast.

[0229] The step of controlling the brightness of the display unit includes a step of determining a control factor value based on the contrast; and a step of partially controlling the brightness of the display unit based on the control factor value; wherein the control factor may include at least one of a target brightness or an arrival time.

[0230] The control method of the wearable display device further includes a step of extracting a color of the surrounding environment; and the step of controlling the brightness of the display unit includes a step of controlling the brightness of the display unit based on the image characteristic and the surrounding environment characteristic; and the surrounding environment characteristic includes at least one of the surrounding environment illuminance or the surrounding environment complexity.

[0231] You can do it.

[0232] The above image characteristics include a color of a color area of ​​the ultrasound image extracted from the ultrasound image data, and the control method of the wearable display device further includes a step of extracting a color of a surrounding environment; and the step of controlling the color of the display unit may include a step of controlling a color displayed on the display unit based on the color of the color area and the color of the surrounding environment.

[0233] The step of controlling the opacity of the lens unit may include a step of recognizing each position where at least one object constituting the ultrasound image is displayed; and a step of partially controlling the opacity of the lens unit based on the position where at least one object constituting the ultrasound image is displayed in the field of view.

[0234] According to the disclosed wearable display device and its control method, the brightness and color of the display unit are adjusted based on image characteristics and surrounding environmental characteristics, and the opacity of the lens unit is adjusted based on the location of the virtual area, which is the portion displaying the ultrasound image and object, thereby improving visibility and promoting user convenience, thereby eliminating user inconvenience in viewing a real view and a virtual image simultaneously.

[0235] The disclosed embodiments have been described with reference to the attached drawings as described above. Those skilled in the art will understand that the present invention can be implemented in forms other than the disclosed embodiments without altering the technical spirit or essential features of the present invention. The disclosed embodiments are illustrative and should not be construed as limiting.

Claims

1. Lens section; A communication unit that receives ultrasound image data; A display unit overlapping at least a portion of the lens unit and displaying the ultrasound image data as an ultrasound image; and including a control unit electrically connected to the lens unit, the communication unit, and the display unit; The above control unit, Controlling at least one of the brightness or color of the display unit based on the image characteristics of the ultrasound image data, A wearable display device that controls the opacity of the lens unit based on the location of the virtual area where the ultrasound image is displayed.

2. In paragraph 1, The above video characteristics are: A wearable display device comprising at least one of a black and white ratio or contrast of the ultrasound image.

3. In paragraph 2, The above control unit, Determine the control factor value based on the above black and white ratio, Control the brightness of the display unit based on the above control factor value, The above regulatory factors are, A wearable display device comprising at least one of a target brightness or a target time to reach.

4. In paragraph 2, The above control unit, A wearable display device that partially controls the brightness of the display unit based on the image characteristic being contrast.

5. In paragraph 4, The above control unit, Determine a control factor value based on the above contrast, and partially control the brightness of the display unit based on the control factor value, The above regulatory factors are, A wearable display device comprising a target brightness or time to reach.

6. In paragraph 1, The above wearable display device, It further includes a camera for extracting the characteristics of the surrounding environment; and a sensor unit; The above control unit, A wearable display device that controls the brightness of a display unit based on the above image characteristics and the above surrounding environment characteristics.

7. In paragraph 6, A wearable display device wherein the above ambient environment characteristics include at least one of ambient environment illuminance or ambient environment complexity.

8. In paragraph 1, The above wearable display device, It further includes a camera for extracting the color of the surrounding environment; and a sensor unit; The above video characteristics are: Including the color of the color area of ​​the above ultrasound image, The above control unit, A wearable display device that controls colors displayed on a display unit based on colors of the above color area and colors of the surrounding environment.

9. In paragraph 1, The above control unit, A wearable display device that obtains location information on which at least one object constituting the above virtual area is displayed.

10. In paragraph 9, The above control unit, A wearable display device that controls the opacity of the lens unit based on the acquired location information.

11. Step of receiving ultrasound image data; A step of extracting image characteristics from the above ultrasound image data; A step of controlling at least one of the brightness or color of a display unit on which an ultrasound image is displayed based on the image characteristics of the ultrasound image data; and A method for controlling a wearable display device, comprising: a step of controlling the opacity of a lens unit based on the location of a virtual area where the ultrasound image is displayed.

12. In paragraph 11, The above video characteristics are: A control method for a wearable display device including at least one of a black and white ratio or a contrast ratio of the ultrasound image extracted from the ultrasound image data.

13. In paragraph 12, The step of controlling the brightness of the above display unit is: A step of determining a control factor value based on the above black and white ratio; and A step of controlling the brightness of the display unit based on the above control factor value; The above regulatory factors are, A method for controlling a wearable display device comprising at least one of a target brightness or a target reaching time.

14. In paragraph 12, The step of controlling the brightness of the above display unit is: A method for controlling a wearable display device, comprising: a step of partially controlling the brightness of the display unit based on the image characteristic being contrast; 15. In paragraph 14, The step of controlling the brightness of the above display unit is: A step of determining a control factor value based on the above contrast; and A step of partially controlling the brightness of the display unit based on the above control factor value; The above regulatory factors are, A method for controlling a wearable display device comprising at least one of a target brightness or a target reaching time.

Images