Display apparatus and control method thereof

Abstract

The present invention relates to a display device capable of automatically adjusting a posture of a display unit according to a posture of a user and a control method thereof, and may provide a display device including: a signal input section; the display unit is provided with a display panel and a camera; the supporting device is used for supporting the display unit; a posture adjustment drive unit provided on the support device so as to be capable of adjusting the posture of the display unit; and a control section that controls the posture adjustment driving section so that a posture of the display unit is adapted to feature points of a user's face and a user posture deduced from a first user image acquired through the camera using an artificial intelligence model.

Description

Technical Field

[0001] The present invention relates to a display device and a control method capable of adjusting the height and / or tilt angle of a display unit. Background Art

[0002] Recently, with the development of information society, various display devices such as liquid crystal display devices (LCD: Liquid Crystal Display Device), plasma display panels (PDP: Plasma Diplay Panel), electroluminescent displays (Electro Luminescent Display), vacuum fluorescent displays (Vacuum Fluorescent Display) and the like are being developed and used.

[0003] Such a display device includes: a display unit for displaying an image; and a support device for supporting the display unit to be spaced apart from the top surface of a desk and / or table at a preset height.

[0004] In such conventional display devices, there are the following problems: the user needs to manually adjust the height and / or tilt angle of the display unit according to his / her own posture, which is inconvenient, and each time the user's posture changes, adjustments must be made one by one, which is quite troublesome. Summary of the invention

[0005] Problems to be solved by the invention

[0006] The present invention is proposed to solve the above-mentioned problem, and relates to a display device capable of automatically adjusting the posture of a display unit according to the posture of a user and a control method thereof.

[0007] Technical solutions to the problem

[0008] In order to achieve the above-mentioned purpose, according to one aspect of the present invention, a display device can be provided, which includes: a signal input unit; a display unit having a display panel and a camera; a supporting device that supports the display unit; a posture adjustment drive unit that is arranged on the supporting device to be able to adjust the posture of the display unit; and a control unit that controls the posture adjustment drive unit so that the posture of the display unit is suitable for the feature points and user posture of the user's face inferred from the first user image obtained through the camera using an artificial intelligence model.

[0009] The control unit may infer the user posture based on a separation distance between the camera and the user calculated based on a feature point pixel distance between two feature points on the user's face in the first user image.

[0010] The control unit may calculate the feature point pixel distance based on the two-dimensional marker information inferred from the first user image using the artificial intelligence model.

[0011] The control unit may correct the feature point pixel distance based on the three-dimensional body skeleton information inferred from the first user image using the artificial intelligence model.

[0012] The control unit can obtain a second user image with the user taking a basic user posture as the subject at a first height of the display unit through the camera, and obtain a third user image with the user maintaining the basic user posture as the subject at a second height of the display unit through the camera, calculate a reference separation distance between the display unit and the user based on the second user image and the third user image, calculate a reference pixel distance between two feature points of the user's face from the second user image or the third user image, and further calculate the separation distance between the camera and the user in the first user image based on the reference separation distance and the reference pixel distance.

[0013] The control unit may control to store data on the reference spacing distance and the reference pixel distance in association with the user.

[0014] The control unit may control to store data on the reference spacing distance and the reference pixel distance when the left-right movement of the subject in the second user image and the third user image is within a predetermined pixel distance.

[0015] The control unit may correct at least one of the second user image and the third user image based on the orientation information of the display unit when the second user image and the third user image are obtained, and calculate the reference spacing distance and the reference pixel distance based on the corrected second user image and the third user image.

[0016] The two feature points of the user's face may be two eyes.

[0017] The control unit may generate a three-dimensional body mesh of the user using the second user image and the third user image.

[0018] The control unit may calculate an optimal display unit posture setting for the user based on the three-dimensional body mesh.

[0019] The control unit may control the user's optimal display unit posture setting so that the user can modify it through the signal input unit.

[0020] In the case where the user corrects the user's optimal display unit posture setting, the control unit can store the corrected posture setting as the user preference setting; in the case where the user does not correct the user's optimal display unit posture setting, the control unit can store the user's optimal display unit posture setting as the user preference setting; the control unit can control the posture adjustment drive unit to further consider the user preference setting to adjust the posture of the display unit.

[0021] The control unit may further control the posture adjustment drive unit based on the second user image and the spatial relationship between the user's basic posture when the second user image is obtained and the user's preference setting.

[0022] When the control unit detects that the user has left a seat in the first user image, the control unit can maintain the posture of the display unit at the time when the departure is detected, and when the departure is continuously detected within a specified time starting from the time when the departure is detected, the control unit can control the posture adjustment drive unit to adjust the posture of the display unit according to the user's preference setting.

[0023] The control unit may control the posture adjustment driving unit so that the posture of the display unit is adjusted within the up-and-down movement range of the display unit determined based on the user posture in the first user image.

[0024] The control section may further determine the up-and-down movement range of the display unit based on a spatial relationship between the user basic posture and the user preference setting.

[0025] The control unit may control the posture adjustment drive unit to adjust the posture of the display unit so that the posture of the display unit has a height variation of a continuous sinusoidal wave curve trajectory within the up-and-down movement range.

[0026] The control unit may control the posture adjustment drive unit so that the height of the display unit is maintained at a random height within the up-and-down movement range.

[0027] In addition, according to one aspect of the present invention, a method for controlling a display device can be provided, which includes: a step of capturing a user image through a camera; and a step of controlling a posture of a display unit so that the posture of the display unit is suitable for feature points of the user's face and the user posture inferred from the user image using an artificial intelligence model.

[0028] In addition, according to one aspect of the present invention, a display device can be provided, which includes: a signal input unit; a display unit having a display panel and a camera; a supporting device that supports the display unit; a posture adjustment drive unit that is arranged on the supporting device so as to be able to adjust the posture of the display unit; and a control unit that obtains a first user image with the user as the subject at a first height of the display unit through the camera, obtains a second user image with the user as the subject at a second height of the display unit through the camera, calculates a first separation distance between the display unit and the user based on the first user image and the second user image, calculates a first pixel distance between two feature points on the face of the user from the first user image or the second user image, stores data about the first separation distance and the first pixel distance of the user, obtains a third user image with the user as the subject through the camera, calculates a second pixel distance between two feature points on the face of the user from the third user image, and controls the posture adjustment drive unit to adjust the posture of the display unit according to the second separation distance between the display unit and the user calculated based on the second pixel distance and the stored data.

[0029] The control unit may control to store data on the first separation distance and the first pixel distance when the left-right movement of the subject in the first user image and the second user image is within a predetermined pixel distance.

[0030] The control unit may correct at least one of the first user image and the second user image based on the orientation information of the display unit when the first user image and the second user image are obtained, and calculate the first separation distance and the first pixel distance based on the corrected first user image and the second user image.

[0031] The control unit may calculate the second pixel distance based on the two-dimensional marker information calculated from the third user image.

[0032] The control unit may correct the second pixel distance based on three-dimensional body skeleton information calculated from the third user image.

[0033] The two feature points of the user's face may be two eyes.

[0034] The control unit may control the posture adjustment drive unit according to the user posture in the third user image detected based on the second separation distance.

[0035] The control unit may generate a three-dimensional body mesh of the user using the first user image and the second user image.

[0036] The control unit may calculate an optimal display unit posture setting for the user based on the three-dimensional body mesh.

[0037] The control unit may control the user's optimal display unit posture setting so that the user can modify it through the signal input unit.

[0038] In the case where the user corrects the user's optimal display unit posture setting, the control unit can store the corrected posture setting as the user preference setting; in the case where the user does not correct the user's optimal display unit posture setting, the control unit can store the user's optimal display unit posture setting as the user preference setting; the control unit can control the posture adjustment drive unit to further consider the user preference setting to adjust the posture of the display unit.

[0039] The control unit may further control the posture adjustment drive unit based on a spatial relationship between a basic posture of the user when the first user image and the second user image are obtained and the user preference setting.

[0040] The control section may control the posture adjustment drive section so that the posture of the display unit follows the user posture to maintain the spatial relationship.

[0041] The user posture mode may include a gaze mode and a non-gaze mode. When the user posture mode is the gaze mode, the control unit may control the posture adjustment drive unit so that the posture of the display unit follows the user posture. When the user posture mode is the non-gaze mode, the control unit may control the posture adjustment drive unit so that the posture of the display unit does not follow the user posture.

[0042] When the user posture mode is the gaze mode, the user posture mode may include a focus mode and a relaxation mode. When the user posture mode is the focus mode, the control unit may control the posture adjustment drive unit so that the display unit moves in a direction that is the same as the user's eye height based on the user posture.

[0043] When the user posture mode is the relaxation mode, the control unit may control the posture adjustment drive unit so that the height of the display unit can be increased as the eye height of the user decreases.

[0044] The control unit may control to output a turtle neck posture warning when the user posture is a turtle neck posture.

[0045] When the user posture is a turtle neck posture, the control unit may control the posture adjustment drive unit so that the posture of the display unit does not follow the user posture and the height of the display unit rises.

[0046] The control unit may control the posture adjustment drive unit so that the height of the display unit rises until the user leaves the turtle neck posture.

[0047] In addition, according to one aspect of the present invention, a control method for a display device can be provided, which includes: a step of acquiring a first user image with the user as the subject at a first height of the display unit through a camera; a step of acquiring a second user image with the user as the subject at a second height of the display unit through the camera; a step of calculating a first separation distance between the display unit and the user based on the first user image and the second user image; a step of calculating a first pixel distance between two feature points on the user's face from the first user image or the second user image; a step of storing data about the first separation distance and the first pixel distance of the user; a step of acquiring a third user image with the user as the subject through the camera; a step of calculating a second pixel distance between two feature points on the user's face from the third user image; and a step of adjusting the posture of the display unit according to the second separation distance between the display unit and the user calculated based on the second pixel distance and the stored data.

[0048] In addition, according to one aspect of the present invention, a display device can be provided, which includes: a display unit having a display panel and a camera; a supporting device that supports the display unit; a posture adjustment drive unit that is arranged on the supporting device to be able to adjust the posture of the display unit; and a control unit that controls the posture adjustment drive unit so that the posture of the display unit is adjusted within the up and down movement range of the display unit determined based on the first user posture in the first user image captured by the camera.

[0049] The control section may further determine the up-and-down movement range of the display unit based on a spatial relationship between a basic user gesture and a user preference setting.

[0050] The control unit may control the posture adjustment drive unit to adjust the posture of the display unit so that the posture of the display unit has a height variation of a continuous sinusoidal wave curve trajectory within the up-and-down movement range.

[0051] The control unit can control the posture adjustment drive unit so that the posture of the display unit is adjusted within the up and down moving range within one cycle, and then based on the user preference setting and the second user posture in the second user image captured by the camera, the up and down moving range of the display unit is updated, and the posture of the display unit is adjusted within the updated up and down moving range within the next cycle.

[0052] The control unit may control the initial height of the sinusoidal wave curve trajectory to be different depending on the height of the display unit at a time point when the up-and-down movement range is determined.

[0053] When the height of the display unit is within the up-and-down moving range, the control unit can control the height of the display unit to change along a sinusoidal wave curve trajectory at a first speed. When the height of the display unit is outside the up-and-down moving range, the control unit can control the height of the display unit to move to the boundary of the up-and-down moving range at a second speed faster than the first speed, and then change along the sinusoidal wave curve trajectory at the first speed.

[0054] The control unit may control the posture adjustment drive unit so that the height of the display unit is maintained at a random height within the up-and-down movement range.

[0055] The control unit may control the posture adjustment drive unit so that the height of the display unit is maintained at the random height within one cycle, and then the random height is updated within the up and down moving range, and the height of the display unit is maintained at the updated random height within the next cycle.

[0056] When leaving of the user is detected in the user image, the control unit may control the posture adjustment drive unit to maintain the posture of the display unit at a time when the leaving of the user is detected.

[0057] When the seat leaving is continuously detected within a predetermined time from the time when the seat leaving is detected, the control unit may control the posture adjustment drive unit to adjust the posture of the display unit according to the user preference setting.

[0058] When detecting that the user exists in front of the display unit, the control section may start posture adjustment of the display unit.

[0059] The control section may control to perform posture adjustment of the display unit in further consideration of a user posture pattern.

[0060] The user posture mode may include a gaze mode and a non-gaze mode. When the user posture mode is the gaze mode, the control unit may control the posture adjustment drive unit to adjust the posture of the display unit. When the user posture mode is the non-gaze mode, the control unit may control the posture adjustment drive unit not to adjust the posture of the display unit.

[0061] The control unit can obtain the body skeleton information of the user from the first user image, and based on the body skeleton information, obtain the sight point where the user's sight lines intersect the display panel, and can distinguish between the gaze mode and the non-gaze mode based on whether the sight point is located within the display panel.

[0062] The control unit may determine the user posture according to a separation distance between the camera and the user calculated based on a feature point pixel distance between two feature points on the user's face in the first user image.

[0063] The control unit can obtain a second user image with the user taking the user basic posture as the subject through the camera at a first height of the display unit, obtain a third user image with the user maintaining the user basic posture as the subject through the camera at a second height of the display unit, calculate a reference pixel distance between two feature points on the user's face from the second user image or the third user image, and further calculate the separation distance between the camera and the user in the first user image based on the reference separation distance and the reference pixel distance.

[0064] The control unit may calculate an optimal display unit posture setting for the user based on a three-dimensional body mesh of the user generated using the second user image and the third user image.

[0065] When the user corrects the user's optimal display unit posture setting, the control unit can store the corrected posture setting as the user's preferred setting. When the user does not correct the user's optimal display unit posture setting, the control unit can store the user's optimal display unit posture setting as the user's preferred setting.

[0066] In addition, according to one aspect of the present invention, a control method for a display device can be provided, which includes: a step of capturing a user image through a camera; and a step of adjusting the posture of the display unit within the up and down movement range of the display unit determined based on the user posture in the user image.

[0067] Effects of the Invention

[0068] The effects of the display device and the control method thereof according to the present invention will be described below.

[0069] According to at least one aspect of the various aspects of the present invention, there is an advantage that the posture of the display unit can be automatically adjusted according to the posture of the user. BRIEF DESCRIPTION OF THE DRAWINGS

[0070] Figure 1 FIG. 4 is a side view of a display device according to an embodiment of the present invention.

[0071] Figure 2 yes Figure 1 A rear perspective view of a display device.

[0072] Figure 3 yes Figure 1 A cross-sectional view of a joining area of ​​the first arm and the display unit.

[0073] Figure 4 yes Figure 3 Internal stereogram of .

[0074] Figure 5 It is shown Figure 3 Diagram of the driving gear and driven gear.

[0075] Figure 6 It is shown Figure 1 A cross-sectional view of the interior of a pillar.

[0076] Figure 7 yes Figure 6 A cross-sectional view of the upper support.

[0077] Figure 8 yes Figure 6 A cross-sectional view of the lower support.

[0078] Fig. 9 It is a brief description Figure 7 Diagram of the structure of the clutch.

[0079] Fig.10 yes Figure 1 Control block diagram of a display device.

[0080] Fig.11 An AI server according to an embodiment of the present invention is shown.

[0081] Fig.12 It is shown Figure 2 A diagram of a state in which a display unit is pivoted in the up-down direction.

[0082] Fig.13 It is used to illustrate Figure 2 Diagram of the up and down tilt and height adjustment of the display unit.

[0083] Fig.14 A block diagram for explaining the operation of a display device according to an embodiment of the present invention is shown.

[0084] Fig.15 FIG. 1 is a diagram for explaining two-dimensional facial landmark recognition of a user according to an embodiment of the present invention.

[0085] Fig.16FIG. 1 shows a change in the eye height of a user in an image of the user captured by a camera installed on the display unit based on the distance between the display unit and the user according to an embodiment of the present invention.

[0086] Fig.17 FIG. 1 is a diagram for explaining three-dimensional body skeleton recognition of a user according to an embodiment of the present invention.

[0087] Fig.18 Shows that the Fig.17 An example of posture information of the user obtained by using a three-dimensional body skeleton.

[0088] Fig.19 An example of changes in a user's posture detected according to an embodiment of the present invention is shown.

[0089] Fig. 20 The figure shows the preparation process of calibration according to an embodiment of the present invention.

[0090] Fig.21 and Fig. 22 A guide screen displayed for guiding calibration according to an embodiment of the present invention is shown.

[0091] Fig.23 The figure shows the execution flow of calibration according to an embodiment of the present invention.

[0092] Figure 24 to Figure 26 A guide screen displayed for guiding calibration according to an embodiment of the present invention is shown.

[0093] Fig. 27 The modification process for modifying the user's optimal posture of a display unit according to an embodiment of the present invention is shown.

[0094] Fig.28 The flowchart of invoking or registering preference settings according to a user in a display device according to an embodiment of the present invention is shown.

[0095] Fig.29 A sequence diagram for explaining posture adjustment of a display unit according to an embodiment of the present invention is shown.

[0096] Fig.30 A sequence diagram showing a display device searching for a user according to an embodiment of the present invention is shown.

[0097] Fig.31 A sequence diagram showing the process of detecting the user's absence from a seat by a display device according to an embodiment of the present invention.

[0098] Fig.32 It is a diagram for explaining a user's posture pattern according to an embodiment of the present invention.

[0099] Fig.33 It is a diagram for explaining a user's posture pattern according to an embodiment of the present invention.

[0100] Fig.34 A sequence diagram for explaining posture adjustment of a display unit according to an embodiment of the present invention is shown.

[0101] Fig.35 A sequence diagram for explaining posture adjustment of a display unit according to an embodiment of the present invention is shown.

[0102] Fig.36 Shown for illustration Fig.35 The posture of the display unit adjusts the relationship between the display unit posture and the user posture.

[0103] Fig.37 A sequence diagram for explaining posture adjustment of a display unit according to an embodiment of the present invention is shown.

[0104] Fig.38 Shown for illustration Fig.37 The posture of the display unit adjusts the relationship between the display unit posture and the user posture.

[0105] Fig.39 A sequence diagram for explaining posture adjustment of a display unit according to an embodiment of the present invention is shown.

[0106] Fig.40 Shown for illustration Fig.39 The posture of the display unit adjusts the relationship between the display unit posture and the user posture.

[0107] Figure 41 to Figure 43 Shows Fig.40 The deformation of the posture adjustment graph.

[0108] Fig.44 A sequence diagram for explaining posture adjustment of a display unit according to an embodiment of the present invention is shown.

[0109] Fig.45 Shown for illustration Fig.44 The posture of the display unit adjusts the relationship between the display unit posture and the user posture. DETAILED DESCRIPTION

[0110] Hereinafter, the embodiments disclosed in this specification are described in detail with reference to the accompanying drawings, and regardless of the figure numbers, the same or similar constituent elements are given the same figure numbers, and repeated descriptions thereof are omitted. The suffixes "module" and "unit" used in the following description for the constituent elements are only given or mixed for the convenience of writing the specification, and they themselves do not have meanings or functions that distinguish each other. In addition, when describing the embodiments disclosed in this specification, if it is determined that the specific description of the relevant known technology may confuse the subject matter of the embodiments disclosed in this specification, its detailed description is omitted. In addition, it should be understood that the drawings are only used to facilitate the understanding of the embodiments disclosed in this specification, and the technical ideas disclosed in this specification are not limited to the drawings, including all changes, equivalents and substitutes made within the idea and technical scope of the present invention.

[0111] Terms including ordinal numbers such as "first" and "second" may be used to describe various components, but the components are not limited by the terms. The terms are used only to distinguish one component from other components.

[0112] When a certain component is mentioned as being "connected" or "linked" to another component, it should be understood that it may be directly connected or linked to the other component, but other components may be present between them. Conversely, if a certain component is mentioned as being "directly connected" or "directly linked" to another component, it should be understood that no other components exist between them.

[0113] Unless the context clearly indicates otherwise, an expression in the singular includes an expression in the plural.

[0114] In the present application, “at least one of A and B” may refer to “A”, may refer to “B”, or may refer to both “A” and “B”.

[0115] In the present application, terms such as "including" or "having" are only used to specify the existence of features, numbers, steps, actions, constituent elements, parts or their combinations recorded in the specification, and are not intended to exclude the possibility of the existence or addition of one or more other features or numbers, steps, actions, constituent elements, parts or their combinations.

[0116] The display device described in this specification may include a display screen, a mobile phone, a smartphone, a laptop computer, a digital broadcast terminal, a PDA (personal digital assistant), a PMP (portable multimedia player), a navigator, a touch-screen tablet PC (slate PC), a tablet PC (tablet PC), an ultrabook, a digital TV, etc.

[0117] Figure 1 is a side view of a display device according to an embodiment of the present invention, Figure 2 yes Figure 1 A rear perspective view of a display device. Figure 1 and Figure 2 As shown, a display device according to an embodiment of the present invention includes a display unit 100, a fixing seat bracket ( Figure 3 140a), the first arm 160, the second arm 190, the third arm 220, the support column 270 and the fixing unit 310.

[0118] The display unit 100 is configured to have a screen for displaying an image on the front side.

[0119] The display unit 100 , for example, includes a display panel 1001 forming the screen and a cover 1002 surrounding and supporting the display panel 1001 .

[0120] The display device of this embodiment includes: the display unit 100; and a supporting device 130a, which is combined with the back of the display unit 100 and supports the display unit 100 so as to adjust the tilt angle, height and distance.

[0121] The supporting device 130 a includes a fixing seat bracket 140 , a first arm 160 , a second arm 190 , a third arm 220 , a support column 270 and a fixing unit 310 .

[0122] The fixing base bracket 140 , the first arm 160 , the second arm 190 , the third arm 220 , the support column 270 , and the fixing unit 310 are coupled to the back side of the display unit 100 so as to be relatively movable.

[0123] Therefore, the display unit 100 has a relatively high degree of freedom (degree of freedom greater than 5), so the height, front-to-back distance, and up-and-down tilt angle of the screen of the display unit 100 can be adjusted relative to the user's eyes, thereby easily ensuring an appropriate viewing angle.

[0124] The fixing seat bracket 140 is fixedly connected to the back of the display unit 100, and the front end of the first arm 160 is connected to the axis (ie, Figure 6 The tilt axis 1603) is tilted in the up and down direction as the center.

[0125] The front end of the second arm 190 is coupled to the rear end of the first arm 160 so as to be relatively rotatable around a shaft disposed vertically.

[0126] The front end of the third arm 220 is coupled to the rear end of the second arm 190 so as to be relatively rotatable around a shaft disposed vertically.

[0127] A rear end portion of the third arm 220 is movably coupled to the support column 270 .

[0128] The support column 270 is coupled to the fixing unit 310 so as to be relatively rotatable around a shaft disposed vertically.

[0129] The fixing unit 310 is fixed to a fixing object 101 (eg, a top plate of a desk or table).

[0130] The fixing unit 310 may be coupled to an edge of the fixing object 101 .

[0131] In this embodiment, the fixing object 101 is formed in a rectangular plate shape, for example, and the fixing unit 310 is coupled to the center of the rear side of the fixing object 101 as an example for description.

[0132] In this embodiment, the fixing unit 310 does not necessarily have to have a structure coupled to the rear edge of the fixing object 101. For example, the fixing unit 310 may also have a support structure that can be placed on the top plate of the fixing object 101.

[0133] The display unit 100 is formed in, for example, a rectangular parallelepiped shape having two long sides 1003 and two short sides 1004 .

[0134] Generally, the display unit 100 is configured to have a longer length on the left and right sides. The two long sides 1003 of the display unit 100 are configured in the horizontal direction, and the two short sides 1004 are configured in the vertical direction.

[0135] When the screen of the display unit 100 faces forward, the long side 1003 is arranged along the left-right direction, and the short side 1004 is arranged along the up-down direction.

[0136] In this embodiment, when the screen of the display unit 100 is arranged to face forward, the thickness direction of the display unit 100 may be referred to as the front-to-back direction.

[0137] The display unit 100 of this embodiment can be configured to rotate (pivot) between a first position where the two long sides 1003 are horizontally arranged and a second position where the two long sides 1003 are vertically arranged, with the first arm 160 coupled to the back as the center (see Fig.11 ).

[0138] A camera 105 capable of photographing a user is provided on the front of the display unit 100. The camera 105 may be disposed, for example, in the center of the upper edge (long side 1003) (eg, upper frame) of the screen of the display unit 100.

[0139] In this case, the optical axis of the camera 105 may be arranged on the display unit 100 at a predetermined angle tilted downward with respect to the normal line of the display unit 100 , so that the camera 105 can better photograph the user.

[0140] A recessed portion ( Figure 5 107), a recessed portion cover ( Figures 3 to 5 110) to cover the opening of the recessed portion 107. One side (front end) of the first arm 160 penetrates and is coupled to the recessed portion cover 110.

[0141] Figure 3 yes Figure 1 A cross-sectional view of a combined area of ​​the first arm and the display unit 100, Figure 4 yes Figure 3 Internal stereogram of Figure 5 It is shown Figure 3 Figure 1 shows the driving gear and driven gear of the vehicle. Figures 3 to 5 As shown, a fixing seat bracket 140 is disposed on the inner side of the recessed portion cover 110 .

[0142] The fixing seat bracket 140 has a substantially rectangular plate shape.

[0143] The recessed portion cover 110 may be formed in a rectangular plate shape having a size sufficient to surround the outer appearance of the fixing seat bracket 140 .

[0144] In this embodiment, the display unit 100 and the fixing base bracket 140 can be combined in a snap-fit ​​manner.

[0145] Specifically, an upper coupling protrusion 1401 is formed on the upper edge of the fixing seat bracket 140 and protrudes upward, and an upper coupling protrusion groove (not shown) for inserting the upper coupling protrusion 1401 can be formed on the upper side edge of the recessed portion 107 of the display unit 100.

[0146] On the other hand, an elastic protrusion 1403 that can be elastically protruded and retracted may be provided at the lower side of the recessed portion 107, and a lower coupling protrusion 1402 disposed in front of the elastic protrusion 1403 may be provided at the lower side of the fixing seat bracket 140. The elastic protrusion 1403 is disposed behind the lower coupling protrusion 1402 to prevent the lower coupling protrusion 1402 from detaching backward.

[0147] The lower coupling protrusion 1402 may include a horizontal section 14021 protruding forward from the lower end of the fixing seat bracket 140, and a vertical section 14022 bent downward from the horizontal section 14021. The elastic protrusion 1403 may be disposed at the lower side of the horizontal section 14021 of the lower coupling protrusion 1402 and behind the vertical section 14022.

[0148] Although not specifically shown in the drawings, an elastic protrusion spring may be provided on one side (lower side) of the elastic protrusion 1403, and the elastic protrusion spring applies elastic force to make the elastic protrusion 1403 protrude upward. A guide inclined surface 14031 is formed on the outer side (back side) of the elastic protrusion 1403 at an angle to the moving direction of the elastic protrusion 1403. When the guide inclined surface 14031 is pressed, the elastic protrusion 1403 is withdrawn to the lower side, and when the pressing force is released, the elastic protrusion 1403 is reset to the initial position protruding upward under the elastic force of the elastic protrusion spring.

[0149] According to such a configuration, the fixing seat bracket 140 is combined in a state of being tilted downwardly toward the rear, so that the end of the upper coupling protrusion 1401 can be inserted into the upper coupling protrusion groove. The lower side edge of the fixing seat bracket 140 is rotated downward to rotate the lower coupling protrusion 1402 downward to contact the guide inclined surface 14031 of the elastic protrusion 1403, and then the elastic protrusion 1403 is pressed by the vertical section 14022 of the lower coupling protrusion 1402. When the lower end of the vertical section 14022 of the lower coupling protrusion 1402 contacts and presses the guide inclined surface 14031 of the elastic protrusion 1403, the elastic protrusion 1403 moves downward.

[0150] When the vertical section 14022 of the lower coupling protrusion 1402 passes through the elastic protrusion 1403, the fixing seat bracket 140 contacts the back of the display unit 100. When the vertical section 14022 of the lower coupling protrusion 1402 passes through the elastic protrusion 1403, and the pressure acting on the elastic protrusion 1403 is released, the elastic protrusion 1403 protrudes upward and returns to the initial position. At this time, the elastic protrusion 1403 is arranged on the lower side of the horizontal section 14021 of the lower coupling protrusion 1402 and behind the vertical section 14022, so that the fixing seat bracket 140 can be prevented from accidentally separating from the display unit 100.

[0151] The recessed portion cover 110 and the fixing seat bracket 140 are respectively formed with receiving holes 1101 and 1404 to allow the first arm 160 to be relatively movably received.

[0152] The receiving holes 1101 and 1404 are respectively formed to have a longer length in the up-down direction to correspond to the relative movement trajectory of the first arm 160 when the display unit 100 is tilted up and down.

[0153] In this embodiment, the first arm 160 includes, for example: a first arm body 1601 ; and a second arm connecting portion 1602 formed at one end (rear end) of the first arm body 1601 and connected to the second arm 190 .

[0154] The first arm body 1601 has, for example, a rod shape.

[0155] The second arm connecting portion 1602 may be formed to be larger than the first arm body 1601 to correspond to the size of the second arm 190 , for example.

[0156] like Figure 4 As shown, a tilting shaft 1603 is provided at the front end of the first arm 160 .

[0157] The tilt axis 1603 is disposed perpendicular to the first arm 160 .

[0158] The tilt axis 1603 is arranged along the horizontal direction.

[0159] When the first arm 160 is disposed along the front-rear direction of the fixed object 101 , the tilt axis 1603 may be disposed along the left-right direction of the fixed object 101 .

[0160] The tilt shaft 1603 may be disposed, for example, at a distance from the front end of the first arm 160 .

[0161] A pivot shaft 1609 that is pivotable relative to the first arm body 1601 may be provided at a front end portion of the first arm 160 .

[0162] Thus, the display unit 100 can rotate along the panel direction with the first arm 160 (first arm body 1601) as the center.

[0163] The pivot shaft 1609 may be formed to protrude forward of the first arm body 1601 .

[0164] The pivot shaft 1609 may be rotatably coupled to the center of the first arm body 1601 .

[0165] A tilt shaft support member 1604 that supports the tilt shaft 1603 is provided at the front end of the first arm 160 (first arm body 1601 ).

[0166] The tilt shaft supporting member 1604 has a shape in which one side (front) is open.

[0167] The tilt shaft supporting member 1604 may be combined with the pivot shaft 1609 .

[0168] Thus, the tilt shaft supporting member 1604 can rotate around the pivot shaft 1609 .

[0169] The pivot shaft 1609 may be configured to be rotatable between a first position where the long side 1003 of the display unit 100 is horizontally arranged and a second position where the long side 1003 of the display unit 100 is vertically arranged, for example.

[0170] The tilting shaft 1603 may be spaced apart from the pivot shaft 1609 and supported by the tilting shaft supporting member 1604 .

[0171] An elastic member 1605 that is compressed and accumulates elastic force when the display unit 100 is rotated downward is provided between the tilt shaft 1603 and the tilt shaft supporting member 1604 .

[0172] The elastic member 1605 may be implemented by a torsion coil spring, for example.

[0173] Thus, when the display unit 100 is rotated upward, the display unit 100 can be easily rotated upward under the action of the elastic force accumulated by the elastic member 1605 .

[0174] In addition, a driving force required for the display unit 100 to rotate upward may be reduced.

[0175] The tilting shaft 1603 is provided with a tilting member 1606 that can be tilted up and down with the tilting shaft 1603 as the center.

[0176] The tilting member 1606 can rotate upward and downward around the tilting shaft 1603 .

[0177] An accommodation space is provided inside the inclined member 1606 .

[0178] The inclined member 1606 is formed to have an open rear end.

[0179] The front end of the inclined member 1606 is in contact with and coupled to the back surface of the fixing seat bracket 140 .

[0180] An inclined housing 1607 is provided on the outer side of the inclined member 1606 .

[0181] The tilting housing 1607 has a size larger than the tilting member 1606 so as to be able to accommodate the tilting member 1606 therein.

[0182] The tilt housing 1607 is received in the recessed portion 107 of the display unit 100 .

[0183] The inclined housing 1607 is formed in, for example, a rectangular parallelepiped shape having a receiving space opened toward the rear.

[0184] The rear end of the inclined housing 1607 is coupled to the fixing seat bracket 140 .

[0185] A connector 1608 is disposed inside the tilted housing 1607 .

[0186] The connector 1608 may be disposed inside the tilting housing 1607 and on the lower side of the tilting member 1606 .

[0187] When the tilt housing 1607 is inserted into the recessed portion 107 of the display unit 100 , the connector 1608 is connected to a connector (not shown) provided in the recessed portion 107 of the display unit 100 .

[0188] Thus, the display unit 100 can be electrically connected to other electronic devices (not shown). More specifically, the display device of this embodiment can be composed of a display screen (display) of a personal computer, and the electronic device can be composed of a main body of the personal computer. Through the connection of the connector 1608, the display device can be electrically connected to the main body of the personal computer.

[0189] On the other hand, the tilting member 1606 and the first arm 160 are provided with a tilting driving unit 180 that tilts the tilting member 1606 up and down around the tilting shaft 1603 .

[0190] The tilt driving unit 180 includes: a driving gear 181 formed on either side of the tilting member 1606 and the first arm 160; a driven gear 182, arranged on the other side of the tilting member 1606 and the first arm 160, and toothedly coupled to the driving gear 181; and a tilt driving motor 183, which rotationally drives the driving gear 181.

[0191] The tilting member 1606 is provided with the tilting drive motor 183 .

[0192] The tilt drive motor 183 may be disposed inside the tilt member 1606 and on an upper side of the tilt shaft support member 1604 .

[0193] The rotation axis of the tilt drive motor 183 is arranged in parallel with the tilt axis 1603 .

[0194] The driving gear 181 is provided on the rotating shaft of the tilt driving motor 183 .

[0195] The drive gear 181 can be designed, for example, as a spur gear having a toothed portion protruding radially on the circumference.

[0196] The driven gear 182 may be disposed on the tilting shaft 1603 , for example.

[0197] like Figure 5 As shown, the driven gear 182 can be implemented by a sector gear, which is formed on an arc spaced a preset distance from the tilting shaft 1603 , and the inner angles of both ends of the sector gear have preset angles.

[0198] The driven gear 182 may be fixedly supported by the tilting shaft 1603 and the tilting shaft supporting member 1604 , for example.

[0199] A plurality of protrusions 1822 protruding from the tilt shaft 1603 and the tilt shaft supporting member 1604 may be inserted and coupled to the driven gear 182 .

[0200] In this embodiment, the toothed portion of the driven gear 182 is disposed on the upper side of the tilting shaft 1603 , and the driving gear 181 is disposed on the upper portion of the tilting member 1606 to mesh with the toothed portion.

[0201] When the screen of the display unit 100 is arranged in the up-down direction (vertical direction), the driving gear 181 may be combined to be arranged at the center of the toothed portion of the driven gear 182. Thus, the driving gear 181 may move upward and downward along the driven gear 182.

[0202] With such a configuration, if the driving gear 181 rotates clockwise in the drawing, the driving gear 181 moves downward in the clockwise direction along the toothed portion of the driven gear 182, and the tilting member 1606 rotates upward around the tilting shaft 1603, so that the screen of the display unit 100 faces upward. On the contrary, if the driving gear 181 rotates counterclockwise, the driving gear 181 moves upward along the toothed portion of the driven gear 182, and the tilting member 1606 rotates downward around the tilting shaft 1603, so that the screen of the display unit 100 faces downward.

[0203] Figure 6 It is shown Figure 1 A cross-sectional view of the interior of a pillar, Figure 7 yes Figure 6 A cross-sectional view of the upper support, Figure 8 yes Figure 6 A cross-sectional view of the lower support, Fig. 9 It is a brief description Figure 7 The structure of the clutch is shown in the figure. Figure 6 As shown, the support 270 may include: a lower support 272 connected to the fixing unit 310 ; and an upper support 271 capable of being raised and lowered relative to the lower support 272 .

[0204] The third arm 220 may be disposed on the upper support column 271 .

[0205] The third arm 220 is disposed at the upper end of the upper support column 271 .

[0206] In this embodiment, the rear end of the third arm 220 may be coupled to the upper end of the upper support 271 .

[0207] Therefore, the height of the third arm 220 can be adjusted by being linked with the lifting and lowering of the upper support 271 .

[0208] The third arm 220 may be disposed perpendicular to the support column 270 .

[0209] The support column 270 is disposed in a vertical direction, and the third arm 220 is disposed in a horizontal direction.

[0210] The support column 270 may be provided with an elastic member 275 that is compressed and accumulates elastic force when the upper support column 271 descends.

[0211] Therefore, when the upper support 271 is raised, the driving force required for raising the upper support 271 can be reduced accordingly by the elastic force of the elastic member 275 .

[0212] The elastic member 275 may be implemented by a gas spring 275 , for example.

[0213] Two gas springs 275 may be disposed in parallel with each other.

[0214] The elastic member 275 (gas spring) may include, for example: a cylinder 2751 ; a piston 2752 disposed inside the cylinder 2751 ; and a piston rod 2753 connected to the piston 2752 and extending to the outside of the cylinder 2751 .

[0215] In this embodiment, one end of the elastic member 275 (gas spring) may be fixed to the lower support column 272 , and the other end of the elastic member 275 (gas spring) may be fixed to the upper support column 271 .

[0216] More specifically, the cylinder 2751 of the gas spring may be fixed to the upper support column 271 , and the piston rod 2753 may be fixed to the lower support column 272 .

[0217] The upper support 271 may be inserted into the lower support 272 , for example.

[0218] The upper support 271 and the lower support 272 may each have an elliptical cross section.

[0219] The outer surface of the upper support 271 may contact and slide with the inner surface of the lower support 272 .

[0220] like Figure 7 As shown, an upper frame 2711 is provided inside the upper support 271 .

[0221] The upper frame 2711 is provided with a gas spring accommodation portion 2712 for accommodating and coupling the gas spring 275 .

[0222] An upper guide 2713 is provided at the center of the upper frame 2711 .

[0223] The upper guide 2713 is formed to have a substantially rectangular cross-section.

[0224] The upper guide 2713 may be implemented as a rectangular tube having an accommodation space formed therein.

[0225] The upper guide 2713 may be disposed between the gas springs 275 .

[0226] like Figure 8 As shown, a lower frame 2721 is provided inside the lower support column 272 .

[0227] A lower guide 2722 is provided on the outer side of the lower frame 2721 , and the lower guide 2722 is inserted into the upper support 271 to guide the upper support 271 .

[0228] The lower frame 2721 is disposed inside the lower guide 2722 .

[0229] An upper guide support portion 27211 is formed through the lower frame 2721 , and the upper guide support portion 27211 supports the upper guide 2713 so as to be slidable.

[0230] A gas spring support portion 27212 is formed through the lower frame 2721 , and the gas spring support portion 27212 supports the gas spring 275 so as to be slidable.

[0231] The piston rod 2753 of the gas spring 275 is accommodated inside the gas spring support portion 27212 .

[0232] On the other hand, the support column 270 is provided with a height adjusting unit 280 for adjusting the height of the third arm 220 .

[0233] Thus, the height of the display unit 100 can be adjusted.

[0234] The height adjustment unit 280 may include a rack toothed portion 281 disposed on the lower support column 272 , a pinion 282 engaged with the rack toothed portion 281 and rotated, and a pinion drive motor 283 to drive the pinion 282 to rotate.

[0235] The rack toothed portion 281 may be disposed inside the upper guide support portion 27211 .

[0236] The rack toothed portion 281 may extend toward the inside of the upper guide member 2713 .

[0237] The pinion gear 282 may be disposed on the upper support column 271 .

[0238] The pinion gear 282 may be disposed on the upper guide member 2713 .

[0239] The upper support column 271 may be provided with a pinion drive motor 283 for rotationally driving the pinion 282 .

[0240] On the other hand, a clutch 284 may be provided between the pinion driving motor 283 and the pinion gear 282 , and the clutch 284 selectively transmits the rotation force of the pinion driving motor 283 to the pinion gear 282 .

[0241] Thus, the upper support 271 can be manually operated in a state where the power transmission between the pinion drive motor 283 and the pinion 282 is separated by the clutch 284.

[0242] Raised and lowered relative to the lower support column 272 .

[0243] like Fig. 9 As shown, the clutch 284 may include, for example: a first clutch 2841 coupled to the rotating shaft of the pinion drive motor 283 ; and a second clutch 2842 configured to approach and move away from the first clutch 2841 .

[0244] A first gear 2843 and a second gear 2844 are provided on one side of the second clutch 2842, meshing with each other at right angles. The second clutch 2842 is configured to be able to approach and move away from the first gear 2843. The second clutch 2842 can move away from the first gear 2843 and engage with the first clutch 2841. Thus, the rotational force of the pinion drive motor 283 can be transmitted to the pinion 282.

[0245] The second gear 2844 and the pinion gear 282 are coupled to the same rotating shaft.

[0246] When the second clutch 2842 is engaged with the first clutch 2841 , the rotational force of the pinion drive motor 283 is transmitted to the pinion gear 282 via the first clutch 2841 , the second clutch 2842 , the first gear 2843 , and the second gear 2844 .

[0247] When the second clutch 2842 is released from the first clutch 2841 , the pinion drive motor 283 and the pinion gear 282 are released, so that the pinion gear 282 is in a freely rotatable state.

[0248] According to such a configuration, if the pinion gear 282 rotates in one direction (counterclockwise), the pinion gear 282 moves downward along the rack toothed portion 281. As a result, the upper support 271 and the third arm 220 can move downward. At this time, each of the gas springs 275 accumulates elastic force while being compressed.

[0249] If the pinion 282 rotates in the other direction (clockwise), the pinion 282 moves upward along the rack toothed portion 281, and at this time, the upper support 271 and the third arm 220 move upward. At this time, the upper support 271 and the third arm 220 can easily move upward by the elastic force accumulated by each of the gas springs 275. In addition, the input current of the pinion drive motor 283 can be significantly reduced.

[0250] Fig.10 yes Figure 1 The control block diagram of the display device. Fig.10 As shown, the display device of this embodiment includes a control unit 350, and the control unit 350 has a control program and is implemented by a microprocessor.

[0251] The control unit 350 is configured to adjust at least one of the tilt angle, height, and distance of the display unit 100 .

[0252] The control unit 350 is provided with a signal input unit 355 for inputting an operation signal.

[0253] The signal input unit 355 may be configured to allow signal input through, for example, a pressing operation and / or a touch operation.

[0254] The camera 105 capable of photographing the user's gesture may be communicatively connected to the control unit 350. The camera 105 may be provided on the front side of the display unit 100.

[0255] The tilt driving unit 180 is controllably connected to the control unit 350 to adjust the tilt angle of the display unit 100 .

[0256] The height adjustment unit 280 is controllably connected to the control unit 350 to adjust the height of the display unit 100 .

[0257] The distance adjustment unit 190 may be controllably connected to the control unit 350 to adjust the distance of the display unit 100 .

[0258] The distance adjusting unit 190 may include, for example, the first rotation driving unit 200 and the second rotation driving unit 250 .

[0259] The distance adjusting unit 190 may include, for example, the second rotation driving unit 250 and the third rotation driving unit 340 .

[0260] The distance adjusting unit 190 may include, for example, the first rotation driving unit 200 , the second rotation driving unit 250 , and the third rotation driving unit 340 .

[0261] The control unit 350 may include, for example, the second rotation driving unit 250 and the third rotation driving unit 340 .

[0262] The control unit 350 can be configured to respectively identify the basic posture and posture changes of the user captured by the camera 105, and respectively control at least one of the tilt drive unit 180, the height adjustment unit 280 and the distance adjustment unit 190, so as to be able to adjust the direction of the display unit to be suitable for the user's viewing angle.

[0263] At least one of the tilt driving unit 180 , the height adjusting unit 280 , and the distance adjusting unit 190 may be collectively referred to as a “posture adjusting driving unit”.

[0264] For example, the control unit 350 may be configured to actively adjust the viewing angle between the user and the display unit 100 to guide the user to change his posture when the user has been in the basic posture for a set period of time or longer.

[0265] The control unit 350 may be configured to notify the user of the change in posture by using the display unit 100 when the posture of the user changes from the basic posture and exceeds the set time.

[0266] The control unit 350 may be configured to guide the user to perform posture change information using the display unit 100 when the user's posture changes from the basic posture and exceeds the set time, and to enable the user to perform slight neck movements while watching the display unit 100. More specifically, the control unit 350 may be configured to guide the user to perform neck movements when the display unit 100 rotates up and down, and to guide the user to perform neck movements when the display unit 100 rotates left and right, while the user is watching the screen of the display unit 100.

[0267] The control unit 350 may include a timer 3501 for timing.

[0268] The control unit 350 may include a data storage unit 3502 that stores various information including information related to the user's basic posture and changed postures.

[0269] The control unit 350 may include an artificial intelligence model storage unit 3503 for storing a model composed of an artificial neural network that is being learned or has been learned, that is, an artificial intelligence model.

[0270] Although not shown in the figure, the control unit 350 may further include a learning processor for enabling the artificial intelligence model to learn.

[0271] The data storage unit 3502 and the artificial intelligence model storage unit 3503 may also be stored in a separate memory which is a hardware entity independent of the control unit 350 .

[0272] Artificial Intelligence (AI) that can be used in the present invention will be described below.

[0273] Artificial intelligence refers to the field of research on artificial intelligence or the methodology that can create artificial intelligence, while machine learning refers to the field of defining various problems that are dealt with in the field of artificial intelligence and studying the methodology to solve these problems. Machine learning can also be defined as an algorithm that improves the performance of a certain task through continuous experience.

[0274] An artificial neural network (ANN) is a model used in machine learning. It can refer to the entire model composed of artificial neurons (nodes) that form a network through synaptic connections and have problem-solving capabilities. An artificial neural network can be defined by the connection pattern between neurons in different layers, the learning process for updating model parameters, and the activation function that generates output values.

[0275] The artificial neural network may include an input layer, an output layer, and optionally one or more hidden layers. Each layer may include one or more neurons, and the artificial neural network may include synapses connecting neurons. In the artificial neural network, each neuron may output an input signal input through a synapse, a weight value, and a function value of an activation function for a bias.

[0276] Model parameters refer to parameters determined through learning, including the weight values ​​of synaptic connections and the bias of neurons. In addition, hyperparameters refer to parameters that need to be set before learning in machine learning algorithms, including learning rate, number of iterations, mini batch size, initialization function, etc.

[0277] The learning objective of an artificial neural network can be considered as determining the model parameters that minimize the loss function. The loss function can be used as an indicator for determining the optimal model parameters during the learning process of the artificial neural network.

[0278] According to the learning method, machine learning can be divided into supervised learning, unsupervised learning, and reinforcement learning.

[0279] Supervised learning may refer to a method of making an artificial neural network learn given a label for learning data, and the label may refer to the correct answer (or result value) that the artificial neural network should infer when the learning data is input into the artificial neural network. Unsupervised learning may refer to a method of making an artificial neural network learn without giving a label for learning data. Reinforcement learning may refer to a learning method of selecting an action or action sequence that maximizes the cumulative compensation in each state for an agent defined in a certain environment.

[0280] In artificial neural networks, machine learning using a deep neural network (DNN) including a plurality of hidden layers may also be referred to as deep learning, and deep learning is a part of machine learning. Hereinafter, machine learning is used to include deep learning.

[0281] Object detection models using machine learning include the single-step YOLO (you Only Look Once) model and the two-step Faster R-CNN (Regions with Convolution Neural Networks) model.

[0282] The YOLO (You Only Look Once) model is a model that can predict the object and the location of the object in an image by looking at the image only once.

[0283] The YOLO (You Only Look Once) model divides the original image into grids of the same size. In addition, for each grid, the number of bounding boxes specified in a predefined shape is predicted with the center of the grid as the center, and the reliability is calculated based on this.

[0284] Then, whether an object is contained in the image, or whether it contains only the background, and a position with high object reliability can be selected to grasp the object category.

[0285] The Faster R-CNN (Regions with Convolution Neural Networks) model is a model that can detect objects faster than the RCNN model and the Fast RCNN model.

[0286] Specifically explain the Faster R-CNN (Regions with Convolution Neural Networks) model.

[0287] First, a feature map is extracted from the image through a CNN (Convolution Neural Network) model. Based on the extracted feature map, multiple regions of interest (RoI) are extracted. Region of interest pooling is performed on each region of interest.

[0288] The region of interest pooling refers to a process of setting a grid for a feature map projected on the region of interest to fit a preset H×W size, and extracting a feature map having an H×W size by extracting the maximum value according to the grids included in each grid.

[0289] A feature vector may be extracted from the feature map having a size of H x W, and identification information of the object may be acquired from the feature vector.

[0290] The artificial intelligence model stored in the artificial intelligence model storage unit 3503 can be learned on a separate AI server and can be downloaded from the AI ​​server to the artificial intelligence model storage unit 3505. Fig.11 , describing an AI server that enables the artificial intelligence model to learn. Fig.11 An AI server according to an embodiment of the present invention is shown.

[0291] Reference Fig.11 , the AI ​​server 2000 may refer to a device that uses a machine learning algorithm to make an artificial neural network learn or use a learned artificial neural network. Here, the AI ​​server 2000 may be composed of a plurality of servers and perform distributed processing, and may be defined as a 5G network. At this time, the AI ​​server 2000 may also be included as part of the display device and perform at least part of the AI ​​processing together.

[0292] The AI ​​server 2000 may include a memory 2300 , a learning processor 2400 , a processor 2600 , and the like.

[0293] The communication unit 2100 can transmit and receive data with an external device such as the display device.

[0294] The memory 2300 may include a model storage unit 2310. The model storage unit 2310 may store an artificial intelligence model (or an artificial neural network) 2310a that is being learned or has been learned by the learning processor 2400.

[0295] The learning processor 2400 can use the learning data to learn the artificial neural network 2310a. The learning model can be used in a state where it is installed in the AI ​​server 2000 of the artificial neural network, or can also be installed in an external device such as the display device.

[0296] The learning model may be implemented by hardware, software, or a combination of hardware and software. When a part or all of the learning model is implemented by software, one or more instructions constituting the learning model may be stored in the memory 230 .

[0297] Processor 2600 may utilize the learning model to infer result values ​​for new input data, and may generate responses or control instructions based on the inferred result values.

[0298] Fig.12 It is shown Figure 2 FIG. 1 is a diagram showing a state where the display unit is pivoted in the up-down direction. Fig.12 As shown, the display device of this embodiment can rotate between a first position where the long side 1003 of the display unit 100 is horizontally arranged and a second position where the long side 1003 is vertically arranged.

[0299] When the display unit 100 is to be rotated to the second position, the display unit 100 may be rotated clockwise. When the display unit 100 is pressed clockwise, the display unit 100 rotates around the pivot shaft 1609. At this time, the display unit 100 is stopped at the second position by the stopper 211.

[0300] Fig.13 It is used to illustrate Figure 2 Figure 1 shows the up and down tilt and height adjustment of the display unit. Fig.12 As shown, the control unit 350 can control the tilt driving unit 180 to adjust the tilt angle of the screen of the display unit 100 .

[0301] In this embodiment, the tilt angle of the screen of the display unit 100 can also be adjusted manually. Specifically, when manually adjusting the tilt angle of the screen of the display unit 100, if the edge of the display unit 100 is grasped and pressure is applied upward or downward, the display unit 100 rotates upward or downward respectively with the tilt axis 1603 as the center.

[0302] The control unit 350 may control the height adjustment unit 280 to adjust the height of the display unit 100 .

[0303] In this embodiment, the height of the display unit 100 can be achieved by manual operation. When the height of the display unit 100 is to be increased, the upper support 271 or the third arm 220 can be moved upward by grasping the lower support 272. Conversely, when the height of the display unit 100 is to be decreased, the third arm 220 or the upper support 271 can be pressed toward the lower support 272.

[0304] Further references Fig.14 , briefly describing the operation of the display device as described above. Fig.14 A block diagram for explaining the operation of a display device according to an embodiment of the present invention is shown.

[0305] The camera 105 may acquire an image frame (still image or video) of a user located in front of the display device to use the display device [ S141 ].

[0306] The control unit 350 may receive the image frame from the camera 105, perform two-dimensional facial landmark recognition of the user from the image frame, and perform three-dimensional body skeleton recognition of the user from the image frame [S143]. The facial landmark recognition and body skeleton recognition will be described later.

[0307] The control unit 350 may acquire the user's posture information based on the results of the facial landmark recognition and the body frame recognition [S144]. That is, the control unit 350 may detect changes in the user's posture based on the facial landmark recognition and the body frame recognition.

[0308] The user's posture may refer to at least one of the relative position and direction of each part of the user's body. The user's posture may be a concept further including at least one of the relative position of the user relative to the display unit 100 (for example, the distance of the user from the display unit 100, the height of the user's face relative to the display unit 100, etc.) and direction.

[0309] The control unit 350 may control at least one of the tilt driving unit 180 , the height adjusting unit 280 , and the distance adjusting unit 190 based on the posture information of the user and the current posture information of the display unit 100 [ S146 ].

[0310] That is, at least one of the tilt drive unit 180, the height adjustment unit 280 and the distance adjustment unit 190 can adjust the posture of the display unit 100 to be suitable for the user under the control of the control unit 350, so that the posture of the display unit 100 is suitable for the posture of the user, that is, the user can comfortably view the display unit 100 [S147].

[0311] The posture of the display unit 100 may refer to at least one of a tilt angle, a pan angle, a height, and a distance of the display unit 100 .

[0312] The control unit 350 may obtain the adjusted posture information of the display unit 100 [S145]. The control unit 350 may obtain the adjusted posture information from the tilt driving unit 180, the height adjusting unit 280, and the distance adjusting unit 190, or may obtain the adjusted posture information from control instruction information for controlling the tilt driving unit 180, the height adjusting unit 280, and the distance adjusting unit 190.

[0313] As described above, the acquired posture information of the display unit 100 may be used together with the posture information of the user for posture adjustment of the display unit 100 [ S146 ].

[0314] Below, refer to Fig.15 , illustrating two-dimensional facial landmark recognition of the user. Fig.15 FIG. 1 is a diagram for explaining two-dimensional facial landmark recognition of a user according to an embodiment of the present invention.

[0315] like Fig.15 As shown in (15-1), the control unit 350 can identify the two-dimensional facial landmarks of the user U from the user image P acquired by the camera 105. The facial landmarks may refer to the facial feature points of the user U. Fig.15 In (15-1), the facial landmarks are represented by a plurality of points.

[0316] In order to recognize the two-dimensional facial landmarks of the user U, the control unit 350 may utilize the artificial intelligence model stored in the artificial intelligence model storage unit 3505 .

[0317] Then, the control unit 350 can analyze the two-dimensional facial landmarks of the user U and find out the facial landmarks in the user image P that are similar to the two-dimensional facial landmarks of the user U. Fig.15 The number of pixels (or pixel distance) pd corresponding to the actual distance PD between the eyes of the user U shown in (15-2) is as follows. In the present invention, the distance between the eyes may refer to the distance between the through holes.

[0318] When the actual eye distance PD of the user U is known, the Fig.15 The distance D from the camera 105 to the face of the user U is calculated by the equation shown in (15-3) of FIG. 15 through the user image P (i.e., only one image frame from which the facial landmarks can be derived). In the equation, "f" may refer to the focal distance. The actual distance PD between the eyes of the user U will be described later.

[0319] When calculating the distance D between the camera 105 and the face of the user U, it is not necessary to use the two eyes of the user. Of course, other body parts or other two feature points (for example, two ears) may also be used. The feature points (two eyes, two ears, etc.) of the user's face used when calculating the distance D between the camera 105 and the face of the user U may also be understood as "reference feature points".

[0320] Further references Fig.16 The reason why the distance D from the camera 105 to the face of the user U is important for understanding the posture of the user is described below. Fig.16 FIG. 1 shows a change in the eye height of a user U in a user image P captured by a camera installed on the display unit based on the distance between the display unit and the user according to an embodiment of the present invention.

[0321] As described above, a camera capable of photographing a user may be provided at the upper end of the front side of the display unit 100. Figure 1 and Figure 2 The optical axis of the camera 105 may be arranged on the display unit 100 at a predetermined angle tilted downward with respect to the normal line of the display unit 100, so that the camera 105 can better photograph the user.

[0322] In this case, even if the eye height of the user U is the same relative to the display unit 100 , the eye height of the user U in the user image P captured by the camera 105 may become different depending on the distance between the display unit 100 and the user U.

[0323] More specifically, in Fig.16 In (16-1), (16-2) and (16-3), three situations are shown in which the eye height of the user U is the same relative to the display unit 100 and the distance between the display unit 100 and the user U is different. Fig.16 In (16-1), (16-2) and (16-3), a dotted line E1 indicating the height of the center of the display unit 100 is shown.

[0324] That is, in Fig.16In the three cases of (16-1), (16-2) and (16-3), it is illustrated that the eye height of the user U corresponds to the height of the center of the display unit 100, and the distance DZ between the display unit 100 and the user U is Fig.16 In (16-1), it is 90cm. Fig.16 In (16-2) it is 56cm, in Fig.16 In (16-3), it is 50cm.

[0325] Fig.16 (16-4) shows that Fig.16 The first user image P1 captured in the case of (16-1), Fig.16 (16-5) shows that Fig.16 The second user image P2 captured in the case of (16-2) is Fig.16 (16-6) shows that Fig.16 The third user image P3 is captured in the case of (16-3). In the first user image P1, the second user image P2, and the third user image P3, a horizontal line running through the middle of the upper and lower lengths is indicated by a dotted line E2.

[0326] In the first user image P1, the eye height of the user U is located higher than the dotted line E2. In the second user image P2, the eye height of the user U is located on the dotted line E2. In the third user image P3, the eye height of the user U is located lower than the dotted line E2.

[0327] That is, in fact, Fig.16 In the three cases (16-1), (16-2) and (16-3), even if the eye height of the user U is the same relative to the display unit 100, as the distance between the display unit 100 and the user U becomes different, the eye height of the user U may also become different in the first to third user images P1, P2, P3 captured by the camera 105.

[0328] Therefore, in order to accurately grasp the posture (especially, the height of the face or eyes) of the user U captured by the camera 105 installed on the display unit 100, it is important to grasp the distance DZ between the display unit 100 and the user or the distance D between the camera 105 installed on the display unit 100 and the user.

[0329] Below, refer to Fig.17 , illustrating the three-dimensional body skeleton recognition of the user. Fig.17 FIG. 1 is a diagram for explaining three-dimensional body skeleton recognition of a user according to an embodiment of the present invention.

[0330] As described above, when the actual eye distance PD of the user U is known, the Fig.15 The formula shown in (15-3) calculates the distance D between the camera 105 and the face of the user U from the number of pixels (or pixel distance) pd corresponding to the actual distance PD between the eyes of the user U in the user image P.

[0331] However, the control unit 350 cannot determine whether the user U is looking at the display unit 100 (or the camera 105 ) from the front or from the side based on the user image U.

[0332] Even if the distance D between the camera 105 and the face of the user U is the same, the number of pixels (or pixel distance) pd corresponding to the actual distance PD between the two eyes of the user U in the user image P may become different depending on the direction the user U is facing (i.e., looking at the display unit 100 from the front or from the side).

[0333] Therefore, in order to accurately grasp the distance D between the camera 105 and the face of the user U, it is necessary to grasp the posture of the user U, such as the facing direction, and correct the number of pixels (or pixel distance) pd corresponding to the actual distance PD between the two eyes of the user U according to the grasped posture of the user U.

[0334] To this end, the control unit 350 may be configured as follows: Fig.17 The user image P is analyzed as shown in (17-1) to identify Fig.17 The three-dimensional body skeleton (or body bones) of the user shown in (17-2).

[0335] That is, the control unit 350 may be as follows Fig.17 The user image P is analyzed as shown in (17-1) to identify various body parts of the user, such as the head H, shoulders S, chest C, right arm RA and left arm LA.

[0336] The control unit 350 may generate the following information based on the various body parts of the user identified: Fig.17 The three-dimensional body skeleton of the user is shown in (17-2). Based on the three-dimensional body skeleton, the positions of various body parts of the user in the direction Z from the display unit 100 toward the user U can be grasped. Fig.17 The three-dimensional body skeleton of (17-2) can three-dimensionally identify various body parts of the user, such as the head H, shoulders S, chest C, right arm RA and left arm LA.

[0337] Therefore, the control unit 350 can grasp the posture of the user U, such as the facing direction, based on the three-dimensional body skeleton, and correct the number of pixels (or pixel distance) pd corresponding to the actual binocular distance PD of the user U according to the grasped user posture.

[0338] Below, refer to Fig.18 , illustrating an example (not limited to this) of the distance D between the camera 105 and the face of the user U and the posture information of the user that can be obtained from the three-dimensional body skeleton. Fig.18 Shows that the Fig.17 An example of posture information of the user obtained by using a three-dimensional body skeleton. Fig.18 In FIG. 1 , the camera 105 is shown to be disposed protruding upward at the upper end of the display unit 100. However, in the following description, even if the camera 105 is disposed at the upper edge of the display unit 100 as described above, it can be applied as it is.

[0339] Examples of the user's posture information that can be grasped from the distance D between the camera 105 and the face of the user U and the three-dimensional body skeleton are as follows.

[0340] 1) If Fig.18 As shown in (18-1) and (18-2), the position of the point OP (hereinafter referred to as the "normal point") where the normal line toward the user's eye on the display panel intersects the plane of the display panel can be grasped.

[0341] 2) If Fig.18 As shown in (18-1) and (18-2), the position of the point GP (hereinafter referred to as the "sight point") where the user's line of sight intersects the plane of the display panel can be grasped.

[0342] 3) If Fig.18 As shown in (18-1), the distance (or position) from the normal point OP to the user's eye in the Z direction, that is, the Z direction distance DZ, can be grasped.

[0343] 4) If Fig.18 As shown in (18-1) and (18-2), the distance from the position of the camera 105 to the user's eyes in the vertical direction (i.e., the Y direction) of the display panel, i.e., the Y direction distance DY, can be grasped.

[0344] 5) If Fig.18 As shown in (18-2), the distance from the position of the camera 105 to the user's eyes in the horizontal direction (ie, X direction) of the display panel, that is, the X direction distance DX, can be grasped.

[0345] This is just an example, and the user's other posture information can also be used to determine the user's U orientation. For example, as mentioned above, the user U's facing direction can be determined from the three-dimensional body skeleton. In addition, the three-dimensional body skeleton can also be used to determine whether the user is in a turtle neck posture. In order to determine the normal point and / or the sight point, the display device can also include an eye tracking sensor (not shown).

[0346] As described above, the control unit 350 may adjust the posture of the display unit 100 through at least one of the tilt driving unit 180 , the height adjusting unit 280 , and the distance adjusting unit 190 based on the posture information of the user.

[0347] However, if the posture of the display unit 100 is immediately and sensitively changed according to the changed posture of the user every time the posture of the user slightly changes, this may instead cause the user to feel dizzy. Therefore, it may also be necessary to change the posture of the display unit 100 when the change in the posture of the user is above a specified level. Fig.19 Provide explanation. Fig.19 An example of changes in a user's posture detected according to an embodiment of the present invention is shown.

[0348] Fig.19 The graph of (19-1) (hereinafter, the first graph) shows the real-time height of the user's face (or eyes) over time. That is, line 1-1 L1-1 of the first graph represents the value of the height change of the user's face measured in real time, line 1-2 L1-2 of the first graph represents the average value of line 1-1 L1-1 within the first unit time, and line 1-3 L1-3 of the first graph represents the average value of line 1-1 L1-1 within the second unit time that is greater than the first unit time.

[0349] Fig.19 The graph of (19-2) (hereinafter, the second graph) shows the amount of change of each line of the first graph. That is, the 2-1 line L2-1 of the second graph shows the amount of change of the 1-1 line L1-1 of the first graph, the 2-2 line L2-2 of the second graph shows the amount of change of the 1-2 line L1-2 of the first graph, and the 2-3 line L2-3 of the second graph shows the amount of change of the 1-3 line L1-3 of the first graph.

[0350] The control unit 350 may also control the posture change of the display unit 100 according to the 1-2 line L1-2 or the 1-3 line L1-3 of the first graph, instead of controlling the posture change of the display unit 100 according to the 1-1 line L1-1 of the first graph.

[0351] The 1-2 line L1-2 and the 1-3 line L1-3 of the first curve graph represent average values ​​within a specified unit time, so when the 1-2 line L1-2 or the 1-3 line L1-3 of the first curve graph is used, the posture of the display unit 100 can be adjusted less sensitively than when the 1-1 line L1-1 of the first curve graph is used.

[0352] Alternatively, the control unit 350 may control the posture change of the display unit 100 according to any one of the 2-1 line L2-1, the 2-2 line L2-2, and the 2-3 line L2-3 of the second graph. That is, when any one of the 2-1 line L2-1, the 2-2 line L2-2, and the 2-3 line L2-3 of the second graph is used, when the absolute value of the change amount of the corresponding line is greater than a specified value, the control unit 350 may control the posture change of the display unit 100. In this case, the posture of the display unit 100 can of course be adjusted less sensitively than when the 1-1 line L1-1 of the first graph is used.

[0353] The above illustrates that if the actual eye distance PD of the user U is known, the distance can be calculated based on Fig.15 The distance D between the camera 105 and the face of the user U is calculated by using the formula (e.g., the pinhole camera model formula) shown in (15-3), which is necessary to accurately grasp the posture (especially, height) of the user U photographed by the camera 105 installed on the display unit 100. The following describes the calibration for measuring the actual inter-eye distance PD of the user U.

[0354] First, refer to Figure 20 to Figure 22 , describing the preparation for the calibration. Fig. 20 The figure shows the preparation process of calibration according to an embodiment of the present invention. Fig.21 and Fig. 22 A guide screen displayed to guide calibration according to an embodiment of the present invention is shown.

[0355] The calibration preparation process may be started when the display device is powered on and / or when a prescribed instruction is input from the user through the signal input unit 355 .

[0356] When the display device is powered on or the specified instruction is input through the signal input unit 355, the control unit 350 can control the display unit 100 to display the following information: Fig.21 A first guide screen 1100 is shown for guiding the user to perform calibration.

[0357] An execution step notification icon 1110 for notifying a current execution step of the calibration may be displayed on the first guide screen 1100 .

[0358] The first guide screen 1100 may display a user posture guide image 1120 for guiding the posture that the user should take for the calibration. The posture that the user should take (hereinafter, "user basic posture") may be a posture that is taken at a predetermined distance from the display unit 100 so that the user can view the display unit 100 most correctly and comfortably. In the first guide screen 1100, the predetermined distance is exemplified as the user's arm length. The predetermined distance may be different depending on the size of the display unit 100. The predetermined distance may be a distance at which there is no problem in realizing the three-dimensional image described below.

[0359] In addition, a guidance instruction 1130 explaining actions that the user should take to prepare for the calibration may be displayed on the first guidance screen 1100 .

[0360] If the calibration preparation process starts, the control unit 350 may determine whether the current position of the display unit 100 is the lowermost end [ S201 ].

[0361] As a result of the determination, if the current position of the display unit 100 is not the lowest end, the display unit 100 may be controlled to move toward the lowest end until it moves to the lowest end [S202].

[0362] If the current position of the display unit 100 is at the bottom, the control unit 350 may activate the camera 105 at the current position of the display unit 100 to determine whether the presence of a person (i.e., the user of the display unit 100) can be detected by the camera 105 [S203]. To this end, the two-dimensional facial landmark recognition and / or three-dimensional body skeleton recognition may be used.

[0363] If it is determined that there is no person, the control unit 350 may cause the display unit 100 to gradually move upward by a first predetermined distance until the presence of a person is detected [ S203 , S204 , S205 ].

[0364] If the display unit 100 moves to the uppermost position and no human presence is detected, the control unit 350 may determine that the detection of human presence has failed (i.e., determine that the calibration cannot be continued) and may interrupt the calibration preparation process [S206, S207].

[0365] If it is determined that a person is present, the control unit 350 may determine whether the face of the detected person is located in the center in the vertical direction of the image captured by the camera 105 [S208].

[0366] If the face of the person is not located in the center of the image captured by the camera, the control unit 350 may control to adjust the height of the display unit 100 so that the face is located in the center [S209].

[0367] If the face of the person is located in the center of the image captured by the camera, the control unit 350 may determine whether the display unit can be moved upward or downward from the current position by more than a second specified distance (e.g., 5 cm). The second specified distance may be the same as the first specified distance, or may be shorter or longer.

[0368] If the display unit can be moved upward or downward from the current position by more than a second predetermined distance, the control unit 350 may determine that the calibration can be continued and terminate the calibration preparation process.

[0369] However, if the display unit cannot be moved upward or downward from the current position by more than the second specified distance, it can be determined that the calibration cannot be continued and the calibration preparation process is interrupted [S207].

[0370] On the other hand, the control unit 350 may control the display unit 100 to display the following information during the period when the display unit 100 is moved up and down during the calibration preparation process: Fig. 22 A second guide screen 1200 is shown for guiding the user to perform calibration.

[0371] An execution step notification icon 1210 for notifying a current execution step of the calibration may be displayed on the second guide screen 1200 .

[0372] The second guide screen 1200 may display a guide image 1220 notifying that the display unit 100 can be moved up and down for the calibration and a guide instruction 1230 .

[0373] In addition, the second guide screen 1200 may display an image 1240 captured by the camera 105 .

[0374] In the above calibration preparation process, it is described that while the display unit 100 is moving from the bottom to the top, it is determined whether a person is present. However, the present invention is not limited thereto. Of course, it can also be configured such that while the display unit 100 is moving from the top to the bottom, it is determined whether a person is present.

[0375] After the calibration preparation process is completed, the calibration can be officially performed. Figure 23 to Figure 26 , describing the execution process of the calibration. Fig.23 FIG. 2 shows the execution flow of calibration according to an embodiment of the present invention. Figure 24 to Figure 26 A guide screen displayed for guiding calibration according to an embodiment of the present invention is shown.

[0376] The control unit 350 may obtain, at the current position of the display unit 100 , through the camera 105 , a first user image frame in which the user maintaining the basic posture in the display unit 100 is taken as a subject [ S231 ].

[0377] After obtaining the first user image frame, the control unit 350 may control the display unit 100 to move from the current position to the upper side or the lower side to the position separated by a second predetermined distance [ S232 ].

[0378] Furthermore, the control unit 350 may obtain, through the camera 105 at the moved position, a second user image frame in which the user maintaining the basic posture on the display unit 100 is taken as a subject [S233].

[0379] The second specified distance may be defined as a minimum distance at which a three-dimensional image of the user can be realized using the first user image frame and the second user image frame.

[0380] The control unit 350 may control the display unit 100 to display the following image during the period of moving the display unit 100 upward or downward to obtain the first user image frame and the second user image frame: Fig.24 A third guide screen 1300 is shown for guiding the user to perform calibration.

[0381] The third guide screen 1300 may display an execution step notification icon 1310 for notifying a current execution step of the calibration.

[0382] A guide image 1320 notifying that the first user image frame and the second user image frame are being acquired may be displayed on the third guide screen 1300 .

[0383] The third guide screen 1300 may display a guide instruction 1330 requesting the user to maintain a posture because the first user image frame and the second user image frame are being acquired.

[0384] In addition, the third guide screen 1300 may display an image 1340 captured by the camera 105 .

[0385] The control unit 350 may analyze the first user image frame and the second user image frame to determine whether the user has moved in the first user image frame and the second user image frame [S234, S235]. That is, it may be determined whether the user's movement in the first user image frame and the second user image frame is within a specified number of pixels (or pixel distance). This is to cope with the situation where the user attempts to maintain the basic posture but moves unintentionally.

[0386] Since the first user image frame and the second user image frame are obtained when the display unit moves in the up-down direction, the movement of the user may be left-right movement. If the first user image frame and the second user image frame are obtained when the display unit moves in the up-down direction, the movement of the user may be up-down movement.

[0387] The left-right movement may be determined based on the user's feature points (e.g., eyes, nose, philtrum, facial contour, etc.) in the first user image frame and the second user image frame. The specified number of pixels may be defined as the maximum pixel value without problems when the first user image frame and the second user image frame are used to realize the three-dimensional image of the user.

[0388] If it is determined that the user's movement in the first user image frame and the second user image frame is not within the specified number of pixels (i.e., determined to be user movement), the control unit 350 may determine that calibration cannot be performed further and may interrupt the calibration execution process [S236].

[0389] If the calibration execution process is interrupted, the control unit 350 may control the display to be as follows: Fig.25 The fourth guiding screen 1400 is shown for guiding the interruption of the calibration execution process.

[0390] The fourth guide screen 1400 may display an execution step notification icon 1410 for notifying a current execution step of the calibration.

[0391] The fourth guidance screen 1400 may display a guidance image 1420 and a guidance instruction 1430 for notifying that the calibration execution process is interrupted.

[0392] In addition, the fourth guide screen 1400 may display an image 1440 captured by the camera 105 .

[0393] The fourth guidance screen 1400 may also be displayed when the calibration preparation process is interrupted in the step S207.

[0394] If it is determined that the user's movement in the first user image frame and the second user image frame is within the specified number of pixels (ie, it is determined that the user has not moved), the control unit 350 may perform the following actions [S237].

[0395] 1) The control unit 350 may correct at least one of the first user image frame and the second user image frame based on the orientation information of the display unit when the first user image frame and the second user image frame are obtained (i.e., information about at least one of tilt, yaw, and roll). This is because the optical axis of the camera 105 may not be precisely perpendicular to the up-and-down movement direction of the display unit 100 depending on the orientation direction of the display unit 100. That is, at least one of the first user image frame and the second user image frame is corrected so that they are corrected as if they were taken by a camera having an optical axis perpendicular to the up-and-down movement direction of the display unit 100.

[0396] 2) The control unit 350 may generate a depth map of the user using the first user image frame and the second user image frame, and may obtain three-dimensional landmark information of the user's face.

[0397] 3) The control unit 350 can measure the distance between the camera and the user by changing the position of the same feature point in the first user image frame and the second user image frame taken at a second predetermined distance. In addition, the control unit 350 can measure the actual distance PD between the eyes of the user using the depth map and the three-dimensional marker information.

[0398] 4) The control unit 350 may generate a three-dimensional facial mesh of the user using the depth map and the three-dimensional marker information.

[0399] Next, the control unit 350 may calculate and determine the display unit posture (or its setting) that is most suitable for the user based on the three-dimensional facial mesh of the user, and adjust the posture of the display unit 100 (for example, at least one of the height value, the tilt angle value, and the distance value) to achieve the calculated optimal posture of the display unit 100, thereby proposing the optimal posture of the display unit 100 to the user [S238]. The control unit 350 may also infer the optimal posture through the artificial intelligence model based on the three-dimensional facial mesh of the user.

[0400] The control unit 350 can be controlled to display the following Fig.26 The fifth guiding screen 1500 is shown for guiding the calibration execution process to end.

[0401] The fifth guide screen 1500 may display an execution step notification icon 1410 for notifying a current execution step of the calibration.

[0402] The fifth guidance screen 1500 may display a guidance image 1520 and a guidance description 1530 notifying that the calibration execution process is completed.

[0403] In addition, the fifth guide screen 1500 may display an image 1540 captured by the camera 105 .

[0404] The above describes the use of the actual distance between the eyes of the user. Fig.15 The distance D between the camera 355 and the user is calculated using the relationship formula between the actual distance between the two eyes and the pixel distance between the two eyes in (15-3). However, when calculating the distance D between the camera 355 and the user, the actual distance between the two eyes of the user is not necessarily required. If the ratio information between the separation distance between the camera and the user measured when performing the calibration (hereinafter referred to as the "reference separation distance") and the pixel distance between the two eyes in the first image frame and / or the second image frame captured when performing the calibration (hereinafter referred to as the "reference pixel distance") is stored, then only the ratio information is used. Fig.15 The pixel distance between the two eyes of the user image P of (15-1) can be measured using the ratio information. Fig.15 The distance D between the camera 105 and the face of the user U in the user image P of (15-1) is shown in FIG. The actual distance between the two eyes of the user and the ratio information may be collectively referred to as basic information for calculating the distance between the user.

[0405] The above describes how to obtain the display unit posture or its setting that is judged to be most suitable for the user according to the calibration execution process. However, it is not necessary to perform the calibration execution process for this purpose. Alternatively, the display device may also provide a pre-stored default display unit posture setting (hereinafter, also referred to as a "default setting") as the setting for the optimal posture of the display unit 100. And various default settings may be stored according to the user's gender and / or age. By allowing the user to directly input his or her own gender and / or age, one of the various default settings may be called. Alternatively, the user's gender and / or age may be inferred by the artificial intelligence model, and the default setting corresponding to the inferred gender and / or age may be called. The setting for the optimal posture of the display unit 100 may also be inferred by the artificial intelligence model based on the inferred gender and / or age.

[0406] In addition, the calibration execution process may not be executed, and the default eye distance (i.e., the average actual eye distance of ordinary users prepared in advance by the manufacturer) (or basic information for calculating the separation distance) may be used instead of the actual eye distance. Various default eye distances (or basic information for calculating the separation distance) may also be stored according to the user's gender and / or age. By allowing the user to directly input his or her own gender and / or age, one of the various default eye distances (or basic information for calculating the separation distance) may be called. Alternatively, the user's gender and / or age may be inferred through the artificial intelligence model, and the default eye distance (or basic information for calculating the separation distance) corresponding to the inferred gender and / or age may be called from the various default eye distances (or basic information for calculating the separation distance). The actual eye distance (or basic information for calculating the separation distance) of the user may also be inferred based on the inferred gender and / or age through the artificial intelligence model. Even, the actual eye distance of the user may be received from the user through the signal input unit 355.

[0407] On the other hand, following the completion of the calibration execution process, the proposed user-optimal posture of the display unit 100 (ie, the user-optimal display unit posture or its setting) may be modified by the user. Fig. 27 Provide explanation. Fig. 27 A modification process for modifying the user's optimal posture of the proposed display unit according to an embodiment of the present invention is shown.

[0408] First, the control unit 350 may receive a user instruction for adjusting the user's optimal posture of the display unit from the user through the signal input unit 355. That is, the user instruction is used to further adjust at least one of the height, tilt angle, and distance of the display unit 100 so that the user's optimal posture of the display unit is suitable for the user's basic posture according to the user's own preference.

[0409] The control unit 350 may control at least one of the tilt driving unit 180 , the height adjusting unit 280 , and the distance adjusting unit 190 to adjust the user's optimal posture of the display unit according to the user instruction [ S271 ].

[0410] If the adjustment of the user's best posture of the display unit is completed, the control unit 350 may store the adjusted user's best posture as the user's preferred display unit posture (or user's preferred setting) [S272]. The control unit 350 may also store the height value, tilt angle value, and distance value of the display unit 100 based on the user's preferred display unit posture. Alternatively, the control unit may store the height value, tilt angle value, and distance value of the display unit 100 based on the proposed user's best posture, and may also store the height difference value, tilt angle difference value, and distance difference value corresponding to the difference between the proposed user's best posture and the user's preferred display unit posture as offset values.

[0411] If the proposed optimal posture for the user is not modified by the user, the control unit may also store the proposed optimal posture for the user as the user preference setting.

[0412] The above description describes obtaining user preference settings by performing calibration for a user. However, if the display device is used by a plurality of users, the calibration may need to be performed again each time the user using the display device changes. This may be troublesome for the user.

[0413] To solve this problem, each user may also register his / her own favorite posture in the display device, and by identifying who is the user currently using the display device, the favorite posture is called for the identified user. Fig.28 Provide explanation. Fig.28 The flowchart of invoking or registering preference settings according to a user in a display device according to an embodiment of the present invention is shown.

[0414] The control unit 350 may use the camera 105 to photograph a user who is using the display device [S281].

[0415] The control unit 350 may analyze the captured user image to identify the user in the image [S282]. To this end, the control unit 350 may use the artificial intelligence model stored in the artificial intelligence model storage unit 3505.

[0416] Next, the control unit 350 may determine whether the identified user is a pre-registered user [S283].

[0417] As a result of the determination, if the identified user is a pre-registered user, the control unit 350 may call up the stored user preference settings for the pre-registered user, and control the display device based on this action [S284].

[0418] However, as a result of the judgment, if the identified user is not a pre-registered user, the control unit 350 may display a user interface for confirming whether the user performs a registration procedure [S285].

[0419] If the user does not want to perform the registration procedure through the user interface, the control unit 350 may call a default setting and control the display device based on this action [S286].

[0420] The control unit 350 may store various default settings according to the gender and / or age of the user. Therefore, even if the identified user is not a pre-registered user, the control unit 350 may infer the gender and / or age through the artificial intelligence model and call the default settings corresponding to the inferred gender and / or age.

[0421] However, if the user wishes to perform the registration step through the user interface, the control unit 350 may perform the calibration execution process to newly register the user, and may store the user preference settings determined through the calibration execution process in correspondence with the user [S286]. At this time, the control unit 350 may also store the user's actual eye distance PD and / or the user's three-dimensional facial mesh corresponding to the user in correspondence with the user. At this time, the basic information for calculating the separation distance may also be stored instead of the user's actual eye distance PD.

[0422] In addition, the control unit 350 may control the display device to operate based on the user's preference setting for the user [S284].

[0423] The above describes identifying the user based on the artificial intelligence model and registering the user preference settings, but the present invention is not limited to this. The user can also directly register his own identification information (e.g., name) and perform the calibration execution process to store the user preference settings determined by the calibration execution process corresponding to the registered identification information. Therefore, instead of the steps S281 and S283, the user can input or select his own pre-registered identification information in the display device to determine whether the user is a pre-registered user in the step S283.

[0424] Previously, refer to Fig.14, which explains that the posture of the display unit 100 can be adjusted to suit the posture of the user based on the posture information of the user. However, there can be many modes (or methods) for adjusting the posture of the display unit 100 to suit the posture of the user. Below, the present invention newly proposes at least four adjustment modes. In addition, when adjusting the posture of the display unit 100 to suit the posture of the user, the aforementioned user preference settings can also be further considered. In this regard, further reference is made to Fig.29 Provide explanation. Fig.29 A sequence diagram for explaining posture adjustment of a display unit according to an embodiment of the present invention is shown.

[0425] First, the user may enter a menu mode (not shown) of the display device and select an adjustment mode that he or she desires [S2901]. In the present invention, the following four adjustment modes are proposed.

[0426] 1) The first adjustment mode: user posture following adjustment mode

[0427] 2) Second adjustment mode: User posture following and correction adjustment mode

[0428] 3) The third adjustment mode: continuous adjustment mode

[0429] 4) The fourth adjustment mode: random adjustment mode

[0430] The operation of the display device in each adjustment mode will be described again later.

[0431] Next, the control unit 350 may search for the user's location through the camera 105 [S2902]. That is, the control unit 350 may determine whether there is a user in front of the display device or the display unit 100. The process of searching for the user's location will be described again later.

[0432] If the search for the user's position fails, that is, if it is determined that there is no user in front of the display device, the control unit 350 may not adjust the posture of the display unit 100 based on the selected adjustment mode.

[0433] If the user's position is successfully searched, that is, it is determined that there is a user in front of the display device, the control unit 350 may determine whether the user whose position is searched is a pre-registered user [S2903]. Fig.28 described.

[0434] If the user is a pre-registered user, the control unit 350 may call the user preference setting pre-set for the user [S2904].

[0435] If the user is not a pre-registered user, the control unit 350 may call a default setting [S2905].

[0436] Regarding calling the user preference settings and calling the default settings, as previously referred to Fig.28 described.

[0437] Next, the control unit 350 can acquire the image of the user in real time through the camera 105 to detect the user's posture in real time [S2906]. The user's posture detection is as described above with reference to Figures 14 to 18 described.

[0438] Next, the control unit 350 may adjust the posture of the display unit 100 according to at least one of the setting (i.e., the user preference setting or the default setting), the selected adjustment mode, and the detected user posture [S2907]. The step S2907 will be described again later according to each adjustment mode.

[0439] During the adjustment of the posture of the display unit 100, the control unit 350 may detect whether the user has left the seat [S2908]. The process of detecting the user leaving the seat will be described later.

[0440] If it is not detected that the user has left the seat, the control unit 350 may continue to execute the steps S2906 and S2907.

[0441] However, if it is detected that the user has left the seat, the control unit 350 may control the display unit 100 to maintain the current posture, that is, the posture of the display unit 100 last adjusted before the user's departure is detected in step S2907 [S2909].

[0442] Next, the control unit 350 may determine whether the retention time of the seat leaving has exceeded a first predetermined time (eg, 5 minutes) [S2910].

[0443] If the holding time of the seat absence does not exceed the first predetermined time, the control unit 350 may execute the steps S2906 and S2907.

[0444] However, if the maintenance time of the absence exceeds the first specified time, the control unit 350 can adjust the posture of the display unit 100 to the setting (i.e., the user preference setting or the default setting), and can end the posture adjustment of the display unit 100 based on the selected adjustment mode [S2911].

[0445] Below, refer to Fig.30 , indicating that Fig.29 The process of searching the user's location mentioned in step S2902. Fig.30 A sequence diagram showing a display device searching for a user according to an embodiment of the present invention is shown.

[0446] The control unit 350 may determine whether the upper body (face and / or shoulder line) of the user is detected by the camera 105 in the current posture of the display unit at the time point when the position of the user is to be searched [S3001].

[0447] If the upper body of the user is detected, the control unit 350 may end the position search of the user.

[0448] If the upper body of the user is not detected in the step S3001, the control unit 350 may move the display unit 100 to a side closer to the current position (or height) based on the current posture, between the upper end position where the display unit 100 can rise the highest and the lower end position where the display unit 100 can rise the lowest [S3002]. Of course, if the current position corresponds to any one of the upper end position and the lower end position, the display unit 100 does not need to move.

[0449] If the display unit 100 is located at the upper end position as a result of executing the step S3002, the control unit 350 may adjust the posture of the display unit 100 so that the display unit 100 is tilted from the upper side to the lower side [S3003, S3004].

[0450] The control unit 350 may determine whether the upper body of the user is detected by the tilt of the display unit 100 [S3005].

[0451] If the upper body of the user is detected by the tilt of the display unit 100 , the control unit 350 may end the position search of the user.

[0452] However, if the upper body of the user is not detected, the control unit 350 may determine whether the upper body of the user is detected while moving the position of the display unit 100 from the upper end position to the lower end position [S3006, S3007, S3005].

[0453] If the upper body of the user is detected through the position movement of the display unit 100, the control unit 350 may end the position search of the user.

[0454] However, if the position of the display unit 100 moves to the lower end position but the upper body of the user is still not detected, the control unit 350 may determine that the user position search has failed.

[0455] On the other hand, if the display unit 100 is located at the lower end position as a result of executing the step S3002, the control unit 350 may adjust the posture of the display unit 100 so that the display unit 100 is tilted from the lower side to the upper side [S3003, S3008].

[0456] The control unit 350 may determine whether the upper body of the user is detected by the tilt of the display unit 100 [S3009].

[0457] If the upper body of the user is detected by the tilt of the display unit 100 , the control unit 350 may end the position search of the user.

[0458] However, if the upper body of the user is not detected, the control unit 350 may determine whether the upper body of the user is detected while moving the position of the display unit 100 from the lower end position to the upper end position [S3010, S3011, S3009].

[0459] If the upper body of the user is detected through the position movement of the display unit 100, the control unit 350 may end the position search of the user.

[0460] However, if the position of the display unit 100 moves to the upper end position but the upper body of the user is still not detected, the control unit 350 may determine that the user position search has failed.

[0461] Below, refer to Fig.31 , indicating that Fig.29 The process of detecting the user's absence mentioned in step S2908. Fig.31 A sequence diagram showing the process of detecting the user's absence from a seat by a display device according to an embodiment of the present invention.

[0462] During the adjustment of the posture of the display unit 100 , the control unit 350 may also determine in real time or periodically whether the upper body of the user is detected [ S311 ].

[0463] If the upper body of the user is detected, the control unit 350 may determine that the user has not left the seat [S312].

[0464] However, if the upper body of the user is not detected, the control unit 350 may continue to determine whether the upper body of the user is detected from the time point when the upper body of the user is not detected until a second specified time (for example, 30 seconds) has passed [S313].

[0465] If the upper body of the user is detected before the second predetermined time has passed, the control unit 350 may determine that the user has not left the seat [ S312 ].

[0466] However, if the upper body of the user is not detected before a second predetermined time (eg, 30 seconds) has passed, the control unit 350 may determine that the user has left the seat [S314].

[0467] The above describes adjusting the posture of the display unit according to the detected posture of the user. However, depending on the type or mode of the detected posture of the user, the manner of adjusting the posture of the display unit may also be different. For example, in a case where the user sits with his upper body upright at work, it may be preferable to adjust the posture of the display unit so that the height of the display unit rises and falls accordingly as the user's face rises and falls. However, in a case where the user sits with his upper body lying back while watching a movie, it may be preferable to adjust the posture of the display unit so that the height of the display unit falls and rises opposite to the situation at work when the user's face rises and falls.

[0468] Further reference is made to Fig.32 , describing the user's posture pattern. Fig.32 It is a diagram for explaining a user's posture pattern according to an embodiment of the present invention.

[0469] Assume that the user sits with his upper body straight, so that the user's face is separated from the display unit 100 of a fixed posture by a first distance (for example, 70 cm) [C3]. At this time, it is assumed that the user's eye height is the same as the center height of the display unit 100.

[0470] However, when the user gradually lies down with his upper body, the user's eye height gradually becomes lower than the central height of the display unit 100 , and the user's face may gradually move away from the display unit [ C1 , C2 ].

[0471] On the contrary, when the user gradually tilts his upper body forward, the eye height of the user gradually becomes lower than the central height of the display unit 100, and the face of the user may gradually approach the display unit [C4, C5].

[0472] The user usually takes the postures C3, C4, C5, etc. when concentrating on work or study, etc. Hereinafter, the user posture pattern that the user is likely to take when concentrating as described above is referred to as a "concentration mode".

[0473] On the other hand, the user generally takes the postures C1, C2, etc. when relaxing, such as watching a movie or taking a rest. The user posture pattern that the user is likely to take when generally relaxing as described above is referred to as a "relaxation mode."

[0474] Below, refer to Fig.33 , further describing the focus mode and the relaxation mode in detail. Fig.33 It is a diagram for explaining a user's posture pattern according to an embodiment of the present invention.

[0475] like Fig.33 As shown in (33-1), in the focus mode, on the display panel 1001, the sight point GP can usually be lower than the normal point OP.

[0476] On the contrary, Fig.33 As shown in (33-2), in the relaxation mode, on the display panel 1001, the sight point GP can generally be higher than the normal point OP.

[0477] Therefore, the control unit 350 may distinguish between the focus mode and the relaxation mode in consideration of the inclination of the user's upper body, the height of the user's head, and the positional relationship between the normal point OP and the gaze point GP.

[0478] Furthermore, the control unit 350 may infer the difference between the concentration mode and the relaxation mode from the user's posture using an artificial intelligence model that has learned the user's posture.

[0479] The control unit 350 may also distinguish between the focus mode and the relaxation mode using a user instruction for directly selecting one of the focus mode and the relaxation mode that may be received from the user through the signal input unit 355 .

[0480] On the other hand, Fig.33 As shown in (33-1) and (33-2), in the focus mode and the relaxation mode, the user's sight point is formed within the display panel 1001. Therefore, the focus mode and the relaxation mode can be understood as a "gaze mode".

[0481] However, if Fig.33As shown in (33-3), the user's gaze point may be formed outside the display panel 1001 regardless of which mode the user is in, the focus mode or the relaxation mode. This may indicate that the user is not looking at the display panel 1001. Hereinafter, such a user posture mode is referred to as a "non-looking mode".

[0482] Below, refer to Fig.34 , indicating that the posture of the display unit is adjusted by further considering the user posture pattern. This can also be understood as Fig.29 Detailed flow of step S2907. Fig.34 A sequence diagram for explaining posture adjustment of a display unit according to an embodiment of the present invention is shown.

[0483] As reference Fig.29 The control unit 350 can obtain the user's image in real time through the camera 105 to detect the user's posture in real time [S2906]. The user's posture detection is as described above with reference to Figures 14 to 18 described.

[0484] The control unit 350 may determine the user's gesture pattern based on the user's gesture detected in step S2906 [S342]. The user's gesture pattern is determined as described above with reference to Fig.32 and Fig.33 In the case where the user's gesture pattern is determined based on the user instruction, the step S342 may also be performed before the step S2906.

[0485] The control unit 350 may determine whether the detected user's posture has a sudden change [S343]. For example, when the user temporarily stands up from a seat to pick up something and then sits down, the user's posture may change suddenly. In such a case, it is not necessary to adjust the posture of the display unit 100 according to the user's posture. Therefore, if the amount of change in the user's posture per unit time is greater than a specified value, the control unit 350 may ignore the sudden posture change and execute the step S2906.

[0486] If the amount of change in the user's posture per unit time is less than a specified value, the control unit 350 may determine whether the user's posture pattern corresponds to the gaze mode or the non-gaze mode [S344]. Fig.33 described.

[0487] If the user's posture mode is the non-attention mode, the control unit 350 may control the display unit 100 to maintain the current posture, that is, the posture of the display unit 100 in the step S344 [ S345 ].

[0488] Next, the control unit 350 may determine whether the non-attention mode is maintained for a third predetermined time (eg, 5 minutes) [S346]. The third predetermined time may be the same as or different from the first predetermined time and the second predetermined time.

[0489] If the maintenance time of the non-attention mode does not exceed the third predetermined time, the control unit 350 may control the flow to proceed to step S2906.

[0490] If the maintenance time of the non-attention mode exceeds a third predetermined time, the control unit 350 may control the flow to proceed to step S2911.

[0491] On the other hand, if the user's posture pattern is the gaze mode, the control unit 350 may determine which of the concentration mode and the relaxation mode the user's posture pattern corresponds to [S347].

[0492] If the user's posture mode is the focus mode, the control unit 350 may adjust the posture of the display unit 100 differently according to the adjustment mode selected in the step S2901 [S348]. This will be described again later.

[0493] However, if the user's posture mode is the relaxation mode, the control unit 350 may adjust the display unit posture according to the relaxation mode [S349].

[0494] For example, in the relaxation mode, in response to the user's face lowering, the control unit 350 may adjust the posture of the display unit 100 so that the height of the display unit 100 increases and the display unit 100 tilts downward. This is to enable the user to comfortably look up at the display unit 100 in a backward tilted posture.

[0495] Further reference is made to Fig.35 and Fig.36 , indicating that when the adjustment mode selected in the step S2901 is the first adjustment mode, the posture of the display unit 100 is adjusted. This can also be understood as Fig.34 Detailed flow chart of step S348. Fig.35 A sequence diagram for explaining posture adjustment of a display unit according to an embodiment of the present invention is shown. Fig.36 Shown for illustration Fig.35 The posture of the display unit adjusts the relationship between the display unit posture and the user posture.

[0496] In the case where the adjustment mode selected in step S2901 is the first adjustment mode, the control unit 350 may adjust the posture of the display unit 100 to follow the detected user posture [S351]. That is, the control unit 350 may adjust the posture of the display unit 100 to follow the user's facial position based on the detected user posture in real time, so that the spatial relationship between the user's facial position based on the user's basic posture and the user's preferred display unit posture remains unchanged. Here, "real-time" following may mean following the user with a delay within a specified range when the user's posture changes by more than a specified range, rather than immediately following the user's posture when the posture changes slightly.

[0497] For example, Fig.36 As shown, it is assumed that the spatial relationship between the user's facial position based on the user's basic posture and the user's preferred display unit posture is to make the eye height of the user U located at the central height of the display unit 100. In this case, at the first time point t1, the eye height of the user U and the central height of the display unit can both be located at the second height h2.

[0498] However, as time passes from the first time point t1 to the second time point t2, the eye height of the user U may rise from the second height h2 to the third height h3. Therefore, the control unit 350 may adjust the posture of the display unit 100 so that the center height of the display unit 100 changes from the second height h2 to the third height h3.

[0499] As time passes from the second time point t2 to the second time point t3, the eye height of the user U may decrease from the third height h3 to the second height h2. Therefore, the control unit 350 may adjust the posture of the display unit 100 so that the center height of the display unit 100 changes from the third height h3 to the second height h2.

[0500] Next, the control unit 350 may determine whether the user is detected to be in a turtle neck posture for more than a fourth specified time [S352]. The fourth specified time may be the same as or different from any one of the first to third specified times. Whether the user is in a turtle neck posture may be determined from the three-dimensional body skeleton and / or the three-dimensional user face mesh. Alternatively, when the eye height of the user based on the detected user posture is lower than the eye height of the user based on the user basic posture by more than a specified value, it may be determined that the user is in a turtle neck posture.

[0501] If it is detected that the user is in the turtle neck posture for more than a fourth predetermined time, the control unit 350 may control to output a warning to warn the user that the user is in the turtle neck posture [S353]. The warning may be displayed in an OSD (On Screen Display) manner at a predetermined position of the display panel 1001, for example.

[0502] Further references Fig.36 As time passes from the third time point t3 to the fourth time point t4, the eye height of the user U may decrease from the second height h2 to the first height h1 and the user U maintains the turtle neck posture for a fourth predetermined time. Therefore, the control unit 350 may control to adjust the posture of the display unit 100 so that the center height of the display unit 100 changes from the second height h2 to the first height h1, and output the warning.

[0503] The control unit 350 may control the process to enter the step S2908 after the step S353.

[0504] If it is not detected that the user is in the turtle neck posture for more than the fourth specified time, the control unit 350 can control the process to directly enter the step S2908.

[0505] On the other hand, when adjusting the posture of the display unit 100 to follow the user's facial position based on the detected user posture in real time, the following degree may be different according to the separation distance between the user's face and the display unit 100. That is, the following degree may be inversely proportional to the separation distance. For example, when the separation distance is less than a prescribed distance, the control unit 350 may control so that the posture of the display unit 100 follows the user's facial position in real time with the following degree of 100%, and when the separation distance is greater than the prescribed distance, the control unit 350 may control so that the posture of the display unit 100 follows the user's facial position in real time with the following degree less than 100%. That is, if the user's face is close to the display unit 100, the display unit 100 may move up and down by an amount corresponding to the distance the user's face moves up and down, but if the user's face is far from the display unit 100, the display unit 100 may move up and down by an amount less than the distance the user's face moves up and down.

[0506] Further reference is made to Fig.37 and Fig.38 , indicating that when the adjustment mode selected in the step S2901 is the second adjustment mode, the posture of the display unit 100 is adjusted. This can also be understood as Fig.34 Detailed flow chart of step S348. Fig.37A sequence diagram for explaining posture adjustment of a display unit according to an embodiment of the present invention is shown. Fig.38 Shown for illustration Fig.37 The posture of the display unit adjusts the relationship between the display unit posture and the user posture.

[0507] In the case where the adjustment mode selected in step S2901 is the second adjustment mode, the control unit 350 may adjust the posture of the display unit 100 to follow the detected user posture [S371]. That is, the control unit 350 may adjust the posture of the display unit 100 to follow the user's facial position based on the detected user posture, so that the spatial relationship between the user's facial position based on the user's basic posture and the user's preferred display unit posture remains unchanged.

[0508] For example, Fig.38 As shown, it is assumed that the spatial relationship between the user's facial position based on the user's basic posture and the user's preferred display unit posture is to make the eye height of the user U located at the center height of the display unit. In this case, at the first time point t1, the eye height of the user U and the center height of the display unit can both be located at the second height h2.

[0509] However, as time passes from the first time point t1 to the second time point t2, the eye height of the user U may rise from the second height h2 to the third height h3. Therefore, the control unit 350 may adjust the posture of the display unit 100 so that the center height of the display unit 100 changes from the second height h2 to the third height h3.

[0510] As time passes from the second time point t2 to the second time point t3, the eye height of the user U may decrease from the third height h3 to the second height h2. Therefore, the control unit 350 may adjust the posture of the display unit 100 so that the center height of the display unit 100 changes from the third height h3 to the second height h2.

[0511] Next, the control unit 350 may determine whether the user is detected to be in a turtle neck posture for more than a fourth prescribed time [S372]. The fourth prescribed time may be the same as or different from any one of the first to third prescribed times. Whether the user is in a turtle neck posture may be determined from the three-dimensional body skeleton and / or the three-dimensional user face mesh. Alternatively, when the eye height of the user based on the detected user posture is lower than the eye height of the user based on the user basic posture by a prescribed value or more, it may be determined that the user is in a turtle neck posture.

[0512] If the user is detected to be in the turtle neck posture for more than a fourth predetermined time, the control unit 350 may stop adjusting the posture of the display unit 100 to follow the posture of the user. Also, the control unit 350 may adjust the posture of the display unit 100 to allow the user to correct the posture.

[0513] Further references Fig.38 As time flows from the third time point t3 to the fourth time point t4, the eye height of the user U may decrease from the second height h2 to the first height h1 and the user U maintains the turtle neck posture for the fourth prescribed time. Therefore, the control unit 350 will not adjust the posture of the display unit 100 to make the central height of the display unit 100 change from the second height h2 to the first height h1. Instead, the control unit 350 may be controlled so that the central height of the display unit 100 gradually rises to the highest height h4 at a prescribed speed until the user U escapes from the turtle neck posture. This is to guide the user U to raise his head as the display unit 100 rises and escape from the turtle neck posture. The prescribed speed may be a speed at which the user cannot easily recognize that the central height of the display unit 100 is rising. Alternatively, the prescribed speed may also be a speed at which the user can easily recognize that the central height of the display unit 100 is rising, so that the user can consciously correct his or her turtle neck posture. At this time, the control unit 350 may of course also output a warning to warn the user that he or she is in the turtle neck posture.

[0514] The control unit 350 may determine whether the user U has escaped from the turtle neck posture, that is, whether the user's posture has been corrected, while gradually raising the central height of the display unit 100 to the maximum height h4 [S374].

[0515] If the user's posture is corrected, the control unit 350 may readjust the posture of the display unit 100 to follow the detected user's posture [S375] This is the same as the aforementioned step S371.

[0516] However, if the central height of the display unit 100 rises to the maximum height h4, but the user's posture is still not corrected, the control unit 350 can control the posture of the display unit 100 to adjust the central height of the display unit 100 based on the user preference setting or the default setting, and then execute the S375 step [S376, S375].

[0517] Even when the center height of the display unit 100 rises to the highest height h4 but the user's posture is still not corrected, the control unit 350 may of course control the execution of step S375 instead of step S376.

[0518] The control unit 350 may control the process to enter the step S2908 after the step S375.

[0519] On the other hand, as described above, when adjusting the posture of the display unit 100 to follow the user's face position based on the detected user posture in real time, the following degree may be different according to the separation distance between the user's face and the display unit 100 .

[0520] Further reference is made to Fig.39 and Fig.40 , indicating that when the adjustment mode selected in the step S2901 is the third adjustment mode, the posture of the display unit 100 is adjusted. This can also be understood as Fig.34 Detailed process of step S348 and step S2908. Fig.39 A sequence diagram for explaining posture adjustment of a display unit according to an embodiment of the present invention is shown. Fig.40 Shown for illustration Fig.39 The posture of the display unit adjusts the relationship between the display unit posture and the user posture.

[0521] When the adjustment mode selected in the step S2901 is the third adjustment mode, the control unit 350 may generate a posture adjustment map for the display unit 100 based on the detected user's posture [S391].

[0522] Furthermore, the control unit 350 may adjust the posture of the display unit 100 based on the generated posture adjustment map [S392].

[0523] Reference Fig.40 , describing the posture adjustment of the display unit 100 based on the generated posture adjustment map.

[0524] It is assumed that the spatial relationship between the user's face position based on the user's basic posture and the user's preferred display unit posture is such that the eye height of the user U is located at the center height of the display unit 100 .

[0525] The control unit 350 may generate a posture adjustment map for the display unit 100 based on the posture of the user U detected at the time point when the posture adjustment map is to be generated [ S391 ].

[0526] When generating the posture adjustment map, the control unit 350 may set the initial center height of the display unit 100 to be suitable for the user's face height (more accurately, the user's eye height) based on the detected user posture, so that the spatial relationship between the user's face position based on the user's basic posture and the user's preferred display unit posture remains unchanged. For example, the control unit 350 may set the initial center height of the display unit 100 to the 1-1th height h1-1 to be the user's eye height based on the detected user posture.

[0527] Next, the control unit 350 may generate the posture adjustment diagram so that the central height of the display unit 100 has a height variation with an amplitude based on a sine wave curve trajectory within a first period T1 (e.g., 1 hour) with the initial central height h1-1 as the center [S391]. In the height variation based on the sine wave curve trajectory, the lowest central height of the display unit 100 may be the 1-2 height h1-2, and the highest central height of the display unit 100 may be the 1-3 height h1-3.

[0528] The height difference between the 1-1st height h1-1 and the 1-2nd height h1-2 and the height difference between the 1-1st height h1-1 and the 1-3rd height h1-3 may be the same as each other. However, the height difference between the 1-2nd height h1-2 and the 1-3rd height h1-3 may be a smaller value (e.g., 6 cm) so that it is not easy for the user U to recognize. That is, since the display unit 100 adjusts the height by 6 cm within the first period (e.g., 1 hour), the user U may not be able to easily recognize the posture adjustment of the display unit 100. However, since the user U may unconsciously move his own posture to follow the adjusted posture of the display unit 100, physical fatigue that may be caused by maintaining a fixed posture for a long time can be prevented in advance.

[0529] The control unit 350 may adjust the posture of the display unit 100 so that the central height of the display unit 100 continuously follows the sinusoidal curve trajectory of the posture adjustment diagram within a first period T1 from a first time point t1 [S392].

[0530] On the other hand, when adjusting the posture of the display unit 100 according to the posture adjustment diagram, the control unit 350 may detect whether the user leaves the seat [S393].

[0531] If it is detected that the user has left the seat, the control unit 350 may control the process to delete the posture adjustment diagram and enter the step S2909.

[0532] If it is not detected that the user has left the seat, the control unit 350 may determine whether the first period T1 has ended.

[0533] If the first cycle T1 has not ended, the control unit 350 may control the process to enter step S393.

[0534] However, if the first cycle T1 ends, the control unit 350 may cause the process to enter the step S391. The control unit 350 may update the posture adjustment map [S391].

[0535] That is, the control section 350 may update the posture adjustment map for the display unit 100 based on the posture of the user U detected at the time point when the posture adjustment map is to be updated.

[0536] When updating the posture adjustment map, the control unit 350 may set the initial center height of the display unit 100 to a 2-1th height h2-1 to be the eye height of the user based on the detected user posture.

[0537] Next, the control unit 350 may update the posture adjustment diagram, wherein the central height of the display unit 100 has a height variation with an amplitude based on a sine wave curve trajectory within a second period T2 (e.g., 1 hour) with the initial central height h2-1 as the center. The length of the second period may be the same as the first period. In the height variation based on the sine wave curve trajectory, the lowest central height of the display unit 100 may be the 2-2nd height h2-2, and the highest central height of the display unit 100 may be the 2-3rd height h2-3.

[0538] The height difference between the 2-1st height h2-1 and the 2-2nd height h2-2 may be the same as the height difference between the 1-1st height h1-1 and the 1-2nd height h1-2. In addition, the height difference between the 2-1st height h2-1 and the 2-3rd height h2-3 may be the same as the height difference between the 1-1st height h1-1 and the 1-3rd height h1-3.

[0539] The control unit 350 may adjust the posture of the display unit 100 so that the central height of the display unit 100 continuously follows the sinusoidal curve trajectory of the updated posture adjustment map within a second period from the second time point t2 [S392].

[0540] Of course, the length of the first period and the second period and / or the amplitude based on the trajectory of the sinusoidal wave curve can be adjusted by the user through the signal input unit 355 .

[0541] Alternatively, the length of the first cycle and the second cycle and / or the size of the amplitude based on the sine wave curve trajectory can of course also be automatically adjusted according to the basic user posture. For example, it can be automatically adjusted so that when the user's eye height is high in the basic user posture, the length of the first cycle and the second cycle and / or the size of the amplitude based on the sine wave curve trajectory increases, and when the user's eye height is low in the basic user posture, the length of the first cycle and the second cycle and / or the size of the amplitude based on the sine wave curve trajectory decreases.

[0542] Alternatively, during the process of adjusting the height of the display unit along the sine wave curve track, the change in the user's eye height may be too large or too small. It can be automatically adjusted so that, when the user's eye height changes too much, the amplitude based on the sine wave curve track increases, and when the user's eye height changes too little, the amplitude based on the sine wave curve track decreases. The automatic adjustment can be performed within a cycle or after a cycle ends.

[0543] It is described above that in the first cycle or the second cycle, the center height of the display unit follows a sinusoidal wave curve trajectory of one cycle, but the present invention is not limited thereto. In the first cycle or the second cycle, the center height of the display unit may of course also follow a sinusoidal wave curve trajectory that is longer or shorter than one cycle.

[0544] When describing the posture adjustment diagram above, the height adjustment of the display unit is mainly described. However, the posture adjustment diagram is not necessarily generated only for the height adjustment of the display unit. For example, the posture adjustment diagram may also be generated so that the display unit 100 is tilted downward at a predetermined angle at the highest point height of the display unit 100, and the display unit 100 is tilted upward at a predetermined angle at the lowest point height of the display unit 100.

[0545] On the other hand, the above description describes the posture adjustment map for generating the sine wave curve trajectory corresponding to the initial center height of the display unit 100 and the intermediate heights (i.e., average heights) h1-1, h2-1 between the lowest point center heights h1-2, h2-2 and the highest point center heights h1-3, h2-3. However, it is not necessary to generate the posture adjustment map in this way. For this, further reference is made to Figure 41 to Figure 44 Provide explanation. Figure 41 to Figure 44 Shows Fig.40 The deformation of the posture adjustment graph.

[0546] like Fig.41As shown, before the posture of the display unit 100 is adjusted based on the posture adjustment diagram, that is, before the first time point t1, the central height of the display unit 100 is located between the lowest point central height h1-2 and the highest point central height h1-3, but may be a 3-1th height h3-1 that is different from their middle height h1-1.

[0547] In this case, the control unit 350 can generate the posture adjustment diagram as a height change of the amplitude of a sine wave curve trajectory in which, within the first period T1, the initial central height of the display unit 100 is the 3-1st height h3-1, the lowest point central height of the display unit 100 is the 1-2nd height h1-2, and the highest point central height of the display unit 100 is the 1-3rd height h1-3.

[0548] like Fig.42 As shown, before the posture of the display unit 100 is adjusted based on the posture adjustment diagram, that is, before the first time point t1, the central height of the display unit 100 may be a 3-2th height h3-2 that is higher than the highest point central height h1-3.

[0549] In this case, the control unit 350 can generate the posture adjustment diagram as a height change of the amplitude of a sine wave curve trajectory having an initial central height and a highest point central height of the display unit 100 being a 1-3 height h1-3, and a lowest point central height of the display unit 100 being a 1-2 height h1-2 within the first period T1.

[0550] However, when adjusting the posture of the display unit 100 according to the posture adjustment diagram, the control unit 350 can be controlled so that the central height of the display unit 100 quickly changes from the 3-2 height h3-2 to the 1-3 height h1-3 at the first time point t1, and then the central height of the display unit 100 is adjusted according to the sinusoidal wave curve trajectory of the posture adjustment diagram.

[0551] On the other hand, Fig.43 As shown, before the posture of the display unit 100 is adjusted based on the posture adjustment diagram, that is, before the first time point t1, the central height of the display unit 100 may be a 3-3rd height h3-3 lower than the lowest point central height h1-2.

[0552] In this case, the control unit 350 can generate the posture adjustment diagram as a height change of the amplitude of a sine wave curve trajectory having an initial central height and a lowest point central height of the display unit 100 as a 1-2 height h1-2, and a highest point central height of the display unit 100 as a 1-3 height h1-3 within the first period T1.

[0553] However, when adjusting the posture of the display unit 100 according to the posture adjustment map, the control unit 350 can be controlled so that the central height of the display unit 100 quickly changes from the 3-3 height h3-3 to the 1-2 height h1-2 at the first time point t1, and then the central height of the display unit 100 is adjusted according to the sinusoidal wave curve trajectory of the posture adjustment map.

[0554] Further reference is made to Fig.44 and Fig.45 , indicating that when the adjustment mode selected in the step S2901 is the fourth adjustment mode, the posture of the display unit 100 is adjusted. This can also be understood as Fig.34 Detailed process of step S348 and step S2908. Fig.44 A sequence diagram for explaining posture adjustment of a display unit according to an embodiment of the present invention is shown. Fig.45 Shown for illustration Fig.44 The posture of the display unit adjusts the relationship between the display unit posture and the user posture.

[0555] When the adjustment mode selected in the step S2901 is the fourth adjustment mode, the control unit 350 may generate a posture adjustment map for the display unit 100 based on the detected user's posture [ S441 ].

[0556] Furthermore, the control unit 350 may adjust the posture of the display unit 100 based on the generated posture adjustment map [ S442 ].

[0557] Reference Fig.45 , describing the posture adjustment of the display unit 100 based on the generated posture adjustment map.

[0558] It is assumed that the spatial relationship between the user's face position based on the user's basic posture and the user's preferred display unit posture is such that the eye height of the user U is located at the center height of the display unit 100 .

[0559] The control unit 350 may generate a posture adjustment map for the display unit 100 based on the posture of the user U detected at the time point when the posture adjustment map is to be generated [ S441 ].

[0560] When generating the posture adjustment map, the control unit 350 may set the initial height of the display unit 100 to be suitable for the user's face height based on the detected user posture, so that the spatial relationship between the user's face position based on the user's basic posture and the user's preferred display unit posture remains unchanged. For example, the control unit 350 may set the initial center height of the display unit 100, that is, the 1-1th height h1-1, to be the user's eye height based on the detected user posture.

[0561] Then, when generating the posture adjustment diagram, the control unit 350 may set the lowest point center height of the display unit 100, i.e., the 1-2 height h1-2, which is lower than the 1-1 height h1-1 by a predetermined height, and may set the highest point center height of the display unit 100, i.e., the 1-3 height h1-3, which is higher than the 1-1 height h1-1 by the predetermined height. The predetermined height may be a small value (e.g., 3 cm) so that the user U cannot easily recognize it.

[0562] The control unit 350 can adjust the posture of the display unit 100 so that the central height of the display unit 100 is maintained at any height between the 1-2 height h1-2 as the central height of the lowest point and the 1-3 height h1-3 as the central height of the highest point, that is, the 4-1 height h4-1 within the first period T1 from the first time point t1 [S442].

[0563] On the other hand, when adjusting the posture of the display unit 100 according to the posture adjustment diagram, the control unit 350 may detect whether the user leaves the seat [S443].

[0564] If it is detected that the user has left the seat, the control unit 350 may control the process to delete the posture adjustment diagram and enter the step S2909.

[0565] If the user's leaving is not detected, the control unit 350 may determine whether the first period T1 is completed [S444].

[0566] If the first cycle T1 has not ended, the control unit 350 may control the process to enter the step S443.

[0567] However, if the first cycle T1 ends, the control unit 350 may cause the process to enter the step S442.

[0568] That is, the control unit 350 can adjust the posture of the display unit 100 so that the central height of the display unit 100 is maintained at another arbitrary height, i.e., the 4-2 height h4-2, between the 1-2 height h1-2 as the central height of the lowest point and the 1-3 height h1-3 as the central height of the highest point within the second period T2 from the second time point t2 [S442].

[0569] The present invention described above can be implemented by a computer-readable code in a medium having a program recorded thereon. Computer-readable media include all kinds of storage devices storing data that can be read by a computer system. Examples of computer-readable media include a hard disk drive (HDD), a solid state disk (SSD), a silicon disk drive (SDD), a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like. In addition, the computer may also include a processor of an artificial intelligence device.

Claims

1. A display device, wherein: include: A display unit having a display panel and a camera; A supporting device, supporting the display unit; a posture adjustment driving unit, provided on the supporting device, so as to be able to adjust the posture of the display unit; as well as The control unit controls the posture adjustment driving unit so that the posture of the display unit is adjusted within the up-and-down moving range of the display unit determined based on the first user posture in the first user image captured by the camera.

2. The display device according to claim 1, characterized in that The control section further determines the up-and-down movement range of the display unit based on a spatial relationship between a user basic posture and a user preference setting.

3. The display device according to claim 2, characterized in that: The control unit controls the posture adjustment drive unit to adjust the posture of the display unit so that the posture of the display unit has a height variation of a continuous sinusoidal wave curve trajectory within the vertical movement range.

4. The display device according to claim 3, characterized in that: The control unit controls the posture adjustment drive unit so that the posture of the display unit is adjusted within the up and down moving range within one cycle, and then updates the up and down moving range of the display unit based on the user preference setting and the second user posture in the second user image captured by the camera, and adjusts the posture of the display unit within the updated up and down moving range within the next cycle.

5. The display device according to claim 3, characterized in that: The control unit controls so that the initial height of the sinusoidal wave curve trajectory differs according to the height of the display unit at a time point when the up-and-down movement range is determined.

6. The display device according to claim 3, characterized in that: If the height of the display unit is within the up-and-down moving range, the control unit controls the height of the display unit to change along a sinusoidal wave curve trajectory at a first speed; If the height of the display unit is outside the up-and-down moving range, the control unit controls so that the height of the display unit moves to the boundary of the up-and-down moving range at a second speed faster than the first speed, and then changes along the sinusoidal wave curve trajectory at the first speed.

7. The display device according to claim 2, characterized in that: The control unit controls the posture adjustment drive unit so that the height of the display unit is maintained at a random height within the up-and-down movement range.

8. The display device according to claim 7, characterized in that: The control unit controls the posture adjustment drive unit so that the height of the display unit is maintained at the random height in one cycle, then updates the random height within the up and down movement range, and maintains the height of the display unit at the updated random height in the next cycle.

9. The display device according to claim 2, characterized in that: When leaving of the user is detected in the user image, the control unit controls the posture adjustment drive unit so as to maintain the posture of the display unit at a time when the leaving of the user is detected.

10. The display device according to claim 9, characterized in that: When the seat leaving is continuously detected within a predetermined time from the time when the seat leaving is detected, the control unit controls the posture adjustment drive unit to adjust the posture of the display unit according to the user preference setting.

11. The display device according to claim 2, characterized in that: If the presence of the user in front of the display unit is detected, the control unit controls to start posture adjustment of the display unit.

12. The display device according to claim 2, characterized in that: The control section controls to perform posture adjustment of the display unit in further consideration of a user posture pattern.

13. The display device according to claim 12, characterized in that: The user posture mode includes a gaze mode and a non-gaze mode; If the user posture mode is the gaze mode, the control unit controls the posture adjustment drive unit to adjust the posture of the display unit; If the user posture mode is the non-attention mode, the control section controls the posture adjustment drive section not to adjust the posture of the display unit.

14. The display device according to claim 13, characterized in that: The control unit acquires the body skeleton information of the user from the first user image; The control unit acquires a sight point where a sight line of the user intersects the display panel based on the body skeleton information.

15. The display device according to claim 14, characterized in that: The control unit distinguishes between the attention mode and the non-attention mode based on whether the sight point is located within the display panel.

16. The display device according to claim 1, characterized in that: The control unit determines the user posture according to a separation distance between the camera and the user calculated based on a feature point pixel distance between two feature points on the user's face in a first user image.

17. The display device according to claim 16, characterized in that: The control unit controls: Acquiring, by the camera at a first height of the display unit, a second user image in which the user taking the user basic posture is taken as a subject; Acquiring, by the camera, a third user image at a second height of the display unit, with the user maintaining the basic user posture as a subject; Calculate a reference pixel distance between two feature points on the face of the user from the second user image or the third user image; The separation distance between the camera and the user in the first user image is further calculated based on the reference separation distance and the reference pixel distance.

18. The display device according to claim 17, characterized in that: The control unit calculates an optimal display unit posture setting for a user based on a three-dimensional body mesh of the user generated using a second user image and a third user image.

19. The display device according to claim 18, characterized in that If the user modifies the user's optimal display unit posture setting, the control unit stores the modified posture setting as a user preference setting; If the user does not correct the user optimum display unit posture setting, the control section stores the user optimum display unit posture setting as the user preference setting.

20. A method for controlling a display device, wherein: include: Steps for capturing user images through a camera; as well as The step of adjusting the posture of the display unit within the up-and-down movement range of the display unit determined based on the user posture in the user image.

Images