Display device and control method thereof

Abstract

The present invention discloses a display device, which includes: a display; a driving unit; and a processor, which identifies an object contained in the image while the image is displayed on the display, determines whether the displayed image is a horizontal image or a vertical image based on the object, and controls the driving unit to rotate the display based on the configuration state of the display and the type of the displayed image.

Description

Technical Field

[0001] The present invention relates to a display device and a control method thereof, and more particularly to a display device with a rotatable display and a control method thereof. Background Art

[0002] Generally, a display device such as a television displays an image based on the resolution information of the image. For example, if the resolution of the image is 1920×1080, the display device will display a horizontal image whose horizontal length is greater than its vertical length.

[0003] However, the actual image may not be a landscape-type image, for example, when a user rotates an image shot at a resolution of 1080×1920 to a resolution of 1920×1080 for storage (or uploads to a server, etc.).

[0004] In this case, if Figure 1 As shown, the display device displays the vertical type image as a horizontal image.

[0005] This is a factor that hinders users from viewing images, and vertical images need to be displayed as vertical images with a length greater than the horizontal length. Similarly, horizontal images need to be displayed as horizontal images with a length greater than the vertical length. Summary of the invention

[0006] The present invention is proposed based on the above-mentioned necessity, and an object of the present invention is to provide a display device and a control method thereof, in which, when the resolution information of the image does not correspond to the type of the actual image, the display is rotated to correspond to the type of the actual image.

[0007] A display device of one embodiment of the present invention for achieving the above-mentioned purpose includes: a display; a driving unit; and a processor, which identifies an object contained in the image while the image is displayed on the display, determines based on the object whether the displayed image is a horizontal type image or a vertical type image, and controls the driving unit to rotate the display based on the configuration state of the display and the type of the displayed image.

[0008] Furthermore, the processor may determine the direction of the object displayed on the display, and if the horizontal length of the displayed image is greater than the vertical length based on the direction of the object, the displayed image is determined to be the horizontal type image; and if the vertical length of the displayed image is greater than the horizontal length based on the direction of the object, the displayed image is determined to be the vertical type image.

[0009] Here, the object may include at least one of text, things or people contained in the displayed image.

[0010] Furthermore, the processor may, when the directions of text and objects contained in the displayed image are different from each other, determine the type of the displayed image based on the direction of the text; and when the directions of objects and people contained in the displayed image are different from each other, determine the type of the displayed image based on the direction of the object.

[0011] Furthermore, when the display is configured in portrait orientation, if the processor determines that the landscape-type image is displayed on the display, the processor controls the drive unit to rotate the display in the landscape direction; and when the display is configured in landscape orientation, if the processor determines that the portrait-type image is displayed on the display, the processor controls the drive unit to rotate the display in the portrait direction.

[0012] Furthermore, the processor may display a user interface (UI) for rotating the display in a region of the display, and upon receiving a user instruction to select the user interface, control the driving unit to rotate the display.

[0013] Furthermore, the processor may determine whether the displayed image includes a blank area, and if the displayed image includes a blank area, crop the image of the remaining area except the blank area, and identify the object in the cropped image.

[0014] And it may be that if a user instruction for displaying the image is input, the processor displays the image on the display, and determines the type of the image displayed based on the object recognized during a set time period after the image is displayed on the display.

[0015] Furthermore, when the object recognized during the set time is displayed in a plurality of directions, the processor may determine the type of the image based on a direction displayed for a relatively longer period of time.

[0016] Furthermore, the processor may determine a direction in which the display is to be rotated at a minimum rotation angle, and control the drive unit to rotate the display in the determined direction.

[0017] On the other hand, a control method for a display device according to an embodiment of the present invention includes: a step of identifying an object contained in the image while the image is displayed on the display; a step of determining whether the displayed image is a horizontal type image or a vertical type image based on the object; and a step of rotating the display based on the configuration state of the display and the type of the displayed image.

[0018] And it can be that, in the step of judging, the direction of the object displayed on the display is judged, and based on the direction of the object, if the horizontal length of the displayed image is greater than the vertical length, the displayed image is judged as the horizontal type image, and based on the direction of the object, if the vertical length of the displayed image is greater than the horizontal length, the displayed image is judged as the vertical type image.

[0019] Here, the object may include at least one of text, things or people contained in the displayed image.

[0020] Furthermore, in the step of performing the judgment, when the directions of text and objects contained in the displayed image are different from each other, the type of the displayed image is judged based on the direction of the text; and when the directions of objects and persons contained in the displayed image are different from each other, the type of the displayed image is judged based on the direction of the object.

[0021] Furthermore, in the step of rotating, when the display is configured in portrait orientation, if it is determined that the landscape-type image is displayed on the display, the display is rotated in the landscape direction; and when the display is configured in landscape orientation, if it is determined that the portrait-type image is displayed on the display, the display is rotated in the portrait direction.

[0022] Furthermore, the control method further includes a step of displaying a user interface (UI) for rotating the display in an area of ​​the display, and during the step of rotating, if a user instruction to select the user interface is received, the display is rotated.

[0023] Furthermore, in the step of identifying the object, it is determined whether the displayed image contains a blank area. If the displayed image contains a blank area, the image of the remaining area excluding the blank area is cropped out, and the object is identified in the cropped image.

[0024] And it may be that, in the step of making a judgment, if a user instruction for displaying the image is input, the image is displayed on the display, and the type of the image displayed is judged based on the object recognized during a set time period after the image is displayed on the display.

[0025] Furthermore, in the step of making a judgment, when the object recognized during the set time is displayed in a plurality of directions, the type of the image may be judged based on the direction displayed for a relatively longer time.

[0026] Furthermore, in the step of rotating, a direction for rotating the display at a minimum rotation angle may be determined, and the display may be rotated in the determined direction.

[0027] According to various embodiments of the present invention as described above, a display device and a control method thereof can be provided for rotating a display to correspond to the type of an actual image when the resolution information of the image does not correspond to the type of the actual image, thereby allowing the user to view a natural image. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] Figure 1 This is a diagram for explaining an example in which a conventional display device displays a vertical-type image.

[0029] Figure 2 is a block diagram for illustrating a display device according to an embodiment of the present invention.

[0030] Figure 3a The diagram is used to explain an embodiment of the present invention in which a landscape-type image is displayed on a landscape-arranged display.

[0031] Figure 3b The diagram is used to explain an embodiment of the present invention in which a horizontal type image is displayed on a display arranged vertically.

[0032] Figure 4a This is a diagram for explaining an embodiment of the present invention in which a vertical type image is displayed on a display arranged vertically.

[0033] Figure 4b This is a diagram for explaining an embodiment of the present invention in which a vertical image is displayed on a horizontally arranged display.

[0034] Figure 5 This is a diagram for explaining an embodiment in which a display arranged vertically according to an embodiment of the present invention is rotated.

[0035] Figure 6 This is a diagram for explaining an embodiment in which a display arranged horizontally according to an embodiment of the present invention is rotated.

[0036] Figure 7a It is a diagram for explaining the determination of the image type according to an embodiment of the present invention.

[0037] Figure 7b It is a diagram for explaining the determination of the image type according to an embodiment of the present invention.

[0038] Figure 8 It is a diagram for explaining the determination of the image type according to an embodiment of the present invention.

[0039] Fig. 9 The figure is used to illustrate a user interface (UI) for rotation according to an embodiment of the present invention.

[0040] Fig.10a This is a diagram for explaining an embodiment of cropping a remaining area except for a blank area when a display arranged horizontally according to an embodiment of the present invention displays an image including a blank area.

[0041] Fig.10b This is a diagram for explaining an embodiment of rotating a display that displays an image including a blank area according to an embodiment of the present invention.

[0042] Fig.11a This is a diagram for explaining an embodiment of cropping a remaining area except for a blank area when a vertically arranged display displays an image including a blank area according to an embodiment of the present invention.

[0043] Fig.11b This is a diagram for explaining an embodiment of rotating a display that displays an image including a blank area according to an embodiment of the present invention.

[0044] Fig.12 It is a diagram for explaining an embodiment in which a display device according to an embodiment of the present invention displays a mirror image.

[0045] Fig.13 is a detailed block diagram for explaining a display device according to an embodiment of the present invention.

[0046] Fig.14 is a flowchart for illustrating a method for controlling a display device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0047] First, regarding the terms used in this specification and the scope of protection, common terms have been selected in consideration of the functions of the present invention. However, these terms may vary depending on the intentions of technicians in this field, legal or technical interpretations, and the emergence of new technologies. In addition, some terms are arbitrarily selected by the applicant. These terms may be interpreted according to the meanings defined in this specification. If there is no specific definition of the term, it may be interpreted based on the overall content of this specification and common technical knowledge in the field.

[0048] Furthermore, when describing the present invention, if it is deemed that the detailed description of related well-known functions or features may unnecessarily obscure the gist of the present invention, the detailed description will be shortened or omitted.

[0049] Furthermore, embodiments of the present invention will be described in detail below with reference to the drawings and the contents described in the drawings, but the present invention is not limited or restricted by these embodiments.

[0050] In addition, hereinafter, a display arranged vertically is referred to as a display in a portrait posture, a display in a vertical posture, or a display in a vertical mode, and a display arranged horizontally is referred to as a display in a landscape posture, a display in a horizontal posture, or a display in a horizontal mode.

[0051] Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

[0052] Figure 2 is a block diagram for illustrating a display device according to an embodiment of the present invention.

[0053] The display device 100 of an embodiment of the present invention may be a smart TV, but this is only an embodiment, and the display device 100 may also be any electronic device with a display, such as a personal computer, a notebook computer, a tablet computer, a digital camera, a camcorder, a PDA, a smart phone, etc.

[0054] Reference Figure 2 A display device 100 according to an embodiment of the present invention includes a display 110 , a driving unit 120 and a processor 130 .

[0055] The display 110 can display a variety of images. As an example, the display 110 can obviously display stored images, and can also display images received from external devices. Here, the external device can be a server, a personal computer, a notebook computer, a smart phone, etc., which can transmit images to the display device 100.

[0056] On the other hand, the image includes at least one of a static image or a dynamic image, and the display 110 can display various images such as broadcast content, multimedia content, etc. In addition, the display 110 can also display various user interfaces (UI) and icons.

[0057] The display 110 can rotate. Specifically, the display 110 can be configured into one of a horizontal state and a vertical state according to a control signal for rotation. To this end, the present invention may further include a driving unit 120 for rotating the display 110 .

[0058] Such a display 110 can be realized by various types of displays such as LCD (Liquid Crystal Display Panel), LED (light emitting diode), OLED (Organic Light Emitting Diodes), LCoS (Liquid Crystal on Silicon), DLP (Digital Light Processing), etc. In addition, the display 110 can also include a driving circuit, a backlight unit, etc. that can be realized in the form of a-siTFT (amorphous silicon TFT), LTPS (low temperature polysilicon) TFT, OTFT (organic TFT), etc.

[0059] Furthermore, the display 110 may be combined with a touch sensing unit to form a touch screen.

[0060] The driving unit 120 can rotate the display 110. Specifically, the driving unit 120 can rotate the display to one of a horizontal state and a vertical state according to a control signal for rotation. Here, it is obvious that the rotation direction can be either clockwise or counterclockwise. To this end, the driving unit 120 can include a motor.

[0061] The processor 130 controls the overall operation of the display device 100. To this end, the processor 130 may include one or more of a central processing unit (CPU), an application processor (AP), or a communication processor (CP).

[0062] The processor 130 drives an operating system or an application program to control components such as hardware or software connected to the processor 130, and can perform various data processing and calculations. In addition, the processor 130 loads instructions or data received from at least one of the other components into a volatile memory for processing, and stores various data in a non-volatile memory.

[0063] The processor 130 can control the display 110 to display an image. Here, the concept of an image includes at least one of a static image or a dynamic image, and it can obviously be a stored image or an image received from an external device.

[0064] For example, if a user instruction for displaying a stored photo image or a stored dynamic image is received, the processor 130 will control the display 110 to display the image. To this end, the present invention may further include a storage unit for storing images.

[0065] Furthermore, if a user instruction for playing a specific dynamic image through a dynamic image application is received, the processor 130 may send a signal to an external device (assuming a server) requesting the transmission of the dynamic image. Then, if a dynamic image is received from the external device, the processor 130 may control the display 110 to play the received dynamic image. To this end, the present invention further includes a communication unit for communicating with an external device.

[0066] While the image is displayed on the display 110 , the processor 130 may identify an object included in the image. Here, the object may be at least one of text, an object, or a person included in the image displayed on the display 110 .

[0067] Specifically, while the image is displayed on the display 110 , the processor 130 may recognize at least one of text (assuming that it is a word, letter, or number, etc.), an object, or a person included in the image through an image recognition algorithm.

[0068] Here, the image recognition algorithm may be at least one of a text recognition algorithm, an object recognition algorithm, or a face recognition algorithm. Specifically, the processor 130 may detect the outline of the object contained in the image through the text recognition algorithm, thereby recognizing the text contained in the image. In addition, the processor 130 may detect the outline of the object contained in the image through the object recognition algorithm, thereby recognizing the object contained in the image, and may detect at least one of the eyes, nose, or mouth contained in the image through the face recognition algorithm, thereby recognizing the person contained in the image.

[0069] On the other hand, the above algorithm is only one embodiment. The present invention can recognize text, objects or people contained in an image through various algorithms such as an algorithm that recognizes objects through color value analysis of the image or an algorithm that recognizes objects through pattern analysis of the objects contained in the image.

[0070] In addition, the processor 130 can also identify the objects contained in the image through an artificial intelligence module. Here, the artificial intelligence module can be a module based on machine learning (Machine Learning) or a deep neural network (DNN, Deep Neural Network). However, this is only an embodiment, and the artificial intelligence module can also be various modules such as a convolutional neural network (CNN, Convolution Neural Network), a recurrent neural network (Recurrent Neural Network), etc.

[0071] If the object is recognized, the processor 130 may determine whether the image displayed on the display 110 is a horizontal type image or a vertical type image based on the recognized object.

[0072] Specifically, the processor 130 determines the direction of the identified object. Based on the direction of the object, if the horizontal length of the image displayed on the display 110 is greater than the vertical length, the image displayed on the display 110 may be determined as a horizontal type image. Based on the direction of the object, if the vertical length of the image displayed on the display 110 is greater than the horizontal length, the image displayed on the display 110 may be determined as a vertical type image.

[0073] Below, refer to Figures 3a to 4b Provide explanation.

[0074] Figure 3a is a diagram for explaining an embodiment of a horizontal type image displayed on a horizontally arranged display according to an embodiment of the present invention, Figure 3b The diagram is used to explain an embodiment of the present invention in which a horizontal type image is displayed on a display arranged vertically.

[0075] As mentioned above, the processor 130 may utilize at least one of an image recognition algorithm or an artificial intelligence module to recognize an object contained in an image.

[0076] For example, Figure 3a When the image is displayed on the display 110 in a horizontal configuration, the processor 130 may use at least one of an image recognition algorithm or an artificial intelligence module to recognize at least one of the faces 311 to 313 of the people or the text 314 included in the image. Figure 3a , the text may be a broadcast logo, but is not limited thereto.

[0077] Likewise, if Figure 3b When the image is displayed on the display 110 arranged in a vertical orientation, the processor 130 may utilize at least one of an image recognition algorithm or an artificial intelligence module to recognize at least one of the faces 311 ˜ 313 of the characters or the text 314 included in the image.

[0078] Furthermore, the processor 130 may determine the direction of the identified object. Specifically, the processor 130 uses the imaginary y-axis as a reference, and if it is determined that the object is not rotated or rotated clockwise or counterclockwise according to a set first range of angles (assuming 1° to 20°), the direction of the object may be determined to be horizontal. Furthermore, the processor 130 uses the imaginary y-axis as a reference, and if it is determined that the object is rotated clockwise or counterclockwise according to a set second range of angles (assuming 70° to 110°), the direction of the object may be determined to be vertical.

[0079] For example, refer to Figure 3a , the processor 130 may determine that the text 314, which is an object that is not rotated based on the imaginary y-axis, is a horizontal object. In addition, the faces 311 to 313 of the people, which are objects that are not rotated based on the imaginary y-axis or rotated in the clockwise or counterclockwise direction according to the first range of angles 1° to 20° that have been set, are also determined as horizontal objects.

[0080] As another example, refer to Figure 3b , the processor 130 can determine the text 324, which is an object rotated counterclockwise at an angle of 90° within the set first range, as a vertical object based on the imaginary y-axis. In addition, the faces 321 to 323 of the person, which are objects rotated counterclockwise at an angle of 70° to 110° within the set second range based on the imaginary y-axis, are also determined as vertical objects.

[0081] Then, the processor 130 determines the type of the image displayed on the display 110 based on the direction of the object.

[0082] Specifically, if the object is oriented horizontally, the processor 130 determines the type of image displayed on the display 110 based on the horizontal direction; if the object is oriented vertically, the processor 130 determines the type of image displayed on the display 110 based on the vertical direction.

[0083] For example, if Figure 3a The object determined to be horizontal is displayed on the display 110, and the processor 130 uses the horizontal direction as a reference to determine the type of the image displayed on the display 110. In this case, the horizontal direction is used as a reference (in this case, the imaginary x-axis is regarded as the horizontal direction), and because the horizontal length of the image is greater than the vertical length of the image, the processor 130 can determine the type of the image displayed on the display 110 as a horizontal type.

[0084] And, if Figure 3b The object determined to be in a vertical orientation is displayed on the display 110, and the processor 130 determines the type of the image displayed on the display 110 based on the vertical orientation. In this case, based on the vertical orientation (i.e., the imaginary y-axis is regarded as the horizontal orientation), the processor 130 can determine the type of the image displayed on the display 110 as a horizontal type because the horizontal length of the image is greater than the vertical length of the image.

[0085] That is, the type of the image in the present invention is not determined based on the configuration state of the display 110 itself, but is determined based on the direction of the object. Referring to the above content, regardless of whether the configuration state of the display 110 is horizontal or vertical, if the same image is displayed, the type of the image is determined to be the same type.

[0086] Figure 4a FIG. 1 is a diagram for explaining an embodiment of a vertical image displayed on a vertically arranged display according to an embodiment of the present invention. Figure 4b This is a diagram for explaining an embodiment of the present invention in which a vertical image is displayed on a horizontally arranged display.

[0087] As mentioned above, the processor 130 may utilize at least one of an image recognition algorithm or an artificial intelligence module to recognize an object contained in an image.

[0088] For example, Figure 4a When the image is displayed on the display 110 in a vertical configuration, the processor 130 may use at least one of an image recognition algorithm or an artificial intelligence module to recognize at least one of a face 411 of a person, an object 412, or text 413 included in the image. Figure 4a , the object may be a microphone, and the text may be a subtitle, but is not limited thereto.

[0089] Likewise, if Figure 4b When the image is displayed on the display 110 in a horizontal configuration, the processor 130 may utilize at least one of an image recognition algorithm or an artificial intelligence module to recognize at least one of a face 421 of a person, an object 422 or text 423 included in the image.

[0090] Furthermore, the processor 130 may determine the direction of the identified object. As described above, the processor 130 uses the imaginary y-axis as a reference, and if it is determined that the object is not rotated or rotated clockwise or counterclockwise according to a set first range of angles (assuming 1° to 20°), the direction of the object may be determined to be horizontal. Furthermore, the processor 130 uses the imaginary y-axis as a reference, and if it is determined that the object is rotated clockwise or counterclockwise according to a set second range of angles (assuming 70° to 110°), the direction of the object may be determined to be vertical.

[0091] For example, refer to Figure 4a , the processor 130 may determine that the text 413, which is an object that is not rotated based on the imaginary y-axis, is a horizontal object. In addition, the face 411 of the person and the object 412, which are objects that are rotated clockwise or counterclockwise at an angle of 1° to 20° in the first range that has been set based on the imaginary y-axis, are also determined as horizontal objects.

[0092] As another example, refer to Figure 4b, the processor 130 can determine the text 423, which is an object rotated counterclockwise at an angle of 90° within the set first range, as a vertical object based on the imaginary y-axis. In addition, the face 421 of the person and the object 423, which are objects rotated counterclockwise at an angle of 70° to 110° within the set second range based on the imaginary y-axis, are also determined as vertical objects.

[0093] Then, the processor 130 may use the direction of the object as a reference to determine the type of the image displayed on the display 110 .

[0094] As described above, if the object is oriented horizontally, the processor 130 determines the type of image displayed on the display 110 based on the horizontal direction, and if the object is oriented vertically, the processor 130 determines the type of image displayed on the display 110 based on the vertical direction.

[0095] For example, if Figure 4a The object determined to be in a horizontal orientation is displayed on the display 110, and the processor 130 uses the horizontal orientation as a reference to determine the type of the image displayed on the display 110. In this case, using the horizontal orientation as a reference, the processor 130 can determine the type of the image displayed on the display 110 as a vertical type because the vertical length of the image is greater than the horizontal length of the image.

[0096] And, if Figure 4b The object determined to be in a vertical orientation is displayed on the display 110, and the processor 130 determines the type of the image displayed on the display 110 based on the vertical orientation. In this case, based on the vertical orientation, since the vertical length of the image is greater than the horizontal length of the image, the processor 130 can determine the type of the image displayed on the display 110 as a vertical type.

[0097] That is, the type of the image in the present invention is not determined based on the configuration state of the display 110 itself, but is determined based on the direction of the object. Referring to the above content, regardless of whether the configuration state of the display 110 is horizontal or vertical, if the same image is displayed, the type of the image is determined to be the same type.

[0098] Figure 5 and Figure 6 It is a diagram for explaining an example in which a display according to one embodiment of the present invention is rotated.

[0099] If the type of the image is determined, the processor 130 may control the driving unit 120 to rotate the display 110 based on the configuration state of the display 110 and the type of the image.

[0100] Specifically, if the configuration state of the display 110 and the type of the image correspond, the processor 130 does not rotate the display 110 , and if the configuration state of the display 110 and the type of the image do not correspond, the processor 130 rotates the display 110 .

[0101] That is, when the display 110 is in a portrait configuration, if the processor 130 determines that a landscape-type image is displayed on the display 110, the processor 130 controls the drive unit 120 to rotate the display 110 in a landscape direction. When the display 110 is in a landscape configuration, if the processor 130 determines that a portrait-type image is displayed on the display 110, the processor 130 controls the drive unit 120 to rotate the display 110 in a portrait direction.

[0102] For example, in the display 110 Figure 5 In the state of the portrait configuration, if a landscape-type image is displayed on the display 110 , the processor 130 controls the driving unit 120 to rotate the display 110 in the landscape direction.

[0103] Furthermore, on the display 110, Figure 6 In the horizontal configuration state, if a vertical image is displayed on the display 110 , the processor 130 controls the driving unit 120 to rotate the display 110 toward the vertical direction.

[0104] As a result, users can enjoy natural images.

[0105] On the other hand, the processor 130 may determine a direction for rotating the display 110 at a minimum rotation angle, and control the driving unit 120 to rotate the display 110 in the determined direction.

[0106] Specifically, if the processor 130 determines that the object is rotating counterclockwise, it controls the driving unit 120 to rotate the display 110 clockwise. If it determines that the object is rotating clockwise, it controls the driving unit 120 to rotate the display 110 counterclockwise.

[0107] For example, Figure 5 or Figure 6 As shown, when the object rotates counterclockwise, the processor 130 controls the driving unit 120 to rotate the display 110 90° clockwise. When the object rotates clockwise, the processor 130 controls the driving unit 120 to rotate the display 110 90° counterclockwise.

[0108] Therefore, the present invention can reduce the load on the motor.

[0109] Figure 7a , Figure 7b and Figure 8 It is a diagram for explaining the determination of the image type according to an embodiment of the present invention.

[0110] Depending on the situation, there are multiple objects included in the image, and the directions of the multiple images may be partially different. For example, when text, people, and objects are recognized in the image, the directions of the objects may be partially horizontal and partially vertical.

[0111] In this case, the processor 130 may determine the direction of the object according to the direction of the text. Alternatively, when the image does not contain text, the processor 130 may determine the direction of the object according to the direction of the object.

[0112] For example, in images such as Figure 7a In the case shown on the display 110 , the processor 130 may utilize at least one of an image recognition algorithm or an artificial intelligence module to recognize an object 710 and text 720 included in the image.

[0113] Furthermore, the processor 130 may determine the direction of the object. Figure 7a , the processor 130 can determine that the object 710 is an unrotated object or an object rotated counterclockwise according to a set first range of angles (assuming 1° to 20°) based on the shape of the object. That is, the processor 130 can determine that the direction of the object 710 is horizontal.

[0114] And, in Figure 7a In the example, the processor 130 can determine that the character 720 is an object rotated clockwise at 90° within the set second range of angles based on the shape of the character. That is, the processor 130 determines that the character 720 is vertical.

[0115] Thus, when the directions of the text and the object contained in the image displayed on the display 110 are different from each other, the processor 130 can use the direction of the text as a reference to determine the type of the image. That is, in the above embodiment, the processor 130 can use the direction of the text, i.e., the vertical direction, as a reference. Since the horizontal length of the image is greater than the vertical length of the image, the processor 130 can determine the type of the image displayed on the display 110 as a horizontal type.

[0116] Then, the processor 130 may control the driving unit 120 to rotate the display 110 in the horizontal direction.

[0117] As another example, in an image such as Figure 7b In the case shown on the display 110 , the processor 130 may utilize at least one of an image recognition algorithm or an artificial intelligence module to recognize an object 730 and a face 740 of a person included in the image.

[0118] Furthermore, the processor 130 may determine the direction of the object. Figure 7b, the processor 130 may determine that the object 730 is an object rotated counterclockwise at an angle of 90° within the set second range based on the shape of the object. That is, the processor 130 may determine that the direction of the object 730 is vertical.

[0119] And, in Figure 7b In the example, the processor 130 can determine that the face 740 of the person is an unrotated object or an object rotated clockwise according to a set first range of angles (assuming 1° to 20°) based on the shape of the face. That is, the processor 130 can determine that the direction of the face 740 of the person is horizontal.

[0120] Thus, when the directions of the objects and people included in the image displayed on the display 110 are different from each other, the processor 130 can use the direction of the object as a reference to determine the type of the image. That is, in the above embodiment, the processor 130 uses the longitudinal direction as a reference, and because the horizontal length of the image is greater than the vertical length of the image, the processor 130 can determine the type of the image displayed on the display 110 as a horizontal type.

[0121] Then, the processor 130 may control the driving unit 120 to rotate the display 110 toward the horizontal direction.

[0122] In this way, when the directions of multiple objects included in the image are different, the processor 130 can determine the type of the image according to the set priority. That is, the processor 130 can determine the type of the image by the text included in the image as the first priority, the object as the second priority, and the person as the third priority. Then, the present invention can rotate the display to match the type of the actual image. On the other hand, the above-mentioned priority is only an embodiment, and the priority can be set or changed in various ways.

[0123] On the other hand, depending on the situation, an image may contain multiple objects with the same priority, but these multiple objects may have different directions from each other. Figure 8 As shown in FIG. 1 , the first vertical object 810 and the second horizontal object 820 are included in the image. Here, the first object may be text such as a logo of a playback unit, which is fixedly displayed in a specific area of ​​the screen even if the frame of the image changes, and the second object 820 may be text included in a dynamic image, which may not be included in the screen when the frame of the image changes.

[0124] In this case, the processor 130 may determine the type of the image based on an object such as a playback unit mark that is fixedly displayed in a specific area of ​​the screen even if the image frame changes. Specifically, when multiple objects having the same priority in the image are included in different directions, multiple image frames may be analyzed to determine the type of the image based on the objects included in the multiple image frames.

[0125] exist Figure 8 In the case of, if the processor 130 determines that the first character 810 is a character included in multiple image frames from the first and second characters 810 and 820, the first character 810 may be determined as an object fixedly displayed in a specific area of ​​the screen. Figure 8 As shown, when the first character 810 is a character rotated 90 degrees in the counterclockwise direction, the processor 130 determines the direction of the first character 810 as the vertical direction, and determines the type of the image displayed on the display 110 as the horizontal type. Then, the processor 130 can control the driving unit 120 to rotate the display 110 in the horizontal direction.

[0126] Fig. 9 The figure is used to illustrate a user interface (UI) for rotation according to an embodiment of the present invention.

[0127] As described above, if the processor 130 determines that a horizontal-type image is displayed on the display 110 when the display 110 is configured vertically, it controls the drive unit 120 to rotate the display 110 horizontally. If it is determined that a vertical-type image is displayed on the display 110 when the display 110 is configured horizontally, it controls the drive unit 120 to rotate the display 110 vertically.

[0128] On the other hand, such an action can obviously be automatically executed when the configuration state of the display 110 and the image type do not correspond, and can also be executed based on receiving a user instruction of selecting a user interface (UI) for rotation.

[0129] For example, refer to Fig. 9 When the configuration state of the display 110 and the type of the image do not correspond, the processor 130 displays a user interface 910 for rotating the display 110 in an area of ​​the display 110, and if a user instruction to select the user interface 910 is received, the drive unit 120 can be controlled to rotate the display 110.

[0130] As described above, when the arrangement state of the display 110 and the type of the image do not correspond, by displaying the user interface for rotation, the user can rotate the display 110 by a simple operation of selecting the user interface.

[0131] Fig.10a and Fig.10b This is a diagram for explaining a method of recognizing an object and rotating the display when a display arranged in a horizontal position displays an image including a blank area according to an embodiment of the present invention.

[0132] Depending on the situation, the display 110 may display an image with blank areas on the left and right of the content. Fig.10a As shown in the left figure of , this is the case when the display 110 is configured in the horizontal direction and the content with a resolution of 1080×1920 is played.

[0133] The processor 130 may determine whether the image displayed on the display 110 includes a blank area.

[0134] Specifically, the processor 130 determines the black areas 1110-1 and 1110-2 from the image displayed by the display 110, and determines the area corresponding to the black area as a blank area. Here, the black areas 1110-1 and 1110-2 can be determined by analyzing the color value of the image displayed by the display 110. However, this is only an embodiment, and the processor 130 can also determine the black areas 1110-1 and 1110-2 included in the image displayed by the display 110 through an edge detection algorithm.

[0135] Next, the processor 130 may crop the remaining area except the blank area from the image displayed on the display 110 , and recognize the object from the cropped image 1020 .

[0136] Thus, by identifying the object in the cropped image that is not the entire image, the present invention can reduce the computational load of the processor 130 .

[0137] Next, if the processor 130 determines that Fig.10a The cropped image shown contains an object that is rotated counterclockwise, and the orientation of the object can be judged to be portrait.

[0138] Then, the processor 130 determines the type of the entire image including the blank area based on the direction of the object. In this embodiment, taking the vertical direction as a reference, the vertical length of the entire image including the blank area is greater than the horizontal length, so it can be determined as a vertical type image.

[0139] Then, if Fig.10b As shown, the processor 130 controls the driving unit 120 to rotate the display 110 90° in the clockwise direction.

[0140] Fig.11a and Fig.11bThis is a diagram for explaining a method of recognizing an object and rotating the display when a display arranged vertically displays an image including a blank area according to an embodiment of the present invention.

[0141] Depending on the situation, the display 110 may display an image with blank areas above and below the content. Fig.11a As shown in the left figure of , this is the case when the display 110 is configured vertically and the content with a resolution of 1920×1080 is played.

[0142] The processor 130 may determine whether the image displayed on the display 110 includes a blank area.

[0143] Specifically, the processor 130 determines the black areas 1110-1 and 1110-2 from the image displayed by the display 110, and determines the area corresponding to the black area as a blank area. Here, the black areas 1110-1 and 1110-2 can be determined by analyzing the color value of the image displayed by the display 110. However, this is only an embodiment, and the processor 130 can also determine the black areas 1110-1 and 1110-2 included in the image displayed by the display 110 through an edge detection algorithm.

[0144] Next, the processor 130 may crop the remaining area except the blank area from the image displayed on the display 110 , and recognize the object from the cropped image 1120 .

[0145] Thus, by identifying the object in the cropped image that is not the entire image, the present invention can reduce the computational load of the processor 130 .

[0146] Next, if the processor 130 determines that Fig.11a The cropped image shown contains an object that is rotated in a clockwise direction, and the orientation of the object can be judged to be portrait.

[0147] Then, the processor 130 determines the type of the entire image including the blank area based on the direction of the object. In this embodiment, taking the longitudinal direction as a reference, the horizontal length of the entire image including the blank area is greater than the vertical length, so it can be determined as a horizontal type image.

[0148] Then, with Fig.10b Similarly, the processor 130 controls the driving unit 120 to rotate the display 110 90° in the counterclockwise direction.

[0149] Fig.12 It is a diagram for explaining an embodiment in which a display device according to an embodiment of the present invention displays a mirror image.

[0150] The processor 130 may display the image being displayed on the external device 200 as a mirror image. To this end, the processor 130 communicates with the external device 200 and receives the image for preparing the mirror image from the external device 200. Here, the external device 200 may be a smart phone, a personal computer, a notebook computer, etc., but is not limited thereto. The external device 200 may be various electronic devices that can transmit the image being displayed on the external device 200 to the display device 100.

[0151] In particular, when the image received from the external device 200 includes a dynamic image and a static image, the processor 130 may display the dynamic image on the display 110. Specifically, if an image for mirroring is received from the external device 200, the processor 130 analyzes a plurality of frames included in the image and may determine an area whose content changes with changes in the image frames and an area whose content does not change. Then, the processor 130 determines an area whose content changes with changes in the image frames as an area containing a dynamic image, and determines an area whose content does not change with changes in the image frames as an area containing a static image. As an example, referring to Fig.12 The processor 130 may determine the first area 10 whose content does not change with the change of the image frame as an area containing a static image, and may determine the second area 20 whose content changes with the change of the image frame as an area containing a dynamic image.

[0152] Next, as described above, the processor 130 may determine the direction of the object contained in the dynamic image. Fig.12 In the case of the image being displayed horizontally, the processor 130 can determine that the object contained in the image is a horizontal object based on the face direction of the person. Next, the processor 130 uses the horizontal direction as a reference, and because the horizontal length of the image of the second area 20 is greater than the vertical length, the image of the second area 20 is determined to be a horizontal type image. Thereafter, the processor 130 controls the drive unit 120 to rotate the display 110 in the horizontal direction, and displays the image of the second area 20 displayed on the external device 200 on the display 110 when the display 110 is in the horizontal direction.

[0153] Fig.13 is a detailed block diagram for explaining a display device according to an embodiment of the present invention.

[0154] Reference Fig.13 According to an embodiment of the present invention, the display device 100 may include a display 110, a driving unit 120, a storage unit 140, a communication unit 150, a microphone 160, a speaker 170, an input unit 180, a signal processing unit 190, and a processor 130. Hereinafter, parts that overlap with the detailed description will be omitted or briefly described.

[0155] The storage unit 140 may store an operating system (OS) for controlling overall operations of components of the display device 100 and instructions or data related to the components of the display device 100 .

[0156] Thus, the processor 130 can control many hardware or software components of the display device 100 using various instructions or data stored in the storage unit 140, can load instructions or data received from at least one of the other components into a volatile memory for processing, and can store various data in a non-volatile memory.

[0157] In particular, the storage unit 140 may store information related to an image recognition algorithm or an artificial intelligence module that can recognize an object contained in an image.

[0158] The communication unit 150 can communicate with external devices to send and receive various data. For example, the communication unit 150 can obviously communicate with the electronic device through a local area network (LAN), the Internet, a mobile communication network, and can also communicate with the electronic device through various communication methods such as Bluetooth (BT), Bluetooth Low Energy (BLE), WI-FI (Wireless Fidelity), Zigbee, and near field communication (NFC).

[0159] To this end, the communication unit 150 may include various communication modules for network communication, such as a Bluetooth chip, a WI-FI chip, a wireless communication chip, and the like.

[0160] In particular, the communication unit 150 can communicate with an external device and receive images from the external device. Here, the external device may be a server, a smart phone, a personal computer, a notebook computer, etc., but is not limited thereto.

[0161] On the other hand, the communication unit 150 can communicate with an external device and receive broadcast content (or broadcast signals). Here, the broadcast signal may include at least one of images, audio, or additional data (such as EPG). To this end, the communication unit 150 may include a tuner (not shown), a demodulator (not shown), an equalizer (not shown), etc.

[0162] The microphone 160 may receive a user's voice. Here, the user's voice may be a voice for executing a specific function of the display device 100. If the user's voice is received through the microphone 160, the processor 130 may analyze the user's voice through a speech to text (STT) algorithm and execute a function corresponding to the user's voice.

[0163] For example, if a user's voice for rotating the display 110 is received through the microphone 160 , the processor 130 may control the driving unit 120 to rotate the display 110 .

[0164] The speaker 170 may output various audios. For example, when the display 110 is rotated, the speaker 170 may output audios.

[0165] The input unit 180 may receive various user instructions. The processor 130 may execute a function corresponding to the user instruction input through the input unit 180.

[0166] For example, the input unit 180 may receive a user instruction for rotating the display 110. Also, the input unit 180 may receive a user instruction for starting, tuning, adjusting volume, etc., and the processor 130 may start, tune, adjust volume, etc. of the display device 100 according to the input user instruction.

[0167] To this end, the input unit 180 may be implemented by an input panel, which may be implemented by a touch pad, a keyboard having various function keys, numeric keys, special keys, letter keys, etc., or a touch screen.

[0168] The signal processing unit 190 performs signal processing on the content received through the communication unit 150. Specifically, the signal processing unit 190 performs operations such as decoding, scaling, and frame rate conversion on the image constituting the content, and can process the image signal into a form that can be output from the display device 100. In addition, the signal processing unit 190 can perform signal processing such as decoding on the audio constituting the content, and can process the audio signal into a form that can be output from the speaker 170.

[0169] Thus, the display 110 can display the image output from the signal processing unit 190 , and the speaker 170 can output the audio output from the signal processing unit 190 .

[0170] The processor 130 controls the overall operation of the display device 100 .

[0171] In particular, if a user instruction for displaying an image is input, the processor 130 may control the display 110 to display the image. Next, the processor 130 may determine the type of the image based on an object included in the image.

[0172] In this case, processor 130 may determine the type of the image displayed on display 110 based on the object recognized during the set time after the image is displayed on display 110. Assume that the set time may be 15 seconds, but this may be variously set or changed according to user instructions.

[0173] This is because continuing to perform object recognition and image type determination from the image until the end of the image may cause an overload on the processor 130 .

[0174] On the other hand, the object recognized during the set time period may be displayed facing multiple directions.

[0175] For example, when playing music, the objects included in the image also rotate due to the rotation of the actual camera angle.

[0176] In this way, when the identified object is displayed in multiple directions during a set time period, the processor 130 can use the direction displayed for a relatively longer time as a reference to determine the type of the image.

[0177] That is, taking the set time of 15 seconds as an example, if it is determined that the object is oriented horizontally for about 10 seconds and vertically for the remaining 5 seconds, the processor 130 determines that the object is a horizontal object.

[0178] Therefore, even if the camera angle is rotated or the image is temporarily rotated, the present invention can accurately determine the direction of the object.

[0179] On the other hand, when the processor 130 determines that the object is rotated clockwise or counterclockwise at an angle within a set third range (assuming 160° to 180°), it can also determine that the object is in the horizontal direction.

[0180] For example, Figure 3a , Figure 3b or Figure 5 This is the case when the image shown is upside down. In this case, the processor 130 can control the driving unit 120 to rotate the display 110 by 180°.

[0181] As a result, users can enjoy natural images.

[0182] Fig.14 is a flowchart for illustrating a method for controlling a display device according to an embodiment of the present invention.

[0183] While the image is displayed on the display, the display device may identify an object contained in the image (S1410). Specifically, the display device uses an image recognition algorithm or an artificial intelligence module to identify the object contained in the image.

[0184] Next, the display device can determine whether the image is a horizontal type image or a vertical type image based on the identified object. Specifically, when the direction of the object is horizontal, the display device uses the horizontal direction as a reference, and if the horizontal length of the image is greater than the vertical length, the image is determined to be a horizontal type, and if the vertical length of the image is greater than the horizontal length, the image is determined to be a vertical type. In addition, when the direction of the object is vertical, the display device uses the vertical direction as a reference, and if the horizontal length of the image is greater than the vertical length, the image is determined to be a horizontal type, and if the vertical length of the image is greater than the horizontal length, the image is determined to be a vertical type.

[0185] The display device may rotate the display based on the configuration state of the display and the type of the image (S1430). Specifically, if the configuration state of the display and the type of the image do not correspond, the display device may rotate the display.

[0186] On the other hand, the methods according to the various embodiments of the present invention described above may be implemented by software or applications installed on an existing display device.

[0187] In addition, the methods according to the various embodiments of the present invention can be implemented by simply updating the software or hardware of the existing display device.

[0188] In addition, the various embodiments of the present invention described above may also be executed by an embedded server disposed in the display device or an external server of the display device.

[0189] Furthermore, a non-transitory computer readable medium storing a program capable of sequentially executing the control method of the display device of the present invention may be provided.

[0190] Non-volatile readable media are not media that store data in a short moment like registers, caches, and memories, but are media that store data semi-permanently and can be read by a device. Specifically, the above-mentioned various applications or programs can be stored in non-volatile readable media such as CDs, DVDs, hard disks, Blu-ray discs, USBs, memory cards, and ROMs.

[0191] In addition, the above diagrams and descriptions show preferred embodiments of the present invention, but the present invention is not limited to the above-mentioned specific embodiments. Without departing from the main points of the present invention as required by the scope of protection, it is obvious that a person skilled in the art in the technical field to which the present invention belongs can implement various modifications, and such modifications should not be understood as being independent of the technical concept or expectation of the present invention.

[0192] Explanation of symbols

[0193] 100: Display device

[0194] 110: Display

[0195] 120: Drive unit

[0196] 130: Processor

Claims

1. A display device, comprising: monitor; a drive unit configured to rotate the display between a horizontal arrangement state in which the horizontal length of the display is greater than the vertical length of the display and a vertical arrangement state in which the vertical length of the display is greater than the horizontal length of the display; as well as The processor is configured as: Recognize an object included in the image as at least one of text, an object, or a person, and recognize a direction of the object included in the image based on the recognition of the object, Based on the orientation of the object, if the horizontal length of the image is greater than the vertical length of the image, the image type is identified as horizontal type. Based on the orientation of the object, if the vertical length of the image is greater than the horizontal length, the image type is identified as the vertical type. Based on the arrangement state of the display and the type of the recognized image, the driving unit is controlled to rotate the display, wherein, based on the display being arranged in a vertical arrangement state and based on the image being recognized as a horizontal type of image, the control driving unit rotates the display to a horizontal arrangement state, and, based on the display being arranged in a horizontal arrangement state and based on the image being recognized as a vertical type of image, the control driving unit rotates the display to a vertical arrangement state; Wherein, based on the image including a plurality of different objects, the processor is configured to identify the type of the image according to a predetermined priority of the objects based on the text having a first priority, the object having a second priority, and the person having a third priority; and When the image includes multiple objects having the same priority but different directions, the processor is configured to analyze the multiple image frames and identify the type of the image based on the objects having the priority consistently displayed in a specific area of ​​the screen according to the multiple image frames.

2. The display device according to claim 1, wherein: The processor: When the display is arranged in a vertical direction, based on determining that a landscape-type image is displayed on the display, controlling the driving unit to rotate the display toward a landscape direction; When the display is arranged in the horizontal direction, based on determining that a vertical type image is displayed on the display, the driving unit is controlled to rotate the display toward the vertical direction.

3. The display device according to claim 1, wherein: The processor displays a user interface for rotating the display in a region of the display, and controls the driving part to rotate the display if a user instruction for selecting the user interface is received.

4. The display device according to claim 1, wherein: The processor: Determining whether the displayed image contains a blank area; and If the displayed image includes a blank area, the image is cropped to exclude the blank area, and an object is identified in the cropped image.

5. The display device according to claim 1, wherein: The processor: If a user instruction for displaying the image is input, controlling the image to be displayed on the display; and Based on the object being recognized during a predetermined time after the image is displayed on the display, a type of the image being displayed is determined.

6. The display device according to claim 5, wherein: In a case where the object recognized during the predetermined time is displayed in a plurality of directions, the processor determines the type of the image based on a direction displayed during a relatively longer time.

7. The display device according to claim 1, wherein: The processor determines a direction for rotating the display at a minimum rotation angle, and controls the drive unit to rotate the display in the determined direction.

8. A method for controlling a display device, the display device comprising: monitor; a drive unit configured to rotate the display between a horizontal arrangement state in which the horizontal length of the display is greater than the vertical length of the display and a vertical arrangement state in which the vertical length of the display is greater than the horizontal length of the display; The control method comprises: Recognize an object included in the image as at least one of text, an object, or a person, and recognize a direction of the object included in the image based on the recognition of the object, Based on the orientation of the object, if the horizontal length of the image is greater than the vertical length of the image, the image type is identified as horizontal type. Based on the orientation of the object, if the image is longer than it is tall, the image type is identified as portrait, and Based on the arrangement state of the display and the type of the recognized image, the control driving unit rotates the display between a horizontal arrangement state and a vertical arrangement state, in which the horizontal length of the display is greater than the vertical length of the display, and in which the vertical length of the display is greater than the horizontal length of the display, wherein based on the display being arranged in the vertical arrangement state and based on recognizing the image as a horizontal type image, the control driving unit rotates the display to the horizontal arrangement state, and, based on the display being arranged in the horizontal arrangement state and based on recognizing the image as a vertical type image, the control driving unit rotates the display to the vertical arrangement state; Among them, the types of recognized images also include: Based on the image including a plurality of different objects, based on text having a first priority, objects having a second priority, and people having a third priority, identifying the type of the image according to a predetermined priority of the objects; and When an image includes a plurality of objects having the same priority but different directions, the plurality of image frames are analyzed, and the type of the image is identified based on the objects having the priority that are consistently displayed in a specific area of ​​the screen according to the plurality of image frames.

9. The control method of the display device according to claim 8, wherein: The types of images that can be identified include: determining a direction of the object displayed on the display; Taking the direction of the object as a reference, if the horizontal length of the displayed image is greater than the vertical length of the displayed image, the displayed image is determined to be the horizontal type image; and Based on the direction of the object, if the vertical length of the displayed image is greater than the horizontal length of the displayed image, the displayed image is determined to be the vertical type image.

10. The control method of the display device according to claim 8, wherein: The control drive unit includes: When the display is arranged in a vertical direction, based on determining that the landscape-type image is displayed on the display, rotating the display toward a landscape direction, and When the display is arranged in a horizontal direction, based on determining that the vertical type image is displayed on the display, the display is rotated toward the vertical direction.

Images