Display Device and Method for Display
By introducing processors and drivers into flexible display devices and adjusting screen sizes according to content and events, the problem that flexible display devices in the prior art cannot be adaptively adjusted, and the use efficiency of display devices and user interaction experience are improved.
Patent Information
- Application Number
- CN202110040260.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2015-04-16
- Filing Date
- 2016-04-04
- Publication Date
- 2025-07-11
- Estimated Expiration
- 2036-04-04
AI Technical Summary
Existing flexible display devices are only used for moving or rolling up when changing the screen size, fail to effectively adapt to user interaction needs in home large-sized devices, and fail to adaptively adjust the screen size according to the content.
A display device is provided, including a flexible display, a driver and a processor, which determines the screen ratio of the content through the processor, controls the driver to change the screen size of the flexible display, adjusts the display size of the UI elements and content in response to a specific event, and supports the reception of screen size information of the external device.
The flexible display adaptively adjusts the screen size according to the content, prevents image distortion, and improves the use efficiency of the display device and user interaction experience.
Smart Images

Figure CN112748821B_ABST
Abstract
Description
[0001] This application is a divisional application of a patent application for an invention titled "Display Device and Method for Display", with an application date of April 4, 2016, and an application number of "201680017168.0". Technical Field
[0002] The present disclosure relates to a display device and method for display. More specifically, the present disclosure relates to a display device capable of adaptively adjusting the screen size of a flexible display according to the size of content. Background Art
[0003] With the development of the information society, the demand for display devices has increased, and in recent years, various display devices such as liquid crystal display (LCD) devices, plasma display panels (PDPs), electroluminescent displays (ELDs), and vacuum fluorescent displays (VFDs) have been studied and used.
[0004] Among display devices, flexible display devices that will not be damaged even when the device is folded or rolled up are expected to become emerging technologies in the display field.
[0005] Currently, there are various obstacles in implementing flexible display devices; however, with the development of technology, thin-film LCD devices, organic light-emitting diode (OLED) devices, electrophoretic displays, etc. have become the main body of development.
[0006] Therefore, a flexible display can change the size of the screen displayed to the user by folding or rolling up the display, but in the related art, the change in the screen size is only used for moving the display device. That is, when using a flexible display device, the flexible display device is unfolded, and when not using the flexible display device, the flexible display device is rolled up and stored.
[0007] In addition, in the related art, only the user interaction in a flexible display device with a portable size that can be carried by a user is considered, and the interaction in a large-sized flexible display device equipped in a home is not considered.
[0008] The above information is presented only as background information to assist in the understanding of the present disclosure. It is not determined nor asserted whether any of the above applies to the prior art with respect to the present disclosure. Summary of the Invention
[0009] Technical Problem
[0010] Aspects of the present disclosure at least solve the above problems and / or disadvantages, and at least provide the following advantages. Accordingly, one aspect of the present disclosure is to provide a display device capable of adaptively adjusting the screen size of a flexible display according to the content size and a method for display.
[0011] Technical solution
[0012] According to one aspect of the present disclosure, a display device is provided. The display device includes: a flexible display for displaying an image, a driver for changing the screen size of the flexible display, and a processor for controlling the driver to display an image corresponding to the content according to a screen size corresponding to the size of the content to be displayed on the flexible display.
[0013] In this case, the processor may determine the screen ratio of the content and control the driver so that the flexible display has a screen size corresponding to the determined screen ratio.
[0014] The flexible display has a flat display area that can be rolled up toward one side, and the driver may change the screen size of the flexible display by rolling up a part of the display area.
[0015] In this case, the driver may change the width of the flexible display by rolling up the display area in the horizontal direction of the display device.
[0016] Meanwhile, the processor may control the driver and the flexible display in response to the occurrence of a specific event so that a user interface (UI) element corresponding to the specific event is displayed according to a screen size corresponding to the UI element.
[0017] In this case, the specific event is a command for driving a smart TV (TV) function, and the processor may control the channel list to be displayed according to a preset first screen size, and in response to the selection of any one of the displayed channel lists, control the content corresponding to the selected channel to be displayed according to a second screen size larger than the first screen size.
[0018] Meanwhile, the specific event is the reception of a notification message related to an event or state change occurring in a device connected to the device within a home network, and the processor may control the notification message to be displayed according to a preset first screen size, and in response to the selection of the notification message, control the device information corresponding to the notification message to be displayed according to a second screen size larger than the first screen size.
[0019] Meanwhile, the processor may change the size of the image corresponding to the content and display the image when changing the screen size of the flexible display.
[0020] Optionally, the processor may fix the size of the image corresponding to the content and display the image when changing the screen size of the flexible display.
[0021] Optionally, the processor may further control the image corresponding to the content not to be displayed when changing the screen size of the flexible display.
[0022] Meanwhile, when changing the screen size of the flexible display, the processor may further display UI elements unrelated to the content.
[0023] Meanwhile, the present display device further includes a communication interface for receiving screen size information from an external device, and the processor may control the driver to display an image in accordance with the screen size corresponding to the received size information.
[0024] According to another aspect of the present disclosure, there is provided a display method for a display device. The display method having a flexible display includes: determining a screen size of the flexible display corresponding to the size of the content to be displayed on the flexible display; changing the screen size of the flexible display to have the determined screen size; and using the flexible display to display an image corresponding to the content.
[0025] In this case, the determining step may include: determining a screen ratio of the content, and determining a screen size corresponding to the determined screen ratio.
[0026] Meanwhile, the changing step may include: changing the width of the flexible display by rolling up a planar display area in a horizontal direction of the display device.
[0027] Meanwhile, the determining step may include: in response to the occurrence of a specific event, determining a screen size corresponding to a screen ratio of a UI element corresponding to the specific event, and the displaying step includes: displaying the UI element.
[0028] Meanwhile, the displaying step may, when changing the screen size of the flexible display, change the size of the image corresponding to the content and display the image.
[0029] Meanwhile, the displaying step may, when changing the screen size of the flexible display, fix the size of the image corresponding to the content and display the image.
[0030] From the following detailed description of various embodiments of the present disclosure disclosed in conjunction with the accompanying drawings, other aspects, advantages and significant features of the present disclosure will become apparent to those skilled in the art.
[0031] Technical Effects Description of the Drawings
[0032] From the following detailed description made in conjunction with the accompanying drawings, the above and other aspects, features and advantages of specific embodiments of the present disclosure will become more apparent, wherein:
[0033] Figure 1 is a block diagram schematically showing the configuration of a display device according to an embodiment of the present disclosure;
[0034] Figures 2 to 4 is a view showing a specific form of a flexible display according to various embodiments of the present disclosure;
[0035] Figure 5a is a block diagram showing in detail the configuration of a display device according to an embodiment of the present disclosure;
[0036] Figure 5b is a view showing an example of a software configuration of a user terminal device according to an embodiment of the present disclosure;
[0037] Figures 6a to 16c is a view provided according to various embodiments of the present disclosure for illustrating various embodiments of controlling a display device using a flexible display;
[0038] Figures 17a to 19 is a view provided according to various embodiments of the present disclosure for illustrating various embodiments of controlling a display device using an external device;
[0039] Figure 20 is a flowchart provided according to an embodiment of the present disclosure for illustrating a method of controlling a display device including a flexible display;
[0040] Figure 21 and Figure 22 is provided according to various embodiments of the present disclosure for specifically illustrating Figure 20 a determination operation flowchart.
[0041] Throughout the drawings, the same reference numerals will be understood to indicate the same components, elements, and structures.
[0042] Optimal Embodiment Detailed Embodiment
[0043] The following description with reference to the accompanying drawings is provided to assist in a comprehensive understanding of various embodiments of the present disclosure defined by the claims and their equivalents. The description includes various specific details to aid in this understanding, but these details are to be considered merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications can be made to the various embodiments described herein without departing from the scope and spirit of the present disclosure. In addition, descriptions of well-known functions and structures may be omitted for clarity and conciseness.
[0044] The terms and words used in the following description and claims are not limited to the written meanings, but are used by the inventors only to enable a clear and consistent understanding of the present disclosure. Accordingly, it should be clear to those skilled in the art that the following description of the various embodiments of the present disclosure is provided for illustrative purposes only and not for the purpose of limiting the present disclosure defined by the claims and their equivalents.
[0045] It will be understood that, unless the context clearly dictates otherwise, the singular forms include plural referents. Thus, for example, reference to "a component surface" includes reference to one or more of such surfaces.
[0046] Terms such as first and second may be used to distinguish one entity from another entity, and do not necessarily imply any actual relationship or order between such entities.
[0047] The terms "comprising", "including", "configured to", etc. in the specification are used to indicate the presence of features, numbers, operations, elements, components, or combinations thereof, and do not preclude the possibility of incorporating or adding one or more features, numbers, operations, elements, components, or combinations thereof.
[0048] In one embodiment, a "module" or "unit" performs at least one function or operation and can be implemented as hardware, firmware, software, or a combination thereof. Further, except for a "module" or "unit" that should be implemented in specific hardware, a plurality of "modules" or a plurality of "units" can be integrated into at least one module and can be implemented as at least one processor (not shown).
[0049] Hereinafter, the present disclosure will be described in detail with reference to the accompanying drawings.
[0050] Figure 1 is a block diagram showing an example of a basic configuration of a display device according to various embodiments of the present disclosure. Figure 1 The display device 100 can be implemented as various types of devices, such as a television (TV), a personal computer (PC), a laptop PC, a mobile phone, a tablet PC, a personal digital assistant (PDA), a Moving Picture Experts Group phase 1 or phase 2 (MPEG-1 or MPEG-2) Audio Layer 3 (MP3) player, an information station, an electronic photo frame, a desktop display device, etc. When the display device is implemented as a portable type device such as a mobile phone, a tablet PC, a PDA, an MP3 player, a laptop PC, etc., the display device may be referred to as a mobile device, but will be described as a display device throughout this specification.
[0051] Referring to Figure 1 , the display device 100 includes a flexible display 110, a driver 120, and a processor 130.
[0052] The flexible display 110 can be bent from a flat state and can be flattened again from a bent state. Specifically, the flexible display 110 has an area that is flat and can be rolled to one side. When a part of the display area is rolled up, the display area can be divided into a main area for displaying an image and a rolled-up area that does not display an image.
[0053] In addition, the flexible display 110 displays an image. Specifically, the flexible display 110 can display an image on a display area that is not rolled up in the entire area of the flexible display 110.
[0054] The driver 120 is configured to change the screen size of the flexible display 110. Specifically, the driver 120 can change the screen size of the flexible display 110 by rolling up a part of the flexible display 110. For example, when the flexible display 110 is rolled up in the horizontal direction, the driver 120 can roll up the display area in the horizontal direction of the flexible display 110 and change the horizontal length of the flexible display 110.
[0055] The processor 130 is configured to control each component in the display device 100. Specifically, the processor 130 can detect the size of the content to be displayed in the flexible display 110, and determine the screen size of the flexible display 110 corresponding to the detected size of the content. For example, when the flexible display 110 can change the horizontal length of the flexible display 110 by being rolled up in the horizontal direction, the vertical length is fixed. Therefore, the processor 130 can determine the screen ratio of the content, calculate the horizontal length based on the fixed vertical length and the screen ratio of the content, and control the driver 120 to have the calculated horizontal length.
[0056] In addition, the processor 130 is configured to detect whether a specific event has occurred. In this case, the event can be set in various ways, such as an event in which a user gesture is detected, an event in which a system alarm is generated, an event in which a specific program is executed or ended, etc.
[0057] In addition, the processor 130 can control the driver 120 and the flexible display 110 to control the user interface (UI) elements corresponding to a specific event to be displayed according to the screen size corresponding to the UI elements. The type, display method, layout, etc. of the content displayed in the flexible display 110 can be changed in various ways according to various embodiments. The above will be described in detail below. In this case, the UI element is a graphical object that can be displayed in the display device. The UI element can be the content itself, or can be an image, a graphic image, a video, etc., such as a thumbnail and an icon of the content, an icon corresponding to a menu, etc.
[0058] As described above, the display device 100 according to an embodiment can automatically change the size of the flexible display 110 adaptively to the size of the content, thereby preventing distortion of the image or effective use of the display. In addition, various user interfaces can be provided in response to the shape of the display device.
[0059] Figures 2 to 4is a view showing a specific shape of the flexible display 110 according to various embodiments of the present disclosure. Specifically, Figure 2 is a view showing the flexible display 110 with the entire area rolled up, Figure 3 is a view showing the flexible display 110 with one side rolled up, Figure 4 is a view showing the flexible display 110 with both sides rolled up.
[0060] Referring to Figure 2 and Figure 3 , the rolled-up area refers to the entire area where the flexible display device is bent and in a rolled-up state. As Figure 2 shown, when the flexible display 110 is rolled up as a whole, the entire area of the flexible display device can be defined as the rolled-up area, and as Figure 3 shown, the flexible display 110' can be partially rolled up.
[0061] As Figure 3 shown, the flexible display 110' can be divided into a flat display area and a rolled-up area. In this case, an image can be displayed only in the display area. Therefore, the display device 100 can change the screen size of the display by adjusting the area of the rolled-up area.
[0062] Meanwhile, as described in Figure 3 , the rolled-up area is only set on the area on the right side of the display area, but as Figure 4 shown, the rolled-up areas of the flexible display 110'' can be set on each of the left and right sides of the display area. In this case, Figure 4 has the advantage of changing the screen size of the display faster than Figure 3 . In this case, the rolled-up areas that are rolled up can be accommodated only in the main body of the display device 100.
[0063] Meanwhile, as described above, only the horizontal length of the flexible display is adjusted, but it can be implemented such that the flexible display is rolled up in the direction of the y-axis.
[0064] Meanwhile, it is beneficial to be rolled up in the x-axis direction to provide various screen ratios. Specifically, display devices in the prior art have screen ratios with longer horizontal lengths (such as 16:9 or 21:9) to display images such as movies. When the horizontal length is adjusted, a more favorable screen ratio for providing images, such as a square ratio (1:1), can be provided.
[0065] Figure 5a is a block diagram showing a detailed configuration of a display device according to an embodiment of the present disclosure.
[0066] Referring to Figure 5a, the display device 100 may include a flexible display 110, a driver 120, a processor 130, a memory 140, a communication interface 150, a voice recognition unit 160, a motion recognition unit 170, sensors 180, a speaker 185, and external input ports 190-1 to 190-n.
[0067] The flexible display 110 is flexible. The flexible display 110 may be implemented as various types of displays, such as a liquid crystal display (LCD), an organic light emitting diode (OLED) display, a plasma display panel (PDP), etc. The flexible display 110 may include a driving circuit, a backlight unit, etc., where the driving circuit may be implemented in the form of an amorphous silicon (a-Si) thin film transistor (TFT), a low temperature polycrystalline silicon (LTPS) TFT, an organic TFT (OTFT), etc. Meanwhile, the flexible display 110 may be combined with a touch sensor and implemented as a flexible touch screen.
[0068] In this case, the touch sensor may include at least one of a touch panel and a pen recognition panel. The touch panel may detect the input of a user's finger gesture and output a touch event value corresponding to the detected touch signal. The touch panel may be entirely mounted under all areas of the flexible display 110, or may be mounted only under a partial area of the flexible display 110. Methods for detecting the input of a finger gesture through the touch panel may include an electrostatic method and a pressure sensing type method. The electrostatic method is a method of calculating touch coordinates by detecting nanoelectricity caused by the user's body. The pressure sensing method includes two electrode plates included in the touch panel to calculate touch coordinates by detecting the current flow caused by the contact between the upper plate and the lower plate at the touch input point.
[0069] The pen recognition panel may detect the input of a user's pen gesture according to the operations of a touch pen (e.g., a stylus pen) and a digitizing pen, and output a pen proximity event value or a pen contact event value. The pen recognition panel may be mounted under at least one of the main area and multiple sub-areas of the flexible display 110.
[0070] The pen recognition panel may be implemented by, for example, an electromagnetic resonance (EMR) method, and may detect the input of contact or proximity according to the change in the electromagnetic field intensity caused by the proximity or contact of the pen. More specifically, the pen recognition panel may be configured to include an electronic induction coil sensor (not shown) having a grid structure and an electronic signal controller (not shown), where the electronic signal controller sequentially provides an alternating current (AC) signal having a predetermined frequency to each loop coil of the electronic induction coil sensor.
[0071] When a pen including a resonant circuit is near the loop coil of such a pen recognition panel, a magnetic field emitted from the corresponding loop coil generates a current based on mutual electromagnetic induction with the resonant circuit in the pen. Based on this current, an induced magnetic field is generated from the coil constituting the resonant circuit in the pen, and the pen recognition panel can detect this induced magnetic field in a signal reception state to detect the proximity position or contact position of the pen.
[0072] The driver 120 is configured to change the screen size of the flexible display 110. Specifically, the driver 120 may include a rotating roller or the like capable of rolling up a partial region of the flexible display 110. In addition, the driver 120 may drive the above-described moving member and motor to change the screen size of the flexible display 110. For example, when the flexible display 110 can change its horizontal length by rolling up in the horizontal direction, the driver 120 may roll up the display area in the horizontal direction of the flexible display 110 to change the horizontal length of the flexible display screen.
[0073] The processor 130 may display an image in the display area (image display area other than the rolled-up area) of the flexible display 110 using programs or data stored in the memory 140. In addition, in response to the occurrence of an event, the processor 130 performs a control operation corresponding to the event.
[0074] The processor 130 may include a random access memory (RAM) (not shown), a read only memory (ROM) (not shown), a central processing unit (CPU) (not shown), a graphics processing unit (GPU) (not shown), and a bus (not shown). The RAM, ROM, CPU, GPU, etc. may be connected to each other through the bus.
[0075] The CPU is configured to access the memory 140 and perform startup using the operating system (OS) stored in the memory 140. In addition, the CPU performs various operations using various programs, content, data, etc. stored in the memory 140.
[0076] The ROM is configured to store an instruction set for system startup and the like. When a power-on command is input and power is supplied, the CPU is configured to copy the OS stored in the memory 140 to the RAM according to the instructions stored in the ROM and start the system by executing the OS. When the startup is completed, the CPU is configured to copy various programs stored in the memory 140 to the RAM and perform various operations by executing the programs copied to the RAM. The GPU is configured to display a UI screen in the display area when the startup of the display device 100 is completed. Specifically, the GPU can use a computing unit (not shown) and a rendering unit (not shown) to generate a screen including various objects such as icons, images, text, etc. The computing unit is configured to calculate attribute values such as the coordinate values, forms, sizes, colors, etc. at which each object will be displayed according to the layout of the screen. The rendering unit is configured to generate a screen including various layouts of objects based on the attribute values calculated in the computing unit. The screen generated in the rendering unit can be provided to the flexible display 110 and displayed in the display area of the flexible display 110.
[0077] The memory 140 can store various programs or data associated with the operation of the display device 100, setting information set by the user, system operation software, various application programs, information about operations corresponding to user operations, etc.
[0078] The sensor 180 can detect the bending state and touch state of the entire display device 100 and the flexible display 110. The sensor 180 can include various types of sensors, such as a touch sensor, a geomagnetic sensor, an acceleration sensor, a bending sensor, a pressure sensor, a proximity sensor, a grip sensor, etc.
[0079] In this case, the touch sensor can be implemented as a capacitive type or a pressure sensing type. The capacitive type is a method of calculating touch coordinates based on a dielectric stacked on the surface of the flexible display and detecting the nano current caused by a part of the user's body when the user's body touches the surface of the flexible display. The pressure sensing type including two electrode plates is a method of calculating touch coordinates by detecting the current flow when the upper plate and the lower plate come into contact at the touch input point when the user touches the screen. The touch sensor can be implemented in various forms as described above.
[0080] The geomagnetic sensor is a sensor for detecting the rotation state and moving direction of the display device 100, and the acceleration sensor is a sensor for detecting the inclination of the display device 100. As described above, the geomagnetic sensor and the acceleration sensor can be respectively used to detect the bending characteristics of the display device 100, such as the bending direction, the bending area, etc., but can be additionally used to detect the rotation state or inclination state of the display device 100.
[0081] The bending sensor can be implemented in various forms and quantities and can detect the bending state of the flexible display 110.
[0082] The pressure sensor is configured to detect the magnitude of the pressure applied to the flexible display 110 when the user performs a touch or bending operation and provide the magnitude of the pressure to the processor 130. The pressure sensor can be mounted in the flexible display 110 and includes a piezoelectric film for outputting an electrical signal corresponding to the magnitude of the pressure. At the same time, when the touch sensor is implemented as a pressure-sensing type touch sensor, the pressure-sensing type touch sensor can also be used as a pressure sensor.
[0083] The pressure sensor is a sensor for detecting movement close to but not directly in contact with the display surface. The pressure sensor can be implemented as various types of sensors, such as a high-frequency oscillator type that detects a current caused by a change in magnetic field properties when an object approaches, a magnetic type using a magnet, and an electrostatic capacitance type that detects a change in capacitance due to the approach of a target object.
[0084] The grip sensor is a sensor independent of the pressure sensor disposed at the edge or handle of the display device 100 and detects the user's grip. The grip sensor can be implemented as a pressure sensor or a touch sensor.
[0085] The processor 130 can analyze various detection signals detected in the sensor 180, identify the user's intention, and perform an operation corresponding to the intention. As an example, the processor 130 can process data obtained through communication with an external device or data stored in the memory 140 and output the data through the flexible display 110, the speaker 185, etc. In this case, the processor 130 can communicate with the external device using the communication interface 150.
[0086] The communication interface 150 is configured to communicate with various types of external devices according to various types of communication methods. The communication interface 150 can include a broadcast receiving module 151, a near-field wireless communication module 152, a global positioning system (GPS) module 153, a wireless communication module 154, etc.
[0087] In this case, the broadcast receiving module 151 can include a terrestrial broadcast receiving module (not shown) for receiving terrestrial broadcast signals (the terrestrial broadcast receiving module includes an antenna, a demodulator, an equalizer, etc.), a digital multimedia broadcast (DMB) module for receiving and processing DMB broadcast signals, etc. The near-field wireless communication module 152 is a module for communicating with external devices located at a short distance according to near-field wireless communication methods such as near-field communication (NFC), Bluetooth, ZigBee, etc.
[0088] The GPS module 153 is a module for receiving GPS signals from GPS satellites and detecting the current location of the display device 100. The wireless communication module 154 is a module that communicates by being connected to an external network according to a wireless communication protocol (such as WiFi, Institute of Electrical and Electronics Engineers (IEEE), etc.). In addition, the wireless communication module 154 may further include a mobile communication module that communicates by accessing a mobile communication network according to various mobile communication specifications (such as third generation (3G), 3rd Generation Partnership Project (3GPP), Long Term Evolution (LTE), etc.).
[0089] The processor 130 may perform operations by selectively activating the elements required to execute the operations desired by the user among the elements of the communication interface 150 described above.
[0090] Meanwhile, the processor 130 may also recognize voice input or motion input in addition to the bending operation or touch operation, and perform an operation corresponding to the input. In this case, the processor 130 may activate the voice recognition unit or the motion recognition unit 170.
[0091] The voice recognition unit 160 is configured to collect the user's voice or external sound using a sound acquisition device such as a microphone (not shown), and then send it to the processor 130. In a state where the processor 130 operates in the voice control mode, when the user's voice matches a predetermined voice command, the processor 130 may execute a task corresponding to the user's voice. Tasks that can be controlled by voice may include various tasks such as screen size adjustment, volume adjustment, channel selection, channel jumping, display attribute adjustment, reproduction, pause, rewind, fast forward, application execution, menu selection, turning on the device, turning off the device, etc.
[0092] Meanwhile, the motion recognition unit 170 is configured to acquire an image of the user using an image capturing device such as a camera (not shown), and then provide the acquired image to the processor 130. If the processor 130 is operated in the motion control mode, the processor 130 is configured to analyze the user image, and when it is determined that the user has made a motion gesture corresponding to a preset motion command, execute an operation corresponding to the motion gesture. For example, various tasks such as screen size adjustment, channel jumping, turning on the device, turning off the device, pause, reproduction, pause, rewind, fast forward, mute, etc. can be controlled by motion. The above examples of tasks that can be controlled by voice, tasks that can be controlled by motion, etc. are only examples and are not limited thereto.
[0093] In addition to the above, the external input ports 1, 2 to n (190-1 to 190-n) can be respectively connected to various types of external devices and receive various data programs, control commands, etc. Specifically, the external input ports can include a Universal Serial Bus (USB) port, a headphone port, a mouse port, a Local Area Network (LAN) port, etc.
[0094] In addition, although not shown in Figure 5a , according to an embodiment, the display device 100 may further include a USB port that can be connected to a USB connector, various external input ports for connecting to various external terminals (such as headphones, mice, LANs, etc.), a DMB chip for receiving and processing DMB signals, various sensors, etc.
[0095] Meanwhile, as described above, the memory 140 can store various programs.
[0096] Figure 5b is a diagram for explaining the structure of software stored in the display device 100 according to an embodiment of the present disclosure. According to Figure 5b , the memory 140 can store software including an OS 510, a kernel 520, middleware 530, application modules 540, etc.
[0097] Referring to Figure 5b , the OS 510 is configured to perform functions of controlling and managing the overall operation of the hardware. That is, the OS 510 is a class responsible for basic functions such as hardware management, memory, security, etc.
[0098] The kernel 520 serves as a channel through which various signals such as touch signals detected in the flexible display 110 are sent to the middleware 530.
[0099] The middleware 530 includes various software modules for controlling the operation of the display device 100. According to Figure 5b , the middleware 530 includes an X11 module 530-1, an APP manager 530-2, a connection manager 530-3, a security module 530-4, a system manager 530-5, a multimedia framework 530-6, a UI framework 530-7, a window manager 530-8, and a sub-UI framework 530-9.
[0100] The X11 module 530-1 is a module for receiving various event signals from various hardware included in the display device 100. In this case, events can be set in various ways, such as an event where a user gesture is detected, an event where a system alarm occurs, an event where a specific program is executed or ended, etc.
[0101] The APP manager 530-2 is a module for managing the execution status of various applications 540 installed in the memory 140. The APP manager 530-2 is configured to call and execute the application corresponding to the event when an application execution event is detected from the X11 module 530-1.
[0102] The connection manager 530-3 is a module for supporting wired or wireless network connections. The connection module 530-3 may include various detailed modules, such as a DNET module, a Universal Plug and Play (UPnP) module, etc.
[0103] The security module 530-4 is a module for hardware-supported authentication, licensing, secure storage, etc.
[0104] The system manager 530-5 is configured to monitor the status of each component in the display device 100 and provide the monitoring results to other modules. For example, in the case of a missing battery, an error, a disconnection from the network, etc., the system manager 530-5 may provide the monitoring results to the main UI framework 530-7 or the sub-UI framework 530-9 and output a notification message or an alarm sound.
[0105] The multimedia framework 530-6 is a module for reproducing multimedia content stored in the display device 100 or provided from an external source. The multimedia framework 530-6 may include a player module, a video camera module, a sound processing module, etc. Thus, the multimedia framework 530-6 can generate and reproduce screens and sounds corresponding to various multimedia contents.
[0106] The main UI framework 530-7 is a module for providing various UIs to be displayed on the flexible display 110, and the sub-UI framework 530-9 is a module for providing various UIs to be displayed in the corresponding sub-region when the sub-UI framework includes a sub-region. The main UI framework 530-7 and the sub-UI framework 530-9 may include an image synthesizer module for configuring various objects, a coordinate synthesizer module for calculating the coordinates of the objects to be marked, a rendering module for rendering the configured objects at the calculated coordinates, a two-dimensional or three-dimensional UI toolkit for providing tools for configuring two-dimensional or three-dimensional UIs, etc.
[0107] The window manager 530-8 can detect touch events or other input events using the user's body or a pen. The window manager 530-8 is configured to send an event signal to the main UI framework 530-7 or the sub-UI framework 530-9 when such an event is detected and control the execution of the operation corresponding to the event.
[0108] In addition to the above, the middleware can store various program modules, such as a writing module for drawing a line according to a dragging trajectory when the user touches and drags the screen, a position calculation module for calculating the position of the user based on the ultrasonic sensor value detected in the sensor 180, a line-of-sight calculation module for calculating the direction of the user's line of sight in a user image captured by a capturing unit (not shown), and the like.
[0109] The application module 540 includes applications 540-1 to 540-n for supporting various functions. For example, the application module may include program modules for providing various services, such as a GPS program module, a game module, an e-book module, a calendar module, an alarm management module, and the like. Such applications may be installed by default or may be arbitrarily installed and used during use. When an object is selected, the CPU 230 may use the application module 540 to execute an application corresponding to the selected object.
[0110] In Figure 5b The software structure shown is only an example and is not limited thereto. Therefore, some elements may be omitted, modified, or added as needed. For example, the memory 140 may additionally have various programs, such as a sensing module for analyzing signals sensed by various sensors, a messaging module (including messenger programs, short message service (SMS) and multimedia message service (MMS) programs, and e-mail programs), a call information aggregation program module, an Internet voice protocol (VoIP) module, a web browser module, and the like.
[0111] Meanwhile, as described above, the display device 100 may be implemented as various types of devices, such as a mobile phone, a tablet PC, a laptop PC, a PDA, an MP3 player, an electronic photo frame device, a TV, a PC, an information station, and the like. Therefore, Figure 5a and Figure 5b the features described in
[0112] As described above, the display device 100 may be implemented in various forms and configurations. According to an embodiment, the processor 130 of the display device 100 may support various user interactions.
[0113] Hereinafter, methods of user interaction according to various embodiments will be described in detail.
[0114] As an embodiment, the processor 130 is configured to determine whether to change the screen size of the display device 100. Specifically, the processor 130 is configured to determine the screen size (or screen ratio) of the content to be displayed on the display 100 and identify the current screen size (or display area) of the display 100.
[0115] Therefore, when the current screen size and the screen size of the content are different from each other, the processor 130 may determine to change the screen size of the display 100 and control the driver 120 so that the current screen size is the same as the screen size corresponding to the content. Then, the processor 130 may display an image corresponding to the new content on the display area with the changed size.
[0116] Meanwhile, when the current screen size and the screen size of the content are the same as each other, the processor 130 may control the new content to be immediately displayed on the display area of the flexible display 110 without changing the screen size of the flexible display 110.
[0117] In such a case, when a specific event occurs, the processor 130 may display a UI element corresponding to the specific event on the flexible display. In this case, when the UI element corresponding to the specific event and being displayed is different from the current screen size, the processor 130 may control the driver 120 so that the flexible display 110 has the same screen size as the screen size corresponding to the UI element.
[0118] For example, as Figure 6a shown, when user identification is completed as a result of voice recognition, face recognition, etc., the flexible display 610 may display information corresponding to the user account. As Figure 6b shown, when the user account is authenticated, the flexible display 620 may display content frequently viewed by the user or recently viewed content in the form of a menu UI.
[0119] In this case, when the user selects any one of the content, the flexible display 630 may be enlarged to the screen size corresponding to the content selected by the user (for example, as Figure 6c shown, the flexible display 630 is enlarged in the horizontal direction), and the content selected by the user is displayed in the enlarged screen.
[0120] Figures 6a to 6c is a diagram provided according to various embodiments of the present disclosure for illustrating various embodiments of controlling a display device using a flexible display.
[0121] Meanwhile, for the flexible display 110 in the illustrated embodiment, when the flexible display 110 is arranged as Figure 4 shown, the rolled-up area on the left side is rolled onto the rotating roller inside the left main body of the display device, and the rolled-up area on the right side is rolled onto the rotating roller inside the right main body of the display device. Therefore, the flexible display 110 may be rolled up or unfolded to change the size of the display device. In some embodiments, different sides may be rolled up or unfolded independently.
[0122] Figures 7a to 7eIt is a diagram showing an example of a user interface window when a display device is in a content reproduction mode according to various embodiments of the present disclosure.
[0123] Referring to Figure 7a , the content reproduction mode is a mode for displaying content that can be reproduced in the display device 710. When the user selects the content reproduction mode, as Figure 7b shown, the size of the display area 720 can be changed so that the size of the display area is the same as the screen size (e.g., 21:9) corresponding to the content selected by the user.
[0124] When viewing the screen, the user may want to know information about another channel. In this case, when the user requests information about another channel, as Figure 7c shown, the display device 100 can also expand the screen size of the flexible display device 730, thereby distinguishing a main area 731 for displaying basic content and a sub-area 733 for displaying additional information.
[0125] As shown in FIG. 7D, the separated sub-area 733' can display information about another channel. At the same time, according to an embodiment, the sub-area 733' can display not only information about another channel but also notification messages received by another device within the home network.
[0126] In addition, when the user selects another content in the sub-area 733', the display device 750 can change the screen size so that the screen size is the same as the screen size corresponding to the selected content, and as Figure 7e shown, the display device 750 can display the content with the changed screen size.
[0127] Figures 8a to 8c It is a diagram showing an example of a user interface window when a display device is in a music reproduction mode according to various embodiments of the present disclosure.
[0128] Referring to Figure 8a , the display area 810 is configured to display only basic UI elements, such as information about the music content currently being reproduced. In this case, when the user requests a reproduction list, the display device 100 can, as Figure 8b shown, expand the size of the display area 820 to display the reproduction list more prominently.
[0129] Referring to Figure 8b , the display area 820 that has been expanded in the horizontal direction can display the current reproduction list of the device in the form of a list.
[0130] When the user selects any one from the displayed reproduction list, in order to reproduce the corresponding content, the display device 100 may change the screen size of the flexible display 830 such that the flexible display 830 has a screen size corresponding to the corresponding content, and as Figure 8c shown, display the content selected by the user in an enlarged size.
[0131] Figures 9a to 9c is a diagram showing an example of a user interface window when the display device is in the smart home mode according to various embodiments of the present disclosure.
[0132] Referring to Figures 9a to 9c , the smart home mode is an area for controlling another terminal device directly connected to a display device or a household appliance within a home network, or an area for providing information for checking the status of the corresponding device. Therefore, when the user selects the smart home mode, the display area 910 is configured to display UI elements (e.g., terminal devices 10-1 to 10-5) corresponding to each terminal device currently connectable to the display device in the smallest size.
[0133] When the user selects any one from the multiple displayed devices, as Figure 9b shown, the display area 920 may display the operation UI elements corresponding to the selected device together.
[0134] If necessary, as Figure 9c shown, the display area 930 may be enlarged, and display the information corresponding to the device selected by the user on a large screen.
[0135] Figures 10a to 11b is a diagram showing an example of an operation when the length of the display device is adjusted in the vertical direction according to various embodiments of the present disclosure.
[0136] Referring to Figure 10a and Figure 10b , the display area 1010 is configured to display only simple UI elements, such as information on the music content currently being reproduced. In this case, if the user wants to watch the music video of the music content currently being reproduced and gives a command through a voice message, the display device 100 may retrieve the video content corresponding to the corresponding music content, and change the screen size of the flexible display 110 such that the screen has a screen ratio (e.g., 16:9) corresponding to the retrieved video content. Then, the display device 100 may display the retrieved video content in the changed display area 1020.
[0137] Meanwhile, as described above, the lower end of the display area 1010 is rolled up and the display area 1010 extends upward; however, the flexible display may also be implemented in such a way that the upper area of the flexible display is rolled up and the flexible display extends downward.
[0138] Referring Figure 11a and Figure 11b , the display area 1110 is configured to display only simple UI elements, such as information corresponding to the music content being currently reproduced. In this case, if the user wants to watch the music video of the music content being currently reproduced and gives a command using the remote controller, the display device 100 may retrieve the video content corresponding to the corresponding music content and change the screen size of the flexible display 110 such that the screen has a screen ratio (e.g., 16:9) corresponding to the retrieved video content. Then, the display device 100 may display the retrieved video content in the changed display area 1120.
[0139] Meanwhile, as described above, the size of the display area is gradually enlarged according to the user's operation; however, according to an embodiment, the size of the display area may also be reduced according to the user's operation.
[0140] In addition, as described above, when the content to be displayed is changed, the screen size is changed to correspond to the changed content and the content is displayed in the screen with the changed size. However, according to the present embodiment, since the screen size of the flexible display 110 is physically changed, the changing process may take some time. Therefore, how to display the content in the form while the screen size is being changed will be described below.
[0141] First, as a first example, the size of the image corresponding to the content may be fixed and displayed while the screen size of the flexible display is being changed. In this regard, reference will be made to Figures 12a to 12c for description..
[0142] Figures 12a to 12c is a user interface window according to various embodiments of the present disclosure.
[0143] Referring Figure 12a , the user interface window 1210 is configured to display the first content with the first screen size (4:3). In this case, the user may input a reproduction command for the second content with the second screen size (16:9). Since the screen size of the second content is larger, the flexible display 110 may expand the areas 1210a and 1210b to the left and right.
[0144] During the expansion as described above, as Figure 12bAs shown, the user interface window 1220 is configured to display the second content according to the current screen size. However, since the current screen size of the flexible display does not have the screen size of the second content, the flexible display cannot display the screens corresponding to the left region 1220a and the right region 1220b of the second content.
[0145] However, as the screen of the flexible display 110 is additionally extended to the left and right, as Figure 12c shown, the user interface window 1230 can finally display the entire screen of the second content.
[0146] Meanwhile, in the Figures 12a to 12c shown method, the central region can continuously display an image during the transition process, and the advantage is that the change of the image is not obvious during the transition process. However, its disadvantage is that some regions of the image are not displayed.
[0147] Therefore, as a second example, when the screen size of the flexible display is being changed, the size of the image corresponding to the content can be changed and displayed. In this regard, reference will be made to Figure 13a and Figure 13b for description.
[0148] Figure 13a and Figure 13b are user interface windows according to various embodiments of the present disclosure.
[0149] In the case where expansion is required as described above, the user interface window 1320 can reduce the image of the second content and display the reduced second content in the first screen of the current size (4:3). Since the screen ratio of the second content is different from the screen ratio of the first content 1312, blank regions 1311 and blank regions 1313 without image display are arranged in the upper region and the lower region of the image.
[0150] In this case, the screen of the flexible display 110 is extended in the left - right direction, and the screen of the second content is extended at the same ratio to correspond to the expansion speed. Finally, the expanded display area will have a ratio corresponding to the second content, and thus, as Figure 13b shown, the blank regions displayed during the transition process will disappear.
[0151] Meanwhile, it has been described that new content is displayed during the transition process; however, according to an embodiment, when the screen size is being changed, the image corresponding to the content selected by the user may not be displayed. In this regard, the following will refer to Figures 14a to 14c for description.
[0152] Figures 14a to 14c are user interface windows according to various embodiments of the present disclosure.
[0153] Reference Figure 14a As shown in Figure 14a , the user interface window 1410 displays the first content with the first screen size (4:3). At this time, the user can input a command to reproduce the second content with the second screen size (16:9). Since the screen size of the first content is larger, the flexible display 110 will be expanded in the left - right direction.
[0154] During the above - mentioned expansion, the user interface window 1420 displays UI elements corresponding to a graphic effect that is irrelevant to the first and second contents.
[0155] Then, when the screen of the flexible display 110 is fully expanded, as shown in Figure 14c , the user interface 1430 can display the second content selected by the user. Figure 14c As shown
[0156] In addition, according to an embodiment, the above - mentioned transition process can also be implemented as a combination of multiple transition processes. For example, through the combination of the embodiment of Figures 12a to 12c and the embodiment of Figures 14a to 14c , when the screen size of the display is being changed, the second content can overlap and be displayed with the UI elements corresponding to the graphic effect, as shown in Figure 15a . Figures 12a to 12c of the embodiment and Figures 14a to 14c of the embodiment, when the screen size of the display is being changed, the second content can overlap and be displayed with the UI elements corresponding to the graphic effect, as shown in Figure 15a . Figure 15a As shown
[0157] Figure 15a And Figure 15b are user interface windows according to various embodiments of the present disclosure.
[0158] Meanwhile, as described above, an image is displayed when the screen size is being changed; however, according to an embodiment, an image may not be displayed when the screen size is being changed. That is, when the screen size is being changed, the image display operation can be stopped, and when the change of the screen size is completed, the changed content can be displayed.
[0159] Meanwhile, as described above, when the user selects content, the screen size change regions 1510a and 1510b of the flexible display 1510 correspond to the content selected by the user. However, according to an embodiment, the screen size can be changed not only in response to the change of content but also in response to user operations, operations of another terminal device, etc.
[0160] Specifically, it can be assumed that the display device according to this embodiment is a large - scale display device, so the user does not directly change the screen size of the corresponding display device, but uses a device to change the screen size. Therefore, various interaction methods for remotely controlling the screen size of the flexible display device will be described below with reference to Figures 16a to 19 . Figures 16a to 19 Describe various interaction methods for remotely controlling the screen size of the flexible display device.
[0161] Specifically, FIGS. 16A to 16C are diagrams provided in accordance with various embodiments of the present disclosure for illustrating changing the screen size of a flexible display device in response to an operation of an external mobile device.
[0162] Referring Figures 16a to 16c , a user views content 210 using a mobile device 200. At this time, the user may want to view the content 210 on the display device 1610 and input a mirroring command. Accordingly, the display device 1610 mirrors the content 210 transmitted from the mobile device 200 and displays the content.
[0163] At this time, when the user changes the ratio of the content on the mobile device 200, as Figure 16b and Figure 16c shown, the mobile device 200 will display an image 220 according to the changed ratio.
[0164] That is, a blank area where the corresponding image is not displayed is generated in the mobile device 200. However, the display device 1620 recognizes that the ratio of the image of the content has been changed and changes the screen size corresponding to the changed ratio. Accordingly, the display device 1630 will display the image 230 without additional screen distortion.
[0165] Figures 17a to 17d is a user interface window according to various embodiments of the present disclosure.
[0166] Referring Figure 17a , a user views content 930 using a mobile device 200. At this time, when the user mirrors content A to the display device 100, the display device 100 may display an image corresponding to the transmitted content and the display method of the mobile device 200.
[0167] At this time, referring Figure 17b , when the user rotates the mobile device 200 and the screen layout of the mobile device is changed accordingly, the display device 100 may change the screen size to correspond to the rotation ratio of the mobile device and display the corresponding content 930 of the changed screen size, as Figure 17d shown.
[0168] In addition, according to an embodiment, the screen ratio of the display device 100 may be changed not only by the rotation operation of the user on the mobile device but also by inputting a touch gesture (as if the corresponding content is being sent outward), as shown in FIG. 17.
[0169] Figure 18 is a user interface window according to an embodiment of the present disclosure.
[0170] Referring Figure 18, the user can reproduce the content stored in the wearable device on the display device. In this case, the user can input a specific touch gesture to the wearable device, and a control command corresponding to the touch gesture is sent to the display device 100, and the display device 100 can change the screen size in response to the control command.
[0171] Figure 19 is a gesture using remote control according to an embodiment of the present disclosure.
[0172] Referring to Figure 19 , the user can manually change the screen size of the display device by waving the remote control terminal device 400 (i.e., the remote control) for operating the display device from left to right. For example, the screen can be expanded by waving the remote control left and right. In addition, a screen reduction command can be input by shaking the remote control up and down.
[0173] Only the use of a device other than the display device to perform remote control is described; however, the user can also control the screen size of the display device by voice (i.e., voice recognition technology) or by a pre-registered motion behavior.
[0174] Figure 20 is a flowchart provided according to various embodiments of the present disclosure for illustrating a method of controlling a display device including a flexible display.
[0175] Referring to Figure 20 , in operation S2010, the user can select the content to be displayed on the flexible display. When such a change command is input, the size of the screen for displaying the corresponding content can be determined, and the current size of the screen of the flexible display device can be recognized. Through this process, it can be determined whether it is necessary to change the current screen size of the flexible display device.
[0176] As a result of the determination, when a change is required in operation S2020, in operation S2030, the screen size of the flexible display is changed to the determined screen size.
[0177] After the determination, when no change is required or the change has been processed, in operation S2040, an image corresponding to the changed content can be displayed using the flexible display.
[0178] Through the above embodiments, the size of the flexible display can be automatically changed adaptively according to the size of the content, thereby preventing image distortion and inefficient use of the display. In addition, the user can experience various user environments in response to the form of the display device.
[0179] The above display method of the display device can be implemented as a program executable by a program, and the program can be stored in a non-transitory computer-readable medium.
[0180] A non-transitory computer-readable medium refers to a computer-readable medium that stores data semi-permanently rather than for a short period of time, such as registers, caches, memories, etc. The various applications or programs described above can be stored in non-transitory computer-readable media such as optical discs (CDs), digital versatile discs (DVDs), hard disks, Blu-ray discs, USB sticks, memory cards, and ROMs.
[0181] Figure 21 and Figure 22 are flowcharts provided for illustrating Figure 20 the determination operations according to various embodiments of the present disclosure.
[0182] Referring to Figure 21 , first, in operation S2110, a specific function of the display device can be executed.
[0183] When the corresponding function is executed, in operation S2120, an image form corresponding to the function can be generated and displayed.
[0184] Then, in operation S2130, data can be collected in real time from a terminal device (e.g., a household appliance within a home network) that can be connected to the display device 100.
[0185] Then, in operation S2140, a main value graph can be extracted from the collected data, and in operation S2150, the image can be converted in real time by applying parameters corresponding to a predetermined reference value. For example, in operation S2151, color values corresponding to a predetermined value in warm colors such as red and cool colors such as blue can be replaced according to the characteristics of the temperature and information. Optionally, in operation S2153, an effect corresponding to a predetermined reference value can be provided according to the magnitude of the value. This effect can be applied as the graphic effect described with reference to Figure 14b and Figure 15b .
[0186] Referring to Figure 22 , first, in operation S2210, a specific function of the display device is executed.
[0187] When the corresponding function is executed, in operations S2220 and S2230, an image form corresponding to the function can be generated and displayed.
[0188] Then, in operation 2240, a sensor attached to the flexible display can be used to detect a change in the screen ratio (or screen size).
[0189] Then, in operation S2250, the image can be converted in real time by applying parameters corresponding to a predetermined reference value based on the collected screen information. Specifically, in operation S2251, the size of the graphics and the number of objects can be adjusted according to the size conversion or ratio change of the screen. Optionally, when the screen stops or is being expanded, in operation S2253, the graphics movement can be adjusted accordingly.
[0190] Although the present disclosure has been shown and described with reference to various embodiments thereof, those skilled in the art will understand that various changes in form and detail may be made therein without departing from the spirit and scope of the present disclosure as defined by the claims and their equivalents.
Claims
1. A display device, comprising: A flexible display; A roller configured to roll up or unroll the flexible display; A motor configured to drive the roller; A housing body configured to accommodate the flexible display; And At least one processor configured to: Based on a first control signal received from a control device, control the motor to drive the roller to extend the flexible display vertically upward so that a first area of the flexible display is exposed through the housing body; When the first area of the flexible display is exposed through the housing body, control the flexible display to display first video content on the first area of the flexible display; Based on a second control signal received from the control device when the first area of the flexible display is exposed through the housing body, control the motor to drive the roller to contract the flexible display vertically downward so that a second area of the flexible display smaller than the first area is exposed through the housing body by reducing the area of the flexible display exposed through the housing body, and stop displaying the first video content on the flexible display; Based on a first user input received when the second area of the flexible display is exposed through the housing body for selecting a music mode from multiple modes, control the flexible display to display information corresponding to music content on the second area of the flexible display.
2. The display device according to claim 1, wherein, The at least one processor is configured to: Based on a second user input received when the second area of the flexible display is exposed through the housing body for selecting a smart home mode from the multiple modes, Control the flexible display to display a user interface UI on the second area of the flexible display, Wherein, the UI includes at least one device UI element corresponding to at least one external device within a home network.
3. The display device according to claim 2, wherein, The at least one processor is configured to: Based on a third user input received for selecting a device UI element from at least one device UI element included in the UI, control the flexible display to display a plurality of control UI elements for controlling an external device corresponding to the selected device UI element.
4. The display device according to claim 1, wherein, The screen ratio of the first area is different from the screen ratio of the second area.
5. The display device according to claim 1, wherein, The size of the second area of the flexible display is smaller than the area where the flexible display is not exposed through the housing body when the second control signal is received.
6. The display device according to claim 1, wherein, The at least one processor is configured to: Based on a fourth user input received when the displayed video content is displayed on the first area of the flexible display for displaying second video content different from the first video content, change the size of the first area to correspond to the aspect ratio of the second video content, and display the second video content on the first area of the flexible display.
7. A display method of a display device, the display device comprising: A flexible display; A roller configured to roll up or unroll the flexible display; A motor configured to drive the roller; A housing body configured to accommodate the flexible display, wherein the display method includes: Based on a first control signal received from a control device, control the motor to drive the roller to extend the flexible display vertically upward so that a first area of the flexible display is exposed through the housing body; When the first area of the flexible display is exposed through the housing body, display first video content on the first area of the flexible display; Based on receiving a second control signal from the control device when the first area of the flexible display is exposed through the housing body, controlling the motor to drive the roller to contract the flexible display downward in the vertical direction, so as to expose a second area of the flexible display smaller than the first area through the housing body by reducing the area of the flexible display exposed through the housing body, and stopping displaying the first video content on the flexible display; and Based on receiving a first user input for selecting a music mode from multiple modes when the second area of the flexible display is exposed through the housing body, displaying information corresponding to music content on the second area of the flexible display.
8. The method according to claim 7, wherein The method further includes: Based on receiving a second user input for selecting a smart home mode from the multiple modes when the second area of the flexible display is exposed through the housing body, displaying a user interface UI on the second area of the flexible display, wherein the UI includes at least one device UI element corresponding to at least one external device within the home network.
9. The method according to claim 8, wherein The method further includes: Based on receiving a third user input for selecting a device UI element from at least one device UI element included in the UI, displaying a plurality of control UI elements for controlling the external device corresponding to the selected device UI element.
10. The method according to claim 7, wherein, The screen ratio of the first area is different from the screen ratio of the second area.
11. The method according to claim 7, wherein, The size of the second area of the flexible display is smaller than the area where the flexible display is not exposed through the housing body when the second control signal is received.
12. The method according to claim 7, wherein, The method further includes: Based on receiving a fourth user input for displaying a second video content different from the first video content when the displayed video content is displayed on the first area of the flexible display, changing the size of the first area to correspond to the aspect ratio of the second video content, and displaying the second video content on the first area of the flexible display.
Citation Information
Patent Citations
Electronic device having flexible display and operating method thereof
US20140380186A1
Multimedia device having flexible dipslay and controlling method thereof
WO2014200151A1