Collapsible device and method of controlling same

Automatically unlock the display and touch panel by detecting angle changes through the sensing interface, and combined with the biometric identifier, it solves the problem of fast unlocking and security verification of the foldable device when unfolded, improving user experience and security.

CN120540484APending Publication Date: 2025-08-26SAMSUNG ELECTRONICS CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202510678964.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2016-08-30
Publication Date
2025-08-26

AI Technical Summary

Technical Problem

When the existing foldable device is deployed, it is difficult to quickly and conveniently switch from the locked state to the unlocked state, and the lack of an effective user authentication mechanism leads to erroneous operation and security problems.

Method used

The sensor interface detects the angle changes of the foldable device, the controller activates or unlocks the display and touch panel, and combines the biometric information recognizer for user authentication to achieve automatic unlocking and secure verification.

Benefits of technology

It enables quick unlocking of the display unit without additional input during the expansion process, improves user experience, and improves security and prevents misoperation through biometric recognition.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120540484A_ABST
    Figure CN120540484A_ABST
Patent Text Reader

Abstract

A foldable device and a method of controlling the foldable device are provided. A foldable device includes: a display; a touch panel configured to detect a touch input; a sensing interface configured to detect an angle of the foldable device; and a controller configured to activate the display unit when an angle detected by the sensing unit when the foldable device is unfolded is equal to or greater than a first angle, and activate the touch panel when the angle detected by the sensing unit is equal to or greater than a second angle.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] Methods and apparatuses consistent with exemplary embodiments relate to a foldable device in which a locked state of a display unit is controlled, and a method of controlling the foldable device. Background Art

[0002] Due to the advancement of display technology, various display devices such as flexible displays and transparent displays have been developed. A device including a flexible display can be folded or unfolded by a user, and thus the size of the device can be reduced.

[0003] A flexible display can be implemented in the form of an organic electroluminescent light-emitting display device or a liquid crystal display (LCD) device. A flexible display can be manufactured by using a flexible material (for example, by replacing the glass substrate of a typical LCD device or a typical organic electroluminescent display device with a plastic film). In addition, a foldable device can be manufactured by using a flexible material at least in the foldable region of a typical LCD device or a typical organic electroluminescent display device.

[0004] Flexible displays can be used in electronic books that replace magazines, textbooks, publications, and comic books. Flexible displays can be used in new portable information technology (IT) products such as ultra-small personal computers (PCs) with foldable or rollable displays and smart cards for checking information in real time.

[0005] Therefore, a user interface that reflects the characteristics of a foldable device would be useful. Summary of the Invention

[0006] According to one or more exemplary embodiments, there are provided a foldable display in which a lock state of a display unit is controlled, and a method of controlling a foldable device.

[0007] Additional aspects will be set forth in part in the description which follows and, in part, will be apparent from the description, or may be learned by practice of the exemplary embodiments.

[0008] According to one aspect of an exemplary embodiment, a foldable device is provided, comprising: a display; a touch panel configured to detect touch input; a sensing interface configured to detect an angle of the foldable device; and a controller configured to activate the display in response to the detected angle being equal to or greater than a first angle, and to activate the touch panel in response to the detected angle being equal to or greater than a second angle.

[0009] The controller may be further configured to display an image indicating that the foldable device is in a locked state on the display in response to the angle of the foldable device being equal to or greater than the first angle.

[0010] The controller may be further configured to control the display to change or move an image in response to detecting that the unfolded angle of the foldable device is increasing.

[0011] The controller may be further configured to, in response to the angle of the foldable device being equal to or greater than a second angle, release the foldable device from the locked state and display a preset wallpaper on the display.

[0012] The controller may be further configured to display a first mode wallpaper in response to the angle of the foldable device being within a first angle range, and display a second mode wallpaper in response to the angle of the foldable device being within a second angle range.

[0013] The foldable device may further include a biometric information identifier configured to obtain biometric information, wherein the controller may be further configured to perform user authentication by using the biometric information, and activate the touch panel in response to determining that the user authentication has succeeded.

[0014] The controller may be further configured to: in response to the sensing interface detecting an operation of unfolding the foldable device from a folded state, activate the biometric information identifier and obtain biometric information.

[0015] The controller may be further configured to, in response to the angle of the foldable device being equal to or greater than the first angle, provide an interface on the display indicating that user authentication is being performed.

[0016] The biometric information recognizer may include at least one of a fingerprint recognition sensor and an iris recognition camera.

[0017] According to one aspect of another exemplary embodiment, a method for releasing a foldable device from a locked state is provided, the method comprising: activating a display in response to an angle detected by a sensing interface being equal to or greater than a first angle as the foldable device is unfolded; and activating a touch panel for detecting touch input in response to an angle detected by the sensing interface being equal to or greater than a second angle.

[0018] The method may further include displaying an image indicating that the foldable device is in a locked state in response to the angle of the foldable device being equal to or greater than the first angle.

[0019] The method may further include changing or moving the image in response to detecting that the angle of the foldable device is increasing.

[0020] The method may further include releasing the foldable device from a locked state and displaying a preset wallpaper in response to the angle of the foldable device being equal to or greater than a second angle.

[0021] The displaying of the preset wallpaper may include displaying a first mode wallpaper in response to the angle of the foldable device being within a first angle range, and displaying a second mode wallpaper in response to the angle of the foldable device being within a second angle range.

[0022] The method may further include performing user authentication by using biometric information of the user obtained by the biometric information recognizer, wherein activating the touch panel may include activating the touch panel in response to determining that the user authentication has succeeded.

[0023] The performing of the user authentication may include activating a biometric information identifier and obtaining biometric information in response to detecting an operation of unfolding the foldable device from a folded state.

[0024] The method may further include providing, on the display, an interface indicating that user authentication is being performed, in response to the angle of the foldable device being equal to or greater than the first angle.

[0025] The biometric information recognizer may include at least one of a fingerprint recognition sensor and an iris recognition camera.

[0026] According to an aspect of another exemplary embodiment, a flexible display device is provided, the flexible display device including: a display; a touch panel configured to detect a touch input; a sensing interface configured to detect an angle of the flexible display device; and a controller configured to activate the display in response to determining that the angle of the flexible display device is equal to or greater than a first angle, and to activate the touch panel in response to determining that the angle of the flexible display is greater than or equal to a second angle.

[0027] The second angle may be greater than the first angle.

[0028] The flexible device may further include a biometric information identifier configured to receive biometric information from a user, wherein the controller may be further configured to enter an unlocked state in response to determining that the user is authenticated.

[0029] The controller may be further configured to display an image indicating that the flexible display apparatus is in a locked state on the display in response to the detected angle being between the first angle and the second angle.

[0030] The controller may be further configured to move the image from the first position to the second position in response to determining that the detected angle is increasing. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] These and / or other aspects will become clear and more readily understood from the following description of exemplary embodiments taken in conjunction with the accompanying drawings, in which:

[0032] Figure 1A and Figure 1Bis a conceptual diagram illustrating one or more exemplary embodiments;

[0033] Figure 2 and Figure 3 is a block diagram of a foldable device according to one or more exemplary embodiments;

[0034] Figure 4 and Figure 5 is a flowchart of a method of controlling a foldable device according to one or more exemplary embodiments;

[0035] Figure 6 is a diagram illustrating a method of releasing a foldable device from a locked state according to an exemplary embodiment;

[0036] Figure 7 is a diagram illustrating an interface for releasing a foldable device from a locked state when the foldable device is unfolded according to one or more exemplary embodiments;

[0037] Figure 8 is a flow chart illustrating a method of releasing a foldable device from a locked state according to an unfolding angle of the foldable device according to an exemplary embodiment;

[0038] Figure 9A and Figure 9B is a diagram illustrating releasing a foldable device from a locked state according to an unfolding angle of the foldable device according to an exemplary embodiment;

[0039] Figure 10 is a flowchart illustrating user authentication using biometric information according to an exemplary embodiment;

[0040] Figure 11A and Figure 11B is a diagram for describing an arrangement position of a biometric information identifier according to an exemplary embodiment;

[0041] Figures 12 to 18 is a diagram illustrating user authentication using biometric information according to one or more exemplary embodiments;

[0042] Figures 19 to 21 is a diagram illustrating a foldable device that is released from a locked state when the foldable device is unfolded according to one or more exemplary embodiments. DETAILED DESCRIPTION

[0043] One or more exemplary embodiments will be described with reference to the accompanying drawings. However, the one or more exemplary embodiments may be implemented in many different forms and should not be construed as being limited to the exemplary embodiments set forth herein. In the following description, if a well-known function or structure would obscure the present disclosure with unnecessary detail, the well-known function or structure may not be described in detail. Throughout the specification, the same reference numerals in the accompanying drawings represent the same or similar elements.

[0044] The advantages and features of one or more exemplary embodiments and the method for realizing the one or more exemplary embodiments can be understood with reference to the following detailed description of exemplary embodiments and the accompanying drawings. Although the terms including ordinal numbers (such as, first, second, etc.) can be used to describe various elements, structural elements are not limited by the terms. The terms are only used to distinguish an element from another element. For example, without departing from the scope of the present disclosure, the first structural element can be referred to as the second structural element. Similarly, the second structural element can also be referred to as the first structural element.

[0045] Hereinafter, one or more exemplary embodiments will be described in detail with reference to the accompanying drawings.Terms such as "module" or "unit" should be considered in a broad sense and should not be limited to any specific meaning or role.

[0046] Examples of the devices described herein may include mobile phones, smart phones, portable personal computers (PCs), laptop computers, digital broadcast terminals, personal digital assistants (PDAs), portable multimedia players (PMPs), and navigation devices, etc. However, the configuration according to one or more exemplary embodiments may also be applied to fixed terminals such as digital televisions (TVs) or desktop computers.

[0047] In the detailed description, if a component is “connected” to another component, the component and the other component may be “directly connected” but may also be “electrically connected” via another device between the component and the other component. In addition, if a component “includes” an element, the component may also include other elements unless otherwise stated.

[0048] As used herein, the term "and / or" includes any and all combinations of one or more of the associated listed items. Expressions such as "at least one of," when preceding a list of elements, modify the entire list of elements and do not modify the individual elements of the list.

[0049] Hereinafter, one or more exemplary embodiments will be described in detail with reference to the accompanying drawings.

[0050] Figure 1A and Figure 1B is a conceptual diagram illustrating one or more embodiments.

[0051] like Figure 1A and Figure 1B As shown in , according to an exemplary embodiment, when a user unfolds the foldable device 100 , the foldable device 100 may be released from a locked state.

[0052] According to an exemplary embodiment, the locked state of the foldable device 100 may indicate a case where the display unit 115 is in an inactive state and the touch panel 117 is in an inactive state. In addition, the locked state may indicate a case where the display unit 115 is activated and the touch panel 117 is in an inactive state.

[0053] According to an exemplary embodiment, when the foldable device 100 is in a locked state, the display unit 115 may be activated and display a screen, but since the touch panel 117 is in an inactive state, a user's touch on the display unit 115 may not be detected.

[0054] For example, when the user unfolds the foldable device 100 in the folded state to use the foldable device 100, an image indicating the locked state may be displayed on the display unit 115. In addition, since the touch panel 117 is in an inactive state, erroneous operations caused by unintentional touch inputs on the display unit 115 may be prevented.

[0055] The unlocked state of the display unit 115 is a state in which the display unit 115 is released from the locked state. The unlocked state may refer to a state in which the display unit 115 is activated and the touch panel 117 is activated.

[0056] For example, when the foldable device 100 is in an unlocked state, a preset wallpaper may be displayed on the display unit 115 , and since the touch panel 117 is activated, the touch panel 117 may detect a user input touching the display unit 115 .

[0057] According to an exemplary embodiment, when the foldable device 100 is foldable, the foldable device 100 may provide a user interface (UI) through the display unit 115 when the foldable device 100 is unfolded. Therefore, a user may unfold the foldable device 100 to use the foldable device 100.

[0058] According to an exemplary embodiment, a method for quickly and conveniently releasing the display unit 115 from a locked state may be provided without having to perform a separate input (e.g., a password input or a pattern input) for releasing the display unit 115 from a locked state after the user unfolds the foldable device 100. In other words, when the user unfolds the foldable device 100 by at least a predetermined angle, the foldable device 100 may determine that the display unit 115 is released from a locked state.

[0059] The foldable device 100 according to an exemplary embodiment may have a Figure 1A The symmetrical shape shown in Figure 1B The asymmetrical shape shown in .

[0060] like Figure 1A As shown in , areas of two surfaces of the foldable device 100 that face each other when folded may be the same, and the two surfaces may be symmetrical so that the display unit 115 is not exposed when the foldable device 100 is folded.

[0061] Alternatively, as Figure 1B As shown in , the areas of the two surfaces of the foldable device 100 may be different and the two surfaces may be asymmetric, so that when the foldable device 100 is folded, the display unit 115 provided inside is partially exposed.

[0062] Figure 2 and Figure 3 is a block diagram of a foldable device according to one or more exemplary embodiments.

[0063] Reference Figure 2 , the foldable device 100 may include a sensing unit 140 , a display unit 115 , a touch panel 117 , and a controller 180 .

[0064] like Figure 3 As shown in the figure, the foldable device 100 may also include: a video processor 110, an audio processor 120, an audio output unit 125 (e.g., an audio outputter), a power supply 130, a tuner unit 135 (e.g., a tuner), a communicator 150, a detector 160, an input / output unit 170 (e.g., an input / output interface), a storage unit 190 (e.g., a memory), and a biometric information identifier 195.

[0065] The video processor 110 performs processing on video data received by the foldable device 100. The video processor 110 may perform various image processing (such as decoding, scaling, noise filtering, frame rate conversion, and resolution conversion) on the video data.

[0066] The display unit 115 may display a video included in a broadcast signal received through the tuner 135 on a screen according to the control of the controller 180. In addition, the display unit 115 may display content (e.g., video) input through the communicator 150 or the input / output unit 170. The display unit 115 may output an image stored in the storage unit 190 according to the control of the controller 180. In addition, the display unit 115 may display a voice UI (e.g., including voice command guidance) for performing a voice recognition task corresponding to voice recognition or a motion UI (e.g., including user motion guidance for motion recognition) for performing a motion recognition task corresponding to motion (e.g., gesture) recognition.

[0067] Examples of the display unit 115 include a liquid crystal display (LCD), a thin film transistor liquid crystal display (TFT-LCD), an organic light emitting diode (OLED), an active matrix organic light emitting diode (AM-OLED), a plasma display panel (PDP), a flexible display, a three-dimensional (3D) display, and an electrophoretic display. In addition, the display unit 115 may be transparent and / or wearable.

[0068] When the display unit 115 according to an exemplary embodiment is implemented as a flexible display, the foldable device 100 may be implemented to be foldable.

[0069] In addition, according to an exemplary embodiment of the foldable device 100, the foldable device 100 may include at least two display units 115. The at least two display units 115 may face each other by using a hinge.

[0070] According to an exemplary embodiment, when an unfolded angle detected by the sensing unit 140 (eg, a sensing interface) as the foldable device 100 is unfolded is equal to or greater than a first angle, the display unit 115 may be activated according to control of the controller 180 .

[0071] Furthermore, according to the control of the controller 180 , when the unfolded angle of the foldable device 100 is equal to or greater than the first angle, the display unit 115 according to an exemplary embodiment may display an image indicating that the foldable device 100 is in a locked state.

[0072] According to an exemplary embodiment, according to the control of the controller 180, when it is detected that the unfolded angle of the foldable device 100 increases, the display unit 115 may change an image or move an image.

[0073] According to an exemplary embodiment, according to the control of the controller 180, when the unfolded angle of the foldable device 100 is equal to or greater than the second angle, the display unit 115 may release the foldable device 100 from the locked state and display a preset or predetermined wallpaper.

[0074] According to control of the controller 180, the display unit 115 according to an exemplary embodiment may display a first mode wallpaper when the unfolded angle of the foldable device 100 is within a first angle range, and display a second mode wallpaper when the unfolded angle of the foldable device 100 is within a second angle range.

[0075] According to an exemplary embodiment, the display unit 115 may display an interface indicating that user authentication is being performed according to the control of the controller 180 .

[0076] When the display unit 115 and the touch panel 117 are configured as a touch screen by forming a layer structure, the display unit 115 may be used as an output device and an input device.

[0077] The touch panel 117 may be configured to convert a change in pressure or capacitance generated in a region of the display unit 115 into an electric input signal. The touch panel 117 may be configured to detect a touched position, a touched region, and a touch pressure.

[0078] When the touch panel 117 receives a touch input, a signal corresponding to the touch input is sent to the touch controller. The touch controller processes the signal and sends the data obtained by processing the signal to the controller 180. Accordingly, the controller 180 determines which area of ​​the display unit 115 is touched. According to an exemplary embodiment, under the control of the controller 180, the touch panel 117 may be activated when the expansion angle detected by the sensing unit 140 is equal to or greater than the second angle. According to an exemplary embodiment, under the control of the controller 180, when it is determined that user authentication using the user's biometric information obtained by the biometric information identifier 195 has succeeded, the touch panel 117 may be activated.

[0079] The audio processor 120 performs processing on the audio data. The audio processor 120 may perform various processing such as decoding, amplification, and noise filtering on the audio data. The audio processor 120 may include a plurality of audio processing modules to process audio corresponding to a plurality of pieces of content.

[0080] The audio output unit 125 (e.g., an audio outputter) outputs audio included in the broadcast signal received through the sensing unit 140 according to the control of the controller 180. The audio output unit 125 can output audio (e.g., voice or sound) input through the communicator 150 or the input / output unit 170. In addition, the audio output unit 125 can output audio stored in the storage unit 190 according to the control of the controller 180. The audio output unit 125 may include at least one of the following items: a speaker 126, a headphone output terminal 127, and a Sony / Philips Digital Interface (S / PDIF) output terminal 128. The audio output unit 125 may include any combination of the speaker 126, the headphone output terminal 127, and the S / PDIF output terminal 128.

[0081] The power supply unit 130 supplies power from an external power source to the elements included in the foldable device 100 according to the control of the controller 180. In addition, the power supply unit 130 supplies power output from at least one battery provided inside the foldable device 100 to the elements included in the foldable device 100 according to the control of the controller 180.

[0082] The tuner unit 135 can tune and select a frequency of a channel to be received by the foldable device 100 among radio wave components of a wired or wireless broadcast signal through amplification, mixing, and resonance. The broadcast signal includes audio, video, and additional information such as an electronic program guide (EPG).

[0083] The tuner unit 135 can receive a broadcast signal in a frequency band corresponding to a channel number (e.g., cable channel number 506) according to a user input (e.g., a control signal received from a control device, such as a channel number input, a channel up / down input, or a channel input in an EPG screen).

[0084] The tuner unit 135 can receive a broadcast signal from any of various sources such as terrestrial broadcasting, cable broadcasting, satellite broadcasting, and Internet broadcasting. The tuner unit 125 can receive a broadcast signal from a source such as an analog broadcast or a digital broadcast. The broadcast signal received by the tuner unit 135 can be decoded (e.g., audio decoding, video decoding, or additional information decoding) and separated into audio, video, and / or additional information. The audio, video, and / or additional information can be stored in the storage unit 190 according to the control of the controller 180.

[0085] The foldable device 100 may include at least one tuner unit 135. The tuner unit 135 may be implemented as an integral component of the foldable device 100, or may be implemented as a separate device electrically connected to the foldable device 100 (e.g., a tuner unit connected to a set-top box and the input / output unit 170).

[0086] The sensing unit 140 may detect a state of the foldable device 100 or a state around the foldable device 100 and transmit the detected state to the controller 130 .

[0087] The sensing unit 140 may include at least one of the following items: a magnetic sensor 141, an acceleration sensor 142, a Hall sensor, a bending sensor, a temperature / humidity sensor 143, an infrared sensor 144, a gyroscope sensor 145, a position sensor 146 (e.g., a global positioning system (GPS)), an air pressure sensor 147, a proximity sensor 148 and an RGB sensor 149 (e.g., an illumination sensor), but is not limited thereto.

[0088] In addition, the sensing unit 140 may include a sensor for detecting a touch input of an input tool (e.g., a stylus pen) and a sensor for detecting a touch input of a user. The sensor for detecting a touch input of a user may be included in a touch screen or a touch pad. The sensor for detecting a touch input of an input tool may be provided below or inside the touch screen or the touch pad.

[0089] According to an exemplary embodiment, the sensing unit 140 may detect an operation of unfolding or folding the foldable device 100. According to an exemplary embodiment, the sensing unit 140 may detect an operation of changing the foldable device 100 from a folded state to an unfolded state or vice versa. For example, a Hall sensor or a magnetic sensor 141 provided in a folding area may detect an operation of folding or unfolding the foldable device 100.

[0090] According to another exemplary embodiment, the sensing unit 140 may detect whether the current state of the foldable device 100 is the folded state or the unfolded state, and detect a folding or unfolding operation when the current state is changed.

[0091] According to an exemplary embodiment, the sensing unit 140 may be provided at a position where two surfaces of the foldable device 100 approach each other by being folded, thereby detecting a folded state.

[0092] In addition, the sensing unit 140 may detect an unfolded angle of the foldable device 100. For example, when the foldable device 100 has a hinge structure, an angle between two unfolded surfaces may be measured based on the hinge structure.

[0093] According to an exemplary embodiment, the sensing unit 140 may determine a folded state or an unfolded state and provide the determination result to the controller 180. In addition, the sensing unit 140 may provide the controller 180 with information about an unfolded angle of the foldable device 100.

[0094] The communicator 150 may connect an external device (eg, an audio device) to the foldable device 100 according to control of the controller 180. The controller 180 may receive / transmit content from / to an external device, download applications from / to an external device, and / or browse the Internet.

[0095] The communicator 150 may include at least one of the following items based on the performance and mechanism of the foldable device: wireless local area network (LAN) 151, Bluetooth 152, and wired Ethernet 153. The communicator 150 may include any combination of wireless LAN 151, Bluetooth 152, and wired Ethernet 153.

[0096] The communicator 150 may include a Bluetooth Low Energy (BLE) communicator, a near field communication unit, a WLAN (Wi-Fi) communicator, a Zigbee communicator, an Infrared Data Association (IrDA) communicator, a Wi-Fi Direct (WFD) communicator, an Ultra Wideband (UWB) communicator, and an Ant+ communicator, but is not limited thereto.

[0097] The communicator 150 can transmit and receive wireless signals from at least one of the following: a base station on a mobile communication network, an external terminal, and a server. The wireless signals can include various types of data according to the transmission and reception of voice call signals, image call signals, and / or text / multimedia messages.

[0098] The communicator 150 may include a broadcast receiver that receives an external broadcast signal and / or broadcast-related information through a broadcast channel. Non-limiting examples of the broadcast channel include a satellite channel and a terrestrial channel.

[0099] The communicator 150 may receive a control signal of an external control device according to the control of the controller 180. The control signal may be a Bluetooth type, a Radio Frequency (RF) signal type, and / or a Wi-Fi type.

[0100] The detector 160 may detect a user's voice, a user's image, or a user's interaction.

[0101] The microphone 161 receives a voice uttered by the user. The microphone 161 converts the voice into an electrical signal and outputs the electrical signal to the controller 180. The voice may include, for example, a voice corresponding to a menu or function of the foldable device 100. The microphone 161 may have a recognition range from the microphone 161 to the user's position (e.g., 4 meters), and may vary depending on the volume of the voice or the surrounding environment (e.g., speaker sound and surrounding noise).

[0102] The microphone 161 may be embedded in the foldable device 100 or separated from the foldable device 100. When the microphone 161 is separated from the foldable device 100, the microphone 161 may be electrically connected to the foldable device 100 through the communicator 150 and / or the input / output unit 170.

[0103] The camera 162 may include a lens and an image sensor. The camera 162 may support optical zoom or digital zoom by using multiple lenses and utilizing image processing. The recognition range of the camera 162 may be set differently depending on the camera angle and surrounding conditions. When the camera 162 includes multiple cameras, the camera unit 162 may receive 3D still images or 3D motion by using the multiple cameras.

[0104] The camera 162 may be embedded in the foldable device 100 or separated from the foldable device 100. When the camera 162 is separated from the foldable device 100, the camera 162 may be electrically connected to the foldable device 100 through the communicator 150 or the input / output unit 170.

[0105] According to an exemplary embodiment, the camera 162 may include an iris recognition camera.

[0106] According to an exemplary embodiment, the optical receiver 163 receives an optical signal (including a control signal) from an external control device through an optical window of the frame of the display unit 115. The optical receiver 163 may receive an optical signal corresponding to a user input (e.g., touch, press, touch gesture, voice, or motion) from the external control device. The control signal may be extracted from the optical signal according to the control of the controller 180.

[0107] The input / output unit 170 receives video (e.g., moving images), audio (e.g., voice or music), and additional information (e.g., EPG) from an external source of the foldable device 100 according to the control of the controller 180. The input / output unit 170 may include at least one of a high-definition multimedia interface (HDMI) port 171, a component jack 172, a personal computer (PC) port 173, and a universal serial bus (USB) port 174. The input / output unit 170 may include the HDMI port 171, the component jack 172, the PC port 173, and the USB port 174.

[0108] The structure and operation of the input / output unit 170 may differ according to exemplary embodiments.

[0109] The controller 180 controls the overall operation of the foldable device 100 and the signal flow between the elements of the foldable device 100, and processes data. The controller 180 may execute an operating system (OS) or various applications stored in the storage unit 190 when a user input is received or a stored preset condition is satisfied.

[0110] The controller 180 may include: a random access memory (RAM) 181 used as a storage space for storing external signals or data corresponding to various operations performed by the foldable device 100, a read-only memory (ROM) 182 storing a control program for controlling the foldable device 100, and a processor 183 (e.g., a main CPU).

[0111] The processor 183 may include a graphics processing unit (GPU) for performing graphics processing corresponding to the video. The processor 183 may be implemented as a system on a chip (SoC) including a core and a GPU. The processor 183 may include a single core, a dual core, a triple core, a quad core, or any multi-core.

[0112] In addition, the processor 183 may include a plurality of processors. For example, the processor 183 may include a main processor and a sub-processor operating in a sleep mode.

[0113] The image processor 184 generates a screen including various objects (such as icons, images, and text) by using a calculator and a rendering unit. The calculator calculates the attribute value (such as coordinate value, shape, size, or color) of each object to be displayed according to the layout of the screen using the user interaction detected by the detector 160. The rendering unit generates a screen including various layouts of objects based on the attribute values ​​calculated by the calculator. The screen generated by the rendering unit is displayed in the display area of ​​the display unit 115.

[0114] The first to nth interfaces 185-1 to 185-n are connected to the above-described elements. One of the first to nth interfaces 185-1 to 185-n may be a network interface connected to an external device through a network.

[0115] The RAM 181 , the ROM 182 , the processor 183 , the graphic processor 184 , and the first to nth interfaces 185 - 1 to 185 - n may be connected to each other through the internal bus 186 .

[0116] According to an exemplary embodiment, the “controller” may include a processor 183 , a ROM 182 , and a RAM 181 .

[0117] According to an exemplary embodiment, the controller 180 of the foldable device 100 may activate the display unit 115 when the unfolding angle detected by the sensing unit 140 when the unfolding device 100 is unfolded is equal to or greater than a first angle, and may activate the touch panel 117 when the unfolding angle detected by the sensing unit 140 is equal to or greater than a second angle.

[0118] When the unfolded angle of the foldable device 100 is equal to or greater than the first angle, the controller 180 of the foldable device 100 according to an exemplary embodiment may display an image indicating that the foldable device 100 is in a locked state on the display unit 115 .

[0119] Furthermore, when an increase in the unfolded angle of the foldable device 100 is detected, the controller 180 according to an exemplary embodiment may change an image or move an image.

[0120] According to an exemplary embodiment, when the unfolded angle of the foldable device 100 is equal to or greater than the second angle, the controller 180 may release the display unit 115 from the locked state and display a preset wallpaper on the display unit 115 .

[0121] The controller 180 may display a first mode wallpaper when the unfolded angle of the foldable device 100 is within a first angle range, and may display a second mode wallpaper when the unfolded angle of the foldable device 100 is within a second angle range.

[0122] The controller 180 according to an exemplary embodiment may perform user authentication by using biometric information of the user obtained through the biometric information recognizer 195 .

[0123] According to an exemplary embodiment, when an operation of unfolding the foldable device 100 is detected through the sensing unit 140 , the controller 180 may activate the biometric information recognizer 195 and obtain biometric information.

[0124] According to an exemplary embodiment, when it is determined that the user authentication has succeeded, the controller 180 may activate the touch panel 117 .

[0125] According to an exemplary embodiment, the controller 180 may provide an interface indicating that user authentication is being performed to the display unit 115 .

[0126] The structure and operation of the controller 180 may differ according to exemplary embodiments.

[0127] The storage unit 190 may store various types of data, programs, and / or applications for driving and controlling the foldable device 100 according to the control of the controller 180. The storage unit 190 may store input / output signals and / or data according to the operations of the video processor 110, the display unit 115, the audio processor 120, the audio output unit 125, the power supply unit 130, the tuner unit 135, the communicator 150, the detector 160, and the input / output unit 170. The storage unit 190 may store control programs for controlling the foldable device 100 and the controller 180, applications originally provided by the manufacturer or downloaded from an external source, GUIs related to the applications, objects for providing the GUIs (e.g., images, text, icons, or buttons), user information, documents, databases, and / or related data.

[0128] According to an exemplary embodiment, the "storage unit" includes a storage unit 190, a ROM 182, a RAM 181, and / or a memory card (e.g., a micro secure digital (SD) card or a USB memory) provided in the foldable device 100. The storage unit 190 may include a nonvolatile memory, a volatile memory, a hard disk drive (HDD), or a solid state drive (SSD).

[0129] The storage unit 190 may include: a broadcast receiving module, a channel control module, a voice control module, a communication control module, a voice recognition module, a motion recognition module, an optical receiving module, a display control module, an audio control module, an external input control module, a power control module, a power control module for an external device connected wirelessly (e.g., via Bluetooth), a voice database (DB), and / or a motion DB. The modules or DBs of the storage unit 190 may be implemented in the form of software to perform broadcast receiving control functions, channel control functions, voice control functions, communication control functions, voice recognition functions, motion recognition functions, optical receiving control functions, display control functions, audio control functions, external input control functions, power control functions, and / or power control functions for external devices connected wirelessly (e.g., via Bluetooth) in the foldable device. The controller 180 may perform functions by using the software stored in the storage unit 190.

[0130] The biometric information recognizer 195 may include, but is not limited to, a fingerprint recognition sensor 196 and an iris recognition camera 197. The biometric information recognizer 195 may include, but is not limited to, a voice recognition sensor, a facial recognition sensor, a palm print recognition sensor, a blood vessel distribution recognition sensor, a retinal recognition sensor, a motion pattern recognition sensor (such as a gait recognition sensor), an electrocardiogram (ECG) recognition sensor, and / or a palm print recognition sensor.

[0131] According to an exemplary embodiment, the biometric information recognizer 195 may recognize fingerprint information or iris information of the user according to the control of the controller 180 and transmit the fingerprint information or iris information to the controller 180 .

[0132] According to the performance of the foldable device 100, Figure 3 More or fewer elements than those shown in FIG. 1 may be included in the foldable device 100. Positions of the elements may vary depending on the performance or structure of the foldable device 100.

[0133] Figure 4 and Figure 5 is a flowchart of a method of controlling the foldable device 100 according to one or more exemplary embodiments.

[0134] exist Figure 4 In operation S401 , when the foldable device 100 is unfolded, the controller 180 may activate the display unit 115 when an unfolding angle detected by the sensing unit 140 is equal to or greater than a first angle.

[0135] For example, when the foldable device 100 is unfolded from the folded state to at least a first angle (e.g., 20 degrees), the display unit 115 may be activated. At this time, the foldable device 100 is in a locked state, and an image indicating the locked state may be displayed on the display unit 115.

[0136] exist Figure 4 In operation S402, the controller 180 may activate the touch panel 117 for detecting an input of touching the display unit 115 when the unfolded angle of the foldable device 100 detected by the sensing unit 140 is equal to or greater than a second angle.

[0137] For example, when the foldable device 100 is unfolded to at least a second angle (e.g., 160°), the controller 180 may display a preset wallpaper on the display unit 115. When the touch panel 117 is activated, for example, a touch input selecting an application displayed on the preset wallpaper may be detected. This may mean that the foldable device 100 according to an exemplary embodiment is in an unlocked state when the foldable device 100 is unfolded to at least the second angle.

[0138] According to an exemplary embodiment, the first angle and the second angle may be set when the foldable device 100 is manufactured, or may be set or changed by a user, but is not limited thereto.

[0139] As will be described later with reference to FIG. 11 to FIG. Figure 21 As described, the locked state may be achieved after secure user authentication (eg, biometric information recognition) of the foldable device 100 .

[0140] Figure 5 is a flowchart for describing a UI when the display unit 115 is changed from a locked state to an unlocked state. Figure 6 A method of releasing the foldable device 100 from a locked state according to an exemplary embodiment is shown. Figure 7 and Figure 8 is a diagram illustrating an interface for releasing the foldable device from a locked state when the foldable device 100 is unfolded according to one or more exemplary embodiments.

[0141] Will refer to Figures 6 to 8 To describe Figure 5 Flowchart of the process.

[0142] exist Figure 5 In operation S501, when the unfolding angle detected by the sensing unit 140 as the foldable device is unfolded is equal to or greater than a first angle, the display unit 115 may be activated. In operation S502, the foldable device 100 may display an image indicating a locked state on the display unit 115.

[0143] Reference Figure 6When the foldable device in the folded state is unfolded to at least a first angle (eg, 20°), the controller 180 may activate the display unit 115 and provide an interface for indicating the locked state. Figure 6 As shown in the middle diagram of , an ellipse may be displayed and an icon i10 moving on the ellipse may be displayed.

[0144] exist Figure 5 In operation S503 , when it is determined that the unfolded angle of the foldable device 100 increases, the controller 180 may change or move an image indicating a locked state.

[0145] For example, refer to Figure 7 , when the unfolded angle of the foldable device 100 increases, the foldable device 100 may move the icon i12 to the left to display the icon i12 - 1 .

[0146] According to an exemplary embodiment, when the foldable device 100 is unfolded until the icon moved according to the unfolding angle reaches the ellipse (eg, Figure 7 The user can intuitively recognize that the foldable device 100 is out of the locked state.

[0147] exist Figure 5 In operation S504, when the unfolded angle of the foldable device 100 detected by the sensing unit 140 is equal to or greater than the second angle, the controller 180 may release the foldable device 100 from the locked state and display the preset wallpaper on the display unit 115. Here, in operation S505, the controller 180 may activate the touch panel 117 for detecting an input of touching the display unit 115.

[0148] For example, Figure 6 As shown on the left side of FIG, the controller 180 may display a preset wallpaper on the display when the foldable device 100 is unfolded to at least a second angle (e.g., 160°) and detect an input of touching the display unit 115. The foldable device 100 may be released from the locked state when the foldable device 100 is unfolded to at least the second angle.

[0149] Figure 8 is a flowchart illustrating releasing the foldable device 100 from a locked state according to an unfolded angle of the foldable device 100 according to an exemplary embodiment. Figure 9A and Figure 9B is a diagram illustrating how the foldable device 100 is released from a locked state according to an unfolding angle of the foldable device 100 according to an exemplary embodiment. Figure 9A and Figure 9B To describe Figure 8 Flowchart of the process.

[0150] According to an exemplary embodiment, when the foldable device 100 is released from a locked state as the foldable device is unfolded to at least a predetermined angle, the foldable device 100 may provide different service environments according to the unfolding angle range.

[0151] For example, when the unfolded angle range is from 80° to 100°, the foldable device 100 can operate in laptop mode, and when the unfolded angle range is from 150° to 180°, the foldable device 100 can operate in tablet mode. The device 100 can provide different wallpapers in laptop mode and tablet mode. For example, applications can be integrated to form wallpapers for each of the laptop mode and tablet mode. In addition, different background images can be set for each mode. The wallpaper or background image can be set when the foldable device 100 is manufactured, or can be initially set or changed by the user, but is not limited thereto.

[0152] As another example, different OSs may be driven in each mode according to the unfolded angle of the foldable device 100. For example, when the unfolded angle ranges from 80° to 100°, Windows may be driven, and when the unfolded angle ranges from 150° to 180°, Android may be driven. Exemplary embodiments are not limited thereto.

[0153] Reference Figure 8 , in operation S901 , the controller 180 of the foldable device 100 may detect an unfolding angle of the foldable device 100 through the sensing unit 140 .

[0154] exist Figure 8 In operation S902 , the controller 180 of the foldable device 100 may determine that the unfolded angle of the foldable device 100 is within a first angle range. In operation S903 , the controller 180 may display a first pattern wallpaper on the display unit 115 .

[0155] For example, Figure 9A As shown in , when the angle of the foldable device 100 is within a first angle range (e.g., from 100° to less than 130°), the controller 180 may display an icon i15 moved to a position corresponding to the first angle range on the display unit 115. Figure 9A As shown in , when the foldable device 100 is unfolded within a first angle range, the controller 180 may display a first mode wallpaper (eg, a wallpaper in a laptop mode) on the display unit 115 .

[0156] exist Figure 8 In operation S904, the controller 180 of the foldable device 100 may determine that the unfolded angle of the foldable device 100 is within the second angle range. In operation S905, the controller 180 may display the second mode wallpaper on the display unit 115.

[0157] For example, Figure 9B As shown in , when the unfolded angle of the foldable device 100 is within the second angle range (e.g., from 130° to 180°), the controller 180 may display an icon i15-1 moved to a position corresponding to the second angle range on the display unit 115. Figure 9B As shown in , when the foldable device 100 is unfolded within the second angle range, the controller 180 may display a second mode wallpaper (eg, wallpaper in tablet mode) on the display unit 115 .

[0158] According to an exemplary embodiment, the foldable device 100 determines an unfolded angle range to selectively execute one of a plurality of different modes (eg, a laptop mode and a tablet mode), but is not limited thereto.

[0159] According to an exemplary embodiment, the foldable device 100 may perform a laptop mode when the unfolded angle is within a first angle range, and perform a tablet mode when the unfolded angle is within a second angle range.

[0160] Figure 10 is a flowchart illustrating user authentication using biometric information according to an exemplary embodiment.

[0161] According to an exemplary embodiment, the foldable device 100 can be released from a locked state by performing user authentication when the foldable device 100 is unfolded. The foldable device 100 can perform user authentication using the user's biometric information (e.g., fingerprint information or iris information). The biometric information identifier 195 for obtaining biometric information can be executed when the unfolding operation of the foldable device 100 is recognized. Therefore, the user can recognize that the user authentication is being performed while the foldable device 100 is being unfolded.

[0162] Biometric information is not limited to fingerprint information and iris information, and may include voice information, facial information, palm print information, blood vessel distribution information, retinal information, movement pattern information (such as gait information), ECG information, and / or palm print information.

[0163] exist Figure 10 In operation S1101, the controller 180 of the foldable device 100 may detect an operation of unfolding the foldable device 100 through the sensing unit 140. In operation S1102, the foldable device 100 may activate the biometric information recognizer 195 and perform user authentication by using biometric information obtained by the biometric information recognizer 195.

[0164] According to an exemplary embodiment, the controller 180 may perform user authentication by comparing pre-stored fingerprint information and / or pre-stored iris information according to user identification (ID) information with currently obtained fingerprint information and / or currently obtained iris information.

[0165] exist Figure 10 In operation S1103 , when the unfolded angle of the foldable device 100 is at least the first angle, the display unit 115 is activated and an interface indicating that user authentication is being performed may be displayed on the display unit 115 .

[0166] For example, Figure 12 As shown in , when fingerprint authentication is being performed, the fingerprint image i16 may be displayed on the display unit 115 and may move on the display unit 115 until fingerprint recognition is completed.

[0167] In addition, if Figure 13 As shown in , when fingerprint authentication and iris authentication are performed, fingerprint image i17 and iris image i18 may be displayed on the display unit 115. The controller 180 may display the fingerprint image i17 and iris image i18 as a moving image until the fingerprint authentication and iris authentication are completed.

[0168] exist Figure 10 In operation S1104, the controller 180 of the foldable device 100 may determine whether user authentication has succeeded. If it is determined that user authentication has succeeded, in operation S1105, the controller 180 may release the display unit 115 from the locked state and activate the touch panel 117. In operation S1106, the controller 180 may display a preset wallpaper on the display unit 115.

[0169] For example, Figure 12 As shown in , wallpapers preset to be displayed in an unlocked state may be displayed on the display unit 115 .

[0170] When it is determined in operation S1104 that the user authentication is unsuccessful, the controller 180 of the foldable device 100 may maintain the locked state of the display unit 115 in operation S1107.

[0171] For example, the controller 180 may maintain the locked state and display a screen indicating that the biometric information does not match on the display unit 115. In addition, the controller 180 may display a screen requesting user authentication again or a screen requesting input of a pre-stored password on the display unit 115.

[0172] Figure 11A and Figure 11B 1 is a diagram showing an arrangement position of a biometric information identifier 195 according to one or more exemplary embodiments. The biometric information identifier 195 may include the Figure 3 The fingerprint recognition sensor 196 and iris recognition camera 197 are depicted.

[0173] According to an exemplary embodiment, the foldable device 100 may be symmetrical ( Figure 11A ) or asymmetric ( Figure 11B ).

[0174] The biometric information identifier 195 may be disposed in the foldable device 100 in any of various forms.

[0175] Reference Figure 11A , the biometric information identifier 195 may be disposed on the lower housing rear surface 51 of the device area disposed below when the foldable device 100 is folded.

[0176] For example, when the fingerprint recognition sensor 196 is provided on the lower housing rear surface 51, the foldable device 100 can be unfolded while the user's index finger is touching the lower housing rear surface 51. In this case, the user can unfold the foldable device 100 to perform user authentication while leaving the display unit 115 out of the locked state.

[0177] Alternatively, the biometric information identifier 195 may be disposed on the lower housing side surface 52 of the device area disposed below when the foldable device is folded. For example, when the fingerprint recognition sensor 196 is disposed on the lower housing side surface 52, the foldable device 100 can be unfolded when the user's thumb touches the lower housing side surface 52.

[0178] Alternatively, the biometric information identifier 195 may be disposed on the lower housing side upper surface 53, which is the device area disposed below when the foldable device 100 is folded. For example, when the fingerprint recognition sensor 196 is disposed on the lower housing side upper surface 53, the foldable device 100 may be unfolded when the user's index finger touches the lower housing side upper surface 53.

[0179] Alternatively, the biometric information recognizer 195 may be disposed on the upper housing rear surface 54 of the device area disposed above when the foldable device 100 is folded. For example, an iris recognition camera 197 may be provided on the upper housing rear surface 54.

[0180] like Figure 11B The asymmetric foldable device 100 shown in FIG. Figure 11A The symmetrical foldable device 100 shown in FIG. 1 includes a biometric information identifier 195 at a corresponding position.

[0181] Furthermore, when the foldable device 100 is asymmetrical, the biometric information identifier 195 may be disposed on the lower region 61 of the lower housing upper surface, which is the region of the device disposed downward when the foldable device 100 is folded. For example, when the fingerprint recognition sensor 196 is disposed on the lower region 61 of the lower housing upper surface, the foldable device 100 may be unfolded when the user's thumb contacts the lower region 61 of the lower housing upper surface. Furthermore, the fingerprint recognition sensor 196 may operate even when the foldable device is folded.

[0182] The biometric information identifier 195 may be disposed on the lower housing upper surface side area 62, which is the device area disposed below when the foldable device 100 is folded. For example, when the fingerprint recognition sensor 196 is disposed on the lower housing upper surface side area 63, the foldable device 100 can be unfolded when the user's thumb touches the lower housing upper surface side area 62. The fingerprint recognition sensor 196 can operate even when the foldable device 100 is folded.

[0183] The biometric information recognizer 195 may be disposed on the lower housing upper surface upper region 63 of the device region disposed below when the foldable device 100 is folded.

[0184] For example, when the iris recognition camera 197 is disposed on the upper area 63 of the lower housing upper surface, an image of the user's eyes can be obtained through the iris recognition camera 197 when the user holds and unfolds the foldable device 100. The iris recognition camera 197 can operate even when the foldable device 100 is folded.

[0185] When the iris recognition camera 197 is disposed on the lower housing upper surface upper area 63 of the foldable device 100 , an image of the user's eyes may be obtained through the iris recognition camera 197 when the user unfolds the foldable device 100 by at least a predetermined angle. Figure 14 An example is shown in which the iris recognition camera 197 is arranged on the upper area s4 of the lower housing upper surface.

[0186] When the fingerprint recognition sensor 196 is arranged on the lower housing upper surface upper area 63, the foldable device 100 can be unfolded when the user's thumb contacts the lower housing upper surface upper area 63. In addition, the foldable device 100 can operate even when the foldable device 100 is folded.

[0187] The biometric information recognizer 195 may be disposed on the inner side of the lower housing display surface 64 exposed from a device region disposed below when the foldable device 100 is folded.

[0188] For example, when the fingerprint recognition sensor 196 is disposed on the lower housing display surface 64, the foldable device 100 can be unfolded when the user's thumb contacts the lower housing display surface 64. The fingerprint recognition sensor 196 can operate even when the foldable device 100 is folded.

[0189] Figures 12 to 18 is a diagram illustrating user authentication using biometric information according to one or more exemplary embodiments.

[0190] Figure 12 The fingerprint recognition sensor 196 is shown to be arranged on the lower housing side surface s1 (ie, Figure 11A Example on the lower shell side surface 52).

[0191] For example, when the user holds and unfolds the foldable device 100 , the user's thumb may contact the fingerprint recognition sensor 196 to operate the fingerprint recognition sensor 196 .

[0192] Reference Figure 12 , when the foldable device 100 is unfolded by at least a predetermined angle, the display unit 115 is activated and a fingerprint image i16 indicating that fingerprint recognition is being performed may be displayed on the display unit 115. The controller 180 may display the fingerprint image i16 as a moving image until user authentication is completed.

[0193] Reference Figure 12 On the right side, when fingerprint recognition has succeeded when the foldable device 100 is unfolded by at least a predetermined angle, the foldable device 100 may be released from the locked state and a preset wallpaper may be displayed.

[0194] Figure 13 The iris recognition camera 197 is shown to be arranged on the upper area s3 (ie, Figure 11B In addition, the fingerprint recognition sensor 196 is arranged on the lower shell display surface s2 (ie, Figure 11B on the lower housing display surface 64).

[0195] Before or while the user unfolds the foldable device 100, the user's finger may contact the fingerprint recognition sensor 196 (i.e., the lower housing display surface s2), and the fingerprint recognition sensor 196 may be activated. In addition, before or while the user unfolds the foldable device 100, the user's eye image may be obtained by the iris recognition camera 197 on the upper area s3 of the lower housing upper surface.

[0196] Reference Figure 13When the foldable device 100 is unfolded by at least a predetermined angle, the display unit 11 is activated, and a fingerprint image i17 indicating that fingerprint recognition is being performed and an iris image i18 indicating that iris recognition is being performed may be displayed on the display unit 115. The controller 180 may display the fingerprint image i17 and the iris image i18 as a moving image until user authentication is completed.

[0197] Reference Figure 13 , when it is determined that user authentication has succeeded through fingerprint recognition and iris recognition when the foldable device 100 is unfolded within a predetermined angle range, the foldable device 100 is released from the locked state and a preset wallpaper can be displayed.

[0198] Figure 14 An example is shown in which the iris recognition camera 197 is arranged on the upper area s4 of the lower housing upper surface.

[0199] For example, when the iris recognition camera 197 is disposed on an upper region s4 of the lower housing upper surface of the foldable device 100, the iris recognition camera 197 can obtain an eye image of the user when the foldable device 100 is unfolded by at least a predetermined angle.

[0200] Figure 15 An example is shown in which the fingerprint recognition sensor 197 is arranged in the edge display surface s5.

[0201] like Figure 15 As shown in , the edge display surface s5 may be provided at one corner surface of the foldable device 100 and may be exposed even when the foldable device 100 is folded and / or unfolded. The edge display surface s5 may be a display area provided on an extension line of the display surface exposed to the outside when the foldable device 100 is unfolded and bent by at least a predetermined angle.

[0202] For example, when the fingerprint recognition sensor 196 is provided on the edge display surface s5 , the foldable device 100 may be unfolded when the user's thumb contacts the fingerprint recognition sensor 196 on the edge display surface s5 .

[0203] Furthermore, the fingerprint recognition sensor 196 may operate even when the foldable device 100 is folded.

[0204] like Figure 15 As shown in , when it is determined that user authentication has succeeded through fingerprint recognition when the foldable device 100 is unfolded within a predetermined angle range, the foldable device 100 is released from the locked state and a preset wallpaper may be displayed.

[0205] Figure 16 The iris recognition camera 197 is shown to be disposed on the rear surface s7 (ie, Figure 11AIn addition, the fingerprint recognition sensor 196 may be arranged on the side area s6 (ie, the rear surface 54 of the upper shell) of the foldable device 100. Figure 11B On the side area 62 of the lower shell upper surface).

[0206] According to an exemplary embodiment, user authentication may be performed while the foldable device 100 is folded. For example, fingerprint authentication may be performed when the user touches a finger on the fingerprint recognition sensor 196 while the foldable device 100 is folded. Here, the foldable device 100 may obtain an eye image of the user through the iris recognition camera 197 and perform iris authentication.

[0207] The controller 180 may display images i21 and i22 indicating that user authentication is being performed on the display unit 115 exposed when the foldable device 100 is folded. The controller 180 may display images i21 and i22 as moving images until user authentication is completed.

[0208] Figure 17 and Figure 18 An example is shown in which the display unit 115 exposed when the foldable device 100 is folded is released from a locked state through user authentication.

[0209] exist Figure 17 In the embodiment, the iris recognition camera 197 is arranged on the upper area s9 ( Figure 11B In addition, the fingerprint recognition sensor 196 may be arranged in the lower area s8 (ie, the upper area s8 of the lower shell surface of the foldable device 100). Figure 11B On the lower area 61 of the upper surface of the lower shell.

[0210] Reference Figure 17 , the button k1 (eg, a home key or a power key) may be disposed on a lower area of ​​the upper surface of the lower housing of the foldable device 100 (ie, Figure 11B In this case, the user can press button k1 to activate the display area of ​​the display unit 115 that is exposed when the foldable device 100 is folded. In addition, the user's finger can touch button k1 to activate the fingerprint recognition sensor 196 arranged in the same position.

[0211] Reference Figure 18 The foldable device 100 may receive an input of the power key k2 to activate the display area of ​​the display unit 115 that is exposed when the foldable device 100 is folded. In addition, the user's finger may contact the fingerprint recognition sensor s10 to perform fingerprint recognition.

[0212] like Figure 17 and Figure 18 As shown in , when it is determined that user authentication has succeeded by using fingerprint recognition and iris recognition, the foldable device 100 releases the display area from the locked state and displays an interface that is previously set to be displayed in the unlocked state.

[0213] Figures 19 to 21 1 is a diagram illustrating an example of releasing the display unit 115 from a locked state when the foldable device 100 is unfolded, according to one or more exemplary embodiments.

[0214] According to an exemplary embodiment, the foldable decoration 100 may be implemented as a rollable device. Figure 19 As shown in , a foldable device 100 may include a rollable display and a housing area, wherein the rollable display is rolled into the housing area.

[0215] The foldable device 100 may be unfolded when a user pulls the rollable display rolled into the housing area. As another example, the foldable device 100 may be unfolded according to a user input of pressing a button provided on the foldable device 100.

[0216] Reference Figure 19 , when the foldable device 100 is unfolded as the rollable display rolled into the housing area is pulled, the display unit 115 can be released from the locked state.

[0217] According to an exemplary embodiment, when the user unfolds the foldable device 100 to use the foldable device 100, the display unit 115 can be quickly and conveniently released from the locked state without having to perform a separate input (e.g., password input or pattern input) for releasing the display unit 115 from the locked state.

[0218] Figure 20 and Figure 21 An example is shown in which the display unit 115 is released from the locked state when user authentication is performed by using biometric information while the foldable device is unfolded.

[0219] According to an exemplary embodiment, the foldable device 100 may include a biometric information identifier 195. The biometric information identifier 195 may include the above-mentioned Figure 3 The fingerprint recognition sensor 196 and the iris recognition sensor 197 are described.

[0220] The biometric information recognizer 195 may be used during the unfolding operation of the foldable device 100. Therefore, the user may recognize that user authentication is performed while the foldable device 100 is unfolded.

[0221] Figure 20 and Figure 21An arrangement example of the biometric information recognizer 195 is shown, but exemplary embodiments are not limited thereto.

[0222] Reference Figure 20 The fingerprint recognition sensor 196 may be arranged at a location where a user's finger contacts the foldable device 100 by pulling the display area. For example, the fingerprint recognition sensor 196 on the surface s13 may be located at an area on the housing of the foldable device 100 that a finger contacts to unfold the foldable device 100, or inside a display provided on the housing. The fingerprint recognition sensor 196 may be arranged on a bezel area s14 of the display that is rolled into the housing.

[0223] Before the user unfolds the foldable device 100 or while the user unfolds the foldable device 100 , when the user's finger contacts the fingerprint recognition sensor 196 , the fingerprint recognition sensor 196 may be activated.

[0224] The controller 180 may display an image i24 indicating that user authentication is being performed on the display unit 115 provided on the housing, which is exposed when the foldable device 100 is rolled. The controller 180 may display the image i24 as a moving image until user authentication is completed.

[0225] Reference Figure 20 , when it is determined that fingerprint authentication has succeeded while the foldable device 100 is unfolded, the foldable device 100 is released from the locked state and a preset wallpaper may be displayed.

[0226] Reference Figure 21 , the iris recognition camera 197 on the surface s16 can be arranged in the upper area of ​​the housing.

[0227] According to an exemplary embodiment, the iris recognition camera 197 may be activated when the user unfolds the foldable device 100. When the foldable device 100 is unfolded, the iris recognition camera 197 may obtain an eye image of the user and iris recognition may be performed according to the control of the controller 180.

[0228] As another example, when the foldable device 100 is unfolded when the user presses a button provided on the foldable device 100 , the iris recognition camera 197 on the surface s16 may be activated when the button is pressed.

[0229] The controller 180 may display an image i25 indicating that user authentication is being performed on the display unit 115 provided on the housing that is exposed when the foldable device 100 is rolled. The controller 180 may display the image i25 as a moving image until user authentication is completed.

[0230] Reference Figure 21, when it is determined that iris authentication has succeeded while the foldable device 100 is unfolded, the foldable device 100 is released from the locked state and a preset wallpaper may be displayed.

[0231] The exemplary embodiments described above are merely examples and not limitations. In addition, according to one or more exemplary embodiments, the order in which operations are performed is not limited, some operations may be omitted, or at least one operation may be added.

[0232] The exemplary embodiments can also be implemented in the form of a computer-readable recording medium (such as a program module executed by a computer). A computer-readable recording medium can be an available medium that can be accessed by a computer, and examples of computer-readable recording media include all volatile and non-volatile media and separable and inseparable media. In addition, examples of computer-readable recording media may include computer storage media and communication media. Examples of computer-readable recording media may include all volatile and non-volatile media and separable and inseparable media that have been implemented by methods or technologies for storing information (such as computer-readable commands, data instructions, program modules, and other data). Communication media may include computer-readable commands, data structures, program modules, other data of modulated data signals, or another transmission mechanism, and examples of communication media include information transmission media.

[0233] Furthermore, the “unit” may be a hardware component (such as a processor and / or a circuit) and / or a software component executed by a hardware component (such as a processor).

[0234] While one or more exemplary embodiments have been shown and described, it will be understood that various changes in form and detail may be made herein without departing from the spirit and scope of the inventive concept as defined by the claims. It will be understood that the exemplary embodiments described above are not intended to be limiting. For example, each component described as being of a single type may be executed in a distributed manner, and components described as being distributed may also be executed in an integrated form.

[0235] The scope of the inventive concept is indicated by the claims to be described below rather than the detailed description, and it should be understood that the claims and all modifications or modified forms derived from the concept of the claims are included in the scope of the inventive concept.

Claims

1. Electronic devices, including: case; a flexible display configured to unfold from the housing; a first sensor configured to detect whether the flexible display is unfolded from the housing; a second sensor configured to detect biometric information of a user; At least one processor configured to: In response to the first sensor detecting that the flexible display is unfolded, authenticating the user based on biometric information detected by the second sensor; When the flexible display is unfolded, controlling the flexible display to display information indicating that user authentication is in progress on the flexible display exposed on the housing; Based on the user being authenticated, the flexible display is controlled to provide an unlocking screen.

2. The electronic device according to claim 1, wherein The processor is further configured to: When the flexible display is rolled into the housing, acquiring biometric information through the second sensor; and In a state where the flexible display remains rolled up in the housing, user authentication is performed based on the biometric information.

3. The electronic device according to claim 1, wherein: The at least one processor is further configured to control the flexible display to release the locked state of the electronic device and provide the unlocking screen based on the user being authenticated based on the biometric information detected by the second sensor.

4. The electronic device according to claim 1, wherein The processor is further configured to control the flexible display to provide a lock screen based on the user failing to be authenticated through biometric information and the flexible display being unfolded from the housing.

5. The electronic device according to claim 1, wherein The second sensor is located on the frame of the housing.

6. The electronic device according to claim 1, wherein The second sensor includes at least one of a fingerprint recognition sensor that senses fingerprint information of a user or an iris recognition sensor that senses iris information of the user.

7. The electronic device according to claim 1, wherein: The processor is further configured to, in response to the flexible display being partially unfolded to a predetermined extent less than fully unfolded, control the flexible display to display information indicating that user authentication is in progress.

8. The electronic device according to claim 7, wherein: The information indicating that user authentication is in progress includes an image that changes as the degree of unfolding of the flexible display increases.

9. The electronic device according to claim 7, wherein: The information indicating that user authentication is in progress includes an image corresponding to biometric information required for the user authentication.

10. The electronic device according to claim 1, wherein The unlock screen is the background screen, The lock screen is one of the following screens: a screen indicating that user information does not match, a screen requesting user authentication again, and a screen requesting input of a pre-stored password.

11. A method for controlling an electronic device, the electronic device comprising a flexible display deployed from a housing, the method comprising: detecting, by a first sensor, that the flexible display is unfolded from the housing; In response to the first sensor detecting that the flexible display is unfolded, authenticating the user based on biometric information detected by the second sensor; When the flexible display is unfolded, controlling the flexible display to display information indicating that user authentication is in progress on the flexible display exposed on the housing; Based on the user being authenticated, the flexible display is controlled to provide an unlocking screen.

12. The method of claim 11, further comprising: When the flexible display is rolled into the housing, biometric information is acquired through the second sensor; as well as In a state where the flexible display remains rolled up in the housing, user authentication is performed based on the biometric information.

13. The method of claim 11, further comprising: Based on the user passing the authentication based on the biometric information detected by the second sensor, the lock state of the electronic device is released and the unlock screen is provided.

14. The method of claim 11, further comprising: Based on the user failing to be authenticated through biometric information and the flexible display being unfolded from the housing, the flexible display is controlled to provide a lock screen.

15. The method of claim 11, wherein: The second sensor is located on the frame of the housing.