Electronic device including flexible display and method for providing replay service thereof

Abstract

A multi-foldable electronic device according to an embodiment may be configured to: play a video via the second display in a state in which a first housing, a second housing, and a third housing are all folded; while playing the video via a cover display of the electronic device, identify a first point in time, at which at least one of a first angle between the first housing and the second housing or a second angle between the second housing and the third housing becomes equal to or greater than a first threshold angle value, on the basis of data received from the at least one sensor; on the basis of identifying the first point in time, start a timer and record the video being played on the cover display; terminate the timer and stop recording the video on the basis of identifying a second point in time at which the first angle and the second angle become equal to or greater than a second threshold angle value; generate replay images on the basis of images recorded from the first point in time to the second point in time; continue playing the video on the internal display on the basis of all of the first housing, the second housing, and the third housing being switched to an unfolded state; and display at least one of the replay images or an indicator for guiding the replay on at least a portion of the video.

Description

Electronic device including a flexible display and a method for providing a replay service thereof

[0001] The present invention relates to an electronic device including a flexible display and a method for providing a part of the same's replay service.

[0002] Electronic devices are evolving away from uniform shapes to expand displays or improve display usability. Electronic devices can have a deformable structure that is portable and allows for the use of large-screen displays.

[0003] As part of a deformable structure, the electronic device may have a structure (e.g., a foldable structure) capable of varying the display area of ​​a flexible display through at least two housing structures rotatably coupled to each other.

[0004] The information described above may be provided as related art for the purpose of aiding understanding of the present disclosure. No claim or determination is made as to whether any of the foregoing may be applied as prior art related to the present disclosure.

[0005] An electronic device including a flexible display can perform switching of a screen or display that displays visual information (e.g., content playback, application execution screen) according to a change in the state of the housing structure (e.g., unfolding / folding, folding / closing, expanding / shrinking, etc.).

[0006] An electronic device with a foldable structure may include a first display positioned on the front of the electronic device and a second display positioned on the back of the electronic device. When the foldable electronic device changes from an unfolded state to a closed state or vice versa, it supports an app continuity service that allows an application being used by a user to be displayed seamlessly through an internal display (e.g., a first display) and a cover display (e.g., a second display).

[0007] For example, a user can watch a live video on the cover display while it is folded, and then continue watching it on the internal display without interruption even after changing the electronic device to the unfolded state.

[0008] However, because electronic devices with a foldable structure take a certain amount of time to change from an unfolded state to a folded state, users may miss parts of the video they are watching during the screen transition. In particular, for multi-foldable devices that fold a flexible display twice, the time required to change the structure may be relatively longer than for foldable devices with a single-fold structure. For example, while a user is watching a sports video on the cover display and unfolds the foldable structure, they may miss important parts such as goal scenes.

[0009] Various embodiments propose a method, device, and recording medium that allow a portion of content that momentarily disappears from the user's field of vision to be viewed again while the housing structure state of an electronic device including a flexible display is changed.

[0010] The problems to be solved in this disclosure are not limited to those mentioned above, and may be extended in various ways without departing from the spirit and scope of this disclosure.

[0011] An electronic device according to one embodiment may include a flexible display. An electronic device according to one embodiment may include a processor. An electronic device according to one embodiment may include a memory that stores executable instructions by the processor.

[0012] An electronic device according to one embodiment may include a first housing, a second housing, and a third housing. An electronic device according to one embodiment may include a first hinge assembly configured to connect the first housing to one side of the second housing and allow the second housing to rotate relative to the second housing, and a second hinge assembly configured to connect the third housing to the other side of the third housing and allow the third housing to rotate. An electronic device according to one embodiment may include a first display comprising a first display area disposed in the first housing, a second display area disposed in the second housing, and a third display area disposed in the third housing. An electronic device according to one embodiment may include a second display disposed in any one of the first housing, the second housing, and the third housing, and disposed in a direction opposite to the first display area, the second display area, and the third display area. An electronic device according to one embodiment may include at least one sensor. An electronic device according to one embodiment may include a memory that stores executable instructions. An electronic device according to one embodiment may include a processor that accesses the memory and executes the instructions.Commands according to one embodiment may enable the electronic device to play a video through the second display while the first housing, the second housing, and the third housing are all folded, and to play a video through the cover display of the electronic device, and to recognize a first point in time when at least one of the first angle between the first housing and the second housing, or the second angle between the second housing and the third housing, increases to a first threshold angle value or greater based on data received from at least one sensor, to start a timer and record the video being played on the cover display based on the recognition of the first point in time, to end the timer and end the recording of the video based on the recognition of a second point in time when the first angle and the second angle increase to a second threshold angle value or greater, to generate replay videos based on the video recorded from the first point in time to the second point in time, to continue playing the video on the internal display while the first housing, the second housing, and the third housing are all unfolded, and to display at least one of the replay videos and an indicator guiding replay on at least a part of the video.

[0013] A method for providing a replay service for an electronic device according to one embodiment may include an operation of playing a video through a second display disposed on the rear of the electronic device while the first housing, the second housing, and the third housing are all folded. A method according to one embodiment may include an operation of recognizing a first point in time when at least one of a first angle between the first housing and the second housing, or a second angle between the second housing and the third housing, increases by more than a first threshold angle value, based on data received from at least one sensor while playing a video through the second display. A method according to one embodiment may include an operation of starting a timer and recording the video being played on the second display based on the recognition of the first point in time. A method according to one embodiment may include an operation of ending the timer and ending the recording of the video based on the recognition of a second point in time when the first angle and the second angle increase by more than a second threshold angle value. A method according to one embodiment may include an operation of generating replay videos based on the recorded video. A method according to one embodiment may include the operation of continuing to play the video on the first display based on the fact that the first housing, the second housing, and the third housing are all switched to an unfolded state, and displaying at least one of replay videos and an indicator guiding replay on at least a part of the video.

[0014] A non-transitory computer-readable medium storing instructions according to one embodiment of the present disclosure, wherein, when executed by a processor of an electronic device, the electronic device performs operations, and, in a first state, the structural state of the first housing, the second housing, and the third housing, the operation of playing a video through a second display disposed on the rear of the electronic device; the operation of recognizing a first point in time when at least one of a first angle between the first housing and the second housing, or a second angle between the second housing and the third housing, increases above a first threshold angle value based on data received from at least one sensor while playing the video through the second display; the operation of starting a timer and recording the video being played on the second display based on the recognition of the first point in time; the operation of ending the timer and ending the recording of the video based on the recognition of a second point in time when the first angle and the second angle increase above a second threshold angle value; and the operation of generating replay videos based on the video recorded from the first point in time to the second point in time. The operation may include, based on the structural state of the first housing, the second housing, and the third housing being switched to a second state, continuing to play the video on a first display positioned on the front of the electronic device, and displaying at least one of replay videos and an indicator guiding replay on at least a portion of the video being played on the first display.

[0015] Various embodiments may provide a service to the user to rewatch missed parts by partially recording the video being played without temporarily pausing while changing from an unfolded state to a folded state or from a folded state to an unfolded state of an electronic device (or housing structure).

[0016] The effects obtainable from the present disclosure are not limited to those mentioned above, and other unmentioned effects will be clearly understood by those skilled in the art to which the present disclosure belongs from the description below.

[0017] FIG. 1 is a block diagram of an electronic device in a network environment according to one embodiment.

[0018] FIG. 2 is a drawing illustrating examples of electronic devices including flexible displays according to various embodiments.

[0019] FIGS. 3a to 3d are drawings for explaining a multi-foldable housing structure according to one embodiment.

[0020] FIGS. 4a and 4b illustrate drawings for explaining the state of an electronic device of a multi-foldable structure according to one embodiment.

[0021] FIG. 5 illustrates a method for providing a replay service of an electronic device including a flexible display according to one embodiment.

[0022] FIGS. 6a and 6b illustrate screens that provide a replay service for a portion of a running screen based on a change in the housing state in an electronic device according to one embodiment.

[0023] FIG. 7 illustrates screens that provide a replay service for a portion of a running screen based on a change in the housing state in an electronic device according to one embodiment.

[0024] FIG. 8 illustrates screens that provide a replay service for a portion of a running screen based on a change in the housing state in an electronic device according to one embodiment.

[0025] FIG. 9 illustrates screens that provide a replay service for a portion of a running screen based on a change in the housing state in an electronic device according to one embodiment.

[0026] FIG. 10 illustrates screens that provide a replay service for a portion of a running screen based on a change in the housing state in an electronic device according to one embodiment.

[0027] FIGS. 11a and 11b illustrate screens that provide a replay service for a portion of a running screen based on a change in the housing state in an electronic device according to one embodiment.

[0028] Each of the embodiments described with reference to the drawings of the present disclosure may be configured independently as a single embodiment. Each of the embodiments described with reference to the drawings of the present disclosure may operate independently as a single embodiment. At least two of the embodiments described with reference to the drawings of the present disclosure may be configured by combining. At least two of the embodiments described with reference to the drawings of the present disclosure may operate by combining. For example, at least a part of the embodiment of FIG. 1 and at least a part of the embodiment of FIG. 2 may operate by combining with each other.

[0029] When at least two of the embodiments described with reference to the drawings of the present disclosure are combined, at least some of the configurations and / or at least some operations included in each embodiment may be omitted.

[0030] FIG. 1 is a block diagram of an electronic device in a network environment according to one embodiment.

[0031] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) through a first network (198) (e.g., a short-range wireless communication network) or with at least one of an electronic device (104) or a server (108) through a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) through a server (108). According to one embodiment, the electronic device (101) may include a processor (120), memory (130), input module (150), sound output module (155), display module (160) (or display), audio module (170), sensor module (176), interface (177), connection terminal (178), haptic module (179), camera module (180), power management module (188), battery (189), communication module (190), subscriber identification module (196), or antenna module (197). In some embodiments, at least one of these components (e.g., connection terminal (178)) may be omitted from the electronic device (101), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (176), camera module (180), or antenna module (197)) may be integrated into a single component (e.g., display module (160)).

[0032] The processor (120) includes at least one processing circuitry, and the at least one processing circuitry can control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) by executing software (e.g., a program (140)), and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (120) can store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store the resulting data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) that can operate independently or together with it (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device (101) includes a main processor (121) and an auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a designated function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as part thereof.

[0033] The auxiliary processor (123) may control at least some of the functions or states associated with at least one component of the electronic device (101) (e.g., display module (160), sensor module (176), or communication module (190)) on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (123) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (180) or communication module (190)). According to one embodiment, the auxiliary processor (123) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (101) itself where the artificial intelligence is performed, or through a separate server (e.g., server (108)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.

[0034] Memory (130) can store various data used by at least one component of the electronic device (101) (e.g., processor (120) or sensor module (176)). The data may include, for example, software (e.g., program (140)) and input or output data for related instructions. Memory (130) may include volatile memory (132) or non-volatile memory (134). Memory (130) can store instructions executable by the processor (120) or the electronic device (101).

[0035] The program (140) may be stored as software in memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0036] The input module (150) can receive commands or data to be used for a component of the electronic device (101) (e.g., processor (120)) from outside the electronic device (101) (e.g., user). The input module (150) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0037] The sound output module (155) can output a sound signal to the outside of the electronic device (101). The sound output module (155) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.

[0038] A display module (160) (or a display) can visually provide information to an external (e.g., user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.

[0039] The audio module (170) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150) or output sound through the sound output module (155) or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (101).

[0040] The sensor module (176) may include at least one sensor. The sensor module (176) may detect the operating state of the electronic device (101) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (176) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0041] The interface (177) may support one or more specified protocols that can be used for the electronic device (101) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (102)). According to one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0042] The connection terminal (178) may include a connector through which the electronic device (101) can be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0043] The haptic module (179) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that can be perceived by the user through tactile or kinesthetic senses. According to one embodiment, the haptic module (179) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.

[0044] The camera module (180) includes at least one camera and can capture still images and video. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0045] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).

[0046] The battery (189) can supply power to at least one component of the electronic device (101). According to one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0047] A communication module (190) may include at least one communication circuit and may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may include one or more communication processors that operate independently of a processor (120) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (194) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (104) through a first network (198) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (199) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can identify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (196).

[0048] The wireless communication module (192) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (192) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (192) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), external electronic device (e.g., electronic device (104)), or network system (e.g., second network (199)). According to one embodiment, the wireless communication module (192) may support a Peak data rate (e.g., 20 Gbps or more) for eMBB realization, loss coverage (e.g., 164 dB or less) for mMTC realization, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for URLLC realization.

[0049] An antenna module (197) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (198) or a second network (199), may be selected from the plurality of antennas, for example, by a communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (197).

[0050] According to one embodiment, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.

[0051] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.

[0052] According to one embodiment, commands or data may be transmitted or received between an electronic device (101) and an external electronic device (104) through a server (108) connected to a second network (199). Each of the external electronic devices (102, or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations performed on the electronic device (101) may be performed on one or more of the external electronic devices (102, 104, or 108). For example, if the electronic device (101) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (101) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (101) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or neural networks. According to one embodiment, the external electronic device (104) or the server (108) may be included within a second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0053] The electronic device according to the embodiments disclosed in this document may be of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The electronic device according to the embodiments of this document is not limited to the devices described above.

[0054] In the description of the electronic device (101) according to the various embodiments disclosed below, the same reference number is assigned to components that are substantially identical to the configuration disclosed in FIG. 1 above, and redundant descriptions of their functions may be omitted.

[0055] FIG. 2 is a drawing illustrating examples of electronic devices including flexible displays according to various embodiments.

[0056] Referring to FIG. 2, an electronic device (101) according to one embodiment may include a flexible display. FIG. 2 may illustrate examples of various form factors of an electronic device (101) including a flexible display. For example, the electronic device (101) may include various form factors such as a foldable (210 or 220), a multi-foldable (230) or / and a rollable (250) (or slidable). The electronic device (101) may be implemented in various forms, and depending on the implementation form of the electronic device (101), at least one display may be provided in various ways.

[0057] A foldable electronic device (210 or 220) according to one embodiment may mean an electronic device in which a flexible display can be changed to an unfolded state or a folded state with respect to one folding axis. For example, the foldable electronic device (210 or 220) illustrated in FIG. 2 illustrates an example implemented in an in-folding manner (e.g., a method in which a first display area and a second display area of ​​the display face each other with respect to the folding axis), but is not limited thereto, and may also be implemented in an out-folding manner (e.g., a method in which a first display area and a second display area of ​​the display are arranged on opposite sides with respect to the folding axis).

[0058] A multi-foldable electronic device (230) according to one embodiment may mean an electronic device in which a display can be changed to an unfolded or folded state in an in / out folding manner with respect to two folding axes. The multi-foldable electronic device (230) illustrated in FIG. 2 illustrates an example in which the first folding axis is implemented in an in-folding manner and the second folding axis is implemented in an out-folding manner, but is not limited thereto, and the second folding axes may all be implemented in an in-folding manner.

[0059] A rollable electronic device (240) (or slideable electronic device) according to one embodiment may mean an electronic device in which at least a portion of a flexible display can be wound or rolled or stored inside a housing (not shown). Depending on the user's needs, the rollable electronic device (240) can be used to expand the display area by changing the flexible display to an unfolded (e.g., slide-out) state to expose a larger area of ​​the display to the outside.

[0060] The embodiments described below may be applied to an electronic device (101) including a flexible display implemented in various form factors as shown in FIG. 2.

[0061] In this disclosure, an electronic device (101) having a multi-foldable structure is described as an example, but is not limited thereto, and includes a first display (or main display, internal display) disposed on the front of the electronic device and a second display (or sub display, cover display) disposed on the rear of the electronic device.

[0062] In the present disclosure, the surface on which the first display is placed (e.g., the first direction (①)) may be defined as the front of the electronic device (101). The surface on which the second display is placed (e.g., the second direction (②)) as the opposite side of the front may be defined as the rear of the electronic device (101). Additionally, the surface surrounding the space between the front and the rear may be defined as the side of the electronic device (101). Hereinafter, the term “state” may refer to the structural form, shape, or form of the electronic device (101) or its components (e.g., display, foldable housing structure) according to an embodiment of the present disclosure.

[0063] FIGS. 3a to 3d are drawings for explaining a multi-foldable housing structure according to one embodiment. <301> is a front perspective view of the electronic device in a fully unfolded state, and <302> This is a rear perspective view in the unfolded state.

[0064] Referring to FIGS. 3a to 3d, an electronic device (101) (e.g., portable communication device) having a multi-foldable housing structure according to one embodiment may include a first housing (310), a second housing (320), a third housing (330), a first hinge assembly (340), a second hinge assembly (345), a plurality of sensors (351, 352), a first display (360), a second display (370), and a plurality of cameras (381, 382, ​​383, 384, 385).

[0065] The electronic device (101) includes at least some of the configurations and functions of the electronic device (101) shown in FIG. 1, and the configuration disclosed in FIG. 1 may be omitted, or a configuration not disclosed in FIG. 1 may be added.

[0066] The first hinge assembly (340) may be configured to combine the first housing (310) and the second housing (320) and to allow the first housing (310) to rotate relative to the second housing (320). The second hinge assembly (345) may be configured to combine the second housing (320) and the third housing (330) and to allow the third housing (330) to rotate relative to the second housing (320). Both the first hinge assembly (340) and the second hinge assembly (345) may be implemented in an in-folding manner.

[0067] The first display (360) and the second display (370) can be placed within the space formed by the first housing (310), the second housing (320), and the third housing (330).

[0068] The first display (or, internal display, main display, front display) (360) is <301> As illustrated, it may be visually exposed through the front of the electronic device (101) in an unfolded state (e.g., the first direction (①)). The first display (360) may be positioned from the first housing (310) across the first hinge assembly (340), the second housing (320), and the second hinge assembly (345) to the third housing (330). The first display (360) may be implemented as a flexible display such that the portion located over the first hinge assembly (340) and the second hinge assembly (345) can be bent at least partially. The first display (360) may be divided into a first display area (361) located in the first housing (310), a second display area (362) located in the second housing (320), and a third display area (363) located in the third housing (330). The distinction between the first display area (361), the second display area (362), and the third display area (363) may be an exemplary physical distinction.

[0069] The electronic device (101) may include at least one front camera positioned inside the electronic device (101) such that its lens is visually exposed through the front. For example, the first camera (381) may be positioned below the third display area (363). The lens of the first camera (381) is positioned to face the third display area (363) so as to receive light from outside the electronic device (101) through at least a portion of the third display area (363) or through at least one opening formed in the third display area (363). According to one embodiment, the first camera (381) may be referred to as an under-display camera (UDC) as it is positioned below the display and receives light through the display.

[0070] The second display (or, cover display, sub display, rear display) (370) is <302> As illustrated in [Image], it may be visually exposed through the rear of the electronic device (101) in the unfolded state (e.g., the second direction (②)). The second display (370) may be placed in the second housing (320), but is not limited thereto. For example, the second display (370) may be placed in the first housing (310) or the third housing (330).

[0071] The electronic device (101) may include at least one rear camera including a lens positioned to face the rear. For example, the electronic device (101) may further include a second camera (382) located in the third housing (330) and including a lens facing the rear, a third camera (383) located below the second display (370) and including a lens facing the rear, a fourth camera (384), and a fifth camera (385). The fourth camera (384) and the fifth camera (385) may be located adjacent to the second camera (382) in the third housing (330). For example, the second camera (382) may include a wide-angle lens, the fourth camera (384) may include an ultra-wide-angle lens, and the fifth camera (385) may include a telephoto lens.

[0072] According to one embodiment, the electronic device (101) may first fold the first housing (310) with respect to the second housing (320) with respect to the first hinge assembly (340) (e.g., first folding), and later fold the second housing (320) with respect to the third housing (330) with respect to the second hinge assembly (345) (e.g., second folding). For example, the first housing (310) <303> As illustrated in the figure, the first housing (310) can be folded in a folding manner with respect to the second housing (320) through the first hinge assembly (340). When the first housing (310) is folded in a folding manner with respect to the second housing (320), the first display area (361) and the second display area (362) are arranged to face each other, and <304> As illustrated in [Image], the rear surface of the first housing (310) may be exposed to the outside.

[0073] The first housing (310) and the second housing (320) folded in an in-folding manner are <305> As illustrated in the figure, it can be folded in a folding manner with respect to the third housing (330) through the second hinge assembly (345). <305> In this state, the second display (370) can be exposed to the outside.

[0074] According to one embodiment, in a state where a first display positioned on the front is unfolded so as to be exposed to the outside, <306> As illustrated in the figure, the first housing (310) of the electronic device (101) may be folded first in an in-folding manner with respect to the second housing (320) (e.g., first folding), and the third housing (330) may be folded later in an in-folding manner with respect to the second housing (320) (e.g., second folding). Conversely, <307> As illustrated in the figure, the third housing (330) may be unfolded first with respect to the second housing (320), and the first housing (310) may be unfolded later with respect to the second housing (320).

[0075] Sensors (351, 352) (e.g., sensor module (160) of FIG. 1) can generate electrical signals or data values ​​corresponding to the internal operating state of the electronic device (101) or the external environmental state. The sensors (351, 352)) may include a first sensor (351) placed on the front of the third housing (330) and a second sensor (274b) placed on the rear, but may further include at least one sensor not shown in the drawing. In one embodiment, the electronic device (101) may further include at least one sensor not shown, for example, an inertial sensor (e.g., accelerometer and / or gyroscope), a hall sensor, an ultrasonic sensor, a gesture sensor, a grip sensor, a barometric pressure sensor, a magnetic sensor, a biosensor, a temperature sensor, a humidity sensor, a color sensor, a distance detection sensor (e.g., TOF (time of flight), LiDAR (light detection and ranging) sensor, or a fingerprint recognition sensor.

[0076] For example, an inertial sensor or a Hall sensor (not shown) may be used to determine the angle between the housings (310, 320, 330) and the foldable state. The inertial sensor or the Hall sensor may generate data to calculate the direction in which a force applied to the housings (310, 320, 330) acts and / or the angle of the foldable housing structure, or to determine whether the foldable housing structure is open or closed.

[0077] For example, in the case of a multi-foldable structure, the inertial sensor may include a first inertial sensor disposed in the internal space of a first housing (310) to generate position and / or movement (e.g., angular velocity and / or acceleration of 6 or 9 axes) data of the first housing (310), a second inertial sensor disposed in the internal space of a second housing (320) to generate position and / or movement data of the second housing (320), and a third inertial sensor disposed in the internal space of a third housing (330) to generate position and / or movement data of the third housing (330).

[0078] As another example, the Hall sensor can measure the strength of a magnetic field and generate data corresponding to the measured magnetic field strength. In the case of a multi-foldable structure, the Hall sensor may include a first Hall sensor attached to a first hinge assembly (340) and a second Hall sensor attached to a second hinge assembly (345).

[0079] According to one embodiment, the processor (120) may calculate (or determine) the angle between the housings based on data received from an inertial sensor and / or a Hall sensor. According to one embodiment, the processor (120) may also calculate (or determine) the angle between the housings based on the value of an accelerometer sensor mounted in each housing. The processor (120) may determine whether the housing structure is open or closed and the state based on the calculated angle. The processor (120) may recognize a foldable state (e.g., unfolded state, folded state, or intermediate state) based on the calculated angle.

[0080] For example, the processor (120) can determine the state of the housing structure to be folded if the calculated angle is between approximately 0 and 10 degrees. The processor (120) can determine the state of the housing structure to be unfolded if the calculated angle is between approximately 170 and 180 degrees. The processor (120) can determine the state of the housing structure to be intermediate if the angle is between approximately 10 and 169 degrees.

[0081] The processor (120) can determine an active area on which visual information is to be displayed on the display based on the state of the housing structure. For example, the processor (120) can determine that the electronic device (101) <303> When recognized as being in an unfolded state such as , components and a layout for displaying visual information (e.g., an application execution screen) can be determined based at least on the size of the first display (360), and the visual information can be displayed on the first display (360). As another example, an electronic device (101) <305> When recognized as being in a folded state as described in [Image], the processor (120) can determine the components and layout of the visual information based on the size of the second display (270) and display the visual information on the second display (370).

[0082] As another example, an electronic device (101) <304> When recognized as an intermediate state such as, the processor (120) may determine the active area as a third display area (363). In the intermediate state, the processor (120) may determine the components and layout of visual information based on the size of the third display area (363) and display the visual information in the third display area (363).

[0083] According to one embodiment, when the housing structure changes from a folded state to an unfolded state or from an unfolded state to a folded state while displaying an application execution screen (e.g., video playback), the processor (120) may not stop or may stop the execution of an application (software) / process corresponding to the execution screen (e.g., video playback, video recording) (this may change depending on the app connection usability function settings).

[0084] For example, the electronic device (101) may be configured with a first configuration condition for determining the point in time when switching the screen from the second display to the first display while the housing structure changes from a folded state to an unfolded state, and a second configuration condition for determining the point in time when switching the screen from the first display to the second display while the housing structure changes from an unfolded state to a folded state. The first configuration condition and the second configuration condition may include z-axis inversion, rotation order of housings, and rotation angle conditions between housings, but this is merely an example and may vary depending on the electronic device form factor. The first configuration condition and the second configuration condition may differ from the critical angle for determining the state of the electronic device (or housing structure).

[0085] FIGS. 4a and 4b illustrate drawings for explaining the state of an electronic device of a multi-foldable structure according to one embodiment.

[0086] Referring to FIGS. 4a and 4b, according to one embodiment, an electronic device (101) can determine a folded (folded or closed) state or an unfolded (flat or open) state based on the angle formed between two housings joined by a hinge assembly.

[0087] For example, if the angle between the two housings is approximately 170 degrees or more, the state is defined as an unfolded (flat or open) state, and if the angle between the two housings is approximately 10 degrees or less, the state can be defined as a folded (closed) state. If the two housings form an angle greater than the angle when folded and smaller than the angle when unfolded (e.g., between approximately 10 and 169 degrees), the state can be defined as an intermediate state. Here, the intermediate state can be expressed as a partially folded state or a partially unfolded state.

[0088] The electronic device (101) may have a multi-foldable housing structure. The electronic device (101) may be unfolded in various ways.

[0089] For example, an electronic device (101) having a multi-foldable housing structure is <401> As illustrated in the figure, as the first hinge assembly (340) rotates (A of 4a), the first foldable housing structure (310, 320) becomes folded, and as the second hinge assembly (345) rotates (B of 4a) while the first housing structure (310, 320) is in a folded state, it can be changed to a second foldable housing structure (320, 330). <401> As illustrated in the figure, when the first foldable housing structure (310, 320) is folded first and the second foldable housing structure (320, 330) is subsequently changed to a folded state, the second display (370) may be exposed to the outside.

[0090] <402> As illustrated in [Image], when the second foldable housing structure (320, 330) is in a folded state, the second foldable housing structure (320, 330) may be in an intermediate state as the second hinge assembly (345) rotates (C of 4a). When the first foldable housing structure (310, 320) is in a folded state and the second foldable housing structure (320, 330) is in an unfolded state or intermediate state as the second hinge assembly (345) rotates, only the third display area (363) may be exposed to the outside.

[0091] When the first foldable housing structure (310, 320) is in a folded state and the second hinge assembly (345) is in an unfolded or intermediate state, the first hinge assembly (340) is rotated (D of 4a), and the first foldable housing structure (310, 320) can be changed to an intermediate state. When the second foldable housing structure (320, 330) is in an unfolded state and the first foldable housing structure (310, 320) is rotated further in an intermediate state, the housings (310, 320, 330) can be changed to an unfolded state. When the housings (310, 320, 330) are all unfolded, the first display (360) can be exposed to the outside.

[0092] As another example, an electronic device (101) having a multi-foldable housing structure is <401> Unlike <404> As illustrated in Fig. 3, the rear surface of the third housing may be exposed to the outside when all housings (310, 320, 330) are folded. When all housings (310, 320, 330) are folded, the second hinge assembly (345) is first rotated (F in Fig. 4b) to switch the second foldable housing structure (320, 330) to an intermediate state or an unfolded state, and then the first hinge assembly (340) is rotated (E in Fig. 4b) to switch to an intermediate state or an unfolded state, so that all housings (310, 320, 330) can be changed to an unfolded state.

[0093] An electronic device (101) according to one embodiment can determine (or judge) the start of a state change or the completion of a state change of a housing structure based on the angle of a first foldable housing structure (310, 320) by the rotation of a first hinge assembly (340) and / or the angle of a second foldable housing structure (320, 330) by the rotation of a second hinge assembly (345).

[0094] For example, the electronic device (101) may recognize the point in time when the angle caused by rotation of the first foldable housing structure (310, 320) or the second foldable housing structure (320, 330) in the folded state becomes greater than the first critical angle (e.g., about 10 degrees) as the point in time when the state change begins to be recognized (e.g., the first point in time when the state change begins to be recognized). Until the electronic device (101) recognizes the point in time when the state change begins in the folded state, the second display (370) is turned off, and some areas of the first display (360) may be turned on. During the transition of the electronic device (101) from the folded state to the unfolded state, the first display (360) may be turned on for each area exposed to the outside.

[0095] The electronic device (101) may recognize the point in time when the angle caused by rotation of the first foldable housing structure (310, 320) and the second foldable housing structure (320, 330) becomes greater than a second threshold angle (e.g., about 170 degrees) as the point in time when the state change is completed (e.g., a second point in time when it begins to be recognized as an unfolded state). At the point in time when the state change is completed, all areas of the first display (360) (e.g., first area (361), second area (362), and third area (363)) may be turned on.

[0096] An electronic device according to one embodiment may include a first housing, a second housing, and a third housing. An electronic device according to one embodiment may include a first hinge assembly configured to connect the first housing to one side of the second housing and allow the second housing to rotate relative to the second housing, and a second hinge assembly configured to connect the third housing to the other side of the third housing and allow the third housing to rotate. An electronic device according to one embodiment may include a first display comprising a first display area disposed in the first housing, a second display area disposed in the second housing, and a third display area disposed in the third housing. An electronic device according to one embodiment may include a second display disposed in any one of the first housing, the second housing, and the third housing, and disposed in a direction opposite to the first display area, the second display area, and the third display area. An electronic device according to one embodiment may include at least one sensor. An electronic device according to one embodiment may include a memory that stores executable instructions. An electronic device according to one embodiment may include a processor that accesses the memory and executes the instructions.Commands according to one embodiment may enable the electronic device to play a video through the second display while the first housing, the second housing, and the third housing are all folded, and to play a video through the cover display of the electronic device, to recognize that a state change has started in at least one of the first housing, the second housing, and the third housing based on data received from at least one sensor, to start a timer and record the video being played on the cover display based on the start of the state change, to end the timer and end the recording of the video based on the completion of the change to a state where the first housing, the second housing, and the third housing are all unfolded, to generate replay videos based on the recorded video, to continue playing the video on the internal display while the first housing, the second housing, and the third housing are all unfolded, and to display at least one of the replay videos and an indicator guiding replay on at least a part of the video.

[0097] The instructions according to one embodiment may cause the electronic device to recognize that a state change has started when at least one of the first angle between the first housing and the second housing, or the second angle between the second housing and the third housing, becomes larger than or equal to a first threshold angle value.

[0098] The commands according to one embodiment may cause the electronic device to recognize that the state change is completed at the point in time when each of the first angle and the second angle increases to a second threshold angle value or greater.

[0099] The instructions according to one embodiment may prevent the electronic device from stopping video playback running on the second display while the state between the first housing, the second housing, and the third housings is changed.

[0100] The commands according to one embodiment may cause the electronic device to terminate the video recording and not execute a replay function based on the recorded video when the timer recording time exceeds a preset maximum time.

[0101] The commands according to one embodiment may cause the electronic device to display a video currently playing in a first area of ​​the first display and display a list of replay videos in a second area of ​​the first display.

[0102] The commands according to one embodiment may cause the electronic device to switch the first area from the video playback screen to the playback screen of the selected replay video based on an input selecting one of the replay videos displayed in the second area of ​​the first display.

[0103] The instructions according to one embodiment may cause the electronic device to switch the first area to the video playback screen based on the fact that the playback of the replay video of the first area has ended.

[0104] The commands according to one embodiment may cause the electronic device to display the replay videos as a thumbnail list on at least a portion of the video being played through the first display, make the thumbnail list disappear based on an input selecting one of the replay videos, and play the selected replay video in a pop-up window.

[0105] The commands according to one embodiment may cause the electronic device to display a list of thumbnails of the replay videos on at least a portion of the video being played through the first display based on an input requesting the termination of the pop-up window.

[0106] FIG. 5 illustrates a method for providing a replay service of an electronic device including a flexible display according to one embodiment.

[0107] Each operation described in FIG. 5 may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, and at least two operations may be performed in parallel. The functions or operations described in FIG. 5 can be understood as functions performed by the processor (120) of the electronic device (101). The processor (120) can execute instructions (e.g., instructions) stored in memory (130) to implement a software module and can control hardware associated with the function (e.g., the display module (160) of FIG. 1).

[0108] Referring to FIG. 5, while the electronic device (101) (or housing structure) is in a folded state (e.g., a first state), the processor (120) of the electronic device (101) can display a first execution screen related to video playback on a second display (370) located in a second housing (320) in operation 510.

[0109] For example, the processor (120) can run an application that supports video playback and display a first execution screen related to video playback (e.g., playback using a media player, video playback using a web browser / or application) on the second display. The processor (120) can control a DDI (display driver IC) so that the video is played through the first execution screen and control an audio processing circuit so that audio corresponding to the video being played is played through a speaker (or an external audio output device connected to the electronic device (101) via a wireless communication circuit).

[0110] In operation 515, the processor (120) can determine a first time point at which a change in the state of the electronic device begins based on data received from the sensors.

[0111] For example, the processor (120) may recognize a first point in time at which the first housing (310), the second housing (320), and / or the third housing (330) begin to change to an intermediate state based on data sensed from at least one sensor (e.g., an inertial sensor (e.g., an accelerometer and a gyroscope) and / or a Hall sensor). The processor (120) may recognize a first point in time at which the first angle of the first foldable housing structure (310, 320) caused by the rotation of the first hinge assembly (340) or the second angle of the second foldable housing structure (320, 330) caused by the rotation of the second hinge assembly (345) becomes greater than or equal to a first threshold angle value (e.g., about 10 degrees) as the first point in time at which the state change begins.

[0112] Conversely, when transitioning from an unfolded state (e.g., second state) to an intermediate state or a folded state (e.g., first state) of the first foldable housing structure (310, 320) or the second foldable housing structure (320, 330), the first point in time may be recognized as the point in time when at least one of the first angle of the first foldable housing structure (310, 320) or the second angle of the second foldable housing structure (320, 330) becomes smaller than a second threshold angle value (e.g., about 170 degrees).

[0113] In operation 520, the processor (120) can start a timer and start recording video being played on a second display when a state change begins (e.g., a first point in time) from a folded state (e.g., a first state) of the electronic device (101) (or housing structure) (e.g., a first state) (e.g., yes in operation 515).

[0114] According to one embodiment, the processor (120) may not stop the execution of an application (software) / process (e.g., video playback, video recording) corresponding to the execution screen even if a housing structure change begins while displaying the execution screen of an application (e.g., video playback) as part of the app connection usability function.

[0115] For example, the processor (120) can start full screen recording of the first execution screen (e.g., video playback screen) running on the second display and partially record the video playing on the second display.

[0116] In another example, the processor (120) can record the video playback time at a first point in time when the state change begins, when the video being played on the first execution screen uses a real-time streaming service.

[0117] In operation 525, the processor (120) may not record a timer if a state change does not begin when the device (101) (or housing structure) is in a folded state (e.g., a first state) (in operation 515, no).

[0118] In operation 530, the processor (120) can determine whether the time taken to be recorded by the timer is within the maximum time.

[0119] For example, the maximum time may be approximately 5 minutes, but this is just an example and may change depending on the housing structure or / form of the electronic device.

[0120] In operation 535, the processor (120) may stop recording and proceed to no action if the time taken to be recorded by the timer exceeds a preset maximum time (or if the action of changing to an intermediate state exceeds a preset maximum time) (in operation 530, no).

[0121] In operation 540, the processor (120) can determine the point in time (e.g., second point in time) when the change from a folded state (e.g., first state) to an unfolded state (e.g., second state) is completed if the time taken to record the video recording with a timer is within the maximum time (e.g., yes in operation 530).

[0122] For example, the processor (120) may recognize, based on data sensed from at least one sensor (e.g., an inertial sensor and / or a Hall sensor), the point in time when both the first angle of the first foldable housing structure (310, 320) caused by the rotation of the first hinge assembly (340) and the second angle of the second foldable housing structure (320, 330) caused by the rotation of the second hinge assembly (345) become greater than or equal to a second threshold angle value (e.g., about 170 degrees) as the second point in time when the state change is completed.

[0123] Conversely, when transitioning from an unfolded state (e.g., a second state) to a folded state, the first angle of the first foldable housing structure (310, 320) and the second angle of the second foldable housing structure (320, 330) may be recognized as a second point in time when they become smaller than a first threshold angle value (e.g., about 10 degrees).

[0124] In another example, the processor (120) can record the video playback time at a second point in time when the state change is completed, when the video being played on the first execution screen uses a real-time streaming service.

[0125] According to one embodiment, if the recorded video takes too long to reach the maximum time, the electronic device (101) recognizes that a change in the state of the electronic device or a different situation has occurred, and may terminate the recorded video and not play the recorded video.

[0126] In operation 545, the processor (120) may end the timer and end video recording if the state change is completed within a preset maximum time (in operation 535, yes). The processor (120) may store the recorded video in memory (130) allocated in connection with a missed part replay service. The recorded video may be used as replay videos of the missed parts.

[0127] In another example, when a video being played on a first execution screen uses a real-time streaming service, the processor (120) records the video playback time at a first point in time when the state change begins and the playback time at a second point in time when the state change is completed, and may request a video portion for the recorded segment from a server providing a real-time streaming service.

[0128] If the processor (120) does not complete the state change within the preset maximum time (in operation 540, no), it can proceed to operation 530 to check whether the time required for recording is within the maximum time.

[0129] In operation 550, the processor (120) can play the video being played on the second display through the first display based on the electronic device (101) (or housing structure) being switched to a second state, and display at least one of the replay video content (e.g., a missed part video) / indicator on at least a part of the first display.

[0130] The processor (120) can disable the second display (370) based on the completion of the state change (e.g., by stopping the power supply to the second display (370) so that the screen is turned off) and display a second execution screen related to video playback on the first display. The processor (120) can control a DDI (display driver IC) to resume video playback through the second execution screen and control an audio processing circuit so that audio corresponding to the video being played is played through a speaker (or an external audio output device connected to the electronic device (101) via a wireless communication circuit).

[0131] According to one embodiment, the processor (120) can switch the screen currently being displayed on the first display (e.g., video playback) to the second display based on satisfying conditions set for switching the screen from the first display to the second display (e.g., Z-axis inversion, rotation order of housings and rotation angle, etc.).

[0132] The processor (120) can display at least one of a replay video based on a video recorded on the second execution screen and / or an indicator indicating that there is a replay video on at least a part of the second display.

[0133] The replay video refers to a part / part / clip of a video that is out of the user's field of vision and missed while the state of the electronic device (101) (or housing structure) is changing, and can be generated based on the recorded video. For example, the processor (120) can divide the recorded video into multiple fragment videos according to a preset size / or time. As another example, the processor (120) can perform video analysis based on artificial intelligence by linking the stored recorded video with a server, and extract important scenes through video analysis to divide them into multiple fragment videos.

[0134] According to one embodiment, the replay video may be provided via a split view or a pop-up window. Examples of user interface (UI) screens related to the replay video and / or indicators will be explained through the drawings described below.

[0135] In operation 555, the processor (120) can determine whether to return to video playback after a replay video playback request.

[0136] For example, the processor (120) can play the replay video on all or at least part of the second execution screen in response to user input that plays the replay video displayed through the second display. After the playback of the replay video is completed, the processor (120) can resume video playback through the second display.

[0137] In operation 560, the processor (120) can delete the replay video if the second execution screen being displayed through the second display returns to video playback after a request for replay video playback (in operation 555, yes).

[0138] For example, since the user has re-watched videos that were missed from the user's field of vision while the user was changing the state of the electronic device (or housing structure), the replayed video that has finished playing may be deleted.

[0139] In operation 565, if the second execution screen being displayed through the second display does not return to video playback after a request for replay video playback (in operation 555, no), the processor (120) may retain the storage of the replay video and proceed to operation 565.

[0140] FIGS. 6a and 6b illustrate screens that provide a replay service for a portion of a running screen based on a change in the housing state in an electronic device according to one embodiment.

[0141] Referring to FIGS. 6a and 6b, the processor (120) of the electronic device (101) is in a state where the electronic device (101) (or housing structure) is folded <601> As illustrated in the figure, a first UI (user interface) screen (610) related to a video (620) can be displayed on a second display (370) located in a second housing (320).

[0142] The first UI screen (610) may have a layout and visual components corresponding to the size of the second display. The processor (120) may play a video based on user input requesting the playback of a video (620) displayed on the first UI (user interface) screen (610), and may output an audio signal corresponding to the video through a speaker. The first UI screen (610) may refer to the execution screen of a media player or an application that supports video playback (e.g., a video app, YouTube, etc.). The media player or the application that supports video playback may be an application that supports an application continuity service in which the execution of the application is maintained when the state of the electronic device (101) changes.

[0143] The processor (120) can record a portion of the video being played by performing the operations disclosed in FIG. 5 while the electronic device (101) (or housing structure) is changing from a folded state to an unfolded state. The processor (120) can stop recording when the change of the electronic device (101) (or housing structure) from a folded state to an unfolded state is completed and generate replay videos based on the recorded video.

[0144] Based on the fact that the first foldable housing structure (310, 320) is switched to an unfolded state and the second foldable housing structure (320, 330) is switched to an unfolded state, the processor (120) disables the second display (370) (e.g., turns off the screen by stopping the power supply to the second display (370)), and <602> As illustrated in the figure, a second UI screen (615) for playing a video (620) can be displayed on the first display (360). The second UI screen (615) may have a layout and visual components corresponding to the size of the first display (360).

[0145] Based on the fact that the first foldable housing structure (310, 320) and the second foldable housing structure (320, 330) have both been switched to an unfolded state, the processor (120) can play a video (620) through the first display (360) and display a list of missed parts (640) generated based on the recorded video on a part of the second UI screen (615).

[0146] The second UI screen (615) includes function items related to video playback (e.g., start playback item (630), fast forward item (631), volume control item (632), settings item (633), screen sharing item (634) and / or playback bar (635)), but is not limited to the illustrated examples.

[0147] It may include a replay video list (640), replay video thumbnails (641), and a termination item (642) for closing the list window. In one example, the playback bar (635) may display a visual object (650) so that the playback time of the video currently playing and the section of the missed part are visually distinguished.

[0148] <603> As illustrated in the figure, the user can select a thumbnail (641) of a replay video that they wish to rewatch for a missed part from the replay video list (640). The processor (120) selects the replay video based on an input (6010) that selects the replay video. <604> As illustrated in the figure, the first display (360) can be switched to a third UI screen (660) that plays the first replay video. The third UI screen (660) can display guidance information (665) for the first replay video.

[0149] When the user requests to return to video playback via the playback bar (635) (6020) or selects a return item included in the guidance information (665) (6030), the processor (120) <605> As illustrated in [Image], configurations related to replaying missed parts (e.g., replay video list (640), guidance information (665) and visual objects (650), etc.) are deleted, and video (620) playback can be resumed over the entire area of ​​the second display.

[0150] FIG. 7 illustrates screens that provide a replay service for a portion of a running screen based on a change in the housing state in an electronic device according to one embodiment.

[0151] Referring to FIG. 7, an electronic device (101) according to one embodiment can provide a replay video based on a recorded video with various UI configurations while the electronic device (or housing structure) changes from a folded state to an unfolded state.

[0152] According to one embodiment, based on the fact that the first foldable housing structure (310, 320) and the second foldable housing structure (320, 330) are both switched to an unfolded state, the processor (120) of the electronic device (101) on the first display (360) <701> As illustrated in the figure, a second UI screen (615) may be displayed that includes a list of thumbnails (710) of missed parts of the video being played (620) and / or a replay indicator (720).

[0153] According to some embodiments, the second UI screen (615) may display only a thumbnail list (710) of the replay video depending on the settings.

[0154] According to some embodiments, the second UI screen (615) may first display a replay indicator (720) and then later display a replay video thumbnail list (710) based on an input selecting the replay indicator (720).

[0155] The user can select a replay video they want to watch again from the replay video thumbnail list (710). The processor (120) selects the replay video based on the input (7100) of the replay video. <702> As illustrated in the figure, a pop-up window (730) that plays a replay video can be displayed on the first display (360) or the second UI (615). <702> While watching the video playing on the screen, the user can check the parts of the video they missed through the pop-up window (730).

[0156] The processor (120) <703> As illustrated in the figure, based on the input selecting the exit item (735) displayed in the popup window (730), the popup window (730) can be removed from the first display (360) or the second UI (615) and the video (620) playback can be returned.

[0157] FIG. 8 illustrates screens that provide a replay service for a portion of a running screen based on a change in the housing state in an electronic device according to one embodiment.

[0158] Referring to FIG. 8, based on the fact that the electronic device (101) according to one embodiment has been switched to a state where both the first foldable housing structure (310, 320) and the second foldable housing structure (320, 330) are unfolded, the processor (120) on the first display (360) <801> As illustrated in the figure, a second UI screen (615) may be displayed including a replay indicator (720) indicating at least a portion of the video (620) currently being played. Depending on the settings, the second UI screen (615) may display only the replay indicator (720).

[0159] If the user wishes to watch a replay video related to a part they missed, the user can perform a first touch gesture (e.g., drag input) by touching the video (620) currently playing. In the example of FIG. 8, the touch direction of the touch gesture is shown as an up direction, but this is merely an example and the touch direction is not limited.

[0160] The processor (120) can display a recommendation list (810) on a second UI screen (615) that includes recommended videos (815) associated with or related to the video being played, in part of the video (620) being played, based on a first touch gesture.

[0161] The processor (120) receives a second touch gesture that touches the area where the recommendation list (810) is displayed, and based on the second touch gesture <802> As illustrated in [Image], the recommendation list (810) can be switched to a thumbnail list (820) of the replay video (825) of the missed part.

[0162] When a replay video (825) is selected from the thumbnail list (820), the processor (120) of FIG. 6b <604> As illustrated in [Figure], display the video of the missed portion in full screen instead of the video currently being played, or [Figure] 7 <702> As illustrated in [image], the video of the missed part can be played in a pop-up window manner.

[0163] FIG. 9 illustrates screens that provide a replay service for a portion of a running screen based on a change in the housing state in an electronic device according to one embodiment.

[0164] Referring to FIG. 9, an electronic device (101) according to one embodiment can provide a replay video service of the missed part even in a half-folded state.

[0165] According to one embodiment, the processor (120) of the electronic device (101) is in a state where both the first foldable housing structure (310, 320) and the second foldable housing structure (320, 330) are folded <901> As illustrated in the figure, a first UI (user interface) screen (910) related to a video (920) can be displayed on a second display (370) located in a second housing (320).

[0166] <902> As illustrated in the figure, based on the second foldable housing structure (320, 330) being switched to an unfolded state (e.g., half-folded state), the processor (120) can display a second UI screen (915) containing a replay video (925) of a missed part of the video (920) being played, in accordance with the area of ​​the third display area (363) of the first display exposed to the outside. The processor (120) can generate replay videos (925) based on a first recorded video recorded during the time (e.g., 10 minutes) from when the second foldable housing structure (320, 330) started in a folded state until the transition to an unfolded state was completed, and can display the generated replay videos on the second UI screen (915).

[0167] <902> As shown, in a half-folded state <903> As illustrated in the figure, based on the fact that the first foldable housing structure (310, 320) and the second foldable housing structure (320, 330) have both been switched to an unfolded state, the processor (120) may display a third UI screen (930) containing a replay video (925) of a missed part in relation to the video (920) currently being played, in accordance with the area of ​​the first display. The processor (120) may generate replay videos (925) based on the second recorded video and the first recorded video recorded during the time (e.g., 10 minutes) from when the first foldable housing structure (310, 320) started in a folded state until the transition to an unfolded state was completed, and may display the generated replay videos (925) on the third UI screen (930).

[0168] According to one embodiment, the processor (120) may provide as replay videos not only videos recorded between the half-folded state and the fully unfolded state, but also videos recorded between the fully folded state and the fully unfolded state. According to some embodiments, the processor (120) <902> As such, when a user watches a replay video through the second UI screen (920) in a half-folded state (or when eye tracking of the replay video is detected) or when screen manipulation by the user occurs, the first recorded video is deleted, and among the replay videos (925) included in the third UI screen (930), replay videos generated based on the first recorded video may be excluded.

[0169] FIG. 10 illustrates screens that provide a replay service for a portion of a running screen based on a change in the housing state in an electronic device according to one embodiment.

[0170] Referring to FIG. 10, an electronic device (101) according to one embodiment can support a replay service for a video that was missed during a state change of the electronic device (or housing structure) during a video call.

[0171] The processor (120) is in a state where both the first foldable housing structure (310, 320) and the second foldable housing structure (320, 330) are folded <1001> As illustrated in the figure, a first UI (user interface) screen (1010) related to a video call can be displayed on a second display (370) located in a second housing (320). The video call UI screen (1010) can display a user video (1020) and a counterpart video (1030).

[0172] For example, the processor (120) can activate the camera to capture a user image (1020) based on the fact that a video call is connected with the other party's device, and receive the other party's image from the other party's device through a wireless communication circuit to configure a first UI screen (1010).

[0173] The processor (120) can record the image of the other party (1030) while changing the state of the electronic device (e.g., at least one of the first foldable housing structure (310, 320) and the second foldable housing structure (320, 330).

[0174] <1002> As illustrated in the figure, the processor (120) may be switched to display a second UI (user interface) screen (1015) on the first display (360), which includes a replay indicator (1037) and a list of replay videos (1035) of missed parts, based on the fact that the first foldable housing structure (310, 320) and the second foldable housing structure (320, 330) have both been switched to an unfolded state. The user can play back the replay videos (1035) of missed parts to check while changing the state of the electronic device during a call connection with the other party.

[0175] For example, when a user selects a replay video, the processor (120) can delete the replay video list (1035) from the second UI screen (1015) and display a pop-up window (not shown) to play the selected replay video. After the user watches the replay video, if the pop-up window is deleted, the processor (120) can display the replay video list (1035) again on the second UI screen (1015).

[0176] According to some embodiments, the processor (120) may not stop the execution of the camera capturing the user while changing the state of the electronic device (101) (e.g., at least one of the first foldable housing structure (310, 320) and the second foldable housing structure (320, 330). While changing the state of the electronic device (101) (e.g., at least one of the first foldable housing structure (310, 320) and the second foldable housing structure (320, 330)), an image unintended by the user may be transmitted to the counterpart device due to the movement of the camera's position. While changing the state of the electronic device (101), the processor (120) may control the transmission of a still image (1025) of the user, rather than the image captured by the camera, to the counterpart device. Here, the user's still image (1025) may be the last image frame transmitted prior to the point in time when the state of the electronic device (101) begins to change, or may be a user image regenerated based on the user image during a call using a generative artificial function.

[0177] FIGS. 11a and FIGS. 11b illustrate screens that provide a replay service for a portion of a running screen based on a change in the housing state in an electronic device according to one embodiment.

[0178] Referring to FIG. 11a and FIG. 11b, an electronic device (101) according to one embodiment may support a function to stop camera shooting while the state of the electronic device (101) (e.g., at least one of the first foldable housing structure (310, 320) and the second foldable housing structure (320, 330)) is changing during camera shooting, and to resume camera shooting from the point when the change in the state of the electronic device (101) is completed.

[0179] For example, when the first foldable housing structure (310, 320) and the second foldable housing structure (320, 330) are both folded <1101> As illustrated in the figure, the processor (120) receives a video image (1110) through a camera and processes (e.g., reduces resolution) it to display a preview image on the second display (370). While the user changes the state of the electronic device (101) during camera shooting, the processor (120) stops the camera shooting and, at the time when the change in the state of the electronic device (101) is completed, <1101> As illustrated in [Image], camera shooting can be resumed and the video image (1110) being shot can be switched to be displayed through the first display (360).

[0180] An electronic device (101) according to one embodiment may support the function of shooting a camera without interruption while the state of the electronic device (101) changes during camera shooting, detecting a frame interval being shot while the state of the electronic device (101) changes, and guiding image regeneration for the detected frame interval.

[0181] For example, from the electronic device (101) in an unfolded state to a folded state (e.g., when both the first foldable housing structure (310, 320) and the second foldable housing structure (320, 330) are folded), the processor (101) can display camera images (1120) and image frames (1130) being captured through a camera on the second display (370). At this time, if camera capture is maintained while the electronic device (101) changes from an unfolded state to a folded state, <1103> As illustrated in the figure, frames (1135) captured while the state of the electronic device (101) is changing can be displayed to be visually distinguished from other frames, and a regenerated object (1140) can be displayed on at least a part of the video image (1120).

[0182] The processor (120) can determine the start time of a state change and the end time of a state change based on data collected by at least one sensor, and detect frames (1135) of video captured from the start time of the state change to the end time of the state change. The processor (120) can determine the start time of a state change and the end time of a state change based on user input selecting a regenerated object. <1104> As illustrated in [Image], images of detected frames can be processed to regenerate or delete images. When a frame is regenerated, the processor (120) may display an image (1140) or video (1145) indicating that the frame is being regenerated.

[0183] The processor (120) <1105> As illustrated in [Image], some of the frame images included in the camera video being captured can be replaced with regenerated frame images.

[0184] A method for providing a replay service for an electronic device including a flexible display according to one embodiment may include an operation of playing a video through a second display disposed on the rear of the electronic device in a first state where the structural state of the first housing, the second housing, and the third housing is in a first state. A method for providing a replay service for an electronic device according to one embodiment may include an operation of recognizing a first point in time when at least one of a first angle between the first housing and the second housing, or a second angle between the second housing and the third housing, increases by more than a first threshold angle value, based on data received from at least one sensor while playing a video through the second display. A method for providing a replay service for an electronic device according to one embodiment may include an operation of starting a timer and recording the video being played on the second display based on the recognition of the first point in time. A method for providing a replay service for an electronic device according to one embodiment may include an operation of ending the timer and ending the recording of the video based on the recognition of a second point in time when the first angle and the second angle increase by more than a second threshold angle value. A method for providing a replay service of an electronic device according to one embodiment may include an operation of generating replay videos based on a video recorded from the first time point to the second time point. A method for providing a replay service of an electronic device according to one embodiment may include an operation of continuing to play the video on a first display disposed on the front of the electronic device based on the structural state of the first housing, the second housing, and the third housing being switched to a second state, and displaying at least one of replay videos and an indicator guiding replay on at least a part of the video being played on the first display.

[0185] A method for providing a replay service of an electronic device according to one embodiment may further include an operation of controlling so as not to stop the playback of a video running on the second display while the structural state of the first housing, the second housing, and the third housing is changed.

[0186] The operation of terminating the timer and terminating the recording of the video according to one embodiment may further include an operation of terminating the video recording and controlling not to execute a replay function based on the recorded video when the timer recording time exceeds a preset maximum time.

[0187] The operation of generating replay videos based on the recorded video according to one embodiment may perform at least one of the following: dividing the recorded video into replay videos at predetermined sizes or predetermined times to generate the replay videos; and performing video analysis based on artificial intelligence on the recorded video, and extracting scenes that meet predetermined conditions through the video analysis to generate the replay videos.

[0188] The operation of displaying at least one of replay videos and an indicator guiding replay on at least a portion of the video according to one embodiment may further include displaying a video currently playing in a first area of ​​the first display and displaying a list of replay videos in a second area of ​​the first display.

[0189] A method for providing a replay service of an electronic device according to one embodiment may further include, after an operation of displaying a list of replay videos, an operation of switching the first area from the video playback screen to the playback screen of the selected replay video based on an input selecting one of the replay videos displayed in the second area of ​​the first display.

[0190] The operation of displaying at least one of replay videos and an indicator guiding replay on at least a part of the video according to one embodiment may further include the operation of switching the first area to a playback screen of the video based on the fact that the playback of the replay video of the first area has ended, and the operation of displaying the replay videos as a thumbnail list on at least a part of the video being played through the first display.

[0191] A method for providing a replay service of an electronic device according to one embodiment may further include, after the operation of displaying the replay videos as a thumbnail list, the operation of making the thumbnail list disappear based on an input selecting one of the replay videos and playing the selected replay video in a pop-up window.

[0192] A method for providing a replay service of an electronic device according to one embodiment may further include an operation of displaying a thumbnail list of the replay videos on at least a portion of the video currently being played through the first display based on an input requesting the termination of the pop-up window.

[0193] The embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" each may include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as “coupled” or “connected” to another (e.g., 2nd) component, with or without the terms “functionally” or “communicationly,” it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.

[0194] The term “module” as used in the embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0195] One embodiment of the present document may be implemented as software (e.g., program (140)) comprising one or more instructions stored in a storage medium (e.g., internal memory (136) or external memory (138)) readable by a machine (e.g., electronic device (101)). For example, a processor (e.g., processor (120)) of the machine (e.g., electronic device (101)) may call at least one of the one or more instructions stored in the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.

[0196] According to one embodiment, the method according to the embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or an application store (e.g., Play Store). TM It can be distributed online (e.g., downloaded or uploaded) through ) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0197] According to one embodiment, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to one embodiment, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the components of the multiple components in the same or similar manner as those performed by the corresponding components among the multiple components prior to the integration. According to one embodiment, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In an electronic device, First housing; Second housing; Third housing; A first hinge assembly configured to connect a first housing to one side of the second housing and allow the first housing to rotate relative to the second housing; A second hinge assembly configured to connect the third housing to the other side of the second housing and allow the third housing to rotate relative to the second housing; A first display comprising a first display area disposed in the first housing, a second display area disposed in the second housing, and a third display area disposed in the third housing; A second display disposed in any one of the first housing, the second housing, and the third housing, and disposed in a direction opposite to the first display area, the second display area, and the third display area; At least one sensor; Memory for storing executable instructions; and It includes a processor that accesses the memory and executes the instructions, When the above instructions are executed by the processor, the electronic device, The structural state of the first housing, the second housing, and the third housing plays a video through the second display in the first state, and While playing a video through the second display, based on data received from at least one sensor, a first point in time is recognized when at least one of the first angle between the first housing and the second housing, or the second angle between the second housing and the third housing, becomes larger than a first threshold angle value, and Based on the recognition of the first point in time, start the timer and record the video playing on the second display, and Based on the recognition of a second point in time when the first angle and the second angle become larger than or equal to a second threshold angle value, the timer is terminated and the recording of the video is terminated, and Replay videos are generated based on the video recorded from the first point in time to the second point in time, and An electronic device that plays the video on the first display continuously based on the structural state of the first housing, the second housing, and the third housing being switched to a second state, and displays at least one of the replay videos and an indicator guiding replay on at least a part of the video.

2. In Paragraph 1, When the above instructions are executed by the processor, the electronic device, An electronic device that prevents the playback of a video being played on the second display from stopping while the structural state of the first housing, the second housing, and the third housing is changed.

3. In Paragraph 1, When the above instructions are executed by the processor, the electronic device, An electronic device that terminates the recording of the video and prevents the execution of a replay function based on the recorded video when the timer recording time exceeds a preset maximum time.

4. In Paragraph 1, When the above instructions are executed by the processor, the electronic device, The above-mentioned recorded video is divided into the above-mentioned replay videos at preset sizes or preset time intervals, or An electronic device that performs video analysis based on artificial intelligence on the above-mentioned recorded video, extracts scenes that meet preset conditions through the video analysis, and generates the above-mentioned replay videos.

5. In Paragraph 1, When the above instructions are executed by the processor, the electronic device, An electronic device that plays the video in succession in a first area of ​​the first display and displays a list of the replay videos in a second area of ​​the first display.

6. In Paragraph 5, When the above instructions are executed by the processor, the electronic device, An electronic device that switches the first area from the video playback screen to the playback screen of the selected replay video based on an input selecting one of the replay videos displayed in the second area of ​​the first display.

7. In Paragraph 6, When the above instructions are executed by the processor, the electronic device, An electronic device that switches the first area to the video playback screen based on the fact that the playback of the selected replay video in the first area has ended.

8. In Paragraph 1, When the above instructions are executed by the processor, the electronic device, Displaying the replay videos as a thumbnail list on at least a portion of the video being played through the first display, and An electronic device that makes the thumbnail list disappear and plays the selected replay video in a pop-up window based on an input selecting one of the replay videos.

9. In Paragraph 8, When the above instructions are executed by the processor, the electronic device, An electronic device that displays a list of thumbnails of the replay videos again on at least a portion of the video being played through the first display based on an input requesting the termination of the pop-up window.

10. A method for providing a replay service for an electronic device including a flexible display, The operation of playing a video through a second display positioned on the rear of an electronic device in the first state, wherein the structural state of the first housing, the second housing, and the third housing; An operation of recognizing a first point in time when at least one of a first angle between the first housing and the second housing, or a second angle between the second housing and the third housing, increases to a value greater than or equal to a first threshold angle value, based on data received from at least one sensor while playing a video through the second display; An operation to start a timer and record a video playing on a second display based on the recognition of the first point in time; An operation to terminate the timer and end the recording of the video based on the recognition of a second point in time when the first angle and the second angle become larger than or equal to a second threshold angle value; An operation to generate replay videos based on videos recorded from the first point in time to the second point in time; A method comprising the operation of continuing to play the video on a first display positioned on the front of the electronic device based on the structural state of the first housing, the second housing, and the third housing being switched to a second state, and displaying at least one of the replay videos and an indicator guiding replay on at least a portion of the video being played on the first display.

11. In Paragraph 10, A method further comprising an operation to control so as not to stop the playback of a video being played on the second display while the structural state of the first housing, the second housing, and the third housing is changed.

12. In Paragraph 10, The operation of ending the timer and ending the video recording is A method further comprising an operation to stop the recording of the video and control the execution of a replay function based on the recorded video when the timer recording time exceeds a preset maximum time.

13. In Paragraph 10, The operation of generating replay videos based on the above-mentioned recorded video is, The operation of generating the above-mentioned recorded video into the above-mentioned replay videos by dividing it into preset sizes or preset time intervals; and A method of performing at least one of the following operations: performing artificial intelligence-based video analysis on the above-mentioned recorded video, and extracting scenes that meet pre-set conditions through the video analysis to generate the above-mentioned replay videos.

14. In Paragraph 10, The operation of displaying at least one of replay videos and an indicator guiding replay in at least a portion of the above video is, An operation of continuing to play the video currently being played in the first area of ​​the first display and displaying a list of the replay videos in the second area of ​​the first display; After the operation of displaying a list of the replay videos, the operation of switching the first area from the video playback screen to the playback screen of the selected replay video based on an input selecting one of the replay videos displayed in the second area of ​​the first display; and A method further comprising the operation of switching the first area of ​​the first display to the playback screen of the video based on the fact that the playback of the selected replay video in the first area of ​​the first display has ended.

15. In Paragraph 10, The operation of displaying at least one of replay videos and an indicator guiding replay in at least a portion of the above video is, The operation of displaying the replay videos as a thumbnail list on at least a portion of the video being played through the first display; After the operation of displaying the above-mentioned replay videos as a thumbnail list, the operation of making the thumbnail list disappear and playing the selected replay video in a popup window based on an input selecting one of the above-mentioned replay videos; and A method further comprising the operation of displaying a list of thumbnails of the replay videos again on at least a portion of the video being played through the first display based on an input requesting the termination of the popup window.

Images