Electronic device and method for operating electronic device
Patent Information
- Application Number
- PCT/KR2025/001994
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-03-07
- Filing Date
- 2025-02-11
- Publication Date
- 2025-10-02
AI Technical Summary
Existing electronic devices require multiple steps and complex user interactions to display multiple screens in a multi-view manner, which can be cumbersome and time-consuming.
An electronic device and method that allows users to select components on a screen using an indicator to display multiple sub-screens in a multi-view format, enabling efficient display and interaction through input devices or external input devices.
Enhances user experience by simplifying the process of displaying and managing multiple screens, reducing the operational steps and time required for multi-view operations.
Smart Images

Figure KR2025001994_02102025_PF_FP_ABST
Abstract
Description
Electronic devices and methods of operating electronic devices
[0001] The present disclosure relates to an electronic device and a method of operating the electronic device. Specifically, the present disclosure relates to an electronic device displaying a screen and a method of operating the electronic device.
[0002] With the advancement of electronic device technology, various electronic devices that provide images to users are being developed and distributed.
[0003] At this time, technologies are being developed and used to provide users with diverse user experiences when providing images through electronic devices.
[0004] For example, when providing images through electronic devices, the electronic device can provide images in a multi-view manner, displaying two or more screens simultaneously, to provide users with a variety of experiences.
[0005] At this time, the user can use the menu button on the remote control, etc. to go through multiple steps to make the electronic device display the screen in a multi-view manner.
[0006] One embodiment of the present disclosure provides a method for operating an electronic device. The method for operating the electronic device may include a step of displaying a screen through a display. The method for operating the electronic device may include a step of obtaining a first input for selecting one of a plurality of components included in the screen through an indicator displayed on the display. The method for operating the electronic device may include a step of displaying a first sub-screen corresponding to the screen and a second sub-screen corresponding to the component selected by the first input in a multi-view manner through the display.
[0007] One embodiment of the present disclosure provides a method of operating an electronic device. The method of operating an electronic device may include a step of displaying a first sub-screen in a first display area and a second sub-screen in a second display area in a multi-view manner through a display including a first display area and a second display area. The method of operating an electronic device may include a step of obtaining a first input, through an indicator displayed on the display, for performing an operation of dragging and dropping content included in the second sub-screen to the first sub-screen. The method of operating an electronic device may include a step of displaying a third sub-screen, which is different from the first sub-screen and corresponds to the content, in the first display area based on the first input.
[0008] One embodiment of the present disclosure provides an electronic device. The electronic device may include a display. The electronic device may include a memory that stores at least one instruction. The electronic device may include at least one processor. By having the at least one processor execute the at least one instruction stored in the memory, the electronic device may control the display to display a screen. By having the at least one processor execute the at least one instruction stored in the memory, the electronic device may obtain a first input for selecting one of a plurality of components included in the screen through an indicator displayed on the display. By having the at least one processor execute the at least one instruction stored in the memory, the electronic device may control the display to display a first sub-screen corresponding to a first screen and a second sub-screen corresponding to a component selected by the first input in a multi-view manner.
[0009] The technical problems to be achieved in this document are not limited to the technical problems mentioned above, and other technical problems not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present disclosure belongs from the description below.
[0010] The present disclosure may be understood in conjunction with the following detailed description and accompanying drawings, wherein reference numerals refer to structural elements.
[0011] FIG. 1 is a drawing for explaining the operation of an electronic device according to one embodiment of the present disclosure.
[0012] FIG. 2 is a flowchart illustrating the operation of an electronic device according to one embodiment of the present disclosure.
[0013] FIG. 3 is a drawing for explaining an operation for determining the position of a screen in a multi-view manner according to one embodiment of the present disclosure.
[0014] FIG. 4 is a drawing for explaining the types of a plurality of components included in a screen according to one embodiment of the present disclosure.
[0015] FIG. 5 is a drawing for explaining a multi-view method for displaying three or more sub-screens according to one embodiment of the present disclosure.
[0016] FIG. 6 is a drawing for explaining a sub-screen provided in multiple modes in an electronic device according to one embodiment of the present disclosure.
[0017] FIG. 7 is a flowchart for explaining sub-screens provided in multiple modes in an electronic device according to one embodiment of the present disclosure.
[0018] FIG. 8 is a drawing for explaining an operation of adjusting the size of a sub-screen by obtaining an input for performing a scroll operation according to one embodiment of the present disclosure.
[0019] FIG. 9 is a drawing for explaining an operation of changing the position of a sub-screen by obtaining an input for performing a drag-and-drop operation according to one embodiment of the present disclosure.
[0020] FIG. 10 is a flowchart for explaining the size adjustment of a sub-screen and the position change of a sub-screen according to one embodiment of the present disclosure.
[0021] FIG. 11 is a drawing for explaining an operation of displaying a sub-screen corresponding to content through an input of dragging and dropping content included in a multi-view sub-screen according to one embodiment of the present disclosure.
[0022] FIG. 12 is a flowchart for explaining an operation of displaying a sub-screen corresponding to content through an input of dragging and dropping content included in a multi-view sub-screen according to one embodiment of the present disclosure.
[0023] FIG. 13 is a flowchart for explaining an operation of displaying a sub-screen corresponding to content when the content is included in an application according to one embodiment of the present disclosure.
[0024] FIG. 14 is a flowchart for explaining an operation of displaying a sub-screen corresponding to content according to the type of content according to one embodiment of the present disclosure.
[0025] FIG. 15 is a drawing for explaining an operation in which the screen of an electronic device is mirrored and displayed on an external electronic device according to one embodiment of the present disclosure.
[0026] FIG. 16 is a drawing for explaining an operation in which a sub-screen corresponding to content is displayed in a pop-up mode through a drag-and-drop input in a multi-view mode sub-screen according to one embodiment of the present disclosure.
[0027] FIG. 17 is a drawing for explaining the operation of an electronic device according to one embodiment of the present disclosure.
[0028] FIG. 18 is a flowchart for explaining the operation of an electronic device according to one embodiment of the present disclosure.
[0029] FIG. 19 is a drawing for explaining the configuration of an electronic device and an external electronic device according to one embodiment of the present disclosure.
[0030] The terms used in this disclosure will be briefly explained, and one embodiment of the present disclosure will be specifically described.
[0031] The terms used in this disclosure are selected from widely used, current terms, taking into account the functions of one embodiment of the disclosure. However, these terms may vary depending on the intentions of those skilled in the art, precedents, the emergence of new technologies, etc. Furthermore, in certain cases, terms may be arbitrarily selected by the applicant, and in such cases, their meanings will be described in detail in the description of the relevant embodiments of the disclosure. Therefore, the terms used in this disclosure should not be defined simply as names of terms, but rather based on the meanings of the terms and the overall content of the disclosure.
[0032] Singular expressions may include plural expressions unless the context clearly indicates otherwise. Terms used herein, including technical or scientific terms, have the same meaning as commonly understood by a person of ordinary skill in the art described herein.
[0033] Unless the context clearly dictates otherwise, the singular forms "a," "an," and "the" are to be understood to include plural referents. Thus, for example, the description "a constituent surface" may also include reference to one or more of such surfaces.
[0034] Throughout this disclosure, when a part is said to "include" a component, this does not exclude other components, but rather implies the inclusion of other components, unless otherwise specifically stated. Furthermore, terms such as "part," "module," and the like described herein refer to a unit that processes at least one function or operation, which may be implemented in hardware or software, or a combination of hardware and software.
[0035] The expression “configured to” as used herein can be used interchangeably with, for example, “suitable for,” “having the capacity to,” “designed to,” “adapted to,” “made to,” or “capable of.” The term “configured to” does not necessarily mean something that is “specifically designed to” in terms of hardware. Instead, in some contexts, the expression “a system configured to” can mean that the system is “capable of” doing something together with other devices or components. For example, the phrase “a processor configured (or set) to perform A, B, and C” may mean a dedicated processor (e.g., an embedded processor) for performing those operations, or a generic-purpose processor (e.g., a CPU or application processor) that can perform those operations by executing one or more software programs stored in memory.
[0036] Additionally, when a component is referred to as being “connected” or “connected” to another component in the present disclosure, it should be understood that the component may be directly connected or connected to the other component, but may also be connected or connected via another component in between, unless otherwise specifically stated.
[0037] It should be understood that the blocks and combinations of flowcharts in each flowchart can be executed by one or more computer programs containing computer-executable instructions. The one or more computer programs may be stored entirely in a single memory, or may be stored in separate portions across multiple different memories.
[0038] All functions or operations described in this document may be performed by a single processor or a combination of processors. A single processor or a combination of processors is a circuitry that performs processing, and may include circuitry such as an Application Processor (AP), a Communication Processor (CP), a Graphical Processing Unit (GPU), a Neural Processing Unit (NPU), a Microprocessor Unit (MPU), a System on Chip (SoC), or an Integrated Chip (IC).
[0039] Below, with reference to the attached drawings, embodiments of the present disclosure are described in detail so that those skilled in the art can easily implement the present disclosure. However, one embodiment of the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein. In addition, in the drawings, parts irrelevant to the description are omitted to clearly describe one embodiment of the present disclosure, and similar parts are designated with similar drawing reference numerals throughout the present disclosure.
[0040] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings.
[0041] FIG. 1 is a drawing for explaining the operation of an electronic device according to one embodiment of the present disclosure.
[0042] Referring to FIG. 1, in one embodiment of the present disclosure, an electronic device (100) may be a device that displays an image (130) and provides it to a user. The electronic device (100) may include a display (110) that includes a display area (120). The electronic device (100) may control the display (110) to display the image (130) on the display area (120).
[0043] In one embodiment of the present disclosure, FIG. 1 illustrates an electronic device (100) in the shape of a television. However, the present disclosure is not limited thereto. The electronic device (100) may be implemented as electronic devices of various shapes, such as a mobile device, a smart phone, a laptop computer, a desktop, a tablet PC, a digital signage, a projector, and a wearable device.
[0044] In one embodiment of the present disclosure, an electronic device (100) implemented in various shapes may display an image (130) through a display (110) to provide the image (130) to a user.
[0045] In one embodiment of the present disclosure, an image (130) displayed in a specific area of the display area (120) may be referred to as a "screen." In one embodiment of the present disclosure, the screen may refer to an image (130) displayed in the entire display area (120). However, the present disclosure is not limited thereto, and the screen may also refer to an image (130) displayed in a portion of the display area (120). Hereinafter, for convenience of explanation, an image (130) displayed in the display area (120) may be referred to as a screen (130).
[0046] In one embodiment of the present disclosure, the electronic device (100) can divide the display area (120) into two or more areas and display different images in each area. The electronic device (100) can provide images to the user in a "multi-view" manner by dividing the display area (120) into two or more areas and displaying different images in each of the two or more areas.
[0047] In one embodiment of the present disclosure, the display area (120) may include a first display area (150) and a second display area (160). The first display area (150) may refer to a portion of the display area (120). The second display area (160) may refer to a portion of the display area (120) that is different from the first display area (150).
[0048] In one embodiment of the present disclosure, an image displayed in a first display area (150) may be referred to as a first sub-screen (151). An image displayed in a second display area (160) may be referred to as a second sub-screen (161).
[0049] The electronic device (100) can display a first sub-screen (151) and a second sub-screen (161) in a multi-view manner through the display (110) depending on the acquired image signal or the operating method of the electronic device (100). Accordingly, a user can view two different images through the electronic device (100).
[0050] However, the present disclosure is not limited thereto, and it goes without saying that the electronic device (100) can display three or more sub-screens through the display (110) in a multi-view manner.
[0051] In one embodiment of the present disclosure, the electronic device (100) may include an input device capable of obtaining input provided by a user. Additionally, the electronic device (100) may be connected to an external input device capable of obtaining input through a communication interface or an input / output interface.
[0052] In one embodiment of the present disclosure, the input device or external input device may be a device for providing input to a screen displayed on the display (110) through an indicator (140) displayed on the display (110).
[0053] In one embodiment of the present disclosure, a user's input obtained through an input device or an external input device may be displayed as an indicator (140) on a display (110). In one embodiment of the present disclosure, the indicator is illustrated in the form of an arrow-shaped cursor in FIG. 1, but the present disclosure is not limited thereto. The indicator may be displayed on the display (110) in various shapes, such as a circle or a cross.
[0054] In one embodiment of the present disclosure, the input provided by the input device or external input device may include an action of clicking the screen through the indicator (140), an action of dragging and dropping the screen, an action of scrolling the screen, etc.
[0055] In this case, the action of clicking on the screen may mean selecting an area of the screen. In this case, the action of clicking may include two distinct clicks (e.g., a left-click and a right-click of a mouse).
[0056] In one embodiment of the present disclosure, the input device or external input device may include a mouse, a controller, a controller for VR (Virtual Reality), a touch pad, an electronic device including a touch pad, etc. However, the present disclosure is not limited thereto, and the input device or external input device may be an electronic device that can move an indicator (140) displayed on a display (110) and input a clicking motion, a drag and drop motion, or a scrolling motion of a screen through the indicator (140).
[0057] In one embodiment of the present disclosure, the electronic device (100) can display an image displayed on the display (110) in a multi-view mode through an input obtained through an input device or an external input device.
[0058] In one embodiment of the present disclosure, the electronic device (100) may obtain an input including an operation of selecting a portion of a screen (130) through an indicator (140) from an input device or an external input device. Based on the obtained input, the electronic device (100) may display two or more sub-screens on the display (110) in a multi-view manner. Specifically, when the electronic device (100) obtains an input of selecting a portion of the screen (130) through the indicator (140), the electronic device (100) may provide a sub-screen corresponding to the selected portion of the screen in a multi-view manner.
[0059] In one embodiment of the present disclosure, a screen (130) displayed on a display (110) may include a plurality of components. In one embodiment of the present disclosure, the plurality of components may include menus, advertisements, applications, recently watched lists, recommended videos, program schedules, etc. The screen (130) may be a home screen including a plurality of components.
[0060] In one embodiment of the present disclosure, when an input for selecting one of a plurality of components included in a home screen is obtained through an indicator (140), the electronic device (100) can provide the home screen as a first sub-screen (151) and a screen corresponding to the selected one of the components as a second sub-screen (161).
[0061] Through this, a user using an electronic device (100) can view multiple sub-screens provided in a multi-view manner by using an input device or an external input device that can provide an input for selecting a portion of a screen (130) through an indicator (140). The operation steps or time required to operate the electronic device (100) in a multi-view manner can be shortened, thereby improving the user experience.
[0062] The effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned will be clearly understood by a person having ordinary skill in the art to which the present disclosure pertains from the present disclosure.
[0063] The present disclosure is not limited thereto, and the electronic device (100) can of course be operated in various ways in addition to displaying a screen in a multi-view manner. A user can easily utilize various operations that can be performed on the electronic device (100) through an input device or an external input device that can provide input using an indicator (140).
[0064] FIG. 2 is a flowchart illustrating the operation of an electronic device according to one embodiment of the present disclosure.
[0065] Referring to FIGS. 1 and 2, in one embodiment of the present disclosure, a method of operating an electronic device (100) may include a step (S100) of displaying a screen (130) through a display (110). In the step (S100) of displaying the screen (130) through the display (110), the electronic device (100) may control the display (110) to display the screen (130).
[0066] In one embodiment of the present disclosure, a method of operating an electronic device (100) may include a step (S200) of obtaining a first input for selecting one of a plurality of components included in a screen (130) through an indicator (140) displayed on a display (110).
[0067] In the step of obtaining a first input (S200), the electronic device (100) can obtain a first input for selecting one of a plurality of components included in the screen (130) using an indicator (140) through an input device or an external input device.
[0068] In one embodiment of the present disclosure, the operating method of the electronic device (100) may include a step (S300) of displaying a first sub-screen (151) corresponding to a screen (130) and a second sub-screen (161) corresponding to a component selected by a first input in a multi-view manner through a display (110).
[0069] In the step (S300) of displaying the first sub-screen (151) and the second sub-screen (161) in a multi-view manner, the electronic device (100) can control the display (110) to display the first sub-screen (151) corresponding to the screen (130) and the second sub-screen (161) corresponding to the component selected by the first input in a multi-view manner according to the first input.
[0070] However, the present disclosure is not limited thereto. In the step (S100) of displaying a screen (130) through a display (110), the displayed screen (130) may be the home screen illustrated in FIG. 1. The operating method of the electronic device (100) may further include a step of changing the image displayed on the display (110) to display the home screen.
[0071] At this time, the electronic device (100) may obtain an input requesting to display a home screen through an input device or an external input device. The electronic device (100) may also display the home screen through the display (110) depending on the obtained input. However, the input requesting to display the home screen at this time may be obtained not only through an indicator (140), but also by using a button such as a "remote control" or a "menu button" included in the electronic device (100), and is not limited to any one of them.
[0072] In addition, the first to eighth inputs disclosed in the present disclosure are distinguished for convenience of explanation and do not imply the order of inputs or priority of inputs.
[0073] FIG. 3 is a diagram illustrating an operation for determining the position of a screen in a multi-view manner according to one embodiment of the present disclosure. Hereinafter, the same configurations and steps as those described in FIGS. 1 and 2 are assigned the same drawing reference numerals, and redundant descriptions are omitted.
[0074] Referring to FIGS. 1, 2 and 3, in one embodiment of the present disclosure, FIG. 3 illustrates a method of displaying a plurality of sub-screens in a multi-view manner by an electronic device (100) through a plurality of operations.
[0075] In one embodiment of the present disclosure, at operation 300, the electronic device (100) may obtain a first input from an input device or an external input device, through an indicator (140), for selecting one of a plurality of components included in a screen (130).
[0076] In one embodiment of the present disclosure, in operation 310, the electronic device (100) may display a location selection interface (141) on the screen (130) that allows selection of a location to display a second sub-screen (161) corresponding to a component selected by the first input.
[0077] In one embodiment of the present disclosure, the position selection interface (141) may be an interface that can select the positions of the first sub-screen (151) and the second sub-screen (161) displayed in a multi-view manner within the display (110). In one embodiment of the present disclosure, the position selection interface (141) may provide an interface that can determine the position of the second sub-screen (161) as either the left or right side of the display (110).
[0078] However, the present disclosure is not limited thereto, and depending on the multi-view method provided by the electronic device (100), the position selection interface (141) may be provided as an interface that can determine the position of the second sub-screen (161) as either the upper or lower side of the display (110). In addition, when the electronic device (100) provides a screen in a multi-view method including three or more sub-screens, the position selection interface (141) may be provided as an interface that can determine the position of a sub-screen newly added by a first input.
[0079] In one embodiment of the present disclosure, a user may provide an input to select a second sub-screen (161) to be displayed at a desired location among the location selection interfaces (141) via an indicator (140).
[0080] In one embodiment of the present disclosure, the operating method of the electronic device (100) may further include a step of obtaining an input for determining the positions of the first sub-screen (151) and the second sub-screen (161) through a position selection interface (141) between the step of obtaining a first input (S200) and the step of displaying the first sub-screen (151) and the second sub-screen (161) in a multi-view manner (S300).
[0081] In one embodiment of the present disclosure, in operation (320), the electronic device (100) can display a first sub-screen (151) in a first display area (150) and a second sub-screen (161) in a second display area (160) in a multi-view manner.
[0082] In one embodiment of the present disclosure, the first sub-screen (151) may be a screen corresponding to the screen (130). The first sub-screen (151) may be an image in which the screen (130) displayed in the display area (120) is reduced so that it is displayed in the first display area (150).
[0083] In one embodiment of the present disclosure, the second sub-screen (161) may be an image determined according to the type of the component selected by the first input. The type of the second sub-screen (161) may be determined in accordance with the type of the component selected by the first input. The types of each of the plurality of components and the type of the second sub-screen (161) will be described later with reference to FIG. 4.
[0084] FIG. 4 is a drawing for explaining the types of a plurality of components included in a screen according to one embodiment of the present disclosure.
[0085] Referring to FIGS. 1 and 4, in one embodiment of the present disclosure, FIG. 4 illustrates a plurality of components included in a screen (130) displayed on a display (110). In one embodiment of the present disclosure, the types of the plurality of components may differ depending on their respective functions.
[0086] At this time, the screen (130) illustrated in FIG. 4 may be a home screen including multiple components of various types. The home screen may be a screen displayed when the electronic device (100) is driven, or a screen displayed in response to an input requesting display of a screen including multiple components.
[0087] In one embodiment of the present disclosure, the plurality of components may include a first component (400). The first component (400) may be of a type that includes a plurality of icons representing content for a specific field, such as search, games, images, broadcasts, applications, program schedules, etc. The first component (400) may be of a type that allows access to content for a specific field. The first component (400) may also be referred to as a menu, a navigation point, etc.
[0088] In one embodiment of the present disclosure, if the first input is an action of selecting a first component (400) through an indicator (140), a screen including content of a specific field corresponding to the first component (400) may be provided as a second sub-screen (161). In one embodiment of the present disclosure, if the first input is an action of selecting an icon for any one field among a plurality of icons included in the first component (400) through an indicator (140), a screen including content of the corresponding field may be provided as a second sub-screen (161).
[0089] Specifically, in one embodiment of the present disclosure, when the first input is an action of selecting an icon corresponding to “game” among the first components (400) through the indicator (140), a screen including at least one of a list of recently executed games, a list of games executable on the electronic device (100), or a list of recommended games may be provided as the second sub-screen (161). In addition, when the first input is an action of selecting an icon corresponding to “search” among the first components (400), a screen including a search window for searching for an action executable on the electronic device (100), a search window of a web browser, or the like may be provided as the second sub-screen (161).
[0090] However, the present disclosure is not limited thereto, and the type of icon included in the first component (400), the second sub-screen (161) provided when the corresponding icon is selected, etc. may be changed, and these may be preset.
[0091] In one embodiment of the present disclosure, the plurality of components may include a second component (410). The second component (410) may be of a type that includes a plurality of applications that can be executed on the electronic device (100), such as a video application, a music application, an OTT (Over The Top) application, etc.
[0092] In one embodiment of the present disclosure, when the first input is an action to select a second component (410) through an indicator (140), a screen on which an application selected in response to the second component (410) is executed may be provided as a second sub-screen (161). In one embodiment of the present disclosure, when the first input is an action to select one of a plurality of applications included in the second component (410) through an indicator (140), a screen corresponding to the selected application may be provided as a second sub-screen (161).
[0093] At this time, the screen corresponding to the selected application may be a screen preset to be displayed when each application is initially run.
[0094] In one embodiment of the present disclosure, the plurality of components may include a third component (420). The third component (420) may be of a type that includes an advertisement. The advertisement included in the third component (420) may include at least one of an image, a video, or text.
[0095] In one embodiment of the present disclosure, when the first input is an action of selecting a third component (420), a screen corresponding to the third component (420) may be provided as a second sub-screen (161). In one embodiment of the present disclosure, depending on the settings of the advertisement included in the third component (420), a screen including a website, video, purchase page, or content linked to the advertisement may be provided as a second sub-screen (161).
[0096] In one embodiment of the present disclosure, the plurality of components may include a fourth component (430). The fourth component (430) may be of a type that indicates content recommended to the user, such as videos or channels, such as a recently watched list or recommended videos. The content displayed in the fourth component (430) may be determined based on the user's usage history or preferences.
[0097] In one embodiment of the present disclosure, when the first input is an action of selecting the fourth component (430) through the indicator (140), a screen including content recommended to the user corresponding to the fourth component (430) may be provided on the second sub-screen (161).
[0098] In one embodiment of the present disclosure, the plurality of components may include a fifth component (440). The fifth component (440) may be of a type that represents a background or empty space included in the screen (130).
[0099] In one embodiment of the present disclosure, when the first input is an action of selecting a fifth component (440) through an indicator (140), an interface including a plurality of contents recently used by the user through the electronic device (100) in response to the fifth component (440) may be displayed on the screen (130). As an input for selecting one of the contents among the interfaces is acquired through the indicator (140), the electronic device (100) may provide a screen including the selected contents as a second sub-screen (161).
[0100] The types, arrangements, sizes, shapes, etc. of the plurality of components illustrated in FIG. 4 are merely examples, and the present disclosure is not limited thereto. It goes without saying that the types, arrangements, sizes, shapes, etc. of the plurality of components included in the home screen may be set differently.
[0101] FIG. 5 is a diagram illustrating a multi-view method for displaying three or more sub-screens according to one embodiment of the present disclosure. Components identical to those described in FIGS. 1 and 3 are assigned the same drawing reference numerals, and redundant descriptions are omitted.
[0102] Referring to FIG. 5, in one embodiment of the present disclosure, a method of displaying three or more sub-screens in a multi-view manner by an electronic device (100) is illustrated as a plurality of operations.
[0103] In one embodiment of the present disclosure, in operation 500, the electronic device (100) can display a first sub-screen (151) on a first sub-screen (150) and a second sub-screen (161) on a second sub-screen (160) in a multi-view manner.
[0104] In one embodiment of the present disclosure, at operation 500, the electronic device (100) may obtain an input for selecting one of a plurality of components included in a first sub-screen (151) through an indicator (140). At this time, the input for selecting one of the components included in the first sub-screen (151) may be the same type of input as the first input for selecting one of the components included in the screen (130) illustrated in FIGS. 1 and 3.
[0105] A user can select one of the plurality of components included in the first sub-screen (151) using an indicator (140) through an input device or an external input device.
[0106] In one embodiment of the present disclosure, in operation 510, the electronic device (100) may display three sub-screens (521, 531, 541) in a multi-view manner based on an input for selecting one component included in the first sub-screen (521). At this time, the type of the sub-screen to be added may be determined corresponding to the type of one of the selected components.
[0107] The electronic device (100) can divide the display area (120) into three display areas (520, 530, 540). The electronic device (100) can display a sub-screen in each of the three display areas (520, 530, 540).
[0108] At this time, the size and arrangement of each of the three sub-screens (521, 531, 541) may be preset. However, the present disclosure is not limited thereto, and the electronic device (100) may additionally provide an interface for selecting the size or arrangement of the additional sub-screen when an input for selecting any one component included in the first sub-screen (521) is obtained.
[0109] The present disclosure is not limited thereto, and it is to be understood that the electronic device (100) can provide four or more sub-screens in a multi-view manner.
[0110] FIG. 6 is a diagram for explaining sub-screens provided in multiple modes in an electronic device according to an embodiment of the present disclosure. FIG. 7 is a flowchart for explaining sub-screens provided in multiple modes in an electronic device according to an embodiment of the present disclosure. Hereinafter, the same configurations and steps as those described in FIGS. 1 and 3 are given the same reference numerals, and any duplicate descriptions are omitted.
[0111] Referring to FIGS. 1 and 6, in one embodiment of the present disclosure, FIG. 6 illustrates a method of providing a plurality of sub-screens provided in a multi-view manner by an electronic device (100) in a plurality of modes through a plurality of operations.
[0112] Referring to FIGS. 3, 6 and 7, in one embodiment of the present disclosure, the method of operating the electronic device (100) may include a step (S400) of selecting one of the first sub-screen (151) and the second sub-screen (161) displayed in a multi-view manner through the indicator (140), or obtaining a second input of hovering the indicator (140) on one of the first sub-screen (151) and the second sub-screen (161).
[0113] In one embodiment of the present disclosure, the step (S400) of obtaining a second input may be performed after the step (S300) of displaying the first sub-screen (151) and the second sub-screen (161) in a multi-view manner through the display (110).
[0114] In one embodiment of the present disclosure, in the step (S400) of obtaining a second input, the electronic device (100) may select one of the first sub-screen (151) and the second sub-screen (161) displayed in a multi-view manner using an indicator (140) through an input device or an external input device, or obtain a second input of hovering the indicator (140) on one of the first sub-screen (151) and the second sub-screen (161).
[0115] In one embodiment of the present disclosure, the selection action performed in the second input may be different from the selection action performed in the first input. In one embodiment of the present disclosure, if the input device or the external input device is a mouse, the first input may be a selection through a right-click of the mouse, and the second input may be a selection through a left-click of the mouse. However, the present disclosure is not limited thereto. If the input device or the external input device is a device capable of performing two distinct click actions, the first input and the second input may be inputs selected through different click actions.
[0116] In one embodiment of the present disclosure, the operating method of the electronic device (100) may include a step (S410) of providing one of the first sub-screens (151) and the second sub-screen (161) corresponding to the second input in a first mode, which is displayed in a multi-view manner.
[0117] In one embodiment of the present disclosure, in the step (S410) of providing one sub-screen corresponding to the second input in the first mode, operation 600 may be performed.
[0118] In one embodiment of the present disclosure, the electronic device (100) may provide sound for a sub-screen provided in a "first mode" among a plurality of sub-screens provided in a multi-view manner. A user may receive sound from the electronic device (100) for a sub-screen provided in the first mode among the plurality of sub-screens.
[0119] Additionally, the electronic device (100) can control the sound volume of a sub-screen provided in a "first mode" among a plurality of sub-screens provided in a multi-view manner. A user can control the sound volume of a sub-screen provided in the first mode among a plurality of sub-screens by inputting a sound control request through an input device or an external input device.
[0120] In one embodiment of the present disclosure, a sub-screen provided in a first mode among a plurality of sub-screens may be displayed to include a border surrounding the sub-screen.
[0121] Accordingly, the user can easily select a sub-screen from among multiple sub-screens provided in a multi-view manner, from which he or she wants to hear sound, or a sub-screen from which he or she wants to adjust the sound volume, by providing a second input through an indicator (140).
[0122] In one embodiment of the present disclosure, the operating method of the electronic device (100) may include a step (S500) of obtaining a third input for selecting one of the first sub-screen (151) and the second sub-screen (152) provided in the first mode among the first sub-screen (151) and the second sub-screen (152) displayed in a multi-view manner through an indicator (140).
[0123] In the step of obtaining a third input (S500), the electronic device (100) can obtain a third input of selecting one of the first sub-screens (151) and the second sub-screens (152) provided in the first mode among the first sub-screens (151) and the second sub-screens (152) displayed in a multi-view manner using an indicator (140).
[0124] In one embodiment of the present disclosure, the selection action performed in the third input may be identical to the selection action performed in the second input. In one embodiment of the present disclosure, when the second input is a selection via a left-click of the mouse, the third input may also be a selection via a left-click of the mouse.
[0125] In one embodiment of the present disclosure, the operating method of the electronic device (100) may include a step (S510) of providing one of the sub-screens provided in the first mode selected by the third input in a second mode different from the first mode.
[0126] In one embodiment of the present disclosure, in the step (S510) of providing one sub-screen corresponding to the third input in the second mode, operation 610 may be performed.
[0127] In one embodiment of the present disclosure, the electronic device (100) may provide an editing function, such as adjusting the size of a sub-screen provided in a "second mode" among a plurality of sub-screens provided in a multi-view manner, changing the position of the sub-screen, deleting the sub-screen so that it is not displayed in a multi-view manner, or changing the content included in the sub-screen. A user may input a sub-screen editing request through an input device or an external input device to edit a sub-screen provided in a second mode among a plurality of sub-screens.
[0128] In one embodiment of the present disclosure, the electronic device (100) may display an editing interface for performing the above-described edits on a sub-screen provided in the second mode. At this time, the editing interface may include a plurality of editing icons corresponding to each of the above-described edits.
[0129] In one embodiment of the present disclosure, a sub-screen provided in a second mode among a plurality of sub-screens may be displayed to include a border surrounding the sub-screen and the editing interface, respectively.
[0130] Hereinafter, the operation of the electronic device (100) when a fourth input performing a scroll operation through an indicator (140) on a sub-screen provided in the second mode is acquired, or when a fifth input performing a drag-and-drop operation through an indicator (140) is acquired, will be described later with reference to FIGS. 8 to 10.
[0131] In one embodiment of the present disclosure, the operating method of the electronic device (100) may include a step (S600) of obtaining a sixth input for selecting one of the first sub-screen (151) and the second sub-screen (161) provided in a multi-view manner through an indicator (140) in a manner different from the second input.
[0132] In one embodiment of the present disclosure, the step (S600) of acquiring a sixth input may be performed after the step (S300) of displaying the first sub-screen (151) and the second sub-screen (161) in a multi-view manner through the display (110). However, the present disclosure is not limited thereto, and the step (S600) of acquiring a sixth input may also be performed after the step (S400) of acquiring a second input or the step (S500) of acquiring a third input.
[0133] In one embodiment of the present disclosure, the selection action performed in the sixth input may be different from the selection action performed in the second input. In one embodiment of the present disclosure, the sixth input may be a selection of two consecutive left-clicks of the mouse within a preset interval. In one embodiment of the present disclosure, if the left-click of the mouse is performed twice at an interval longer than the preset interval, the electronic device (100) may determine that the second and third inputs have been acquired.
[0134] In the step (S600) of obtaining the sixth input, the electronic device (100) can obtain the sixth input of selecting one of the first sub-screen (151) and the second sub-screen (161) provided in a multi-view manner through the indicator (140) in a manner different from the second input.
[0135] In one embodiment of the present disclosure, the operating method of the electronic device (100) may include a step (S610) of providing one of the sub-screens corresponding to the sixth input among the first sub-screen (151) and the second sub-screen (161) displayed in a multi-view manner in a third mode different from the first mode and the second mode.
[0136] In one embodiment of the present disclosure, in the step (S610) of providing one sub-screen corresponding to the sixth input in the third mode, operation 620 may be performed.
[0137] In one embodiment of the present disclosure, when a sub-screen provided in a "third mode" among multiple sub-screens provided in a multi-view manner includes content that can be selected by the user, the electronic device (100) may provide a function that allows the user to select the content using an indicator (140). When a sub-screen provided in a "third mode" includes multiple content that can be selected by the user, the electronic device (100) may provide a function that allows the user to select the desired content using an indicator (140) within the sub-screen.
[0138] In one embodiment of the present disclosure, if the sub-screen provided in "3rd mode" corresponds to an OTT application, the sub-screen may include multiple contents. The electronic device (100) may provide a function for selecting desired contents from among the multiple contents within the sub-screen provided in the 3rd mode by moving the indicator (140) and performing a selection operation.
[0139] In one embodiment of the present disclosure, a sub-screen provided in a third mode among a plurality of sub-screens may be displayed to include a border surrounding each of the sub-screens and the content selected within the sub-screen.
[0140] Hereinafter, the operation of the electronic device (100) according to the seventh input obtained by performing an operation of selecting through an indicator (140) on a sub-screen provided in the third mode or performing an operation of dragging and dropping content through an indicator (140) will be described later in FIGS. 11 to 16.
[0141] FIG. 8 is a diagram for explaining an operation of adjusting the size of a sub-screen by acquiring an input for performing a scroll operation according to one embodiment of the present disclosure. FIG. 9 is a diagram for explaining an operation of changing the position of a sub-screen by acquiring an input for performing a drag-and-drop operation according to one embodiment of the present disclosure. FIG. 10 is a flowchart for explaining adjusting the size of a sub-screen and changing the position of a sub-screen according to one embodiment of the present disclosure.
[0142] Referring to FIGS. 6 and 8, in one embodiment of the present disclosure, FIG. 8 illustrates a method of adjusting the size of a sub-screen (161) by obtaining an input for performing a scroll operation by an electronic device (100) as a plurality of operations.
[0143] Referring to FIGS. 6, 7, 8 and 10, in one embodiment of the present disclosure, the method of operating the electronic device (100) may include a step (S520) of obtaining a fourth input for performing a scroll operation on any one of the sub-screens (161) provided in the second mode through the indicator (140).
[0144] In one embodiment of the present disclosure, operation 800 may be performed in the step (S520) of obtaining a fourth input for performing a scroll operation on a sub-screen (161) provided in the second mode.
[0145] In one embodiment of the present disclosure, the step (S520) of obtaining a fourth input for performing a scroll operation may be performed after the step (S510) of providing one sub-screen corresponding to the third input in the second mode.
[0146] In one embodiment of the present disclosure, in the step (S520) of obtaining a fourth input for performing a scroll operation, the electronic device (100) may obtain a fourth input for performing a scroll operation on a sub-screen (161) provided in a second mode among a plurality of sub-screens provided in a multi-view manner by using an indicator (140) through an input device or an external input device.
[0147] In one embodiment of the present disclosure, a “scroll operation” may be an operation of positioning an indicator (140) on a sub-screen (161) provided in a second mode, moving the scroll of a mouse, or using a touch pad or a terminal of a controller that can provide an input corresponding to the scroll of a mouse.
[0148] In one embodiment of the present disclosure, the operating method of the electronic device (100) may include a step (S530) of adjusting the size of a sub-screen (161) provided in a second mode based on a fourth input.
[0149] In one embodiment of the present disclosure, in the step (S530) of adjusting the size of the sub-screen (161) provided in the second mode, operation 810 may be performed.
[0150] In one embodiment of the present disclosure, in the step (S530) of adjusting the size of the sub-screen (161) provided in the second mode based on the fourth input, the electronic device (100) can adjust the size of the sub-screen (161) provided in the second mode displayed through the display (110) based on the fourth input.
[0151] At this time, any one of the sub-screens (161) provided in the second mode may be the second sub-screen (161).
[0152] In one embodiment of the present disclosure, in the step (S530) of adjusting the size of the second sub-screen (161), the electronic device (100) can reduce or increase the size of the second sub-screen (161). In one embodiment of the present disclosure, if the scroll operation included in the fourth input is a first direction preset in a direction of reducing the size of the sub-screen, the electronic device (100) can reduce the size of the second sub-screen (161). In one embodiment of the present disclosure, if the scroll operation included in the fourth input is a second direction preset in a direction of increasing the size of the sub-screen, the electronic device (100) can increase the size of the second sub-screen (161). At this time, the first direction and the second direction may be different directions.
[0153] In one embodiment of the present disclosure, FIG. 8 illustrates an electronic device (100) increasing the size of a second sub-screen (161) based on a fourth input. In one embodiment of the present disclosure, in this case, the first sub-screen (151) may be reduced in size.
[0154] In one embodiment of the present disclosure, the step of acquiring a fourth input (S520) and the step of adjusting the size of the sub-screen (161) provided in the second mode based on the fourth input (S530) are illustrated as being separate from each other, but the present disclosure is not limited thereto. In one embodiment of the present disclosure, it goes without saying that the operation of acquiring a fourth input and the operation of adjusting the size of the sub-screen (161) provided in the second mode based on the acquired fourth input can be performed in a single step.
[0155] Referring to FIGS. 6 and 9, in one embodiment of the present disclosure, FIG. 9 illustrates a method of changing the position of a sub-screen (901) by obtaining an input for performing a drag-and-drop operation by an electronic device (100) as a plurality of operations.
[0156] Referring to FIGS. 6, 7, 9 and 10, in one embodiment of the present disclosure, the method of operating the electronic device (100) may include a step (S540) of obtaining a fifth input for performing an operation of dragging and dropping any one of the sub-screens (901) provided in the second mode to a specific area within the display (110) through an indicator (140).
[0157] In one embodiment of the present disclosure, operation 901 may be performed in the step (S540) of obtaining a fifth input for performing a drag-and-drop operation on a sub-screen (901) provided in the second mode.
[0158] In one embodiment of the present disclosure, the step (S540) of obtaining a fifth input for performing a drag-and-drop operation may be performed after the step (S510) of providing one sub-screen corresponding to the third input in the second mode.
[0159] In one embodiment of the present disclosure, in the step (S540) of obtaining a fifth input for performing a drag-and-drop operation, the electronic device (100) may obtain a fifth input for performing a drag-and-drop operation on a sub-screen (901) provided in a second mode among a plurality of sub-screens provided in a multi-view manner by using an indicator (140) through an input device or an external input device.
[0160] In one embodiment of the present disclosure, a “drag and drop operation” may be an operation of selecting a sub-screen (901) provided in the second mode using an indicator (140) and dragging it to a specific location, then deselecting and dropping it.
[0161] In one embodiment of the present disclosure, the operating method of the electronic device (100) may include a step (S550) of changing the position of the sub-screen (901) provided in the second mode based on the fifth input.
[0162] In one embodiment of the present disclosure, in the step (S550) of changing the position of the sub-screen (901) provided in the second mode, operation 910 may be performed.
[0163] In one embodiment of the present disclosure, in the step (S550) of changing the position of the sub-screen (901) provided in the second mode, the electronic device (100) can change the position of the sub-screen (901) provided in the second mode within the display (110) based on the fifth input.
[0164] In one embodiment of the present disclosure, FIG. 9 illustrates four sub-screens being displayed in a multi-view manner. In one embodiment of the present disclosure, the four sub-screens may include a first sub-screen (901) and a second sub-screen (902). In this case, the sub-screen (901) provided in the second mode may be the first sub-screen (901).
[0165] In one embodiment of the present disclosure, in the step (S550) of changing the position of the sub-screen (901) provided in the second mode, the electronic device (100) can change the position of the first sub-screen (901) within the display (110, see FIG. 1) displayed in a multi-view manner.
[0166] In one embodiment of the present disclosure, as the fifth input is an action of dragging the first sub-screen (901) located at the lower right of the display (110) and dropping it at the upper left of the display (110), the electronic device (100) can change the position of the first sub-screen (901) from the lower right to the upper left of the display (110).
[0167] At this time, the second sub-screen (902) displayed on the upper left of the display (110) may be changed to a different location. While FIG. 9 illustrates the change in the location of the second sub-screen (902) to the right, the present disclosure is not limited thereto. The changed location of the second sub-screen (902) may be determined according to preset conditions.
[0168] In one embodiment of the present disclosure, a user can provide a sub-screen displayed in a multi-view manner in a second mode through a third input by inputting using an indicator (140). The user can easily adjust the size or change the position of the sub-screen provided in the second mode through a fourth or fifth input.
[0169] FIG. 11 is a diagram for explaining an operation of displaying a sub-screen corresponding to content through an input of dragging and dropping content included in a multi-view type sub-screen according to one embodiment of the present disclosure. FIG. 12 is a flowchart for explaining an operation of displaying a sub-screen corresponding to content through an input of dragging and dropping content included in a multi-view type sub-screen according to one embodiment of the present disclosure.
[0170] Referring to FIG. 11, in one embodiment of the present disclosure, a method of displaying a sub-screen (1151) corresponding to content through an input of dragging and dropping content included in a multi-view sub-screen (1141) by an electronic device (100) is illustrated as a plurality of operations.
[0171] Referring to FIGS. 1, 11, and 12, in one embodiment of the present disclosure, a method of operating an electronic device (100) may include a step (S300) of displaying a first sub-screen (1131) on a first display area (1130) and a second sub-screen (1141) on a second display area (1140) in a multi-view manner through a display (110) including a first display area (1130) and a second display area (1140).
[0172] In one embodiment of the present disclosure, the step (S300) of displaying a first sub-screen (1131) in a first display area (1130) and displaying a second sub-screen (1141) in a second display area (1140) may be performed after the step (S200) of acquiring a first input illustrated in FIG. 2.
[0173] In one embodiment of the present disclosure, in the step (S300) of displaying the first sub-screen (1131) and the second sub-screen (1141), the electronic device (100) can display the first sub-screen (1131) in the first display area (1130) and the second sub-screen (1141) in the second display area (1140) in a multi-view manner through the display (110).
[0174] In one embodiment of the present disclosure, the second sub-screen (1141) may include at least one content. In one embodiment of the present disclosure, the at least one content included in the second sub-screen (1141) may include a video, a file, text, an image, a website, an application, and the like.
[0175] In one embodiment of the present disclosure, the first sub-screen (1131) may be a screen displayed based on an image signal generated by the electronic device (100). In one embodiment of the present disclosure, the second sub-screen (1141) may be a screen displayed based on an external image signal acquired from an external electronic device connected to the electronic device (100).
[0176] In one embodiment of the present disclosure, the electronic device (100) can be connected to an external electronic device via a communication interface or an input / output interface. The electronic device (100) can obtain an external image signal from the external electronic device.
[0177] In one embodiment of the present disclosure, the electronic device (100) may display a first sub-screen (1131) corresponding to an image signal generated in the electronic device (100) or acquired based on data acquired from the outside, on a first display area (1130). The electronic device (100) may provide a second sub-screen (1141) based on the acquired external image signal, on a second display area (1140). In this case, the second sub-screen (1141) may be the same screen as the screen displayed on the external electronic device.
[0178] In one embodiment of the present disclosure, a user can view a first sub-screen (1131) corresponding to a video signal of the electronic device (100) and a second sub-screen (1141) corresponding to an external video signal of an external electronic device together through an electronic device (100) that provides a first sub-screen (1131) and a second sub-screen (1141) in a multi-view manner. In addition, the user can view the second sub-screen (1141) corresponding to the external video signal in a larger size through the display (110) of the electronic device (100) that is larger in size compared to a display included in an external electronic device.
[0179] In one embodiment of the present disclosure, the operating method of the electronic device (100) may include a step (S700) of obtaining a seventh input for performing an operation of dragging and dropping content included in a second sub-screen (1141) to a first sub-screen (1131) through an indicator (140) displayed on a display (110).
[0180] In one embodiment of the present disclosure, in the step of obtaining the seventh input (S700), operation 1100 may be performed.
[0181] In one embodiment of the present disclosure, in the step of obtaining a seventh input (S700), the electronic device (100) may obtain a seventh input to perform an operation of dragging and dropping content included in a second sub-screen (1141) to a first sub-screen (1131) through an indicator (140). At this time, the operation of dragging and dropping content included in the second sub-screen (1141) to the first sub-screen (1131) may mean an operation of selecting one of a plurality of contents included in the second sub-screen (1141), dragging the selected content, moving the selected content to a first display area (1130), and then deselecting and dropping the selected content in the first display area (1130).
[0182] In one embodiment of the present disclosure, the second sub-screen (1141) may include multiple contents. The second sub-screen (1141) may include a screen of a platform or the like that includes multiple contents. The second sub-screen (1141) may include a screen of an OTT application that includes multiple videos. The seventh input may also mean an action of dragging and dropping any one of the multiple contents included in the second sub-screen (1141) to the first sub-screen (1131).
[0183] In one embodiment of the present disclosure, the seventh input refers to an input that includes an action of dragging and dropping any one of a plurality of contents included in the second sub-screen (1141) to the first sub-screen (1131) for convenience of explanation, and it goes without saying that the present invention can be applied even if the above-mentioned input is referred to by a name different from the seventh input. In one embodiment of the present disclosure, even if the above-mentioned input is referred to as the first input, it goes without saying that the actions illustrated in FIGS. 11 to 16 can be applied.
[0184] In one embodiment of the present disclosure, the operating method of the electronic device (100) may include a step (S800) of displaying a third sub-screen (1151) that is different from the first sub-screen (1131) and corresponds to content dragged and dropped by the seventh input in the first display area (1130), based on the seventh input.
[0185] In one embodiment of the present disclosure, in the step (S800) of displaying a third sub-screen (1151) corresponding to content in the first display area (1130), operation 1110 may be performed.
[0186] In one embodiment of the present disclosure, in the step (S800) of displaying a third sub-screen (1151) corresponding to content in the first display area (1130), the electronic device (100) may, based on a seventh input, display a third sub-screen (1151) that is different from the first sub-screen (1131) and corresponds to content dragged and dropped by the seventh input in the first display area (1130).
[0187] In one embodiment of the present disclosure, the third sub-screen (1151) may be a screen corresponding to content dragged and dropped by the seventh input. The third sub-screen (1151) corresponding to content dragged and dropped by the seventh input and the operation of the electronic device (100) displaying the third sub-screen (1151) will be described later with reference to FIGS. 13 and 14.
[0188] In one embodiment of the present disclosure, the area of the first display area (1130) may be larger than the area of the second display area (1140). Accordingly, as the content included in the second sub-screen (1141) is displayed as the third sub-screen (1151) in the first display area (1130) by the seventh input, the user can view the content included in the second sub-screen (1141) on a large screen.
[0189] In addition, as one of the plurality of contents included in the second sub-screen (1141) is displayed on the third sub-screen (1151) by the seventh input, the user can view the desired content among the plurality of contents included in the second sub-screen (1141) on a large screen.
[0190] In one embodiment of the present disclosure, when the second sub-screen (1141) is a screen displayed based on an external image signal obtained from an external electronic device connected to the electronic device (100), the third sub-screen (1151) may not be a screen displayed by an external image signal obtained from the external electronic device.
[0191] In one embodiment of the present disclosure, the third sub-screen (1151) may be a screen displayed based on a video signal generated to display the third sub-screen (1151) in the electronic device (100). In one embodiment of the present disclosure, the third sub-screen (1151) may be a screen displayed corresponding to content included in the seventh input through casting.
[0192] In one embodiment of the present disclosure, the electronic device (100) may obtain a control signal from an external electronic device to display a screen corresponding to content dragged and dropped by the seventh input as a third sub-screen (1151). The third sub-screen (1151) may be a screen generated by the electronic device (100) based on the control signal, or displayed based on an acquired image signal.
[0193] In one embodiment of the present disclosure, in operation 1120, the second sub-screen (1141) provided in a multi-view manner may be changed. At this time, the third sub-screen (1151) may be displayed as is. As the screen displayed on an external electronic device connected to the electronic device (100) or the program being executed is changed, the second sub-screen (1141) based on an external image signal acquired from the external electronic device may be changed.
[0194] In one embodiment of the present disclosure, the user can drag and drop content he or she wants to continue viewing through the electronic device (100) from the second sub-screen (1141) through the seventh input across operations 1100 and 1110 to the first sub-screen (1131) so that it is displayed on the third sub-screen (1151). Thereafter, the user can change the screen displayed on the second sub-screen (1141) in operation 1120. Accordingly, the user can freely use the external electronic device and continue viewing the desired content through the third sub-screen (1151) of the electronic device (100).
[0195] FIG. 13 is a flowchart illustrating an operation for displaying a sub-screen corresponding to content when the content is included in an application according to one embodiment of the present disclosure. FIG. 14 is a flowchart illustrating an operation for displaying a sub-screen corresponding to content depending on the type of content according to one embodiment of the present disclosure. Hereinafter, steps identical to those described in FIG. 12 are assigned the same reference numerals, and redundant descriptions are omitted.
[0196] Hereinafter, FIGS. 13 and 14 may be an explanation of a case where the first sub-screen (1131) is a screen displayed based on an image signal generated in the electronic device (100), and the second sub-screen (1141) is a screen displayed based on an external image signal obtained from an external electronic device connected to the electronic device (100).
[0197] Referring to FIGS. 1, 11, 12, and 13, in one embodiment of the present disclosure, a method of operating an electronic device (100) may include a step of determining whether content included in a second sub-screen (1141) dragged and dropped by a seventh input is content included in an application.
[0198] In one embodiment of the present disclosure, in the step of determining whether content included in the second sub-screen (1141) is content included in an application, the electronic device (100) may determine whether the dragged-and-dropped content is content included in an application, such as a video or image included in an application such as an OTT application or a video application. If the second sub-screen (1141) is a screen displayed by executing an application, the electronic device (100) may determine that the dragged-and-dropped content by the seventh input is content included in the application.
[0199] In one embodiment of the present disclosure, the electronic device (100) can obtain control information from an external electronic device that the content included in the second sub-screen (1141) is content included in an application. If the second sub-screen (1141) is a screen corresponding to an external image signal generated by executing an application on the external electronic device, the external electronic device can provide the electronic device (100) with control information that the content included in the second sub-screen (1141) is content included in the application.
[0200] In one embodiment of the present disclosure, the operating method of the electronic device (100) may include a step (S710) of determining whether the application described above is installed in the electronic device (100) when it is determined that the content dragged and dropped by the seventh input is content included in the application. At this time, the electronic device (100) may determine whether the same application as the application executed on the external electronic device is installed in the electronic device (100) in order to display the second sub-screen (1141).
[0201] In one embodiment of the present disclosure, in the step (S710) of determining whether an application is installed, the electronic device (100) can determine whether an application including content dragged and dropped by the seventh input is installed on the electronic device (100). In one embodiment of the present disclosure, if the content dragged and dropped by the seventh input is content included in a specific OTT application, the electronic device (100) can determine whether the specific OTT application is installed on the electronic device (100).
[0202] In one embodiment of the present disclosure, the electronic device (100) can check whether an application including content dragged and dropped by the seventh input is installed in a memory (1902, see FIG. 19) to be described later.
[0203] In one embodiment of the present disclosure, the operating method of the electronic device (100) may include a step (S810) of displaying a third sub-screen (1151) in the first display area (1130) using the installed application when it is determined that an application installed in the electronic device (100) exists.
[0204] In one embodiment of the present disclosure, in the step (S810) of displaying a third sub-screen (1151) on the first display area (1130) using an installed application, the electronic device (100) can display the third sub-screen (1151) on the first display area (1130) using the installed application. The electronic device (100) can display the third sub-screen (1151) by executing the installed application.
[0205] In one embodiment of the present disclosure, upon acquiring the seventh input, the electronic device (100) may acquire a control signal for executing content dragged and dropped by the seventh input from an application from an external electronic device. The electronic device (100) may acquire an identifier (Identification) or Uniform Resource Locator (URL) of the content dragged and dropped by the seventh input from the external electronic device.
[0206] In one embodiment of the present disclosure, the electronic device (100) can display a third sub-screen (1151) on the first display area (1130) through an installed application using an acquired control signal, identifier, or URL.
[0207] In one embodiment of the present disclosure, when the application is an OTT application or a video platform application, the electronic device (100) can obtain an identifier (Identification) or Uniform Resource Locator (URL) of dragged and dropped content among a plurality of contents included in the application.
[0208] In one embodiment of the present disclosure, after executing an installed OTT application or video platform application, the electronic device (100) may provide a third sub-screen (1151) corresponding to the dragged-and-dropped content using an acquired identifier (Identification) or Uniform Resource Locator (URL).
[0209] In one embodiment of the present disclosure, the operating method of the electronic device (100) may include a step (S720) of checking whether an application for the electronic device for executing the dragged and dropped content by the seventh input exists when it is determined that no application installed on the electronic device (100) exists.
[0210] In one embodiment of the present disclosure, in the step (S720) of checking whether an application for an electronic device exists, the electronic device (100) can check whether an application for executing content dragged and dropped by the seventh input is also provided for the electronic device.
[0211] In one embodiment of the present disclosure, when the electronic device (100) is a smart TV and the external electronic device is a mobile device, the second sub-screen (1141) may include content executed through an application for the mobile device. The electronic device (100) may check whether an application for the smart TV is provided in order to execute content dragged and dropped on the electronic device (100) by the seventh input.
[0212] In one embodiment of the present disclosure, when it is determined that an application for the electronic device exists, the method of operating the electronic device (100) may include a step (S730) of installing the application on the electronic device (100).
[0213] In the step (S730) of installing an application on an electronic device (100), the electronic device (100) can install the application on the electronic device (100). At this time, the electronic device (100) can obtain the application from an external server, etc., through a communication interface (1904, see FIG. 19) and install the application on the electronic device (100).
[0214] In one embodiment of the present disclosure, the operating method of the electronic device (100) may perform a step (S810) of displaying a third sub-screen (1151) in a first display area (1130) using the installed application after a step (S730) of installing an application in the electronic device (100).
[0215] At this time, the third sub-screen (1151) may be a screen that is not displayed by mirroring the second sub-screen (1141), but is displayed based on a video signal generated to display the third sub-screen (1151) on the electronic device (100) by casting.
[0216] In one embodiment of the present disclosure, a user can perform other actions in addition to executing content through an application via an external electronic device. The user can multitask using the external electronic device.
[0217] In one embodiment of the present disclosure, when it is determined that there is no application for the electronic device, the operating method of the electronic device (100) may include a step (S820) of mirroring the second sub-screen (1141) in response to the seventh input and displaying it as a third sub-screen (1151) in the first display area (1130).
[0218] In one embodiment of the present disclosure, when the electronic device (100) determines that it cannot install an application for executing content dragged and dropped by the seventh input, it can mirror the second sub-screen (1141) and display it as a third sub-screen (1151) in the first display area (1130).
[0219] Referring to FIGS. 1, 11, 12 and 14, in one embodiment of the present disclosure, the method of operating the electronic device (100) may include a step of determining whether content included in a second sub-screen (1141) dragged and dropped by a seventh input is content included in a website.
[0220] In one embodiment of the present disclosure, in the step of determining whether content included in the second sub-screen (1141) is content included in a website, the electronic device (100) may determine whether the dragged-and-dropped content is content included in the website, such as a video or image provided through the website. If the second sub-screen (1141) is a screen displayed by executing the website, the electronic device (100) may determine that the dragged-and-dropped content by the seventh input is content included in the website.
[0221] In one embodiment of the present disclosure, the electronic device (100) can obtain control information from an external electronic device that the content included in the second sub-screen (1141) is content included in a website. If the second sub-screen (1141) is a screen corresponding to an external video signal generated by executing a website on the external electronic device, the external electronic device can provide the electronic device (100) with control information that the content included in the second sub-screen (1141) is content included in a website.
[0222] In one embodiment of the present disclosure, the operating method of the electronic device (100) may include a step (S730) of determining whether the electronic device (100) and an external electronic device are connected through the same network when it is determined that the content dragged and dropped by the seventh input is content included in a website.
[0223] In one embodiment of the present disclosure, in the step (S730) of determining whether or not a connection is made through the same network, the electronic device (100) can check the network to which the electronic device (100) is connected and the network to which the external electronic device is connected.
[0224] In an embodiment of the present disclosure, when an electronic device (100) and an external electronic device are connected using a Wi-Fi network, the electronic device (100) can check the SSID (Service Set Identifier) of the network to which the electronic device (100) is connected and the SSID of the network to which the external electronic device is connected. The electronic device (100) can check whether the electronic device (100) and the external electronic device are connected through a network having the same SSID.
[0225] However, the present disclosure is not limited thereto, and when the electronic device (100) and an external electronic device are connected through a wired network, the electronic device (100) can check whether the electronic device (100) and the external electronic device are connected through the same router.
[0226] In one embodiment of the present disclosure, the operating method of the electronic device (100) may include a step (S731) of obtaining a URL, which is a website address for executing content dragged and dropped by a seventh input, through a network connected to the external electronic device, when it is determined that the electronic device (100) and the external electronic device are connected through the same network.
[0227] In one embodiment of the present disclosure, the electronic device (100) can obtain a URL, which is a website address for executing content dragged and dropped directly from the external electronic device through the network by a seventh input, when it is determined that the electronic device (100) and the external electronic device are connected through the same network.
[0228] In one embodiment of the present disclosure, the operating method of the electronic device (100) may include a step (S732) of obtaining a URL, which is a website address, from the external electronic device through a server when it is determined that the electronic device (100) and the external electronic device are connected to each other through different networks.
[0229] In one embodiment of the present disclosure, when it is determined that the electronic device (100) and the external electronic device are connected through different networks, the electronic device (100) can obtain a URL, which is a website address for executing content dragged and dropped by the seventh input, through a server connecting the electronic device (100) and the external electronic device.
[0230] In one embodiment of the present disclosure, the operating method of the electronic device (100) may include a step (S830) of displaying a third sub-screen (1151) executed using a URL, which is a website address obtained using a web browser, in a first display area (1130).
[0231] In one embodiment of the present disclosure, in the step (S830) of displaying the third sub-screen (1151) in the first display area (1130), the electronic device (100) may execute a web browser and display the third sub-screen (1151) that appears using the URL, which is an acquired website address, in the first display area (1130).
[0232] In one embodiment of the present disclosure, the electronic device (100) may acquire a URL, which is a website address that can execute the third sub-screen (1151) via a web browser, rather than mirroring the second sub-screen (1141) to display the third sub-screen (1151) corresponding to the seventh input. Through this, the user may perform multitasking in addition to executing content via a web browser via an external electronic device.
[0233] Referring again to FIG. 14, in one embodiment of the present disclosure, the method of operating the electronic device (100) may include a step of determining whether content dragged and dropped by the seventh input is a file stored in an external electronic device.
[0234] In one embodiment of the present disclosure, in the step of determining whether the content dragged and dropped by the seventh input is a file stored in an external electronic device, the electronic device (100) can obtain information from the external electronic device that the content included in the second sub-screen (1141) is content included in a file stored in the external electronic device.
[0235] In one embodiment of the present disclosure, the content dragged and dropped by the seventh input may be content included in a file such as an image, video, or text stored in an external electronic device.
[0236] In one embodiment of the present disclosure, the operating method of the electronic device (100) may include a step (S740) of obtaining a file from an external electronic device when it is determined that the content dragged and dropped by the seventh input is content included in a file stored in the external electronic device.
[0237] In one embodiment of the present disclosure, in the step (S740) of obtaining a file from an external electronic device, the electronic device (100) can obtain a file from the external electronic device.
[0238] In one embodiment of the present disclosure, when an electronic device (100) and an external electronic device are connected via the same network, the electronic device (100) can obtain a file directly from the external electronic device via the network through a seventh input. In one embodiment of the present disclosure, when an electronic device (100) and an external electronic device are connected via different networks, the electronic device (100) can obtain a file via a server connecting the external electronic device.
[0239] However, the present disclosure is not limited thereto, and it is obvious that the method of obtaining a file from an external electronic device may be determined depending on the method by which the electronic device (100) and the external electronic device are connected, such as via Bluetooth or wired connection.
[0240] In one embodiment of the present disclosure, the operating method of the electronic device (100) may include a step (S840) of displaying a third sub-screen (1151) in a first display area (1130) using an acquired file.
[0241] In one embodiment of the present disclosure, in the step (S840) of displaying a third sub-screen (1151) on the first display area (1130) using the acquired file, the electronic device (100) may execute the acquired file to display a third sub-screen (1151) including content corresponding to the seventh input on the first display area (1130).
[0242] Referring again to FIG. 14, in one embodiment of the present disclosure, the method of operating the electronic device (100) may include a step of determining whether content included in the second sub-screen (1141) dragged and dropped by the seventh input is content including text.
[0243] In one embodiment of the present disclosure, in the step of determining whether the content included in the second sub-screen (1141) is content including text, the electronic device (100) can determine whether the dragged-and-dropped content is content including text.
[0244] At this time, content including text may mean that the dragged and dropped content is a text included in the second sub-screen (1141) that has been selected and dragged and dropped. In one embodiment of the present disclosure, content including text may include some of a plurality of texts included in the second sub-screen (1141), for example, a movie title, a search term, a novel, etc.
[0245] In one embodiment of the present disclosure, the operating method of the electronic device (100) may include a step (S750) of checking whether an input interface capable of inputting text is included in the first sub-screen (1131) when it is determined that the content dragged and dropped by the seventh input is content including text.
[0246] In one embodiment of the present disclosure, in the step (S750) of checking whether an input interface capable of entering text is included in the first sub-screen (1131), the electronic device (100) can check whether an input interface capable of entering text is included in the first sub-screen (1131).
[0247] In one embodiment of the present disclosure, the input interface may refer to a search box or the like for entering text on a webpage when the first sub-screen (1131) includes a webpage. In addition, the input interface may include an interface for entering text, such as a notepad.
[0248] In one embodiment of the present disclosure, the operating method of the electronic device (100) may include a step (S850) of displaying a third sub-screen (1151) in the first display area (1130) so that text is included in the input interface, as the first sub-screen includes an input interface.
[0249] In one embodiment of the present disclosure, in the step (S850) of displaying a third sub-screen (1151) in the first display area (1130) so that text is included in the input interface, the electronic device (100) may provide the third sub-screen (1151) so that content dragged and dropped by the seventh input is displayed on the input interface.
[0250] At this time, the location where the content dragged by the 7th input is dropped may be included in the area where the input interface is located among the first sub-screens (1131).
[0251] In one embodiment of the present disclosure, the method of operating the electronic device (100) may include a step (S860) of displaying a third sub-screen (1151) on the first display area (1130) so as to include text using a text application capable of displaying text, as the first sub-screen does not include an input interface.
[0252] In one embodiment of the present disclosure, in the step (S860) of displaying a third sub-screen (1151) in the first display area (1130) using a text application capable of displaying text, the electronic device (100) can execute the text application and display content dragged and dropped by the seventh input on the executed text application to provide it as the third sub-screen (1151).
[0253] In one embodiment of the present disclosure, it goes without saying that the operation of determining whether the content included in the second sub-screen (1141) dragged and dropped by the seventh input is content included in an application, content included in a website, a file stored in an external electronic device, or content including text can be performed in one step.
[0254] In one embodiment of the present disclosure, the operation of the electronic device (100) illustrated in FIG. 14 may be such that the screen cast by the seventh input is displayed as the third sub-screen (1151), rather than the second sub-screen (1141) on which the external video signal of the external electronic device is displayed being mirrored and displayed as the third sub-screen (1151).
[0255] In one embodiment of the present disclosure, a user can use the seventh input to display the screen of an external electronic device, which was provided in a multi-view manner, on a third sub-screen (1151), and perform other operations using the external electronic device. Accordingly, the user can continuously view content previously viewed via the external electronic device using the electronic device (100), and perform multitasking using the external electronic device.
[0256] FIG. 15 is a drawing for explaining an operation in which the screen of an electronic device is mirrored and displayed on an external electronic device according to one embodiment of the present disclosure.
[0257] Referring to FIGS. 1, 2 and 15, in one embodiment of the present disclosure, an electronic device (1500) and an external electronic device (1510) providing a first sub-screen (1521) and a second sub-screen (1531) in a multi-view manner are illustrated.
[0258] In one embodiment of the present disclosure, the electronic device (1500) can display a first sub-screen (1521) in a first display area (1520) and a second sub-screen (1531) in a second display area (1530). In one embodiment of the present disclosure, the second sub-screen (1531) can be a screen corresponding to an external image signal obtained from an external electronic device (1510) connected to the electronic device (1500).
[0259] In one embodiment of the present disclosure, an external electronic device (1510) can display an external display screen (1541) in an external display area (1540). An electronic device (1500) connected to the external electronic device (1510) can provide the external display screen (1541) as a second sub-screen (1531) in a multi-view manner.
[0260] In one embodiment of the present disclosure, the method of operating the electronic device (1500) may include a step of obtaining a ninth input for performing an operation of dragging and dropping content included in a first sub-screen (1521) to a second sub-screen (1531) through an indicator (140).
[0261] In one embodiment of the present disclosure, in the step of acquiring the ninth input, the electronic device (1500) may acquire the ninth input by performing an action of dragging and dropping content included in the first sub-screen (1521) to the second sub-screen (1531) through the indicator (140).
[0262] In one embodiment of the present disclosure, the step of acquiring the ninth input may be performed after the step (S300) of displaying the first sub-screen (151) and the second sub-screen (161) in a multi-view manner through the display (110).
[0263] In one embodiment of the present disclosure, the ninth input refers to an input that includes an action of dragging and dropping content included in the first sub-screen (1521) to the second sub-screen (1541) for convenience of explanation. Even if the above-mentioned input is referred to by a name different from the ninth input, the present invention can be applied. In one embodiment of the present disclosure, even if the above-mentioned input is referred to as the second input, the action illustrated in FIG. 15 can be applied.
[0264] In one embodiment of the present disclosure, a method of operating an electronic device (1500) may include a step of displaying a fourth sub-screen, which is different from the second sub-screen and corresponds to content, in a second display area (1531) based on a ninth input.
[0265] In one embodiment of the present disclosure, in the step of displaying a fourth sub-screen corresponding to content, the electronic device (1500) may display a fourth sub-screen corresponding to content dragged and dropped by a ninth input in the second display area (1531) in the second display area (1531).
[0266] In one embodiment of the present disclosure, if the content included in the first sub-screen (1521) is a video or image displayed on the entire first display area (1520), the electronic device (1500) may display the image (1551) in a single-view mode rather than a multi-view mode by a ninth input. The electronic device (1500) may display one screen (1551) on a display area (1550) including the first display area (1520) and the second display area (1530).
[0267] In this case, the fourth sub-screen may be a screen that forms one screen (1551) together with the first sub-screen (1521).
[0268] In one embodiment of the present disclosure, a method of operating an electronic device (1500) may include a step of providing a video signal including information about a first sub-screen and a fourth sub-screen to an external electronic device (1510).
[0269] In one embodiment of the present disclosure, in the step of providing a video signal including information about the first sub-screen and the fourth sub-screen to an external electronic device (1510), the electronic device (1500) may provide the video signal to the external electronic device (1510).
[0270] In one embodiment of the present disclosure, an external electronic device (1510) may display an external display screen (1561) based on a video signal obtained from an electronic device (1500). At this time, the external display screen (1561) may be a screen corresponding to one screen (1551) displayed in a display area (1550) of the electronic device (1500).
[0271] In one embodiment of the present disclosure, an external display screen (1561) displayed on an external electronic device (1510) may be a screen (1551) displayed on an electronic device (100) that is mirrored and displayed.
[0272] In one embodiment of the present disclosure, when the electronic device (100) is a smart TV and the external electronic device (1510) is a mobile device, one screen (1551) may be a broadcast screen viewable on the smart TV. In this case, the user may mirror one screen (1551) displayed on the electronic device (100) and display it on the external electronic device (1510) through a ninth input using the indicator (140). Accordingly, the user's convenience may be improved.
[0273] FIG. 16 is a drawing for explaining an operation in which a sub-screen corresponding to content is displayed in a pop-up mode through a drag-and-drop input in a multi-view mode sub-screen according to one embodiment of the present disclosure.
[0274] Referring to FIG. 16, in one embodiment of the present disclosure, a method of displaying a sub-screen corresponding to content in a pop-up mode through a drag-and-drop input on a multi-view sub-screen of an electronic device (100) is illustrated as a plurality of operations.
[0275] In one embodiment of the present disclosure, FIG. 16 illustrates an electronic device (1600) that provides a first sub-screen (1621) and a second sub-screen (1631) in a multi-view manner. The electronic device (100) can display the first sub-screen (1621) in a first display area (1620) and the second display screen (1631) in a second display area (1630).
[0276] Referring to FIGS. 1, 2 and 16, in one embodiment of the present disclosure, the method of operating the electronic device (100) may include a step (S700) of obtaining a seventh input for performing an operation of dragging and dropping content included in a second sub-screen (1141) to a first sub-screen (1131) through an indicator (140) displayed on a display (110).
[0277] In one embodiment of the present disclosure, the operating method of the electronic device (100) may include a step of displaying a third sub-screen (1651) corresponding to content in a display area (1640) in a pop-up (Picture in Picture, PIP) mode based on a seventh input.
[0278] In one embodiment of the present disclosure, in the step of displaying a third sub-screen (1651) corresponding to content in a pop-up (Picture in Picture, PIP) mode, the electronic device (100) may display a third sub-screen (1651) corresponding to content dragged and dropped by the seventh input in a pop-up mode in the display area (1640).
[0279] In one embodiment of the present disclosure, in the step of displaying the third sub-screen (1651) in a pop-up mode in the display area (1640), the electronic device (100) may display the first sub-screen (1621) displayed in the first display area (1620) as one screen (1641) in the display area (1640). In one embodiment of the present disclosure, the display area (1640) may be an area including the first display area (1620) and the second display area (1630).
[0280] In one embodiment of the present disclosure, the electronic device (100) can display one screen (1641) in a single-view mode rather than a multi-view mode and display a third sub-screen (1651) in a pop-up mode by a seventh input.
[0281] In one embodiment of the present disclosure, a user can view content displayed on a first sub-screen (1621) on one screen (1641) through input using an indicator (140), and view content included in a second sub-screen (1631) using a pop-up mode.
[0282] In one embodiment of the present disclosure, the second sub-screen (1631) may be a screen corresponding to an external image signal acquired from an external electronic device. In one embodiment of the present disclosure, the external electronic device may include a photographing device, such as a camera or webcam. The user may view content through the screen (1641) using the electronic device (100) and view images captured by the photographing device using a pop-up mode.
[0283] The effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned will be clearly understood by a person having ordinary skill in the art to which the present disclosure pertains from the present disclosure.
[0284] FIG. 17 is a diagram illustrating the operation of an electronic device according to one embodiment of the present disclosure. FIG. 18 is a flowchart illustrating the operation of an electronic device according to one embodiment of the present disclosure. Hereinafter, the same configurations and steps as those described in FIGS. 1 and 2 are assigned the same reference numerals, and redundant descriptions are omitted.
[0285] Referring to FIGS. 1, 3, 17 and 18, in one embodiment of the present disclosure, a method of displaying a plurality of sub-screens in a multi-view manner by an electronic device (100) is illustrated by a plurality of operations (1700, 1710).
[0286] The method of operating the electronic device (100) may include a step (S210) of displaying an interface (1701) including a plurality of preset selection elements on a screen (130) in response to a first input. In one embodiment of the present disclosure, the step (S210) of displaying an interface (601) including a plurality of selection elements on the screen (130) may be performed after the step (S200) of acquiring an eighth input.
[0287] In one embodiment of the present disclosure, in the step (S210) of displaying an interface (1701) including a plurality of preset selection elements on a screen (130), operation 1700 may be performed.
[0288] In one embodiment of the present disclosure, the interface (1701) may be preset to include a plurality of applications recently executed on the electronic device (100) as a plurality of selection elements. In one embodiment of the present disclosure, if the applications recently executed on the electronic device (100) are a “music application,” an “OTT application,” and a “note application,” the interface (1701) may include the “music application,” the “OTT application,” and the “note application” as a plurality of selection elements.
[0289] Although FIG. 17 illustrates an interface (1701) as including three selection elements, the present disclosure is not limited thereto. The electronic device (100) may also provide an interface (1701) including two or fewer or four or more selection elements.
[0290] In one embodiment of the present disclosure, the method of operating the electronic device (100) may include a step (S220) of obtaining an eighth input for selecting one of a plurality of selection elements included in an interface (1701).
[0291] In the step (S220) of obtaining an eighth input for selecting one of the plurality of selection elements, the electronic device (100) can obtain an eighth input for selecting one of the plurality of selection elements included in the interface (1701) through the indicator (140).
[0292] In one embodiment of the present disclosure, the method of operating the electronic device (100) may include a step (S310) of displaying a second sub-screen (1711) and a fifth sub-screen (1712) corresponding to a selection element selected by an eighth input in a multi-view manner through a display (110).
[0293] In one embodiment of the present disclosure, in the step (S310) of displaying the second sub-screen (1711) and the fifth sub-screen (1712) in a multi-view manner, operation 1710 may be performed.
[0294] In one embodiment of the present disclosure, the second sub-screen (1711) may be a screen corresponding to a component selected by the first input. The fifth sub-screen (1712) may be a screen corresponding to a selection element selected by the eighth input.
[0295] In one embodiment of the present disclosure, when the first input is an action of selecting a music application corresponding to a second component (410) among a plurality of components, and the eighth input is an action of selecting an “OTT application” among a plurality of selection elements, the electronic device (100) may display a screen corresponding to the music application as a second sub-screen (1711) and a screen corresponding to the OTT application as a fifth sub-screen (1712).
[0296] Accordingly, the user can easily determine multiple sub-screens provided in a multi-view manner in the electronic device (100) through input via the indicator (140).
[0297] In one embodiment of the present disclosure, the fifth sub-screen refers to a screen corresponding to one of the plurality of selection elements included in the interface (1701) for convenience of explanation, and even if the above-mentioned input is referred to by a name different from the fifth sub-screen, the present invention can be applied. In one embodiment of the present disclosure, even if the above-mentioned input is referred to as the fourth sub-screen input, the operations illustrated in FIGS. 17 and 18 can be applied, of course.
[0298] FIG. 19 is a drawing for explaining the configuration of an electronic device and an external electronic device according to one embodiment of the present disclosure.
[0299] Referring to FIGS. 1 and 19, in one embodiment of the present disclosure, an electronic device (100) may include a display (1901), a memory (1902), an input / output interface (1903), a communication interface (1904), and at least one processor (1905). However, not all of the components illustrated in FIG. 19 are essential components.
[0300] In one embodiment of the present disclosure, the electronic device (1900) may be implemented with more components than those illustrated in FIG. 19, or may be implemented with fewer components. The display (1901), the memory (1902), the input / output interface (1903), the communication interface (1904), and at least one processor (1905) may each be electrically and / or physically connected to one another.
[0301] In one embodiment of the present disclosure, the display (1901) may include any one of a liquid crystal display, a plasma display, an organic light emitting diode display, and an inorganic light emitting diode display. However, the present disclosure is not limited thereto, and the display (1901) may include other types of displays capable of displaying the screen (130).
[0302] In one embodiment of the present disclosure, memory (1902) may store instructions, data structures, and program codes that can be read by at least one processor (1905). In one embodiment of the present disclosure, there may be more than one memory (1902). In the disclosed embodiments, operations performed by the electronic device (1900) may be implemented by at least one processor (1905) executing instructions or codes of a program stored in memory (1902).
[0303] In one embodiment of the present disclosure, the memory (1902) may include at least one of a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), a RAM (Random Access Memory), a SRAM (Static Random Access Memory), a ROM (Read-Only Memory), an EEPROM (Electrically Erasable Programmable Read-Only Memory), a PROM (Programmable Read-Only Memory), a Mask ROM, a Flash ROM, etc.), a hard disk drive (HDD), or a solid state drive (SSD).
[0304] In one embodiment of the present disclosure, the memory (1902) may not exist separately and may be configured to be included in at least one processor (1905).
[0305] The memory (1902) may store instructions or program codes for performing functions or operations of the electronic device (1900). The instructions, algorithms, data structures, program codes, and application programs stored in the memory (1902) may be implemented in a programming or scripting language such as, for example, C, C++, Java, Python, or an assembler.
[0306] In one embodiment of the present disclosure, the memory (1902) may store various types of modules that can be used to perform the operations of the electronic device (1900) disclosed in FIGS. 1 to 18.
[0307] In one embodiment of the present disclosure, a 'module' included in the memory (1902) may mean a unit that processes a function or operation performed by at least one processor (1905). The 'module' included in the memory (1902) may be implemented as software such as instructions, an algorithm, a data structure, or a program code.
[0308] In one embodiment of the present disclosure, at least one processor (1905) may be configured as one or more processors, which control a series of processes to cause the electronic device (1900) to operate according to the embodiments described below.
[0309] In one embodiment of the present disclosure, at least one processor (1905) may be configured as at least one of a Central Processing Unit, a microprocessor, a Graphic Processing Unit, an Application Processor (AP), an Application Specific Integrated Circuits (ASICs), a Digital Signal Processor (DSPs), a Digital Signal Processing Device (DSPDs), a Programmable Logic Device (PLDs), a Field Programmable Gate Array (FPGAs), a Communication Processor (CP), a Neural Processing Unit, or an artificial intelligence (AI) processor designed with a hardware structure specialized for learning and processing an artificial intelligence (AI) model, but is not limited thereto.
[0310] In one embodiment of the present disclosure, if one or more processors included in at least one processor (1905) are artificial intelligence-dedicated processors, the artificial intelligence-dedicated processors may be designed with a hardware structure specialized for processing a specific artificial intelligence model.
[0311] In one embodiment of the present disclosure, at least one processor (1905) may be configured as a circuit (Circuitry) such as a System on Chip (SoC) or an Integrated Circuit (IC).
[0312] In one embodiment of the present disclosure, at least one processor (1905) can execute various types of modules stored in the memory (1902). At least one processor (1905) can execute at least one instruction constituting the various types of modules stored in the memory (1902). By executing the program or at least one instruction stored in the memory (1902), at least one processor (1905) can process data according to predefined operation rules or artificial intelligence models.
[0313] In one embodiment of the present disclosure, at least one processor (1905) may include multiple processors. In one embodiment of the present disclosure, at least one module among the multiple modules in the memory (1902) may be executed by any one of the multiple processors. The remaining modules among the multiple modules stored in the memory (1902) may be executed by other processors among the multiple processors.
[0314] In one embodiment of the present disclosure, the input / output interface (1903) can receive an external image signal from an external electronic device (1910) under the control of at least one processor (1905). The at least one processor (1905) can obtain an external image signal from the external electronic device (1910) through the input / output interface (1903).
[0315] In one embodiment of the present disclosure, the input / output interface (1903) may be connected to an external input device. At least one processor (1905) may obtain first to ninth inputs from the external input device through the input / output interface (1903).
[0316] In one embodiment of the present disclosure, the input / output interface (1903) may perform input / output operations with an external electronic device (1910) and an external input device using at least one of input / output methods including a High-Definition Multimedia Interface (HDMI) port, a Digital Visual Interface (DVI), a component jack, a PC port, or a Universal Serial Bus (USB) port. However, the present disclosure is not limited to the above-described input / output methods.
[0317] In one embodiment of the present disclosure, the electronic device (1900) may further include an input device. At least one processor (1905) may obtain first to ninth inputs through the input device.
[0318] In one embodiment of the present disclosure, the communication interface (1904) can perform data communication with an external server or an external electronic device (1910) under the control of at least one processor (1905). The communication interface (1905) can perform data communication with an external server or an external electronic device (1910) using at least one of data communication methods including, for example, wired LAN, wireless LAN, Wi-Fi, Bluetooth, zigbee, Wi-Fi Direct (WFD), infrared Data Association (IrDA), Bluetooth Low Energy (BLE), Near Field Communication (NFC), Wireless Broadband Internet (Wibro), World Interoperability for Microwave Access (WiMAX), Shared Wireless Access Protocol (SWAP), Wireless Gigabit Alliance (WiGig), and RF communication.
[0319] In one embodiment of the present disclosure, the external electronic device (1910) may include a display (1911), a memory (1912), an input / output interface (1913), a communication interface (1914), and at least one processor (1915).
[0320] In one embodiment of the present disclosure, an external electronic device (1910) may be connected to an electronic device (1900) through an input / output interface (1913) under the control of at least one processor (1915). The external electronic device (1910) may provide an external image signal to the electronic device (1900) or receive an image signal through the input / output interface (1913).
[0321] In one embodiment of the present disclosure, an external electronic device (1910) can perform data communication with an electronic device (1900) through a communication interface (1914) under the control of at least one processor (1915). The external electronic device (1910) can provide a URL, a file, a content identification ID, text, etc. to the electronic device (1900) through the communication interface (1914). In addition, the external electronic device (1910) can also obtain a video signal from the electronic device (1900) through the communication interface (1914).
[0322] In one embodiment of the present disclosure, each of the plurality of components included in the external electronic device (1910) may include embodiments of the plurality of components included in the electronic device (1900). Additionally, not all of the components of the external electronic device (1910) illustrated in FIG. 19 are essential components.
[0323] In one embodiment of the present disclosure, the external electronic device (1910) may be implemented with more components than those illustrated in FIG. 19, or it may be implemented with fewer components.
[0324] In one embodiment of the present disclosure, the external electronic device (1910) may be implemented as an electronic device of various shapes, such as a mobile device, a smart phone, a laptop computer, a desktop, a tablet PC, a digital signage, a projector, and a wearable device.
[0325] In order to solve the above-described technical problem, in one embodiment of the present disclosure, a method of operating an electronic device is provided. The method of operating an electronic device may include a step of displaying a screen through a display. The method of operating an electronic device may include a step of obtaining a first input for selecting any one of a plurality of components included in the screen through an indicator displayed on the display. The method of operating an electronic device may include a step of displaying a first sub-screen corresponding to the screen and a second sub-screen corresponding to the component selected by the first input in a multi-view manner through the display.
[0326] In one embodiment of the present disclosure, the types of each of the plurality of components may be different from each other. The type of the second sub-screen may be determined based on the type of the component selected by the first input.
[0327] In one embodiment of the present disclosure, a method of operating an electronic device may include a step of selecting one of a first sub-screen and a second sub-screen displayed in a multi-view manner through an indicator, or obtaining a second input of hovering an indicator on one of the first sub-screen and the second sub-screen. The method of operating an electronic device may include a step of providing one of the first sub-screen and the second sub-screen displayed in a multi-view manner corresponding to the second input in a first mode.
[0328] In one embodiment of the present disclosure, a method of operating an electronic device may include a step of obtaining a third input for selecting one of the first sub-screens and the second sub-screens provided in a first mode among the first sub-screens and the second sub-screens displayed in a multi-view manner through an indicator. The method of operating an electronic device may include a step of providing one of the sub-screens provided in the first mode selected by the third input in a second mode different from the first mode.
[0329] In one embodiment of the present disclosure, a method of operating an electronic device may include a step of adjusting the size of any one of the sub-screens provided in the second mode in response to obtaining a fourth input for performing a scrolling operation on any one of the sub-screens provided in the second mode through an indicator. The method of operating an electronic device may include a step of changing a position of any one of the sub-screens provided in the second mode within the display in response to obtaining a fifth input for performing a drag-and-drop operation on any one of the sub-screens provided in the second mode to a specific area within the display through an indicator.
[0330] In one embodiment of the present disclosure, a method of operating an electronic device may include a step of obtaining a sixth input for selecting one of the first sub-screen and the second sub-screen displayed in a multi-view manner through an indicator in a manner different from a second input. The method of operating an electronic device may include a step of providing one of the first sub-screen and the second sub-screen displayed in a multi-view manner corresponding to the sixth input in a third mode different from the first mode and the second mode.
[0331] In one embodiment of the present disclosure, a display may include a first display area on which a first sub-screen is displayed and a second display area on which a second sub-screen is displayed. An operating method of an electronic device may include a step of obtaining a seventh input that performs an operation of dragging and dropping content included in the second sub-screen to the first sub-screen through an indicator. The operating method of the electronic device may include a step of displaying a third sub-screen, which is different from the first sub-screen and corresponds to the content, in the first display area based on the seventh input.
[0332] In one embodiment of the present disclosure, a method of operating an electronic device may include a step of displaying an interface including a plurality of preset selection elements on a screen in response to a first input. The method of operating the electronic device may include a step of obtaining an eighth input for selecting any one of the plurality of selection elements included in the interface. The method of operating the electronic device may include a step of displaying a second sub-screen and a fourth sub-screen corresponding to the selection element selected by the eighth input in a multi-view manner through a display.
[0333] In order to solve the above-described technical problem, one embodiment of the present disclosure provides a method of operating an electronic device. The method of operating an electronic device may include a step of displaying a first sub-screen in a first display area and a second sub-screen in a second display area in a multi-view manner through a display including a first display area and a second display area. The method of operating an electronic device may include a step of obtaining a first input, through an indicator displayed on the display, for performing an operation of dragging and dropping content included in the second sub-screen to the first sub-screen. The method of operating an electronic device may include a step of displaying a third sub-screen, which is different from the first sub-screen and corresponds to the content, in the first display area based on the first input.
[0334] In one embodiment of the present disclosure, the first sub-screen may be a screen displayed based on a video signal generated by the electronic device. The second sub-screen may be a screen displayed based on an external video signal acquired from an external electronic device connected to the electronic device.
[0335] In one embodiment of the present disclosure, if the content is content included in an application, the method of operating the electronic device may include a step of determining whether the application is installed on the electronic device. If the application is installed on the electronic device, the method of operating the electronic device may include a step of displaying a third sub-screen in the first display area using the installed application.
[0336] In one embodiment of the present disclosure, a method of operating an electronic device may include a step of installing an application on the electronic device when no application is installed on the electronic device. The method of operating the electronic device may include a step of displaying a third sub-screen on the first display area using the installed application.
[0337] In one embodiment of the present disclosure, if the content is content contained in a file stored in an external electronic device, the method of operating the electronic device may include a step of acquiring the file from the external electronic device. The method of operating the electronic device may include a step of displaying a third sub-screen in the first display area using the acquired file.
[0338] In one embodiment of the present disclosure, if the content includes text, the method of operating the electronic device may include a step of checking whether the first sub-screen includes an input interface for inputting text. If the first sub-screen includes an input interface, the method of operating the electronic device may include a step of displaying a third sub-screen in the first display area so that the input interface includes text.
[0339] In one embodiment of the present disclosure, a method of operating an electronic device may include a step of displaying a third sub-screen in a first display area so as to include text using a text application capable of displaying text, since the first sub-screen does not include an input interface.
[0340] In one embodiment of the present disclosure, a method of operating an electronic device may include a step of obtaining a second input, which performs an operation of dragging and dropping content included in a first sub-screen to a second sub-screen, via an indicator. The method of operating the electronic device may include a step of displaying a fourth sub-screen, which is different from the second sub-screen and corresponds to the content, in a second display area based on the second input.
[0341] In one embodiment of the present disclosure, a method of operating an electronic device may include providing a video signal including information about a first sub-screen and a fourth sub-screen to an external electronic device.
[0342] In one embodiment of the present disclosure, a display may include a display area including a first display area and a second display area. A method of operating an electronic device may include the steps of displaying a first sub-screen in the display area based on a first input, and displaying a third sub-screen in the display area in a pop-up (Picture in Picture, PIP) mode.
[0343] To solve the above-described technical problem, one embodiment of the present disclosure provides an electronic device. The electronic device may include a display. The electronic device may include a memory that stores at least one instruction. The electronic device may include at least one processor. By having the at least one processor execute at least one instruction stored in the memory, the electronic device may control the display to display a screen. By having the at least one processor execute at least one instruction stored in the memory, the electronic device may obtain a first input for selecting one of a plurality of components included in the screen through an indicator displayed on the display. By having the at least one processor execute at least one instruction stored in the memory, the electronic device may control the display to display a first sub-screen corresponding to the screen and a second sub-screen corresponding to the component selected by the first input in a multi-view manner.
[0344] In one embodiment of the present disclosure, a display may include a first display area on which a first sub-screen is displayed and a second display area on which a second sub-screen is displayed. By having at least one processor execute at least one command stored in a memory, the electronic device may obtain a second input to perform an operation of dragging and dropping content included in the second sub-screen to the first sub-screen through an indicator. By having at least one processor execute at least one command stored in a memory, the electronic device may control the display to display a third sub-screen, which is different from the first sub-screen and corresponds to the content, in the first display area based on the second input.
[0345] A computer-readable recording medium having recorded thereon a program for performing at least one method of an embodiment of an operating method of an electronic device disclosed in the present disclosure on a computer may be provided.
[0346] The program executed by the electronic device described in this disclosure may be implemented as hardware components, software components, and / or a combination of hardware components and software components. The program may be executed by any system capable of executing computer-readable instructions.
[0347] Software may include a computer program, code, instructions, or a combination of one or more of these, which may configure a processing device to do a desired thing or may independently or collectively command a processing device to do a desired thing.
[0348] Software may be implemented as a computer program containing instructions stored on a computer-readable storage medium. Examples of computer-readable storage media include magnetic storage media (e.g., read-only memory (ROM), random-access memory (RAM), floppy disks, hard disks, etc.) and optical readable media (e.g., CD-ROMs, DVDs (Digital Versatile Discs)). The computer-readable storage media may be distributed across network-connected computer systems, so that computer-readable code may be stored and executed in a distributed manner. The storage media may be readable by a computer, stored in a memory, and executed by a processor.
[0349] Computer-readable storage media may be provided in the form of non-transitory storage media. Here, the term "non-transitory storage media" simply means a tangible device that does not contain signals (e.g., electromagnetic waves). This term does not distinguish between cases where data is permanently stored in the storage media and cases where data is temporarily stored. For example, a "non-transitory storage medium" may include a buffer in which data is temporarily stored.
[0350] Additionally, programs according to the embodiments disclosed herein may be provided as part of a computer program product. The computer program product may be traded as a commodity between sellers and buyers.
[0351] A computer program product may include a software program and a computer-readable storage medium storing the software program. For example, the computer program product may include a product in the form of a software program (e.g., a downloadable application) distributed electronically by an electronic device manufacturer or through an electronic marketplace (e.g., the Samsung Galaxy Store). For electronic distribution, at least a portion of the software program may be stored on a storage medium or temporarily generated. In this case, the storage medium may be a server of the electronic device manufacturer, a server of the electronic marketplace, or a storage medium of an intermediary server that temporarily stores the software program.
[0352] Although the embodiments described above have been described with limited examples and drawings, those skilled in the art will appreciate that various modifications and variations can be made based on the above description. For example, appropriate results can still be achieved even if the described techniques are performed in a different order than described, and / or components such as the described computer system or modules are combined or combined in a different manner than described, or are replaced or substituted with other components or equivalents.
[0353] The effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned will be clearly understood by a person having ordinary skill in the art to which the present disclosure pertains from the present disclosure.
Claims
1. In an electronic device (100), Step (S100) of displaying a screen through a display (110); A step (S200) of obtaining a first input for selecting one of the plurality of components included in the screen through an indicator displayed on the display (110); and An operating method of an electronic device (100), including a step (S300) of displaying a first sub-screen corresponding to the screen and a second sub-screen corresponding to the component selected by the first input in a multi-view manner through the display (110).
2. In paragraph 1, The types of each of the above multiple components are different from each other, The type of the second sub-screen is determined in accordance with the type of the component selected by the first input, and the method of operating the electronic device (100).
3. In either of the first or second paragraphs, The operating method of the above electronic device (100) is: A step of obtaining a second input for selecting one of the first sub-screen and the second sub-screen displayed in the multi-view manner through the indicator, or hovering the indicator on one of the first sub-screen and the second sub-screen; and An operating method of an electronic device (100), comprising the step of providing one of the first sub-screen and the second sub-screen displayed in the multi-view manner corresponding to the second input in a first mode.
4. In paragraph 3, The operating method of the above electronic device (100) is: A step of obtaining a third input for selecting one of the first sub-screen and the second sub-screen provided in the first mode among the first sub-screen and the second sub-screen displayed in the multi-view manner through the indicator; and An operating method of an electronic device (100) comprising a step of providing one of the sub-screens provided in the first mode selected by the third input in a second mode different from the first mode.
5. In paragraph 4, The operating method of the above electronic device (100) is: A step of adjusting the size of one of the sub-screens provided in the second mode by obtaining a fourth input that performs a scrolling operation on one of the sub-screens provided in the second mode through the indicator; and An operating method of an electronic device (100) comprising a step of changing the position of any one of the sub-screens provided in the second mode within the display by obtaining a fifth input that performs an action of dragging and dropping any one of the sub-screens provided in the second mode to a specific area within the display through the indicator.
6. In any one of the clauses 3 to 5, The operating method of the above electronic device (100) is: A step of obtaining a sixth input for selecting one of the first sub-screen and the second sub-screen displayed in the multi-view manner through the indicator in a manner different from the second input; and An operating method of an electronic device (100), comprising the step of providing one of the first sub-screens and the second sub-screens displayed in the multi-view manner, corresponding to the sixth input, in a third mode different from the first mode and the second mode.
7. In the electronic device (100), A step of displaying a first sub-screen in a first display area and a second sub-screen in a second display area in a multi-view manner through a display including a first display area and a second display area; A step of obtaining a first input for performing an action of dragging and dropping content included in the second sub-screen to the first sub-screen through an indicator displayed on the display; and An operating method of an electronic device (100), including a step of displaying a third sub-screen that is different from the first sub-screen and corresponds to the content in the first display area based on the first input.
8. In paragraph 7, A method of operating an electronic device (100), wherein the first sub-screen is a screen displayed based on a video signal generated by the electronic device, and the second sub-screen is a screen displayed based on an external video signal obtained from an external electronic device connected to the electronic device.
9. In paragraph 8, If the above content is included in an application, The operating method of the above electronic device (100) is: a step of determining whether the application is installed on the electronic device; and An operating method of an electronic device (100), including a step of displaying the third sub-screen in the first display area using the installed application, when the application installed in the electronic device exists.
10. In paragraph 9, The operating method of the above electronic device (100) is: As the above application installed on the above electronic device does not exist, a step of installing the application on the electronic device; and An operating method of an electronic device (100) including a step of displaying the third sub-screen in the first display area using the installed application.
11. In any one of the clauses 8 to 10, If the above content is content contained in a file stored on the external electronic device, The operating method of the above electronic device (100) is: A step of obtaining the file from the external electronic device; and An operating method of an electronic device (100), including a step of displaying the third sub-screen in the first display area using the acquired file.
12. In any one of the clauses 8 to 11, If the above content contains text, The operating method of the above electronic device (100) is: A step of checking whether the first sub-screen includes an input interface capable of inputting the text; and An operating method of an electronic device (100), comprising the step of displaying the third sub-screen in the first display area so that the text is included in the input interface, as the first sub-screen includes the input interface.
13. In any one of the clauses 8 to 12, The operating method of the above electronic device (100) is: A step of obtaining a second input for performing an action of dragging and dropping content included in the first sub-screen to the second sub-screen through the indicator; and An operating method of an electronic device (100), including a step of displaying a fourth sub-screen that is different from the second sub-screen and corresponds to the content in the second display area based on the second input.
14. In any one of the clauses 7 to 13, The above display (110) includes a display area including the first display area and the second display area, The operating method of the above electronic device (100) is: An operating method of an electronic device (100), comprising the steps of displaying the first sub-screen in the display area based on the first input and displaying the third sub-screen in the display area in a pop-up (Picture in Picture, PIP) mode.
15. In electronic devices (1900), Display (1901); a memory (1902) storing at least one instruction; and comprising at least one processor (1905), By having the at least one processor (1905) execute the at least one instruction stored in the memory (1902), the electronic device (1900) Control the display (1901) to display the screen, Obtaining a first input for selecting one of the plurality of components included in the screen through an indicator displayed on the display (1901), An electronic device (1900) that controls the display (1901) to display a first sub-screen corresponding to the screen and a second sub-screen corresponding to the component selected by the first input in a multi-view manner.