Display device and operating method thereof
By implementing the operation method of multi-view screen in the display device, and using multiple partial screens to identify and output video call screens, the problem of difficulty in providing video call services while displaying multi-view screens in the prior art is solved, and efficient video call services are realized.
Patent Information
- Application Number
- CN202180054872.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2020-09-04
- Filing Date
- 2021-09-06
- Publication Date
- 2025-03-18
- Estimated Expiration
- 2041-09-06
AI Technical Summary
The prior art is difficult to provide video call services while displaying multi-view screens, and cannot effectively match the user's intentions.
By implementing the multi-view screen operation method in the display device, multiple individually decoded pieces of content are output using multiple partial screens, and a partial screen corresponding to the video call screen is identified and output based on the video call request.
It realizes providing video call service while displaying multi-view screens, improving user satisfaction and convenience.
Smart Images

Figure CN116097655B_ABST
Abstract
Description
Technical Field
[0001] Embodiments of the present disclosure relate to a display device for providing a multi-view screen and an operating method of the display device.
[0002] In detail, an embodiment of the present disclosure relates to a display device for processing a received video call while providing multi-views and an operating method of the display device. Background Art
[0003] With the development of wired / wireless communication networks and communication technologies, the use of video call services between electronic devices has increased. In detail, video call services between electronic devices are widely used for non-face-to-face communication between different users located at remote locations.
[0004] For the video call service, one electronic device and another electronic device may be connected to each other via a wired / wireless communication network. Here, the electronic device includes a display for providing a video call screen, and may be any electronic device capable of communicating with other electronic devices at a remote location by accessing a wired / wireless communication network. Examples of electronic devices may include portable computers (such as laptop computers, netbooks, or tablet personal computers (PCs)), portable terminals (such as smart phones or personal digital assistants (PDAs)), televisions (TVs), and digital TVs.
[0005] When a video call is performed between multiple electronic devices, such as a first electronic device and a second electronic device, the first electronic device obtains an image of a user (hereinafter, referred to as a "first user") and transmits the obtained image to the second electronic device. In addition, the second electronic device obtains an image of a user (hereinafter, referred to as a "second user") and transmits the obtained image to the first electronic device. Therefore, each of the first electronic device and the second electronic device displays a video call screen including images of the first user and the second user. Then, each of the first user and the second user can make a call while viewing the image of the other party at a remote location. Summary of the invention
[0006] Technical issues
[0007] Embodiments of the present disclosure provide a display device capable of providing a video call service while displaying a multi-view screen and an operating method of the display device.
[0008] In detail, an embodiment of the present disclosure provides a display device capable of providing a video call service while displaying a multi-view screen to match a user's intention, and an operating method of the display device.
[0009] Technical Solution
[0010] According to an embodiment of the present disclosure, there is provided an operation method of a display device, the display device being used to display a multi-view screen including a plurality of partial screens. The operation method of the display device comprises: outputting a plurality of pieces of content that are individually decoded through the plurality of partial screens, respectively, identifying at least one piece of content among the plurality of pieces of content based on a video call request, and outputting a video call screen through at least one partial screen among the plurality of partial screens corresponding to the identified at least one piece of content.
[0011] The step of outputting the video call screen may include: stopping decoding of at least one identified content by at least one decoder included in the display device, decoding an image signal corresponding to the video call screen by the at least one decoder that has stopped decoding, and outputting the video call screen based on the decoded image signal through at least one partial screen on which the at least one identified content has been output.
[0012] The identifying of the at least one piece of content may include identifying the at least one piece of content having the same resolution as a resolution of the video call screen from among the plurality of pieces of content.
[0013] The identifying of the at least one piece of content may include identifying the at least one piece of content having an offset resolution from among the plurality of pieces of content.
[0014] The identifying of the at least one piece of content may include identifying the at least one piece of content having a lowest resolution from among the plurality of pieces of content.
[0015] The identifying of the at least one piece of content may include identifying content output through the main screen from among the plurality of pieces of content.
[0016] The step of identifying the at least one piece of content may further include determining whether the at least one piece of content having a resolution corresponding to the video call screen exists, and performing a voice call switching process based on the absence of the at least one piece of content having a resolution corresponding to the video call screen.
[0017] The identifying of the at least one piece of content may further include determining whether the at least one piece of content having a resolution corresponding to the video call screen exists, and ending the video call process based on the absence of the at least one piece of content having a resolution corresponding to the video call screen.
[0018] The operating method may further include displaying a user interface screen for selecting at least one of the plurality of partial screens in response to a video call request, and receiving a user input selecting at least one of the plurality of partial screens through the user interface screen.
[0019] The identifying of the at least one piece of content may include identifying the at least one piece of content based on receipt of a user input.
[0020] The step of identifying the at least one piece of content may include: in response to a video call request, identifying a first content from the multiple pieces of content output through the multi-view screen, and the step of outputting the video call screen may include: outputting the video call screen through a first partial screen corresponding to the first content.
[0021] The step of outputting the video call screen may include: stopping decoding of a first image signal corresponding to the first content, decoding an image signal by a decoder that has stopped decoding the first image signal, and outputting the video call screen through a first partial screen based on the decoded image signal.
[0022] The step of identifying the at least one piece of content may include: identifying the first content and the second content from the plurality of pieces of content output through the multi-view screen based on the video call request. The step of outputting the video call screen may include: displaying the counterpart image and the user image included in the video call screen on a first partial screen corresponding to the first content and a second partial screen corresponding to the second content, respectively.
[0023] According to an embodiment of the present disclosure, a display device may include: a display; a communication interface; a video processing unit including a plurality of decoders; and a processor configured to execute at least one instruction. The processor is configured to execute at least one instruction to perform the following operations: controlling the display to output a plurality of pieces of content individually decoded by the video processing unit through a plurality of partial screens included in a multi-view screen, respectively, identifying at least one piece of content from the plurality of pieces of content based on a video call request, and controlling the display to output a video call screen through at least one partial screen corresponding to the identified at least one piece of content among the plurality of partial screens. BRIEF DESCRIPTION OF THE DRAWINGS
[0024] Figure 1a is a diagram illustrating views of a display device for outputting a multi-view screen according to various embodiments;
[0025] Figure 1b is a diagram illustrating views of a display device for outputting a multi-view screen according to various embodiments;
[0026] Figure 2 is a diagram showing views for describing an example of a layout of a multi-view screen according to various embodiments;
[0027] Figure 3 is a diagram illustrating views for describing an operation of receiving a video call request while outputting a multi-view screen according to various embodiments;
[0028] Figure 4 is a diagram showing a display device according to various embodiments;
[0029] Figure 5 is a diagram showing a display device according to various embodiments;
[0030] Figure 6 is a diagram showing a display device according to various embodiments;
[0031] Figure 7 is a diagram for describing communication between a server supporting a video call service and a display device according to various embodiments;
[0032] Figure 8 is a flowchart illustrating an example operating method of a display device according to various embodiments;
[0033] Fig. 9 is a flowchart illustrating an example operating method of a display device according to various embodiments;
[0034] Fig.10 is a diagram illustrating an example display device according to various embodiments;
[0035] Fig.11 is a diagram illustrating a view of an example user interface screen displayed by a display device according to various embodiments;
[0036] Fig.12 is a diagram illustrating a view of an example user interface screen displayed by a display device according to various embodiments;
[0037] Fig.13 is a flowchart illustrating an example operating method of a display device according to various embodiments;
[0038] Fig.14 is a diagram illustrating a view of an example user interface screen displayed by a display device according to various embodiments;
[0039] Fig.15 is a diagram illustrating a view of an example user interface screen displayed by a display device according to various embodiments;
[0040] Fig.16 is a diagram illustrating a view of an example user interface screen displayed by a display device according to various embodiments;
[0041] Fig.17 is a flowchart illustrating an example operating method of a display device according to various embodiments;
[0042] Fig.18 is a flowchart illustrating an example operating method of a display device according to various embodiments;
[0043] Fig.19 is a diagram illustrating a view of an example user interface screen displayed by a display device according to various embodiments;
[0044] Fig. 20 is a diagram illustrating a view of an example user interface screen displayed by a display device according to various embodiments;
[0045] Fig.21 is a diagram illustrating a view of an example user interface screen displayed by a display device according to various embodiments;
[0046] Fig. 22 is a flowchart illustrating an example operating method of a display device according to various embodiments;
[0047] Fig.23 is a diagram illustrating a view of an example user interface screen displayed by a display device according to various embodiments;
[0048] Fig.24 is a diagram illustrating a view of an example user interface screen displayed by a display device according to various embodiments; and
[0049] Fig.25 is a diagram illustrating views of example user interface screens displayed by a display device according to various embodiments. DETAILED DESCRIPTION
[0050] The present disclosure will now be described more fully with reference to the accompanying drawings so that those of ordinary skill in the art can perform the present disclosure without difficulty. However, the present disclosure can be implemented in many different forms and is not limited to the exemplary embodiments of the present disclosure set forth herein. For the sake of clarity, parts not related to the description of the present disclosure are omitted in the accompanying drawings, and the same components are represented by the same reference numerals throughout the specification.
[0051] Throughout the specification, when one component is “connected” to another component, the component may not only be “directly connected” to the other component but may also be “electrically connected” to the other component through another element therebetween. When a component “includes” an element, unless otherwise specified, another element may be further included rather than excluding the presence of the other element.
[0052] As used herein, phrases such as "in some embodiments" or "in an embodiment" are not necessarily referring to the same embodiment.
[0053] Various embodiments can be represented by function block components and various processing operations. All or some of these function blocks can be implemented by various numbers of hardware and / or software components that perform specific functions. For example, the function blocks of the present disclosure can be implemented using one or more processors or microprocessors or circuit elements for the intended function. For example, the function blocks of the present disclosure can be implemented using various programming or scripting languages. The function blocks can be implemented as algorithms executed by one or more processors. In addition, the present disclosure can adopt related technologies for electronic configuration, signal processing and / or data processing, etc. Terms such as "module", "component", etc. can be used widely and may not be limited to mechanical and physical elements.
[0054] In addition, the connecting lines or connecting members between components shown in the drawings are only illustrations of functional connections and / or physical or circuit connections. In actual devices, the connections between components can be represented by various functional connections, physical connections or circuit connections that can be replaced or added.
[0055] In addition, the expression "at least one of a, b, or c" indicates, for example, only a, only b, only c, both a and b, both a and c, both b and c, or all of a, b, and c.
[0056] An exemplary embodiment of the present disclosure relates to a display device and an operation method thereof. In detail, an exemplary embodiment of the present disclosure relates to an operation method and a display device executing the operation method, in which when a video call is requested between multiple electronic devices, a display device outputting a multi-view screen processes the video call request.
[0057] In an example embodiment of the present disclosure, an electronic device capable of providing a video call service includes a display for displaying a video call screen, and may be any electronic device capable of communicating with other electronic devices at a remote location by accessing a wired / wireless communication network. In addition, the electronic device includes a display and may be any of a variety of computing or computer devices capable of providing a video call service. Examples of electronic devices may include, but are not limited to, wearable devices, smart phones, personal digital assistants (PDAs), media players, tablet personal computers (PCs), laptop computers, media players, televisions (TVs), digital TVs, smart TVs, digital signage, digital signs, etc. In the following, for ease of explanation, an electronic device capable of providing a video call service according to an embodiment of the present disclosure is referred to as a "display device."
[0058] In addition, in the following description, both the "mobile device" and the "display device" may be an electronic device capable of performing a video call by displaying a video call screen on a display. That is, each of the "mobile device" and the "display device" may be a wearable device, a smart phone, a PDA, a media player, a tablet PC, a laptop computer, a media player, a TV, a digital TV, a smart sign, a digital sign, etc.
[0059] However, for ease of explanation, the “mobile device” and the “display device” may be described distinguishably. For example, an electronic device including a relatively large display or capable of providing a video call screen with a relatively wide viewing angle may be referred to as a “display device,” and an electronic device including a relatively small display or capable of providing a video call screen with a relatively narrow viewing angle may be referred to as a “mobile device.”
[0060] Hereinafter, for convenience of explanation, a portable electronic device is referred to as a “mobile device.” An electronic device capable of providing a large screen through a display larger than that of a mobile device and obtaining a video call screen having a wider viewing angle than that of a mobile device may be referred to as a “display device.”
[0061] Furthermore, the mobile device may be carried by the user. The display device may be portable or may be arranged at a fixed location. Alternatively, the display device may be portable and may be arranged at a fixed location.
[0062] In the accompanying drawings, the following content will be described assuming that the mobile device is a smart phone and the display device is a TV. In addition, in the accompanying drawings, the same elements are represented by the same reference numerals. In addition, in the entire detailed description, the same elements are described with the same terms.
[0063] A display device and an operating method thereof according to an embodiment of the present disclosure will be described in detail with reference to the accompanying drawings.
[0064] Figure 1a 2 is a diagram illustrating views of an example display device for outputting a multi-view screen according to various embodiments.
[0065] The display device 100 according to an exemplary embodiment of the present disclosure is an electronic device for providing a multi-view screen. The term "multi-view screen" may refer to a screen in which a screen output to a display included in the display device 100 is divided into a plurality of partial screens and the plurality of partial screens respectively output a plurality of pieces of content.
[0066] Reference Figure 1a , the display device 100 may output a multi-view screen 110 including four partial screens 120, 130, 140, and 150. In detail, the display device 100 may display the multi-view screen 110 that is visually recognizable to a user.
[0067] For example, the multi-view screen 110 may output different pieces of content to four partial screens 120, 130, 140, and 150. In the drawings and detailed description, the pieces of content may be, for example, first content, second content, third content, and fourth content that are different from each other.
[0068] exist Figure 1a In the example of , the first content may be broadcast content corresponding to a music program received through a music broadcast channel, and for ease of explanation, the first content is indicated by icon A121. The second content may be broadcast content corresponding to a football match received through a sports channel, and for ease of explanation, the second content is indicated by icon B141. The third content may be video streaming content corresponding to a volleyball match received from a server of a content provider, rather than a real-time broadcast or live broadcast, and for ease of explanation, the third content is indicated by icon C131. The fourth content may be Internet content received from a website server providing a portal site, and for ease of explanation, the fourth content is indicated by icon D151. Therefore, in the example embodiments and drawings of the present disclosure, content indicated by the same icon (e.g., "A") may refer to the same content (e.g., the first content).
[0069] An icon indicating a specific content, for example, icon A 121, may be represented by a combination of at least one of text, symbol, graphic, identification mark, or color indicating the first content. Icon A may be displayed or not displayed on the actual partial screen 120.
[0070] The display device 100 according to an exemplary embodiment of the present disclosure may divide a screen corresponding to an entire display area of the display into a plurality of partial screens through screen division, and may output independent pieces of content to the plurality of partial screens.
[0071] The display device 100 may receive a first image signal corresponding to a first content, may decode the first image signal, and may output it to a partial screen 120. The display device 100 may receive a second image signal corresponding to a second content, may decode the second image signal, and may output it to a partial screen 130. The display device 100 may receive a third image signal corresponding to a third content, may decode the third image signal, and may output it to a partial screen 140. The display device 100 may receive a fourth image signal corresponding to a fourth content, may decode the fourth image signal, and may output it to a partial screen 150.
[0072] Figure 1b is a diagram showing a display device for outputting a multi-view screen according to various embodiments. Figure 1b In the drawings, the same reference numerals are used to represent Figure 1aTherefore, the same description as that made above will not be repeated.
[0073] Reference Figure 1b ,and Figure 1a Unlike the multi-view screen 110 of the display device 100 , the multi-view screen 111 output from the display device 100 may include a main screen 125 and one or more sub-screens 135 , 145 , and 155 .
[0074] exist Figure 1b , the first content output from the main screen 125, the second content output from the sub-screen 135, the third content output from the sub-screen 145, and the fourth content output from the sub-screen 155 correspond to Figure 1a The first content output from the partial screen 120, the second content output from the partial screen 130, the third content output from the partial screen 140, and the fourth content output from the partial screen 150, and therefore, a detailed description will not be repeated.
[0075] To display the multi-view screen, refer to Figure 1a and Figure 1b The described display device 100 may manage a plurality of decoders (not shown) to appropriately decode a plurality of image signals corresponding to a plurality of pieces of content included in a multi-view screen.
[0076] In detail, the display device 100 may use a multi-view application to provide a multi-view screen. The term "application" may refer to a program or a processor for performing a service, a function, or a specific operation. The application may include at least one instruction for performing a service, a function, or a specific operation. In addition, the application may be stored in a processor (not shown) or a memory (not shown) included in the display device 100. In an embodiment of the present disclosure, an application for performing a service, a function, or an operation of providing a multi-view screen may be referred to as a "multi-view application", for example.
[0077] The multi-view application may refer to an application in which, in order to provide a multi-view screen, a screen output from the display device 100 is divided according to a specific layout and a plurality of pieces of content are controlled to be output through a plurality of divided partial screens. The multi-view application may perform an operation for providing a multi-view screen, and may control at least one of hardware resources or software resources of the display device 100 required for providing the multi-view screen. Examples of hardware resources required for providing the multi-view screen may include a plurality of decoders for decoding a plurality of pieces of content output to the multi-view screen and a memory for storing images to be output to the multi-view screen. In addition, examples of software resources required for providing the multi-view screen may include a software decoder for software decoding a plurality of pieces of content output to the multi-view screen.
[0078] In an embodiment of the present disclosure, a multi-view application stored or included in the display device 100 may generally control generation and output of a multi-view screen.
[0079] As described above, the display device may provide a multi-view screen by controlling a screen to be divided into a plurality of partial screens and managing decoding operations of a plurality of decoders included in the display device 100 .
[0080] Figure 2 is a diagram showing views for describing an example of a layout that can be output to a multi-view screen according to various embodiments. In detail, Figure 2 It is shown by Figure 1a and Figure 1b 1 is a diagram showing an example of a layout of a multi-view screen 110 displayed by a display device 100.
[0081] Reference Figure 2 , Figure 1a or Figure 1b The multi-view screen 110 or 111 may have any of a variety of layouts. Figure 2 In addition to the layout shown, various types of layouts are possible.
[0082] For example, the layout of the multi-view screen 110 may be determined by considering, for example, the number of partial screens, the aspect ratio supported by the display, the aspect ratio of the content output through each of the partial screens, the aspect ratio of the partial screens, and / or the aspect ratio of the window (execution window) of the Internet portal transmitted by the Internet server. In addition, the layout of the multi-view screen 110 may be determined according to the setting of the user or the setting of the display device 100.
[0083] Reference Figure 2 200, when the number of divided screens is 4, that is, when the multi-view screen 110 includes four partial screens, the multi-view screen 110 may include layouts 241, 242, 243, 245, and 246. For example, the layout 241 corresponds to a case where the multi-view screen is equally divided into four partial screens. In addition, the layouts 242, 243, 245, and 246 correspond to a case where the multi-view screen is unequally divided into four partial screens. In this case, one main screen and three sub-screens may be included in each of the layouts 242, 243, 245, and 246.
[0084] The following description will be made assuming that the multi-view screen includes four partial screens and includes the layout 241 or the layout 245 .
[0085] Figure 3 is a diagram showing views for describing an operation of receiving a video call request while a multi-view screen is output according to various embodiments. Figure 3 In the drawings, the same reference numerals are used to represent Figure 1a In addition, in the drawings, the same reference numerals denote the same elements. Therefore, the description thereof will not be repeated.
[0086] Reference Figure 3 , the display device 100 displaying the multi-view screen 110 may provide a video call service.
[0087] In an embodiment of the present disclosure, a video call may refer to, for example, a call in which each of a plurality of users located at a remote location makes a call while viewing the face of the other party on a screen through a plurality of electronic devices. In addition, the “video call” described in the various embodiments may be applied, for example, to any field in which users located at a remote location perform communication while receiving each other's images (such as video conferencing, non-face-to-face communication, or non-face-to-face education), and may refer to any situation in which a plurality of users located at a remote location perform communication while viewing the images of the corresponding parties. The image included in the video call screen does not need to be the face of the user using the video call, but may be, for example, an image indicating the environment in which the user using the video call is located or an image provided by the user.
[0088] Typically, a video call can be performed between two different electronic devices. Alternatively, three or more users located at remote locations can perform a video call through three or more electronic devices.
[0089] The following content will be described assuming that one user (hereinafter, referred to as "user") and another user (hereinafter, referred to as "correspondent") perform a video call through two electronic devices at remote locations. Here, the user does not refer to one person, but may be multiple, and the correspondent may also be multiple.
[0090] Reference Figure 3 , a video call can be performed between the display device 100, which is an electronic device located at a remote location, and the counterpart device 302 (S391). In addition, the video call can be performed by sending and receiving data required for the video call using a communication network such as the third generation (3G), the fourth generation (4G), or the fifth generation (5G). Alternatively, the video call can be performed through a call service of a telecommunications company. In addition, the video call can be performed through a specific application (e.g., a video call application, a non-face-to-face communication application, a video education application, or a video conferencing application) provided by a server of a service provider.
[0091] Including Figure 3In the following, the electronic device of the user is the display device 100, and the electronic device of the other party (correspondent) who wants to make a video call with the user is referred to as the counterpart device 302. In addition, the user of the display device 100 is identified as "user A", and the counterpart who wants to make a video call with user A is identified as "user B". That is, in the embodiment of the present disclosure, the counterpart of the video call may be referred to as "user B", for example. In addition, the counterpart device 302 will be described assuming that it is a smart phone. Figure 3 The display device 100 and the mobile device 301 may be electronic devices owned by the user 317 , and the counterpart device 302 may be an electronic device owned by the counterpart 327 .
[0092] Reference Figure 3 , the display device 100 may perform a video call with the counterpart device 302 which is the counterpart electronic device located at a remote location (S391). The display device 100 may perform a video call by executing its own call function or an application for non-face-to-face communication.
[0093] Alternatively, a video call performed on the mobile device 301 may be performed in the display device 100 through device switching. In detail, a video call may be performed between the mobile device 301 and the counterpart device 302 (S381). Subsequently, a device for performing video call execution may be switched or changed from the mobile device 301 to the display device 100 (S382).
[0094] As described above, the display device 100 can use its own video call service function to perform a direct video call with the counterpart device 302. Alternatively, for a video call performed or initiated by the mobile device 301, the display device 100 can perform a video call through device switching. The following content will be described assuming that the display device 100 directly performs a video call with the counterpart device 302 when the display device 100 provides a video call service (S391).
[0095] In an embodiment of the present disclosure, the display device 100 may receive a video call request while displaying the multi-view screen 110. Here, the video call request may be received from the counterpart device 302. Alternatively, the video call request may be received based on a request of a user 317 of the display device 100. For example, when the user 317 of the display device 100 wants to make a video call, the user may send a user input of selecting an application, a program, or a menu for providing a video call service of the display device 100 to the display device 100. Then, the display device 100 may recognize that the video call request is received based on the user input.
[0096] When a video call is initiated, the electronic devices (e.g., 301 and 302) that perform the video call may both display a video screen. For example, the display of the mobile device 301 as the electronic device of the user 317 may display a video call screen 311 including an image 312 of the counterpart 327 as the main screen and an image (e.g., 313) of the user 317 as the sub-screen. In addition, the video call screen 311 may further include a menu 314 for controlling the video call. In addition, the display of the counterpart device 302 as the electronic device of the counterpart 327 may display a video call screen 321 including an image 323 of the counterpart 327 as the sub-screen and an image (e.g., 322) of the user 317 as the main screen. In addition, the video call screen 321 may further include a menu 324 for controlling the video call.
[0097] Here, the image of the counterpart 327 may be acquired by the camera 320 included in the counterpart device 302. In detail, when a video call request is received, the counterpart device 302 may activate the camera 320 to obtain the image of the counterpart 327. The image of the user 317 may be obtained by the mobile device 301 as the electronic device of the user 317 or by the display device 100. When the display device 100 performs a video call directly with the counterpart device 302, the camera 155 of the display device 100 may obtain the image of the user 317. Alternatively, when the display device 100 performs a video call through the device switching S382, the image of the user may be obtained through the camera 310 included in the mobile device 301. In this case, the mobile device 301 may obtain the image of the user, and may transmit the image of the user to the counterpart device 302 and the display device 100. In addition, optionally, when the display device 100 performs a video call through the device switching S382, the display device 100 may obtain the image of the user 317 through the camera 155 after completing the device switching.
[0098] As described above, the video call screen (eg, 311 or 321 ) may include images of a user and a counterpart using a video call service, and an image signal corresponding to the video call screen may be an image signal having a specific resolution.
[0099] Furthermore, the image signal included in the video call screen may include a user image signal which is an image signal corresponding to the image of the user and a counterpart image signal which is an image signal corresponding to the image of the counterpart.
[0100] Because an electronic device for providing a video call service, such as the display device 100, should visually output a video call screen, the electronic device includes a display. There may be a situation where the electronic device is displaying something before receiving a video call request. In this case, a method for processing a video call request is required.
[0101] However, when a user's electronic device receives a video call request while displaying multiple pieces of content, it is not defined, for example, whether (i) the electronic device should stop displaying the multiple pieces of content, (ii) which of the multiple pieces of content should be stopped, or (iii) which of the multiple partial screens on which the multiple pieces of content have been displayed should be used to output the video call screen.
[0102] Therefore, embodiments of the present disclosure enable an electronic device that simultaneously displays multiple pieces of content to provide a video call service while improving user satisfaction.
[0103] Will refer to Figures 4 to 25 An operation performed by the display device according to an embodiment of the present disclosure when a video call request is received while the multi-view screen 110 is displayed is described in detail.
[0104] Figure 4 are diagrams illustrating display devices according to various embodiments.
[0105] Reference Figure 4 , the display device 400 may be connected with Figure 1a , Figure 1b , Figure 2 and Figure 3 Therefore, when describing the operation of the display device 400, the description will not be repeated with reference to FIG. Figure 1a , Figure 1b , Figure 2 and Figure 3 The descriptions done are the same as the descriptions.
[0106] Reference Figure 4 , the display device 400 includes a processor 410, a display 420, a video processing unit 425 and a communication interface 415. Figure 4 In the embodiment, although the processor 410, the display 420, the video processing unit 425, and the communication interface 415 are connected to each other, at least two of the processor 410, the display 420, the video processing unit 425, and the communication interface 415 may be directly or indirectly connected to each other.
[0107] The processor 410 controls the intended operation to be performed by executing at least one instruction. The at least one instruction may be stored in a memory (not shown) included in the processor 410, or in a memory (not shown) separate from the processor 410 included in the display device 400.
[0108] In detail, the processor 410 may control at least one element included in the display device 400 to perform an intended operation by executing at least one instruction. Therefore, even when the processor 410 performs certain operations, it may mean that the processor 410 controls at least one element included in the display device 400 to perform certain operations. In addition, although the processor 410 includes one processor, the processor 410 may include a plurality of processors.
[0109] The display 420 outputs an image to a screen. In detail, the display 420 may output an image corresponding to video data through a display panel (not shown) included therein so that a user visually recognizes the video data. The video data may correspond to a decoded image signal.
[0110] In an embodiment of the present disclosure, the display 420 may output a multi-view screen. In addition, the display 420 may output a video call screen through at least one partial screen included in the multi-view screen.
[0111] The communication interface 415 may perform communication with at least one external electronic device, a server, and / or a broadcasting station. The at least one external electronic device may be the mobile device 301, the counterpart device 302, and / or an external storage medium connectable through a connection terminal.
[0112] In detail, the communication interface 415 may receive data from various data sources. For example, the communication interface 415 may receive a plurality of pieces of content. The communication interface 415 may receive a plurality of image signals corresponding to the plurality of pieces of content from a broadcast station, an Internet server, a content provider server, etc. For example, each of the plurality of image signals may be a broadcast stream signal, a transport stream (TS), or a video stream signal. Figure 5 The configuration of the communication interface 415 is described in more detail.
[0113] The video processing unit 425 may process an image of the video data. In detail, the video processing unit 425 may process the video data, for example, an image signal, received by the display device 400. The video processing unit 425 may perform various image processing such as decoding, scaling, noise filtering, frame rate conversion, and resolution conversion on the video data.
[0114] In an embodiment of the present disclosure, the video processing unit 425 may include multiple decoders (not shown), and multiple pieces of content may be decoded separately by multiple decoders (not shown). Multiple decoders (not shown) may respectively decode multiple image signals corresponding to the multiple pieces of content. A group of multiple decoders may be referred to as a "multi-decoder".
[0115] The display device 400 may include two or more decoders, and the two or more decoders may decode a plurality of image signals corresponding to a plurality of pieces of content separately. In addition, a plurality of decoders (not shown) included in the display device 400 may correspond to different resolutions. For example, the display device 400 may include a 4K decoder (not shown) and a 2K decoder (not shown). The 4K decoder may decode an image signal corresponding to an image having a resolution of 4K or less. In addition, the 2K decoder may decode an image signal corresponding to an image having a resolution of 2K or less. In addition, each of the plurality of decoders may decode at least one image signal at the same time. For example, the 2K decoder may decode two image signals each having a resolution of 2K at the same time by time division.
[0116] In order to display the multi-view screen, the processor 410 may manage a plurality of decoders to appropriately decode a plurality of image signals corresponding to a plurality of pieces of content included in the multi-view screen.
[0117] In an embodiment of the present disclosure, the processor 410 controls the display 420 by executing at least one instruction to display the image on the multi-view screen ( Figure 4 ) (e.g., Figure 1a The processor 410 outputs a plurality of pieces of content that are individually decoded by the video processing unit 425 in a plurality of partial screens in the multi-view screen 110 of the video call. The processor 410 identifies at least one piece of content from the plurality of pieces of content based on the video call request. In detail, the processor 410 may identify at least one piece of content having a resolution corresponding to the video call screen from the plurality of pieces of content in response to the video call request.
[0118] Subsequently, the processor 410 controls the display 420 to output the video call screen through at least one partial screen corresponding to the recognized at least one piece of content among a plurality of partial screens included in the multi-view screen.
[0119] For example, the processor 410 may include the above-mentioned multi-view application. The multi-view application of the processor 410 may identify at least one piece of content from multiple pieces of content output to the multi-view screen based on the video call request. The multi-view application may control the display 420 to output the video call screen through a partial screen corresponding to the identified content.
[0120] The expression "individual decoding" may refer to, for example, that each of a plurality of image signals corresponding to a plurality of pieces of content is independently decoded. That is, a plurality of images corresponding to a plurality of pieces of content are not integrated and decoded as one image.
[0121] In addition, "video call request" may refer to, for example, a control signal for requesting to start or execute a video call service. The video call request may be generated based on a user input of the display device 400. Alternatively, the video call request may be received from a counterpart device 302 that wants to perform a video call with the display device 400 or the mobile device 301 requesting the device to switch.
[0122] In addition, the “resolution corresponding to the video call screen” may refer to, for example, a resolution of an image signal corresponding to the video call screen. Alternatively, the “resolution corresponding to the video call screen” may refer to, for example, a resolution corresponding to each of a plurality of images (e.g., an image of a user and an image of a counterpart) included in the video call screen.
[0123] For example, when an image signal corresponding to the entire video call screen is received, the image signal may be an image signal having a resolution of 1K, 2K, 4K, or 8K.
[0124] In an embodiment, when a user image signal corresponding to an image of a user and a counterpart image signal corresponding to an image of a counterpart included in a video call screen are received, each of the user image signal and the counterpart image signal may be an image signal having a resolution of 1K, 2K, 4K, or 8K. The user image signal and the counterpart image signal may have the same resolution or may have different resolutions.
[0125] The processor 410 may include a random access memory (RAM) (not shown) storing a signal or data input from the outside of the display device 400 or used as a memory for various operations performed by the display device 400, a read-only memory (ROM) (not shown) storing a control program and / or a plurality of instructions for controlling the display device 400, and at least one processor (not shown). The processor (not shown) may include a graphics processing unit (not shown) for performing graphics processing on a video. The processor (not shown) may be implemented as a system on a chip (SoC) integrating a core (not shown) and a GPU (not shown), for example. In addition, the processor 410 may include a single core or multiple cores. For example, the processor 410 may include a dual core, a triple core, a quad core, a hexa core, an octa core, a deca core, a twelve core, a hexa core, the like.
[0126] In addition, the processor 410 may initiate a video call service with the counterpart device 302 in response to the video call request. As described above, a video call may be performed through a video call function of the display device 400 or an application for providing a video call service. For example, the application for providing a video call service may be referred to as a video call application.
[0127] In detail, the processor 410 may store a video call application. Optionally, the video call application may correspond to at least one processor included in the processor 410. In addition, the video call application may be available through an application store (e.g., Play Store TM ) is distributed online (eg, downloaded or uploaded). When distributed online, the video call application may be distributed through a manufacturer's server, an application store's server, or a relay server.
[0128] For example, a video call application may be installed in at least two of the mobile device 301, the counterpart device 302, and the display device 400, and a video call may be performed between the two devices using the video call application.
[0129] Figure 5 2 is a diagram illustrating a display device according to various embodiments. Figure 5 The display device 500 may be Figure 4 Therefore, when describing the display device 500, the description will not be repeated with reference to Figure 4 The description is the same as the description given above.
[0130] Reference Figure 5 , compared with the display device 400 , the display device 500 may further include at least one of a camera 440 , a memory 470 , a user interface 450 , and an audio input / output unit 465 .
[0131] Reference Figure 5 , the communication interface 415 may include an image input unit 417 and a communication unit 430. In the communication interface 415, a configuration for receiving a data source for displaying an image may be referred to as, for example, the image input unit 417, and a configuration communicable with an external electronic device located at a remote location through a wireless communication network may be referred to as, for example, the communication unit 430.
[0132] The image input unit 417 may receive data from various data sources. For example, the image input unit 417 may include a tuner (not shown) for receiving a live stream arriving via broadcast, a universal serial bus (USB) connection port (not shown) for playing a video, a high-definition multimedia interface (HDMI) connection port (not shown) for receiving an external input, and a component (not shown).
[0133] In addition, the image input unit 417 may receive input data having various formats. The format of the data received by the image input unit 417 may have RGB and YUV formats. The image input unit 417 may receive a plurality of input data (in detail, image resources) having various formats.
[0134] The communication unit 430 performs communication with an external electronic device (not shown) through at least one wired or wireless communication network. In an embodiment of the present disclosure, the communication unit 430 may communicate with at least one of the mobile device 301 and the counterpart device 302. In addition, the communication unit 430 may also communicate with a server ( Figure 5 (not shown) (for example, Figure 7 The communication unit 430 communicates with a content providing server and an Internet server to transmit certain data to or receive certain data from at least one of the mobile device 301 and the counterpart device 302. The communication unit 430 may communicate with a content providing server and an Internet server.
[0135] The communication unit 430 may communicate with an external device (e.g., at least one of the mobile device 301, the counterpart device 302, and a server (not shown)) through the communication network 391. The communication unit 430 may include at least one communication module and a communication circuit, and may transmit and receive data to and from the external device through the communication module and / or the communication circuit.
[0136] In detail, the communication unit 430 may include at least one short-range communication module (not shown) that performs communication according to a communication standard such as Bluetooth, Wi-Fi, Bluetooth Low Energy (BLE), Near Field Communication (NFC) / Radio Frequency Identification (RFID), Wi-Fi Direct, Ultra Wideband (UWB), or Zigbee.
[0137] In addition, the communication unit 430 may further include a remote communication module (not shown) for performing communication with a server (not shown) for supporting remote communication according to a remote communication standard. The communication unit 430 may include a remote communication module (not shown) for performing communication through a network for Internet communication. In addition, the communication unit 430 may include a communication network that complies with a communication standard such as 3G, 4G, and / or 5G.
[0138] The user interface 450 may receive a user input for controlling the display device 500. For example, the user interface 450 may receive a video call request from a user.
[0139] The user interface 450 may include a user input device including, but not limited to, a touch panel that detects a user's touch, a button that receives a user's pressing operation, a scroll wheel that receives a user's rotating operation, a keyboard, and / or a dome switch.
[0140] In addition, the user interface 450 may include a voice recognition device (not shown) for voice recognition. For example, the voice recognition device (not shown) may be a microphone, and the voice recognition device may receive a user's voice command or voice request. Therefore, the processor 410 may control an operation corresponding to the voice command or voice request to be executed.
[0141] The user interface 450 may include a motion detection sensor (not shown). For example, the motion detection sensor (not shown) may detect the motion of the display device 500, and may receive the detected motion as a user input. In addition, the voice recognition device (not shown) and the motion detection sensor (not shown) may not be included in the user interface 450, but may be included in the display device 500 as a module independent of the user interface 450.
[0142] The user interface 450 may receive user input through a remote controller, etc. In this case, the user interface 450 may include a communication module for receiving a signal corresponding to the user input from a remote controller (not shown). For example, when the remote controller (not shown) transmits an infrared (IR) signal corresponding to the user input, the user interface 450 may include a communication module (not shown) for receiving the IR signal.
[0143] When the display device 500 and the external mobile device 301 are wirelessly connected to each other, the user interface 450 may receive a user input received through a touch panel (not shown) of the mobile device 301 .
[0144] Alternatively, the user input received through the touch panel (not shown) of the mobile device 301 may be received through the communication unit 430 of the display device 500, and may be transmitted to the processor 410. For example, when the display device 500 and the external mobile device 301 are wirelessly connected to each other through a Wi-Fi network or a Bluetooth network, the user input received through the touch panel (not shown) of the mobile device 301 may be received through a Wi-Fi communication module (not shown) or a Bluetooth communication module (not shown) of the communication unit 430.
[0145] The camera 440 may include an image sensor (not shown), and may obtain an image frame (such as a still image or a moving image) through the image sensor in a video call mode or an imaging mode. In an embodiment of the present disclosure, when a video call request is received, the camera 440 may be activated. Therefore, the activated camera 440 may obtain an image of the user requesting the video call.
[0146] The camera 440 may obtain image frames at specific time intervals according to a set frame per second (FPS). For example, the camera 440 may obtain 30 image frames per second. Therefore, the first image obtained by the camera 440 may refer to each image in a group of images or images that are continuously obtained and updated.
[0147] In addition, the display device 500 may include one camera. In addition, the display device 500 may include multiple cameras located at different positions. When the display device 500 includes multiple cameras, the display device 500 may allow the user to select any one of the multiple cameras for a video call based on user input or settings of the display device 500.
[0148] The camera for obtaining the image of the user may be provided separately from the display device 500, rather than being included in the display device 500. For example, the camera may be an external camera (not shown) located on a side surface of the display device 500 or adjacent to the display device 500, so as to obtain an image of the front surface of the display device 500. In this case, the external camera (not shown) and the display device 500 may be connected to each other through a wired / wireless signal line, and the external camera (not shown) may obtain the image of the user in the video call under the control of the display device 500.
[0149] For convenience of explanation, the following content will be described assuming that a camera for obtaining an image of a user for a video call is included in the display device 500 .
[0150] The memory 470 may store at least one instruction. The memory 470 may store at least one instruction executed by the processor 410. In addition, the memory 470 may store at least one program executed by the processor 410. The memory 470 may store an application for providing a specific service. For example, the memory 470 may store a video call application.
[0151] The memory 470 may include at least one type of storage medium among flash memory type storage medium, hard disk type storage medium, multimedia card micro storage medium, card type memory (e.g., SD or XD memory), RAM, static RAM (SRAM), ROM, electrically erasable programmable ROM (EEPROM), programmable ROM (PROM), magnetic memory, magnetic disk, and optical disk.
[0152] The audio input / output unit 465 may output audio that can be audibly recognized by a user, or may detect and / or receive audio. In detail, the audio input / output unit 465 may include an audio output unit 460 and an audio input unit 467.
[0153] The audio output unit 460 outputs audio under the control of the processor 410 .
[0154] In detail, the audio output unit 460 may output audio (eg, voice or sound) input through the communication unit 430 .
[0155] In an embodiment of the present disclosure, the processor 410 may control audio received from the counterpart device 302 of the video call to be output through the audio output unit 460 during the video call mode.
[0156] In addition, the audio output unit 460 may output the audio stored in the memory 470 under the control of the processor 410. The audio output unit 460 may include at least one of a speaker (not shown), a headphone output port (not shown), or a Sony / Philips Digital Interface (S / PDIF) output port (not shown). The audio output unit 460 may include a combination of a speaker (not shown), a headphone output port (not shown), and a Sony / Philips Digital Interface (S / PDIF) output port (not shown).
[0157] The audio input unit 467 receives audio. In detail, the audio input unit 467 may include a microphone (not shown) that receives audio as an external sound signal and processes the audio into electrical voice data. For example, the microphone (not shown) included in the audio input unit 467 may receive a sound signal from an external device or a speaker (e.g., a user participating in a video call). In addition, the microphone (not shown) included in the audio input unit 467 may use various noise removal algorithms to remove noise that occurs in the process of receiving the external sound signal.
[0158] In an embodiment of the present disclosure, the audio input unit 467 may receive a sound signal including a user voice during a video call mode, and may process the user voice to be recognized by removing noise from the received sound signal under the control of the processor 410 .
[0159] Figure 6 2 is a diagram illustrating a display device according to various embodiments. Figure 6 The display device 600 may be used with reference to Figure 1a , Figure 1b , Figure 2 , Figure 3 , Figure 4 and Figure 5 The display device 100, 400 or 500 described in the embodiment of the present disclosure corresponds to the display device 100, 400 or 500 according to the embodiment of the present disclosure. Therefore, when describing the display device 600, the description with reference to FIG. Figure 1a , Figure 1b , Figure 2 , Figure 3 , Figure 4 and Figure 5 The description is the same as the description given above.
[0160] In detail, Figure 6 The processor 680, the display 615, the video processing unit 610, the camera unit 662, the memory 690, the audio output unit 625 and the microphone 661 included in the display device 600 can be connected to Figure 5The display device 500 includes a processor 410, a display 420, a video processing unit 425, a camera 440, a memory 470, an audio output unit 460 and an audio input unit 467 corresponding to the processor 410.
[0161] also, Figure 6 The tuner unit 640 and the input / output unit 670 may be connected with Figure 5 The image input unit 417 corresponds to the image input unit 417.
[0162] The video processing unit 610 processes data received by the display device 600, such as video data. The video processing unit 610 may perform various image processing such as decoding, scaling, noise filtering, frame rate conversion, and resolution conversion on the video data. In addition, the video processing unit 610 may be included in the processor 680.
[0163] The processor 680 may receive a recording request for video data processed by the video processing unit 610 , and may control the video data to be encrypted and recorded on a memory device (not shown) included in the memory 690 or the processor 680 , such as a RAM (not shown).
[0164] The display 615 displays a specific screen. Specifically, the display 615 may display a video included in a broadcast signal received through the tuner unit 640 on a screen under the control of the processor 680. In addition, the display 615 may display content (e.g., moving images) input through the communication unit 650 or the input / output unit 670.
[0165] In addition, the display 615 may output an image stored in the memory 690 under the control of the processor 680. The display 615 may display a voice user interface (UI) for performing a voice recognition task corresponding to voice recognition (e.g., a UI including a voice command guide) or a motion UI for performing a motion recognition task corresponding to motion recognition (e.g., a UI including a user motion guide for motion recognition).
[0166] The audio processing unit 620 processes audio data. The audio processing unit 620 may perform various processes such as decoding or amplification and noise filtering on the audio data. The audio processing unit 620 may include a plurality of audio processing modules to process audio data corresponding to a plurality of pieces of content.
[0167] The audio output unit 625 outputs audio included in a broadcast signal received through the tuner unit 640 under the control of the processor 680. The audio output unit 625 may output audio (e.g., voice or sound) input through the communication unit 650 or the input / output unit 670. In addition, the audio output unit 625 may output audio stored in the memory 690 under the control of the processor 680. The audio output unit 625 may include at least one of a speaker 626, an earphone output port 627, or an S / PDIF interface output port 628. The audio output unit 625 may include a combination of the speaker 626, the earphone output port 627, and the S / PDIF output port 628.
[0168] The power supply unit 630 supplies power input from an external power source to the elements (e.g., 610 to 690) in the display device 600 under the control of the processor 680. In addition, the power supply unit 630 may supply power output from one or more batteries (not shown) located in the display device 600 to the elements (e.g., 610 to 690) under the control of the processor 680.
[0169] The tuner unit 640 may tune and select only the frequency of a channel to be received by the display device 600 from among radio wave components by performing amplification, mixing, and / or resonance on a broadcast signal received by wire or wirelessly. The broadcast signal includes audio, video, and additional information (e.g., an electronic program guide (EPG)).
[0170] The tuner unit 640 can receive a broadcast signal in a frequency band corresponding to a channel number (e.g., cable channel number 506) according to a user input (e.g., input of a control signal received from an external control device (not shown) such as a remote controller, such as a channel number input on an EPG screen, a channel up or down input, or a channel input).
[0171] The tuner unit 640 may receive a broadcast signal from any of a variety of sources, such as a terrestrial broadcast station, a cable broadcast station, a satellite broadcast station, or an Internet broadcast station. The tuner unit 640 may receive a broadcast signal from a source, such as an analog broadcast station or a digital broadcast station. The broadcast signal received by the tuner unit 640 is decoded (e.g., audio decoding, video decoding, and / or additional information decoding) and separated into audio, video, and / or additional information. Under the control of the processor 680, the separated audio, video, and / or additional information may be stored in the memory 690.
[0172] The display device 600 may include one or more tuner units 640. According to an embodiment, when a plurality of tuner units 640 are provided, a plurality of broadcast signals may be output to a plurality of partial screens included in a multi-view screen provided to the display 615.
[0173] The tuner unit 640 may be implemented as any one of an integrated tuner, a separate device including a tuner unit electrically connected to the display device 600 (eg, a set-top box (not shown)), or a tuner unit (not shown) connected to the input / output unit 670 .
[0174] The communication unit 650 may communicate with an external electronic device (not shown) under the control of the processor 680. The processor 680 may transmit content to / receive content from an external device connected through the communication unit 650, and may download an application from an external device or may perform web browsing. In detail, the communication unit 650 may be connected to a network and may receive content from an external device (not shown). In addition, the communication unit 650 may include at least one of a short-range communication module (not shown), a wired communication module (not shown), and a mobile communication module (not shown).
[0175] exist Figure 6 In the embodiment, the communication unit 650 includes one of a wireless local area network (LAN) 651, a Bluetooth communication unit 652, and a wired Ethernet 653.
[0176] In addition, the communication unit 650 may include a module combination including at least one of a wireless LAN 651, a Bluetooth communication unit 652, and a wired Ethernet 653. The communication unit 650 may receive a control signal of a control device (not shown) under the control of the processor 680. The control signal may be implemented as a Bluetooth type signal, a radio frequency (RF) signal type signal, or a Wi-Fi type signal.
[0177] The communication unit 650 may further include another short-range communication module (eg, NFC) or a separate BLE module in addition to Bluetooth.
[0178] The detection unit 660 detects a user's voice, image, or interaction.
[0179] The microphone 661 receives a voice spoken by the user. The microphone 661 may convert the received voice into an electrical signal, and may output the electrical signal to the processor 680. The user's voice may include a voice corresponding to a menu or function of the display device 600. For example, a distance of 4 m or less from the microphone 661 to the user's position is recommended as a range of voice recognition with respect to the microphone 661, and the range of voice recognition with respect to the microphone 661 may vary according to the volume of the user's voice and the surrounding environment (e.g., speaker sound or nearby noise).
[0180] The microphone 661 may be implemented as one body or a separate body with respect to the display device 600. When implemented as a separate body, the microphone 661 may be electrically connected to the display device 600 through the communication unit 650 or the input / output unit 670.
[0181] It will be readily understood by those of ordinary skill in the art that the microphone 661 may be excluded depending on the performance and structure of the display device 600 .
[0182] The camera unit 662 receives images (e.g., continuous frames) corresponding to the user's motion including gestures within the camera recognition range. For example, the recognition range of the camera unit 662 may be within a range of 0.1 m to 5 m from the camera unit 662 to the user. The user's motion may include the motion of a body part of the user (such as the user's face, facial expression, hand, fist, or finger), or the motion of a part of the user. The camera unit 662 may convert the received image into an electrical signal under the control of the processor 680 and may output the electrical signal to the processor 680.
[0183] The processor 680 may select a menu displayed by the display device 600 using the received recognition result of the motion, or may perform control corresponding to the motion recognition result. For example, channel adjustment, volume control, and pointer movement may be performed.
[0184] The camera unit 662 may include a lens (not shown) and an image sensor (not shown). The camera unit 662 may support optical zoom or digital zoom using multiple lenses and / or image processing. The recognition range of the camera unit 662 may be variably set according to the angle of the camera and the surrounding environmental conditions. When the camera unit 662 includes multiple cameras, the camera unit 662 may receive a three-dimensional (3D) still image or a 3D motion using the multiple cameras.
[0185] The camera unit 662 may be integrated into the display device 600 or separated from the display device 600. A separate device (not shown) including the separate camera unit 662 may be electrically connected to the display device 600 through the communication unit 650 or the input / output unit 670.
[0186] It will be readily understood by those of ordinary skill in the art that, depending on the performance and structure of the display device 600 , the camera unit 662 may be excluded.
[0187] The optical receiver 663 receives an optical signal (including a control signal) from an external control device (not shown) through an optical window (not shown) of the frame of the display 615. The optical receiver 663 may receive an optical signal corresponding to a user input (e.g., touch, press, touch gesture, voice, or motion) from the control device (not shown). Under the control of the processor 680, the control signal may be extracted from the received optical signal.
[0188] The input / output unit 670 receives video (e.g., moving images), audio (e.g., voice or music), and additional information (e.g., EPG) from the outside of the display device 600 under the control of the processor 680. The input / output unit 670 may include one or more of a high-definition multimedia interface (HDMI) port 671, a component jack 672, a PC port 673, and a USB port 674. The input / output unit 670 may include a combination of the HDMI port 671, the component jack 672, the PC port 673, or the USB port 674.
[0189] It will be readily understood by those of ordinary skill in the art that the configuration and operation of the input / output unit 670 may vary according to embodiments of the present disclosure.
[0190] The processor 680 controls the overall operation of the display device 600 and the signal flow between elements (not shown) in the display device 600, and processes data. The processor 680 can execute an operating system (OS) and various applications stored in the memory 690 when there is a user input or a preset storage condition is satisfied.
[0191] The processor may include a graphics processing unit (not shown) for performing graphics processing on the video. The graphics processing unit (not shown) generates a screen including various objects (such as icons, images, and text) using a computing unit (not shown) and a rendering unit (not shown). The computing unit uses the user interaction detected by the detection unit (not shown) to calculate the attribute values (such as coordinate values, shape, size, and color) of each object to be displayed according to the layout of the screen. The rendering unit generates screens including various layouts of objects based on the attribute values calculated by the computing unit. The screen generated by the rendering unit is displayed on the display area of the display 615.
[0192] Figure 7 is a diagram for describing communication between a server supporting a video call service and a display device according to various embodiments. Figure 7 In the drawings, the same reference numerals are used to represent Figure 1a , Figure 1b , Figure 2 , Figure 3 , Figure 4 and Figure 5 The same elements as the elements in . In addition, Figure 7 The display device 500 may be Figure 1a , Figure 1b , Figure 2 , Figure 3 and Figure 4 Display device 100 or 400.
[0193] Reference Figure 7, the server 700 can communicate with the mobile device 301, the counterpart device 302 and the display device 500 through the wireless communication network 391.
[0194] For example, the server 700 may be a server that provides a video call or a video call service, or a server that supports communications required for a video call service. For example, at least two of the mobile device 301, the counterpart device 302, and the display device 500 may be connected via a mobile communication network (such as 3G, 4G, 5G, etc.), and a video call may be performed between the mobile device 301 or the display device 500 and the counterpart device 302. In this case, the server 700 may be a communication server that supports mobile communications according to a communication standard (such as 3G, 4G, or 5G).
[0195] In addition, the mobile device 301, the counterpart device 302, and the display device 500 may also be connected via an Internet communication network. Each of at least two of the mobile device 301, the counterpart device 302, and the display device 500 may perform a video call via an application that provides a video call service in the device. Therefore, the mobile device 301, the counterpart device 302, and the display device 500 may perform a video call via an application, or may perform a video call according to device switching. In this case, the server 700 may be a server that supports an application for providing a video call service. In detail, the server 700 may be, for example, a server of an entity or user that manufactures and / or distributes an application.
[0196] As described above, operations required to perform a video call can be performed using the communication relay operation of the server 700. Figure 3 The communication relay operation of the server 700 is not shown in the figure, but the communication relay operation of the server 700 may be included in sending and receiving data or signals between two different devices. In detail, the server 700 may be responsible for sending data or signals to support the execution (or switching execution) of the video call service.
[0197] For example, the server 700 may perform a relay operation of transmitting a user image signal generated by the display device 500 to the counterpart device. In addition, the server 700 may transmit or transfer various data and signals for performing a video call service to at least one of the mobile device 301, the counterpart device 302, and the display device 500.
[0198] In the following description, even when describing that certain data or signals are sent from one device (e.g., a display device) to another device (e.g., a counterpart device), it may also include sending certain data or signals from one device (e.g., a display device) to another device (e.g., a counterpart device) through the communication relay operation of the server 700 and sending certain data or signals directly from one device (e.g., a display device) to another device (e.g., a counterpart device).
[0199] Will refer to Figures 8 to 25 Operations performed by the display apparatus 100 , 400 , 500 , or 600 according to various embodiments are described in detail.
[0200] Figure 8 is a flowchart illustrating an example operating method of a display device according to various embodiments. Figure 8 The exemplary operation method 800 of the display device includes operations performed by the display device (e.g., the display device 100, 400, 500, or 600) according to various embodiments of the present disclosure. Therefore, when describing the operations included in the operation method 800 of the display device according to various embodiments, the description related to the operation method 800 will not be repeated. Figures 1a to 7 The operation of the display device 100, 400, 500 or 600 is described in the same manner as described above.
[0201] It will be assumed that Figure 5 The following content is described with reference to the display device 500 executing the display device operation method 800 , but again, the present disclosure is not limited in this regard.
[0202] Reference Figure 8 , the operating method 800 of the display device may be performed by a display device (eg, 500) that displays a multi-view screen including a plurality of partial screens.
[0203] The operating method 800 of the display device includes outputting a plurality of pieces of content that are individually decoded through a plurality of partial screens included in a multi-view screen ( S810 ). Operation S810 may be performed by the display 420 under the control of the processor 410 .
[0204] Based on the video call request received after operation S810, at least one of the plurality of pieces of content is identified (S820). In detail, operation S820 may include: in response to the video call request, identifying at least one piece of content having a resolution corresponding to the video call screen from the plurality of pieces of content. Operation S820 may be performed by the processor 410. In detail, the processor 410 may determine whether there is content having a resolution corresponding to the resolution of the video call screen among the plurality of pieces of content output through the multi-view screen.
[0205] The video call request may be received based on the user input input through the user interface 450. For example, the user of the display device 500 may want to make a video call with his / her friend while viewing the multi-view screen. Then, the user may input a user input for requesting a video call through the user interface 450 of the display device 500. Then, the processor 410 may recognize that the video call request has been received based on the user input. Alternatively, a video call request may be received from an electronic device (e.g., Figure 3 That is, the video call request may be received according to the user of the display device 500 or the counterpart device (eg, Figure 3 302) to receive a video call request in response to a request from at least one of the users.
[0206] In an embodiment of the present disclosure, the content identified in operation S820 may be content having the same resolution as that of the video call screen.
[0207] Alternatively, the content identified in operation S820 may be content having the lowest resolution among the plurality of pieces of content output through the multi-view screen.
[0208] Alternatively, the content identified in operation S820 may be content having offset resolutions among a plurality of pieces of content output through the multi-view screen.
[0209] The offset resolution may refer to a resolution having a preset value, for example. For example, the offset resolution may be determined based on at least one of a setting of the display device, a setting of the multi-view application, a setting of the video call application, a setting of a user of the display device, a setting of a manufacturer of the display device, a setting of a provider of the multi-view application, or a setting of a provider of the video call application.
[0210] In addition, the offset resolution can be set to a specific value or a relative value.
[0211] For example, according to the setting of the multi-view application, the offset resolution may be set to any one of 1K, 2K, 4K, or 8K. Optionally, according to the setting of the multi-view application, the offset resolution may be set to the lowest resolution among the resolutions of the multiple pieces of content output through the multi-view screen. Optionally, according to the setting of the multi-view application, the offset resolution may be set to the highest resolution among the resolutions of the multiple pieces of content output through the multi-view screen. Optionally, according to the setting of the video call application, the offset resolution may be set to the lowest resolution among the resolutions of the multiple pieces of content output through the multi-view screen. Optionally, according to the setting of the video call application, the offset resolution may be set to the resolution value of the video call screen. Optionally, according to the setting of the video call application, the offset resolution may be set to a resolution value that is the same as or most similar to (has the smallest difference between resolution values) the resolution value of the video call screen among the resolutions of the multiple pieces of content output through the multi-view screen.
[0212] Alternatively, the content identified in operation S820 may be content output through the main screen among a plurality of pieces of content output through the multi-view screen.
[0213] Alternatively, the content identified in operation S820 may be content output through a preset partial screen among a plurality of pieces of content output through the multi-view screen.
[0214] Alternatively, the content identified in operation S820 may be at least one piece of content that was last played (eg, the playback of which was most recently initiated) among a plurality of pieces of content output through the multi-view screen.
[0215] Will refer to Figures 17 to 25 The identifying operation of operation S820 is described in detail.
[0216] When the image signal corresponding to the video call screen is received as one image signal (hereinafter, for convenience of explanation, referred to as an "integrated image signal"), the processor 410 may identify one piece of content having a resolution corresponding to the integrated image signal from among the plurality of pieces of content (S820). Figures 17 to 21 The operation of identifying a piece of content in operation S820 is described in detail.
[0217] In an embodiment, when an image signal corresponding to the video call screen is received as two image signals, that is, a user image signal and a counterpart image signal, the processor 410 may identify two pieces of content having resolutions respectively corresponding to the user image signal and the counterpart image signal from among a plurality of pieces of content (S820). Figure 22 to Figure 25 The operation of identifying two pieces of content in operation S820 is described in detail.
[0218] Subsequently, the operating method 800 of the display device includes outputting the video call screen through at least one partial screen among the plurality of partial screens corresponding to the at least one piece of content identified in operation S820 (S830). Operation S830 may be performed by the display 420 under the control of the processor 410.
[0219] According to the display device and the operating method thereof of the embodiment of the present disclosure, the display device outputting the multi-view screen can provide a video call service together without ending or interrupting the multi-view screen.
[0220] According to the display device and the operating method thereof according to the embodiments of the present disclosure, a video call service can also be provided without ending or interrupting the multi-view screen, thereby improving user satisfaction.
[0221] According to the display device and the operation method thereof according to the embodiment of the present disclosure, the display device receiving a video call request while outputting a multi-view screen can provide a video call service while continuing to output the multi-view screen to improve user satisfaction. Therefore, user satisfaction and user convenience can be improved.
[0222] Fig. 9 is a flowchart illustrating an example operating method of a display device according to various embodiments. Fig. 9 The method 900 for operating a display device includes operations performed by a display device according to various embodiments (eg, the display device 100, 400, 500, or 600). In addition, Fig. 9 The operating method 900 of the display device may be a more detailed description of the operating method 800 of the display device.
[0223] When describing the operation method 900 of the display device, operations identical to those of the operation method 800 of the display device are denoted by the same reference numerals, and thus descriptions thereof will not be repeated. Figure 5 The display device 500 executes the operating method 900 of the display device to describe the following.
[0224] Reference Fig. 9 , operation S830 may include operation S831, operation S832, and operation S833.
[0225] In detail, in the example operation method 900 of the display device, operation S830 of outputting the video call screen may include operation S831, operation S832, and operation S833, wherein, in operation S831, at least one decoder (not shown) included in the display device 500 stops decoding at least one content identified in operation S820, in operation S832, the decoder (not shown) that has stopped decoding decodes an image signal corresponding to the video call screen, and in operation S833, based on the image signal decoded in operation S832, the video call screen is output through at least one partial screen on which the at least one content identified has been output.
[0226] Will refer to Fig.10 Operation S831 , operation S832 , and operation S833 are described in detail.
[0227] Fig.10 is a diagram showing a display device according to various embodiments. In detail, Fig.10 It is shown Figure 5 Detailed diagram of the video processing unit 425 of the display device 500. Fig.10 The display device 500 includes Figure 5 Among the elements in the display device 500 , elements that do not require additional explanation are not shown.
[0228] Reference Fig.10 , the video processing unit 425 may perform image processing on the video data. In detail, the display device 500 may receive a plurality of image signals corresponding to a plurality of pieces of content through the communication interface 415. Fig.10 The “service provider” in may be, for example, a server, an electronic device, or a broadcasting station that provides content displayed by the display device 500 .
[0229] Refer to Figure 1a and Fig.10 , service provider 1011 may provide a first content as a broadcast content corresponding to a music program, service provider 1012 may provide a second content as a broadcast content corresponding to a football match, service provider 1013 may provide a third content as a video streaming content corresponding to a volleyball match that is not a real-time or live broadcast, and service provider 1014 may provide a fourth content as an Internet content provided by a portal site.
[0230] The communication interface 415 may receive a first image signal corresponding to the first content, a second image signal corresponding to the second content, a third image signal corresponding to the third content, and a fourth image signal corresponding to the fourth content through the communication network 391 .
[0231] Under the control of the processor 410 , the image signal received by the communication interface 415 may be transmitted to the video processing unit 425 and decoded by the video processing unit 425 .
[0232] The video processing unit 425 may perform image processing on the video data. In detail, the video processing unit 425 may demultiplex the input image signal, may decode the demultiplexed image signal, and may scale the decoded image signal into an image frame to be output from the display 420. Therefore, a plurality of image signals input to the video processing unit 425 may be output as a plurality of images displayed on a plurality of partial screens.
[0233] In detail, the video processing unit 425 may include a demultiplexer 1020 , a multi-decoder 1030 , and a scaler 1040 .
[0234] The image signal, which is multiplexed in the form of a stream and compressed according to a specific codec (or standard), may be received by the display device 500. Therefore, the video processing unit 425 may receive the image signal that is multiplexed, compressed, and generated as a stream, may demultiplex and decompress the input image signal, and may output it as image data having an RGB or YUV format that may be displayed on the display 420.
[0235] The demultiplexer 1020 may receive a plurality of image signals and may demultiplex each of the plurality of image signals. In detail, the demultiplexer 1020 may include a plurality of demultiplexers 1021, 1022, 1023, and 1024 connected in parallel. Each demultiplexer may demultiplex one image signal.
[0236] The multi-decoder 1030 may include a plurality of decoders. In detail, the multi-decoder 1030 may include a plurality of decoders having different resolutions. The term "decoder having a specific resolution" may refer to a decoder capable of decoding an image signal having a specific resolution, for example. That is, the "decoder having a specific resolution" may refer to a decoder that supports processing an image signal having a specific resolution.
[0237] The number and specifications of the decoders included in the multi-decoder 1030 may vary in various ways according to the product specifications, product grade, release year, etc. of the display device 500. In addition, the specifications of the decoders may vary according to a processable bit rate, a supportable resolution, a supportable codec (e.g., HEVC, H.264, or MEPG), etc. Each decoder included in the multi-decoder 1030 may be designed to decompress compression according to at least one codec, or may support decompression of a plurality of codecs.
[0238] In addition, detailed configurations and arrangements of the demultiplexer 1020, the multi-decoder 1030, and the scaler 10740 included in the video processing unit 425 may vary according to product specifications, product grades, and the like.
[0239] For example, the multi-decoder 1030 may include a 4K decoder 1031 for decoding an image signal having a 4K resolution, two 2K decoders 1032 and 1033 for decoding an image signal having a 2K resolution, and a software (SW) decoder 1034 .
[0240] In addition, the 4K decoder 1031 may decode an image signal having a resolution of 4K or less. The 2K decoders 1032 and 1033 may decode an image signal having a resolution of 2K or less. The SW decoder 1034 may be designed to perform software decoding, and perform decoding corresponding to various codecs.
[0241] In addition, each of the plurality of decoders included in the multi-decoder 1030 may decode two or more pieces of content using time division. For example, two image signals corresponding to two pieces of 2K content may be decoded using one 2K decoder 1032.
[0242] The image signal decoded by the multi-decoder 1030 may be scaled by the scaler 1040 and may be output to the display 420. In detail, the scaler 1040 may scale the decoded image signal into an image frame output from the display 420.
[0243] Return to reference Figure 1a , assuming that the first content is 4K content, so the first image signal is sent as a 4K image signal; the second content is 2K content, so the second image signal is sent as a 2K image signal; the third content is 2K content, so the third image signal is sent as a 2K image signal, and the fourth content is 1K content, so the fourth image signal is sent as a 1K image signal.
[0244] Refer to Figure 1a and Fig.10 In the above example, the first image signal corresponding to the 4K content is decoded by the 4K decoder 1031. The second image signal corresponding to the 2K content is decoded by the 2K decoder 1032. The second image signal corresponding to the 2K content is decoded by the 2K decoder 1033. The image signal corresponding to the fourth content, which is the 1K content, is decoded by the SW decoder 1033.
[0245] The scaler 1040 may receive the decoded first image signal, the decoded second image signal, the decoded third image signal, and the decoded fourth image signal, and may scale each image signal into an image frame corresponding to each of the plurality of divided screens included in the multi-view screen 110. For example, the scaler 1040 may scale the decoded first image signal into a first image frame corresponding to the first partial screen 120, may scale the decoded second image signal into a second image frame corresponding to the second partial screen 130, may scale the decoded third image signal into a third image frame corresponding to the third partial screen 140, and may scale the decoded fourth image signal into a fourth image frame corresponding to the fourth partial screen 150.
[0246] In addition, the scaler 1040 may mix the scaled first to fourth image frames, and may generate and output image frames corresponding to the multi-view screen 110. Alternatively, the scaler 1040 may not mix the first to fourth image frames scaled by the scaler 104, and may output the scaled first to fourth image frames as is through the partitioned partial screen of the display 420. Therefore, the display 420 may display Figure 1a The multi-view screen 110 is shown in FIG.
[0247] As described above, when a video call request is received while the multi-view screen 110 is displayed, the display device 500 may identify at least one piece of content by performing operation S820.
[0248] Through the recognition operation of operation S820, the display device 500 may secure hardware and software resources required to decode the video call screen.
[0249] The following content will be described assuming that the content identified in operation S820 is the first content. Then, the processor 410 may stop decoding the first content (S831). In detail, since the first content is decoded by the 4K decoder 1031, the 4K decoder 1031 stops decoding the first content. Therefore, the 4K decoder 1031 may decode signals other than the first image signal, for example, an image signal corresponding to a video call screen. That is, when the display device 500 stops decoding the first image signal, the use of hardware and / or software resources (e.g., the 4K decoder 1031) required for decoding the video call screen may be ensured. That is, the display device 500 may perform decoding for the video call screen using a decoder that has stopped decoding the image signal of the selected content.
[0250] Subsequently, the 4K decoder 1031 that has stopped decoding the first content may decode an image signal corresponding to the video call screen (S833).
[0251] Therefore, a video call screen (not shown) may be output through a partial screen (eg, the first partial screen 120 ) on which the content (eg, the first content) identified in operation S820 has been output based on the image signal decoded by the 4K decoder 1031 .
[0252] As reference Fig.10 As described, in the display device and the operation method according to the embodiment of the present disclosure, when a video call request is received while a multi-view screen is output, at least one of the multiple contents output to the multi-view screen may be identified based on the video call request, and decoder resources included in the display device may be managed so that the video call screen is output to a partial screen on which the identified content has been output. Therefore, in the display device and the operation method according to the embodiment of the present disclosure, the display device outputting the multi-view screen may provide a video call service together without ending or interrupting the multi-view screen.
[0253] Fig.11 is a diagram showing a view of an example user interface screen displayed by a display device according to various embodiments. Fig.11 In the example, the four contents are decoded separately and passed through Figure 2 The layout of 245 multi-view screen output. In addition, included in Fig.11 The first content, the second content, the third content and the fourth content in the multi-view screen 1100 are Figure 1a or Figure 1b The multi-view screen 1100 may correspond to the first content, the second content, the third content, and the fourth content. Figure 1b The multi-view screen 111 corresponds to the multi-view screen 111. Therefore, when describing Fig.11 When the multi-view screen 1100 is displayed, it will no longer be repeated with the Figure 1b The same description is made of the multi-view screen 111.
[0254] In an embodiment of the present disclosure, the content identified in operation S820 may be content having the same resolution as that of the video call screen.
[0255] Return to reference Figure 8 Operation S820 may further include determining (not shown) whether there is at least one piece of content having a resolution corresponding to the video call screen according to the video call request, and when there is no at least one piece of content having a resolution corresponding to the video call screen, performing (not shown) a voice call switching process. Figure 8 and Fig.11 An example embodiment of operation S820 is described.
[0256] In detail, when the video call screen according to the video call request has an 8K resolution, the video call request may be a request for displaying a video call screen with an 8K resolution. For example, the video call request may include information about the resolution of the requested video call screen. In this case, the processor 410 may determine whether there is content corresponding to 8K resolution among the multiple pieces of content output through the multiple partial screens included in the multi-view screen 1100 based on the resolution information included in the video call request (specifically, the information about the resolution of the requested video call screen). Figure 1b Similarly, the first content output through the first partial screen 1111 of the multi-view screen 1100 may be 4K content, the second content output through the second partial screen 1112 may be 2K content, the third content output through the third partial screen 1113 may be 2K content, and the fourth content output through the fourth partial screen 1114 may be 1K content.
[0257] In the above example, since the resolution of the video call screen is 8K, there is no content having the same resolution as the resolution of the video call screen. In this case, the video call screen may not be output to a partial screen while maintaining the resolution of the video call screen. That is, there is no partial screen on which a video call screen having an 8K resolution is output at an 8K resolution. In this case, since the needs of users who want to receive high-quality (specifically, high-resolution) video call services are not reflected, the processor 410 may not provide a video call service.
[0258] As described above, when there is no content having the same resolution as the video call screen, the processor 410 may perform a voice call switching process. The voice call switching process may be a process for providing a voice call service instead of a video call when it is determined that the video call service cannot be provided in response to a video call request.
[0259] The processor 410 may perform a voice call switching process based on a user input.
[0260] Reference Fig.11 , as in the above example, when there is no content having the same resolution as that of the video call screen, the processor 410 may output a user interface menu 1130 for performing a voice call switching process. Fig.11 , the user interface menu 1130 is displayed as a transparent text window in a portion of the multi-view screen 1100. In addition, the size, position, transparency, and / or shape of the user interface menu 1130 may be determined in various ways.
[0261] When a user input selecting menu "Yes" 1131 is received through user interface menu 1130, processor 410 may switch the video call request to a voice call and may provide a voice call service. When providing a voice call service, there is no screen to be output (e.g., a video call screen). Therefore, processor 410 may continue to output the existing multi-view screen 1100. In addition, in order to provide the voice call service, processor 410 may stop outputting an audio signal corresponding to at least one of the multiple contents output through multi-view screen 1100, and may output the audio signal through a speaker (e.g., Figure 5 460) outputs an audio signal corresponding to the voice call.
[0262] Alternatively, the processor 410 may stop outputting an audio signal corresponding to at least one of the plurality of contents output through the multi-view screen 1100, and may output a subtitle message corresponding to the audio signal of each content. For example, a subtitle message corresponding to the audio signal of the first content may be output to the first partial screen 1111.
[0263] When a user input of selecting menu "No" 1132 is received through user interface menu 1130, processor 410 may end the voice call switching process without providing voice call service. In detail, when a user input of selecting menu "No" 1132 is received, processor 410 may continue to output multi-view screen 1100 without providing voice call and voice call service.
[0264] Fig.12 is a diagram showing a view of an example user interface screen displayed by a display device according to various embodiments. Fig.12 In the multi-view screen 1200, the same reference numerals are used to represent the same Fig.11 The elements of the multi-view screen 1100 are the same elements.
[0265] In an embodiment of the present disclosure, the content identified in operation S820 may be content having the same resolution as that of the video call screen. The following content will be described assuming that the resolution of the video call screen is 8K.
[0266] Return to reference Figure 8 , operation S820 may further include: determining (not shown) whether there is at least one piece of content having a resolution corresponding to the video call screen according to the video call request, and when there is no at least one piece of content having a resolution corresponding to the video call screen, ending (not shown) the video call process. Figure 8 and Fig.12 An example embodiment of operation S820 is described.
[0267] In the above example, since the resolution of the video call screen is 8K, there is no content having the same resolution as the resolution of the video call screen. Therefore, the processor 410 may end the video call process. In detail, the processor 410 may reject the video call request and may control the multi-view screen 1200 to be continuously output.
[0268] Reference Fig.12 When the video call processing ends, the processor 410 may display a message window 1230 stating “video call request rejected” or “video call service cannot be provided” on the multi-view screen 1200. Fig.12 , the message window 1230 is output as a non-transparent text window.
[0269] Fig.13 is a flowchart illustrating an example operating method of a display device according to various embodiments. Fig.13 In the drawings, the same reference numerals are used to represent Figure 8 and Fig. 9 In addition, Fig.13 Operation S829 may correspond to operation S820. Therefore, the same description as that described above will not be repeated. In addition, it will be assumed that Figure 5 The display device 500 executes the operating method 1300 of the display device to describe the following content.
[0270] The operating method 1300 of the display device according to an embodiment of the present disclosure may further include, after operation S810, receiving (S828) a user input selecting at least one of a plurality of partial screens included in the multi-view screen in response to a video call request.
[0271] In detail, operation S828 may include displaying (not shown) a user interface screen for selecting at least one of the plurality of partial screens in response to the video call request, and receiving (not shown) a user input selecting at least one of the plurality of partial screens through the user interface screen.
[0272] The operating method 1300 of the display device may include identifying ( S829 ) at least one piece of content from among the plurality of pieces of content output to the plurality of partial screens included in the multi-view screen based on the user input received in operation S828 . Operation S829 may be performed by the processor 410 .
[0273] Will refer to Figure 15 to Figure 16 Operation S829 of identifying content based on the user input is described in detail.
[0274] Fig.14 is a diagram showing a view of an example user interface screen displayed by a display device according to various embodiments. Fig.14In the multi-view screen 1400, the same reference numerals are used to represent the same Fig.11 The elements of the multi-view screen 1100 are the same elements.
[0275] In an embodiment of the present disclosure, when a video call request is received, the processor 410 may output a user interface menu 1430 for receiving a user input as to whether to accept the video call request.
[0276] The user interface menu 1430 may be a user interface menu for notifying that a video call request has been received and receiving a connection request or a connection rejection request. When a user input of selecting the menu "Yes" 1431 is received, the processor 410 identifies at least one piece of content from the plurality of pieces of content output to the partial screen of the multi-view screen 1400 (S829). The operation of identifying the content is the same as the operation in operation S820, and thus a detailed description will not be repeated.
[0277] When a user input selecting a menu 'No' 1432 is received through the user interface menu 1430, the processor 410 may continue to output the multi-view screen 1400 without providing a video call service.
[0278] Fig.15 is a diagram showing a view of an example user interface screen displayed by a display device according to various embodiments. Fig.15 In the drawings, the same reference numerals are used to represent Fig.14 The same components in.
[0279] Fig.13 Operation S828 of the method may further include: responding to a user input (eg, selecting Fig.14 A user interface menu “Yes” 1431 is input by a user, and a user interface menu for selecting at least one of the plurality of partial screens included in the multi-view screen 1400 is output (not shown).
[0280] For details, refer to Fig.15 In response to a user input of selecting the menu "Yes" 1431, the processor 410 may perform screen switching S1510 to output a user interface menu 1530. For example, the processor 410 may output the user interface menu 1530 indicating partial screen selection as a user interface screen. Subsequently, the processor 410 may output a user interface menu 1560 for partial screen selection through screen switching S1540. Then, the user may select a partial screen to which the video call screen is to be output in the user interface menu 1560.
[0281] When receiving the user's selection, the processor 410 may output the video call screen to the partial screen selected by the user. For example, when the user selects the first partial screen (display area "[1]"), the processor 410 may control the video call screen to be output through the first partial screen.
[0282] For example, when the resolution of the first content output through the first partial screen and the resolution of the video call screen are the same, the processor 410 may decode the video call screen by using a decoder that has decoded the first content.
[0283] Optionally, when the resolution of the first content output through the first partial screen and the resolution of the video call screen are different from each other, the processor 410 may enlarge or reduce the resolution of the image signal corresponding to the video call screen so that the resolution of the image signal corresponding to the video call screen is the same as the resolution of the decoder that has decoded the first content. Increasing the resolution of the image to be output may be referred to as enlarging, for example, and reducing the resolution of the image to be output may be referred to as reducing. The enlarging operation and the reducing operation may be performed by the processor 410. The processor 410 may control the video processing unit 425 to perform a decoding operation after the enlarging operation or the reducing operation.
[0284] In addition, for zooming in or out, an artificial intelligence (AI) scaling technology may be used. In detail, the AI scaling technology refers to a technology for adjusting the size or resolution of an input image using a neural network based on the AI technology. The AI scaling technology may include the AI ScaleNet technology. In detail, the AI ScaleNet technology may refer to a technology that uses a standard codec as is and has equivalent compression performance at a bit rate of about half of a reference codec through pre-processing and post-processing based on deep learning, for example. The pre-processing may include encoding, and the post-processing may include decoding.
[0285] The scaling technology using AI may be referred to as “AI codec”, for example. In an embodiment of the present disclosure, the processor 410 may include an AI reducer (not shown) and an AI amplifier (not shown) for performing the AI codec by itself. In addition, the AI reducer (not shown) and the AI amplifier (not shown) may be included in the processor 410. Fig.10 In each decoder included in the multi-decoder 1030.
[0286] In the above example, when the first partial screen is selected by user input and the resolution of the first content output through the first partial screen is different from the resolution of the video call screen, the processor 410 may use the AI codec to enlarge or reduce the image signal corresponding to the video call screen, and may use the decoder that has decoded the first content to decode the enlarged or reduced image signal. Therefore, the video call screen may be output to the first partial screen on which the first content has been output.
[0287] Fig.16 is a diagram showing a view of an example user interface screen displayed by a display device according to various embodiments. Fig.16 In the drawings, the same reference numerals are used to represent Fig.14 and Fig.15 The same components in.
[0288] Reference Fig.16 , after outputting the multi-view screen 1400 including the user interface menu 1430, the processor 410 may output a sub-window 1630 including the user interface menu 1560 for partial screen selection and the user interface menu 1640 for screen layout change through screen switching S1610.
[0289] When the user wants to display the multi-view screen 1400 by including the multi-view screen 1400 having a layout different from that of the current multi-view screen 1400 (e.g., Figure 2 When the video call screen is output through at least one partial screen of the screen layout 241, 242, 243 or 246), the user may change the screen layout using the user interface menu 1640 for screen layout change, and may select at least one partial screen included in the changed screen layout. Then, the processor 410 may output the video call screen through at least one selected partial screen in the changed layout.
[0290] Fig.17 is a flowchart illustrating an example operating method of a display device according to various embodiments. Fig.17 In the method 1700 for operating a display device, the same reference numerals are used to represent the same Figure 8 The same operations as those of the method for operating the display device 800, and operations S822 and S839 may be respectively Figure 8 Therefore, the same description as that made above will not be repeated.
[0291] It will be assumed that Figure 5 The display device 500 executes the operating method 1700 of the display device to describe the following content.
[0292] As described above, when an image signal corresponding to the entire video call screen is received, the image signal may be an image signal having a resolution of 1K, 2K, 4K, or 8K. That is, the image signal corresponding to the video call screen may be an image signal indicating an image in which both a user image and a counterpart image are included. In this case, the image signal may be completely decoded and may be output through a partial screen.
[0293] Therefore, in order to output the video call screen, a partial screen included in the multi-view screen is required, and thus, it is sufficient to recognize only one piece of content.
[0294] Reference Fig.17 , the operation method 1700 of the display device (e.g., 500) may include: based on the video call request received after operation S810, identifying a piece of content from a plurality of pieces of content output to a plurality of partial screens included in the multi-view screen (S822). In detail, in operation S822, a piece of content may be identified based on the video call request. Figures 19 to 21 Describe in detail the operation of identifying a piece of content.
[0295] The video call screen may be output through a partial screen on which the content identified in operation S822 has been output (S839). Fig.18 Operation S839 is described in detail. In the above example, the video call screen may be displayed through the identified partial screen.
[0296] For ease of explanation, the following content will be described assuming that the content identified in operation S822 is the "first content" and the partial screen to which the "first content" has been output is the "first partial screen". That is, in operation S822, the first content among the plurality of content output through the multi-view screen may be identified based on the video call request. In operation S823, the video call screen may be displayed through the first partial screen.
[0297] Fig.18 is a flowchart illustrating an example operation method of a display device according to various embodiments. Fig.18 In the method 1800 for operating the display device, the same reference numerals are used to represent the same Fig.17 The operation of the operating method 1700 of the display device is the same as the operation of the display device, and thus a description thereof will not be repeated.
[0298] It will be assumed that Figure 5 The display device 500 executes the operating method 1800 of the display device to describe the following content.
[0299] Reference Fig.18 , Fig.17The operation S839 may include an operation S1831, an operation S1832, and an operation S1833. The operation S1831, the operation S1832, and the operation S1833 may be respectively Fig. 9 Operation S831, operation S832, and operation S833 correspond to each other, and therefore, will not be repeated with reference to Fig. 9 The description is the same as the description given above.
[0300] In detail, in the operating method 1800 of the display device, operation S839 of outputting the video call screen may include operation S1831, operation S1832, and operation S1833, wherein in operation S1831, any one decoder (not shown) included in the display device 500 stops decoding the content identified in operation S822, in operation S1832, the decoder (not shown) that has decoded the identified content decodes an image signal corresponding to the video call screen, and in operation S1833, the video call screen is output through a partial screen on which the identified content has been output based on the image signal decoded in operation S1832. The "decoder (not shown) that has decoded the identified content" may refer to, for example, a decoder that has stopped decoding.
[0301] Return to reference Fig.10 , the first image signal corresponding to the 4K content is decoded by the 4K decoder 1031. The second image signal corresponding to the 2K content is decoded by the 2K decoder 1032. The third image signal corresponding to the 2K content is decoded by the 2K decoder 1033. The image signal corresponding to the fourth content which is the 1K content is decoded by the SW decoder 1033.
[0302] In the above example, when the content identified in operation S822 is the first content, the first content is decoded by the 4K decoder 1031. Therefore, in operation S1831, the 4K decoder 1031 may stop decoding the first content, and in operation S1832, the 4K decoder 1031 may start decoding the image signal corresponding to the video call screen. Therefore, the image signal decoded by the 4K decoder 1031 may be displayed through the first partial screen (specifically, the partial screen on which the first content has been output) (S1833).
[0303] Fig.19 is a diagram showing a view of an example user interface screen displayed by a display device according to various embodiments. Fig.19 1 , the same elements as those in FIG. 1 are denoted by the same reference numerals. Therefore, the same description as that made above will not be repeated.
[0304] In an embodiment of the present disclosure, operation S820 may include identifying content that is a real-time broadcast or a live broadcast from among a plurality of pieces of content output through the multi-view screen based on the video call request.
[0305] In addition, operation S822 may include identifying a piece of content that is not a real-time broadcast or a live broadcast from the plurality of pieces of content output through the multi-view screen based on the video call request. Here, the term "real-time broadcast or live broadcast" may refer to, for example, a broadcast that transmits content according to time and provides content that can be viewed only at a specific time. In addition, the term "non-real-time broadcast or non-live broadcast" may refer to, for example, a broadcast that transmits content independently of time and provides content that can be viewed again at any time intended by the user or can be interrupted or played regardless of time.
[0306] For example, the non-real-time broadcast or non-live broadcast content may be content provided by a search engine of an Internet portal site and a server that provides content that can be purchased and viewed at any time.
[0307] That is, in operation S820 or operation S822, content that can be viewed again at any time intended by the user regardless of time or content that can be interrupted or played regardless of time may be identified from among a plurality of pieces of content output through the multi-view screen.
[0308] In the multi-view screen 110 of FIG1 , the third content may be video streaming content corresponding to a volleyball game received from a server of a content provider, rather than a real-time broadcast or live broadcast, and for ease of explanation, the third content is indicated by an icon C131. In addition, the fourth content may be Internet content received from a website server providing a portal site, and for ease of explanation, the fourth content is indicated by an icon D151.
[0309] Therefore, in operation S820 or operation S822, the third content and the fourth content as non-real-time or non-live content may be identified. In addition, one of the third content and the fourth content that is most easily interrupted and re-executed may be finally identified. For example, since Internet content (e.g., a search engine) received from a website server may be easily re-executed at any time, the fourth content may be finally identified.
[0310] Therefore, in operation S830 or operation S832, a video call screen may be displayed on the fourth partial screen 150 on which the recognized content (in the above example, the fourth content) is output. The video call screen may include a counterpart image 1910 and a user image 1920.
[0311] Furthermore, in an embodiment of the present disclosure, in operation S820, content having the lowest resolution may be identified from among a plurality of pieces of content output through the multi-view screen based on the video call request.
[0312] Also, in operation S822, a piece of content having a lowest resolution may be identified from among a plurality of pieces of content output through the multi-view screen based on the video call request.
[0313] exist Figure 1a In the multi-view screen 110 of FIG. 5 , the content with the lowest resolution may be the fourth content. Therefore, in operation S820 or operation S822, the fourth content may be identified as the content with the lowest resolution. Therefore, in operation S830 or operation S832, the video call screen may be displayed on the fourth partial screen 150 on which the identified content (in the above example, the fourth content) is output. That is, the display device 500 may display the multi-view screen 1900 including the video call screen.
[0314] Fig. 20 is a diagram showing a view of a user interface screen displayed by a display device according to various embodiments. Fig. 20 In the drawings, the same reference numerals are used to represent Figure 1a and Fig.19 Therefore, the same description as that described above will not be repeated.
[0315] In an embodiment of the present disclosure, operation S820 may include: when the video call request is received, identifying at least one piece of content based on a user input.
[0316] Also, in operation S822, a piece of content may be identified based on a user input based on the video call request.
[0317] For example, when the user receives a video call request, the user may select a third partial screen 140 on which the third content is output from the plurality of partial screens. In operation S830 or operation S832, the third content corresponding to the partial screen selected by the user may be identified. Therefore, in operation S830 or operation S832, the video call screen may be displayed on the third partial screen 140 on which the identified content (in the above example, the third content) is output. That is, the display device 500 may display the multi-view screen 2000 including the video call screen.
[0318] Fig.21 is a diagram showing a view of a user interface screen displayed by a display device according to various embodiments. Fig.21 In the drawings, the same reference numerals are used to represent Figure 1a and Fig.19 Therefore, the same description as that made above will not be repeated.
[0319] In an embodiment of the present disclosure, operation S820 may include identifying, based on the video call request, at least one piece of content having the same resolution as that of the video call screen.
[0320] Also, in operation S822, a piece of content having the same resolution as that of the video call screen may be identified based on the video call request.
[0321] For example, assuming that the video call request is a video call request for displaying a video call screen with a 4K resolution, because the first content is 4K content, the first image signal is transmitted as a 4K image signal; because the second content is 2K content, the second image signal is transmitted as a 2K image signal; because the third content is 2K content, the third image signal is transmitted as a 2K image signal; and because the fourth content is 1K content, the fourth image signal is transmitted as a 1K image signal.
[0322] In this case, in operation S820 or operation S822, the first content may be identified as content having the same resolution as a 4K resolution, which is a resolution of the video call screen.
[0323] Therefore, in operation S830 or operation S832, the video call screen may be displayed on the first partial screen 120 on which the identified content (in the above example, the first content) is output. That is, the display device 500 may display the multi-view screen 2100 including the video call screen.
[0324] Fig. 22 is a flowchart illustrating an example operation method of a display device according to various embodiments. Fig. 22 In the method 2200 for operating the display device, the same reference numerals are used to represent the same Figure 8 The same operations as those in the method 800 for operating the display device, and in addition, operations S825 and S835 may be respectively Figure 8 Therefore, the same description as that made above will not be repeated.
[0325] It will be assumed that Figure 5 The display device 500 executes the operating method 2200 of the display device to describe the following content.
[0326] As described above, a user image signal corresponding to a user image and a counterpart image signal corresponding to a counterpart image constituting a video call screen may be transmitted. In this case, the video call request may be a video call request for displaying a counterpart image and a user image corresponding to the counterpart image signal and the user image signal, respectively. Therefore, when a video call service is provided in response to the video call request, it is necessary to output the counterpart image and the user image through two different partial screens.
[0327] According to the embodiments of the present disclosure, reference will be made to Figure 22 to Figure 24 Detailed Description The counterpart image and the user image may be output through two different partial screens.
[0328] Reference Fig. 22 , the operating method 2200 of the display device (e.g., 500) may include: based on the video call request received after operation S810, identifying two pieces of content from a plurality of pieces of content output to a plurality of partial screens included in the multi-view screen (S825).
[0329] The counterpart image and the user image may be displayed through two partial screens corresponding to the two pieces of content identified in operation S825, respectively (S835).
[0330] One of the two pieces of content identified in operation S825 may be content having the same resolution as that of the counterpart image signal, and the other may be content having the same resolution as that of the user image signal.
[0331] Alternatively, the two pieces of content identified in operation S825 may be two pieces of content having the lowest resolution among the multiple pieces of content output through the multi-view screen. Alternatively, the two pieces of content identified in operation S825 may be two pieces of content selected by a user from among the multiple pieces of content output through the multi-view screen.
[0332] Alternatively, the two pieces of content identified in operation S825 may be two pieces of content selected in order of having the lowest resolution from among the plurality of pieces of content output through the multi-view screen.
[0333] Alternatively, the two pieces of content identified in operation S825 may be two pieces of content having offset resolutions among a plurality of pieces of content output through the multi-view screen.
[0334] Alternatively, the two pieces of content identified in operation S825 may be two pieces of content output through a main screen and a sub-screen among a plurality of pieces of content output through a multi-view screen.
[0335] Alternatively, the two pieces of content identified in operation S825 may be two pieces of content output through two preset partial screens among a plurality of pieces of content output through the multi-view screen.
[0336] Alternatively, the two pieces of content identified in operation S825 may be the last two pieces of content played among the plurality of pieces of content output through the multi-view screen.
[0337] Alternatively, the two pieces of content identified in operation S825 may be two pieces of content related to each other among the multiple pieces of content output through the multi-view screen. “Multiple pieces of content related to each other” may refer to two or more pieces of content outputting related images among the multiple pieces of content output through the multi-view screen.
[0338] For example, “multiple pieces of content related to each other” may be, for example, multiple pieces of content corresponding to multiple scenes in sports game content (such as baseball). In detail, when one piece of content is content mainly showing a batter in a baseball game, another piece of content related to the one piece of content may be content mainly showing a catcher in a specific baseball game, content mainly showing a head coach, and / or content mainly showing an audience. In another example, in the case of content broadcasting a specific performance, multiple pieces of content showing multiple performers performing or performing in the performance may be multiple pieces of content related to each other. In a specific classical music performance, content broadcasting a violinist, content broadcasting a cellist, content broadcasting a conductor, and / or content broadcasting a pianist may be multiple pieces of content related to each other.
[0339] For example, the multi-view screen may include four partial screens, and the two pieces of content output through two of the four partial screens may be multiple pieces of content related to each other. In this case, the two pieces of content identified in operation S825 may be two pieces of content related to each other.
[0340] When there are three or more pieces of content related to each other among the multiple pieces of content included in the multi-view screen, in operation S825, two pieces of content may be selected from the three or more pieces of content related to each other. For example, the processor 410 may select two pieces of content from the multiple pieces of content related to each other in the order in which they were last received. Alternatively, the processor 410 may select two pieces of content in the order with the lowest resolution from the multiple pieces of content related to each other. Alternatively, the processor 410 may select two pieces of content in the order with the highest resolution from the multiple pieces of content related to each other. Alternatively, the processor 410 may select two pieces of content having a resolution corresponding to the resolution of the image signal of the counterpart image and the resolution of the image signal of the user image from the multiple pieces of content related to each other.
[0341] For example, when a user image signal and a counterpart image signal constituting a video call screen have an ultra high definition (UHD) resolution and a full high definition (FHD) resolution, respectively, the multiview application included in the processor 410 may identify two pieces of content having the UHD resolution and the FHD resolution from among a plurality of pieces of content output through the multiview screen. The multiview application may control to stop decoding of the identified two pieces of content, and decode the user image signal and the counterpart image signal by using the decoder whose decoding has been stopped.
[0342] Fig.23 is a diagram showing a view of an example user interface screen displayed by a display device according to various embodiments. Fig.23 In the drawings, the same reference numerals are used to represent Figure 1a Therefore, the same description as that made above will not be repeated.
[0343] Reference Fig. 22 and Fig.23 , the operating method 2200 of the display device (e.g., 500) may include: based on the video call request received after operation S810, identifying two pieces of content from a plurality of pieces of content output to a plurality of partial screens included in the multi-view screen 2300 (S825).
[0344] The counterpart image and the user image may be displayed through two partial screens corresponding to the two pieces of content identified in operation S825 (S835).
[0345] For example, one of the two contents identified in operation S825 may be content having the same resolution as that of the counterpart image signal, and the other may be content having the same resolution as that of the user image signal. For example, because the third content is 2K content, the third image signal is transmitted as a 2K image signal, and because the fourth content is 1K content, the fourth image signal is transmitted as a 1K image signal. It is assumed that the counterpart image signal is an image signal having a 2K resolution, and the user image signal is an image signal having a 1K resolution. In this case, in operation S825, the third content and the fourth content having resolutions corresponding to the resolutions of the counterpart image signal and the user image signal may be identified.
[0346] Therefore, in operation S835, the counterpart image 2310 may be displayed through the third partial screen on which the recognized third content is output, and the user image 2320 may be displayed through the fourth partial screen on which the recognized fourth content is output.
[0347] Fig.24 is a diagram illustrating views of example user interface screens displayed by a display device according to various embodiments.
[0348] Reference Fig.24 , the multi-view screen 2400 including four partial screens may include a main screen 2410 and one or more sub-screens 2420 , 2430 , and 2440 .
[0349] In the above example, the two pieces of content identified in operation S825 may be two pieces of content output through the main screen and the sub-screen among the plurality of pieces of content output through the multi-view screen. For example, content output through the main screen 2410 and content output through any one of the sub-screens 2420, 2430, and 2440 may be identified. In addition, when there are a plurality of sub-screens, content output through the uppermost sub-screen or the leftmost partial screen may be identified.
[0350] The user provided with the video call service may generally want to view the image of the counterpart in a large size, and may want to view the image of the user in a small size. Therefore, the two pieces of content identified in operation S825 may be two pieces of content output through the main screen and the sub-screen among the multiple pieces of content output through the multi-view screen. The image of the counterpart may be displayed through the main screen, and the image of the user may be displayed through the sub-screen.
[0351] Reference Fig.24 , the counterpart image and the user image may be respectively displayed on the main screen 2410 and the sub-screen (e.g., 2420) on which the two pieces of content identified in operation S825 have been output. Therefore, the multi-view screen 2400 in which the counterpart image is displayed on the main screen 2410 and the user image is displayed on the sub-screen (e.g., 2420) may be output.
[0352] Fig.25 is a diagram illustrating a view of an example user interface screen displayed by a display device according to various embodiments. Fig.25 , the multi-view screen 2500 including four partial screens may include a main screen 2510 and one or more sub-screens 2520 , 2530 , and 2540 .
[0353] Reference Fig.25 , the counterpart image and the user image may be displayed on the main screen 2510 and the sub-screen (e.g., 2520) on which the two pieces of content identified in operation S825 have been output. Therefore, the multi-view screen 2500 in which the counterpart image is displayed on the main screen 2510 and the user image is displayed on the sub-screen (e.g., 2520) may be output.
[0354] As described above, in the embodiments of the present disclosure, a display device that receives a video call request while outputting a multi-view screen can provide a video call service while continuing to output the multi-view screen to improve user satisfaction. Therefore, user satisfaction and user convenience can be improved.
[0355] The operating method of the display device according to the embodiment of the present disclosure can be implemented as a program command executable by various computer components and can be recorded on a computer-readable medium. In addition, the embodiment of the present disclosure can be implemented in a computer-readable recording medium having at least one program recorded thereon, wherein the at least one program includes instructions for executing the operating method of the display device.
[0356] The computer-readable medium may include program commands, data files, data structures, etc., either individually or in combination. The program commands recorded on the computer-readable medium may be specially designed and configured for the present disclosure, or may be known to and usable by those of ordinary skill in the field of computer software. Examples of computer-readable recording media include magnetic media (such as hard disks, floppy disks, or magnetic tapes), optical media (such as compact disk read-only memories (CD-ROMs) or digital versatile disks (DVDs)), magneto-optical media (such as optical-magnetic floppy disks), and hardware devices (such as ROMs, RAMs, or flash memory) specially configured to store and execute program commands. Examples of program commands include high-level language codes that can be executed by a computer using an interpreter, etc., and machine language codes made by a compiler.
[0357] The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, the term "non-transitory storage medium" refers to a tangible device and does not include signals (e.g., electromagnetic waves). The term does not distinguish whether data is stored in the storage medium semi-permanently or temporarily. For example, a "non-transitory storage medium" may include a buffer that temporarily stores data.
[0358] According to an embodiment of the present disclosure, the operating method of the display device according to various embodiments of the present disclosure may be provided in a computer program product. The computer program product is a product that can be purchased between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., a compact disc read-only memory (CD-ROM)), or may be downloaded via an application store (e.g., Play Store TM ) or distributed online (e.g., downloaded or uploaded) or directly between two user devices (e.g., smart phones). When distributed online, at least part of the computer program product (e.g., the downloadable application) may be temporarily generated or at least temporarily stored in a machine-readable storage medium, such as a memory of a manufacturer's server, an application store's server, or a relay server.
[0359] The embodiments of the present disclosure may be implemented as a computer program product including a recording medium having recorded thereon a program for executing the operating method of the display device.
[0360] Although the embodiments of the present disclosure have been described in detail above, the scope of the present disclosure is not limited thereto, and various modifications and improvements made by a person of ordinary skill in the art by using the basic concept of the present disclosure defined by the claims are also within the scope of the present disclosure.
Claims
1. A method for operating a display device, the display device comprising a plurality of decoders, the display device being used to display a multi-view screen comprising a plurality of partial screens, the method comprising: outputting, through the plurality of partial screens, a plurality of pieces of content individually decoded using the plurality of decoders; In response to a video call request being received, identifying at least one of the plurality of pieces of content to ensure resources required to decode a video call screen; outputting a video call screen through at least one partial screen corresponding to the identified at least one piece of content among the plurality of partial screens, The step of outputting the video call screen includes: stopping, by at least one decoder included in the display device, decoding of the identified at least one piece of content; decoding, by the at least one decoder that has stopped decoding, an image signal corresponding to the video call screen; and A video call screen is output through the at least one partial screen based on the decoded image signal.
2. The operating method according to claim 1, wherein: The identifying of the at least one piece of content includes identifying the at least one piece of content having a resolution identical to a resolution of a video call screen from among the plurality of pieces of content.
3. The operating method according to claim 1, wherein: The step of identifying the at least one piece of content includes identifying the at least one piece of content having an offset resolution from among the plurality of pieces of content.
4. The operating method according to claim 1, wherein: The step of identifying the at least one piece of content includes identifying the at least one piece of content having a lowest resolution from among the plurality of pieces of content.
5. The operating method according to claim 1, wherein: The step of identifying the at least one piece of content includes identifying content output through a main screen from among the plurality of pieces of content.
6. The operating method according to claim 1, wherein: The step of identifying the at least one piece of content further includes: determining whether the at least one piece of content has a resolution corresponding to a video call screen; and Based on the fact that no content is determined to have a resolution corresponding to the video call screen, a voice call switching process is performed.
7. The operating method according to claim 1, wherein: The step of identifying the at least one piece of content further includes: determining whether the at least one piece of content has a resolution corresponding to a video call screen; and Based on no content being determined to have a resolution corresponding to the video call screen, the video call process is ended.
8. The operating method according to claim 1, further comprising: displaying, in response to a video call request, a user interface screen for selecting at least one partial screen of the plurality of partial screens; as well as receiving, through the user interface screen, a user input for selecting at least one partial screen of the plurality of partial screens, The step of identifying the at least one piece of content includes: identifying the at least one piece of content based on received user input.
9. The operating method according to claim 1, wherein: The step of identifying the at least one piece of content includes: identifying a first piece of content from among the plurality of pieces of content output through the multi-view screen in response to the video call request, and The outputting of the video call screen includes outputting the video call screen through a first partial screen corresponding to the first content.
10. The operating method according to claim 9, wherein: The steps to output the video call screen include: stopping decoding of a first image signal corresponding to the first content; decoding the image signal by the decoder that has stopped decoding the first image signal; and Based on the decoded image signal, a video call screen is output through the first partial screen.
11. The operating method according to claim 1, wherein: The step of identifying the at least one piece of content includes: identifying first content and second content from the plurality of pieces of content output through the multi-view screen based on the video call request, and The outputting of the video call screen includes displaying a counterpart image and a user image included in the video call screen on a first partial screen corresponding to the first content and a second partial screen corresponding to the second content, respectively.
12. The operating method according to claim 11, wherein: The step of outputting the video call screen also includes: stopping decoding of a first image signal and a second image signal corresponding to the first content and the second content, respectively; decoding, by the decoder which has stopped decoding the first image signal and the second image signal, a counterpart image signal and a user image signal corresponding to the counterpart image and the user image, respectively; and Based on the decoded counterpart image signal and user image signal, a counterpart image and a user image are output to a first partial screen and a second partial screen, respectively.
13. The operating method according to claim 11, wherein: The first partial screen is a main screen among the plurality of partial screens, and The second partial screen is a sub-screen among the plurality of partial screens.
14. A display device, comprising: monitor; Communication interface; A video processing unit including a plurality of decoders; as well as A processor is configured to execute at least one instruction to perform the following operations: controlling the display to respectively output the plurality of pieces of content individually decoded by the plurality of decoders included in the video processing unit through a plurality of partial screens included in the multi-view screen, In response to a video call request being received, identifying at least one piece of content from the plurality of pieces of content to ensure resources required for decoding the video call screen, controlling at least one of the plurality of decoders to stop decoding the identified at least one piece of content, controlling the at least one decoder that has stopped decoding to decode an image signal corresponding to a video call screen, and Based on the decoded image signal, the display is controlled to output a video call screen through at least one partial screen among the plurality of partial screens corresponding to the identified at least one piece of content.
Citation Information
Patent Citations
User terminal apparatus and controlling method thereof
CN104603733A
User interface method, system and device in a multitasking environment
CN1925556A