Display device and video calling method performed by the display device

Abstract

A display device configured to communicate with a mobile device for a video call. The display device is configured to activate a camera based on a video call request received from the mobile device, obtain image data of a paired mobile device through a communication interface, and control a display to display a video call screen image, the video call screen image including a first image of the paired mobile device generated based on the image data and a second image obtained by the camera.

Description

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application is based on and claims the benefit of priority under 35 U.S.C. §119 to Korean Patent Application No. 10-2019-0179808, filed on December 31, 2019, in the Korean Intellectual Property Office, the disclosure of which is incorporated herein by reference in its entirety. Technical Field

[0003] The present disclosure relates to a display device and a mobile device capable of performing a video call, a video calling method performed by the display device, and a video calling method performed by the mobile device. Background Art

[0004] With the development of wired and wireless communication networks, electronic devices that display screen images and output data visually recognizable to a user may be connected to each other via the wired and wireless communication networks.

[0005] Electronic devices can send data and receive various data segments to each other through wired and wireless communication networks. In addition, an electronic device can remotely control another electronic device, or can use the electronic device to perform operations or services via another electronic device.

[0006] Examples of electronic devices connectable to each other via a wired or wireless communication network may include portable computers (eg, notebooks, netbooks, or tablet personal computers (PCs)), portable terminals (eg, smartphones or personal digital assistants (PDAs)), and TVs.

[0007] When electronic devices are connected to each other via a communication network, desired services or functions can be provided to users of the electronic devices more conveniently.

[0008] Therefore, there is a need for devices and methods that enable electronic devices to be connected and utilized with each other according to the needs and desired services of users to improve the user's satisfaction level and convenience. Summary of the Invention

[0009] A display device, a mobile device, a video calling method performed by the display device, and a video calling method performed by the mobile device are provided, through which a user can perform a video call more conveniently while viewing a video calling screen image.

[0010] Specifically, a display device, a mobile device, a video call method performed by the display device, and a video call method performed by the mobile device are provided, wherein a user performs a video call through the display device, the mobile device, the video call method performed by the display device, and the video call method performed by the mobile device while watching a video call screen image through a display device having a large-size screen, thereby increasing user convenience and user satisfaction level, as compared to the mobile device.

[0011] Additional aspects will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the presented embodiments of the disclosure.

[0012] According to an embodiment of the present disclosure, a display device is provided, comprising a display, a camera, a communication interface configured to communicate with a mobile device, and a processor configured to execute at least one instruction. The processor may be configured to execute the at least one instruction to: activate the camera based on a video call request received from the mobile device, obtain image data of a paired mobile device for a video call through the communication interface, and control the display to display a video call screen image, the video call screen image comprising a first image of the paired mobile device generated based on the image data and a second image obtained by the camera.

[0013] According to another embodiment of the present disclosure, a mobile device is provided, comprising a display, a camera, a user interface, a communication interface configured to communicate with the display device, and a processor configured to execute at least one instruction. The processor is configured to execute the at least one instruction to: in response to the user interface receiving a user input requesting output of a video call screen image via the display device, control the communication interface to transmit a video call request corresponding to the user input to the display device, and control the display to output a user interface screen image for controlling execution of the video call.

[0014] According to another embodiment of the present disclosure, a video call method performed by a display device is provided, the method including: activating a camera of the display device based on receiving a video call request from a mobile device; obtaining image data for a paired mobile device by the display device; and outputting a video call screen image to be output through the display device, the video call screen image including a first image of the paired mobile device generated based on the image data and a second image of the user of the mobile device obtained by the camera.

[0015] According to another embodiment of the present disclosure, a video call method performed by a mobile device is provided, the method including: receiving, by the mobile device, a user input requesting output of a video call screen image through a display device; sending a video call request corresponding to the user input from the mobile device to the display device; and outputting, through the display of the mobile device, a user interface screen image for controlling the execution of the video call. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] The above and other aspects, features and advantages of certain embodiments of the present disclosure will become more apparent from the following description taken in conjunction with the accompanying drawings, in which:

[0017] Figure 1 shows a mobile device and a display device connected to each other through a communication network according to an embodiment of the present disclosure;

[0018] Figure 2 is a flowchart of a video calling method according to an embodiment of the present disclosure;

[0019] Figure 3 is a block diagram of a display device according to an embodiment of the present disclosure;

[0020] Figure 4 is a block diagram of a display device according to an embodiment of the present disclosure;

[0021] Figure 5 is a block diagram of a mobile device according to an embodiment of the present disclosure;

[0022] Figure 6 is a flowchart of a video calling method performed by a mobile device according to an embodiment of the present disclosure;

[0023] Figure 7 shows a user interface (UI) screen image output by a mobile device according to an embodiment of the present disclosure;

[0024] Figure 8 shows a UI screen image output by a mobile device according to an embodiment of the present disclosure;

[0025] Figure 9 shows a UI screen image output by a mobile device according to an embodiment of the present disclosure;

[0026] Figure 10 is a flowchart of a video calling method performed by a display device according to an embodiment of the present disclosure;

[0027] Figure 11 shows a video call screen image output by a display device according to an embodiment of the present disclosure;

[0028] Figure 12is a flowchart of an image calling method according to an embodiment of the present disclosure;

[0029] Figure 13 is a flowchart of a video calling method performed by a mobile device according to an embodiment of the present disclosure;

[0030] Figure 14 is a flowchart of a video calling method performed by a display device according to an embodiment of the present disclosure;

[0031] Figure 15 is a flowchart of an image calling method according to an embodiment of the present disclosure;

[0032] Figure 16 is a flowchart of a video calling method performed by a display device according to an embodiment of the present disclosure;

[0033] Figure 17 is a flowchart of an image calling method according to an embodiment of the present disclosure;

[0034] Figure 18 is a flowchart of a video calling method performed by a display device according to an embodiment of the present disclosure;

[0035] Figure 19 is a view for explaining a viewing angle detection operation performed by a display device according to an embodiment of the present disclosure;

[0036] Figure 20 is a view for explaining a viewing angle detection operation performed by a display device according to an embodiment of the present disclosure;

[0037] Figure 21 is a flowchart of a video calling method performed by a display device according to an embodiment of the present disclosure;

[0038] Figure 22 is a flowchart for explaining a screen image switching operation performed by a display device according to an embodiment of the present disclosure;

[0039] Figure 23 is a flowchart of a video calling method performed by a display device according to an embodiment of the present disclosure;

[0040] Figure 24 is a flowchart for explaining a screen image switching operation performed by a display device according to an embodiment of the present disclosure;

[0041] Figure 25 is a flowchart for explaining a screen image switching operation performed by a display device according to an embodiment of the present disclosure;

[0042] Figure 26is a view for explaining a position changing operation of a display performed by a display device according to an embodiment of the present disclosure;

[0043] Figure 27 is a block diagram of a display device according to an embodiment of the present disclosure; and

[0044] Figure 28 is a block diagram of a mobile device according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0045] The embodiments of the present disclosure are described in detail herein with reference to the accompanying drawings so that the present disclosure can be easily understood by those skilled in the art. However, the present disclosure can be embodied in many different forms and should not be construed as being limited to the embodiments set forth herein. In the accompanying drawings, portions not relevant to the description are omitted for simplicity of explanation, and similar reference numerals refer to similar elements throughout the text.

[0046] Throughout this specification, when an element is referred to as being "connected" or "coupled" to another element, the element may be directly connected or coupled to the other element, or may be electrically connected or coupled to the other element with an intervening element interposed therebetween. Furthermore, when the terms "comprising" and / or "including" or "including" and / or "comprising" are used in this specification, they specify the presence of the stated elements but do not preclude the presence or addition of one or more other elements.

[0047] Thus, the phrases "according to some embodiments" or "according to an embodiment" used throughout this disclosure are not necessarily referring to the same embodiment.

[0048] Some embodiments can be described based on function block components and various processing steps. Some or all of these function blocks can be implemented by any number of hardware components and / or software modules configured to perform and realize the specified function. For example, function blocks according to the present disclosure can be implemented by one or more processors or microprocessors or by circuit components that are specially programmed for the desired function or generally execute software to perform the desired function. In addition, for example, function blocks according to the present disclosure can be implemented using any programming or scripting language. Function blocks can be implemented using programming algorithms executed under the control of one or more processors. In addition, the disclosure described herein can adopt any number of conventional technologies for electronic configuration, signal processing and / or control, data processing, etc. The terms "module", "component" and "configuration" are used broadly and are not limited to mechanical or physical implementations.

[0049] In addition, the connecting lines or connectors between the components shown in the various figures are intended to represent exemplary functional relationships and / or physical or logical connections between the components. The connections between the components can be represented by many alternative or additional functional relationships, physical connections or logical connections in actual devices.

[0050] In addition, the description of "at least one of A, B, or C" can mean "A", "B", "C", "A and B", "A and C", "B and C", and one of "A, B, and C".

[0051] According to an embodiment of the present disclosure, a display device, a mobile device, a video call method executed by the display device, and a video call method executed by the mobile device are provided, through which a user can more conveniently perform a video call while watching a video call screen image.

[0052] According to an embodiment of the present disclosure, a portable type electronic device is referred to as a mobile device, a user device or a user equipment. Hereinafter, an electronic device capable of providing a large screen image through a display larger than a mobile device will be referred to as a "display device".

[0053] Specifically, a mobile device refers to a user's portable electronic device and may be a wearable device, smartphone, tablet PC, PDA, laptop computer, media player, etc. A display device refers to an electronic device that includes a display having a larger size than the above mobile devices and can provide a screen image having a larger size than the screen image of the mobile device to the user. For example, a display device may be a TV, digital TV, smart TV, digital signage, or digital bulletin board.

[0054] In the accompanying drawings, similar elements use similar reference numerals. In addition, in the entire detailed description, the same terms are used to describe the same components.

[0055] A display device, a mobile device, a video call method performed by the display device, and a video call method performed by the mobile device according to embodiments of the present disclosure will now be described in detail with reference to the accompanying drawings.

[0056] Figure 1 A mobile device and a display device connected to each other through a communication network according to an embodiment of the present disclosure are shown.

[0057] The mobile device 110 and the display device 120 may be connected to each other via a wired or wireless communication network. According to an embodiment of the present disclosure, a video call function or a video call service may be provided using the mobile device 110 and the display device 120.

[0058] The communication network 103 connecting the mobile device 110 to the display device 120 is a wired and / or wireless communication network capable of transmitting or receiving signals corresponding to specific data between devices. For example, the communication network 103 may be formed according to wireless network standards such as a local area network (LAN), a wide area network (WAN), a wireless LAN (WLAN) (Wi-Fi), wireless broadband (Wibro), CDMA, WCDMA, near field communication (NFC), or Bluetooth. The communication network 103 may be a wired network such as an HDMI cable or an MHL cable that connects the mobile device 110 to the display device 120 using a wired cable, or a wired Ethernet or fiber optic network.

[0059] Figure 1 The configuration in which the mobile device 110 is a user's smartphone and the display device 120 is a TV (specifically a smart TV) is shown. For clarity, Figure 1 Not shown is a paired device (eg, a paired user's mobile device) performing a video call with the mobile device 110 .

[0060] A video call is a video call in which an image of the other party is viewed on a display, specifically, a real-time image of the other party. Typically, when a video call is made, the electronic device making the video call (e.g., mobile device 110) displays a video call screen image 111 including the image of the other party. The operating mode for making a video call is now referred to as "video call mode."

[0061] refer to Figure 1 , the video call screen image 111 may include an image 112 of a paired user provided by a paired device and at least one image 104 of a user of the mobile device 110 .

[0062] For ease of explanation, the image of the paired device will now be referred to as the first image, and the image of the user of mobile device 110 will be referred to as the second image. In other words, the first image may be an image that includes at least one of the paired user in a video call, the user's surroundings, or an object or environment that the paired user wants to display to the user of mobile device 110. The second image may be an image that includes at least one of the user in a video call (e.g., the user of mobile device 110), the user's surroundings, or an object or environment that the user wants to display to the paired user in the video call.

[0063] It will also be shown and described that the paired device for making a video call with the mobile device 110 is a device having Figure 1 The mobile device 110 is a configuration of the same type of electronic device. In other words, the video call screen image 111 may include the first image 112 and the second image 104.

[0064] Specifically, the first image may be an image obtained by capturing the face of the paired user in the video call using the front camera of the paired device (specifically, corresponding to front camera 106 of mobile device 110). The second image may be an image obtained by capturing the user's face. According to an embodiment of the present disclosure, when the video call screen image is output via display device 120, the second image included in the video call screen image may be an image captured by camera 130 arranged on the front side of display device 120. When the video call screen image is output via mobile device 110 instead of display device 120, the second image included in the video call screen image may be an image captured by front camera 106 of mobile device 110.

[0065] The video call screen image 111 may have Figure 1 The configurations are different in various configurations.

[0066] According to an embodiment of the present disclosure, when the mobile device 110 and a paired device perform a video call, the display device 120, which can be connected to the mobile device 110 through a wired or wireless communication network, can display or copy a video call screen image output or predetermined to be output by the mobile device 110. Control of the video call operation can be performed through the mobile device 110.

[0067] Reference Figure 1 , when the mobile device 110 initiates a video call, the screen 121 of the display device 120 may display a video call screen image 140 corresponding to the video call screen image 111 output by the mobile device 110 or predetermined to be output.

[0068] Specifically, the video call screen image 140 displayed by the display device 120 may include a second image 143 and a first image 142, the second image 143 being at least one image of the user and the first image 142 being at least one image of the paired user. For example, the first image 142 and the second image 143 may correspond to the first image 112 and the second image 104, respectively. Figure 1 A configuration is shown in which the first image 142 and the second image 143 are output as the main screen image and the sub-screen image of the video call screen image 140 , respectively, but the second image 143 and the first image 142 may be output as the main screen image and the sub-screen image of the video call screen image 140 , respectively.

[0069] While performing a video call, the mobile device 110 may output a user interface (UI) screen image for controlling the video call operation. For convenience of explanation, the UI screen image for controlling the video call operation will be referred to as a control UI screen image.

[0070] The control UI screen image may include a Figure 1 , one or more menus (e.g., 113) for video call operations are shown. The one or more menus 113 may include menu 114, menu 115, menu 116, menu 117, and menu 118. Menu 114 is used to change the output of the video call screen image between mobile device 110 and display device 120, menu 115 is used to change the camera used to capture the user between the front camera and the rear camera, menu 116 is used to terminate the video call, menu 117 is used to mute the user's voice during the video call, and menu 118 is used to change the user's voice to the speaker and / or headphone output during the video call. Other menu items may be displayed.

[0071] One or more menus for controlling the video call may be displayed on the control UI screen image by using at least one of characters, icons, graphics, or symbols. Figure 1 A configuration in which a menu for controlling a video call is displayed in the form of icons on a control UI screen image is shown and described.

[0072] The screen 121 of the display device 120 has a larger size than the screen 111 of the mobile device 110. Generally, the display device 120 has a high-definition performance compared to the mobile device 110. Therefore, since the display device 120 has advantages of a large screen and high-definition performance compared to the mobile device 110, when the user outputs a video call screen image output by the mobile device 110 or predetermined to be output through the display device 120, the user can more conveniently view the video call screen image that the user desires to view through the large high-definition screen.

[0073] The mobile device 110 that receives user input through a touch screen is easier and more convenient to operate than the display device 120 that receives user input through a remote controller, etc. Therefore, according to an embodiment of the present disclosure, a video call operation can be controlled based on the user input received by the mobile device 110, and thus the user's operational convenience during a video call can be improved.

[0074] Now refer to Figures 2 to 28 A display device, a mobile device, a video call method performed by the display device, and a video call method performed by the mobile device according to embodiments of the present disclosure are described in more detail.

[0075] Figure 2 is a flowchart of a video calling method according to an embodiment of the present disclosure. Figure 2 is a flowchart for explaining operations performed by a mobile device or a display device according to an embodiment of the present disclosure. Figure 2 of and Figure 1 The same components are represented by the same reference numerals or characters. Figure 2A redundant description thereof is omitted in the description of the video call method shown in .

[0076] Reference Figure 2 , the mobile device 110 and the display device 120 may communicate with each other via a wired or wireless communication network (eg, Figure 1 Specifically, the mobile device 110 and the display device 120 can be connected to each other via a wired or wireless communication network (eg, Figure 1 103) sends or receives signals and / or data.

[0077] The communication connection between the mobile device 110 and the display device 120 may be performed before performing the video call or simultaneously with a request to perform the video call.

[0078] In other words, in order to perform a video call operation according to an embodiment of the present disclosure, the mobile device 110 and the display device 120 need to be connected to each other via a wired or wireless communication network. When a wired communication connection between the mobile device 110 and the display device 120 is achieved using a cable or the like, the video call service can be started without a special pairing operation (e.g., operation S210) between the mobile device 110 and the display device 120.

[0079] When the mobile device 110 and the display device 120 are connected to each other via a wireless communication network, the mobile device 110 and the display device 120 may perform a pairing operation for establishing wireless communication. Specifically, when a video call operation according to an embodiment of the present disclosure begins, the mobile device 110 and the display device 120 may perform a pairing operation.

[0080] The pairing operation may refer to an operation of forming a wireless communication network while transmitting or receiving data segments necessary for a wireless communication connection between the mobile device 110 and the display device 120, thereby outputting a video call screen image corresponding to a video call initiated by the mobile device 110 through the display device 120. When the pairing is completed, the mobile device 110 and the display device 120 may transmit or receive data segments necessary for performing a video call.

[0081] Figure 2 A configuration is shown in which the mobile device 110 and the display device 120 are connected to each other via a wireless communication network through a pairing operation, and a configuration in which the pairing operation S210 is performed before a video call starts.

[0082] When a wireless communication network between the mobile device 110 and the display device 120 has already been performed, the above-mentioned pairing operation may be omitted.

[0083] When the mobile device 110 and the display device 120 have previously performed a mirroring service, pairing is performed between the mobile device and the display device 120 at the previous time point. When a video call is requested at a subsequent time point, a communication connection between the mobile device 110 and the display device 120 can be established using the data segments obtained during the previous pairing operation and necessary for the wireless communication connection.

[0084] According to an embodiment of the present disclosure, the mobile device 110 receives a user input requesting output of a video call screen image via the display device 120 ( S220 ).

[0085] Specifically, the mobile device 110 may display a UI screen image including a menu requesting output of a video call screen image through the display device 120. Then, the user may select the displayed menu by using a method such as a touch, and the mobile device 110 may recognize the user's input, and thus may recognize the user input requesting output of the video call screen image through the display device 120.

[0086] Will refer to Figure 7 and Figure 8 Operation S220 is described in detail.

[0087] According to an embodiment of the present disclosure, the mobile device 110 sends a video call request to the display device 120 based on the user input received in operation S220 (S230). Specifically, the mobile device 110 may send the video call request to the display device 120 in accordance with the user input received in operation S220. Therefore, the display device 120 may receive the video call request.

[0088] The video call request may be a request by the user of mobile device 110 to initiate a video call with a paired user while viewing the screen of display device 120. Specifically, the video call request may be a request for display device 120 to take over and execute the video call initiated by mobile device 110. In other words, the video call request may be a request for the video call screen image corresponding to the video call initiated by mobile device 110 to be output via the display of display device 120. Therefore, when the execution target of the video call changes from mobile device 110 to display device 120, the video call screen image can be continuously output from mobile device 110 to display device 120 without interruption.

[0089] Specifically, the video call request may be a request made for the display device 120 to capture the user's image and a video call screen image, wherein the video call screen image includes the captured image and the image of the paired party to be output via the display device 120. Specifically, when a video call is performed, the user's image and the paired party's image may become images captured in real time while the video call is performed.

[0090] Alternatively, the video call request may be a request for a video call initiated by the mobile device 110 to be performed instead by the display device 120. When the display device 120 performs the video call instead, the execution of the video call by the display device 120 may be accompanied by an operation of generating and outputting a display of a video call screen image.

[0091] The mobile device 110 may output a control UI screen image through a display, the control UI screen image being a UI screen image for controlling the execution of a video call (S250). Figure 9 Describes the control UI screen image in detail.

[0092] The display device 120 activates a camera included in the display device 120 based on the video call request received from the mobile device 110 (S240). At this time, the display device 120 can select a camera that can be used to perform a video call by the display device 120 from among cameras included in the display device 120, connected to the display device 120 via a wire, or wirelessly connected to the display device 120. The display device 120 can display a list of cameras that can be used for the video call, and can select a camera according to the user's selection.

[0093] The camera included in the display device 120 may be arranged at a position on the front surface of the display device 120 to photograph the front side of the screen of the display device 120. Figure 1 ,like Figure 1 , the camera 130 of the display device 120 may be arranged at the upper center on the front side of the display device 120. Specifically, the camera 130 of the display device 120 may be arranged at a position on the front side of the display device 120 to obtain an image of a user viewing a screen image output by the display device 120 on the front side of the display device 120. Figure 1 The configuration in which one camera is included in the display device 120 is shown. However, the display device 120 may include multiple cameras arranged at different positions. When the display device 120 includes multiple cameras, the user can select one of the multiple cameras so that the display device 120 can perform a video call based on its own settings or user input.

[0094] The camera for obtaining the image of the user may be an external camera included separately from the display device 120 rather than being integrated into the display device 120. For example, the camera may be an external camera arranged on one side of the display device 120 to capture the front side of the display device 120. In this configuration, the external camera and the display device 120 may be connected to each other through wired or wireless communication, and the external camera may obtain the image of the user of the video call under the control of the display device 120.

[0095] Activating a camera may refer to setting the operating state of the camera to a state in which image capture is performed by the camera. Therefore, when the camera is activated, image capture may be performed by the activated camera, and a signal of an image obtained by the camera may be received from the activated camera.

[0096] Specifically, when the operation mode of the display device 120 is a video call mode or a photographing mode, the camera may be activated to obtain an image, thereby performing image capturing.

[0097] According to an embodiment of the present disclosure, the display device 120 may activate a camera (eg, Figure 1 The camera 130) is used to obtain an image of the user through the camera.

[0098] Subsequently, the display device 120 may obtain image data of the counterparty of the video call (S260). Specifically, the display device 120 may receive the image data of the counterparty of the video call through the communication interface of the display device 120. The image data of the counterparty may be used to generate an image to be included in the video call screen image (e.g., Figure 1 140) in the paired counterpart image (e.g., Figure 1 142). Figures 12 to 16 Operation S260 is described in detail.

[0099] The display device 120 can be displayed through a display (e.g., Figure 1 121) displays a video call screen image (e.g., Figure 1 140 ), the video call screen image includes a first image of the paired party generated based on the image data obtained in operation S260 and a second image of the user obtained by a camera of the display device 120 ( S270 ).

[0100] Already referenced Figure 1 and Figure 2 The embodiments of the present disclosure are briefly described.

[0101] Now refer to Figures 3 to 28The mobile device 110 , the display device 120 , a video call method performed by the mobile device 110 , and the video call method performed by the display device 120 according to an embodiment of the present disclosure are described in detail.

[0102] Figure 3 is a block diagram of a display device 300 according to an embodiment of the present disclosure.

[0103] In the accompanying drawings, like reference numerals denote like components. Figure 3 The mobile device 110 shown can be used with the Figure 1 The mobile device 110 is described to correspond to . Figure 3 The display device 300 shown can be used with the above reference Figure 1 and Figure 2 Therefore, the display device 120 described in the reference Figure 1 and Figure 2 The description of the display device 300 that is identical to those described above will not be repeated here.

[0104] Reference Figure 3 , the display device 300 includes a processor 310 , a display 320 , a communication interface 330 , and a camera 340 .

[0105] The processor 310 executes at least one instruction to control a desired operation to be performed. Here, the at least one instruction may be stored in an internal memory included in the processor 310 or in a memory included in the display device 300 separate from the processor 310.

[0106] Specifically, the processor 310 may execute at least one instruction to control at least one component included in the display device 300 to perform a desired operation. Therefore, even if a configuration in which the processor 310 performs a specific operation is shown and described, the above configuration may also mean that the processor 310 controls at least one component included in the display device 300 to perform these operations.

[0107] Although a configuration in which the processor 310 includes only one processor has been illustrated and described, the processor 310 may also be implemented to include a plurality of processors.

[0108] Specifically, the display device 300 may include RAM, ROM, and at least one processor. The RAM stores signals or data input from external sources to the display device 300 or serves as a storage area for various operations performed by the display device 300, and the ROM stores control programs and / or multiple instructions for controlling the display device 300. The display device 300 may include a graphics processing unit (GPU) for performing video graphics processing. The processor 310 may be implemented as a system on a chip (SoC) including a core and a GPU. The processor 310 may include multiple cores rather than a single core. For example, the processor 310 may include dual cores, triple cores, quad cores, hexa cores, octa cores, deca cores, dodeca cores, hexa cores, etc.

[0109] The display 320 outputs an image on a screen. Specifically, the display 320 may output an image corresponding to the video data through a display panel included in the display 320 so that the user can visually recognize the video data.

[0110] According to the disclosed embodiment, while a video call is being performed, the display 320 may output a video call screen image for the video call.

[0111] The communication interface 330 communicates with another electronic device through at least one wired or wireless communication network. According to an embodiment of the present disclosure, the communication interface 330 communicates with the mobile device 110.

[0112] The communication interface 330 can communicate with the mobile device 110 via a wired and / or wireless communication network. Specifically, the communication interface 330 may include at least one communication module, a communication circuit, an antenna, etc., and may send data to or receive data from an external electronic device or server through the communication module and / or the communication circuit.

[0113] Specifically, the communication interface 330 may include at least one short-range wireless communication module that performs communication according to a communication standard, such as Bluetooth, Wi-Fi, Bluetooth Low Energy (BLE), Near Field Communication (NFC) / Radio Frequency Identification (RFID), Wi-Fi Direct, Ultra-Wideband (UWB), or Zigbee. Here, the short-range wireless communication module may also be referred to as a short-range wireless communication interface.

[0114] The communication interface 330 may also include a remote communication module for communicating with a server supporting remote communication according to a remote communication standard. Specifically, the communication interface 330 may include a remote communication module for performing communication via a network used for Internet communication. The communication interface 330 may include a communication network that complies with communication standards (such as 3G, 4G, and / or 5G). The remote communication module may also be referred to as a remote communication interface.

[0115] The communication interface 330 may include at least one port through which the communication interface 330 may be connected to the mobile device 110 using a wired cable, so that the communication interface 330 may communicate with the mobile device 110 based on a wired communication method. For example, the communication interface 330 may include a cable connection port such as an HDMI port or an Ethernet port.

[0116] Camera 340 can be used with Figure 1 The camera 340 corresponds to the camera 130. The camera 340 may include an image sensor such as a charge coupled device (CCD) sensor, and may obtain image frames such as still images or moving images via the image sensor in a video call mode or a photographing mode.

[0117] Figure 3 The display device 300 is shown as including one camera. However, the display device 300 may include multiple cameras arranged at different positions. When the display device 300 includes multiple cameras, the user can select one of the multiple cameras so that the display device 300 performs a video call based on its own settings or user input.

[0118] The camera for obtaining an image of the user may be external to the display device 300 rather than being integrated into the display device 300. For example, the camera may be an external camera disposed on or adjacent to a lateral surface of the display device 120 to capture the front side of the display device 120. In this configuration, the external camera and the display device 300 may be connected to each other via wired or wireless communication, and the external camera may obtain an image of the user of the video call under the control of the display device 300.

[0119] For convenience of explanation, a configuration in which a camera for obtaining an image of a user to implement a video call is included in the display device 300 will now be described.

[0120] According to an embodiment of the present disclosure, the processor 310 may activate the camera 340 based on a video call request received from the mobile device 110. The processor 310 may obtain image data of the user through the activated camera 340. Continuously, the processor 310 may control a video call screen image including a first image of the paired party generated based on the image data of the paired party and a second image obtained by the camera 340 to be output through the display 320.

[0121] In the following, reference will be made to Figure 4 The components of the display device 300 are described in more detail.

[0122] Figure 4 is a block diagram of a display device 400 according to an embodiment of the present disclosure.

[0123] Figure 4 The display device 400 shown in FIG. Figures 1 to 3 The display devices 120 and 300 shown in FIG correspond to each other. Figure 4 , compared with the display device 300 , the display device 400 may further include at least one of a memory 470 , a user interface 450 , or an audio input / output interface 465 .

[0124] The memory 470 may store one or more instructions, which may include data and one or more software and application programs. The memory 470 may store one or more instructions executed by the processor 310. The memory 470 may store one or more programs executed by the processor 310.

[0125] Specifically, the memory 470 may include at least one type of storage medium selected from a flash memory type, a hard disk type, a micro multimedia card type, a card type memory (e.g., secure digital (SD) or extreme digital (XD) memory), a random access memory (RAM), a static random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable ROM (EEPROM), a programmable ROM (PROM), a magnetic memory, a magnetic disk, and an optical disk.

[0126] The user interface 450 may receive a user input for controlling the display device 400. The user interface 450 may include, but is not limited to, a user input device including a touch pad that senses a user's touch, a hardware button or switch that receives a user's pressing operation, a wheel that receives a user's rotating operation, a keyboard, and a dome switch.

[0127] The user interface 450 may also include a voice recognition device. For example, the voice recognition device may include a microphone and a voice recognition engine for converting speech to text. The voice recognition device may receive a user's voice command or voice request. Accordingly, the processor 310 may control the operation corresponding to the voice command or voice request to be executed.

[0128] The user interface 450 may also include a motion detection sensor. For example, the motion detection sensor may detect the motion of the display device 400 and receive the detected motion as user input. The aforementioned voice recognition device and motion detection sensor may not be included in the user interface 450. Instead, the voice recognition device and motion detection sensor may be included in the display device 400 as modules separate from the user interface 450.

[0129] The audio input / output interface 465 may audibly output audio data recognizable to a user, or may detect and / or receive audio data. Specifically, the audio input / output interface 465 may include an audio output interface 460 and an audio input interface 467 .

[0130] The audio output interface 460 may be a speaker that outputs audio under the control of the processor 310 .

[0131] Specifically, the audio output interface 460 may output audio (eg, voice or sound) input via the communication interface 330 .

[0132] According to an embodiment of the present disclosure, the processor 310 may control audio received from a paired device of a video call to be output through the audio output interface 460 during the video call mode.

[0133] The audio output interface 460 may also output audio stored in the memory 470 under the control of the processor 310. The audio output interface 460 may include at least one selected from a speaker, a headphone output port, or a Sony / Philips Digital Interface (S / PDIF) output port. The audio output interface 460 may include a combination of a speaker, a headphone output port, and an S / PDIF output port.

[0134] The audio input interface 467 receives audio. Specifically, the audio input interface 467 may include a microphone that receives audio as an external sound signal and processes the received audio into electrical audio data. For example, the microphone included in the audio input interface 467 can receive sound signals from an external device or speaker, such as a user who is currently on a video call. The microphone included in the audio input interface 467 can employ various noise cancellation algorithms to remove noise generated when receiving external audio signals.

[0135] According to an embodiment of the present disclosure, under the control of the processor 310 , the audio input interface 467 may receive a sound signal including a user's voice and may remove noise from the received sound signal in a video call mode in order to recognize the user's voice.

[0136] Figure 5 is a block diagram of a mobile device 500 according to an embodiment of the present disclosure.

[0137] Figure 5 The mobile device 500 shown in FIG. 5 can be used with the mobile device 500 shown in FIG. Figures 1 to 4 Therefore, when describing mobile device 500, no reference will be made to the mobile device 110 described herein. Figures 1 to 4 The operations of the mobile device 110 described herein are identical and are redundantly described.

[0138] Reference Figure 5 , the mobile device 500 includes a processor 505 , a user interface 510 , a display 520 , a communication interface 530 , and a camera 540 .

[0139] The processor 505 may execute at least one instruction to control a desired operation to be performed. Here, the at least one instruction may be stored in an internal memory included in the processor 505 or in a memory separate from the processor 505 in the mobile device 500.

[0140] Specifically, the processor 505 may execute at least one instruction to control at least one component included in the mobile device 500 to perform a desired operation. Therefore, even when a configuration in which the processor 505 performs a specific operation is shown and described, the configuration may also mean that the processor 505 controls at least one component included in the mobile device 500 to perform the operation.

[0141] The display 520 outputs an image on a screen. Specifically, the display 520 may output an image corresponding to video data through a display panel included in the display 520 so that a user can visually recognize the video data.

[0142] The display 520 may also include a touchpad coupled to the display panel. When the display 520 is configured as a display panel coupled to the touchpad, the display 520 may output a user interface screen for receiving touch input. When a user operation (e.g., a touch operation) corresponding to a command is detected on the user interface screen, the display 520 may transmit the detected touch input to the processor 505. The processor 505 then interprets the detected touch input, thereby recognizing and executing the command input by the user.

[0143] A configuration in which the display 520 has a shape of a combined display panel and touch panel will now be described. According to an embodiment of the present disclosure, the display 520 can output a control UI screen image simultaneously with outputting a video call screen image through a display device (e.g., 300) (the display device being connected to the mobile device 500 via a wired or wireless communication network). The control UI screen image is a UI screen image for controlling a video call operation under the control of the processor 505.

[0144] The communication interface 530 communicates with another electronic device or a server through at least one wired or wireless communication network.

[0145] According to an embodiment of the present disclosure, the processor 505 can control the communication interface 530 to connect to a server for supporting video calls, so that a video call between the mobile device 500 and a paired device can be implemented in the video call mode. Therefore, the communication interface 530 can send or receive data necessary to perform a video call.

[0146] According to an embodiment of the present disclosure, the communication interface 530 communicates with the display device (e.g., 120, 300, or 400) via wired or wireless communication. Specifically, the processor 505 can be connected to the display device (e.g., 120, 300, or 400) via the communication interface 530 via a wired or wireless communication network, so that the video call screen image is output via the display device (e.g., 120, 300, or 400).

[0147] Specifically, the communication interface 530 may include at least one short-range wireless communication module that performs communication according to a communication standard such as Bluetooth, Wifi, Bluetooth Low Energy (BLE), Near Field Communication (NFC) / Radio Frequency Identification (RFID), Wifi Direct, Ultra Wideband (UWB), or Zigbee.

[0148] The communication interface 530 may also include a remote communication module for communicating with a server supporting remote communication according to a remote communication standard. Specifically, the communication interface 530 may include a remote communication module for performing communication via a network used for Internet communication. The communication interface 530 may include a communication network that complies with communication standards (such as 3G, 4G, and / or 5G). The remote communication module may also be referred to as a mobile communication module.

[0149] For example, the communication interface 530 can be connected to a server for supporting video calls through a communication network that complies with the 5G communication standard. Therefore, the mobile device 500 can provide a video call service with a paired device.

[0150] The communication interface 530 may include at least one port through which the communication interface 530 may be connected to the display device (e.g., 120, 300, or 400) using a wired cable, so that the communication interface 530 may communicate with the display device (e.g., 120, 300, or 400) based on a wired communication method. For example, the communication interface 530 may include a cable connection port, such as an HDMI port, an Ethernet or optical fiber port, or a USB connection port.

[0151] The user interface 510 may receive user input for controlling the mobile device 500. The user interface 510 may include, but is not limited to, a user input device including a touchpad that detects a user's touch, a button that receives a user's press operation, a wheel that receives a user's rotation operation, a keyboard, and a dome switch. The button, wheel, and dome switch may be formed with keys corresponding to different functions.

[0152] The user interface 510 may also include a voice recognition device. For example, the voice recognition device may include a microphone. The voice recognition device may receive a user's voice command or voice request. Thus, the processor 505 may control operations corresponding to the voice command or voice request to be executed.

[0153] The user interface 510 may also include a motion detection sensor. For example, the motion detection sensor may detect the user's movement within a vehicle and receive the detected movement as user input. The aforementioned voice recognition device and motion detection sensor may not be included in the user interface 510. Instead, the voice recognition device and motion detection sensor may be included in the mobile device 500 as components or modules separate from the user interface 510.

[0154] The camera 540 may include an image sensor and may obtain image frames such as still images or moving images via the image sensor in a video call mode or a photographing mode.

[0155] The camera 540 may include one or more cameras formed at different positions. For example, the camera 540 may include a front side camera and a rear side camera. Figure 1 The rear camera 500 may have a field of view that is opposite to that of the front camera 106 and may capture the rear side of the mobile device 500. For example, the rear camera 500 may have a field of view that is 180 degrees different from that of the front camera 106.

[0156] For example, when a video call is requested, the processor 505 activates the camera 540 (particularly the front camera) and can obtain image data of the user through the front camera.

[0157] According to an embodiment of the present disclosure, when the processor 505 controls the video call screen image to be output by the mobile device 500 instead of the display device (eg, 120 , 300 , or 400 ), the processor 505 may control the camera 540 to be activated so that the camera 540 performs an image capturing operation.

[0158] Now refer to Figures 6 to 26 A video call operation and an operation of controlling the video call performed by a mobile device (eg, 110 or 500 ) and a display device (eg, 120 , 300 , or 400 ) according to an embodiment of the present disclosure are described in detail.

[0159] Figure 6 FIG. 6 is a flowchart of a video calling method 600 executed by a mobile device according to an embodiment of the present disclosure.

[0160] Figures 6 to 26 of and included in Figure 2 The same operations or steps as in the video call method of Figure 2 For example, Figure 6 Operation S230 and Figure 2 Therefore, in the reference Figures 6 to 26 The above references are omitted in the description of the operations or steps performed in the embodiments of the present disclosure. Figure 2 Redundant description given.

[0161] The following references Figures 6 to 26 The description of the embodiments of the present disclosure refers to Figure 5 500 mobile devices and Figure 4 Display device 400.

[0162] Reference Figure 6 , the video calling method 600 is performed by a mobile device (eg, the mobile device 500 ) according to an embodiment of the present disclosure. Figure 6 Flowchart illustrating operations performed by a mobile device (eg, mobile device 500 ) according to an embodiment of the present disclosure may be provided.

[0163] Reference Figure 6 , the mobile device 500 receives a user input requesting to output a video call screen image through the display device 400 (S220). Specifically, the processor 505 of the mobile device 500 may receive the user input via the user interface 510. Specifically, the processor 505 may identify a request corresponding to the content detected by the user interface 510 based on a user operation detected through the user interface 510 (e.g., a touch by a user for selecting a certain menu). Now, reference will be made to Figure 7 and Figure 8 Operation S220 is described in detail.

[0164] Figure 7 Shown are UI screen images output by a mobile device according to an embodiment of the present disclosure.

[0165] Reference Figure 7 , the mobile device 500 may display a UI screen image 710. Specifically, the processor 505 of the mobile device 500 may control the UI screen image 710 including a menu 724 requesting a video call to be displayed on the display 520.

[0166] Specifically, UI screen image 710 may be a screen image representing a paired device's contact number or paired device. UI screen image 710 may include at least one of the paired device's name 740, the paired device's social network contact information 730, or the paired device's mobile phone number 720. Mobile phone number 720 is shown as an example of communication contact information used to connect with the paired device for a call with the paired device. In addition to mobile phone number 720, UI screen image 710 may also include information for connecting with the paired device to send or receive data necessary for a call or video call.

[0167] Apart from Figure 7In addition to the information segment, the UI screen image 710 may include an image corresponding to the pairing partner, additional information for the pairing partner, a memo associated with the pairing partner, and the like.

[0168] Reference Figure 7 In addition to the menu 724 for requesting a video call, the UI screen image 710 may further include at least one of a menu 721 for requesting a wired call or a menu 723 for sending or receiving a text message. The menus 721, 723, and 724 corresponding to specific requests may be displayed using at least one of characters, icons, graphics, and symbols. Figure 7 A configuration is shown in which menus 721 , 723 , and 724 corresponding to specific requests are displayed in the form of icons within the UI screen image 710 .

[0169] The user may touch the menu 724 requesting a video call displayed on the UI screen image 710. Then, the processor 505 may recognize that the user's request is for a video call based on the user's touch, and may perform an operation corresponding to the recognized request.

[0170] In response to the user input to the menu 724, the processor 505 can execute the video call and can control the interface screen image 750 for the video call to be displayed. In other words, in response to the user input to the menu 724, the processor 505 can control the UI screen image 710 to change to the interface screen image 750 to be displayed and the interface screen image 750.

[0171] For example, the interface screen image 750 for a video call may include an image 761 of a counterpart, so that the user can perform a call while viewing the counterpart's image. The interface screen image 750 may also include an image 762 of the user.

[0172] According to an embodiment of the present disclosure, the interface screen image 750 may further include a menu 771 requesting output of a video call screen image through the display device 400 connected to the mobile device 500 .

[0173] For convenience of explanation, a request made to output a video call screen image through the display device 400 connected to the mobile device 500 will now be referred to as a “request for a call through TV.” In other words, the menu 771 refers to a menu for a request for a call through TV.

[0174] When user input corresponding to a request to place a call via TV is received (S220), a video call screen image may be output via display device 400, allowing the user to place a video call with a paired user while watching TV. When user input corresponding to a request to place a call via TV is received (S220), the user places a video call with the paired user while watching TV, and thus, camera 340 included in display device 400 may be activated to capture a video for the start of the video call. The image captured by camera 340 may be an image of the user within the video call screen image. In operation S220, receiving the user input corresponding to the request to place a call via TV may be achieved by the user touching menu 771.

[0175] Specifically, the request for making a call through TV may refer to a request made so that the mobile device 500 and the paired device transmit or receive call data required for a video call, and it is assumed that the video call screen image output through the display device 400 is output through the mobile device 500. In this configuration, reference will be made to Figures 12 to 14 Detailed operations performed by at least one of the mobile device 500 or the display device 400 are described.

[0176] Alternatively, the request for making a call through TV may refer to a request made so that after a video call between the mobile device 500 and the paired device is initiated, a video call screen image is displayed on the display device 400 when the paired device and the display device 400 transmit or receive call data required for the video call to each other. Figure 15 and Figure 16 Detailed operations performed by at least one of the mobile device 500 or the display device 400 in the above-described configuration are described.

[0177] Figure 8 A UI screen image 800 output by a mobile device according to an embodiment of the present disclosure is shown. Figure 8 The UI screen image 800 is Figure 7 The same components are denoted by the same reference numerals or symbols.

[0178] Reference Figure 8 , compared with the UI screen image 710, the UI screen image 800 may further include a menu 725 corresponding to a request for making a call through the TV. The menu 725 is Figure 7 A configuration corresponding to menu 771 but displayed in a form different from menu 771 is shown as an example.

[0179] When the UI screen image 800 includes the menu 725 , the user may select (eg, by touching) the menu 725 , and thus the mobile device 500 may receive a user input corresponding to a request for making a call through the TV.

[0180] In response to receiving user input corresponding to a request to make a call via TV (S220), processor 505 of mobile device 500 transmits a video call request to display device 400 (S230). Operation S230 may be performed by communication interface 530 under the control of processor 505 of mobile device 500. In other words, communication interface 530 transmits the video call request under the control of processor 505.

[0181] Then, in the video call method 600, the mobile device 500 displays a control UI screen image (S250). Specifically, the mobile device 500 may control the control UI screen image (which is a UI screen image for controlling the execution of the video call) to be displayed through the display 520 (S250). Operation S250 may be performed by the display 520 outputting the control UI screen image under the control of the processor 505. Now, reference will be made to Figure 9 Describes the control UI screen image in detail.

[0182] Figure 9 Shown are UI screen images output by a mobile device according to an embodiment of the present disclosure.

[0183] Reference Figure 9 , the mobile device 500 may output a control UI screen image 900 (S250). The control UI screen image 900 may include a control Figure 1 One or more menus (eg, 113 ) of video call operations as shown.

[0184] Figure 9 The menu 951, menu 952, menu 953, and menu 954 correspond to the menu 114 for changing the output of the video call screen image between the mobile device 110 and the display device 120, the menu 116 for terminating the video call, the menu 117 for canceling the user's voice (mute) during the video call, and the menu 113 for changing the user's voice to the speaker output and / or the headphone output during the video call, respectively, which have been referred to above. Figure 1 Description has been made, and thus redundant description thereof will be omitted.

[0185] The control UI screen image 900 may further include a menu for controlling at least one of initiation, execution, or termination of a video call in addition to the menus 951 , 952 , 953 , and 954 .

[0186] The control UI screen image 900 may include a status message 920 notifying that a video call is in progress through the display device 400 (eg, through a TV) connected to the mobile device 500. The status message 920 may include information on a situation in which the video call is performed.

[0187] The control UI screen image 900 may further include a menu 930 requesting that a video call screen image including an image of the user and an image of the counterpart be displayed within the control UI screen image 900. In response to a user input corresponding to the menu 930, the processor 505 may control the video call screen image to be displayed within a partial area (e.g., 940) of the control UI screen image 900.

[0188] The control UI screen image 900 may control a video call screen image including the user's image and the counterpart's image to be displayed in a partial area (e.g., 940) of the control UI screen image 900. In other words, even when there is no user input for selecting the menu 930, the control UI screen image 900 may control the video call screen image to be displayed in the partial area (e.g., 940) of the control UI screen image 900.

[0189] Figure 10 FIG. 1 is a flowchart of a video calling method 1000 performed by a display device according to an embodiment of the present disclosure.

[0190] Reference Figure 10 , the video call method 1000 is performed by a display device (eg, the display device 400 ) according to an embodiment of the present disclosure. Figure 10 It may be a flowchart illustrating operations performed by a display device (eg, display device 400 ) according to an embodiment of the present disclosure.

[0191] Reference Figure 10 The video call method 1000 includes an operation of receiving a video call request (S230) performed by the display device 400. Specifically, the communication interface 330 may receive the video call request from the mobile device 500 under the control of the processor 310.

[0192] In response to the video call request, the camera 340 included in the display device 400 is activated (S240). Specifically, in response to the video call request received in operation S230, the processor 310 may control the camera 340 to be activated, thereby enabling the camera 340 to start video capture. Specifically, the processor 310 may control the camera 340 and the front-side camera to be activated so that the camera 340 can capture an image of the user. In other words, in response to the video call request, it may be determined that the user wants to conduct a video call while viewing the display device 400. The processor 310 may activate the camera 340 to obtain the image of the user required for the video call, allowing the user to conduct a video call while viewing the video call screen image displayed on the display device 400.

[0193] In the video call method 1000, data corresponding to the image of the user obtained by the activated camera 340 may be transmitted from the display device 400 to the mobile device 500. In this configuration, the mobile device 500 may transmit the data corresponding to the image of the user received from the display device 400 to the paired device.

[0194] Alternatively, in the video calling method 1000 , data corresponding to the image of the user obtained by the activated camera 340 may be transmitted from the display device 400 to a server for supporting video calling.

[0195] The video call method 1000 may also include an operation of sending data corresponding to the image of the user obtained by the display device 400 from the paired device to the mobile device 500 and / or at least one of the servers for supporting video calls, so that the paired device can display a video call screen image including a second image of the user.

[0196] Then, in the video call method 1000, image data of the video call partner may be obtained (S260). Specifically, the display device 120 may obtain image data of the video call partner (S260). Operation S260 may be performed by the communication interface 330 under the control of the processor 310.

[0197] Specifically, operation S260 may be performed by the display device 400 contacting a server for supporting a video call through the communication interface 330 and receiving image data of the paired device from the paired device.

[0198] Alternatively, operation S260 may be implemented by the display device 400 receiving the paired partner's image data from the mobile device 500. In this configuration, the mobile device 500 may contact a server supporting video calls via the communication interface 530 and receive the user's image data from the paired device. The mobile device 500 may transmit the paired partner's image data received from the server to the display device 400. Alternatively, the mobile device 500 may generate an image of the paired partner ("first image") based on the paired partner's image data received from the server. The mobile device 500 may generate mirroring data corresponding to the first image and transmit the generated mirroring data to the display device 400, causing the first image to be mirrored on the display device 400.

[0199] Then, in the video call method 1000 , the display device 400 displays the video call screen image ( S270 ). Operation S270 may be performed by the display 320 under the control of the processor 310 .

[0200] Specifically, the display device 400 may display a video call screen image (eg, Figure 1140 ), the video call screen image includes a first image of the paired user generated based on the image data obtained in operation S260 and a second image of the user obtained by a camera of the display device 400 ( S270 ).

[0201] Figure 11 A video call screen image output by a display device according to an embodiment of the present disclosure is shown. Figure 11 of and Figure 1 and Figure 4 The same components are denoted by the same reference numerals or characters.

[0202] Reference Figure 11 According to an embodiment of the present disclosure, the user 1101 can perform a video call while viewing the display 320 of the display device 400 connected to the mobile device 500. Specifically, the display 320 of the display device 400 can perform a video call while viewing a video call screen image 140 including a first image 142 and a second image 143, wherein the first image 142 is an image of the other party and the second image 143 is an image of the user 1101. The camera 340 of the display device 400 can obtain an image of the user necessary for generating the video call screen image by photographing the front side 131 of the display device 400.

[0203] According to an embodiment of the present disclosure, the user 1101 can perform a video call more realistically by performing a video call while viewing the screen of the display device 400 providing a large screen, as compared to the mobile device 500. Since the user does not need to move his or her arms to lift the mobile device 500 so that the mobile device 500 can capture the user's face, the user can perform a video call more conveniently.

[0204] Figure 12 FIG. 4 is a flowchart of an image calling method according to an embodiment of the present disclosure.

[0205] Figure 12 is a flowchart for explaining operations performed by a mobile device (eg, 110 or 500 ) or a display device (eg, 120 , 300 , or 400 ) according to an embodiment of the present disclosure. Figure 12 of and Figures 1 to 11 The same components are represented by the same reference numerals or characters. Figure 12 A redundant description thereof is omitted in the description of the video call method shown in .

[0206] Figure 5 The mobile device 500 is executed Figure 12 Examples of operations of mobile devices. Figure 4 The display device 400 is implemented Figure 12An example of the operation of the display device.

[0207] Reference Figure 12 , refer to the above Figure 2 Compared to the mobile device 110 described above, the mobile device 500 may further perform at least one of operations S245 , S255 , and S257 .

[0208] Reference Figure 12 , mobile device 500 may deactivate camera 540 based on the user input received in operation S220 (S245). Specifically, processor 505 of mobile device 500 may control camera 540 to be inactive in response to the user input received in operation S220, thereby not performing image capture. The user input received in operation S220 may be a request for display device 400 to output a video call screen image and obtain an image of the user, specifically, a request for camera 340 of display device 400 to obtain an image of the user by photographing the user. Therefore, when display device 400 outputs the video call screen image and photographs the user in accordance with the user input received in operation S220, mobile device 500 does not need to perform the photographing of the user required for the video call. Therefore, mobile device 500 may control camera 540 to be inactive to prevent unnecessary camera operations, thereby reducing unnecessary power consumption associated with activating camera 540.

[0209] The user input received in operation S220 is an input for requesting output of a video call screen image through the display device 400. Specifically, the user input may be an input for requesting output of a video call screen image through the display device 400 when a video call is being performed by the mobile device 500. Since the output of the video call screen image may be accompanied by an image capturing operation for the user, the display device 400 may capture an image of the user through the camera 340 and display the video call screen image through the display 320.

[0210] Specifically, based on the user input received in operation S220 , the mobile device 500 may receive image data of the paired partner ( S255 ). Operation S255 may be performed by the communication interface 530 under the control of the processor 505 .

[0211] Specifically, based on the user input received in operation S220, the mobile device 500 may connect to a server for supporting video calls and transmit or receive data for the video call to or from the paired device (S255). Specifically, the mobile device 500 may receive image data corresponding to the image of the user captured by the camera activated in operation S240 from the display device 400 (S257). In this configuration, operation S255 may also include an operation of transmitting the image data corresponding to the received image of the user to the server for supporting video calls. In other words, operation S255 may include the transmission or reception of image data between the mobile device 500 and the server for supporting video calls.

[0212] In operation S257, the mobile device 500 may transmit image data corresponding to the image of the paired party received from the server for supporting video calls to the display device 400. Operation S257 may be performed by the communication interface 530 under the control of the processor 505. Operation S257 may also include an operation of transmitting image data corresponding to the image of the user obtained by the camera 340 of the display device 400 to the mobile device 500. In other words, operation S257 may refer to the transmission or reception of image data between the mobile device 500 and the display device 400.

[0213] Therefore, the display device 400 may obtain image data corresponding to the image of the paired partner (S260) by receiving image data corresponding to the image of the paired partner from the mobile device 500 (S257). Operation S260 may be performed by the communication interface 330 under the control of the processor 310.

[0214] According to an embodiment of the present disclosure, the mobile device 500 may transmit image data corresponding to an image of a paired partner received from a server for supporting a video call to the display device 400 without change.

[0215] According to an embodiment of the present disclosure, the processor 505 of the mobile device 500 may transmit mirroring data including an image of the pairing partner to the display device 400 , so that the image of the pairing partner generated by the mobile device 500 may be mirrored and displayed by the display device 400 .

[0216] Alternatively, in operation S257, the image data of the paired partner transmitted by the mobile device 500 to the display device 400 may be mirrored data. Specifically, the processor 505 of the mobile device 500 may generate an image of the paired partner for use in the video call based on the image data of the paired partner received from the server for supporting video calls. The processor 505 may generate mirroring data for mirroring the image of the paired partner, so that the generated image of the paired partner is mirrored and output by the display device 400. The generated mirroring data may be transmitted to the display device 400. Thus, the processor 310 of the display device 400 may mirror the image of the paired partner generated by the mobile device 500 to control the image data regarding the paired partner to be received from the mobile device 500.

[0217] Figure 13 is a flowchart of a video calling method 1300 performed by a mobile device according to an embodiment of the present disclosure. Figure 13 The operations may be performed by a mobile device (eg, 110 or 500 ) according to an embodiment of the present disclosure. Figure 13 of and Figure 6 and Figure 12 The same components are represented by the same reference numerals or characters. Figure 13 Redundant description of it will be omitted in the description of the components.

[0218] Reference Figure 13 , the video call method 1300 can be performed by a mobile device (eg, 110 or 500). Now, a configuration for performing the video call method 1300 by the mobile device 500 will be described. Figure 4 The video calling method 1300 is described with reference to the display device 400 shown as being connected to the display device of the mobile device 500 .

[0219] Reference Figure 13 ,and Figure 6 Compared with the video call method 600, the video call method 1300 may further include at least one of operations S210, S245, S255, and S257.

[0220] Specifically, in the video call method 1300, pairing between the mobile device 500 and the display device 400 may be performed (S210). Although the pairing operation S210 is Figure 13 The pairing operation S210 is performed before operation S220, but the pairing operation S210 may be performed in response to a user input requesting a video call, or may be performed simultaneously with operation S220, or may be performed before or after operation S220.

[0221] In the video call method 1300, the camera 540 may be deactivated based on the user input received in operation S220 (S245). Figure 13 Operation S245 is performed after operation S230 , but operation S245 may be performed only simultaneously with operation S220 or after operation S220 .

[0222] In the video calling method 1300 , image data of the user may be received from the display device 400 ( S255 ), and may be transmitted to a server for supporting video calling ( S257 ).

[0223] Figure 14 FIG14 is a flowchart of a video calling method 1400 performed by a display device according to an embodiment of the present disclosure. Figure 14 The operations may be performed by the display device (eg, 120 , 300 , or 400 ) according to an embodiment of the present disclosure. Figure 14 of and Figure 10 and Figure 12 The same components are represented by the same reference numerals or characters. Figure 14 Redundant description of it will be omitted in the description of the components.

[0224] Reference Figure 14 , the video call method 1400 may be performed by a display device (eg, 120, 300, or 400). Figure 4 The display device 400 performs the configuration of the video call method 1400. By referring to Figure 5 The video calling method 1400 is described with reference to the mobile device 500 , which is shown as a mobile device connected to the display device 400 .

[0225] Reference Figure 14 Operation S260 of the video call method 1400 may include receiving image data of the paired party from the mobile device 500. Specifically, in operation S270, the display device 400 may obtain the paired party's image data by receiving the paired party's image data from the mobile device 500 and display the video call screen image.

[0226] Figure 15 FIG. 4 is a flowchart of an image calling method according to an embodiment of the present disclosure. Figure 15 is a flowchart for explaining operations performed by a mobile device (eg, 110 or 500 ) or a display device (eg, 120 , 300 , or 400 ) according to an embodiment of the present disclosure. Figure 15 of and Figures 1 to 14 The same components are represented by the same reference numerals or characters. Figure 15 Redundant descriptions thereof are omitted in the descriptions of the illustrated components.

[0227] Figure 5 The mobile device 500 is executed Figure 15Examples of operations of mobile devices. Figure 4 The display device 400 is implemented Figure 15 An example of the operation of the display device.

[0228] Reference Figure 15 ,and Figure 2 Compared with the display device 120, the display device 400 may further perform operation S1545.

[0229] Figure 15 Operation S1525 can be performed with Figure 2 Corresponding to operation S230.

[0230] According to an embodiment of the present disclosure, the mobile device 500 may transmit a video call request including connection information of a pairing device corresponding to a pairing party to the display device 400 .

[0231] Reference Figure 15 , the mobile device 500 may send a video call request including the connection information of the paired device corresponding to the paired party of the video call to the display device 400. Therefore, the display device 400 may receive the video call request including the connection information of the paired device. Operation S1525 may be performed by the communication interface 530 sending the video call request including the connection information of the paired device under the control of the processor 505 of the mobile device 500. Operation S1525 may be performed by the communication interface 330 receiving the video call request including the connection information of the paired device under the control of the processor 310 of the display device 400.

[0232] The connection information for the paired device may be communication connection information for connecting to the paired device to talk with the paired party. For example, the connection information may be a mobile phone number of the paired device (e.g., Figure 7 of 720).

[0233] The video call request received in operation S1525 may be a request made for a video call initiated through the mobile device 500 and executed through the display device 120. Specifically, when the video call initiated through the mobile device 500 is executed by the display device 120, the display device 120 may transmit or receive image data required for the video call by connecting to a server for supporting video calls without going through the mobile device 500.

[0234] Based on the connection information received in operation S1525, the display device 400 may perform a video call with the paired device through the server for supporting video calls (S1545). Operation S1545 may be performed under the control of the processor 310. Specifically, based on the connection information received in operation S1525, the processor 310 may control the communication interface 330 to receive image data of the paired device from the paired device (specifically, from the paired device through the server for supporting video calls).

[0235] Therefore, the display device 400 may obtain the image data of the paired user required for the video call by directly receiving the image data of the paired user from the server for supporting the video call ( S260 ).

[0236] Figure 16 FIG16 is a flowchart of a video calling method 1600 performed by a display device according to an embodiment of the present disclosure. Figure 16 The operations may be performed by the display device (eg, 120 , 300 , or 400 ) according to an embodiment of the present disclosure. Figure 16 of and Figure 10 and Figure 15 The same components are represented by the same reference numerals or characters. Figure 16 Redundant description of it will be omitted in the description of the components.

[0237] Reference Figure 16 , the video call method 1600 may be performed by a display device (eg, 120, 300, or 400). Figure 4 The display device 400 performs the configuration of the video call method 1600. By referring to Figure 5 The video calling method 1600 is described with reference to the mobile device 500 , which is shown as a mobile device connected to the display device 400 .

[0238] Reference Figure 16 ,and Figure 10 Compared with the operation of the display device 400, the display device 400 may further include operation S1545. Figure 16 Operation S1525 can be performed with Figure 2 Corresponding to operation S230.

[0239] The display device 400 may receive a video call request including connection information of a paired device ( S1525 ).

[0240] The display device 400 may then perform a video call with the paired device through the server for supporting video calls based on the connection information received in operation S1525 (S1545). Specifically, the processor 310 may control the communication interface 330 to receive image data of the paired device from the paired device (specifically, from the paired device through the server for supporting video calls) based on the connection information received in operation S1525.

[0241] Despite Figure 16 Operation S1545 is performed after operation S240, but operation S1545 is performed based on the video call request received in operation S1525. Therefore, operation S1545 may be performed only after operation S1525.

[0242] When the video call method 1600 includes operation S1545 , the display device 400 may obtain image data of the paired partner required for the video call by directly receiving the image data of the paired partner from the server for supporting the video call ( S260 ).

[0243] Figure 17 is a flowchart of an image calling method according to an embodiment of the present disclosure. Figure 17 is a flowchart for explaining operations performed by a mobile device (eg, 110 or 500 ) or a display device (eg, 120 , 300 , or 400 ) according to an embodiment of the present disclosure. Figure 17 of and Figures 1 to 16 The same components are represented by the same reference numerals or characters. Figure 17 The redundant description thereof is omitted in the description of the illustrated video calling method.

[0244] Figure 5 The mobile device 500 is executed Figure 17 Examples of operations of mobile devices. Figure 4 The display device 400 is implemented Figure 12 An example of the operation of the display device.

[0245] Reference Figure 17 ,and Figure 2 Compared with the display device 120, the display device 400 may further perform operations S1710, S1720, S1730, and S1740.

[0246] According to an embodiment of the present disclosure, the processor 310 of the display device 400 may detect the user's viewing angle (S1710). Specifically, the processor 310 of the display device 400 may detect the user's viewing angle based on an image of the user (S1710). When the user's viewing angle detected in operation S1710 changes from the display device 400 to the mobile device 500, the processor 310 of the display device 400 may control the screen image of at least one of the display device 400 or the mobile device 500 according to the change in viewing angle.

[0247] In operation S1710, the user's viewing angle may be detected by analyzing an image of the user obtained via a video call. Specifically, the processor 310 may analyze the user's image to identify whether there is a change in at least one of the user's eyeballs, the user's face, the user's overall posture, or the movement (or rotation) of the user's head, thereby determining whether the user's viewing angle has changed from the display device 400 to the mobile device 500. Specifically, viewing angle detection through image analysis may use gaze detection technology, eye tracking technology, head posture estimation technology, etc.

[0248] In operation S1710, a dedicated sensor (eg, an NIR sensor, a time-of-flight (ToF) sensor, or a structured light (SL) sensor) may be used to detect the user's viewing angle. In this configuration, the display device 400 may further include a sensor for detecting the user's viewing angle.

[0249] In operation S1710, a user's viewing angle may be detected based on the user's voice.

[0250] According to an embodiment of the present disclosure, the display device 400 may further include a sensor for detecting the user's voice. The sensor for detecting the voice may be Figure 4 The processor 310 may determine whether the user's viewing angle has changed from the display device 400 to the mobile device 500 based on the result of detecting the user's voice. When the user's viewing angle has changed, the processor 310 may terminate the output of the video call screen image and may control the execution of the video call by the mobile device 500. Specifically, the processor 310 may control the execution of the video call by the mobile device 500 by sending a control signal for requesting the execution of the video call by the mobile device 500 to the mobile device 500.

[0251] Specifically, the audio input / output interface 465 included in the display device 400 may detect a user's voice, and may recognize whether the user's voice is directed toward the display device 400 or the mobile device 500 .

[0252] Alternatively, when detecting the user's voice, it is recognized that the user's perspective exists on the device selected from among the display device 400 and the mobile device 500 , on which the user's voice volume is detected to be louder than the other.

[0253] Display device 400 may send a screen image switching request to mobile device 500 (S1720) requesting that mobile device 500 output a video call screen image based on the change in viewing angle. Display device 400 may switch the video call screen image displayed in operation S270 to a different type of screen image based on the change in viewing angle (S1740). Specifically, display device 400 may change the screen image output via display 320 from the video call screen image to the screen image output before the video call begins. For example, display device 400 may display a screen image corresponding to the content being reproduced before the video call screen image was output. For example, display device 400 may receive the video call request in operation S220 while simultaneously reproducing content broadcast on channel 1. Then, when the user's viewing angle has changed in operation S1710, display device 400 may terminate output of the video call screen image and perform a screen image switching operation to reproduce the content broadcast on channel 1.

[0254] Specifically, when it is detected in operation S1710 that the user's viewing angle is changed from the display device 400 to the mobile device 500 , the processor 310 may terminate the output of the video call screen image in operation S270 and may control the video call screen image to be output by the mobile device 500 .

[0255] Based on the screen image switching request in operation S1720, the mobile device 500 may control the output of the video call screen image through the display 520. Specifically, since the user's viewing angle is located at the mobile device 500, the mobile device 500 may obtain the user's image by activating the camera 540 included in the mobile device 500. The mobile device 500 may generate a video call screen image including the obtained image of the user and the image of the other party, and may control the display 520 to display the generated video call screen image.

[0256] Now refer to Figure 19 and Figure 20 Detailed description of embodiments of detecting a user's perspective and changes in perspective by analyzing images of the user.

[0257] Figure 19 is a view for explaining a viewing angle detection operation performed by a display device according to an embodiment of the present disclosure. Figure 20 is a view for explaining a viewing angle detection operation performed by a display device according to an embodiment of the present disclosure. Figure 19 and Figure 20 of and Figure 11 The same components are denoted by the same reference numerals or characters.

[0258] Reference Figure 19 , user 1101 can conduct a video call with a paired user while viewing the video call screen image 140 output by display device 400. While conducting the video call, display device 400 can detect the user's perspective. For example, display device 400 can obtain an image of the user used in the video call by using activated camera 340. Display device 400 can identify whether the user's perspective 1905 corresponds to that of display device 400 by analyzing the obtained image of the user.

[0259] Reference Figure 20 , the user 1101 can change the posture from the posture 2010 to the posture 2020 to view the screen image 501 of the mobile device 500 while performing a video call while viewing the video call screen image 140 output by the display device 400 .

[0260] In this configuration, the display device 400 can detect that the user's viewing angle has changed from the display device 400 to the mobile device 500 by analyzing the user's posture, eyeballs, face, etc. based on the image of the user.

[0261] Reference Figure 20 , the viewing angle 1905 of the display device 400 of the user 1101 may be changed to the viewing angle 1920 of the mobile device 500. Then, the display device 400 may detect the viewing angle change and may send a screen image change request corresponding to the viewing angle change to the mobile device 500 (S1720). The mobile device 500 may control the display 520 to automatically output the video call screen image received in S1720.

[0262] According to an embodiment of the present disclosure, when the viewing angle of user 1101 changes from display device 400 to mobile device 500, mobile device 500 can output a video call screen image and perform image capture (specifically, camera shooting) of the user required for the video call. Therefore, the device that dynamically provides the video call screen image can be changed according to the user's intention, thereby improving user satisfaction and convenience.

[0263] According to an embodiment of the present disclosure, the operation of detecting the user's viewing angle can be performed by a device that performs the operation of outputting the current video call screen image and the operation of obtaining the user's image. Figure 19When the user's perspective changes as shown in the figure, mobile device 500 can start capturing the image of the user required for the video call and output the video call screen image through display 520 of mobile device 500. Therefore, mobile device 500 can perform an operation to detect the user's perspective by analyzing the image of the user obtained through the user image capture. When mobile device 500 detects that the user's perspective has changed back to display device 400, mobile device 500 can send a video call request back to display device 400. Display device 400 can then perform the operations required to output the video call screen image based on the video call request (e.g., S240, S260, and S270).

[0264] Figure 18 FIG18 is a flowchart of a video calling method 1800 performed by a display device according to an embodiment of the present disclosure. Figure 18 The video call method 1800 may be a flowchart illustrating operations performed by a display device (eg, 120 , 300 , or 400 ) according to an embodiment of the present disclosure. Figure 18 of and Figure 17 The same components are represented by the same reference numerals or characters. Figure 18 Redundant description of it will be omitted in the description of the components.

[0265] We will now describe Figure 4 The display device 400 performs the configuration of the video call method 1800. By referring to Figure 5 The video calling method 1800 is described with reference to the mobile device 500 , which is shown as a mobile device connected to the display device 400 .

[0266] Reference Figure 18 ,and Figure 10 Compared with the video call method 1000, the video call method 1800 may further include at least one of operations S210, S1710, and S1740. Figure 17 、 Figure 19 and Figure 20 Describes in detail Figure 18 Operations S1710 and S1740 are described below, and thus redundant descriptions thereof will be omitted.

[0267] Figure 21 is a flowchart of a video calling method 2100 performed by a display device according to an embodiment of the present disclosure. Figure 21 The video call method 2100 may be a flowchart illustrating operations performed by a display device (eg, 120 , 300 , or 400 ) according to an embodiment of the present disclosure. Figure 21 of and Figure 10 or Figure 18 The same components are represented by the same reference numerals or characters. Figure 21 Redundant description of it will be omitted in the description of the components.

[0268] Reference Figure 21 ,and Figure 10 Compared with the video call method 1000, the video call method 2100 may further include at least one of operations S210, S2110, and S2120. Figure 17 、 Figure 19 and Figure 20 Describes in detail Figure 18 Operations S1710 and S1740 are described below, and thus redundant descriptions thereof will be omitted.

[0269] After outputting the video call screen image in operation S270, the display device 400 may receive a request to switch the video call (S2110). The request to switch the video call may include: i) a request to execute the video call again through the mobile device 500, specifically, a request to execute output of the video call screen image and capture an image of the user for the video call in the mobile device 500, ii) a request to play back (reproduce) content, or iii) a request to terminate the output of the video call screen image.

[0270] Specifically, when the user sends user input for selecting CH1 to the display device 400 by manipulating the remote controller for controlling the display device 400, the display device 400 can terminate the output of the video call screen image based on the user input, and can control the display 320 to display the screen image corresponding to the content sent through CH1.

[0271] Specifically, the display device 400 may receive a user input corresponding to a request to switch the video call via the user interface 450 of the display device 400. For convenience of explanation, the user input corresponding to the request to switch the video call may be referred to as a 'first input'.

[0272] When the first input is received through the display device 400 , the processor 310 may terminate outputting the video call screen image based on the receipt of the first input, and may control execution of the video call by the mobile device 500 .

[0273] Specifically, operation S2110 may further include an operation of sending a control signal including a request for switching the video call to the mobile device 500. Then, in response to the control signal, the mobile device 500 enables output of a video call screen image through the display 520, thereby implementing the video call through the mobile device 500 instead of the display device 400.

[0274] Then, in the video call method 2100, the screen image output by the display 320 may be switched based on the request received in operation S2110 (S2120). Figure 22 Operation S2120 is described in more detail.

[0275] Figure 22 is a flowchart for explaining a screen image switching operation performed by a display device according to an embodiment of the present disclosure.

[0276] Reference Figure 22 , the mobile device 500 may first output the Figure 8 The display device 400 that is paired with the mobile device 500 but is a pairing target may display a playback screen image 2210 of content provided by CH1.

[0277] The user may request output of the video call screen image through the display device 400 by using the UI screen image ( S230 ).

[0278] Then, the mobile device 500 may display the control UI screen image 2210 described in operation S250. The display device 400 may output the video call screen image 2220 (S270).

[0279] Then, when receiving a request to switch the video call (S2110), the display device 400 may terminate the output of the video call screen image 2220 and perform screen image switching so that the content broadcasted through CH1 is displayed again. Therefore, the display device 400 may display a screen image 2270 corresponding to the content transmitted again through CH1.

[0280] When a request for switching the video call is received (S2110), a control signal notifying switching of the video call may be transmitted to the mobile device 500. Then, the mobile device 500 may output a video call screen image 2230.

[0281] Figure 23 23 is a flowchart of a video calling method 2300 performed by a display device according to an embodiment of the present disclosure. Figure 23 The video call method 2300 may be a flowchart illustrating operations performed by a display device (eg, 120 , 300 , or 400 ) according to an embodiment of the present disclosure. Figure 23 of and Figure 10 or Figure 18 The same components are represented by the same reference numerals or characters. Figure 23 Redundant description of it will be omitted in the description of the components.

[0282] Reference Figure 23 ,and Figure 10 Compared with the video call method 1000, the video call method 2300 may further include at least one of operations S210, S2310, and S2320.

[0283] Specifically, after outputting the video call screen image in operation S270, the display device 400 may receive a request to play back content (S2310). Operation S2310 may be performed through the user interface 450. Specifically, the user may manipulate the remote controller for controlling the display device 400 so that a user input requesting playback of the user's desired content is sent through the user interface 450.

[0284] The display device 400 may switch the displayed screen image based on the content playback request received in operation S2310 (S2320). Operation S2320 may be performed under the control of the processor 310.

[0285] When a user input selecting CH1 is transmitted to the display device 400, a screen image corresponding to the content transmitted through CH1 may be controlled to be displayed through the display 320. Switching in the displayed screen image based on a content playback request may be referred to as "screen image switching." Figure 24 Screen image switching is described in more detail.

[0286] Figure 24 is a flowchart for explaining a screen image switching operation performed by a display device according to an embodiment of the present disclosure. Figure 24 of and Figure 22 The same components are denoted by the same reference numerals or characters.

[0287] Reference Figure 24 , after the display device 400 outputs the video call screen image 2220, a content playback request may be received (S2310). Figure 23 The content playback request 2310 may include not only a request to play back specific content, but also a search request for content playback (eg, an input corresponding to a channel operation key).

[0288] Specifically, when a user manipulates a channel up key or a channel down key included in the remote controller to view content, the display device 400 may receive a content playback request corresponding to the user's manipulation or the user input.

[0289] Then, the display device 400 may control the screen 2410 including the image 2201 corresponding to the playback-requested content.

[0290] Specifically, the processor 310 of the display device 400 may split the displayed screen image into a first area and a second area based on a content playback request, and may control output of the video call screen image through the first area and control output of the screen image including the content through the second area.

[0291] Reference Figure 24 , the processor 310 of the display device 400 may control a screen image 2410 including both an image 2201 corresponding to the content and a video call screen image 2411 to be displayed.

[0292] When the screen image 2410 output by the display device 400 includes the image 2201 corresponding to the content and the video call screen image 2411, the display device 400 can selectively output the audio corresponding to the content and the audio corresponding to the video call. For example, when the content playback request received in operation S2310 is a request corresponding to the operation of the up channel key or the down channel key for searching for content, the display device 400 can control not to output the audio corresponding to the content, and control to output the audio corresponding to the video call. As another example, when the content playback request received in operation S2310 is a request corresponding to the operation of directly selecting specific content or a specific channel, the display device 400 can control to output the audio corresponding to the content.

[0293] Figure 25 is a flowchart for explaining a screen image switching operation performed by a display device according to an embodiment of the present disclosure.

[0294] According to an embodiment of the present disclosure, a request for switching a video call may be received by the mobile device 500 (S2510). Specifically, after the mobile device 500 outputs the control UI screen image 2210, the user may select "Video Call Switch TV" as a menu included for requesting video call switching. Then, the mobile device 500 may control the video call screen image to be output through the mobile device 500 again, and may transmit a control signal for requesting the video call switching to the display device 400.

[0295] Therefore, the mobile device 500 may display the video call screen image 2520 again, and the display device 400 may terminate the output of the video call screen image 2220. The display device 400 may control to output again the screen image 2201 corresponding to the content output before performing the video call.

[0296] Figure 26 is a view for explaining a position changing operation of a display performed by a display device according to an embodiment of the present disclosure.

[0297] According to an embodiment of the present disclosure, the processor 310 of the display device 400 may control the position movement of the display 320 to correspond to the video call screen image received in operation S220 based on the video call request.

[0298] Specifically, the display device 400 may be a display device that can be moved so that the display 320 is rotated 90 degrees and arranged in a horizontal direction or a vertical direction. The display device may be called a vertical TV.

[0299] refer to Figure 26 , the display device 2600 may correspond to the display device 120 , 300 or 400 according to an embodiment of the present disclosure.

[0300] Reference Figure 26 , the display device 2600 may include a display 2601 arranged in a horizontal direction before receiving the video call request of operation S220. Because the display 2601 is arranged horizontally before receiving the video call request, the display device 2600 may display a content playback screen image 2630.

[0301] In response to the video call request of operation S220 , the display device 2600 may adjust the position of its display based on the video call request so that the position of the display 2601 is changed to the position of the display 2620 .

[0302] The display device 2600 may control the display 2620 arranged in a vertical direction to display a video call screen image 2650 .

[0303] As above reference Figure 26 As described, according to an embodiment of the present disclosure, the arrangement direction of the display included in the display device 2600 is adjusted according to whether a video call screen image is output, and thus a screen image more consistent with a video call can be output.

[0304] Figure 27 is a block diagram of a display device 2700 according to an embodiment of the present disclosure. The display device 2700 can be used in conjunction with the display device 2700 according to the above reference. Figures 1 to 26 Thus, the description of the display device 2700 is similar to that of the display device 2700 with reference to FIG. Figures 1 to 26 The descriptions made are the same and will not be repeated here.

[0305] Specifically, including Figure 27 The processor 2780, the display 2715, the communication interface 2750, the memory 2790, the camera 2762, and the audio output interface 2725 in the display device 2700 may respectively correspond to the components included in Figure 4The processor 310, the display 320, the communication interface 330, the memory 470, the camera 340 and the audio output interface 460 in the display device 400.

[0306] The video processor 2710 processes video data received by the display device 2700. The video processor 2710 may perform various image processing such as decoding, scaling, noise filtering, frame rate conversion, and resolution conversion on the received video data.

[0307] The processor 2780 may receive a write request for video data processed by the video processor 2710 and may control encryption and writing of the video data to a memory device or memory 2790 (eg, RAM) included in the processor 2780 .

[0308] The display 2715 displays a video included in a broadcast signal received via the tuner 2740 on its screen under the control of the processor 2780. The display 2715 may also display content (eg, moving pictures) input via the communication interface 2750 or the input / output (I / O) interface 2770.

[0309] The display 2715 may also output an image stored in the memory 2790 under the control of the processor 2780. The display 2715 may include a voice UI (e.g., including a voice instruction guide) for performing a voice recognition task corresponding to voice recognition or a motion UI (e.g., including a user motion guide for motion recognition) for performing a motion recognition task corresponding to motion recognition.

[0310] The audio processor 2720 processes audio data. The audio processor 2720 may perform various processes on the audio data, such as decoding, amplification, or noise filtering. The audio processor 2720 may include a plurality of audio processing modules to process audio corresponding to a plurality of content segments.

[0311] The audio output interface 2725 outputs audio included in the broadcast signal received via the tuner 2740 under the control of the processor 2780. The audio output interface 2725 may also output audio (e.g., voice or sound) input via the communication interface 2750 or the I / O interface 2770. The audio output interface 2725 may also output audio stored in the memory 2790 under the control of the processor 2780. The audio output interface 2725 may include at least one of a speaker 2726, a headphone output port 2727, or a Sony / Philips Digital Interface (S / PDIF) output port 2728. The audio output interface 2725 may include a combination of the speaker 2726, the headphone output port 2727, and the S / PDIF output port 2728.

[0312] The power supply 2730 supplies power input from an external power source to the internal components 2710 to 2790 of the display device 2700 under the control of the processor 2780. The power supply 2730 may also supply power output by one or more batteries located in the display device 2700 to the internal components 2710 to 2790 of the display device 2700 under the control of the processor 2780.

[0313] The tuner 2740 can tune and select only the frequency of a channel that the image display device 2700 wants to receive from among many radio wave components obtained through amplification, mixing, resonance, etc. of wired or wireless broadcast signals. The broadcast signal includes audio, video, and additional information (e.g., electronic program guide (EPG)).

[0314] Tuner 2740 can receive a broadcast signal in a frequency band corresponding to a channel number (e.g., cable broadcast No. 506) according to user input (e.g., a control signal received from an external control device (e.g., a remote controller), such as a channel number input, a channel up and down input, and a channel input on an EPG screen image).

[0315] Tuner 2740 can receive broadcast signals from various sources, such as terrestrial broadcasts, cable broadcasts, satellite broadcasts, and internet broadcasts. Tuner 2740 can also receive broadcast signals from sources such as analog broadcasts or digital broadcasts. Broadcast signals received via tuner 2740 are decoded (e.g., audio decoding, video decoding, or additional information decoding) and thus divided into audio, video, and / or additional information. The audio, video, and / or additional information can be stored in memory 2790 under the control of processor 2780.

[0316] The display device 2700 may include a single tuner 2740 or a plurality of tuners 2740. According to an embodiment, when a plurality of tuners 2740 are included, the plurality of tuners 2740 may output a plurality of broadcast signals to a plurality of partial screen images included in a multi-view screen image provided to the display 2715.

[0317] The tuner 2740 may be integral with the display device 2700 or implemented as a separate device with the tuner electrically connected to the display device 2700 (eg, a tuner connected to a set-top box and I / O interface 2770 ).

[0318] The communication interface 2750 can connect the display device 2700 to an external device (e.g., an audio device) under the control of the processor 2780. The processor 2780 can transmit or receive content to or from an external device connected via the communication interface 2750, download an application from an external device, or perform web browsing. Specifically, the communication interface 2750 can connect to a network to receive content from an external device.

[0319] As described above, the communication interface 2750 may include at least one selected from a short-range wireless communication module, a wired communication module, and a mobile communication module.

[0320] According to an embodiment of the present disclosure, the communication interface 2750 may communicate with a server for supporting video calls through a mobile communication module or a mobile device (eg, the mobile device 500 ) through a short-range wireless communication module or a wired communication module.

[0321] Figure 27 A configuration is shown in which the communication interface 2750 includes one of a wireless local area network (LAN) 2751 , an interface for a Bluetooth network 2752 , and an interface for a wired Ethernet 2753 .

[0322] The communication interface 2750 may include a combination of one or more of a wireless LAN 2751, a Bluetooth network 2752, and a wired Ethernet 2753. The communication interface 2750 may receive a control signal for controlling the device under the control of the processor 2780. The control signal may be implemented as a Bluetooth signal, a radio frequency (RF) signal, or a Wi-Fi signal.

[0323] In addition to the Bluetooth interface 2752 , the communication interface 2750 may also include short-range communication (eg, near field communication (NFC) or Bluetooth Low Energy (BLE)).

[0324] The sensor 2760 detects the user's voice, the user's image, or interaction with the user.

[0325] Microphone 2761 receives voices uttered by the user. Microphone 2761 may convert the received voices into electrical signals and output the electrical signals to processor 2780. The user's voices may include, for example, voices corresponding to menus or functions of display device 2700. For example, the recognition range of microphone 2761 is recommended to be within 4 meters from microphone 2761 to the user's location, and may vary depending on the volume of the user's voice and the surrounding environment (e.g., speaker sound or ambient noise).

[0326] The microphone 2761 may be integrated with or separated from the display device 2700. The separate microphone 2761 may be electrically connected to the display device 2700 via the communication interface 2750 or the I / O interface 2770.

[0327] It will be readily understood by those skilled in the art that the microphone 2761 may be excluded depending on the performance and structure of the display device 2700 .

[0328] Camera 2762 receives images (e.g., consecutive frames) corresponding to the user's movements, including gestures, within the recognition range of camera 2762. For example, the recognition range of camera 2762 may be within a distance of 0.1 to 5 meters from camera 2762 to the user. The user's movements may include movements of a portion of the user's body, such as the user's face, facial expressions, hands, fists, and fingers. Under the control of processor 2780, camera 2762 may convert the received images into electrical signals and output the electrical signals to processor 2780.

[0329] According to an embodiment of the present disclosure, the sensor 2760 may further include at least one sensor for detecting the user's viewing angle. For example, the at least one sensor may include an NIR sensor, a ToF sensor, an SL sensor, etc.

[0330] The processor 2780 may select a menu displayed on the display device 2700 by using the result of the received motion recognition, or perform control corresponding to the result of the motion recognition. For example, the control may be channel adjustment, volume adjustment, or pointer movement.

[0331] Camera 2762 may include a lens and an image sensor. Camera 2762 may support optical zoom or digital zoom by using multiple lenses and image processing. The recognition range of camera 2762 may be set differently depending on the angle of camera 2762 and surrounding environmental conditions. When camera 2762 is composed of multiple cameras, three-dimensional (3D) still images or 3D motion can be received by the multiple cameras.

[0332] The camera 2762 may be integrated with the display device 2700 or may be separated from the display device 2700. An independent device including the independent camera 2762 may be electrically connected to the display device 2700 via the communication interface 2750 or the I / O interface 2770.

[0333] It will be readily understood by those skilled in the art that the camera 2762 may be excluded depending on the performance and structure of the display device 2700 .

[0334] Optical receiver 2763 receives optical signals (including control signals) from an external control device via a light window in the bezel of display 2715. Optical receiver 2763 can receive optical signals corresponding to user input (e.g., touch, press, touch gesture, voice, or motion) from the control device. Under the control of processor 2780, the control signal can be extracted from the received optical signals.

[0335] For example, light receiver 2763 can receive a signal corresponding to the pointing position of the control device and transmit the received signal to processor 2780. For example, when a UI screen image for receiving data or commands from a user has been output via display 2715 and the user wishes to input data or commands to display device 2700 via the control device, the user moves the control device while touching a touchpad provided in the control device. At this time, light receiver 2763 can receive a signal corresponding to the movement of the control device and transmit the received signal to processor 2780. Light receiver 2763 can receive a signal indicating that a certain button provided on the control device has been pressed and transmit the received signal to processor 2780. For example, when a user presses a button-type touchpad provided in the control device with their finger, light receiver 2763 can receive a signal indicating that the button-type touchpad has been pressed and transmit the received signal to processor 2780. For example, the signal indicating that the button-type touchpad has been pressed can be used as a signal for selecting one of the items.

[0336] The I / O interface 2770 receives video (e.g., moving images), audio (e.g., voice or music), and additional information (e.g., EPG) from outside the display device 2700 under the control of the processor 2780. The I / O interface 2770 may include a high-definition multimedia interface (HDMI) port 2771, a component jack 2772, a PC port 2773, or a USB port 2774. The I / O interface 2770 may include a combination of the HDMI port 2771, the component jack 2772, the PC port 2773, and the USB port 2774.

[0337] It will be understood by those skilled in the art that the structure and operation of the I / O interface 2770 may be implemented differently depending on the implementation.

[0338] The processor 2780 controls the overall operation of the display device 2700 and signal transmission between internal components of the display device 2700 and processes data. When there is a user input or a stored preset condition is satisfied, the processor 2780 may execute an operating system (OS) and various applications stored in the memory 2790.

[0339] The processor 2780 may include a RAM storing a signal or data input from an external source of the display device 2700 or serving as a storage area for various operations performed by the display device 2700 , a ROM storing a control program for controlling the display device 2700 , and a processor.

[0340] The processor may include a graphics processing unit (GPU) for performing video graphics processing. The processor may be implemented as a system on a chip (SoC) including a core and a GPU. The processor may include a single-core, dual-core, triple-core, quad-core, or multi-core processor.

[0341] The processor may include a plurality of processors. For example, the processor may be implemented by using a main processor and a sub-processor that operates in a sleep mode.

[0342] The GPU generates a screen image including various objects such as icons, images, and text by using an arithmetic unit and a rendering unit. The arithmetic unit calculates attribute values, such as coordinate values, shape, size, color, etc., for each object to be displayed according to the layout of the screen image using user interactions detected by the sensor. The rendering unit generates a screen image including various layouts of objects based on the attribute values ​​calculated by the arithmetic unit. The screen image generated by the rendering unit is displayed on the display area of ​​the display 2715.

[0343] Figure 28 is a block diagram of a mobile device 2800 according to an embodiment of the present disclosure.

[0344] Figure 28 The mobile device 2800 shown in FIG. Figures 1 to 25 The mobile device 110 or 500 shown in FIG. Figure 28 The processor 2805, the user input interface 2810, the display 2821, the camera 2861 and the communication interface 2830 in the mobile device 2800 can be respectively connected to the Figure 5 The processor 505, user interface 510, display 520, camera 540 and communication interface 530 in the mobile device 500 correspond to each other.

[0345] Therefore, the description of mobile device 2800 that is the same as the description of mobile devices 110 and 500 given above is redundant and is therefore omitted here.

[0346] The user input interface 2810 represents a device through which a user inputs data for controlling the mobile device 2800. For example, the user input interface 2810 may be, but is not limited to, a keyboard, a dome switch, a touchpad (e.g., capacitive cover type, resistive cover type, infrared beam type, integral strain gauge type, surface acoustic wave type, piezoelectric type, etc.), a jog wheel, or a jog switch.

[0347] The user input interface 2810 may receive a user input for selecting a virtual image to be displayed. The user input interface 2810 may also receive a user input for setting an operation of the virtual image and a user input for purchasing an item associated with the virtual image.

[0348] The output interface 2820 may output an audio signal, a video signal, or a vibration signal, and may include a display 2821 , an audio output interface 2822 , and a vibration motor 2823 .

[0349] The display 2821 displays information processed by the mobile device 2800. For example, the display 2821 may display a user interface for selecting a virtual image, a user interface for setting an operation of a virtual image, and a user interface for purchasing an item of a virtual image.

[0350] When the display 2821 forms a layered structure with the touch panel to construct a touch screen, the display 2821 can function as both an input device and an output device. The display 2821 may include at least one of a liquid crystal display (LCD), a thin film transistor-LCD (TFT-LCD), an organic light-emitting diode (OLED), a flexible display, a three-dimensional (3D) display, and an electrophoretic display. Depending on the embodiment of the mobile device 2800, the mobile device 2800 may include at least two displays 2821. The at least two displays 2821 may be arranged facing each other using a hinge.

[0351] The audio output interface 2822 outputs audio data received from the communication interface 2830 or stored in the memory 2870. The audio output interface 2822 may also output audio signals related to the functions of the mobile device 2800 (e.g., call signal reception sound, message reception sound, notification sound). The audio output interface 2822 may include, for example, a speaker and a buzzer.

[0352] The vibration motor 2823 can output a vibration signal. For example, the vibration motor 2823 can output a vibration signal corresponding to the output of audio data or video data (e.g., a call signal reception sound or a message reception sound). The vibration motor 2823 can also output a vibration signal when the touch screen is touched.

[0353] The processor 2805 generally controls all operations of the mobile device 2800. For example, the processor 2805 may control the user input interface 2810, the output interface 2820, the sensing unit 2840, the communication interface 2830, the audio / video (A / V) input interface 2860, etc. by executing a program stored in the memory 2870.

[0354] The sensing unit 2840 may detect a state of the mobile device 2800 or a state of the surroundings of the mobile device 2800 and may transmit information corresponding to the detected state to the processor 2805 .

[0355] The sensing unit 2840 may include, but is not limited to, at least one selected from a magnetic sensor 2841, an acceleration sensor 2842, a temperature / humidity sensor 2843, an infrared sensor 2844, a gyroscope sensor 2845, a position sensor (e.g., a global positioning system (GPS)) 2846, a pressure sensor 2847, a proximity sensor 2848, and an RGB sensor 2849 (i.e., an illumination sensor). The functions of most sensors will be intuitively understood by those skilled in the art based on their names, and thus their detailed description will be omitted here.

[0356] According to an embodiment of the present disclosure, the sensing unit 2840 may further include at least one sensor for sensing the user's viewing angle. For example, the at least one sensor may include an NIR sensor, a ToF sensor, an SL sensor, etc.

[0357] The communication interface 2830 may include at least one component that enables the mobile device 2800 to perform data communication with the HMD device or server. For example, the communication interface 2830 may include a short-range wireless communication interface 2851 , a mobile communication interface 2852 , and a broadcast receiver 2853 .

[0358] Examples of the short-range wireless communication interface 2851 may include, but are not limited to, a Bluetooth communication interface, a Bluetooth Low Energy (BLE) communication interface, a near field communication (NFC) interface, a wireless local area network (WLAN) (e.g., Wi-Fi) communication interface, a ZigBee communication interface, an Infrared Data Association (IrDA) communication interface, a Wi-Fi Direct (WFD) communication interface, an ultra-wideband (UWB) communication interface, and an Ant+ communication interface.

[0359] The mobile communication interface 2852 can exchange wireless signals with at least one selected from a server, an external terminal, and a base station on a mobile communication network. Examples of wireless signals here may include voice call signals, video call signals, and various types of data according to text / multimedia message transmission.

[0360] The broadcast receiver 2853 receives a broadcast signal and / or broadcast-related information from an external source via a broadcast channel. The broadcast channel may be a satellite channel, a ground wave channel, etc. Depending on the embodiment, the mobile device 2800 may not include the broadcast receiver 2853.

[0361] The A / V input interface 2860 inputs an audio signal or a video signal and may include a camera 2861 and a microphone 2862. The camera 2861 may acquire image frames (e.g., still images or moving images) via an image sensor in a video call mode or a shooting mode. Images captured via the image sensor may be processed by the processor 2805 or a separate image processor.

[0362] The image frame obtained by the camera 2861 may be stored in the memory 2870 or transmitted to the outside via the communication interface 2830. According to an embodiment of the terminal structure, at least two cameras 2861 may be included.

[0363] Microphone 2862 receives external audio signals and converts the external audio signals into electrical audio data. For example, microphone 2862 can receive audio signals from an external device or a speaker. Microphone 2862 can use various noise cancellation algorithms to remove noise generated when receiving external audio signals.

[0364] The memory 2870 may store programs used by the processor 2805 to perform processing and control, and may also store data input to or output from the mobile device 2800 .

[0365] The memory 2870 may include at least one type of storage medium selected from a flash memory type, a hard disk type, a micro multimedia card type, a card type memory (e.g., secure digital (SD) or extreme digital (XD) memory), a random access memory (RAM), a static random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable ROM (EEPROM), a programmable ROM (PROM), a magnetic memory, a magnetic disk, and an optical disk.

[0366] Programs stored in the memory 2870 may be classified into a plurality of modules according to their functions, for example, a user interface (UI) module 2871 , a touch screen module 2872 , and a notification module 2873 .

[0367] The UI module 2871 may provide a UI, a graphical user interface (GUI), etc. that is specific to each application and interoperates with the mobile device 2800. The touch screen module 2872 may detect a touch gesture on the user's touch screen and transmit information about the touch gesture to the processor 2805. The touch screen module 2872 according to an embodiment may recognize and analyze touch codes. The touch screen module 2872 may be configured by separate hardware including a controller.

[0368] To detect actual touch or near touch on a touchscreen, the touchscreen may have various internal or external sensors. An example of a sensor for detecting touch on a touchscreen is a tactile sensor. A tactile sensor is a sensor that detects touch of a specific object to a degree comparable to human perception or higher. The tactile sensor can detect various types of information, such as the roughness of the touched surface, the hardness of the touched object, and the temperature of the touched point.

[0369] Another example of a sensor for detecting a real touch or a proximity touch on a touch screen is a proximity sensor.

[0370] A proximity sensor detects the presence of an object approaching a predetermined sensing surface, or detects the presence of an object nearby without mechanical contact, by using electromagnetic force or infrared rays. Examples of proximity sensors include transmissive photoelectric sensors, direct reflective photoelectric sensors, mirror reflective photoelectric sensors, high-frequency oscillation proximity sensors, capacitive proximity sensors, magnetic proximity sensors, and infrared proximity sensors. Examples of user touch gestures include tapping, touch and hold, double-clicking, dragging, shaking, tapping, dragging and dropping, and sliding.

[0371] The notification module 2873 may generate a signal for notifying that an event has been generated in the mobile device 2800. Examples of events generated in the mobile device 2800 may include call signal reception, message reception, key signal input, schedule notification, etc. The notification module 2873 may output the notification signal in the form of a video signal via the display 2821, output the notification signal in the form of an audio signal via the audio output interface 2822, or output the notification signal in the form of a vibration signal via the vibration motor 2823.

[0372] The video call method according to an embodiment of the present disclosure can be implemented as a program command that can be executed by various computer devices and can be recorded on a computer-readable recording medium. According to an embodiment of the present disclosure, a computer-readable storage medium can implement at least one program including commands for executing the above-mentioned video call method.

[0373] Computer-readable recording media may include program commands, data files, data structures, and the like, either singly or in combination. The program commands to be recorded on the computer-readable recording medium may be specifically designed and configured for the implementation, or they may be well-known and usable by those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, or magnetic tapes; optical media such as compact disk read-only memories (CD-ROMs) or digital versatile disks (DVDs); magneto-optical media such as floppy disks; and hardware devices specifically configured to store and execute program commands, such as ROM, random access memory (RAM), or flash memory. Examples of program commands include high-level language code that can be executed by a computer using an interpreter, etc., and machine language code generated by a compiler.

[0374] In addition, the video call method according to an embodiment of the present disclosure can be implemented as a computer program product, which includes a recording medium on which a program is recorded, wherein the program is used to perform an operation of obtaining a sentence composed of multiple languages; and using a multilingual translation model, obtaining a vector value corresponding to each word contained in the sentence composed of multiple languages, and converting the obtained vector value into a vector value corresponding to the target language, and obtaining a sentence composed of the target language based on the vector value corresponding to the target language.

[0375] According to the embodiments of the present disclosure, in a display device, a mobile device, a video calling method performed by the display device, and a video calling method performed by the mobile device, a user can perform a video call while viewing a video calling screen image provided by a large screen. Therefore, the convenience of the user and the level of user satisfaction during the video call can be increased.

[0376] Although one or more embodiments of the present disclosure have been described with reference to the accompanying drawings, persons skilled in the art will understand that various changes in form and details may be made therein without departing from the spirit and scope of the present disclosure as defined by the appended claims.

Claims

1. Display devices, including: monitor; camera; a communication interface configured to communicate with a mobile device; as well as A processor configured to execute at least one instruction to: receiving a video call request from the mobile device to perform a video call with a paired device, activating the camera based on the video call request, obtaining image data of a paired device for a video call through the communication interface, controlling the display to display a video call screen image, the video call screen image including a first image of the paired device generated based on the image data and a second image obtained by the camera, and controlling the communication interface to send image data corresponding to the second image to the mobile device, so that the image data corresponding to the second image is sent to the paired device through a server for supporting video calls; The processor is further configured to execute the at least one instruction to: detecting a viewing angle of a user of the mobile device based on the second image, and When the viewing angle of the user is changed from the display device to the mobile device, a camera included in the mobile device is controlled to be activated, and the mobile device is controlled to display a video call screen image including the first image and the second image obtained by the camera of the mobile device.

2. The display device according to claim 1, wherein The processor is further configured to execute the at least one instruction to control the image data of the paired device to be received from the mobile device through the communication interface.

3. The display device according to claim 1, further comprising: a sensor configured to detect a viewing angle of a user of the mobile device, The processor is further configured to execute the at least one instruction to: determining whether the viewing angle of the user is changed from the display device to the mobile device based on a result of detecting the viewing angle of the user of the mobile device by the sensor, and Based on detecting a change in the viewing angle of the user, outputting the video call screen image by the display device is terminated.

4. The display device according to claim 1, further comprising: a sensor configured to detect a voice of a user of the mobile device, The processor is further configured to execute the at least one instruction to: tracking the directionality of the voice of the user of the mobile device detected by the sensor, and determining whether the viewing angle of the user of the mobile device changes from the display device to the mobile device based on whether the directionality of the voice of the user changes, and Based on detecting that the viewing angle of the user has changed, outputting the video call screen image by the display device is terminated.

5. The display device according to claim 1, wherein The processor is further configured to execute the at least one instruction to: mirroring image data of the paired device generated by the mobile device, and The communication interface is controlled to receive the image data from the mobile device. The display device according to claim 1 , wherein: The video call request includes connection information of the paired device, and The processor is further configured to execute the at least one instruction to control the communication interface to receive the image data from the paired device based on the connection information.

7. The display device according to claim 1, further comprising: a user interface that receives a first input requesting to switch the video call; The processor is further configured to execute the at least one instruction to terminate the output of the video call screen image by the display device based on receiving the first input, and control the execution of the video call by the mobile device.

8. The display device according to claim 1, further comprising: a user interface that receives a second input requesting playback of the content, The processor is further configured to execute the at least one instruction to terminate output of the video call screen image by the display device based on receiving the second input, and control the display device to display a screen image corresponding to the content.

9. The display device according to claim 1, further comprising: a user interface that receives a second input requesting playback of the content, The processor is further configured to execute the at least one instruction to: Based on receiving the second input, dividing the screen of the display into a first area and a second area, controlling the video call screen image to be output through the first area, and A screen image including the content is controlled to be output through the second area.

10. A video calling method performed by a display device, the video calling method comprising: receiving a video call request from the mobile device to perform a video call with a paired device; activating a camera of the display device based on the video call request; Obtaining image data of a paired device by the display device; outputting, through the display device, a video call screen image to be output, the video call screen image including a first image of the paired device generated based on the image data and a second image of the user of the mobile device obtained by the camera; sending image data corresponding to the second image to the mobile device, so that the image data corresponding to the second image is sent to the paired device via a server for supporting video calls; as well as detecting a viewing angle of a user of the mobile device based on the second image, and When the viewing angle of the user is changed from the display device to the mobile device, a camera included in the mobile device is controlled to be activated, and the mobile device is controlled to display a video call screen image including the first image and the second image obtained by the camera of the mobile device.

Images