Display device and operating method thereof

Abstract

The disclosed display device includes: a display; a communication unit; comprising one or more instructions; and at least one processor that executes the one or more instructions stored in the memory. The at least one processor: identifies, by executing the one or more instructions, a transmission area and a gesture recognition area in an image area of a first image captured by the camera for a video call; controlling the communicator to send a second image corresponding to the transmission area to a video call opposite side display device so as to provide a video call service; performing gesture recognition in a third image corresponding to the gesture recognition region; and performing a function corresponding to the recognized gesture from the gesture recognition in the third image.

Description

Technical Field

[0001] The disclosed embodiments relate to a display device and an operating method of the display device for providing a video call service, and more particularly, to a display device and an operating method of the display device for relatively more efficiently performing a gesture recognition function while providing a video call service. Background Art

[0002] With the development of wired or wireless communication networks and communication technologies, the use of video call services between electronic devices has increased. In particular, video call services between electronic devices have been widely used for contactless communication between different users at remote locations.

[0003] For example, in a video call service, an electronic device and another electronic device can be connected to each other via a wired or wireless communication network. The electronic device may include all electronic devices that include a display for providing a video call screen and capable of performing communication with other electronic devices in a remote location by accessing a wired or wireless communication network. For example, the electronic device may include, for example, a portable computer (e.g., a notebook computer, a netbook computer, or a tablet personal computer (PC)), a portable terminal (e.g., a smart phone or a personal digital assistant (PDA)), an analog television (TV), or a digital TV.

[0004] When a video call is performed between multiple electronic devices (e.g., a first electronic device and a second electronic device), the first electronic device can obtain an image about the first user and send the obtained image to the second electronic device. In addition, the second electronic device can obtain an image about the second user and send the obtained image to the first electronic device. Therefore, the first electronic device and the second electronic device can respectively display a video call screen including images about the first user and the second user. By doing so, each of the first user and the second user can perform a call while viewing an image relative to the other party in a position far away from each other. Summary of the invention

[0005] Technical issues

[0006] According to the disclosed embodiments, a display device for providing a video call service and an operating method of the display device are provided.

[0007] Specifically, a display device for relatively more efficiently performing a gesture recognition function while providing a video call service and an operating method of the display device are provided.

[0008] Solution to the problem

[0009] A display device may include: a display; a communicator; a memory storing one or more instructions; and at least one processor configured to execute the one or more instructions. The at least one processor may be configured to execute the one or more instructions to identify a transmission area and a gesture recognition area in an image area of ​​a first image captured by a camera for a video call. The at least one processor may be configured to execute one or more instructions to control the communicator to send a second image corresponding to the transmission area to a counterpart display device participating in the video call so as to provide a video call service. The at least one processor may be configured to execute the one or more instructions to perform gesture recognition in a third image corresponding to the gesture recognition area. The at least one processor may be configured to execute the one or more instructions to execute a function corresponding to the recognized gesture from the gesture recognition in the third image.

[0010] The at least one processor is configured to execute the one or more instructions to identify the gesture recognition area by detecting the gesture recognition area at a designated location of the image area.

[0011] The at least one processor is configured to execute one or more instructions to identify the gesture recognition area by: detecting a user's hand in the image area; and determining the gesture recognition area based on an area where the hand is detected.

[0012] The at least one processor may be further configured to execute the one or more instructions to: provide a user interface on the display to adjust the gesture recognition area; and adjust the gesture recognition area based on user input received through the user interface.

[0013] The at least one processor is configured to execute one or more instructions to perform the gesture recognition in the third image by performing the gesture recognition according to a specified event while the video call service is being provided. The specified event may include at least one of the following: a user input selecting the gesture recognition function, or detecting a motion exceeding a threshold in the image area.

[0014] The at least one processor may be further configured to execute the one or more instructions to identify a category of the zoom function based on the zoom function being performed when the gesture recognition function is provided while the video call service is being provided.

[0015] The at least one processor may also be configured to execute one or more instructions to: based on the category of the zoom function being identified as optical zoom, output a message to the display indicating that the gesture recognition function has been terminated, and based on the category of the zoom function being identified as digital zoom, expand the second image corresponding to the transmission area, and control the communicator to send the expanded second image to the other party's display device participating in the video call, perform the gesture recognition in the third image corresponding to the gesture recognition area, and execute the function corresponding to the recognized gesture from the gesture recognition in the third image.

[0016] The camera may include a non-zoom camera and a zoom camera. The at least one processor may also be configured to execute one or more instructions to switch the non-zoom camera that captures the first image for the video call to the zoom camera that captures the expanded first image based on the zoom function being performed when the gesture recognition function is provided while the video call service is being provided.

[0017] The at least one processor may also be configured to execute one or more instructions to provide gesture guidance, the gesture guidance providing one or more gestures and functions corresponding to each of the one or more gestures to guide the user with available gestures.

[0018] An operating method of a display device may include: identifying a transmission area and a gesture recognition area in an image area of ​​a first image captured by a camera for a video call; sending a second image corresponding to the transmission area to a counterpart display device participating in the video call so as to provide a video call service; performing gesture recognition in a third image corresponding to the gesture recognition area; and executing a function corresponding to a recognized gesture from the gesture recognition in the third image.

[0019] Identifying a gesture recognition area may include identifying the gesture recognition area at a designated location of the image area.

[0020] Identifying a gesture recognition area may include: detecting a hand of a user in the image area; and determining the gesture recognition area based on an area where the hand is detected.

[0021] The operating method may further include: providing a user interface on the display to adjust the gesture recognition area; and adjusting the gesture recognition area based on a user input received through the user interface.

[0022] Performing the gesture recognition in the third image may include performing the gesture recognition according to a specified event while the video call service is being provided. The specified event may include at least one of: (i) user input selecting the gesture recognition function or (ii) detecting a motion exceeding a threshold in the image area.

[0023] The operating method may further include identifying a category of the zoom function based on that the zoom function is performed when the gesture recognition function is provided while the video call service is being provided.

[0024] The operating method may further include: based on the category of the zoom function being identified as optical zoom, outputting a message to the display indicating that the gesture recognition function has been terminated, and based on the category of the zoom function being identified as digital zoom, expanding the second image corresponding to the transmission area, and controlling the communicator to send the expanded second image to the counterpart display device participating in the video call, performing the gesture recognition in the third image corresponding to the gesture recognition area, and performing the function corresponding to the recognized gesture from the gesture recognition in the third image.

[0025] The camera may include a non-zoom camera and a zoom camera. The operation method may also include, based on the zoom function being performed when the gesture recognition function is provided while the video call service is being provided, switching the non-zoom camera that captures the first image for the video call to the zoom camera for capturing the expanded first image.

[0026] The operating method may further include providing a gesture guide that provides one or more gestures and a function corresponding to each of the one or more gestures so as to guide the user with available gestures.

[0027] A non-transitory computer-readable recording medium may store therein a program for executing an operation method of a display device. The operation method may include: identifying a transmission area and a gesture recognition area in an image area of ​​a first image captured by a camera for a video call; sending a second image corresponding to the transmission area to a counterpart display device participating in the video call so as to provide a video call service; performing gesture recognition in a third image corresponding to the gesture recognition area; and performing a function corresponding to a recognized gesture from the gesture recognition in the third image.

[0028] Disclosure of beneficial effects

[0029] According to the display device and the operating method thereof, a gesture recognition function can be performed while providing a video call service.

[0030] In particular, according to the display device and the operating method thereof, a video call service can be effectively provided while performing a gesture recognition function.

[0031] In particular, according to the display device and the operating method thereof, user satisfaction can be increased by making the user's body part used for gesture recognition invisible on the video call screen. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] The present disclosure can be easily understood based on a combination of the following detailed description and the accompanying drawings in which the reference numerals indicate structural elements.

[0033] Figure 1 is a reference diagram for describing a method of providing a video calling service via two display devices according to an embodiment of the present disclosure.

[0034] Figure 2 is a reference diagram for describing a method according to an embodiment of the present disclosure, which makes it possible to perform a gesture recognition function without interrupting a video call screen while a video call service is being provided by a display device.

[0035] Figure 3 An example of a system for performing a video call function according to an embodiment of the present disclosure is shown.

[0036] Figure 4 is a detailed block diagram of a display device according to an embodiment of the present disclosure.

[0037] Figure 5 is a flowchart of an operating method of a display device according to an embodiment of the present disclosure.

[0038] Figure 6 is a reference diagram for describing a method of recognizing a transmission area in an image capturing a user for a video call function according to an embodiment of the present disclosure.

[0039] Figure 7 is a reference diagram for describing an operation method performed by a display device using a transmission area and a gesture recognition area recognized in an image capturing a user for a video call function.

[0040] Figure 8 is a reference diagram for describing an example of a method of determining a gesture recognition area according to an embodiment of the present disclosure.

[0041] Fig. 9 is a reference diagram for describing an example of a method of determining a gesture recognition area according to detection of a hand according to an embodiment of the present disclosure.

[0042] Fig.10 is a reference diagram for describing a method of adjusting a gesture recognition area according to an embodiment of the present disclosure.

[0043] Fig.11 is an example of a flowchart of a method performed by a display device for performing an operation corresponding to a zoom input while the display device provides a video call service and a gesture recognition function according to an embodiment of the present disclosure.

[0044] Fig.12 is a reference diagram for describing an operation method of a data processing apparatus when a zoom type is an optical zoom according to an embodiment of the present disclosure.

[0045] Fig.13 is a reference diagram for describing an operation method of a data processing device when a zoom type is a digital zoom according to an embodiment of the present disclosure.

[0046] Fig.14 is a reference diagram for describing an operation method of a display device when the display device includes two cameras according to an embodiment of the present disclosure.

[0047] Fig.15 An example of a user interface of a display device capable of providing a gesture recognition function while providing a video call service according to an embodiment of the present disclosure is shown. DETAILED DESCRIPTION

[0048] Hereinafter, the embodiments will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art can easily perform the embodiments. However, the disclosed embodiments may have different forms and should not be construed as being limited to the embodiments described herein. Also, in the accompanying drawings, for the sake of clarity, parts not related to the description are omitted, and similar reference numerals are used for similar elements throughout the specification. In addition, the same reference numerals are used for the same elements throughout the accompanying drawings.

[0049] Throughout the specification, when a part is referred to as being "connected" to other parts, the part may be "directly connected" to other parts, or may be "electrically connected" to other parts with other devices therebetween. Also, when a part "includes" a certain element, unless otherwise specifically mentioned, the part may further include another component, and may not exclude another component.

[0050] The expressions “according to an embodiment,” “according to an embodiment of the present disclosure,” “according to some embodiments,” or “according to one or more embodiments” written in various parts of the specification do not necessarily refer to the same embodiment.

[0051] One or more embodiments may be indicated as function block components and various processing operations. Some or all of such function blocks may be implemented by various numbers of hardware and / or software components configured to perform a specified function. For example, a function block may be implemented by one or more processors or microprocessors, or by a circuit structure for performing an intended function. In addition, for example, a function block may be implemented by various programming or scripting languages. A function block may be implemented by an algorithm executed by one or more processors. In addition, the disclosed embodiments may employ conventional techniques for electronic configuration, signal processing, and / or data control. Terms such as "module," "component," etc. may be used broadly and are not limited to mechanical or physical components.

[0052] In addition, the connecting lines or connecting members between the components shown in the drawings are intended to represent example functional connections and / or physical or logical connections between the components. It should be noted that many alternative or additional functional connections, physical connections or logical connections may exist in actual devices.

[0053] In addition, the expression “at least one of A, B, or C” indicates any one of “A,” “B,” “C,” “A and B,” “A and C,” “B and C,” and “A, B, and C.”

[0054] A display device and an operation method thereof are described. Specifically, an operation method for processing a video call request performed by a display device for displaying a multi-view screen when a video call is requested between a plurality of electronic devices, and a display device for performing the operation method are described.

[0055] Electronic devices capable of providing video call services may include all types of electronic devices that include a display for displaying a video call screen and are capable of performing communications with other electronic devices in a remote location by accessing a wired or wireless communication network. In addition, electronic devices may include various types of computing devices that include a display and are capable of providing video call services. For example, electronic devices may include, for example, wearable devices, smart phones, personal digital assistants (PDAs), media players, tablet personal computers (PCs), laptop computers, media players, televisions (TVs), digital TVs, smart TVs, digital signage, and digital boards, but are not limited thereto. In the following, for ease of explanation, electronic devices capable of providing video call services will be referred to as "display devices."

[0056] Hereinafter, in the drawings, the display device is shown and described as, for example, a TV. In addition, in the drawings, the same elements are indicated by using the same reference numerals. In addition, throughout the detailed description, the same elements are described by using the same terms.

[0057] Hereinafter, a display device and an operating method thereof will be described in detail by referring to the accompanying drawings.

[0058] Figure 1 is a reference diagram for describing a method of providing a video calling service via two display devices according to an embodiment of the present disclosure.

[0059] Reference Figure 1 , two display devices (i.e., the first display device 100 and the second display device 200) can provide a video call service by using a video call application. An application may represent a program or a processor for performing a service, a function, or a specified operation. In detail, an application may be formed by at least one instruction for performing a service, a function, or a specified operation. An application for performing a video call service or function or a video call operation may be referred to as a video call application.

[0060] A video call may refer to an operation in which each of multiple users at a remote location makes a telephone call with another party through multiple electronic devices while viewing the face of the other party on the screen. In addition, the described "video call" can be implemented in all fields, such as video conferencing, contactless communication, and / or contactless education, in which remote users perform communication by receiving images about other parties, and "video call" may refer to all situations in which multiple remote users perform communication while viewing images about other parties. The image included in the video call screen may not necessarily be the face of the user using the video call. Instead, the image may also include, for example, an image indicating the environment of the user using the video call and / or an image provided by the user.

[0061] Generally, a video call can be performed between two different electronic devices. Alternatively, three or more users at locations far away from each other can perform a video call through three or more electronic devices.

[0062] Hereinafter, a case where a user (hereinafter, "user") and another user (hereinafter, "the other party") perform a video call through two electronic devices remotely located from each other is described and shown as an example. The user may refer to not a single person but multiple persons, and the other party may also refer to multiple persons.

[0063] Reference Figure 1, a video call can be performed between the first display device 100 and the second display device 200 of the electronic device which are remote locations. In addition, the video call can be performed by sending and receiving data required for the video call using a communication network such as the third generation (3G), the fourth generation (4G) or the fifth generation (5G). Alternatively, the video call can be performed through the call service of the communication operator. In addition, the video call can be performed through a specified application (e.g., a video call application, a contactless communication application, a video education application and / or a video conferencing application) provided by the server of the service provider.

[0064] Included below Figure 1 In the description, the user's electronic device will be referred to as display device 100, and the electronic device of the other party performing a video call with the user will be referred to as the other party's display device 200. Alternatively, the user's electronic device may be simply referred to as the first display device, and the other party's electronic device may be simply referred to as the second display device. In addition, the user of display device 100 will be simply referred to as the user, and the other party performing a video call with the user will be referred to as the other user. In addition, the user and the other user may also be referred to as the first user and the second user, respectively. In addition, in Figure 1 In the embodiment, the display device is described as an example of an electronic device of the user and other users. However, the electronic device may also be various types of electronic devices such as a smart phone.

[0065] Reference Figure 1 , the display device 100 can perform a video call with the counterpart display device 200, which is an electronic device of the other party at a remote location. The display device 100 can perform a video call by directly executing its call function or by executing an application for contactless communication. As described above, the display device 100 can directly perform a video call with the counterpart display device 200 by using its video call service function.

[0066] The display device 100 may send a video call request to the counterpart display device 200, or the counterpart display device 200 may send a video call request to the display device 100. For example, when a user of the display device 100 wants to perform a video call, the user may input a user input for selecting an application, a program, or a menu for providing a video call service of the display device 100 to the display device 100. Then, the display device 100 may recognize that the video call request is received based on the user input.

[0067] When a video call starts, the display device 100 and the counterpart display device 200 performing the video call may display a video call screen. For example, the user's display device 100 may display a video call screen 10 by including an image about the other party on the main screen 11 and an image about the user on the sub-screen 12. In addition, the video call screen 10 may further include a menu for controlling the video call. In addition, the display of the counterpart display device 200 may display a video call screen 20 by including an image of the user on the main screen 21 and an image of the other party on the sub-screen 22. In addition, the video call screen 20 may further include a menu for controlling the video call. For example, when the display device 100 starts a video call request, the camera 162 of the display device 100 may shoot the user and send the image of the user to the counterpart display device 200, and the counterpart display device 200 receiving the video call request may shoot the other party by using the camera 262 and send the image of the other party to the display device 100. As described above, the video call screens 10 and 20 may include each of an image about a user and an image about another party who uses a video call service, and image signals corresponding to the video call screens 10 and 20 may include image signals having a designated resolution.

[0068] As described above, when a video call is performed between a user of the display device 100 and another user of the counterpart display device 200, when the user uses the gesture recognition function of the display device 100, the user can make various gestures by using the hand in order to use the gesture recognition function. The gesture recognition function may refer to a function according to which, when the user makes a gesture by using a body part such as a hand, the display device 100 recognizes the user's gesture, and the display device 100 performs a function mapped to the recognized gesture. Therefore, the user can make a specified gesture to trigger a specified function corresponding to the gesture. For example, the user can make a gesture of making an "X" sign by using two fingers in order to perform a mute function in a function such as a video call service. As described above, an image signal including a gesture 23 for gesture recognition made by the user in various ways may be sent to the counterpart display device 200 and may be fully displayed on the main screen 21 of the counterpart display device 200. Therefore, other users of the counterpart display device 200 may have to see unnecessary gestures 23, and therefore, may be distracted and lose attention or even feel uncomfortable when watching the video call screen 20. In addition, the user himself / herself may not want to show his / her gestures irrelevant to the content of the video call to the other party. Therefore, a method is provided according to which a portion for gesture recognition is not included in the video call screen in order to eliminate such unnecessary and reduce the inconvenience of the user.

[0069] Figure 2is a reference diagram for describing a method according to an embodiment of the present disclosure, which makes it possible to perform a gesture recognition function without interrupting a video call screen while a video call service is being provided by a display device.

[0070] Reference Figure 2 , when the display device 100 and the counterpart display device 200 perform a video call function, the user 15 may use the gesture recognition function to control the video call function or other functions. The user 15 may take a designated gesture for triggering the gesture recognition function, and the camera 162 of the display device 100 may capture an image of the upper body of the user 15. The image of the upper body of the user 15 captured by the camera 162 may include not only the face of the user 15 but also the hand making the gesture.

[0071] The display device 100 may identify at least a portion of the image obtained by the camera 162 as a transmission area, and identify at least a portion of the image other than the transmission area as a non-transmission area. The transmission area may indicate a portion of the image that is sent to the other display device 200 for the video call function, and the non-transmission area may indicate a portion of the image that is not sent to the other display device 200. The transmission area, which is the portion sent to the other display device 200, may be centered on the face of the user 15, and may not include a body part of the user making a gesture, such as a part of a hand or an arm. The display device 100 may perform gesture recognition in the non-transmission area. The display device 100 may perform gesture recognition based on the entire non-transmission area, or may determine at least a portion of the non-transmission area as a gesture recognition area, and may perform gesture recognition in the determined gesture recognition area.

[0072] As described above, by providing only a portion of the image of the user 15 captured by the camera 162 of the display device 100 (the portion where the user's gesture is not shown) to the counterpart display device 200, the counterpart display device 200 can output the image of the user 15 on the main screen 24, which does not include the gesture of the user 15. Therefore, when using the video call service through the counterpart display device 200, the other user 25 may not have to watch the unnecessary gesture of the user 15, and thus the video call can be used without being interrupted.

[0073] Figure 3 An example of a system for performing a video call function according to an embodiment of the present disclosure is shown.

[0074] Reference Figure 3 , the system may include a display device 100 , a counterpart display device 200 , and a server 300 .

[0075] The display apparatus 100 may be a device capable of displaying an image or data according to a user's request, and may include a communicator 110 , a display 120 , a memory 130 , a processor 140 , and a camera 162 .

[0076] The communicator 110 (e.g., a communication interface including a communication circuit) can perform communication with at least one external electronic device, at least one server and / or at least one broadcasting station. The at least one external electronic device can be a counterpart display device 200 and / or an external storage medium, which can be connected through a connection terminal.

[0077] In detail, the communicator 110 may receive data received from various data sources. For example, the communicator 110 may receive a plurality of pieces of content. In detail, the communicator 110 may receive a plurality of image signals corresponding to the plurality of pieces of content, for example, from a broadcast station, an Internet server, and / or a content provider server, respectively. For example, each of the plurality of image signals may include a broadcast stream signal, a transport stream (TS), and / or a video stream signal. Figure 4 The configuration of the communicator 110 is described in detail.

[0078] The display 120 may output an image on a screen. In detail, the display 120 may output an image corresponding to video data through a display panel (not shown) included in the display 120 so that a user can visually recognize the video data. The video data may correspond to a decoded image signal.

[0079] The display 120 may output the video call screen. In addition, the display 120 may output the video call screen in a picture-in-picture (PIP) format through a main screen and a sub-screen having different sizes from each other. The sub-screen may be overlaid on the main screen.

[0080] The display 120 may output images or data processed by the display device 100 .

[0081] The camera 162 may capture images (eg, continuous frames) corresponding to the external environment or the user's motion, including gestures, within a camera recognition range.

[0082] The memory 130 may store a program for processing and control by the processor 140, and may store data input to or output from the display apparatus 100. In addition, the memory 130 may store data necessary for the operation of the display apparatus 100.

[0083] The memory 130 may include at least one type of storage medium from a flash memory type, a hard disk type, a multimedia card micro, a card-type memory (e.g., an SD or XD memory), a random access memory (RAM), a static RAM (SRAM), a read-only memory (ROM), an electrically erasable programmable ROM (EEPROM), a programmable ROM (PROM), a magnetic memory, a magnetic disk, and an optical disk.

[0084] The processor 140 may control the general operation of the display device 100. For example, the processor 140 may execute one or more instructions stored in the memory 130 to perform the functions of the display device 100 described herein. The processor 140 may include one or more processors, and the one or more processors may execute one or more instructions stored in the memory 130 to perform the functions of the display device 100 described herein.

[0085] The processor 140 may store one or more instructions in an internal memory provided in the processor 140, and may execute one or more instructions stored in the internal memory provided in the processor 140 to control the operation of the display device to be performed. That is, the processor 140 may execute at least one instruction or program stored in the internal memory of the processor 140 or the memory 130 to perform a specified operation.

[0086] Processor 140 may execute one or more instructions stored in memory 130 to control camera 162 to capture an image of user 15 for the video calling service.

[0087] The processor 140 may execute one or more instructions stored in the memory 130 to control the communicator 110 to transmit the image of the user 15 captured by the camera 162 to the counterpart display device 200 .

[0088] The processor 140 may execute one or more instructions stored in the memory 130 to control the communicator 110 to receive an image of another user 25 for a video call service.

[0089] The processor 140 may execute one or more instructions stored in the memory 130 to control the display 120 to output an image of another user 25 for a video call service received by the communicator 110 on the main screen of the video call screen, and to output an image of the user 15 obtained by the camera 162 on the sub-screen of the video call screen. However, it is not necessary to display the image of the user 25 on the main screen of the video call screen and to display the image of the user 15 on the sub-screen of the video call screen. The image of the user 15 and the image of the other user 25 may be displayed on two split screens having the same size.

[0090] The processor 140 may execute one or more instructions stored in the memory 130 to identify a transmission area and a gesture recognition area from an image area of ​​an image captured by a camera for a video call.

[0091] The processor 140 may execute one or more instructions stored in the memory 130 to control the communicator to send an image corresponding to the transmission area to the counterpart display device so as to provide a video call service.

[0092] The processor 140 may execute one or more instructions stored in the memory 130 to perform gesture recognition in an image corresponding to the gesture recognition area and execute a function corresponding to the recognized gesture.

[0093] Processor 140 may execute one or more instructions stored in memory 130 to determine a gesture recognition area at a designated location of the image area.

[0094] Processor 140 may execute one or more instructions stored in memory 130 to detect a user's hand in an image region and determine a gesture recognition region based on the region where the hand is detected.

[0095] The processor 140 may execute one or more instructions stored in the memory 130 to provide a user interface for adjusting the gesture recognition area, and adjust the gesture recognition area according to a user input through the user interface.

[0096] The processor 140 can execute one or more instructions stored in the memory 130 to perform gesture recognition according to a specified event while providing a video call service, wherein the specified event may include at least one of the following: a user input selecting the gesture recognition function, or detecting a motion having a value exceeding a threshold in the image area.

[0097] The processor 140 may execute one or more instructions stored in the memory 130 to identify the type of zoom based on that the zoom function is performed while providing the gesture recognition function during providing the video call service, and based on that the zoom function is optical zoom.

[0098] The processor 140 can execute one or more instructions stored in the memory 130 to output a message notifying that the gesture recognition function has been terminated based on the zoom type being identified as optical zoom, and to output an expanded image corresponding to the transmission area based on the zoom type being identified as digital zoom, and to control the communicator to send the expanded image corresponding to the transmission area to the other party's display device for the video call, perform gesture recognition in the image corresponding to the gesture recognition area, and execute a function corresponding to the recognized gesture.

[0099] The processor 140 may execute one or more instructions stored in the memory 130 to switch a normal camera for capturing an image for a video call to a zoom camera for capturing an extended image based on a zoom function being performed while providing a gesture recognition function during providing a video call service.

[0100] The processor 140 may execute one or more instructions stored in the memory 130 to provide a gesture guide that guides one or more gestures and a function corresponding to each gesture so as to guide the user with available gestures.

[0101] The processor 140 may execute one or more instructions stored in the memory 130 to terminate gesture recognition according to a designated event while providing a video call service. The designated event may include at least one of the following: recognition of a gesture for terminating the gesture recognition function, or user input selecting the end of the gesture recognition function.

[0102] Figure 3 A block diagram of a display device 100 according to an embodiment of the present disclosure is shown. Each component of the block diagram may be combined, added, or omitted according to the specification of the display device 100 actually implemented. For example, two or more components may be integrated into one component, or one component may be divided into two or more components as required. In addition, the functions performed in each block are described to explain the disclosed embodiments, and the specific operations or devices thereof do not limit the scope of the disclosed embodiments.

[0103] The counterpart display apparatus 200 may include a communicator 210, a display 220, a memory 230, a camera 262, and a processor 240. However, the counterpart display apparatus 200 may be implemented by including more components than those shown, and is not limited to the described example.

[0104] The communicator 210 may communicate with external devices by using various communication technologies.

[0105] The display 220 may output an image or data processed by the counterpart display device 200 .

[0106] The camera 262 may capture images (eg, continuous frames) corresponding to the external environment or the user's motion including gestures within a camera recognition range.

[0107] The memory 230 may store programs for processing and control by the processor 240 , and may store data input to or output from the counterpart display apparatus 200 .

[0108] The memory 230 may include at least one type of storage medium from among flash memory type, hard disk type, multimedia card micro, card type memory (e.g., SD or XD memory), RAM, SRAM, ROM, EEPROM, PROM, magnetic storage, magnetic disk and optical disk.

[0109] The processor 240 may control general operations of the counterpart display device 200. For example, the processor 240 may execute one or more instructions stored in the memory 230 to perform the functions of the counterpart display device 200 described herein.

[0110] In addition, the processor 240 may store one or more instructions in an internal memory provided in the processor 240, and may execute one or more instructions stored in the internal memory provided in the processor 240 to control the above-mentioned operations to be performed. That is, the processor 240 may execute at least one instruction or program stored in the internal memory of the processor 240 or the memory 230 to perform a specified operation.

[0111] Processor 240 may execute one or more instructions stored in memory 230 to control camera 262 to capture an image of user 25 for the video calling service.

[0112] The processor 240 may execute one or more instructions stored in the memory 230 to control the communicator 210 to transmit the image of the user 25 captured by the camera 262 to the display device 100 .

[0113] The processor 240 may execute one or more instructions stored in the memory 230 to control the communicator 210 to receive the image of the user 15 for the video call service.

[0114] The processor 240 may execute one or more instructions stored in the memory 230 to control the display 220 to output the received image of the user 15 for the video call service on the main screen of the video call screen, and to output the image of another user 25 received through the communicator 210 on the sub-screen of the video call screen. However, it is not required that the image of the user 15 is displayed on the main screen of the video call screen and the image of the other user 25 is displayed on the sub-screen of the video call screen. The image of the user 15 and the image of the other user 25 may be displayed on two screens separated into the same size.

[0115] The other party display device 200 may include all types of devices configured to perform functions by including a processor and a memory. The other party display device 200 may be a fixed or portable device. For example, the other party display device 200 may include various electronic devices, for example, computers such as desktop computers, laptop computers, tablet computers, televisions, set-top boxes, smart phones, cellular phones, game consoles, music players, video players, medical devices and / or home appliances.

[0116] Figure 3 A block diagram of a counterpart display device 200 according to an embodiment of the present disclosure is shown. Each component of the block diagram may be combined, added, or omitted according to the specification of the counterpart display device 200 actually implemented. For example, two or more components may be integrated into one component, or one component may be divided into two or more components as required. In addition, the functions performed in each block are described to explain the disclosed embodiment, and its specific operations or devices do not limit the scope of the disclosed embodiment.

[0117] Figure 4 is a detailed block diagram of a display device according to an embodiment of the present disclosure. Figure 4 The display device 100 shown may correspond to Figure 3 Therefore, when describing the display device 100, the display device 100 is omitted. Figure 3 Same description.

[0118] Reference Figure 4 The display device 100 may include a tuner 105, a communicator 110, a display 120, a video processor 125, a memory 130, a processor 140, an audio input / output 150, a sensor 160, an audio processor 170, an input / output 180, and a user input interface 190.

[0119] The tuner 105 can tune and select only the frequency of a channel to be received by the display device 100 from a plurality of electric wave components by, for example, amplification, mixing and / or resonance. Regarding a broadcast signal received, for example, in a wired or wireless manner. The broadcast signal may include audio data, video data, and additional data (e.g., an electronic program guide (EPG)).

[0120] The tuner 105 can receive a broadcast signal from a frequency band corresponding to a channel number (e.g., cable broadcast channel number 506) according to a control signal received from an external control device (not shown) (e.g., a remote controller), wherein the control signal includes, for example, input of a channel number, input of scrolling up or down channels, and / or input of a channel on an EPG screen.

[0121] The tuner 105 may receive broadcast signals from various sources such as ground wave broadcasting, cable broadcasting, satellite broadcasting, and / or Internet broadcasting. The tuner 105 may receive broadcast signals from sources such as analog broadcasting or digital broadcasting. The broadcast signals received by the tuner 105 may be decoded (e.g., audio decoding, video decoding, or additional data decoding) and divided into audio data, video data, and / or additional data. The divided audio, video, and / or additional data may be stored in the memory 130 according to the control of the processor 140.

[0122] The tuner 105 may be implemented as an integrated type with the display device 100, as an additional device having a tuner electrically connected to the display device 100 (e.g., a set-top box (not shown)), or as a tuner (not shown) connected to the inputter / outputter 180.

[0123] The communicator 110 may perform communication with an external electronic device (not shown) through at least one wired or wireless communication network. The communicator 110 may communicate with the counterpart display device 200. In addition, the communicator 110 may perform communication with a server (e.g., Figure 4 The communicator 110 may communicate with a server 300 shown in FIG. 1 ) for transmitting and receiving designated data to and from the counterpart display apparatus 200. In addition, the communicator 110 may perform communication with, for example, a content providing server and / or an Internet server.

[0124] The communicator 110 can communicate with an external device (e.g., at least one of the counterpart display device 200 or a server (not shown)) through a communication network. In detail, the communicator 110 can be provided in a form including, for example, at least one communication module and / or communication circuit, and can send and receive data to and from the external device through the communication module and / or communication circuit.

[0125] In detail, the communicator 110 may include at least one short-range wireless communication module 111 that performs communication according to a communication standard such as Bluetooth, Wifi, Bluetooth Low Energy (BLE), Near Field Communication (NFC) / Radio Frequency Identification (RFID), Wifi Direct, Ultra Wideband (UWB), or Zigbee.

[0126] In addition, the communicator 110 may further include a remote communication module 112 that performs communication with a server to assist remote communication according to a remote communication standard. In detail, the communicator 110 may include a remote communication module that performs communication through a network for Internet communication. In addition, the communicator 110 may include a communication network according to a communication standard such as 3G, 4G and / or 5G.

[0127] The communicator 110 may perform communication with an external electronic device (not shown) according to the control of the processor 140. The processor 140 may transmit / receive content to / from an external device connected to the processor 140, download an application from the external device, or browse the Web through the communicator 110. In detail, the communicator 110 may access a network and receive content from an external device (not shown).

[0128] The display 120 may display a designated screen. In detail, the display 120 may display a video included in a broadcast signal received through a tuner on a screen according to the control of the processor 140. In addition, the display 120 may display content (e.g., video) input through the communicator 110 or the input / output device 180.

[0129] In addition, the display 120 may output an image stored in the memory 130 according to the control of the processor 140. In addition, the display 120 may display a voice user interface (UI) (e.g., including a voice command guide) for performing a voice recognition task corresponding to voice recognition or a motion UI (e.g., including a user motion guide for motion recognition) for performing a motion recognition task corresponding to motion recognition.

[0130] The video processor 125 may perform image processing on the video data. In detail, the video processor 125 may process the video data, for example, an image signal, received by the display device 100. The video processor 125 may perform various image processing operations on the video data, such as decoding, scaling, noise reduction, frame rate conversion, and / or resolution conversion.

[0131] The memory 130 may store at least one instruction. In addition, the memory 130 may store at least one instruction executed by the processor 140. In addition, the memory 130 may store at least one program executed by the processor 140. In addition, the memory 130 may store an application for providing a designated service. For example, the memory 130 may store a video call application.

[0132] In detail, the memory 130 may include at least one type of storage medium from among flash memory type, hard disk type, micro multimedia card type, card type memory (e.g., SD or XD memory), RAM, SRAM, ROM, EEPROM, PROM, magnetic storage, magnetic disk and optical disk.

[0133] The audio inputter / outputter 150 may output audio that can be acoustically recognized by a user, or may sense and / or receive audio. In detail, the audio inputter / outputter 150 may include an audio outputter 151 and an audio inputter 152 .

[0134] The audio outputter 151 may output audio according to the control of the processor 140 .

[0135] In detail, the audio outputter 151 may output audio (eg, voice or sound) input through the communicator 110 .

[0136] The processor 140 may control the audio outputter 151 to output audio received from the counterpart display device 200 , which is the other party of the video call, during the video call mode.

[0137] The audio outputter 151 may output audio included in a broadcast signal received through the tuner according to the control of the processor 140. The audio outputter 151 may output audio (e.g., voice or sound) input through the communicator 110 or the inputter / outputter 180. In addition, the audio outputter 151 may output audio stored in the memory 130 according to the control of the processor 140.

[0138] The audio outputter 151 may include at least one of a speaker, a headphone output terminal, or a Sony / Philips Digital Interface (S / PDIF) output terminal. The audio outputter 151 may include a combination of a speaker, a headphone output terminal, and a S / PDIF output terminal.

[0139] The audio input 152 may receive audio. In detail, the audio input 152 may include a microphone portion (in detail, a microphone) that receives audio (which is an external audio signal) and processes the audio into electrical sound data. For example, the microphone included in the audio input 152 may receive a sound signal from an external device or a speaker (e.g., a user performing a video call). In addition, the microphone included in the audio input 152 may use various noise removal algorithms to remove noise that occurs in the process of receiving an external sound signal.

[0140] During the video call mode, the audio inputter 152 may receive a sound signal including a user's voice, and remove noise from the received sound signal to process the user's voice to be recognized according to the control of the processor 140 .

[0141] The audio processor 170 may perform processing on the audio data. The audio processor 170 may perform various processing operations on the audio data, such as decoding, amplification, and / or noise reduction. The audio processor 170 may include a plurality of audio processing modules for processing audio data corresponding to a plurality of pieces of content.

[0142] The camera 162 may include an image sensor and may obtain image frames such as still images or videos through the image sensor in a video call mode or a capture mode. The camera 162 may be activated based on the receipt of a video call request. Therefore, the activated camera 162 may perform a capture operation to obtain an image of the user requesting the video call.

[0143] In detail, the camera 162 can obtain image frames based on a specified time interval according to a set number of frames per second (FPS). For example, the camera 162 can obtain 30 image frames per second. Therefore, the first image obtained by the camera 162 can represent each of the image set or images that are continuously obtained and updated.

[0144] The display device 100 may include a camera.

[0145] The display device 100 may include a plurality of cameras arranged at different positions from each other. When the display device 100 includes a plurality of cameras, the display device 100 may select any one of the plurality of cameras for a video call based on its setting or a user input.

[0146] In addition, a camera configured to obtain an image about a user may not be included in the display device 100, but may be provided separately from the display device 100. For example, the camera may be an external camera disposed on a side surface of the display device 100 or disposed adjacent to the display device 100 so as to capture the front side of the display device 100. In this case, the external camera and the display device 100 may be connected to each other by a wired or wireless signal cable, and the external camera may obtain an image about a user of a video call according to the control of the display device 100.

[0147] Hereinafter, for convenience of explanation, it is illustrated and described based on an example in which a camera for obtaining an image of a user regarding a video call is included in the display device 100 .

[0148] The input / output device 180 may receive input data in various formats. The data received by the input / output device 180 may have, for example, an RGBA format and / or a YUV format. In addition, the input / output device 180 may receive a plurality of input data (specifically, image sources) in various formats.

[0149] The input / output 180 may receive video (e.g., moving images), audio (e.g., voice and / or music), and additional data (e.g., EPG) from the outside of the display device 100 according to the control of the processor 140. The input / output 180 may include one of a high-definition multimedia interface (HDMI) port 181, a component jack 182, a PC port 183, and a universal serial bus (USB) port 184. The input / output 180 may include a combination of the HDMI port 181, the component jack 182, the PC port 183, and the USB port 184.

[0150] It can be easily understood by those skilled in the art that the structure and operation of the inputter / outputter 180 can be implemented in various ways.

[0151] The user input interface 190 may receive a user input for controlling the display apparatus 100. For example, the user input interface 190 may receive a video call request from the user.

[0152] The user input interface 190 may include, but is not limited to, a user input device including, for example, a touch panel configured to sense a user's touch, a button configured to receive a user's push manipulation, a scroll wheel configured to receive a user's rotation manipulation, a keyboard and / or a dome switch.

[0153] In addition, the user input interface 190 may be a voice recognition device for voice recognition, and may include, for example, a microphone, and the voice recognition device may receive a user's voice command or voice request. Therefore, the processor 140 may control an operation corresponding to the voice command or voice request to be performed.

[0154] In addition, the user input interface 190 may include a motion sensing sensor (not shown). For example, the motion sensing sensor may sense the motion of the display device 100 and receive the sensed motion as a user input. In addition, the above-mentioned voice recognition device (e.g., microphone) and the motion sensing sensor may not be included in the user input interface 190. Instead, the voice recognition device and the motion sensing sensor may be included in the display device 100 as a module separate from the user input interface 190.

[0155] In addition, the user input interface 190 can receive user input through, for example, a remote controller. In this case, the user input interface 190 may include a communication module for receiving a signal corresponding to the user input from the remote controller. For example, when the remote controller sends an infrared (IR) signal corresponding to the user input, the user input interface 190 may include an optical receiving module capable of receiving the IR signal.

[0156] The sensor 160 may sense a user's voice, image, or interaction.

[0157] The microphone 161 may receive a user's voice utterance. The microphone 161 may convert the received voice into an electrical signal, and may output the electrical signal through the processor 140. The user's voice may include, for example, a voice corresponding to a menu or function of the display device 100. For example, a recommended recognition range of the microphone 161 may be within about 4 m from the microphone 161 to the user's position, and the recognition range of the microphone 161 may be changed based on the volume of the user's voice or the surrounding environment (e.g., speaker sound and / or ambient noise).

[0158] The microphone 161 may be implemented as an integrated type or a separate type with respect to the display device 100. The separate type microphone 161 may be electrically connected to the display device 100 through the communicator 110 or the inputter / outputter 180.

[0159] It may be easily understood by those skilled in the art that the microphone 161 may be excluded depending on the performance and structure of the display device 100 .

[0160] The camera 162 may receive images (e.g., continuous frames) corresponding to the motion of the user including gestures within the camera recognition range. For example, the recognition range of the camera 162 may correspond to 0.1 m to about 5 m from the camera 162 to the user. The motion of the user may include, for example, a body part of the user, such as the user's face, expression, hand, fist and / or finger, or the motion of a body part of the user. The camera 162 may convert the received image into an electrical signal and output the electrical signal to the processor 140 according to the control of the processor 140.

[0161] The camera 162 may include a lens and an image sensor. The camera 162 may support optical zoom or digital zoom by using multiple lenses and image processing. The recognition range of the camera 162 may be set differently according to the angle of the camera and the conditions of the surrounding environment. When the camera 162 includes multiple cameras, a three-dimensional still image or a three-dimensional motion may be received by using multiple cameras. The camera 162 may include two or more cameras, including a normal camera and a zoom camera.

[0162] The camera 162 may be implemented as an integrated type or a separate type with respect to the display apparatus 100. An additional device (not shown) including the separate type camera 162 may be electrically connected to the display apparatus 100 through the communicator 110 or the inputter / outputter 180.

[0163] It may be easily understood by those skilled in the art that the camera 162 may be excluded depending on the performance and structure of the display device 100 .

[0164] The optical receiver 163 may receive an optical signal (including a control signal) from an external controller through an optical window (not shown) of a frame of the display 120. The optical receiver 163 may receive an optical signal corresponding to a user input (e.g., a touch input, a press input, a touch gesture, a voice, or a motion) from the controller. The control signal may be extracted from the received optical signal according to the control of the processor 140.

[0165] The processor 140 may control the general operation of the display device 100, control the signal flow between the built-in components (not shown) of the display device 100, and process data. When there is a user input or a specified and stored condition is met, the processor 140 may execute an operating system (OS) or various applications stored in the memory 130.

[0166] The processor may include a graphics processing unit (GPU) (not shown) for processing graphics data corresponding to the video data. The GPU may generate a screen including various objects (such as icons, images, and / or text) by using a calculator (not shown) and a renderer (not shown). The calculator may use the user interaction sensed by the sensor to calculate the attribute value of each object, such as coordinate value, shape, size, and / or color, and display the object according to the layout of the screen via these attribute values. The renderer may generate a screen including various layouts of the object based on the attribute value calculated by the calculator. The screen generated by the renderer may be displayed in the display area of ​​the display 120.

[0167] The server 300 may communicate with the display apparatus 100 and the counterpart display apparatus 200 through a wireless communication network.

[0168] For example, the server 300 may provide a video call or a video call service or support communications required for a video call service. For example, the display device 100 and the counterpart display device 200 may be connected to each other via a mobile communication network such as 3G, 4G, and / or 5G, and a video call may be performed between the display device 100 and the counterpart display device 200. In this case, the server 300 may be a communication server supporting mobile communications according to a communication standard such as 3G, 4G, and / or 5G.

[0169] In addition, the display device 100 and the counterpart display device 200 can be connected to each other through an Internet communication network. In addition, the display device 100 and the counterpart display device 200 can perform a video call through an application that provides a video call service in the display device. Then, the display device 100 and the counterpart display device 200 can perform a video call with each other through the application. In this case, the server 300 can support the application that provides the video call service. Specifically, the server 300 can be a server of a user who manufactures and / or distributes the application.

[0170] As described above, through the communication relay of the server 300, the operations required to perform the above-mentioned video call can be performed. Figure 3 The communication relay operation of the server 300 is not shown in the figure, but the communication relay operation of the server 300 may include sending and receiving data or signals between two different devices. Specifically, the server 300 may be responsible for sending data or signals to support the execution of the video call service.

[0171] For example, the server 300 may perform a relay operation of transmitting a user image signal generated from the display device 100 to the counterpart display device 200. In addition, the server 300 may transmit or deliver various data and signals for performing a video call service to the display device 100 and the counterpart display device 200.

[0172] In the following, the description of specifying data or signals being sent from one device (e.g., display device 100) to another device (e.g., counterpart display device 200) may not only indicate that the specified data or signals are sent directly from one device (e.g., display device 100) to another device (e.g., counterpart display device 200), but may also indicate that the specified data or signals are sent from one device (e.g., display device 100) to another device (e.g., counterpart display device 200) through the communication relay of server 300.

[0173] In the following, reference is made to Figures 5 to 15 Operations performed by the display apparatus 100 are described in detail.

[0174] Figure 5 is a flow chart of an operating method of a display device according to an embodiment of the present disclosure. Figure 5 The illustrated operating method of the display device indicates sequential operations performed by the display device 100 .

[0175] In operation 510 , the display apparatus 100 may identify a transmission area and a non-transmission area in an image area of ​​an image for a video call captured by a camera.

[0176] The display device 100 can perform a video call function with the other party's display device 200. Specifically, when any one of the display device 100 and the other party's display device 200 requests a video call and the video call request is accepted, the video call function can be performed. The video call request can be based on a user input received through a user interface. For example, the user of the display device 100 may want to make a video call with a friend. Then, the user can input a user input requesting a video call through the user interface of the display device 100. Then, the processor 140 can recognize that a video call request has been received based on the user input. Alternatively, the video call request can be received by the display device of the other party who wants to make a video call with the user of the display device 100. That is, the video call request can be received based on a request from at least one of the user of the display device 100 or other users of the other party's display device 200.

[0177] According to the execution of the video call function, the display device 100 can capture the image of the user of the display device 100 and send the user's image to the counterpart display device 200, and the display device 100 can receive the image of the other party from the counterpart display device 200 which is the other party of the video call partner.

[0178] When the display device 100 performs the video call function, the display device 100 may display the image of the other party and the image of the user received from the counterpart display device 200 on the display. For example, the display device 100 may display the image of the other party on the main screen and the image of the user on the sub-screen. Alternatively, the display device 100 may display the image of the other party and the image of the user on screens of the same size.

[0179] The display device 100 may capture an image of the user for a video call screen by using a camera. The display device 100 may identify a transmission area and a non-transmission area in an image area of ​​the image for the video call captured by the camera. The transmission area refers to an area identified for transmission to the other party's display device 200, and may mainly include an upper body part including the user's face. The non-transmission area may be an area other than the transmission area for transmission to the counterpart display device in the image area of ​​the image for the video call captured by the camera.

[0180] The display device 100 may identify a transmission area and a non-transmission area in a designated position of an image area of ​​an image for a video call captured by a camera. For example, the image area of ​​an image for a video call captured by a camera may include an upper body portion including the face of the user. The display device 100 may empirically predetermine the position of a portion of the image area including the face of the user, and may identify a transmission area in the designated position, and identify an area of ​​the image area other than the transmission area as a non-transmission area.

[0181] The display device 100 may detect a face in an image area of ​​an image for a video call captured by a camera, and may identify a transmission area and a non-transmission area based on the area where the face is detected. For example, the display device 100 may detect the user's face in the image area by using various object detection techniques, and may identify the area where the face is detected or an area including some areas around the area where the face is detected as a transmission area, and identify the area of ​​the image area other than the transmission area as a non-transmission area. The various object detection techniques may include, for example, a rule-based object detection technique or an artificial intelligence (AI)-based object detection technique.

[0182] The display device 100 may detect a hand in an image area of ​​an image for a video call captured by a camera, and may identify a transmission area and a non-transmission area based on the area where the hand is detected. For example, the display device 100 may detect the user's hand in the image area by using various object detection techniques, and may identify the area where the hand is detected or an area including some areas around the area where the hand is detected as a transmission area, and identify areas of the image area other than the transmission area as a non-transmission area. The various object detection techniques may include, for example, rule-based object detection techniques or AI-based object detection techniques.

[0183] In operation 520, the display device 100 may transmit an image corresponding to the transmission area to the counterpart display device 200 in order to provide a video call service.

[0184] In detail, the display device 100 may control the communicator to transmit an image corresponding to the transmission area to the counterpart display device 200. As described above, the transmission area may be identified based on a face-based area in an image captured to provide a video call service, or the transmission area may be identified to exclude a hand that may make a gesture, and the image corresponding to the transmission area may be transmitted to the counterpart display device 200. Therefore, it is possible to prevent the user's gesture from being shown on the video call screen on the display of the counterpart display device 200.

[0185] In operation 530 , the display apparatus 100 may perform gesture recognition in an image corresponding to the gesture recognition area which is at least a part of the non-transmission area, and may execute a function corresponding to the recognized gesture.

[0186] The display device 100 may determine at least a portion of the non-transmission area as the gesture recognition area. The display device 100 may determine the entire non-transmission area as the gesture recognition area.

[0187] The display device 100 may determine a gesture recognition area at a designated position of the non-transmission area.

[0188] The display device 100 can detect the user's hand in the non-transmission area by using various object detection technologies, and can determine the area where the hand is detected or an area including some areas around the area where the hand is detected as a gesture recognition area. The various object detection technologies may include, for example, rule-based or AI-based object detection technologies.

[0189] The display device 100 may perform a gesture recognition operation in the determined gesture recognition area. Gesture recognition may refer to an operation performed by the display device 100 to recognize and identify a specified motion performed by a user by analyzing an acquired image. The display device 100 may perform a gesture recognition operation by preprocessing an image corresponding to the gesture recognition area to find an attribute, measuring similarity by comparing a motion recognized based on an attribute with each gesture stored in a gesture database, and identifying a gesture whose similarity value relative to the compared gesture of the database is measured to be greater than a threshold value.

[0190] The display apparatus 100 may perform a function corresponding to the gesture determined through the gesture recognition operation.

[0191] The display device 100 may perform a designated function corresponding to a gesture determined by the gesture recognition operation. The designated function may include one or more functions for controlling a video call function or one or more functions for controlling the display device as a whole. For example, a gesture may include a gesture corresponding to the number of fingers spread out. For example, a gesture may include a gesture of spreading one finger, a gesture of spreading two fingers, a gesture of spreading three fingers, a gesture of spreading four fingers, and a gesture of spreading five fingers. A gesture may include a gesture of making an OK sign by connecting the thumb with the end of the index finger. Alternatively, a gesture may include a gesture of making an X shape by using two fingers. A gesture may include a gesture of directly using the movement of the hand. A gesture may include a gesture of clenching one's fist, a gesture of moving the hand vertically, and a gesture of moving the hand horizontally.

[0192] The function mapped to each gesture may be determined differently. For example, the function mapped to each gesture may include a function of controlling a video call or a function of generally controlling a display device. The function of controlling a video call function may include various functions, such as ending a video call, setting a mute, switching a video call to a voice call, expanding a video call screen, and / or reducing a video call screen. The function of generally controlling a display device may include, for example, increasing the volume.

[0193] As described above, when the gesture recognition function is used while performing a video call, the image sent to and displayed on the other party's display device 200 may not show the user's gesture, and therefore, the user making the gesture or other users may not be interrupted by the user's gesture action and may focus on the video call.

[0194] Figure 6 is a reference diagram for describing a method of recognizing a transmission area in an image capturing a user for a video call.

[0195] refer to Figure 6 , the display device 100 can identify a transmission area 610 and a non-transmission area 620 in the image 600 capturing the user for the video call. The transmission area 610 refers to an area to be sent to the counterpart display device 200 for the video call screen, and the non-transmission area 620 refers to an area including an area on which the user's gesture recognition is to be performed.

[0196] The display device 100 can identify the transmission area 610 and the non-transmission area 620 in the image 600 of the user captured for the video call according to various methods. The user who performs the video call can, for example, sit on a chair in front of the display device 100 so that the camera of the display device 100 can shoot the user, and therefore, in many cases, the camera can capture an upper body image above the waist of the user. Therefore, in general, the image 600 of the user captured for the video call may include the upper body of the user. Based on the empirical data, the display device 100 can identify some upper percentage points (e.g., the upper 60 percentage points) of the user's image 600 as the transmission area 610, and the rest can be identified as the non-transmission area 620. Alternatively, the display device 100 can identify some lower percentage points (e.g., the lower 30 percentage points) of the user's image 600 as the non-transmission area 620.

[0197] The display apparatus 100 may determine a gesture recognition area 621 in a non-transmission area 620 identified in an image 600 capturing a user for a video call.

[0198] For example, the display device 100 may determine the entire non-transmission area 620 as the gesture recognition area 621 .

[0199] For example, the display device 100 may determine some parts of the non-transmission area 620 as the gesture recognition area 621. For example, the display device 100 may determine a part of the non-transmission area 620 as the gesture recognition area 621, which part is expected to be where the user's hand is located.

[0200] The display device 100 may directly perform an operation of detecting a user's hand in the image 600 capturing the user for the video call, and may determine a portion where the user's hand is detected as a gesture recognition area 621 .

[0201] Figure 7 is a reference diagram for describing an operation method performed by a display device using a transmission area and a gesture recognition area recognized in an image capturing a user for a video call function.

[0202] Reference Figure 7 , the display device 100 may transmit an image corresponding to the transmission area 610 identified in the image 600 of the user captured by using the camera to the counterpart display device 200 via the communicator. Then, the counterpart display device 200 may display on the display an image corresponding to the transmission area 610 received from the display device 100. The counterpart display device 200 may output an image 611 of another user who is a user of the counterpart display device 200 on a portion of the display.

[0203] The display device 100 may perform a gesture recognition operation by using an image corresponding to the gesture recognition area 621 recognized in the image 600 of the user, and may control the display device 100 according to a function corresponding to the gesture recognized by the gesture recognition operation. The display device 100 may output an image 710 of another user received from the counterpart display device 200 on the display. In addition, the display device 100 may output an image 711 of the user of the display device 100 on a portion of the display. In addition, in order to show the user of the display device 100 that the user's hand is within the gesture recognition area 712, or to guide the user so that the user's hand for gesture recognition does not deviate from the gesture recognition area 712, the display device 100 may provide a visual effect such as a boundary line in the gesture recognition area 712.

[0204] Figure 8 is a reference diagram for describing an example of a method of determining a gesture recognition area according to an embodiment of the present disclosure.

[0205] refer to Figure 8 , the display apparatus 100 may identify a gesture recognition area 621 in a designated position of an image 600 of a user for a video call captured by using a camera.

[0206] For example, the display device 100 may identify an area in the image 600 of the user, which is a specified distance h from the lower end of the image 600 of the user, as the gesture recognition area 621 .

[0207] For example, the display device 100 may identify some lower percentage points (eg, lower 40 percentage points) of the user's image 600 as the gesture recognition area 621 .

[0208] Fig. 9 is a reference diagram for describing an example of a method of determining a gesture recognition area according to detection of a hand according to an embodiment of the present disclosure.

[0209] refer to Fig. 9 , the display device 100 may recognize the gesture recognition area 621 by detecting a hand in the image 600 of the user for the video call captured by using the camera.

[0210] Generally, the user may make a gesture by using a part of a hand or an arm, and thus the display device 100 may recognize the gesture recognition area 621 by detecting at least one of the hand or the arm of the user in the image 600 of the user.

[0211] The display device 100 can obtain the hand detection area 910 by detecting the user's hand in the user's image 600 using the object detection technology. When the user makes a gesture by using the hand, the hand can move substantially a specified distance from the detected position in the upward and downward directions or in the right and left directions, and therefore, by considering the distance that the hand can move, for example, the hand detection area 910 can be expanded horizontally or vertically to determine the gesture recognition area. For example, the display device 100 can determine the gesture recognition area 911 by expanding the hand detection area 910 horizontally by a distance v1 and vertically by a height h1.

[0212] The display apparatus 100 may recognize the transmission area by detecting a face in the image 600 of the user for the video call captured by using the camera.

[0213] The display device 100 may obtain the face detection area 920 by detecting the user's face in the user's image 600 using an object detection technique. For example, the display device 100 may determine the gesture recognition area 921 by extending the face detection area 920 horizontally by a distance v2 and vertically by a height h2.

[0214] Fig.10 is a reference diagram for describing a method of adjusting a gesture recognition area according to an embodiment of the present disclosure.

[0215] refer to Fig.10, the display device 100 may determine a gesture recognition area 1010 in the image 600 capturing the user for the video call. In addition, the display device 100 may provide a user input interface for receiving a user input for adjusting the gesture recognition area 1010 determined as described above. The gesture recognition area initially determined may be considered by the user to be too wide or too narrow to make a gesture, and therefore, a user interface may be provided to adjust the gesture recognition area 1010. For example, the display device 100 may provide the gesture recognition area 1010 to be adjusted by expanding or reducing the gesture recognition area 1010 using the cursor 1000, and when the user inputs a user input for adjusting the gesture recognition area 1010 using the cursor 1000, the display device 100 may adjust the gesture recognition area 1010 to expand or reduce according to the user input.

[0216] Fig.11 is an example of a flowchart of a method performed by a display device for performing an operation corresponding to a zoom input while the display device provides a video call service and a gesture recognition function according to an embodiment of the present disclosure.

[0217] refer to Fig.11 , operations 1110 to 1130 and Figure 5 Operations 510 to 530 are the same, so their description is omitted.

[0218] In operation 1140 , the display apparatus 100 may receive a user input requesting execution of a zoom function.

[0219] Zoom-in refers to displaying an image by expanding the image, and may include optical zoom-in and digital zoom-in.

[0220] The display device 100 may perform a zoom function according to a user input requesting the zoom function. The user may input a zoom command by using various user interfaces for requesting the zoom function, or may input a zoom command by making a gesture corresponding to the zoom function using a gesture recognition function.

[0221] In operation 1150 , the display device 100 may identify a zoom type in order to perform a zoom function.

[0222] Zoom can include optical zoom processed optically and digital zoom processed by software.

[0223] Zooming using optical zoom refers to a capturing method according to which a zoom lens for continuously changing the focal length by moving a part of the optical system in the optical axis direction is used, and by adjusting the focal length of the zoom lens, a subject can be photographed so that it appears as if the zoom lens is close to the subject. According to this method, by adjusting the focal length of the lens, the subject can be expanded per frame.

[0224] Digital zoom refers to a capturing method according to which captured image data can be displayed by expanding a portion of a screen showing the captured image data based on a digital processing method to obtain a zoom effect. According to this method, the zoom effect can be conveniently obtained in a software manner without changing the hardware of the lens, but because only limited data of the entire screen is displayed for expansion, image quality may be deteriorated.

[0225] The display device 100 may determine which zoom type the display device 100 is to perform, and based on the determination, when the determined zoom type is optical zoom, the display device 100 may proceed to operation 1160, and when the determined zoom type is digital zoom, the display device 100 may proceed to operation 1170.

[0226] In operation 1160 , when the zoom type is the optical zoom, the display apparatus 100 may obtain an image of the expanded user by controlling the zoom lens to adjust the focal length, and may transmit the obtained image to the counterpart display apparatus 200 .

[0227] In operation 1170, the display apparatus 100 may output a message notifying that the gesture recognition function has been terminated. Fig.12 , operations 1160 and 1170 are described.

[0228] Fig.12 is a reference diagram for describing an operation method of a data processing apparatus when a zoom type is an optical zoom according to an embodiment of the present disclosure.

[0229] refer to Fig.12 , while the display device 100 performs a video call function, the display device 100 may capture an image 1200 of a user by using a camera. While performing the capture, the display device 100 may identify the zoom type according to a user input requesting zoom, and when the zoom type is optical zoom, the display device 100 may adjust the focal length of the zoom lens so that the user as an object may be expanded per frame. Therefore, the display device 100 may obtain an image 1211 of the user in which the user's appearance is expanded. When the zoom function is performed as described above, the user's appearance is expanded in a limited frame, and therefore, the image 1211 may not include the user's hand. Therefore, the display device 100 may not detect the gesture recognition area in the expanded image 1211.

[0230] It may be difficult for the display device 100 to recognize the gesture recognition area in the extended image 1211 alone, and therefore, the display device 100 may not recognize the transmission area or the non-transmission area in the extended image 1211, and may directly transmit the extended image 1211 to the counterpart display device 200 of the video call. The counterpart display device 200 may output the extended image 1211, which is received from the display device 100, on the display.

[0231] Since it may be difficult for the display device 100 to recognize the gesture recognition area in the extended image 1211 individually, the display device 100 may not perform gesture recognition. Therefore, the display device 100 may determine that it is impossible to perform gesture recognition, and in order to notify the user of it, a notification for notifying that the gesture recognition function has been terminated may be output on the display. For example, the display device 100 may output a message 1020 of <gesture recognition function terminated>.

[0232] For example, even when zooming is performed based on optical zoom, the user's hand may be included in the extended image according to the degree of zoom. Therefore, when the value of zoom exceeds a specified threshold (i.e., a threshold at or below which the user's hand may be included in the extended image), that is, when the user's hand may not be seen in the extended image according to the zoom, the display device 100 may perform Fig.11 Operations 1160 and 1170. In contrast, when the value of the zoom does not exceed a specified threshold (i.e., a threshold at or below which the user's hand can be included in the extended image), that is, when the user's hand can be seen in the extended image according to the zoom, the display device 100 may perform the gesture recognition function as described in operations 1110 to 1130.

[0233] Reference again Fig.11 , in operation 1150 , when the display apparatus 100 determines the zoom type as the digital zoom, the display apparatus 100 may proceed to operation 1170 .

[0234] In operation 1170, the display device 100 may expand the image captured by the camera for the video call, and transmit the expanded image to the corresponding display device 200. In the case of digital zoom, the image of the user may not be optically expanded by using a lens, but the captured image may be processed based on a software method for expansion. The display device 100 may expand the entire captured image based on a software method, and may transmit the expanded image to the corresponding display device 200. The display device 100 may expand the transmission area in the captured image based on a software method, and may transmit the expanded image to the corresponding display device 200.

[0235] In operation 1180 , the display apparatus 100 may perform gesture recognition in an image corresponding to the gesture recognition area which is at least a portion of the non-transmission area, and may execute a function corresponding to the recognized gesture.

[0236] Digital zoom refers to a method of processing an image captured by a camera based on a software method, and therefore, an image captured by the camera after performing digital zoom may be the same as an image captured by the camera before performing digital zoom. Therefore, the display device 100 may perform gesture recognition in an image corresponding to a gesture recognition area that is at least a portion of a non-transmission area in an image captured by the camera, and may perform a function corresponding to the recognized gesture. Reference Fig.13 , operations 1180 and 1190 are described.

[0237] Fig.13 is a reference diagram for describing an operation method of a data processing device when a zoom type is a digital zoom according to an embodiment of the present disclosure.

[0238] refer to Fig.13 , the display device 100 may capture the user's image 1300 by using a camera while performing a video call function. While performing the capture, the display device 100 may identify the zoom type according to the user input requesting the zoom, and when the zoom type is the digital zoom, the display device 100 may expand the image corresponding to the transmission area 1301 in the user's image 1300 based on a software method to obtain an extended image 1311. In the case of digital zoom, a zoom lens is not used, and software processing is performed, so the user's image 1300 captured by the camera may be the same as the image captured by the camera before the digital zoom is performed. In addition, the display device 100 may send the extended image 1311 to the counterpart display device 200 so that the extended image 1311 based on the digital zoom may be displayed on the display of the counterpart display device 200. However, the extended image 1131 based on the digital zoom is obtained by simply expanding the size of the frame of a part of the user's captured image 1300, and therefore, the resolution of the extended image 1311 may be greatly reduced compared to the resolution of the original image 1300 before the expansion.

[0239] Furthermore, the display device 100 may recognize a gesture recognition area 1302 in the image 1300 of the user, and may perform gesture recognition for an image corresponding to the recognized gesture recognition area 1302. Furthermore, the display device 100 may perform a function corresponding to a gesture recognized as a result of the gesture recognition.

[0240] Fig.14 is a reference diagram for describing an operation method of a display device when the display device includes two cameras according to an embodiment of the present disclosure.

[0241] Reference Fig.14 , the display device 100 may include two cameras, ie, a normal camera 162a without a zoom lens and a zoom camera 162b including a zoom lens.

[0242] The display device 100 can obtain the user's image 1400 for providing a video call service by capturing the user using the general camera 162a. The display device 100 can transmit an image 1410 corresponding to the transmission area recognized in the user's image 1400 to the counterpart display device 200 for display on the video call screen, and can perform gesture recognition on an image 1420 corresponding to the gesture recognition area recognized in the user's image 1400 to recognize a gesture and execute a function corresponding to the recognized gesture.

[0243] When the display device 100 operates as described above, the display device 100 may receive a user input requesting zooming. In this case, the display device 100 may not only continue to shoot the user by using the normal camera 162a, but also shoot the user by using the zoom camera 162b. The zoom camera 162b may adjust the focal length of the zoom lens, and thus, an image 1430 in which the user as the object is expanded may be obtained. Therefore, the display device 100 may send the expanded image 143 obtained by the zoom camera 162b to the other party's display device 200 in response to the user's request to perform zooming. In addition, according to the gesture recognition operation, a gesture recognition area may be identified in the image 1400 of the user obtained by the normal camera 162a, gesture recognition may be performed on the image 1420 corresponding to the identified gesture recognition area to recognize the gesture, and a function corresponding to the recognized gesture may be performed.

[0244] As described above, when the display device 100 includes two cameras (i.e., a normal camera and a zoom camera), and when the display device 100 provides a video call service and also provides a gesture recognition function, even when the display device 100 performs zooming according to a user input requesting to perform zooming, the display device 100 may not degrade the quality of the image sent to the user of the other display device 200, and may also provide a gesture recognition function.

[0245] Fig.15 An example of a user interface of a display device capable of providing a gesture recognition function while providing a video call service according to an embodiment of the present disclosure is shown.

[0246] Reference Fig.15 , the display device 100 may display an image 1530 of another user received from the counterpart display device 200 on a main screen of the display, and may display an image 1540 of the user captured by a camera of the display device 100 on a sub-screen of the display.

[0247] In addition, the display device 100 may provide a user interface 1520 for controlling a video call function while providing a video call service. The user interface 1520 for controlling the video call function may include a mute icon 1521 , a voice call icon 1522 , and a video call icon 1523 .

[0248] In addition, when the display device 100 provides a gesture recognition function, the display device 100 may display a gesture guide 1510 for guiding the user with available gestures and their corresponding functions. The gesture guide 1510 may include information about one or more gestures available in the gesture recognition function of the display device 100 and the function corresponding to each gesture. Fig.15 The posture guide 1510 may provide the following guidance: a first function is provided corresponding to a first posture, a second function is provided corresponding to a second posture, and a third function is provided corresponding to a third posture.

[0249] The gestures available in the gesture recognition function may include various gestures. In detail, the gestures may include, for example, gestures using hands, gestures using fingers, and / or gestures using hands and arms. For example, the gestures may include various gestures such as a waving gesture, a clenched fist gesture, a gesture of moving hands in the upward and downward directions, a gesture of moving hands in the right and left directions, a gesture of spreading one finger, a gesture of spreading two fingers, a gesture of spreading three fingers, a gesture of spreading four fingers, a gesture of spreading five fingers, a gesture of making an X shape using two fingers, and / or a gesture of making an OK sign using the thumb and index finger.

[0250] The functions mapped to each gesture may include, for example, a function to control a video call function and / or a function to generally control a display device. The function to control a video call function may include a mute function, a function to switch a video call to a voice call, a function to switch a voice call to a video call, a function to hide the user's image, a zoom-in function, and / or a zoom-out function. The function to generally control a display device may include, for example, a function to adjust the volume of the display device.

[0251] When the display device 100 provides a video call service and the display device 100 does not perform a gesture recognition function, the display device 100 may not need to identify the transmission area and the gesture recognition area in the image of the user captured by using the camera. Therefore, in this case, the display device 100 may directly transmit the image captured by using the camera to the counterpart display device 200.

[0252] When the display device 100 provides a video call service, the display device 100 may not perform the gesture recognition function, and then may receive a user input requesting the execution of the gesture recognition function. According to the user input requesting the execution of the gesture recognition function, the display device 100 may perform the operation described above in this specification, including the operation of identifying the transmission area and the gesture recognition area in the image of the user captured by using the camera.

[0253] As described above, when a gesture recognition function is provided while providing a video call service, an image can be processed and output so that a video call between users is not interrupted by the user's gesture, and thus user satisfaction and user convenience can be increased.

[0254] The operating method of the display device can be implemented as a program command, which can be executed by various computer devices and can be recorded on a computer-readable medium. In addition, one or more programs including instructions for executing the operating method of the display device can be recorded on a computer-readable recording medium.

[0255] The computer readable medium may include, for example, each of a program command, a data file and / or a data structure, etc., individually, or may include a combination thereof. The program command recorded on the computer readable medium may be specially designed and constructed, or may be known and usable by a person of ordinary skill in the field of computer software. Examples of computer readable recording media include magnetic media (such as hard disks, floppy disks, and magnetic tapes), optical media (such as compact disk read-only memories (CD-ROMs) and digital versatile disks (DVDs)), magneto-optical media (such as optical magnetic floppy disks), and hardware devices (such as ROMs, RAMs, and flash memories) that are specially configured to store and execute program commands. Examples of program commands include high-level language codes that can be executed by a computer using, for example, an interpreter, and machine language codes generated by a compiler.

[0256] The machine-readable storage medium may be provided in the form of a non-transitory storage medium. "Non-transitory storage medium" may simply indicate that the medium is a tangible device, rather than a signal (e.g., electromagnetic waves), and does not distinguish between semi-permanent storage of data in the storage medium and temporary storage of data in the storage medium. For example, a "non-transitory storage medium" may include a buffer that temporarily stores data.

[0257] The operating method of the display device described in this specification may be provided to include a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a storage medium (e.g., a compact disc read-only memory (CD-ROM)), or distributed directly online (e.g., downloaded or uploaded) through an application store (e.g., Play Store TM) or distributed between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product (e.g., a downloadable application) may be at least temporarily stored in a machine-readable storage medium (such as a memory of a manufacturer's server, an application store's server, or a relay server), or may be temporarily generated.

[0258] In particular, the method for operating the display device may be implemented as a computer program product including a recording medium having a program for executing the method for operating the display device stored thereon.

[0259] Although the embodiments are described in detail above, the scope of the claims is not limited thereto, and various modifications and changes made by a person of ordinary skill in the art using the basic concept defined by the appended claims are also included in the scope of the claims.

Claims

1. A display device (100), comprising: Display (120); Communicator(110); A memory (130) storing one or more instructions; as well as at least one processor (140) configured to execute the one or more instructions, Wherein, the at least one processor (140) is configured to execute the one or more instructions to: identifying a transmission area and a gesture recognition area in an image area of ​​a first image captured by a camera for a video call; Controlling the communicator (110) to send a second image corresponding to the transmission area to a display device of a counterpart participating in the video call, so as to provide a video call service; performing gesture recognition in a third image corresponding to the gesture recognition area; and A function corresponding to the recognized gesture from the gesture recognition in the third image is performed.

2. The display device according to claim 1, wherein: The at least one processor (140) is configured to execute the one or more instructions to identify the gesture recognition area by detecting the gesture recognition area at a designated location of the image area.

3. The display device according to claim 1, wherein: The at least one processor (140) is configured to execute the one or more instructions to identify the gesture recognition area by: detecting a user's hand in the image region; as well as The gesture recognition area is determined based on the area where the hand is detected.

4. The display device according to any one of claims 1 to 3, wherein: The at least one processor (140) is further configured to execute the one or more instructions to: providing a user interface on the display to adjust the gesture recognition area; as well as The gesture recognition area is adjusted based on user input received through the user interface.

5. The display device according to any one of claims 1 to 4, in, The at least one processor (140) is configured to execute the one or more instructions to perform the gesture recognition in the third image by performing the gesture recognition according to a specified event while the video call service is being provided, and The designated event includes at least one of the following: a user input selecting the gesture recognition function, or a motion exceeding a threshold is detected in the image area.

6. The display device according to any one of claims 1 to 5, wherein: The at least one processor (140) is further configured to execute the one or more instructions to identify a category of the zoom function based on the zoom function being performed when the gesture recognition function is provided while the video call service is being provided.

7. The display device according to claim 6, wherein: The at least one processor (140) is further configured to execute the one or more instructions to: outputting a message indicating that the gesture recognition function has been terminated to the display based on the category of the zoom function being identified as optical zoom, and based on said category of said zoom function being identified as digital zoom, expanding the second image corresponding to the transmission area, and controlling the communicator to send the expanded second image to the counterpart display device participating in the video call, performing the gesture recognition in the third image corresponding to the gesture recognition area, and The function corresponding to the recognized gesture from the gesture recognition in the third image is performed.

8. The display device according to any one of claims 1 to 7, in, The camera (162) includes a non-zoom camera and a zoom camera, and The at least one processor (140) is further configured to execute the one or more instructions to switch the non-zoom camera for capturing the first image for the video call to the zoom camera for capturing the expanded first image based on the zoom function being executed when the gesture recognition function is provided while the video call service is being provided.

9. The display device according to any one of claims 1 to 8, wherein: The at least one processor (140) is further configured to execute the one or more instructions to provide gesture guidance, the gesture guidance providing one or more gestures and functions corresponding to each of the one or more gestures to guide the user with available gestures.

10. A method for operating a display device (100), the method comprising: identifying a transmission area and a gesture recognition area in an image area of ​​a first image captured by a camera for a video call; sending a second image corresponding to the transmission area to a display device of a counterpart participating in the video call, so as to provide a video call service; performing gesture recognition in a third image corresponding to the gesture recognition area; as well as A function corresponding to the recognized gesture from the gesture recognition in the third image is performed.

11. The operating method according to claim 10, wherein: Identifying the gesture recognition area includes identifying the gesture recognition area at a designated location in the image area.

12. The operating method according to claim 10, wherein: Identifying the gesture recognition area includes: detecting a user's hand in the image region; and The gesture recognition area is determined based on the area where the hand is detected.

13. The operating method according to any one of claims 10 to 12, further comprising: providing a user interface on the display to adjust the gesture recognition area; as well as The gesture recognition area is adjusted based on user input received through the user interface.

14. The operating method according to any one of claims 10 to 13, in, The performing of the gesture recognition in the third image includes: performing the gesture recognition according to a designated event while the video call service is being provided, and The designated event includes at least one of the following: a user input selecting the gesture recognition function, or a motion exceeding a threshold is detected in the image area. 15 . A computer-readable recording medium which can be read by one or more computers and stores a program for executing the method according to claim 10 .

Images