Display device and method for operating the same

Abstract

A display device and an operation method thereof are disclosed. The display device includes: a display; a network interface configured to wirelessly communicate with a camera device or a server; an external device interface configured to communicate with the camera device through High-Definition Multimedia Interface-Consumer Electronics Control (HDMI-CEC); and a controller configured to display, on the display, a camera service list including a plurality of camera service items respectively corresponding to a plurality of camera service applications when connected to the camera device, send an execution request of a camera service application corresponding to a selected camera service item to the camera device in response to a selection of any one of the plurality of camera service items, and switch an external input to the camera device according to the execution request.

Description

Technical Field

[0001] The present disclosure relates to a display device and an operating method thereof. Background Art

[0002] Digital TV services using wired or wireless communication networks are becoming common. Digital TV services can provide various services that cannot be provided in conventional analog broadcast services.

[0003] For example, IPTV (Internet Protocol Television) and smart TV services, which are types of digital TV services, provide two-way functionality that allows users to actively select the type of program to watch and the viewing time. Based on this two-way functionality, IPTV and smart TV services can provide various additional services such as Internet search, home shopping, and online games.

[0004] In addition, recent TVs provide services associated with cameras.

[0005] However, conventionally, in order to provide camera services (e.g., multi-party video calls, AI functions, or AR functions), it is necessary to change the platform of the TV or there are many restrictions on the system-on-chip (SoC) of the TV.

[0006] In addition, when an external camera is installed on a TV product, there are difficulties in the development of camera services and in coping with two-way communication platforms. That is, the camera only provides A / V signals and does not support any communication.

[0007] In addition, whenever a new camera service is provided, the TV needs to be upgraded.

[0008] In addition, conventionally, a list of peripheral devices is provided for connection to wireless products and the connection is established through user selection. In this case, a separate operation such as user selection is necessary, causing inconvenience to the user. Summary of the Invention

[0009] An object of the present disclosure is to minimize the change of the platform of a display device for providing camera services and to eliminate the storage space limitation according to the installation of camera service applications.

[0010] Another object of the present disclosure is to achieve two-way communication with a camera device installed outside the display device.

[0011] Another object of the present disclosure is to automatically perform network settings using the camera device.

[0012] A display device according to an embodiment of the present disclosure includes: a display; a network interface configured to communicate wirelessly with a camera device or a server; an external device interface configured to communicate with the camera device via High-Definition Multimedia Interface-Consumer Electronics Control (HDMI-CEC); and a controller configured to display, on the display, a camera service list including a plurality of camera service items respectively corresponding to a plurality of camera service applications when connected to the camera device, send an execution request of a camera service application corresponding to a selected camera service item to the camera device in response to a selection of any one of the plurality of camera service items, and switch an external input to the camera device according to the execution request. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Figure 1 is a block diagram illustrating a configuration of a display device according to an embodiment of the present disclosure.

[0014] Figure 2 is a block diagram illustrating a configuration of a remote control device according to an embodiment of the present disclosure.

[0015] Figure 3 is a diagram illustrating an actual configuration of a remote control device according to an embodiment of the present disclosure.

[0016] Figure 4 is a diagram illustrating an example of using a remote control device according to an embodiment of the present disclosure.

[0017] Figure 5 is a diagram illustrating a configuration of a network-interworking camera system according to an embodiment of the present disclosure.

[0018] Figure 6 is a block diagram illustrating a configuration of a camera device according to an embodiment of the present disclosure.

[0019] Figure 7 is a ladder diagram illustrating a method of operating a network-interworking camera system according to an embodiment of the present disclosure.

[0020] Figure 8 is a diagram illustrating an interworking process between a camera device and a display device according to an embodiment of the present disclosure.

[0021] Figure 9 is a diagram illustrating an example of providing a camera service list and switching an external input to a camera device according to an embodiment of the present disclosure.

[0022] Figure 10FIG. is an example of adding a new service when a new service item is selected from a camera service list according to an embodiment of the present disclosure.

[0023] Figure 11 FIG. is a diagram illustrating a process of connecting a display device and an external device through wireless network communication according to the related art.

[0024] Figure 12 FIG. is a diagram illustrating a process of connecting a display device and a camera device according to an embodiment of the present disclosure.

[0025] Figure 13 FIG. is a diagram illustrating a method of transmitting network setting data sent to a camera device through HDMI-CEC according to an embodiment of the present disclosure.

[0026] Figure 14 FIG. is a diagram illustrating a format of network setting data according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0027] Hereinafter, embodiments related to the present invention will be described in detail with reference to the accompanying drawings. The suffixes “module” and “unit” of components used in the following description are assigned or mixed for ease of writing the specification, and do not have distinct meanings or functions in themselves.

[0028] When an Internet function is added while implementing a broadcast reception function, a display device according to an embodiment of the present invention (e.g., an artificial display device that adds computer support functions to a broadcast reception function) may have user-friendly interfaces such as a writing input device, a touch screen, and a spatial remote control device. Then, with the support of a wired or wireless Internet function, it can perform functions such as email, web browsing, banking, or gaming when accessing the Internet and a computer. To perform such various functions, a standardized general-purpose OS can be used.

[0029] Therefore, since various applications can be freely added or deleted on a general-purpose OS kernel, the display device described herein can perform various user-friendly functions, for example. More specifically, the display device can be a network TV, a hybrid broadcast broadband TV (HBBTV), a smart TV, a light-emitting diode (LED) TV, an organic light-emitting diode (OLED) TV, etc., and in some cases, can be applied to a smart phone.

[0030] Figure 1 FIG. is a block diagram illustrating a configuration of a display device according to an embodiment of the present invention.

[0031] Refer to Figure 1, the display device 100 may include a broadcast receiving unit 130, an external device interface unit 135, a storage unit 140, a user interface unit 150, a control unit 170, a wireless communication unit 173, a display unit 180, an audio output unit 185, and a power supply unit 190.

[0032] The broadcast receiving unit 130 may include a tuner 131, a demodulation unit 132, and a network interface unit 133.

[0033] The tuner 131 may select a specific broadcast channel according to a channel selection command. The tuner 131 may receive a broadcast signal for the selected specific broadcast channel.

[0034] The demodulation unit 132 may divide the received broadcast signal into a video signal, an audio signal, and a broadcast program-related data signal, and restore the divided video signal, audio signal, and data signal into an output-usable form.

[0035] The external device interface unit 135 may receive an application or a list of applications in an adjacent external device and transfer it to the control unit 170 or the storage unit 140.

[0036] The external device interface unit 135 may provide a connection path between the display device 100 and an external device. The external device interface unit 135 may receive at least one image or audio output from an external device wirelessly or wiredly connected to the display device 100 and transfer it to the control unit 170. The external device interface unit 135 may include a plurality of external input terminals. The plurality of external input terminals may include RGB terminals, at least one high-definition multimedia interface (HDMI) terminal, and component terminals.

[0037] The image signal of the external device input through the external device interface unit 135 may be output through the display unit 180. The sound signal of the external device input through the external device interface unit 135 may be output through the audio output unit 185.

[0038] The external device connectable to the external device interface unit 135 may be one of a set-top box, a Blu-ray player, a DVD player, a game console, a soundbar, a smart phone, a PC, a USB memory, and a home theater system, but this is merely exemplary.

[0039] The network interface unit 133 may provide an interface for connecting the display device 100 to a wired / wireless network including the Internet network. The network interface unit 133 may send data to another user or another electronic device or receive data from another user or another electronic device through an accessed network or another network linked to the accessed network.

[0040] In addition, some of the content data stored in the display device 100 can be sent to a user or an electronic device selected from other users or other electronic devices pre-registered in the display device 100.

[0041] The network interface unit 133 can access a predetermined web page through an accessed network or another network linked to the accessed network. That is, the network interface unit 133 can send data to or receive data from a corresponding server by accessing a predetermined web page via the network.

[0042] Then, the network interface unit 133 can receive content or data provided by a content provider or a network operator. That is, the network interface unit 133 can receive content such as movies, advertisements, games, VODs, and broadcast signals and their related information provided by a content provider or a network provider through the network.

[0043] In addition, the network interface unit 133 can receive firmware update information and update files provided by a network operator and send data to the Internet or a content provider or a network operator.

[0044] The network interface unit 133 can select and receive a desired application among publicly available (open to the air) applications through the network.

[0045] The storage unit 140 can store signal-processed images, voices, or data signals stored by a program for each signal processing and control in the control unit 170.

[0046] In addition, the storage unit 140 can perform the function of temporarily storing images, voices, or data signals output from the external device interface unit 135 or the network interface unit 133, and can store information about a predetermined image through a channel memory function.

[0047] The storage unit 140 can store an application or a list of applications input from the external device interface unit 135 or the network interface unit 133.

[0048] The display device 100 can play content files (e.g., video files, still image files, music files, document files, application files, etc.) stored in the storage unit 140 and provide them to the user.

[0049] The user interface unit 150 may transfer a signal input by a user to the control unit 170 or transfer a signal from the control unit 170 to the user. For example, the user interface unit 150 may receive or process control signals from the remote control device 200 such as power on / off, channel selection, and screen setting, or transmit the control signal from the control unit 170 to the remote control device 200 according to various communication methods such as Bluetooth, ultra-wideband (UWB), ZigBee, radio frequency (RF), and IR.

[0050] In addition, the user interface unit 150 may transfer a control signal input from local keys (not shown) such as a power key, a channel key, a volume key, and a setting key to the control unit 170.

[0051] The image signal processed in the control unit 170 may be input to the display unit 180 and displayed as a corresponding image to the corresponding image signal. In addition, the image signal processed in the control unit 170 may be input to an external output device through the external device interface unit 135.

[0052] The voice signal processed in the control unit 170 may be output to the audio output unit 185. In addition, the voice signal processed in the control unit 170 may be input to an external output device through the external device interface unit 135.

[0053] In addition to this, the control unit 170 may also control the overall operation in the display device 100. In addition, the control unit 170 may control the display device 100 through a user command or an internal program input via the user interface unit 150 and download a desired application or a list of applications to the display device 100 when accessing a network.

[0054] The control unit 170 may output the channel information selected by the user together with the processed image or voice signal through the display unit 180 or the audio output unit 185.

[0055] In addition, according to an external device image playback command received through the user interface unit 150, the control unit 170 may output an image signal or a voice signal of an external device such as a camera or a camcorder input through the external device interface unit 135 through the display unit 180 or the audio output unit 185.

[0056] In addition, the control unit 170 may control the display unit 180 to display an image and control a broadcast image input through the tuner 131, an external input image input through the external device interface unit 135, an image input through the network interface unit, or an image stored in the storage unit 140 to be displayed on the display unit 180. In this case, the image displayed on the display unit 180 may be a still image or a video and may also be a 2D image or a 3D image.

[0057] In addition, the control unit 170 may play content stored in the display device 100, received broadcast content, and externally input external input content, and the content may have various formats such as a broadcast image, an external input image, an audio file, a still image, an accessed web screen, and a document file.

[0058] In addition, the wireless communication unit 173 may perform wired or wireless communication with an external electronic device. The wireless communication unit 173 may perform short-range communication with an external device. To this end, the wireless communication unit 173 may support short-range communication by using at least one of Bluetooth TM , radio frequency identification (RFID), infrared data association (IrDA), ultra-wideband (UWB), ZigBee, near field communication (NFC), wireless fidelity (Wi-Fi), Wi-Fi Direct, and wireless universal serial bus (USB) technologies. The wireless communication unit 173 may support wireless communication between the display device 100 and a wireless communication system, between the display device 100 and another display device 100, or between a network including the display device 100 and another display device 100 (or an external server) through a wireless local area network. The wireless local area network may be a wireless personal area network.

[0059] In this document, the other display device 100 may be a mobile terminal such as a wearable device (e.g., a smart watch, smart glasses, and a head-mounted display (HMD)) or a smart phone that can exchange data (or interoperate) with the display device 100. The wireless communication unit 173 may detect (or identify) a wearable device communicable around the display device 100. In addition, if the detected wearable device is a device certified to communicate with the display device 100, the control unit 170 may send at least a part of the processed data in the display device 100 to the wearable device through the wireless communication unit 173. Therefore, the user of the wearable device may use the processed data in the display device 100 through the wearable device.

[0060] The display unit 180 may convert the image signal, data signal, or on-screen display (OSD) signal processed in the control unit 170 or the image signal or data signal received in the external device interface unit 135 into R, G, and B signals to generate a driving signal.

[0061] In addition, Figure 1 The illustrated display device 100 is merely one embodiment of the present invention, and thus, some of the illustrated components may be integrated, added, or omitted according to the specifications of the actually implemented display device 100.

[0062] That is, when necessary, two or more components may be integrated into one component, or one component may be divided into two or more components and configured. In addition, the functions performed by each block will describe the embodiments of the present invention, and the specific operations or devices do not limit the scope of the present invention.

[0063] According to another embodiment of the present invention, different from Figure 1 the display device 100 may receive images through the network interface unit 133 or the external device interface unit 135 without including the tuner 131 and the demodulation unit 132 and play them.

[0064] For example, the display device 100 may be divided into an image processing device such as a set-top box for receiving broadcast signals or content according to various network services and a content playback device for playing the content input from the image processing device.

[0065] In this case, the following method of operating a display device according to an embodiment of the present invention may be performed by one of the display device described with reference to Figure 1 an image processing device such as a separate set-top box, and a content playback device including the display unit 180 and the audio output unit 185.

[0066] Then, with reference to Figure 2 and Figure 3 a remote control device will be described according to an embodiment of the present invention.

[0067] Figure 2 is a block diagram illustrating a remote control device according to an embodiment of the present invention, and Figure 3 is a diagram illustrating the actual configuration of a remote control device according to an embodiment of the present invention.

[0068] First, with reference to Figure 2 the remote control device 200 may include a fingerprint recognition unit 210, a wireless communication unit 220, a user input unit 230, a sensor unit 240, an output unit 250, a power supply unit 260, a storage unit 270, a control unit 280, and a sound acquisition unit 290.

[0069] Reference Figure 2

[0069] , the wireless communication unit 220 transmits a signal to any one of the display devices according to the above-described embodiments of the present invention or receives a signal from any one of the display devices according to the above-described embodiments of the present invention.

[0070] The remote control device 200 may include a radio frequency (RF) module 221 for transmitting a signal to the display device 100 or receiving a signal from the display device 100 according to an RF communication standard, and an IR module 223 for transmitting a signal to the display device 100 or receiving a signal from the display device 100 according to an IR communication standard. Additionally, the remote control device 200 may include a Bluetooth module 225 for transmitting a signal to the display device 100 or receiving a signal from the display device 100 according to a Bluetooth communication standard. Additionally, the remote control device 200 may include a near field communication (NFC) module 227 for transmitting a signal to the display device 100 or receiving a signal from the display device 100 according to an NFC communication standard, and a wireless local area network (WLAN) module 229 for transmitting a signal to the display device 100 or receiving a signal from the display device 100 according to a WLAN communication standard.

[0071] Additionally, the remote control device 200 may transmit, via the wireless communication unit 220, a signal including information about the movement of the remote control device 200 to the display device 100.

[0072] Furthermore, the remote control device 200 may receive a signal transmitted from the display device 100 via the RF module 221, and when necessary, may transmit commands regarding power on / off, channel change, and volume change to the display device 100 via the IR module 223.

[0073] The user input unit 230 may be configured with a keypad button, a touchpad, or a touch screen. The user may manipulate the user input unit 230 to input commands related to the display device 100 into the remote control device 200. If the user input unit 230 includes hard key buttons, the user may input commands related to the display device 100 into the remote control device 200 by pushing the hard key buttons. Reference will be made to Figure 3 for a description thereof.

[0074] Reference Figure 3

[0069] , the remote control device 200 may include a plurality of buttons. The plurality of buttons may include a fingerprint recognition button 212, a power button 231, a home button 232, a live button 233, an external input button 234, a voice adjustment button 235, a voice recognition button 236, a channel change button 237, a check box button 238, and a back button 239.

[0075] The fingerprint recognition button 212 may be a button for recognizing a user's fingerprint. According to an embodiment of the present invention, the fingerprint recognition button 212 may perform a push operation and receive a push operation and a fingerprint recognition operation. The power button 231 may be a button for turning on / off the power of the display device 100. The home button 232 may be a button for moving to the home screen of the display device 100. The live button 233 may be a button for displaying a live broadcast program. The external input button 234 may be a button for receiving an external input connected to the display device 100. The voice adjustment button 235 may be a button for adjusting the volume output from the display device 100. The voice recognition button 236 may be a button for receiving a user's voice and recognizing the received voice. The channel change button 237 may be a button for receiving a broadcast signal of a specific broadcast channel. The check box button 238 may be a button for selecting a specific function and the back button 239 may be a button for returning to the previous screen.

[0076] Again, referring to Figure 2 , if the user input unit 230 includes a touch screen, the user may touch the soft keys of the touch screen to input commands related to the display device 100 into the remote control device 200. In addition, the user input unit 230 may include various input means (e.g., scroll keys and jog keys) manipulated by the user, and this embodiment does not limit the scope of the present invention.

[0077] The sensor unit 240 may include a gyro sensor 241 or an acceleration sensor 243, and the gyro sensor 241 may sense information about the movement of the remote control device 200.

[0078] For example, the gyro sensor 241 may sense information about the operation of the remote control device 200 based on the x-axis, y-axis, and z-axis, and the acceleration sensor 243 may sense information about the moving speed of the remote control device 200. In addition, the remote control device 200 may further include a distance measurement sensor and sense the distance from the display unit 180 of the display device 100.

[0079] The output unit 250 may output an image or voice signal in response to the manipulation of the user input unit 230 or an image or voice signal corresponding to the signal transmitted from the display device 100. The user may identify whether the user input unit 230 is manipulated or the display device 100 is controlled through the output unit 250.

[0080] For example, if the user input unit 230 is manipulated or a signal is sent to the display device 100 through the wireless communication unit 220 / a signal is received from the display device 100, the output unit 250 may include an LED module 251 for flashing, a vibration module 253 for generating vibration, a sound output module 255 for outputting sound, or a display module 257 for outputting an image.

[0081] In addition, the power supply unit 260 supplies power to the remote control device 200 and stops power supply when the remote control device 200 does not move within a predetermined time, so that power waste can be reduced. If a predetermined key provided at the remote control device 200 is manipulated, the power supply unit 260 may resume power supply.

[0082] The storage unit 270 may store various programs and application data necessary for the control or operation of the remote control device 200. If the remote control device 200 wirelessly transmits / receives signals through the display device 100 and the RF module 221, the remote control device 200 and the display device 100 transmit / receive signals through a predetermined frequency band.

[0083] The control unit 280 of the remote control device 200 may store information about the frequency band for transmitting signals to the display device 100 paired with the remote control device 200 / receiving signals from the display device 100 paired with the remote control device 200 in the storage unit 270 and refer to it.

[0084] The control unit 280 controls general matters related to the control of the remote control device 200. The control unit 280 may send a signal corresponding to the manipulation of a predetermined key of the user input unit 230 or a signal corresponding to the movement of the remote control device 200 sensed by the sensor unit 240 to the display device 100 through the wireless communication unit 220.

[0085] In addition, the sound acquisition unit 290 of the remote control device 200 may acquire voice. The sound acquisition unit 290 may include at least one microphone and acquire voice through the microphone 291.

[0086] Figure 4 It is a diagram of using a remote control device according to an embodiment of the present invention. Figure 4 In the (a) of, an example shows that a pointer 205 corresponding to the remote control device 200 is displayed on the display unit 180.

[0087] The user can move or rotate the remote control device 200 vertically or horizontally. The pointer 205 displayed on the display unit 180 of the display device 100 corresponds to the movement of the remote control device 200. Since the corresponding pointer 205 is moved and displayed according to the movement in the 3D space as shown in the figure, the remote control device 200 can be called a spatial remote control device.

[0088] Figure 4 Example (b) shows that if the user moves the remote control device 200, the pointer 205 displayed on the display unit 180 of the display device 100 is moved to the left according to the movement of the remote control device 200.

[0089] Information about the movement of the remote control device 200 detected by the sensor of the remote control device 200 is sent to the display device 100. The display device 100 can calculate the coordinates of the pointer 205 based on the information about the movement of the remote control device 200. The display device 100 can display the pointer 205 in a manner that matches the calculated coordinates.

[0090] Figure 4 Example (c) shows a situation where when a specific button on the remote control device 200 is pressed and the user moves the remote control device 200 away from the display unit 180. Therefore, the selection area corresponding to the pointer 205 in the display unit 180 can be enlarged and displayed larger.

[0091] On the other hand, if the user moves the remote control device 200 closer to the display unit 180, the selection area corresponding to the pointer 205 in the display unit 180 can be reduced and displayed in a reduced size.

[0092] On the other hand, if the remote control device 200 is moved away from the display unit 180, the selection area can be reduced, and if the remote control device 200 is moved closer to the display unit 180, the selection area can be enlarged.

[0093] In addition, if a specific button on the remote control device 200 is pressed, the recognition of vertical or horizontal movement can be excluded. That is, if the remote control device 200 is moved away from or closer to the display unit 180, upward, downward, leftward, or rightward movement cannot be recognized, and only forward and backward movement can be recognized. When the specific button on the remote control device 200 is not pressed, only the pointer 205 moves according to the upward, downward, leftward, or rightward movement of the remote control device 200.

[0094] Furthermore, the movement speed or movement direction of the pointer 205 can correspond to the movement speed or movement direction of the remote control device 200.

[0095] In addition, the pointer in this specification means an object displayed on the display unit 180 in response to an operation of the remote control device 200. Therefore, various forms of objects are possible in addition to the arrow form of the pointer 205 shown in the drawings. For example, the above concepts include points, cursors, prompts, and thick outlines. Then, the pointer 205 can be displayed corresponding to a point on one of the horizontal axis and the vertical axis on the display unit 180 and can also be displayed corresponding to multiple points such as lines and surfaces.

[0096] Figure 5 This is a diagram illustrating the configuration of a network-interworking camera system according to an embodiment of the present disclosure.

[0097] The network-interworking camera system 5 may include a camera device 500, a display device 100, and an app store server 50.

[0098] The camera device 500 may exchange basic control data with the display device 100 according to the HDMI CEC (High-Definition Multimedia Interface Consumer Electronics Control) standard.

[0099] The basic control data may include network setting values between the camera device 500 and the display device 100. The network may be a Wi-Fi network.

[0100] The network setting values may include a service set identifier (SSID) and a password.

[0101] The camera device 500 may exchange interworking data with the display device 100 according to the Wi-Fi standard.

[0102] The interworking data may include a software development kit (SDK) for providing a camera service.

[0103] The display device 100 may receive a camera service list from the app store server 50. The camera service list may include camera service items that can be provided by the camera device 500 connected to the display device 100. Each of the camera service items may be a camera service application.

[0104] Figure 6 This is a block diagram illustrating the configuration of a camera device according to an embodiment of the present disclosure.

[0105] Referring to Figure 6 , the camera device 500 may include a wireless communication interface 510, a wired communication interface 520, a memory 530, an image sensor 540, an audio processor 550, and a processor 590.

[0106] The wireless communication interface 510 may perform wireless communication with the app store server 50 and the display device 100.

[0107] The wireless communication interface 510 may include a Wi-Fi module.

[0108] The wired communication interface 520 may be connected to an external device interface unit 135 of the display device 100.

[0109] The wired communication interface 520 may include an HDMI output terminal. The wired communication interface 520 may send information to the display device 100 and receive information from the display device 100 via HDMI-CEC.

[0110] The memory 530 may store program data, video data, and audio data necessary for an application that installs a camera service.

[0111] The image sensor 540 may read information about an object and transform it into an electrical image signal. The transformed image signal may be sent to the display device 100 through the wired communication interface 520.

[0112] The audio processor 550 may process audio obtained through a microphone (not shown) and send the processed audio to the display device 100.

[0113] The processor 590 may control the overall operation of the camera device 500.

[0114] The processor 590 may receive a program necessary for installing a camera service application from the application store server 50 and install the camera service application based on the received program data.

[0115] Figure 7 is a ladder diagram illustrating a method of operating a network interworking camera system according to an embodiment of the present disclosure.

[0116] In Figure 7 , it is assumed that the camera device 500 and the display device 100 are wired-connected through the HDMI-CEC standard, and the camera device 500 and the display device 100 are wirelessly connected to the network.

[0117] The wireless network connection may be a Wi-Fi network connection.

[0118] The camera device 500 may be installed at the upper end of the display device 100, but its position is merely an example.

[0119] Referring to Figure 7 , the control unit 170 of the display device 100 receives a camera service list from the application store server 50 through the network interface unit 133 (S701).

[0120] The network interface unit 133 may include a Wi-Fi module. When the display device 100 and the camera device 500 are connected, the control unit 170 may receive a camera service list that can be provided by the camera device 500.

[0121] The camera service list may include a plurality of camera service items corresponding to a plurality of camera service applications, respectively.

[0122] The camera service applications may include a home training application, a video call application, and a photo / video shooting application.

[0123] The camera service list may include items corresponding to camera service applications previously executed on the display device 100.

[0124] In another embodiment, when a connection with the camera device 500 is established, the control unit 170 of the display device 100 may receive a camera service list from the camera device 500.

[0125] The camera service list may further include new service items. The new service items may be camera service items that can be newly provided through the camera device 500.

[0126] The control unit 170 of the display device 100 displays a camera service list including a plurality of camera service items on the display unit 180 (S703).

[0127] The control unit 170 of the display device 100 determines whether a new service item is selected from the plurality of camera service items (S705).

[0128] When a new service item is selected, the control unit 170 of the display device 100 sends a request to the application store server 50 for downloading a new camera service application corresponding to the new service item to the camera device 500 (S707).

[0129] That is, the control unit 170 may send a request to the application store server 50 through the network interface unit 133 for installing the new camera service application on the camera device 500.

[0130] The application store server 50 sends the program data necessary for installing the new camera service application to the camera device 500 in response to the request received from the display device 100 (S709).

[0131] The processor 590 of the camera device 500 installs the new camera service application based on the program data received from the application store server 50 (S711).

[0132] The camera device 500 may download the program data for installing the new camera service application from the application store server 50 and install the new camera application based on the program data.

[0133] In addition, when a request to execute an existing camera service application is received, the control unit 170 of the display device 100 sends an execution request to the camera device 500 (S713).

[0134] The execution request for the camera service application may be a request to switch an external input.

[0135] That is to say, the control unit 170 can switch the external input to the camera device 500 according to the execution request of the camera service application while displaying the image received from the live TV or the set-top box or the image received from an external device via HDMI.

[0136] The processor 590 of the camera device 500 executes the existing camera service application according to the received execution request (S715), and sends an image signal to the display device 100 via the wired communication interface 520 according to the execution of the camera service application (S717).

[0137] The wired communication interface 520 can be connected to the external device interface unit 135 of the display device 100 via an HDMI cable.

[0138] The image signal can be a signal captured by the image sensor 540 of the camera device 500.

[0139] The control unit 170 of the display device 100 displays an image based on the image signal received from the camera device 500 via the display unit 180 (S719).

[0140] Figure 8 FIG. is a diagram illustrating an interworking process between a camera device and a display device according to an embodiment of the present disclosure.

[0141] Refer to Figure 8 FIG., the camera device 500 and the display device 100 can be connected via an HDMI cable, and the camera device 500 can send video and audio to the display device 100 via the HDMI cable.

[0142] Each of the camera device 500 and the display device 100 can perform data communication via a network module. The network module can be a Wi-Fi module.

[0143] Each of the camera device 500 and the display device 100 can be connected to the application store server 50 via a router 800.

[0144] The operating system of the camera device 500 can be AOS and the operating system of the display device 100 can be BOS, and these operating systems can be different from each other.

[0145] The display device 100 can perform basic control of the camera device 500 according to the HDMI-CEC standard. The display device 100 can receive the identification information of the camera device 500 according to the HDMI-CEC standard and identify the camera device 500 based on the received identification information.

[0146] The display device 100 can send network setting data of a router wirelessly connected thereto to the camera device 500 via the HDMI-CEC standard. The network setting data can include an SSID and a password. The camera device 500 can access the router via the network setting data and thus perform wireless communication with the display device 100.

[0147] The display device 100 can switch an external input to the camera device 500 according to the execution of a camera service application.

[0148] The display device 100 can send a four-way key control command received from the remote control device 200 to the camera device 500 via the HDMI-CEC standard.

[0149] The display device 100 and the camera device 500 exchange interoperability data via the Wi-Fi standard.

[0150] For example, the display device 100 can send the coordinates of a pointer controlled according to the movement of the remote control device 200 to the camera device 500 via a Wi-Fi module.

[0151] The camera device 500 can send information about a camera service application installed in the camera device 500, remaining storage space, and application download progress, as well as information about the installation of a new camera service application, to the display device 100 via a Wi-Fi module.

[0152] The camera device 500 can send an event generated during the execution of a camera service application to the display device 100 via a Wi-Fi module. For example, when the camera service application is a video call application, a video call signal can be an event.

[0153] In this way, interoperability data with a small data capacity can be exchanged via a Wi-Fi module, and data with a large data capacity, such as video data, can be sent to the display device 100 via HDMI.

[0154] Therefore, data exchange can be performed quickly and efficiently.

[0155] Figure 9 It is a diagram illustrating an example of providing a camera service list and switching an external input to a camera device according to an embodiment of the present disclosure.

[0156] The display device 100 can include a camera service list 910 including a plurality of camera service items 911 to 915.

[0157] Each item can be in the form of an icon, but this is merely an example.

[0158] When the camera device 500 is connected, the display device 100 may display a camera service list 910.

[0159] The plurality of camera service items 911 to 915 may correspond to camera service applications, respectively.

[0160] The first camera service item 911 may be a home training application, the second camera service item 912 may be a video call application, the third camera service item 913 may be a video conferencing application, the fourth camera service item 914 may be a photo / video shooting application, and the fifth camera service item 915 may be an item for installing a new service application.

[0161] The first camera service item 911 to the fourth camera service item 914 may be items previously provided through the display device 100 by communicating with the camera device 500.

[0162] When a command for selecting the first camera service item 911 is received, the display device 100 may switch the external input to the camera device 500. The display device 100 may display an image 930 based on an image signal received from the camera device 500 through an HDMI cable.

[0163] The image 930 may be an execution screen of a home training application and may include an image captured by the camera device 500.

[0164] The display device 100 may control the home training application according to a command received from the remote control device 200.

[0165] The display device 100 may display a content image 950 that was being displayed before the camera service list 910 was provided according to a command for ending the external input to the camera device 500.

[0166] According to an embodiment of the present disclosure, a user may receive a service associated with a camera without installing a camera service application in the display device 100.

[0167] Therefore, it is not necessary to change the platform of the display device 100 and the limitation on storage space due to the installation of applications is eliminated.

[0168] In addition, a camera service different from the prior art may be provided through two-way communication between the display device 100 and the camera device 500.

[0169] Figure 10 It is a diagram illustrating an example of adding a new service when a new service item is selected from a camera service list according to an embodiment of the present disclosure.

[0170] When at Figure 9When a command for selecting a new service item is received, such as Figure 10 shown, the display device 100 may display a new service screen 1000 for providing information about the new service.

[0171] The new service screen 1000 may include description information and installation items of the new camera service application. The installation item 1010 may be an item for installing the new camera service application in the camera device 500.

[0172] Assume that the new camera service application is an augmented reality (AR) application.

[0173] When a command for selecting the installation item 1010 is received, the display device 100 may send a command for installing the AR application in the camera device 500 to the application store server 50.

[0174] The display device 100 may receive a command for selecting the installation item 1010 from the remote control device 200.

[0175] The application store server 50 may send program data necessary for installing the AR application to the camera device 500 according to the received installation command.

[0176] The camera device 500 may install the AR application based on the received program data. When the AR application is installed in the camera device 500, the camera device 500 may send a notification of the completion of the AR application installation to the display device 100 through the wired communication interface 520.

[0177] The display device 100 may receive a notification of the completion of the AR application installation from the camera device 500 or the application store server 50, and display an AR item 1030 corresponding to the AR application on the camera service list 910.

[0178] When the AR item 1030 is selected, the display device 100 may send an execution command of the AR application to the camera device 500 and display an AR application execution screen 1050 based on the image signal received from the camera device 500.

[0179] According to an embodiment of the present disclosure, a user may receive a new camera service without installing an application for the new camera service in the display device 100. Therefore, whenever a new camera service is released, the burden of installing an application in the display device 100 may be reduced, and the display device 100 does not have to be upgraded.

[0180] Figure 11 is a diagram illustrating a process of connecting a display device and an external device through wireless network communication according to the related art, and Figure 12It is a diagram illustrating a process of connecting a display device and a camera device according to an embodiment of the present disclosure.

[0181] Referring to Figure 11 , for wireless network communication between the display device 100 and the external device 1100, a search process and a connection process are mainly required.

[0182] The search process is a process in which the display device 100 searches for the external device 1100, and may include a notification sending process and a pairing process (external device registration process).

[0183] The connection process may include a network setting process and a process of sending a screen to the display device 100.

[0184] During the connection process, a user operation is necessary.

[0185] For example, in the case of connecting via Wi-Fi Direct, it is necessary to enter the soft AP mode. For this, a device list is provided and the connection process is executed by user selection.

[0186] In addition, in the case of connecting via BLE, device registration is necessary. For this, a device list is provided and the connection process is executed by user selection.

[0187] In the case of connecting via NFC, the connection process is executed by manually touching the NFC tag.

[0188] In the case of connecting via QR code, it is necessary to provide a QR code and a process that enables the user to establish a connection by taking a picture of the QR code with the camera.

[0189] In this way, there is an inconvenience that the connection between the display device 100 and the external device 1100 must require a user input operation.

[0190] Referring to Figure 12 , the display device 100 and the camera device 500 are in a disconnected state.

[0191] When the external device interface unit 135 of the display device 100 and the wired communication interface 520 of the camera device 500 are connected via an HDMI cable, the display device 100 may display a pop-up window 1200 for indicating that the camera device is connected.

[0192] After the pop-up window 1200 is displayed, step S701 of Figure 7 may be sequentially executed.

[0193] When the display device 100 and the camera device 500 are connected via HDMI-CEC, the display device 100 may send network setting values to the camera device 500.

[0194] The network setting value (or network setting data) may include the SSID and password for accessing a Wi-Fi network (or router).

[0195] The size of the SSID may be at most 32 bytes at maximum, and the size of the password may be at most 64 bytes.

[0196] The camera device 500 may use the SSID and password to access the Wi-Fi network and thus establish a wireless network with the display device 100.

[0197] According to an embodiment of the present disclosure, when the camera device 500 is connected, the display device 100 may provide a connection guide pop-up window and automate the network setting, thereby minimizing additional network setting operations.

[0198] That is, the user does not need to perform additional operations for setting up a separate network between the display device 100 and the camera device 500, thereby improving convenience.

[0199] Figure 13 is a diagram illustrating a method of transmitting network setting data sent to a camera device via HDMI-CEC according to an embodiment of the present disclosure, and Figure 14 is a diagram illustrating the format of network setting data according to an embodiment of the present disclosure.

[0200] When connected via HDMI-CEC, the display device 100 and the camera device 500 may share each other's vendor information (manufacturer information).

[0201] When connected to the camera device 500 via HDMI-CEC, the display device 100 may include the network setting data in a vendor-specific command sent to the camera device 500 and send it to the camera device 500.

[0202] Since the size of the user data that can be used in the vendor-specific command of the HDMI-CEC protocol is 13 bytes. Since the maximum total size of the SSID and password is 96 bytes, the network setting data may be divided at least 8 times and sent to the camera device 500.

[0203] Refer to Figure 14 to show the format of the network setting data.

[0204] The network setting data 1400 may be named router information AP info.

[0205] The network setting data 1400 may be composed of a combination of an SSID, a password, a security type, and Is Hidden.

[0206] The security type can represent the security type and Is Hidden can represent whether the network setting data is hidden.

[0207] According to an embodiment of the present disclosure, a user can receive a service associated with a camera without installing a camera service application in a display device. Accordingly, there is no need to change the platform to enable the display device to provide a camera service, and the limitation on storage space according to application installation can be eliminated.

[0208] In addition, the burden of installing an application in the display device every time a new camera service is released can be reduced, and there is no need to upgrade the display device.

[0209] In addition, the user does not need to perform an additional operation for network settings between the display device and the camera device, thereby improving convenience.

[0210] According to an embodiment of the present disclosure, the above method can be implemented as processor-readable code on a processor-readable medium having a program recorded thereon. Examples of the processor-readable medium include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, and carrier wave (e.g., data transmission through the Internet).

[0211] In the above display device, the configurations and methods of the above embodiments are not limitedly applicable, but all or some of the above embodiments are selectively combined so that various modifications can be made.

[0212] Cross-reference to related applications

[0213] This application claims priority to Korean Patent Application No. 10-2021-0149237, filed on Nov. 2, 2021, the entire contents of which are incorporated herein by reference.

Claims

1. A display device, the display device comprising: a display; a network interface configured to wirelessly communicate with a camera device or a server; an external device interface configured to communicate with the camera device via High-Definition Multimedia Interface-Consumer Electronics Control (HDMI-CEC); and a controller configured to display, on the display, a camera service list including a plurality of camera service items respectively corresponding to a plurality of camera service applications when connected to the camera device, send an execution request of a camera service application corresponding to a selected camera service item to the camera device in response to a selection of any one of the plurality of camera service items, and switch an external input to the camera device according to the execution request, wherein the controller is further configured to: receive information about the camera service application installed in the camera device from the camera device via a Wi-Fi module included in the network interface, and receive an image of the executed camera service application from the camera device via an HDMI interface included in the external device interface.

2. The display device according to claim 1, wherein the controller is configured to change the image to a previously displayed content image according to a command for ending an external input to the camera device.

3. The display device according to claim 1, wherein the controller is configured to send a request for installing the new camera service application in the camera device to the server when a new camera service application corresponding to a new camera service item included in the plurality of camera service items is selected via the network interface.

4. The display device according to claim 1, wherein when the camera device is connected via the HDMI-CEC, the controller sends network setting data to the camera device via the HDMI-CEC for wireless communication.

5. The display device according to claim 4, wherein the network setting data includes a service set identifier and a password for accessing a router.

6. The display device according to claim 4, wherein the controller is configured to divide the network setting data into multiple times and send the network setting data to the camera device.

7. The display device according to claim 1, wherein the controller is configured to display a pop-up window for displaying the connection of the camera device on the display when the camera device is connected.

8. A method of operating a display device, the display device including a network interface for wirelessly communicating with a camera device or a server and an external device interface for communicating with the camera device via High-Definition Multimedia Interface-Consumer Electronics Control (HDMI-CEC), the method comprising the steps of: displaying, when connected to the camera device, a camera service list including a plurality of camera service items respectively corresponding to a plurality of camera service applications; Sending an execution request for a camera service application corresponding to the selected camera service item to the camera device in response to the selection of any one of the plurality of camera service items; And Switching an external input to the camera device according to the execution request, wherein the method further comprises the following steps: Receiving information about the camera service application installed in the camera device from the camera device through a wi-fi module included in a network interface, and Receiving an image of the executed camera service application from the camera device through an HDMI interface included in the external device interface.

9. The method according to claim 8, the method further comprises the following steps: Changing the image into a previously displayed content image according to a command for ending the external input of the camera device.

10. The method according to claim 8, the method further comprises the following steps: When a new camera service application corresponding to a new camera service item included in the plurality of camera service items is selected through the network interface, sending a request for installing the new camera service application in the camera device to the server.

11. The method according to claim 8, the method further comprises the following steps: When the camera device is connected through the HDMI-CEC, sending network setting data to the camera device through the HDMI-CEC for wireless communication.

12. The method according to claim 11, wherein, The network setting data includes a service set identifier and a password for accessing a router.

13. The method according to claim 8, wherein, The method further comprises the following steps: when the camera device is connected, displaying a pop-up window for displaying the connection of the camera device on a display.

Images