Display apparatus and method of operating the same

Abstract

This disclosure relates to a display device and its operating method. An embodiment of the display device may include: a display; a wireless communication interface providing a first path based on a wireless connection with an external device; an external device interface providing a second path based on a wired connection with an external device; and a controller that processes a first video via the first path and displays it on the display, and upon detecting a wired connection based on the second path and inputting a second video via the second path, determines the similarity between the first video and the second video, and based on the determination result, processes the second video via the second path and displays it on the display.

Description

Technical Field

[0001] This disclosure relates to display devices and methods of operation thereof. Background Technology

[0002] Digital TV services utilizing wired or wireless communication networks have become widespread. Digital TV services offer a variety of services that were not available in the previous analog broadcasting services.

[0003] For example, in the case of digital TV services such as IPTV (Internet Protocol Television) and smart TV, a two-way communication is provided, allowing users to flexibly choose the types of programs they can watch and the viewing time. IPTV and smart TV services can leverage this two-way communication to offer various value-added services, such as internet search, TV shopping, and online games.

[0004] In general, wired connections offer more stable data transmission compared to wireless connections. For example, wired connections are often more robust to transmission delays (latencies) compared to wireless connections.

[0005] Therefore, when the same external device achieves a wired connection while wirelessly connecting, or achieves a wired connection after wirelessly connecting, data transmission via the wired connection will be more stable.

[0006] As an example, users can connect external devices such as Android or Apple devices to a display device via wireless communication and view content using the display device's screen.

[0007] On the other hand, wired connections between display devices and external devices are becoming increasingly simpler. While external devices and display devices are typically connected via RCA or HDMI, wired connections are becoming simpler to achieve via USB.

[0008] As an example, DP ALT MODE (DisplayPort Alternative Mode), although a USB-C type, supports displayport mode for video transmission. It typically supports DP 1.4 and can output up to 8K 60Hz with a bandwidth of 25.92 Gbps, supporting a wider bandwidth than USB 3.1 versions. It is expected that the output and bandwidth of such wired connections will gradually be enhanced. Furthermore, it is anticipated that more diverse and simpler wired connection methods utilizing portable devices such as smartphones will be provided.

[0009] This could lead to a situation where the same external device connects simultaneously via both wireless and wired connections. Therefore, improving user convenience is necessary in such cases. Summary of the Invention

[0010] Technical issues

[0011] This disclosure provides a display device and its operating method that enable more stable data transmission when simultaneously achieving wireless and wired connections to external devices for the display device.

[0012] On the other hand, this disclosure provides a display device and its operation method that enable video viewing through a more stable connection when simultaneously realizing wireless and wired connections to an external device for the display device and transmitting video through the same external device.

[0013] On the other hand, this disclosure provides a display device and its operation method that can automatically switch to a wired connection when transmitting video through the same external device while simultaneously realizing wireless and wired connections to an external device for the display device.

[0014] Methods for solving problems

[0015] The display device of embodiments of this disclosure may include: a display; a wireless communication interface that provides a first path based on a wireless connection with an external device; an external device interface that provides a second path based on a wired connection with an external device; and a controller that processes a first video and displays it on the display via the first path, and when a wired connection based on the second path is detected and a second video is input via the second path, determines the similarity between the first video and the second video, and processes the second video via the second path and displays it on the display based on the determination result.

[0016] The operation method of the display device according to the embodiments of this disclosure may include the following steps: processing a first video and displaying it on the display via a first path based on a wireless connection; detecting a wired connection based on a second path; determining the similarity between the first video and the second video when a second video is input via the second path; and processing the second video and displaying it on the display via the second path according to the determination result.

[0017] Invention Effects

[0018] According to at least one embodiment of the various embodiments of this disclosure, more stable data transmission can be achieved when both wireless and wired connections to external devices are simultaneously implemented for the display device.

[0019] On the other hand, according to at least one embodiment of the various embodiments of this disclosure, when video is transmitted through the same external device while simultaneously realizing wireless and wired connections to the display device, video can be viewed through a more stable connection.

[0020] On the other hand, according to at least one embodiment of the various embodiments of this disclosure, when video is transmitted through the same external device while simultaneously realizing wireless and wired connections for the display device, it can be automatically switched to a wired connection.

[0021] On the other hand, according to at least one embodiment of the various embodiments of this disclosure, when video is transmitted through the same external device while simultaneously realizing wireless and wired connections for the display device, the connection can be automatically switched to a wired connection, thereby improving user convenience.

[0022] In addition to the effects described above, the specific effects of this disclosure will be described in detail below when specific matters are explained. Attached Figure Description

[0023] Figure 1 This is a block diagram illustrating the structure of a display device according to an embodiment of the present invention.

[0024] Figure 2 This is a block diagram of a remote control device according to an embodiment of the present invention.

[0025] Figure 3 An example of the actual structure of a remote control device according to an embodiment of the present invention is shown.

[0026] Figure 4 An example of applying a remote control device according to an embodiment of the present invention is shown.

[0027] Figure 5a and Figure 5b This is a diagram used to illustrate the landscape and portrait modes of the floor-standing display device according to embodiments of the present disclosure.

[0028] Figure 6 This is a block diagram of a display device according to an embodiment of the present disclosure.

[0029] Figure 7 This is a flowchart illustrating an operation method of a display device according to an embodiment of the present disclosure.

[0030] Figure 8 This is a schematic diagram illustrating an example of the operation process of a display device according to an embodiment of the present disclosure.

[0031] Figure 9This is a flowchart illustrating an example of a specific operation method of a display device according to an embodiment of the present disclosure.

[0032] Figure 10 This is a schematic diagram illustrating another example of the operation process of a display device according to an embodiment of the present disclosure.

[0033] Figure 11 This is a flowchart illustrating another example of a specific operation method of a display device according to an embodiment of the present disclosure. Detailed Implementation

[0034] Hereinafter, with reference to the accompanying drawings, embodiments related to the present invention will be described in more detail. The suffixes “module” and “part” used in the following description regarding constituent elements are merely for ease of writing and are not intended to distinguish one from the other.

[0035] The display device in embodiments of the present invention is, for example, an intelligent display device that adds computer-aided functions to the basic broadcast receiving function. It retains the broadcast receiving function while adding internet functionality, and may have more user-friendly interfaces such as a handwriting input device, a touchscreen, or a spatial remote control. Furthermore, it can be connected to the internet and a computer via wired or wireless internet support, thereby enabling functions such as email, web browsing, banking, or gaming. To achieve these diverse functions, a standardized general-purpose OS (operating system) can be used.

[0036] Therefore, the display device described in this invention can freely install or uninstall various applications on a general-purpose OS kernel, thus enabling the execution of various user-friendly functions. More specifically, the aforementioned display device can be, for example, a network TV, HBBTV, smart TV, LED TV, OLED TV, etc., and depending on the circumstances, it can also be applied to smartphones.

[0037] Figure 1 This is a block diagram illustrating the structure of a display device according to an embodiment of the present invention.

[0038] Reference Figure 1 The display device 100 may include a broadcast receiver 130, an external device interface 135, a memory 140, a user input interface 150, a controller 170, a wireless communication interface 173, a display 180, a speaker 185, and a power supply circuit 190.

[0039] The broadcast receiver 130 may include a tuner 131, a demodulator 132, and a network interface 133.

[0040] Tuner 131 can select a specific broadcast channel according to a channel selection command. Tuner 131 can receive the broadcast signal of the selected specific broadcast channel.

[0041] The demodulator 132 can separate the received broadcast signal into video signal, audio signal, and data signal related to the broadcast program, and restore the separated video signal, audio signal, and data signal into an output form.

[0042] The external device interface 135 can receive applications or application directories from adjacent external devices and pass them to the controller 170 or the memory 140.

[0043] External device interface 135 provides a connection path between display device 100 and external devices. External device interface 135 can receive one or more video or audio signals output from an external device wirelessly or wiredly connected to display device 100 and transmit them to controller 170. External device interface 135 may include multiple external input terminals. These external input terminals may include RGB terminals, one or more HDMI (High Definition Multimedia Interface) terminals, and component terminals.

[0044] Image signals from external devices input via external device interface 135 can be output via display 180. Audio signals from external devices input via external device interface 135 can be output via speaker 185.

[0045] The external device that can be connected to the external device interface 135 can be any of the following: set-top box, Blu-ray player, DVD player, game console, soundbar, smartphone, PC, USB storage device, home theater system, but this is only an example.

[0046] Network interface 133 provides an interface for connecting the display device 100 to wired / wireless networks, including the Internet. Network interface 133 can send and receive data with other users or other electronic devices through the accessed network or other networks linked to the accessed network.

[0047] Additionally, the display device 100 may send a portion of the content data stored in the display device 100 to other users or selected users or electronic devices that have been pre-registered in the display device 100.

[0048] Network interface 133 can access the specified webpage through the connected network or other networks connected to the connected network. That is, it can send and receive data with the corresponding server by accessing the specified webpage through the network.

[0049] Furthermore, network interface 133 can receive content or data provided by content providers or network operators. That is, network interface 133 can receive content and related information such as movies, advertisements, games, VOD, and broadcast signals provided by content providers or network providers via the network.

[0050] In addition, network interface 133 can receive hardware update information and update files provided by network operators, and send data to the Internet or content providers or network operators.

[0051] Network interface 133 selectively receives desired applications from publicly available (open) applications via the network.

[0052] The memory 140 can store programs for processing and controlling various signals within the controller 170, and can also store processed image, voice, or data signals.

[0053] In addition, the memory 140 can perform the function of temporarily storing video, voice or data signals input from the external device interface 135 or the network interface 133, and can also store information about a specified image through the channel memory function.

[0054] The memory 140 may store applications or application directories input from the external device interface 135 or the network interface 133.

[0055] The display device 100 can play content files (moving image files, still image files, music files, document files, application files, etc.) stored in the memory 140 and provide them to the user.

[0056] User input interface 150 transmits user-input signals to controller 170 or transmits signals from controller 170 to user. For example, user input interface 150 receives and processes control signals such as power on / off, channel selection, and screen settings from remote control device 200 via various communication methods such as Bluetooth, WB (Ultra Wideband), ZigBee, RF (Radio Frequency), or infrared (IR) communication, or transmits control signals from controller 170 to remote control device 200 for processing.

[0057] In addition, the user input interface 150 can transmit control signals input from local buttons (not shown), such as the power button, channel button, volume button, and setting button, to the controller 170.

[0058] The image signal processed by the controller 170 is input to the display 180 and displayed as an image corresponding to the image signal. In addition, the image signal processed by the controller 170 is input to an external output device through the external device interface 135.

[0059] The voice signal processed by the controller 170 can be output to the speaker 185. In addition, the voice signal processed in the controller 170 can be input to an external output device through the external device interface 135.

[0060] In addition, the controller 170 can control the overall operation within the display device 100.

[0061] In addition, the controller 170 can control the display device 100 by user commands or internal programs input through the user input interface 150, and can connect to the network to download the application or application directory desired by the user to the display device 100.

[0062] The controller 170 can control the output of user-selected channel information and other processed video or audio signals through the display 180 or speaker 185.

[0063] Additionally, the controller 170 can output image or audio signals from an external device, such as a camera or camcorder, input through the external device interface 135 via the display 180 or speaker 185, based on an external device image playback command received through the user input interface 150.

[0064] On the other hand, the controller 170 can control the display 180 to display images. For example, it can control the display to display broadcast images input through the tuner 131, externally input images input through the external device interface 135, images input through the network interface, or images stored in the memory 140. In this case, the images displayed on the display 180 can be still images or moving images, and can be 2D or 3D images.

[0065] In addition, the controller 170 can control the playback of content stored in the display device 100 or received broadcast content, or externally input content, which can be various forms such as broadcast images, externally input images, audio files, still images, accessed web pages and document files.

[0066] The wireless communication interface 173 can communicate with external devices via wired or wireless communication. The wireless communication interface 173 can perform short-range communication with external devices. For this purpose, the wireless communication interface 173 can support short-range communication using at least one of Bluetooth™, RFID (Radio Frequency Identification), Infrared Data Association (IrDA), UWB (Ultra-Wideband), ZigBee, NFC (Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus). Such a wireless communication interface 173 can support wireless communication between the display device 100 and a wireless communication system, between the display device 100 and other display devices, or between the network where the display device 100 (or an external server) resides, via wireless area networks. Short-range wireless communication networks can be called wireless personal area networks (PANs).

[0067] Here, other display devices 100 may be wearable devices (e.g., smartwatches, smartglasses, HMDs, smartphones, etc.) that can exchange data (or be linked) with the display device 100 of the present invention. The wireless communication interface 173 can detect (or identify) communicable wearable devices around the display device 100.

[0068] Furthermore, if the detected wearable device is certified as a device that communicates with the display device 100 of the present invention, the controller 170 may transmit at least a portion of the data processed by the display device 100 to the wearable device via the wireless communication interface 173. Therefore, the user of the wearable device can utilize the data processed by the display device 100 through the wearable device.

[0069] The display 180 can convert the image signals, data signals, OSD signals processed by the controller 170 or the image signals and data signals received by the external device interface 135 into R, G, and B signals respectively to generate drive signals.

[0070] On the other hand, illustrated in Figure 1 The display device 100 is only one embodiment of the present invention. Some of the constituent elements shown in the figure may be integrated, added, or omitted according to the specifications of the actual implemented display device 100.

[0071] That is, as needed, two or more constituent elements can be combined into one constituent element or one constituent element can be subdivided into two or more constituent elements to form the invention. Furthermore, the functions executed in each block are used to illustrate embodiments of the present invention, and their specific operations or apparatus do not limit the scope of the invention.

[0072] According to yet another embodiment of the present invention, with Figure 1 In a different scenario, the display device 100 may not have a tuner 131 and a demodulator 132, and may receive and play images via a network interface 133 or an external device interface 135.

[0073] For example, the display device 100 can be divided into an image processing device such as a set-top box for receiving broadcast signals or content from various network services, and a content playback device for playing content input from the aforementioned image processing device.

[0074] In this case, the operation method of the display device of the embodiments of the present invention described below can be obtained by referring to... Figure 1 The operation can be performed by the display device 100 described above, or by any of the following devices: a separate set-top box or a content playback device equipped with a display 180 and an audio output unit 185.

[0075] Next, refer to Figures 2 to 3 The following describes a remote control device according to an embodiment of the present invention.

[0076] Figure 2 This is a block diagram of a remote control device according to an embodiment of the present invention. Figure 3 An actual structural example of a remote control device 200 according to an embodiment of the present invention is shown.

[0077] First, refer to Figure 2 The remote control device 200 may include a fingerprint reader 210, a wireless communication circuit 220, a user input interface 230, a sensor 240, an output interface 250, a power supply circuit 260, a memory 270, a controller 280, and a microphone 290.

[0078] Reference Figure 2 The wireless communication circuit 220 transmits and receives signals with any of the display devices in the embodiments of the present invention described above.

[0079] The remote control device 200 may include an RF circuit 221 capable of transmitting and receiving signals with the display device 100 according to RF communication specifications, and an IR circuit 223 capable of transmitting and receiving signals with the display device 100 according to IR communication specifications. Additionally, the remote control device 200 may include a Bluetooth circuit 225 capable of transmitting and receiving signals with the display device 100 according to Bluetooth communication specifications. Furthermore, the remote control device 200 may include an NFC circuit 227 capable of transmitting and receiving signals with the display device 100 according to NFC (Near Field Communication) communication specifications, and a WLAN circuit 229 capable of transmitting and receiving signals with the display device 100 according to WLAN (Wireless LAN) communication specifications.

[0080] In addition, the remote control device 200 transmits a signal containing information related to the movement of the remote control device 200 to the display device 100 via the wireless communication circuit 220.

[0081] On the other hand, the remote control device 200 can receive signals sent by the display device 100 through the RF circuit 221, and send commands related to power on / off, channel change, volume change, etc. to the display device 100 through the IR circuit 223 as needed.

[0082] The user input interface 230 may be composed of a numeric keypad, buttons, a touchpad, or a touch screen. The user inputs commands related to the display device 100 to the remote control device 200 by operating the user input interface 230. If the user input interface 230 has physical buttons, the user can input commands related to the display device 100 to the remote control device 200 by pressing the physical buttons. For details, please refer to... Figure 3 Please provide an explanation.

[0083] Reference Figure 3 The remote control device 200 may include multiple buttons. These buttons may include a fingerprint recognition button 212, a power button 231, a home button 232, a live button 233, an external input button 234, a volume adjustment button 235, a voice recognition button 236, a channel switching button 237, a confirmation button 238, and a back button 239.

[0084] The fingerprint recognition button 212 can be a button for recognizing a user's fingerprint. As one embodiment, the fingerprint recognition button 212 can be pressed, and thus can also receive pressing operations and fingerprint recognition operations.

[0085] The power button 231 can be a button used to turn the power supply of the display device 100 on / off.

[0086] The home button 232 can be a button used to navigate to the home screen of the display device 100.

[0087] The live button 233 can be a button used to display live broadcast programs.

[0088] External input button 234 can be a button for receiving external input connected to display device 100.

[0089] The volume adjustment button 235 can be a button used to adjust the volume output by the display device 100.

[0090] The voice recognition button 236 can be a button used to receive the user's voice and recognize the received voice.

[0091] The channel switching button 237 can be a button used to receive broadcast signals from a specific broadcast channel.

[0092] The confirmation button 238 can be a button for selecting a specific function, and the back button 239 can be a button for returning to the previous screen.

[0093] Re-examine Figure 2 Please provide an explanation.

[0094] When the user input interface 230 is equipped with a touch screen, the user can touch the soft keys on the touch screen to input commands related to the display device 100 to the remote control device 200. In addition, the user input interface 230 may have various user-operable input units such as scroll keys or jog keys; this embodiment does not limit the scope of the invention.

[0095] Sensor 240 may include gyroscope sensor 241 or accelerometer sensor 243. Gyroscope sensor 241 can sense information related to the movement of remote control device 200.

[0096] For example, the gyroscope sensor 241 can sense information related to the operation of the remote control device 200 based on the x-axis, y-axis, and z-axis, and the accelerometer sensor 243 can sense information related to the moving speed of the remote control device 200. On the other hand, the remote control device 200 may also be equipped with a distance measurement sensor, thereby sensing the distance between itself and the display 180 of the display device 100.

[0097] The output interface 250 can output image or voice signals that correspond to the operation of the user input interface 230 or to the signals sent by the display device 100.

[0098] Users can identify whether the user input interface 230 is being operated or whether the display device 100 is being controlled through the output interface 250.

[0099] For example, the output interface 250 may include: an LED 251 that lights up when the user input interface 230 is operated or when signals are transmitted and received between the user input interface 230 and the display device 100 via the wireless communication unit 225; a vibrator 253 that generates vibration; a speaker 255 that outputs sound; or a display 257 that outputs images.

[0100] In addition, the power supply circuit 260 can supply power to the remote control device 200, and interrupt the power supply when the remote control device 200 does not move during a specified period of time to reduce power waste.

[0101] When a specified key is operated on the remote control device 200, the power supply circuit 260 can restart the power supply.

[0102] The memory 270 can store various programs, application data, etc. required for the control or operation of the remote control device 200.

[0103] When the remote control device 200 wirelessly transmits and receives signals with the display device 100 via the RF circuit 221, the remote control device 200 and the display device 100 transmit and receive signals via a specified frequency band.

[0104] The controller 280 of the remote control device 200 can store information such as the frequency band for wirelessly transmitting and receiving signals with the display device 100 paired with the remote control device 200 in the memory 270 and refer to it.

[0105] The controller 280 controls all matters related to the control of the remote control device 200. The controller 280 can send signals corresponding to specified key operations of the user input interface 230 or signals corresponding to the movement of the remote control device 200 sensed by the sensor 240 to the display device 100 via the wireless communication unit 225.

[0106] In addition, the microphone 290 of the remote control device 200 can acquire voice.

[0107] Multiple microphones can be set (290).

[0108] Next, regarding Figure 4 Please provide an explanation.

[0109] Figure 4 An example of applying a remote control device according to an embodiment of the present invention is shown.

[0110] Figure 4(a) illustrates the case where the pointer 205 corresponding to the remote control device 200 is displayed on the display 180.

[0111] The user can move or rotate the remote control device 200 up and down, left and right. The pointer 205 displayed on the display 180 of the display device 100 corresponds to the movement of the remote control device 200. As shown in the figure, the pointer 205 moves and is displayed accordingly as the remote control device 200 moves in 3D space, so it can be called a space remote control.

[0112] Figure 4 (b) shows that when the user moves the remote control device 200 to the left, the pointer 205 displayed on the display 180 of the display device 100 also moves to the left accordingly.

[0113] Information related to the movement of the remote control device 200, sensed by the sensors of the remote control device 200, is transmitted to the display device 100. The display device 100 can calculate the coordinates of the pointer 205 based on the information related to the movement of the remote control device 200. The display device 100 can display the pointer 205 in accordance with the calculated coordinates.

[0114] Figure 4 Example (c) illustrates a situation where, with a specific button within the remote control device 200 pressed, the user moves the remote control device 200 away from the display 180. As a result, the selection area within the display 180 corresponding to the pointer 205 is partially zoomed in and displayed in a larger size.

[0115] Conversely, when the user moves the remote control device 200 closer to the display 180, the selection area within the display 180 corresponding to the pointer 205 is partially zoomed out and displayed in a smaller size.

[0116] On the other hand, when the remote control device 200 is away from the display 180, the selection area can be locally zoomed out, and when the remote control device 200 is close to the display 180, the selection area can be locally zoomed in.

[0117] Furthermore, when a specific button within the remote control device 200 is pressed, the recognition of up / down and left / right movement can be excluded. That is, when the remote control device 200 is moved away from or towards the display 180, up / down, left / right movement is not recognized; only forward / backward movement is recognized. When the specific button within the remote control device 200 is not pressed, only the pointer 205 moves according to the up / down, left / right movement of the remote control device 200.

[0118] On the other hand, the moving speed or direction of the pointer 205 can correspond to the moving speed or direction of the remote control device 200.

[0119] On the other hand, the pointer in this specification refers to an object displayed on the display 180 corresponding to the operation of the remote control device 200. Therefore, in addition to the arrow shape illustrated in the accompanying drawings as pointer 205, it can be an object of various shapes. For example, it can be a concept including a point, cursor, prompt, bold outline, etc. Furthermore, pointer 205 can be displayed not only corresponding to any one point on the horizontal and vertical axes of the display 180, but also corresponding to multiple points such as lines and surfaces.

[0120] Figure 5a and Figure 5b This is a diagram used to illustrate the landscape and portrait modes of the floor-standing display device according to embodiments of the present disclosure.

[0121] Reference Figure 5a and Figure 5b This shows a floor-standing display device 100.

[0122] The display device 100 can be connected to the shaft 103 and the floor stand base 105.

[0123] Axis 103 can connect to display device 100 and floor stand base 105. Axis 103 can extend vertically.

[0124] The lower end of shaft 103 can be connected to the edge of floor stand base 105.

[0125] The lower end of shaft 103 is rotatably connected to the periphery of floor support base 105.

[0126] The display device 100 and the axis 103 can rotate about the vertical axis relative to the floor stand base 105.

[0127] The upper part of shaft 103 can be connected to the rear surface of display device 100.

[0128] The floor stand base 105 can support the display device 100.

[0129] The display device 100 may be configured to include a shaft 103 and a floor stand base 105.

[0130] The display device 100 can rotate around the point where the upper part of the shaft 103 and the rear surface of the display 180 are in contact.

[0131] Figure 5aThis illustrates a scenario where the display 180 is operated in landscape mode, where its horizontal length is longer than its vertical length. Figure 5b This illustrates a scenario where the display 180 is operating in landscape mode, where its vertical length is longer than its horizontal length.

[0132] Users can carry the floor-standing display device around. That is, unlike fixed devices, floor-standing display devices offer enhanced mobility, thus freeing users from restrictions on the placement location.

[0133] Figure 6 This is a block diagram of a display device according to an embodiment of the present disclosure.

[0134] Reference Figure 6 The display device 100 may include a display 180 (see reference 180). Figure 1 ( ); wireless communication interface 173, which provides a first path based on a wireless connection with an external device; external device interface 135, which provides a second path based on a wired connection with an external device; and controller 170, which performs video processing via the first path and via the second path.

[0135] The controller 170 may include a wireless communication unit 171, which transmits and receives video data associated with the first video when the first video is input via a first path through the wireless communication interface 173.

[0136] As an example, the controller 170 may also include a wireless communication unit 171, which transmits and receives video data related to the first video with an external device via wireless communication.

[0137] The controller 170 may include a wired communication unit 172, which, when receiving the second video via a second path through an external device interface 173, transmits and receives video data associated with such a second video.

[0138] As an example, controller 170 may include a wired communication unit 172, which transmits and receives video data related to the second video with an external device via wired communication.

[0139] The video data transmitted and received via the wireless communication unit 171 and / or the wired communication unit 172 can be processed by the data processing unit 174. Thus, the video data processed by the data processing unit 174 can be displayed on the display 180. Depending on the situation, such a data processing unit 174 may be referred to as an image processing unit 174.

[0140] As described above, the external device interface 135 can receive one or more images or audio signals output from an external device wirelessly or wiredly connected to the display device 100 and transmit them to the controller 170. Therefore, the wireless communication unit 171 can also be connected to the external device interface 135.

[0141] Here, the external device can be any of a set-top box, Blu-ray player, DVD player, game console, soundbar, smartphone, PC, USB storage device, or home theater system, but this is only an example. Below, as a specific embodiment, an illustrative description will be given of the case where the external device is a smartphone.

[0142] With this structure, controller 170 processes the first video via a first path and displays it on monitor 180. Additionally, controller 170 processes the second video via a second path and displays it on monitor 180.

[0143] In general, wired connections offer more stable data transmission compared to wireless connections. For example, wired connections are often more robust to transmission delays (latencies) compared to wireless connections.

[0144] Therefore, when the same external device achieves a wired connection while wirelessly connecting, or achieves a wired connection after wireless connecting, data transmission via the wired connection may be more stable.

[0145] Therefore, when a wireless connection is established based on the first path and the first video is displayed on the display 180, if a wired connection based on the second path is detected and the same video is input through the second path, the controller 170 can process the second video through the second path based on the wired connection and display it on the display 180.

[0146] At this point, the controller 170 can determine the similarity between the video transmitted via wireless connection and the video transmitted via wired connection.

[0147] As an example, the controller 170 can determine the similarity between the first video and the second video, and based on the determination result, process the second video through the second path and display it on the display 180.

[0148] As described above, the display device 100 can wirelessly connect to an external device, for example, a smartphone, to process video and display it on the monitor 180. For example, the display device 100 can process a first video and display it on the monitor 180 via a first wireless path.

[0149] As an exemplary embodiment, the display device 100 may utilize various wireless communication display transmission technologies to display video from an external device on the display 180 of the display device 100.

[0150] Examples of such wireless communication display transmission technologies include Miracast and AirPlay.

[0151] Miracast is a 1:1 wireless communication display transmission technology defined by the Wi-Fi Alliance, essentially a form of mirroring. This transmission technology can utilize Wi-Fi to transmit video (images) and audio (sound). For example, display device 100 can use Miracast technology to transmit the screen of an Android device, such as a smartphone, to display 180.

[0152] On the other hand, AirPlay is a protocol stack developed by Apple for transmitting audio or video between devices connected to an internal network. This feature allows for the wireless streaming of music, videos, photos, and related information from Apple devices such as iPhones, iPads, and iPod touches. Mirroring functionality is also possible. For example, display device 100 can use AirPlay technology to transmit the screen of an Android device, such as a smartphone, to display device 180.

[0153] As an example, a user connects an external device such as an Android device or an Apple device to the display device 100 via wireless communication and uses the display device 100's screen 180 to view content.

[0154] On the other hand, the wired connection between the display device 100 and the external device is becoming increasingly simpler. While external devices and the display device 100 can typically be connected via RCA or HDMI, wired connections via USB are becoming increasingly easier to achieve.

[0155] As an example, DP ALT MODE (DisplayPort Alternative Mode), although a USB-C type, supports displayport mode for video transmission. It typically supports DP 1.4 and can output up to 8K 60Hz with a bandwidth of 25.92Gbps, supporting a wider bandwidth than USB 3.1 versions. It is expected that the output and bandwidth of such wired connections will gradually be enhanced. Furthermore, it is anticipated that more diverse and simpler wired connection methods utilizing portable devices such as smartphones will be provided.

[0156] Reference above Figure 5a and Figure 5b Unlike fixed devices, the floor-standing display device 100 described above has improved mobility, thus freeing users from restrictions on the placement location.

[0157] Given the enhanced mobility of the display device 100, there is a high probability that both wireless (Miracast / AirPlay) and wired (DP Alt Mode) connections originate from the same external device. Furthermore, if the same external device enables wired connectivity simultaneously with wireless connectivity, or enables wired connectivity after wireless connectivity, data transmission via wired connection is more stable.

[0158] Therefore, when the external device that was previously connected wirelessly (Miracast / Airplay) and wired (DP Alt Mode) is the same device and transmits the same image, the user's convenience can be improved when the connection is automatically switched to a wired connection.

[0159] The specific embodiments will now be described in detail with reference to the accompanying drawings.

[0160] Figure 7 This is a flowchart illustrating an operation method of a display device according to an embodiment of the present disclosure.

[0161] As an example, the operation method of the display device 100 described below can be executed by the controller 170 with the structure described above.

[0162] Users connect external devices such as Android or Apple devices to display device 100 via wireless communication and can view content using the display screen 180 of display device 100.

[0163] That is, when wireless connection input is made (S100), the controller 170 establishes a wireless connection based on the first path, thereby displaying the first video through the display 180.

[0164] In this state, the controller 170 can detect a wired connection based on the second path (S110). As an example, the controller 170 can periodically or continuously detect a wireless connection when a wireless connection is established based on the first path and a first video is displayed on the display 180.

[0165] Thus, when a wired connection is detected while a wireless connection is established via the first path and a first video is displayed on the display 180, the controller 170 can determine the similarity between the video transmitted via the wireless connection and the video transmitted via the wired connection (S120).

[0166] As an example, controller 170 can determine the similarity between a first video transmitted via a wireless connection and a second video transmitted via a wired connection. In this case, the second video is received via the wired connection, but the current state could be that the first video is displayed on monitor 180.

[0167] As an example of determining the similarity between a first video transmitted via a wireless connection and a second video transmitted via a wired connection, the controller 170 can compare a specific frame (wireless frame) of the first video transmitted via a wireless connection and a specific frame (wired frame) of the second video transmitted via a wired connection (S120).

[0168] Based on the comparison results of the wireless and wired images, it is determined whether the similarity is high (S130). If the similarity is high, the controller 170 can automatically switch the input method to a wired connection (S140). For example, when it is determined that the similarity between the wireless and wired images is above a certain threshold and thus they are essentially the same image, the controller 170 can automatically switch the input method to a wired connection.

[0169] As an example, when a user is watching specific content via a wireless connection using an external device, and then establishes a wired connection using the same external device, the same specific content can be input into the display device 100.

[0170] That is, if the same content is received from both wireless and wired connections to the same external device, the controller 170 can automatically switch the input method from wireless to wired. Thus, the controller 170 processes the first and second videos via a second path based on the wired connection for display on the monitor 180. As an example, the controller 170 can automatically switch to USB-CDP Alt Mode input.

[0171] Conversely, based on the comparison results of the wireless and wired images, it is determined whether the similarity is high (S130). If the similarity is low, the controller 170 can maintain the existing wireless connection (S150). That is, the controller 170 can continue to display the first video transmitted through the wireless connection based on the first path on the display 180.

[0172] As described above, the display device 100, which enhances mobility, allows video acquired via both wireless and wired connections to be transmitted through the same external device. In such cases, where the external device connected wirelessly (for example, Miracast / Airplay) and wiredly (for example, DP Alt Mode) is the same device and the same image is transmitted, user convenience is improved when the connection (automatic switch) is performed to a wired connection.

[0173] Figure 8 This is a schematic diagram illustrating an example of the operation process of a display device according to an embodiment of the present disclosure. Additionally, Figure 9 This is a flowchart illustrating an example of a specific operation method of a display device according to an embodiment of the present disclosure.

[0174] Figure 8 This illustrates a practical example of the operation process of a display device according to an embodiment of the present disclosure.

[0175] Reference Figure 8 The illustration schematically shows, as an example, a smartphone 300 connected to a display device 100 via wired and wireless paths, mirroring the content displayed on the smartphone 300's screen onto the display device 100, or playing VOD (video on demand) on the display device 100's screen by linking an application on the smartphone 300.

[0176] Figure 9 An example of the specific operation process of the display device 100 that can be performed under such circumstances is shown.

[0177] Below, refer to Figure 8 and Figure 9 A specific example of the operation process of a display device according to an embodiment of the present disclosure will be described.

[0178] First, users can run the VOD application through the display 301 of their smartphone 300 to watch content, for example, by watching VOD.

[0179] At this time, the user can connect the smartphone 300 and the display device 100 wirelessly (for example, Miracast or AirPlay) and view content on the display 180 of the display device 100. At this time, the display device 100 can receive video and other data from the smartphone 300 wirelessly (S200).

[0180] Reference Figure 8 The illustration shows a state where a VOD application is displayed on the screen 301 of a smartphone 300, along with recommended channels (VOD1) and recommended content (Movie 1). In this state, the user can control the application on the smartphone 300 and watch content using the screen 181 of the display device 100.

[0181] As an example, when wireless connection input is made (S200), the controller 170 establishes a wireless connection based on the first path, thereby displaying the first video through the display 181.

[0182] In this state, it is possible for a user to connect the smartphone 300 to the display device 100 via a wired connection. For example, the user can connect the smartphone 300 to the display device 100 using a USB cable. The display device 100 can then detect this wired connection (S210).

[0183] At this time, the display device 100 can be in a state where it can transmit video via a USB connection. As an example, the display device 100 may support DP Alt Mode based on a USB-C connection.

[0184] Therefore, the controller 170 can determine the similarity between the video transmitted via wireless connection and the video transmitted via wired connection (S220).

[0185] As an exemplary embodiment, the controller 170 captures a first connected frame through a first path and a second connected frame through a second path, thereby comparing the first connected frame and the second connected frame to determine the similarity of the videos.

[0186] That is, the controller 170 can capture the wireless connection screen (first connection screen) (S221). And the controller 170 can capture the wired connection screen (second connection screen) (S222). The order of these capture processes (S221, S222) is not limited. That is, the capture processes (S221, S222) can be performed simultaneously, or the wired connection screen capture process (S222) can be performed first.

[0187] As an example, uncorrected input video received via a wireless connection can be captured. Alternatively, uncorrected input video received via a wired connection can be captured in the background. That is, the wired video capture process (S222) does not need to be displayed on monitors 181 and 301.

[0188] Then, the controller 170 can compare the wireless and wired images (S223).

[0189] As an example, controller 170 for Figure 8 The image shown can capture and compare images based on wireless input and wired input.

[0190] As an example, controller 170 can compare the hash data of the first connected screen and the second connected screen to determine the similarity.

[0191] Here, hashing refers to mapping data of varying lengths to values ​​of fixed length. It allows you to store or retrieve the index or position of a specific array using the values ​​of the input data.

[0192] As another example, controller 170 can compare the metadata of the first connection screen and the second connection screen to determine the similarity.

[0193] At this point, controller 170 can use ACR (Automatic Content Recognition) to determine the similarity between the first video and the second video. For example, controller 170 can use ACR to determine the similarity between the first connected frame and the second connected frame.

[0194] ACR (Acoustic Recognition) is a technology that identifies currently displayed content by comparing it with other video sources. Specifically, it can be viewed as converting live broadcast or recorded video into a digital format, then extracting audio or video information from it and comparing it with live or stored video files to identify the content regardless of its source.

[0195] That is, the controller 170 can convert the first connected screen and the second connected screen into digital format, extract audio or video information, and identify the content to determine the similarity between the first video and the second video.

[0196] Thus, based on the comparison results of the wireless and wired images, when a high similarity is determined (S230), the controller 170 can automatically switch the input method to a wired connection (S240). For example, when it is determined that the similarity between the wireless and wired images is above a certain threshold, and thus the first connected image and the second connected image are essentially the same image, the controller 170 can automatically switch the input method to a wired connection (S240).

[0197] As an example, if a user uses an external device to view specific content via a wireless connection, and a wired connection is established via the same external device, the same specific content will be input to the display device 100.

[0198] That is, if the same content is received from both wireless and wired connections to the same external device, the controller 170 can automatically switch the input method from wireless to wired. Thus, the controller 170 can process the first and second videos and display them on the monitor 181 via a second path based on the wired connection. As an example, the controller 170 can automatically switch to USB-CDP Alt Mode input.

[0199] Conversely, based on the comparison results of the wireless and wired images, it is determined whether the similarity is high (S230). If the similarity is low (no), the controller 170 can maintain the existing wireless connection (S250). That is, the controller 170 can continue to display the first video transmitted through the wireless connection based on the first path on the display 181.

[0200] The rest are the same as the above references. Figure 6 and Figure 7 The situations described are the same. Therefore, repeated explanations are omitted.

[0201] Figure 10 This is a schematic diagram illustrating another example of the operation process of a display device according to an embodiment of the present disclosure. Additionally, Figure 11 This is a flowchart illustrating another example of a specific operation method of a display device according to an embodiment of the present disclosure.

[0202] Figure 10 This is another actual example of the operation process of a display device illustrating one embodiment of the present disclosure.

[0203] Reference Figure 10 ,and Figure 8 Similarly, as an example of an external device, a smartphone 300 is connected to a display device 100 via wired or wireless paths to mirror the content displayed on the smartphone 300's screen onto the display device 100, or to play VOD (video on demand) on the display device 100's screen by linking an application in the smartphone 300.

[0204] Figure 11 An example of the specific operation process of the display device 100 that can be performed under such circumstances is shown.

[0205] Below, refer to Figure 10 and Figure 11 A specific example of the operation process of a display device according to an embodiment of the present disclosure will be described.

[0206] First, users can run the VOD application through the display 301 of their smartphone 300 to watch content, for example, by watching VOD.

[0207] At this time, the user can connect the smartphone 300 and the display device 100 wirelessly (for example, Miracast or AirPlay) and view content on the display 180 of the display device 100. At this time, the display device 100 can receive video and other data from the smartphone 300 wirelessly (S300).

[0208] Reference Figure 10 The illustration shows a VOD application displayed on the screen 301 of a smartphone 300, along with recommended channels (VOD1) and recommended content (Movie 1). In this state, the user can control the smartphone 300's application and view content using the screen 181 of the display device 100.

[0209] As an example, when a wireless connection input is made (S300), the controller 170 establishes a wireless connection based on the first path, thereby displaying the first video through the display 181.

[0210] In this state, it is possible for a user to connect the smartphone 300 to the display device 100 via a wired connection. For example, the user can connect the smartphone 300 and the display device 100 using a USB cable. The display device 100 can then detect this wired connection (S310).

[0211] At this time, the display device 100 can be in a state where it can transmit video via a USB connection. As an example, the display device 100 may support DP Alt Mode based on a USB-C connection.

[0212] Therefore, the controller 170 can determine the similarity between the video transmitted via wireless connection and the video transmitted via wired connection (S320).

[0213] As an exemplary embodiment, the controller 170 may request that a marker 302 pop up on the screen of an external device (S321). Here, as an example, the marker 302 is displayed as a dot, but it can be represented by various other shapes. The visible area of ​​such a marker 302 is very short, but the marker 302 can also be represented by a watermark shape that is not recognizable to the user.

[0214] Thus, the image with mark 302 is transmitted to the display device, so that a screen containing the same mark 182 can be displayed on the display 181 of the display device 100.

[0215] Therefore, the controller 170 can capture a first frame containing marker 182 in the first connected frame via the first path (S322), and capture a second frame containing marker 182 in the second connected frame via the second path (S323). Furthermore, the controller 170 can compare the first frame and the second frame containing marker 182 (S324) to determine the similarity of the videos.

[0216] That is, the controller 170 can capture the wireless connection screen (first connection screen) containing marker 182 (S322). Furthermore, the controller 170 can capture the wired connection screen (second connection screen) containing marker 182 (S323). The order of these capture processes (S322, S323) is not limited. That is, the capture processes (S322, S323) can be performed simultaneously, or the wired connection screen capture process (S323) can be performed first.

[0217] As an example, uncorrected input video received via a wireless connection can be captured. Alternatively, uncorrected input video received via a wired connection can be captured in the background. That is, the video capture process via wired connection (S323) does not need to be displayed on monitors 181 and 301.

[0218] Then, the controller 170 can compare the two captured images (S324).

[0219] As an example, controller 170 for Figure 10 The image shown can capture and compare images based on wireless input and wired input.

[0220] As an exemplary embodiment, in the event of latancy or delay between the wired and wireless connections, the controller 170 may request a pop-up flag from the smartphone 300 (S321). For example, in the event of a delay between the first connection screen and the second connection screen, the controller 170 may request a pop-up flag from the smartphone 300 (S321).

[0221] In this case, as an example, controller 170 may maintain the pop-up time of marker 302 for a longer period than the delay. On the other hand, controller 170 may set the pop-up time of marker 302 for a period of time or longer, taking into account the communication status.

[0222] As an example, in situations where there is a capture delay between wired and wireless images and the scene changes suddenly, the wired and wireless images may differ significantly. As another example, even when capturing the same image simultaneously, the delay may cause the first and second connected images to be different.

[0223] Therefore, when the controller 170 of the display device 100 transmits a command to the smartphone 300 through a separate control channel to pop up the marker 302, even if there are differences between the wired and wireless screens due to delay, they are comparable because the positions of the overlay markers 182 are the same.

[0224] Based on the comparison results of the wireless and wired images, if the similarity is determined to be high (Yes; S330), the controller 170 can automatically switch the input method to a wired connection (S340). As an example, when it is determined that the similarity between the wireless and wired images is above a certain threshold, and thus the first connected image and the second connected image are essentially the same image, the controller 170 can automatically switch the input method to a wired connection (S340).

[0225] That is, if the same content is received from both a wireless and wired connection to the same external device, the controller 170 can automatically switch the input method from wireless to wired. Thus, the controller 170 can process the first and second videos and display them on the monitor 181 via a second path based on the wired connection. As an example, the controller 170 can automatically switch to USB-CDP Alt Mode input.

[0226] Conversely, based on the comparison results of the wireless and wired images, it is determined whether the similarity is high (S330). If the similarity is low (no), the controller 170 can maintain the existing wireless connection (S350). That is, the controller 170 can continue to display the first video obtained through the wireless connection based on the first path on the display 181.

[0227] Any other parts not specified above are consistent with the above references. Figures 6 to 9 The situations described are the same. Therefore, repeated explanations are omitted.

[0228] According to one embodiment of the present invention, the above-described method can be implemented by processor-readable code in a medium containing a program. Examples of processor-readable media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.

[0229] The display device described above is not limited to the structure and method of the embodiments described above, but can be selectively combined in whole or in part to make various modifications to the embodiments described above.

[0230] Industrial utilization potential

[0231] According to this disclosure, a display device and a method of operating thereof that can view video via wired and wireless connections may be provided.

Claims

1. A display device comprising: monitor; A wireless communication interface that provides a first path based on a wireless connection with an external device; An external device interface that provides a second path based on a wired connection with an external device; and The controller processes the first video and displays it on the display via the first path. When a wired connection based on the second path is detected and a second video is input via the second path, the controller determines the similarity between the first video and the second video, and processes the second video via the second path and displays it on the display based on the determination result.

2. The display device according to claim 1, wherein, The controller captures a first connection screen that passes through the first path and a second connection screen that passes through the second path, and compares the first connection screen and the second connection screen to determine their similarity.

3. The display device according to claim 2, wherein, The controller compares the hash data of the first connection screen and the second connection screen.

4. The display device according to claim 2, wherein, The controller compares the metadata of the first connection screen and the second connection screen.

5. The display device according to claim 1, wherein, After the controller converts the first connection screen and the second connection screen into digital format, it uses Automatic Content Recognition (ACR) to determine the similarity between the first video and the second video by extracting audio or video information.

6. The display device according to claim 1, wherein, The controller requests a marker to pop up on the screen of the external device, captures a first screen containing the marker in the first connected screen via the first path, captures a second screen containing the marker in the second connected screen via the second path, and compares the first screen and the second screen to determine the similarity.

7. The display device according to claim 6, wherein, In the event of a time delay between the first connection screen and the second connection screen, the controller requests the external device to display the aforementioned marker.

8. The display device according to claim 7, wherein, The controller will keep the pop-up time of the above-mentioned marker longer than the above-mentioned delay.

9. A method of operating a display device, comprising the following steps: The first video is processed and displayed on the aforementioned display via a first path implemented through a wireless connection; Detect wired connections implemented based on the second path; When a second video is input via the second path described above, the similarity between the first video and the second video is determined; and Based on the above judgment result, the second video is processed through the second path and displayed on the display.

10. The method of operating the display device according to claim 9, wherein, The steps to determine the above similarity include the following: Capture the first connected frame via the aforementioned first path; Capture the second connection screen via the aforementioned second path; and Compare the first connection screen and the second connection screen mentioned above.

11. The method of operating the display device according to claim 10, wherein, In the above comparison step, the hash data of the first connection screen and the second connection screen are compared.

12. The method of operating the display device according to claim 10, wherein, In the above comparison step, the metadata of the first connection screen and the second connection screen are compared.

13. The method of operating the display device according to claim 9, wherein, The steps to determine the above similarity include the following: Request a pop-up icon to appear on the screen of an external device; Capture the first frame containing the aforementioned marker in the first connected frame via the first path described above; Capture the second frame containing the aforementioned marker in the second connected frame via the second path described above; and Compare the first image above with the second image above.

14. The method of operating the display device according to claim 13, wherein, In the event of a time delay between the first connection screen and the second connection screen, please display the aforementioned marker.

15. The method of operating the display device according to claim 13, wherein, The pop-up time of the above markers should be kept longer than the above delay.

Images