Display device and operation method thereof

Abstract

A display device and an operation method thereof are disclosed. A display device according to at least one of various embodiments of the present disclosure may comprise: a memory; and a processor for receiving a packet from a remote control device, if the received packet is a packet having a first parameter value and a preset condition is satisfied, performing pairing by transmitting a scan signal to the remote control device, and transmitting a control signal related to the preset condition to the paired remote control device.

Description

Display device and method of operation thereof

[0001] The present disclosure relates to a display device and a method of operating the same.

[0002] The functions of recent terminals are becoming more diverse, including data and voice communication, taking pictures and videos through a camera, voice recording, playing music files through a speaker system, and outputting images or videos to a display.

[0003] Some terminals have added electronic game play capabilities or perform multimedia player functions.

[0004] As terminals become more diverse in their functions, they are being implemented in the form of multimedia players with complex functions such as taking photos or videos, playing music or video files, playing games, and receiving broadcasts.

[0005] The present disclosure provides a display device and an operating method thereof that operate in conjunction with a remote control device when paired with a remote control device other than a traditional type of remote control device.

[0006] A display device according to at least one of the various embodiments of the present disclosure may include a display having a plurality of codes formed on a panel; and a processor that obtains the code information from a remote control device and controls a cursor to be output at a position corresponding to the code information.

[0007] According to at least one of the various embodiments of the present disclosure, each of the codes may have identification information and / or coordinate information.

[0008] According to at least one of the various embodiments of the present disclosure, each of the codes may be formed around a pixel formed on the panel.

[0009] According to at least one of the various embodiments of the present disclosure, each of the codes may be formed between pixels formed on the panel.

[0010] According to at least one of the various embodiments of the present disclosure, the plurality of codes may be arranged at an edge on the panel, and / or at a predefined interval on the panel.

[0011] According to at least one of the various embodiments of the present disclosure, the plurality of codes may be arranged at a narrower interval in at least one of the functional area and the menu area on the panel compared to the other areas.

[0012] According to at least one of the various embodiments of the present disclosure, the display may have a film applied thereon printed so that the plurality of codes are arranged on the panel.

[0013] According to at least one of the various embodiments of the present disclosure, when there are multiple pieces of code information obtained from the remote control device, the processor may select representative code information and determine a location at which a cursor is to be output based on the representative code information.

[0014] According to at least one of the various embodiments of the present disclosure, the processor may further obtain a wake-up signal from the remote control device, and, when the wake-up signal is received, output a cursor at the cursor position output at the most recent point in time.

[0015] According to at least one of the various embodiments of the present disclosure, the processor may further obtain distance information from the remote control device.

[0016] According to at least one of the various embodiments of the present disclosure, the processor may determine a location at which the cursor is to be output by considering the distance information based on the code information.

[0017] According to at least one of the various embodiments of the present disclosure, the processor can control the processor to recognize a gesture and output menu information or perform an operation corresponding to the recognized gesture when only the distance information is obtained after obtaining the code information.

[0018] According to at least one of the various embodiments of the present disclosure, the processor may further obtain a button press signal from the remote control device.

[0019] According to at least one of the various embodiments of the present disclosure, the processor can determine and output menu information based on code information immediately before a button press signal of the remote control device is acquired.

[0020] According to at least one of the various embodiments of the present disclosure, the remote control device can recognize the code through an image sensor.

[0021] According to at least one of the various embodiments of the present disclosure, when paired with a remote control device other than a traditional type of remote control device, the display device can be operated in conjunction with the remote control device, thereby improving the convenience of using the display device for a user.

[0022] FIG. 1 is a block diagram illustrating the configuration of a display device according to one embodiment of the present disclosure.

[0023] FIG. 2 is a block diagram of a remote control device according to an embodiment of the present disclosure.

[0024] Fig. 3 shows an example of an actual configuration of a remote control device according to one embodiment of the present disclosure.

[0025] FIG. 4 shows an example of utilizing a remote control device according to an embodiment of the present disclosure.

[0026] FIG. 5 is a drawing for explaining the horizontal mode and vertical mode of a stand-type display device according to an embodiment of the present disclosure.

[0027] FIG. 6 is a block diagram illustrating a connection control operation between a display device and a remote control device according to one embodiment of the present disclosure.

[0028] FIGS. 7 to 11 are drawings illustrating code arrangement or distribution on a display panel according to an embodiment of the present disclosure.

[0029] FIGS. 12 to 14 are block diagrams illustrating an operation method of a display device connected to a remote control device according to an embodiment of the present disclosure.

[0030] FIG. 15 is a diagram illustrating a display operation according to a remote control device connected according to one embodiment of the present disclosure.

[0031] FIG. 16 is a drawing illustrating an operation of a display device that detects movement of a connected remote control device and responds according to an embodiment of the present disclosure.

[0032] Hereinafter, embodiments related to the present disclosure will be described in more detail with reference to the drawings. The suffixes "module" and "part" used in the following description for components are assigned or used interchangeably solely for the convenience of writing the specification, and do not in themselves have distinct meanings or roles.

[0033] FIG. 1 is a block diagram illustrating the configuration of a display device (100) according to one embodiment of the present disclosure.

[0034] Referring to FIG. 1, the display device (100) may include a broadcast receiving unit (130), an external device interface unit (135), a storage unit (140), a user input interface unit (150), a control unit (170), a wireless communication unit (173), a voice acquisition unit (175), a display unit (180), an audio output unit (185), and a power supply unit (190).

[0035] The broadcast receiving unit (130) may include a tuner (131), a demodulation unit (132), and a network interface unit (133).

[0036] The tuner (131) can select a specific broadcast channel according to a channel selection command. The tuner (131) can receive a broadcast signal for the selected specific broadcast channel.

[0037] The demodulator (132) can separate the received broadcast signal into a video signal, an audio signal, and a data signal related to the broadcast program, and can restore the separated video signal, audio signal, and data signal into a form that can be output.

[0038] The network interface unit (133) may provide an interface for connecting the display device (100) to a wired / wireless network including the Internet. The network interface unit (133) may transmit or receive data to or from other users or other electronic devices via the connected network or another network linked to the connected network.

[0039] The network interface unit (133) can access a predetermined web page through a connected network or another network linked to the connected network. That is, by accessing a predetermined web page through a network, data can be transmitted or received with the corresponding server.

[0040] In addition, the network interface unit (133) can receive content or data provided by a content provider or network operator. That is, the network interface unit (133) can receive content such as movies, advertisements, games, VOD (Video on Demand), broadcast signals, etc., and information related thereto provided from a content provider or network provider via a network.

[0041] Additionally, the network interface unit (133) can receive firmware update information and update files provided by the network operator, and transmit data to the Internet or content provider or network operator.

[0042] The network interface unit (133) can select and receive a desired application from among applications open to the public via a network.

[0043] The external device interface unit (135) can receive an application or a list of applications in an adjacent external device and transmit it to the control unit (170) or storage unit (140).

[0044] The external device interface unit (135) can provide a connection path between the display device (100) and the external device. The external device interface unit (135) can receive one or more of images and audio output from an external device connected wirelessly or wiredly to the display device (100) and transmit them to the control unit (170). The external device interface unit (135) can include a plurality of external input terminals. The plurality of external input terminals can include an RGB terminal, one or more HDMI (High Definition Multimedia Interface) terminals, and a component terminal.

[0045] The voice signal of an external device input through the external device interface unit (135) can be output through the display unit (180). The voice signal of an external device input through the external device interface unit (135) can be output through the audio output unit (185).

[0046] An external device that can be connected to the external device interface unit (135) may be any one of a set-top box, a Blu-ray player, a DVD player, a game console, a sound bar, a smartphone, a PC, a USB memory, and a home theater, but this is only an example.

[0047] Additionally, some content data stored in the display device (100) can be transmitted to a selected user or electronic device among other users or other electronic devices pre-registered in the display device (100).

[0048] The storage unit (140) stores programs for each signal processing and control within the control unit (170), and can store signal-processed images, voices, or data signals.

[0049] In addition, the storage unit (140) may perform a function for temporary storage of video, audio, or data signals input from an external device interface unit (135) or a network interface unit (133), and may also store information about a specific image through a channel memory function.

[0050] The storage unit (140) can store an application or a list of applications input from the external device interface unit (135) or the network interface unit (133).

[0051] The display device (100) can play content files (video files, still image files, music files, document files, application files, etc.) stored in the storage unit (140) and provide them to the user.

[0052] The user input interface unit (150) can transmit a signal input by a user to the control unit (170), or transmit a signal from the control unit (170) to the user. For example, the user input interface unit (150) can receive and process control signals such as power on / off, channel selection, and screen setting from the remote control device (200) according to various communication methods such as Bluetooth, Ultra Wideband (UWB), ZigBee, Radio Frequency (RF) communication, or infrared (IR) communication, or process the control signals from the control unit (170) to be transmitted to the remote control device (200).

[0053] In addition, the user input interface unit (150) can transmit control signals input from local keys (not shown) such as a power key, channel key, volume key, and setting value to the control unit (170).

[0054] An image signal processed by the control unit (170) can be input to the display unit (180) and displayed as an image corresponding to the image signal. In addition, an image signal processed by the control unit (170) can be input to an external output device through the external device interface unit (135).

[0055] The voice signal processed in the control unit (170) can be output as audio to the audio output unit (185). In addition, the voice signal processed in the control unit (170) can be input to an external output device through the external device interface unit (135).

[0056] In addition, the control unit (170) can control the overall operation within the display device (100).

[0057] In addition, the control unit (170) can control the display device (100) by a user command or internal program input through the user input interface unit (150), and can connect to a network to enable the user to download a desired application or application list into the display device (100).

[0058] The control unit (170) enables the channel information selected by the user to be output through the display unit (180) or audio output unit (185) together with the processed video or audio signal.

[0059] In addition, the control unit (170) allows a video signal or audio signal from an external device, for example, a camera or camcorder, input through the external device interface unit (135) to be output through the display unit (180) or audio output unit (185) in accordance with an external device video playback command received through the user input interface unit (150).

[0060] Meanwhile, the control unit (170) can control the display unit (180) to display an image, and for example, can control the display unit (180) to display a broadcast image input through the tuner (131), an external input image input through the external device interface unit (135), an image input through the network interface unit, or an image stored in the storage unit (140). In this case, the image displayed on the display unit (180) can be a still image or a moving image, and can be a 2D image or a 3D image.

[0061] In addition, the control unit (170) can control the playback of content stored in the display device (100), received broadcast content, or external input content input from outside, and the content can be in various forms such as broadcast video, external input video, audio file, still image, connected web screen, and document file.

[0062] The wireless communication unit (173) can communicate with an external device through wired or wireless communication. The wireless communication unit (173) can perform short-range communication with the external device. To this end, the wireless communication unit (173) can support short-range communication using at least one of Bluetooth™, BLE (Bluetooth Low Energy), RFID (Radio Frequency Identification), Infrared Data Association (IrDA), UWB (Ultra Wideband), ZigBee, NFC (Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technologies. This wireless communication unit (173) can support wireless communication between the display device (100) and a wireless communication system, between the display device (100) and another display device (100), or between the display device (100) and a network where the display device (100, or an external server) is located via a short-range wireless communication network (Wireless Area Network). The short-range wireless communication network may be a short-range wireless personal area network (Wireless Personal Area Network).

[0063] Here, the other display device (100) may be a wearable device (e.g., a smart watch, smart glasses, a head mounted display (HMD), a mobile terminal such as a smart phone) that can exchange data with the display device (100) according to the present disclosure (or can be linked). The wireless communication unit (173) may detect (or recognize) a wearable device capable of communication around the display device (100). Furthermore, if the detected wearable device is an authenticated device to communicate with the display device (100) according to the present disclosure, the control unit (170) may transmit at least a part of the data processed in the display device (100) to the wearable device through the wireless communication unit (173). Accordingly, a user of the wearable device may use the data processed in the display device (100) through the wearable device.

[0064] The voice acquisition unit (175) can acquire audio. The voice acquisition unit (175) can include at least one microphone (not shown) and can acquire audio around the display device (100) through the microphone (not shown).

[0065] The display unit (180) can generate a driving signal by converting a video signal, data signal, OSD signal processed by the control unit (170) or a video signal, data signal, etc. received from the external device interface unit (135) into R, G, B signals, respectively.

[0066] Meanwhile, since the display device (100) illustrated in FIG. 1 is merely an example of the present disclosure, some of the illustrated components may be integrated, added, or omitted depending on the specifications of the display device (100) actually implemented.

[0067] That is, two or more components may be combined into a single component, or a single component may be subdivided into two or more components, as needed. Furthermore, the functions performed by each block are intended to illustrate embodiments of the present disclosure, and their specific operations or devices do not limit the scope of the present disclosure.

[0068] According to another embodiment of the present disclosure, the display device (100) may receive and play back an image through a network interface unit (133) or an external device interface unit (135) without having a tuner (131) and a demodulator (132), unlike as shown in FIG. 1.

[0069] For example, the display device (100) may be implemented separately as an image processing device, such as a set-top box, for receiving broadcast signals or contents according to various network services, and a content playback device for playing contents input from the image processing device.

[0070] In this case, the method of operating the display device according to the embodiment of the present disclosure to be described below may be performed by any one of the display device (100) described with reference to FIG. 1, as well as an image processing device such as a separate set-top box, or a content playback device having a display unit (180) and an audio output unit (185).

[0071] The audio output unit (185) receives a signal processed by the control unit (170) and outputs it as voice.

[0072] The power supply unit (190) supplies power to the entire display device (100). In particular, it can supply power to a control unit (170) that can be implemented in the form of a system on chip (SOC), a display unit (180) for displaying images, and an audio output unit (185) for outputting audio.

[0073] Specifically, the power supply unit (190) may be equipped with a converter that converts AC power into DC power and a dc / dc converter that converts the level of the DC power.

[0074] Next, a remote control device according to an embodiment of the present disclosure will be described with reference to FIGS. 2 and 3.

[0075] FIG. 2 is a block diagram of a remote control device according to an embodiment of the present disclosure, and FIG. 3 shows an example of an actual configuration of a remote control device according to an embodiment of the present disclosure.

[0076] First, referring to FIG. 2, the remote control device (200) may include a fingerprint recognition unit (210), a wireless communication unit (220), a user input unit (230), a sensor unit (240), an output unit (250), a power supply unit (260), a storage unit (270), a control unit (280), and a voice acquisition unit (290).

[0077] Referring to FIG. 2, the wireless communication unit (220) transmits and receives signals with any one of the display devices according to the embodiments of the present disclosure described above.

[0078] The remote control device (200) may be equipped with an RF module (221) capable of transmitting and receiving signals with the display device (100) according to RF communication standards, and may be equipped with an IR module (223) capable of transmitting and receiving signals with the display device (100) according to IR communication standards. In addition, the remote control device (200) may be equipped with a Bluetooth module (225) capable of transmitting and receiving signals with the display device (100) according to Bluetooth communication standards. In addition, the remote control device (200) may be equipped with an NFC module (227) capable of transmitting and receiving signals with the display device (100) according to NFC (Near Field Communication) communication standards, and may be equipped with a WLAN module (229) capable of transmitting and receiving signals with the display device (100) according to WLAN (Wireless LAN) communication standards.

[0079] Additionally, the remote control device (200) transmits a signal containing information about the movement of the remote control device (200) to the display device (100) through the wireless communication unit (220).

[0080] Meanwhile, the remote control device (200) can receive a signal transmitted by the display device (100) through the RF module (221), and, if necessary, can transmit commands for turning the power on / off, changing the channel, changing the volume, etc. to the display device (100) through the IR module (223).

[0081] The user input unit (230) may be configured as a keypad, buttons, a touch pad, or a touch screen. The user can input commands related to the display device (100) to the remote control device (200) by operating the user input unit (230). If the user input unit (230) is equipped with a hard key button, the user can input commands related to the display device (100) to the remote control device (200) by pushing the hard key button. This will be described with reference to FIG. 3.

[0082] Referring to FIG. 3, the remote control device (200) may include a plurality of buttons. The plurality of buttons may include a fingerprint recognition button (212), a power button (231), a home button (232), a live button (233), an external input button (234), a volume control button (235), a voice recognition button (236), a channel change button (237), a confirmation button (238), and a back button (239).

[0083] The fingerprint recognition button (212) may be a button for recognizing a user's fingerprint. In one embodiment, the fingerprint recognition button (212) may be capable of a push operation, and thus may receive a push operation and a fingerprint recognition operation. The power button (231) may be a button for turning the display device (100) on / off. The home button (232) may be a button for moving to the home screen of the display device (100). The live button (233) may be a button for displaying a real-time broadcast program. The external input button (234) may be a button for receiving an external input connected to the display device (100). The volume control button (235) may be a button for adjusting the volume output by the display device (100). The voice recognition button (236) may be a button for receiving a user's voice and recognizing the received voice. The channel change button (237) may be a button for receiving a broadcast signal of a specific broadcast channel. The confirmation button (238) may be a button for selecting a specific function, and the back button (239) may be a button for returning to the previous screen.

[0084] Let's explain Figure 2 again.

[0085] When the user input unit (230) is equipped with a touch screen, the user can input commands related to the display device (100) using the remote control device (200) by touching the soft keys of the touch screen. In addition, the user input unit (230) may be equipped with various types of input devices that can be operated by the user, such as a scroll key or a jog key, and the present embodiment does not limit the scope of the present disclosure.

[0086] The sensor unit (240) may be equipped with a gyro sensor (241) or an acceleration sensor (243), and the gyro sensor (241) may sense information about the movement of the remote control device (200).

[0087] For example, the gyro sensor (241) can sense information about the operation of the remote control device (200) based on the x, y, and z axes, and the acceleration sensor (243) can sense information about the movement speed of the remote control device (200). Meanwhile, the remote control device (200) can further include a distance measuring sensor, so as to sense the distance to the display unit (180) of the display device (100).

[0088] The output unit (250) can output a video or audio signal corresponding to the operation of the user input unit (230) or to a signal transmitted from the display device (100). Through the output unit (250), the user can recognize whether the user input unit (230) is being operated or whether the display device (100) is being controlled.

[0089] For example, the output unit (250) may be equipped with an LED module (251) that lights up when the user input unit (230) is operated or a signal is transmitted and received with the display device (100) through the wireless communication unit (220), a vibration module (253) that generates vibration, a sound output module (255) that outputs sound, or a display module (257) that outputs an image.

[0090] In addition, the power supply unit (260) supplies power to the remote control device (200), and can reduce power waste by stopping the power supply when the remote control device (200) is not moved for a predetermined period of time. The power supply unit (260) can resume the power supply when a predetermined key provided in the remote control device (200) is operated.

[0091] The storage unit (270) can store various types of programs, application data, etc. required for the control or operation of the remote control device (200). If the remote control device (200) wirelessly transmits and receives signals through the display device (100) and the RF module (221), the remote control device (200) and the display device (100) transmit and receive signals through a predetermined frequency band.

[0092] The control unit (280) of the remote control device (200) can store and reference information regarding the frequency band, etc., that can wirelessly transmit and receive signals with the display device (100) paired with the remote control device (200), in the storage unit (270).

[0093] The control unit (280) controls all matters related to the control of the remote control device (200). The control unit (280) can transmit a signal corresponding to a predetermined key operation of the user input unit (230) or a signal corresponding to the movement of the remote control device (200) sensed by the sensor unit (240) to the display device (100) via the wireless communication unit (220).

[0094] Additionally, the voice acquisition unit (290) of the remote control device (200) can acquire voice.

[0095] The voice acquisition unit (290) may include at least one microphone (291) and may acquire voice through the microphone (291).

[0096] Next, Figure 4 is described.

[0097] FIG. 4 shows an example of utilizing a remote control device according to an embodiment of the present disclosure.

[0098] Figure 4 (a) illustrates that a pointer (205) corresponding to a remote control device (200) is displayed on a display unit (180).

[0099] The user can move or rotate the remote control device (200) up and down, left and right. The pointer (205) displayed on the display unit (180) of the display device (100) corresponds to the movement of the remote control device (200). As shown in the drawing, the pointer (205) moves and is displayed according to the movement in 3D space, so the remote control device (200) can be called a space remote control.

[0100] Figure 4 (b) illustrates that when a user moves the remote control device (200) to the left, the pointer (205) displayed on the display unit (180) of the display device (100) also moves to the left in response.

[0101] Information about the movement of the remote control device (200) detected by the sensor of the remote control device (200) is transmitted to the display device (100). The display device (100) can calculate the coordinates of the pointer (205) from the information about the movement of the remote control device (200). The display device (100) can display the pointer (205) to correspond to the calculated coordinates.

[0102] Figure 4 (c) illustrates a case where a user moves the remote control device (200) away from the display unit (180) while pressing a specific button within the remote control device (200). As a result, a selection area within the display unit (180) corresponding to the pointer (205) can be zoomed in and displayed in an enlarged manner.

[0103] Conversely, when the user moves the remote control device (200) closer to the display unit (180), the selection area within the display unit (180) corresponding to the pointer (205) may be zoomed out and displayed in a reduced size.

[0104] Meanwhile, when the remote control device (200) moves away from the display unit (180), the selection area may be zoomed out, and when the remote control device (200) moves closer to the display unit (180), the selection area may be zoomed in.

[0105] In addition, when a specific button within the remote control device (200) is pressed, recognition of up, down, left, and right movements may be excluded. That is, when the remote control device (200) moves away from or toward the display unit (180), up, down, left, and right movements may not be recognized, and only forward and backward movements may be recognized. When a specific button within the remote control device (200) is not pressed, only the pointer (205) moves in accordance with the up, down, left, and right movements of the remote control device (200).

[0106] Meanwhile, the movement speed or movement direction of the pointer (205) can correspond to the movement speed or movement direction of the remote control device (200).

[0107] Meanwhile, the pointer in this specification refers to an object displayed on the display unit (180) in response to the operation of the remote control device (200). Therefore, objects of various shapes other than the arrow shape illustrated in the drawing can be used as the pointer (205). For example, the pointer may be a concept including a point, a cursor, a prompt, a thick outline, etc. In addition, the pointer (205) may be displayed corresponding to one point on the horizontal or vertical axis on the display unit (180), or may be displayed corresponding to multiple points such as lines or surfaces.

[0108] FIG. 5 (a) and FIG. 5 (b) are drawings for explaining the horizontal mode and vertical mode of a stand-type display device according to an embodiment of the present disclosure.

[0109] Referring to (a) and (b) of FIG. 5, a stand-type display device (100) is illustrated.

[0110] A shaft (103) and a stand base (105) can be connected to the display device (100).

[0111] The shaft (103) can connect the display device (100) and the stand base (105). The shaft (103) can extend vertically.

[0112] The lower end of the shaft (103) can be connected to the edge of the stand base (105).

[0113] The lower end of the shaft (103) can be rotatably connected to the periphery of the stand base (105).

[0114] The display device (100) and shaft (103) can rotate around a vertical axis with respect to the stand base (105).

[0115] The upper part of the shaft (103) can be connected to the rear of the display device (100).

[0116] The stand base (105) can serve to support the display device (100).

[0117] The display device (100) may be configured to include a shaft (103) and a stand base (105).

[0118] The display device (100) can rotate around the point where the upper part of the shaft (103) and the rear part of the display (180) meet.

[0119] Figure 5 (a) shows that the display (180) operates in a landscape mode in which the horizontal length is greater than the vertical length, and Figure 5 (b) shows that the display (180) operates in a landscape mode in which the vertical length is greater than the horizontal length.

[0120] The user can move the stand-type display device (100). That is, unlike a fixed device, the stand-type display device (100) has improved mobility, so the user is not restricted by the placement location.

[0121] A display device (100) is typically paired and connected with a remote control device having a traditional shape or form (e.g., a shape such as that shown in FIG. 3), performs data communication, and operates accordingly. However, in the case of traditional remote control devices, their weight and mechanical structure make them unsuitable for gestures, and thus, they are vulnerable to detailed tasks such as drawing patterns, writing, or drawing on the display device (100).

[0122] The present disclosure hereinafter discloses a display device and an operating method thereof that operates according to a remote control device when paired or connected with a remote control device other than a traditional type of remote control device.

[0123] Accordingly, when referred to as a remote control device (200) hereinafter, it may refer to a remote control device of a pen type or pen shape as illustrated in FIG. 7, rather than a traditional remote control device as illustrated in FIG. 3. Meanwhile, the configuration of the remote control device (200) as illustrated in FIG. 7 may include, for example, all or part of the configuration as illustrated in FIG. 2.

[0124] FIG. 6 is a block diagram illustrating a connection control operation between a display device and a remote control device according to one embodiment of the present disclosure.

[0125] At least one remote control device (200) can be paired and connected to the display device (100). Meanwhile, the remote control device (200) can also be connected to the display device (100) via a server (300).

[0126] As described above, when the display device (100) is connected to a remote control device (200) other than a traditional remote control device, it may include a display having a plurality of codes formed on a display panel constituting the display (180) for operation. In this case, the plurality of codes may be formed, for example, by applying a printed film containing or printing the plurality of codes so that they can be placed at appropriate locations on the panel.

[0127] The display device (100) may further include a processor (not shown) to connect to a remote control device (200) and control the operation of the display device (100) accordingly. In this case, the processor may be, for example, a configuration corresponding to or including the controller (170) of FIG. 1. However, for convenience, it will be described below by referring to it as a processor.

[0128] The processor of the display device (100) can identify the type of the connected remote control device (200), whether it is a traditional type remote control device as illustrated in FIG. 3, for example, or a remote control device (200) as illustrated in FIG. 7 according to the present disclosure.

[0129] The remote control device (200) can read a code placed on a display panel, including a sensor. At this time, the sensor may include at least one of a camera sensor, an image sensor, or a dedicated sensor for reading codes.

[0130] When a remote control device (200) equipped with an attached or built-in sensor is directed toward the panel of the display device (100), the remote control device (200) can read code information positioned at a corresponding location on the panel. Alternatively, the remote control device (200) can capture an area of ​​the panel containing a code and analyze the captured image to obtain code information. The code information thus obtained can be transmitted to the display device (100).

[0131] The processor of the display device (100) can obtain code information from the connected remote control device (200). At this time, the processor of the display device (100) can generate a signal including at least one of distance information (or length information), direction information, velocity information (or moving speed information), and predetermined button press selection information provided in the remote control device (200) in addition to the code information from the remote control device (200), and transmit the signal to the display device (100). Accordingly, when the display device (100) receives a signal (i.e., a packet) from the remote control device (200), it can parse the signal, distinguish and classify the information included in the received signal, and process and store the information.

[0132] The processor of the display device (100) can perform at least one of cursor output, menu information output, and specific operation performance, based on information obtained from the remote control device (200).

[0133] In the above, when performing a specific action, for example, based on information obtained from the remote control device (200) in the display device (100), it can be determined whether the input (i.e., movement) of the remote control device (200) is a gesture input. If, as a result of the determination, the input of the remote control device (200) according to the corresponding information is identified as a gesture, the display device (100) can determine whether a corresponding gesture exists, and if the corresponding gesture exists as a result of the determination, it can operate to perform an action mapped or linked to the corresponding gesture. Meanwhile, although it is expressed as performing a specific action, since this is a response according to a gesture, even in this case, the action may also include cursor appearance, cursor removal, menu output, etc.

[0134] FIGS. 7 to 11 are drawings illustrating code arrangement or distribution on a display panel according to an embodiment of the present disclosure.

[0135] As described above, various examples of codes that must be included on the display panel to enable data communication between a remote control device (200) and a display device (100) other than a traditional remote control device are described in FIGS. 7 to 11. However, the present disclosure is not limited to the examples in FIGS. 7 to 11.

[0136] According to the present disclosure, codes formed on a display panel may have identification information, coordinate information, etc. in advance. At this time, the coordinate information may indicate, for example, absolute coordinates, or may set a reference coordinate and indicate relative coordinates with respect to the reference coordinates.

[0137] According to another embodiment, codes formed on the display panel do not have separate identification information or coordinate information, but can obtain location information such as identification information or coordinate information about the code from the surroundings of the code.

[0138] One or more codes may be formed on the display panel.

[0139] First, referring to FIG. 7, the code can be formed around a pixel or between pixels.

[0140] For convenience, Figure 7 illustrates a total of 7 codes being arranged, but this is only to explain the arrangement of the codes, and not all 7 codes may be arranged.

[0141] The first code (721), the second code (722), and the third code (723) can be placed between pixels composed of R, G, and B in the x direction.

[0142] The fourth code (724) is also placed between pixels composed of R, G, and B, but unlike the first to third codes (721 to 723) described above, it can be seen that it is placed in the y direction.

[0143] The fifth code (725), the sixth code (726), and the seventh code (727) may be positioned between pixels, but may be positioned at the center (or periphery) between the four surrounding pixels.

[0144] The sixth code (726) may be placed, for example, in the central area of ​​the panel.

[0145] The remote control device (200) can obtain information about the code by capturing or directly pointing to the location or area where the code is placed.

[0146] Next, in FIGS. 8 to 11, the display panel is arbitrarily divided into a pixel area and a non-pixel area, and this is explained. At this time, the pixel area (or display area) refers to an area where at least one pixel is arranged, and the area where no pixel is arranged is referred to as a non-pixel area (or peripheral area).

[0147] In (a) and (b) of FIG. 8, all codes can be formed only in, for example, the non-pixel area (820).

[0148] Referring to (a) of FIG. 8, codes can be placed in all non-pixel areas (820) except the pixel area (810).

[0149] On the other hand, referring to (b) of FIG. 8, the codes may be formed only in some of the non-pixel areas (820), not in all non-pixel areas (820).

[0150] Meanwhile, the spacing between codes in (a) of Fig. 8 may be the same as or different from the spacing between codes in (b) of Fig. 8.

[0151] Referring to (a) and (b) of FIG. 9, the spacing between codes may vary depending on the location within the non-pixel area. For example, the spacing between codes arranged horizontally may be the same as or different from the spacing between codes arranged vertically. Similarly, the spacing between codes located above and below in the horizontal direction and / or the spacing between codes located on the left and right in the vertical direction may also be the same as or different.

[0152] Referring to (a) of FIG. 10, codes can be formed in both the pixel area (810) and the non-pixel area (820).

[0153] Meanwhile, referring to (b) of Fig. 10, unlike Figs. 8 and 9, the codes can be formed only in the pixel area (810).

[0154] Referring to (b) of FIG. 10 to (c) of FIG. 11, the spacing between codes formed in the pixel area (810) can be defined in various ways.

[0155] According to at least one of the various embodiments of the present disclosure, the plurality of codes may be arranged at an edge on the panel, and / or at a predefined interval on the panel.

[0156] According to at least one of the various embodiments of the present disclosure, the plurality of codes may be arranged at a narrower interval in at least one of the functional area and the menu area on the panel compared to the other areas. Here, both the functional area and the menu area may correspond to the pixel area (810). Alternatively, the functional area may correspond to the pixel area (810), but the menu area may correspond to the non-pixel area (820).

[0157] Figures 12 to 14 are block diagrams illustrating an operation method of a display device (100) connected to a remote control device (200) according to one embodiment of the present disclosure.

[0158] First, referring to FIG. 12, the remote control device (200) can advertise a data packet (S110). The display device (100) can receive the data packet advertised by the remote control device (200).

[0159] When a data packet is received, the display device (100) determines whether or not it is paired with the remote control device (200), and if pairing has not yet occurred, it can perform a pairing operation with the remote control device (200). Meanwhile, if the display device (100) determines that pairing with the remote control device (200) has already occurred, it can approve the connection and succeed in the connection (S120).

[0160] After pairing with the display device (100), the remote control device (100) can face the panel of the display device (100) and acquire code information formed on the panel. The remote control device (200) can advertise a data packet including the code information thus acquired (S130). At this time, the advertising may be a data packet having different parameter values ​​from the data packet advertised in the aforementioned S110 operation.

[0161] When a data packet is advertised from a remote control device (200), the display device (100) can parse the data packet to obtain code information. Based on the code information thus obtained, the display device (100) can identify a position or coordinate on the panel corresponding to the code information (S140).

[0162] The display device (100) can output a cursor on the screen based on position or coordinate identification information on the panel corresponding to code information through operation S140 (S150).

[0163] Next, Fig. 13 may be, for example, a subsequent operation of Fig. 12.

[0164] Referring to FIG. 13, the remote control device (200) advertises a data packet (S210), and the display device (100) can obtain and identify the advertised data packet (S220).

[0165] At this time, the remote control device (200) can configure the identification information of the data packet advertised in operation S110 of FIG. 12 described above differently from the identification information within the data packet advertised in operation S130 of FIG. 12 or operation S210 of FIG. 13. In other words, the remote control device (200) can advertise by giving different identification information in cases where the data packet includes code information and cases where it does not.

[0166] When a packet is identified through operation S220 (i.e., a data packet including code information is identified), the display device (100) can parse the code information included in the identified packet, determine the position of the cursor to be output (S230), and output the cursor at the determined position (S240).

[0167] In FIG. 13, if the data packet advertised through operation S210 includes at least one of information other than code information, such as distance information, speed information, and direction information, the position of the cursor may be determined by referring to the code information included in the previously acquired data packet (e.g., the data packet advertised in operation S130 of FIG. 12), and the cursor may be output at the determined position.

[0168] Referring to FIG. 14, the display device (100) can receive a data packet from the remote control device (200) (S310).

[0169] The display device (100) can identify the data packet received through operation S310 (S320).

[0170] The display device (100) can determine whether the data packet identified through operation S320 includes code information (S330).

[0171] If the display device (100) determines in operation S330 that the data packet identified through operation S320 does not contain code information, it can obtain other information, for example, distance information (S340).

[0172] The display device (100) can determine whether the information included in the data packet of the remote control device (200) represents a gesture based on the distance information obtained in operation S340 (S350).

[0173] The display device (100) determines the position of the cursor based on the distance information acquired in advance (S360) if the S350 operation is not determined to be a gesture, and outputs the cursor at the determined position (S370).

[0174] On the other hand, the display device (100) can identify the determined gesture if it is determined as a gesture as a result of the S350 operation determination (S380).

[0175] In this case, the display device (100) can acquire and store various gesture information that has been previously promised or set from the remote control device (200). By reading out the gesture information stored in this manner and comparing it with the determined gesture, the gesture can be identified.

[0176] Alternatively, the display device (100) may identify a gesture by reading out and comparing pre-stored gesture information.

[0177] Meanwhile, when storing gesture information, the display device (100) may map corresponding information in advance and store it together. The corresponding information may include various items, such as menus and actions. This information may be manually set by the user, automatically set by the display device (100), or arbitrarily changed. The information mapped and stored above may be automatically executed when the macro function is activated.

[0178] Accordingly, the display device (100) can determine a menu or action corresponding to the gesture identified through the S380 operation (S390), and output the menu or perform the action thus determined (S400).

[0179] In relation to this, when there are multiple pieces of code information obtained from the remote control device (200), the processor can select representative code information and determine the position at which the cursor is to be output based on the representative code information.

[0180] The processor can further obtain a wake-up signal from the remote control device (200), and when the wake-up signal is received, output the cursor at the cursor position output at the most recent point in time.

[0181] The processor can further obtain distance information from the remote control device (200). The processor can determine the location at which the cursor is to be output by considering the distance information based on the code information.

[0182] After acquiring the code information, the processor can control the processor to recognize the gesture and output menu information corresponding to the recognized gesture or perform an operation when only the distance information is acquired.

[0183] The processor can further obtain a button press signal from the remote control device (200). The processor can determine and output menu information based on code information immediately before the time at which the button press signal of the remote control device (200) is obtained.

[0184] According to an embodiment, the remote control device (200) may transmit a data packet containing information about the operation of the remote control device to the display device (100) even if it is not necessarily directed toward the display device (100) after performing pairing with the display device (100) or after pointing to the display or outputting a cursor at least once. For example, the remote control device (200) may obtain information about the movement distance, movement direction, movement speed, etc. based on the pairing or after performing pointing or outputting a cursor at least once, and may thereby perform the same effect or operation as the above-described embodiments by including the information in a data packet and transmitting it to the display device (100). In the above, with respect to pairing, even if the remote control device (200) is not directed toward the panel of the display device (100) after pairing, the movement information of the remote control device (200) as described above can be obtained based on the position at the time of pairing completion, and if this is transmitted to the display device (100) in a data packet, the display device (100) can perform movement of the cursor or other operations based on the movement information included in the transmitted data packet based on a preset reference position (e.g., the center point of the screen, etc.).

[0185] The above remote control device (200) can recognize a code through an image sensor.

[0186] FIG. 15 is a drawing illustrating a display operation according to a remote control device (200) connected according to one embodiment of the present disclosure.

[0187] In Fig. 15, there is shown an example of the operation of the display device (100) according to the movement of the remote control device (200), etc.

[0188] The display device (100) can output a content playback screen (1510) or the like on the screen.

[0189] In this process, when a data packet containing code information obtained from a remote control device (200) is transmitted, a cursor (1520) can be output accordingly, or menu information (1530) can be output according to the cursor position or pressing of a specific key button.

[0190] FIG. 16 is a drawing illustrating an operation of a display device (100) that detects and responds to the movement of a connected remote control device (200) according to one embodiment of the present disclosure.

[0191] In FIG. 16, for example, if an image sensor (1610) is included in a display device (100) or an external device, and a predetermined pattern operation or gesture of a pen remote control (200) is recognized through the image sensor (1610), and if the operation or gesture corresponds to a preset predetermined pattern, the pen remote control can be registered as a remote control device capable of data communication with the display device (100). As described above, if the remote control device (200) is registered according to a predetermined pattern operation or gesture, the display device (100) can perform automatic pairing and connection with the pen remote control (200). In the above, the external device may include various devices such as mobile terminals such as smartphones, IoT devices, and other home appliances. If the external device includes an image sensor, the external device can transmit an image of the pen remote control (200) acquired through the image sensor to the display device (100), and the display device (100) can perform the aforementioned identification and registration operations.

[0192] In relation to this, the display device (100) can define and store pattern movements or gestures for pre-identification and registration, such as in relation to registration of external remote control devices. This can also be utilized for traditional remote control devices. Meanwhile, if pattern movements or gestures are defined differently depending on the type of remote control device, the type of remote control device can be immediately identified based on the pattern movements or gestures alone. In addition, information such as whether or not the identified remote control device is paired or connected can be stored in advance and controlled.

[0193] Meanwhile, the above-mentioned content may be operated after being registered as a pen remote control in Fig. 16.

[0194] Although not shown, if the codes formed on the panel of the display device (10) contain identification information and are designed to react when receiving a laser or light irradiated from the remote control device (200), a signal according to the reaction can be detected and a request for the remote control device (200) can be responded to, for example, outputting a cursor or menu or performing a predetermined operation as described above.

[0195] Even if not specifically mentioned, the order of at least some of the operations disclosed in the present disclosure may be performed simultaneously, in a different order than the order described above, or some may be omitted / added.

[0196] According to one embodiment of the present disclosure, the above-described method can be implemented as processor-readable code on a medium in which a program is recorded. Examples of processor-readable media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, and optical data storage devices.

[0197] The display device described above is not limited to the configuration and method of the embodiments described above, and the embodiments may be configured by selectively combining all or part of each embodiment so that various modifications can be made.

[0198] The present disclosure relates to a display device and an operating method thereof, and more particularly, to a source device such as a remote control device of various kinds or types that can be quickly and accurately linked and controlled from a sink device such as a display device, and thus, the present disclosure has industrial applicability as it can be used in various industrial fields.

Claims

1. A display in which multiple codes are formed on the panel; and A processor that obtains the code information from a remote control device and controls the cursor to be output at a location corresponding to the code information. Display device.

2. In claim 1, Each of the above codes, having identification information and / or coordinate information, Display device.

3. In claim 1, Each of the above codes, formed around the pixels formed on the above panel, Display device.

4. In claim 1, Each of the above codes, Formed between pixels formed on the above panel, Display device.

5. In claim 1, The above multiple codes are, The edge on the above panel, are arranged at predefined intervals on the above panel, Display device.

6. In claim 1, The above multiple codes are, At least one of the function area and menu area on the above panel is arranged at a narrower spacing than the other areas. Display device.

7. In claim 1, The above display is, A film printed so that the above plurality of codes are arranged on the panel is applied, Display device.

8. In claim 1, The above processor, In the case where there are multiple pieces of code information obtained from the above remote control device, representative code information is selected and the position at which the cursor is to be output is determined based on the representative code information. Display device.

9. In claim 1, The above processor, Further obtain a wake-up signal from the above remote control device, When the above wake-up signal is received, the cursor is output at the cursor position that was output at the most recent point in time. Display device.

10. In claim 1, The above processor, Obtaining further distance information from the above remote control device, Display device.

11. In claim 10, The above processor, The location where the cursor will be output is determined by considering the distance information based on the code information. Display device.

12. In claim 10, The above processor, After obtaining the above code information, if only the above distance information is obtained, it is controlled to recognize the gesture and output menu information corresponding to the recognized gesture or perform an action. Display device.

13. In claim 10, The above processor, Further obtaining a button press signal from the above remote control device, Display device.

14. In claim 13, The above processor, Determines and outputs menu information based on code information immediately before the button press signal of the above remote control device is acquired Display device.

15. In claim 1, The above remote control device, Recognizing the above code through an image sensor, Display device.

Images