Display device and operation method thereof

Abstract

The invention aims to provide a function of carrying out keyword search on Web contents. A display device according to an embodiment of the present invention may comprise: a display for displaying Web content; the controller is used for extracting a plurality of candidate search terms by utilizing a Web document of the Web content, determining a plurality of final search terms from the plurality of candidate search terms based on a classification condition, then obtaining a plurality of keyword terms of a first type from the determined plurality of final search terms, and sending the keyword terms of the first type to the server; and the plurality of obtained keyword items are displayed on the display.

Description

Technical Field

[0001] The invention relates to a display device providing a keyword search function. Background Art

[0002] Digital TV services using wired or wireless communication networks are becoming more and more popular. Digital TV services can provide various services that cannot be provided by existing analog broadcasting services.

[0003] For example, among the types of digital TV services, Internet Protocol Television (IPTV) and smart TV services provide interactivity, so that users can actively choose the type of audio-visual programs, the time of viewing, etc. Based on such interactivity, IPTV and smart TV services can also provide a variety of additional services, such as Internet search, home shopping, online games, etc.

[0004] In recent years, a keyword search function has been provided that analyzes the content currently being viewed and provides a keyword search related to the content when a button of a remote controller is long pressed during TV viewing.

[0005] However, such a function has a limitation that only keywords provided by an application installed in the TV by the manufacturer of the TV and keywords provided by a Service Discovery Protocol (SDP) server are provided.

[0006] That is, the limitation is that the third party (3 rd Content provided by a third-party application and Web content such as web pages provided through a Web browser do not provide a keyword search function.

[0007] The related existing patent document is US Patent Application Publication No. US2013 / 0086056. However, the existing patent document only provides a menu matching the situation after analyzing the area designated as a closed area by the user, and does not provide a keyword search for the designated area. Summary of the invention

[0008] Problem that the invention aims to solve

[0009] The object of the present invention is to provide a keyword search function for Web contents.

[0010] An object of the present invention is to provide a search function for a plurality of keywords adjacent to a cursor position of a remote control device.

[0011] An object of the present invention is to provide only main search terms among a plurality of search terms for Web contents according to preset preferences.

[0012] Technical solutions to the problem

[0013] A display device of an embodiment of the present invention may include: a display, displaying Web content; and a controller, extracting a plurality of candidate search items using a Web document of the Web content, and determining a plurality of final search items from the plurality of candidate search items based on classification conditions, and then obtaining a plurality of first-type keyword items from the determined plurality of final search items, and displaying the plurality of keyword items on the display.

[0014] In the display device of an embodiment of the present invention, when a search request for the position of a search term included in a plurality of candidate search terms is received, a plurality of candidate search terms among the plurality of candidate search terms that are located adjacent to the search term can be obtained as a plurality of final search terms.

[0015] In the display device of the embodiment of the present invention, when a priority option is set, a plurality of final search items can be determined from a plurality of candidate search items according to the priority option.

[0016] Effects of the Invention

[0017] According to various embodiments of the present invention, various keywords can be extracted from applications and web applications provided by third parties and web pages provided by web browsers to provide search results for keywords. Thus, more abundant search results are provided without application restrictions, thereby improving user experience.

[0018] According to the embodiment of the present invention, a plurality of keywords adjacent to the search object are provided, thereby providing a user-customized search function.

[0019] According to the embodiment of the present invention, only a plurality of keywords having preset attributes are extracted, thereby providing a user-customized search function. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 This is a block diagram showing the structure of a display device according to an embodiment of the present invention.

[0021] Figure 2 is a block diagram of a remote control device according to an embodiment of the present invention.

[0022] Figure 3 An actual configuration example of a remote control device according to an embodiment of the present invention is shown.

[0023] Figure 4 An example of fully utilizing a remote control device according to an embodiment of the present invention is shown.

[0024] Figure 5This is a flowchart for explaining an operation method of a display device according to an embodiment of the present invention.

[0025] Figure 6 is a diagram illustrating an example of extracting a plurality of keyword terms from a PWA (or Web application) according to an embodiment of the present invention.

[0026] Figure 7 FIG. 1 is a diagram illustrating an example of displaying a plurality of keyword items extracted from a broadcast providing Web data according to an embodiment of the present invention.

[0027] Figure 8 This is a flowchart for explaining an operation method of a display device according to another embodiment of the present invention.

[0028] Fig. 9 It is to explain the implementation Figure 8 A diagram of the operations of multiple hardware components of the operation method.

[0029] Fig.10a is a diagram illustrating a process of providing a keyword search function by linking with a Toss application in the prior art. Fig.10b 2 is a diagram illustrating a process of providing a keyword search function by linking with a Toss application in one embodiment of the present invention.

[0030] Fig.11 is a diagram of a process of providing search results for a keyword term selected from a plurality of keyword terms through a mini browser according to an embodiment of the present invention. DETAILED DESCRIPTION

[0031] The following is a detailed description of embodiments related to the present invention with reference to the accompanying drawings. The suffixes "module" and "unit" used in the following description are given or used interchangeably for the convenience of writing the specification, and do not have different meanings or functions.

[0032] The display device of the embodiment of the present invention is, for example, an intelligent display device that adds a computer support function to a broadcast receiving function. While being faithful to the broadcast receiving function, an Internet function is added, so it can have an interface that is more convenient to use than a hand-written input device, a touch screen, or a space remote controller. In addition, it is also possible to access the Internet and a computer with the support of a wired or wireless Internet function to perform functions such as sending and receiving emails, web browsing, banking, or games. For such a variety of functions, a standardized general-purpose OS can be used.

[0033] Therefore, the display device described in the present invention can freely add or delete various applications on the general OS kernel, so as to perform various user-friendly functions. As a more specific example, the display device can be a network TV, a hybrid broadcast broadband TV (HBBTV), a smart TV, an LED TV, an OLED TV, etc., and can also be applied to a smart phone according to the situation.

[0034] Figure 1 This is a block diagram showing the structure of a display device according to an embodiment of the present invention.

[0035] Reference Figure 1 The display device 100 may include a broadcast receiving unit 130 , an external device interface 135 , a memory 140 , a user interface 150 , a controller 170 , a wireless communication interface 173 , a display 180 , a speaker 185 and a power supply circuit 190 .

[0036] The broadcast receiving unit 130 may include a tuner 131 , a demodulator 132 , and a network interface 133 .

[0037] The tuner 131 may select a specific broadcast channel according to a channel selection instruction. The tuner 131 may receive a broadcast signal of the selected specific broadcast channel.

[0038] The demodulator 132 may separate the received broadcast signal into a video signal, an audio signal, and a data signal associated with a broadcast program, and may restore the separated video signal, audio signal, and data signal into an outputtable form.

[0039] The external device interface 135 may receive an application or an application directory within an adjacent external device and transfer it to the controller 170 or the memory 140 .

[0040] The external device interface 135 may provide a connection path between the display device 100 and an external device. The external device interface 135 may receive one or more of an image and audio output from an external device wirelessly or wiredly connected to the display device 100, and transmit it to the controller 170. The external device interface 135 may include a plurality of external input terminals. The plurality of external input terminals may include an RGB terminal, one or more High Definition Multimedia Interface (HDMI) terminals, and a component terminal.

[0041] An image signal of the external device input through the external device interface 135 may be output through the display 180 . A voice signal of the external device input through the external device interface 135 may be output through the speaker 185 .

[0042] The external device connectable to the external device interface 135 may be any of a set-top box, a Blu-ray player, a DVD player, a game console, a sound bar, a smartphone, a PC, a USB memory, and a home theater, but this is merely an example.

[0043] The network interface 133 may provide an interface for connecting the display device 100 to a wired / wireless network including the Internet. The network interface 133 may transmit or receive data to or from another user or another electronic device through a connected network or another network linked to the connected network.

[0044] In addition, content data stored in a part of the display apparatus 100 may be transmitted to a user selected from other users or other electronic devices pre-registered in the display apparatus 100 or to a selected electronic device.

[0045] The network interface 133 can be connected to a specified web page through a connected network or other networks linked to the connected network. That is, data can be sent to or received from a corresponding server through a network connected to a specified web page.

[0046] In addition, the network interface 133 can receive content or data provided by a content provider or a network operator. That is, the network interface 133 can receive content such as movies, advertisements, games, video on demand (VOD), broadcast signals, and information associated therewith provided by a content provider or a network provider through a network.

[0047] In addition, the network interface 133 can receive firmware update information and update files provided by the network operator, and can send data to the Internet or content providers or network operators.

[0048] The network interface 133 may select and receive a desired application from a plurality of applications open to the public through a network.

[0049] The memory 140 may store programs for various signal processing and control in the controller 170 , and may store image, voice or data signals that have undergone signal processing.

[0050] In addition, the memory 140 may perform a function for temporarily storing an image, a voice, or a data signal input from the external device interface 135 or the network interface 133 , and may also store information related to a prescribed image through a channel memory function.

[0051] The storage 140 may store applications or an application directory input from the external device interface 135 or the network interface 133 .

[0052] The display device 100 may provide the user with content files (video files, still image files, music files, text files, application files, etc.) stored in the memory 140 through playback.

[0053] The user interface 150 may transmit a signal input by the user to the controller 170 or transmit a signal from the controller 170 to the user. For example, the user interface 150 may receive and process control signals such as power on / off, channel selection, and screen setting from the remote control device 200 using various communication methods such as Bluetooth, ultra-wideband (WB), ZigBee, RF, or IR, or process and send control signals from the controller 170 to the remote control device 200.

[0054] In addition, the user interface 150 may transmit a control signal input from a local key (not shown) such as a power key, a channel key, a volume key, and a setting value to the controller 170 .

[0055] The image signal processed by the controller 170 may be input to the display 180 to be displayed as an image corresponding to the image signal. In addition, the image signal processed by the controller 170 may be input to an external output device through the external device interface 135.

[0056] The voice signal processed in the controller 170 may be audio-outputted to the speaker 185. In addition, the voice signal processed in the controller 170 may be inputted to an external output device through the external device interface 135.

[0057] In addition, the controller 170 may control overall actions within the display device 100 .

[0058] In addition, the controller 170 may control the display device 100 using a user instruction input through the user interface 150 or an internal program, and may access a network to download an application or application directory required by the user to the display device 100 .

[0059] The controller 170 may cause channel information or the like selected by the user to be output through the display 180 or the speaker 185 together with the processed image or voice signal.

[0060] In addition, the controller 170 can output an image signal or a voice signal from an external device, such as a camera or a video camera, input through the external device interface 135 through the display 180 or the speaker 185 according to an external device image playback instruction received through the user interface 150 .

[0061] On the other hand, the controller 170 may control the display 180 to display an image, for example, the display 180 may be controlled to display a broadcast image input through the tuner 131, an external input image input through the external device interface 135, an image input through the network interface unit, or an image stored in the memory 140. In this case, the image displayed on the display 180 may be a still image or a video, and may be a 2D image or a 3D image.

[0062] In addition, the controller 170 can control the playback of content stored in the display device 100 or received broadcast content or external input content input from the outside. The content can be in various forms such as broadcast images, external input images, audio files, static images, visited web pages, and text files.

[0063] The wireless communication interface 173 can communicate with an external device through wired or wireless communication. The wireless communication interface 173 can perform short range communication with an external device. To this end, the wireless communication interface 173 can use Bluetooth. TM ), Radio Frequency Identification (RFID), Infrared Data Association (IrDA), UWB (Ultra Wideband), ZigBee, Near Field Communication (NFC), Wireless-Fidelity (Wi-Fi), Wireless Direct (Wi-Fi Direct), Wireless Universal Serial Bus (Wireless USB) technologies to support short-range communication. Such a wireless communication interface 173 can support wireless communication between the display device 100 and a wireless communication system, between the display device 100 and another display device 100, or between the display device 100 and a network in which the display device 100 (or an external server) is provided through a short-range wireless communication network (Wireless Area Networks). The short-range wireless communication network can be a short-range wireless personal communication network (Wireless Personal Area Networks).

[0064] Here, the other display device 100 may be a wearable device (such as a smart watch, smart glasses, head mounted display (HMD)) that can exchange data with the display device 100 of the present invention (or can be linked), or a mobile terminal such as a smart phone. The wireless communication interface 173 can detect (or identify) wearable devices that can communicate around the display device 100.

[0065] Further, in the case where the detected wearable device is a device authenticated to communicate with the display device 100 of the present invention, the controller 170 may send at least a portion of the data processed in the display device 100 to the wearable device through the wireless communication interface 173. Therefore, the user of the wearable device can utilize the data processed in the display device 100 through the wearable device.

[0066] The display 180 may convert an image signal, a data signal, an OSD signal processed in the controller 170 or an image signal, a data signal, etc. received from the external device interface 135 into R, G, B signals, respectively, to generate a driving signal.

[0067] on the other hand, Figure 1 The display device 100 shown is only one embodiment of the present invention, and some of the multiple components shown in the figure may be integrated, added, or omitted according to the configuration of the display device 100 actually implemented.

[0068] That is, as required, two or more components can be combined into one component, or one component can be subdivided into two or more components. In addition, the functions performed in each block are used to illustrate the embodiments of the present invention, and the specific actions or devices thereof do not limit the scope of the present invention.

[0069] According to another embodiment of the present invention, Figure 1 Different from the above, the display device 100 may not include the tuner 131 and the demodulator 132 , but may receive and play images through the network interface 133 or the external device interface 135 .

[0070] For example, the display device 100 may be implemented by being separated into an image processing device such as a set-top box for receiving broadcast signals or contents from various network services and a content playing device for playing contents input from the image processing device.

[0071] In this case, the operation method of the display device according to the embodiment of the present invention described below can be used not only by referring to Figure 1The display device 100 described above may also be implemented using any of the separate image processing devices such as a set-top box or the content playback device having the display 180 and the audio output unit 185 .

[0072] Then, refer to Figures 2 to 3 , a remote control device according to an embodiment of the present invention is described.

[0073] Figure 2 is a block diagram of a remote control device according to an embodiment of the present invention, Figure 3 An actual configuration example of the remote control device 200 according to an embodiment of the present invention is shown.

[0074] First, refer to Figure 2 The remote control device 200 may include a fingerprint identifier 210 , a wireless communication circuit 220 , a user interface 230 , a sensor 240 , an output interface 250 , a power supply circuit 260 , a memory 270 , a controller 280 , and a microphone 290 .

[0075] Reference Figure 2 The wireless communication circuit 220 sends and receives signals with any one of the display devices in the embodiments of the present invention described above.

[0076] The remote control device 200 may have an RF circuit 221 capable of transmitting and receiving signals with the display device 100 according to the RF communication standard, and may have an IR circuit 223 capable of transmitting and receiving signals with the display device 100 according to the IR communication standard. In addition, the remote control device 200 may have a Bluetooth circuit 225 capable of transmitting and receiving signals with the display device 100 according to the Bluetooth communication standard. In addition, the remote control device 200 may have an NFC circuit 227 capable of transmitting and receiving signals with the display device 100 according to the NFC (Near Field Communication) communication standard, and may have a WLAN circuit 229 capable of transmitting and receiving signals with the display device 100 according to the WLAN (Wireless LAN) communication standard.

[0077] In addition, the remote control device 200 transmits a signal including information related to the operation of the remote control device 200 to the display device 100 through the wireless communication circuit 220 .

[0078] On the other hand, the remote control device 200 can receive signals transmitted by the display device 100 through the RF circuit 221, and can transmit instructions related to power on / off, channel change, volume change, etc. to the display device 100 through the IR circuit 223 as needed.

[0079] The user interface 230 may be composed of a keyboard or a keypad or a touch panel or a touch screen. The user may operate the user interface 230 to input a command associated with the display device 100 to the remote control device 200. In the case where the user interface 230 has a hard key, the user may input a command associated with the display device 100 to the remote control device 200 by pressing the hard key. Figure 3 Provide explanation.

[0080] Reference Figure 3 The remote control device 200 may include a plurality of buttons. The plurality of buttons may include a fingerprint recognition button 212, a power button 231, a home button 232, a live button 233, an external input button 234, a volume adjustment button 235, a voice recognition button 236, a channel change button 237, a confirmation button 238, and a back button 239.

[0081] The fingerprint identification key 212 may be a key for identifying a user's fingerprint. As an embodiment, the fingerprint identification key 212 may perform a pressing action, or may receive a pressing action and a fingerprint identification action.

[0082] The power key 231 may be a key for turning on / off the power of the display device 100 .

[0083] The home key 232 may be a key for moving to a home screen of the display device 100 .

[0084] The live key 233 may be a key for displaying a real-time broadcast program.

[0085] The external input key 234 may be a key for receiving an external input connected to the display apparatus 100 .

[0086] The volume adjustment key 235 may be a key for adjusting the volume of the sound output by the display device 100 .

[0087] The voice recognition key 236 may be a key for receiving a user's voice and recognizing the received voice.

[0088] The channel change key 237 may be a key for receiving a broadcast signal of a specific broadcast channel.

[0089] The confirmation key 238 may be a key for selecting a specific function, and the back key 239 may be a key for returning to a previous screen.

[0090] Again, yes Figure 2 Provide explanation.

[0091] When the user interface 230 has a touch screen, the user can input instructions related to the display device 100 to the remote control device 200 by touching the soft keys of the touch screen. In addition, the user interface 230 can have various user-operable input means such as a scroll key or a jog key, and this embodiment does not limit the scope of the invention.

[0092] The sensor 240 may include a gyro sensor 241 or an acceleration sensor 243 . The gyro sensor 241 may sense information related to the motion of the remote control device 200 .

[0093] For example, the gyro sensor 241 can sense information related to the movement of the remote control device 200 based on the x, y, and z axes, and the acceleration sensor 243 can sense information related to the moving speed of the remote control device 200. On the other hand, the remote control device 200 may also have a distance sensor to sense the distance from the display 180 of the display device 100.

[0094] The output interface 250 may output an image signal or a voice signal corresponding to an operation of the user interface 230 or corresponding to a signal transmitted from the display apparatus 100 .

[0095] The user can identify whether the user interface 230 is operated or not or whether the display device 100 is controlled or not through the output interface 250 .

[0096] For example, the output interface 250 may have an LED 251 or a vibrator 253 or a speaker 255 or a display 257. When operating the user interface 230 or sending and receiving signals with the display device 100 through the wireless communication unit 225, the LED 251 is lit, the vibrator 253 generates vibrations, the speaker 255 outputs sounds, and the display 257 outputs images.

[0097] In addition, the power supply circuit 260 can supply power to the remote control device 200 , and when the remote control device 200 does not operate for a predetermined period of time, the power supply can be interrupted to reduce power waste.

[0098] The power supply circuit 260 can resume power supply when a predetermined key provided in the remote control device 200 is operated.

[0099] The memory 270 may store various programs, application data, and the like necessary for controlling or operating the remote control device 200 .

[0100] When the remote control device 200 wirelessly transmits and receives signals with the display device 100 via the RF circuit 221 , the remote control device 200 and the display device 100 transmit and receive signals in a predetermined frequency band.

[0101] The controller 280 of the remote control apparatus 200 may store information on a frequency band capable of wirelessly transmitting and receiving signals with the display apparatus 100 that is paired with the remote control apparatus 200 in the memory 270 and refer to the information.

[0102] Controller 280 controls all matters related to control of remote control device 200. Controller 280 can transmit a signal corresponding to a predetermined key operation of user interface 230 or a signal corresponding to an action of remote control device 200 sensed by sensor 240 to display device 100 via wireless communication unit 225.

[0103] In addition, the microphone 290 of the remote control device 200 can acquire voice.

[0104] A plurality of microphones 290 may be provided.

[0105] Then, yes Figure 4 Provide explanation.

[0106] Figure 4 An example of fully utilizing a remote control device according to an embodiment of the present invention is shown.

[0107] Figure 4 (a) illustrates that a pointer 205 corresponding to the remote control device 200 is displayed on the display 180 .

[0108] The user can move the remote control device 200 up, down, left, right, or rotate. The pointer 205 displayed on the display 180 of the display device 100 corresponds to the movement of the remote control device 200. As shown in the figure, as such a remote control device 200 moves in the 3D space, the corresponding pointer 205 moves and is displayed, and therefore, the remote control device 200 can be named a spatial remote controller.

[0109] Figure 4 (b) illustrates that when the user moves the remote control device 200 to the left, the pointer 205 displayed on the display 180 of the display device 100 moves to the left accordingly.

[0110] Information about the motion of the remote control device 200 detected by the sensor of the remote control device 200 is transmitted to the display device 100. The display device 100 can calculate the coordinates of the pointer 205 from the information about the motion of the remote control device 200. The display device 100 can display the pointer 205 corresponding to the calculated coordinates.

[0111] Figure 4(c) illustrates a case where the user moves the remote control device 200 away from the display 180 while pressing a specific key in the remote control device 200. Thus, the selection area in the display 180 corresponding to the pointer 205 can be displayed in an enlarged manner.

[0112] On the contrary, when the user moves the remote control device 200 closer to the display 180 , the selection area in the display 180 corresponding to the pointer 205 may be displayed in a reduced size.

[0113] On the other hand, when remote control device 200 is far away from display 180 , the selected area may be reduced, and when remote control device 200 is close to display 180 , the selected area may be enlarged.

[0114] In addition, when a specific button in the remote control device 200 is pressed, the recognition of the up, down, left, and right movements may be excluded. That is, when the remote control device 200 is moved closer to or farther away from the display 180, only the forward and backward movement may be recognized, and the up, down, left, and right movements may not be recognized. When a specific button in the remote control device 200 is not pressed, only the pointer 205 moves with the up, down, left, and right movements of the remote control device 200.

[0115] On the other hand, the moving speed or moving direction of the pointer 205 may correspond to the moving speed or moving direction of the remote control device 200 .

[0116] On the other hand, the pointer in this specification means an object displayed on the display 180 corresponding to the action of the remote control device 200. Therefore, as the pointer 205, it can be an object of various shapes other than the arrow shape displayed on the screen. For example, it can be a concept including a point, a cursor, a prompt, a thick outline, etc. In addition, the pointer 205 can be displayed not only corresponding to any position (point) in the horizontal axis and the vertical axis on the display 180, but also corresponding to a plurality of positions such as a line (line) and a surface (surface).

[0117] Figure 5 This is a flowchart for explaining an operation method of a display device according to an embodiment of the present invention.

[0118] The controller 170 of the display apparatus 100 displays Web content on the display 180 ( S501 ).

[0119] In one embodiment, the web content may be content provided by a web-based third party.

[0120] In another embodiment, the web content may be content provided by a progressive web application (PWA). The web content may represent an execution screen of the PWA.

[0121] PWA may be an application based on Web technologies such as HTML and Java Script.

[0122] In yet another embodiment, the Web content may represent a web page executed using a Web browser.

[0123] In yet another embodiment, the Web content may be a Web-based data broadcast.

[0124] The controller 170 of the display apparatus 100 may extract a plurality of candidate search terms using a Web document corresponding to the Web content ( S503 ).

[0125] In one embodiment, the Web document may be a text made in Hyper Text Markup Language (HTML) or a text made in a Web language such as Java script.

[0126] The controller 170 may extract any one or more of an image item, a content name, a text item such as a title, a clickable item, a non-clickable item, and a link item from the Web document.

[0127] The controller 170 may acquire the extracted plurality of terms as a plurality of candidate search terms. The controller 170 may generate the plurality of candidate search terms into a candidate list.

[0128] The controller 170 may also extract coordinate information of each of the plurality of candidate search items.

[0129] The controller 170 may match each of the plurality of candidate search terms with the coordinates of the corresponding term.

[0130] The controller 170 of the display apparatus 100 may determine a plurality of final search terms from the extracted plurality of candidate search terms ( S505 ).

[0131] The controller 170 may determine a plurality of final search terms from the plurality of candidate search terms according to the sorting condition. The sorting condition may be satisfied when either a search request for a target location or a preference request is received.

[0132] In one embodiment, the controller 170 may extract a plurality of search terms adjacent to the position of the cursor from among the extracted plurality of candidate search terms. The cursor may be a pointer that moves as the remote control device 200 moves.

[0133] The position of the cursor may be a position targeted as a search object (or a candidate search term included in Web content).

[0134] That is, when the controller 170 receives a selection input of a confirmation key (ok key) provided in the remote control apparatus 200, the controller 170 may determine a plurality of items located adjacent to the cursor among the plurality of candidate search items as final search items.

[0135] In yet another embodiment, the controller 170 may determine a plurality of final search terms among a plurality of candidate search terms based on a priority option request.

[0136] As an example, the priority option request may be a request to extract only the main keywords.

[0137] As another example, a preference request may be a request followed by a sorting variable.

[0138] The preferred options are described in detail later.

[0139] The controller 170 of the display apparatus 100 acquires a plurality of keyword terms based on the determined plurality of final search terms ( S507 ).

[0140] In one embodiment, the controller 170 may obtain the determined plurality of final search terms as a plurality of keyword terms.

[0141] In another embodiment, the controller 170 may obtain additional search terms for each of the determined final search terms.

[0142] That is, the controller 170 may acquire a plurality of additional search terms for one final search term. The controller 170 may acquire a plurality of additional search terms for the final search term by searching for a connection application. The plurality of keyword terms may include a plurality of additional search terms for each final search term.

[0143] The controller 170 may transmit the plurality of final search terms to the server through the network interface 133 and may receive a plurality of additional search terms from the server.

[0144] The controller 170 of the display apparatus 100 may display the acquired plurality of keyword items on the display 180 ( S509 ).

[0145] The controller 170 may display a plurality of keyword items on the Web content.

[0146] The controller 170 may receive an instruction to select any one of a plurality of keyword items, and may provide search results for the selected keyword item in response to the received instruction.

[0147] The controller 170 may obtain search results for the keyword term through any one of a plurality of search source applications provided in the display device 100 , and display the obtained search results on the display 180 .

[0148] Figure 6 is a diagram illustrating an example of extracting a plurality of keyword terms from a PWA (or Web application) according to an embodiment of the present invention.

[0149] Reference Figure 6 , the display device 100 may display an execution screen 600 of the Web application on the display 180. The Web application may be an application that provides a video streaming service.

[0150] The execution screen 600 may be a web page screen of a web browser, or may be a 3 rd The execution screen of the application provided by the party.

[0151] The display device 100 may acquire a web document corresponding to the execution screen 600 of the web application, and may extract a plurality of candidate search terms from the web document.

[0152] The display device 100 may also obtain coordinate information of each of the plurality of candidate search items from the Web document.

[0153] The display device 100 determines a plurality of final search terms from a plurality of candidate search terms, and acquires the determined plurality of final search terms as keyword terms.

[0154] The plurality of candidate search items may include titles, captions, images, image links, and menu buttons of the respective content items on the execution screen 600 .

[0155] The plurality of candidate search terms may be clickable terms or non-clickable terms.

[0156] A clickable item may be an item that is selectable through user input. A clickable item may be an item that is accessed through a link determined by selection.

[0157] The display apparatus 100 may extract a plurality of keyword terms 601 to 606 from a candidate list including a plurality of candidate search terms extracted from the execution screen 600 .

[0158] The display apparatus 100 may display a plurality of keyword items 601 to 606 on the display 180 .

[0159] The first keyword item 601 is text (movie title) displayed on the image, and may be a non-clickable item.

[0160] The second keyword item 602 is a menu button for entering the home page screen, and may be a clickable item.

[0161] The third keyword item 603 is a title, which may be a non-clickable item.

[0162] The fourth keyword item 604 is a word included in the text describing the corresponding content item, and may be a non-clickable item.

[0163] The fifth keyword item 605 may indicate a keyword representing the execution screen 600 .

[0164] The sixth keyword item 606 is an article included in the text describing the corresponding content item, and may be a clickable item.

[0165] Thus, according to the embodiment of the present invention, various keywords can be extracted from applications and Web applications provided by a third party and web pages provided by a Web browser to provide search results for the keywords.

[0166] As a result, richer search results are provided without any restrictions on applications, thereby improving user experience.

[0167] Figure 7 FIG. 1 is a diagram for explaining an example of displaying a plurality of keyword items extracted from a broadcast providing Web data according to an embodiment of the present invention.

[0168] Reference Figure 7 , the display device 100 may display a Web-based data broadcast image 700 on the display 180 .

[0169] The display device 100 may receive a Web-based data broadcast signal and Web data through the network interface 133 or the external device interface 135 .

[0170] The display apparatus 100 may display the data broadcast image 700 on the display 180 based on the data broadcast signal of the Web.

[0171] The web data may include content information for the data broadcast image 700. The content information may include any one or more of the title of the data broadcast image 700, the name of the character, the work in which the character has appeared, and the fashion information of the character.

[0172] The display apparatus 100 may acquire a plurality of detail items included in the content information as a plurality of keyword items.

[0173] The display apparatus 100 may acquire a plurality of candidate search items based on broadcast information (eg, EPG information).

[0174] The display apparatus 100 may acquire a portion of a plurality of detail items based on the Web data and a plurality of candidate search items based on the broadcast information as a plurality of keyword items.

[0175] Thus, according to the embodiment of the present invention, a plurality of detail items based on Web data and a plurality of keyword items based on existing broadcast information can be mixed to provide a richer search environment for users.

[0176] Figure 8 is a flowchart for explaining an operation method of a display device according to another embodiment of the present invention. Fig. 9 It is to explain the implementation Figure 8 A diagram of the operations of multiple hardware components of the operation method.

[0177] especially, Figure 8 It is a specific description Figure 5 FIG. 1 is a diagram of an embodiment of the present invention.

[0178] Fig. 9 It may be a plurality of components included in the display device 100. In particular, Fig. 9 The controller 170 of the display device 100 may include a plurality of components.

[0179] The controller 170 may include only the Web interface 930 and the rendering processor 950. As another example, the Web interface 930 may be a component included in the user interface 150.

[0180] The Web interface 930 may host a Web service, and may receive a request from an external server or an external device, or transmit a response to an external server or an external device.

[0181] The rendering processor 950 may extract a plurality of final search terms through Web document analysis.

[0182] The web interface 930 may include a key event handler 931 and an API interface 933 .

[0183] The rendering processor 950 may include a web engine 951 , a web document analyzer 953 , and a web document acquisition unit 955 .

[0184] Reference Figure 8 , the controller 170 of the display device 100 displays the Web content on the display 180 (S801).

[0185] In one embodiment, the web content may be content provided by a web-based third party.

[0186] In another embodiment, the web content may be content provided by a Progressive Web App (PWA). The web content may represent an execution screen of the PWA.

[0187] PWA can be an application based on web technologies such as HTML and JavaScript.

[0188] In yet another embodiment, the Web content may represent a Web page executed by a Web browser.

[0189] In yet another embodiment, the Web content may be a Web-based data broadcast.

[0190] The controller 170 of the display apparatus 100 receives a trigger for providing a keyword search function ( S803 ).

[0191] The keyword search function may be a function capable of providing search results for a plurality of keywords extracted from an execution screen of an application or a web document of a web page. The keyword search function may be named an AI Magic Link function.

[0192] In one embodiment, the controller 170 may receive a trigger for providing a keyword search function from the remote control device 200 during display of the Web content. The user may generate a trigger for the keyword search function by selecting an OK button set on the remote control device 200 for a preset time.

[0193] The event generator 910 may transfer the command received from the remote control apparatus 200 to the key event handler 931. The key event handler 931 may process the received command.

[0194] The key event handler 931 may transmit the received instruction to the web engine 951 .

[0195] In another embodiment, the controller 170 may identify an application programming interface (API) request as a trigger when receiving the request. That is, the API request may be a trigger for a keyword search function.

[0196] The following preference options can be added to the API request.

[0197] The API requester 920 may transmit an API request to the API interface 933 .

[0198] The API interface 933 may transmit the received API request to the web engine 951 .

[0199] The controller 170 of the display apparatus 100 extracts a plurality of candidate search terms using a Web document corresponding to the Web content (S805).

[0200] The Web document acquisition section 955 of the controller 170 may acquire a Web document constituting Web contents.

[0201] The Web document analyzer 953 may inject a content analyzer injection code into the Web document. The content analyzer injection code may be a preset code for extracting a plurality of keywords from the Web document.

[0202] As the web engine 951 injects the content analyzer injection code into the web document, the web engine 951 may extract a plurality of coordinates corresponding to the plurality of candidate search terms and the plurality of candidate search terms respectively.

[0203] The controller 170 of the display device 100 determines whether there is a search request for a target location on the screen on which the Web content is displayed ( S807 ).

[0204] In the case of receiving the cursor input from the event generator 910 , the key event handler 931 of the web interface 930 may determine that there is a search request for the target location. The cursor input may be an input to the cursor that is controlled according to the movement of the remote control device 200 .

[0205] The target location may be the location of the candidate search term.

[0206] When the cursor is located on the Web content and a command corresponding to the selection of the OK key of the remote control device 200 is received, the key event handler 931 may determine that a search request for the target location has been made.

[0207] In case there has been a search request for a target location, the controller 170 of the display apparatus 100 determines whether an application providing Web contents supports a keyword search function (S809).

[0208] The web interface 930 can determine whether the application supports the keyword search function based on the application setting information. The application setting information can include information on whether the keyword search function is allowed or not.

[0209] In case that the application supports a keyword search function, the controller 170 of the display apparatus 100 determines a plurality of final search terms among a plurality of candidate search terms based on a target location ( S811 ).

[0210] The web interface 930 may determine a candidate search term adjacent to the target location among the plurality of candidate search terms as a final search term.

[0211] The web interface 930 may acquire coordinate information of the cursor at a time point of receiving a trigger received from the remote control apparatus 200 .

[0212] The web interface 930 may compare the coordinate information of the cursor with the coordinate information of each of the plurality of candidate search items.

[0213] The web interface 930 may extract a plurality of final search items whose coordinate information from the cursor is within a preset difference from the plurality of candidate search items according to the comparison result.

[0214] The web interface 930 may transmit the extracted plurality of final search terms to the Toss application 970 .

[0215] Alternatively, the plurality of final search terms may be converted into a suitable format for processing by the Toss application 970 and transmitted to the Toss application 970 .

[0216] The Toss application 970 may provide a keyword search function based on the received plurality of final search terms.

[0217] The Toss application 970 may generate a plurality of keyword terms corresponding to respective final search terms.

[0218] The controller 170 of the display apparatus 100 acquires a plurality of keyword terms based on the determined plurality of final search terms (S813).

[0219] The controller 170 may acquire, through the Toss application 970 , a plurality of keyword terms corresponding to each of the plurality of final search terms.

[0220] The controller 170 of the display apparatus 100 may display the acquired plurality of keyword items on the display 180 ( S815 ).

[0221] In another embodiment, the controller 170 may transmit a plurality of keyword items to an external device through the wireless communication interface 173 .

[0222] In the case where there is no search request for the target location, the controller 170 of the display apparatus 100 determines whether a priority option for classifying a plurality of candidate search terms is set ( S817 ).

[0223] When the web engine 951 of the controller 170 receives an API request through the API interface 933 , it can be determined whether the API request includes a preference option.

[0224] The preferred option may be an option for filtering a plurality of candidate search items according to a pre-set condition.

[0225] The preferred option may be an option for extracting at least one of a content name and a clickable item among a plurality of candidate search items.

[0226] In one embodiment, the preferred option may be an option for extracting only content names among a plurality of candidate search terms.

[0227] In another embodiment, the preferred option may be an option for extracting a clickable item among a plurality of candidate search items.

[0228] In another embodiment, the preferred option may be an option for extracting only plural items associated with the name of the Web content being played.

[0229] In this way, the preference options can be set variously according to the attributes.

[0230] In the case where the preference option is set, the controller 170 of the display apparatus 100 determines a plurality of final search terms from among a plurality of candidate search terms according to the preference option ( S819 ).

[0231] In the case where the API request includes a preference option, the web engine 951 may determine a plurality of final search terms from a plurality of candidate search terms according to the preference option.

[0232] Afterwards, the display device 100 may sequentially execute step S813 and step S815.

[0233] Fig.10a is a diagram illustrating a process of providing a keyword search function by linking with a Toss application in the prior art. Fig.10b 2 is a diagram illustrating a process of providing a keyword search function by linking with a Toss application in one embodiment of the present invention.

[0234] In the prior art, only a limited number of applications provide a keyword search function.

[0235] Reference Fig.10a , the support application 1010 and the Toss application 1030 may be applications set in the display device 100 .

[0236] The support application 1010 providing the keyword search function includes a setting menu application 1011 for action setting of the display device 100 and a Live TV application 1013 providing real-time broadcasting.

[0237] The Toss application 1030 may receive a plurality of search terms received from the setting menu application 1011 or a plurality of search terms received from the Live TV application 1013 , and may obtain search results for each of the received plurality of search terms.

[0238] The search results may be a plurality of keyword terms corresponding to the search term.

[0239] The Toss application 1030 transmits the plurality of search terms received from the setting menu application 1011 to the SDX 1051 of the service client 1050 , and the SDX 1051 may transmit the plurality of search terms to a service discovery protocol (SDP) server 1071 .

[0240] The service client 1050 may be an interface for communicating with the server 1070 .

[0241] The SDP server 1051 may transmit information of one or more applications that may provide search results for the search term to the SDX 1051 , and the SDX 1051 may transmit the received information of the one or more applications to the Toss application 1030 .

[0242] The Toss application 1030 may display the application icon based on the received information of the one or more applications on the display 180. The user may select the application icon and receive search results for the search term through the application.

[0243] The Toss application 1030 may transmit the plurality of search terms received from the Live TV application 1013 to a natural language processing (NLP) manager 1053 of the service client 1050 , and the NLP manager 1053 may transmit the plurality of search terms to the SDP server 1071 .

[0244] The NLP manager 1053 may generate analysis results for the search terms and may transmit the search terms and the analysis results to the Tips server 1073 .

[0245] The Tips server 1073 may transmit one or more keyword terms corresponding to the search term and links for each keyword term to the NLP manager 1053 based on broadcast information (eg, EPG information), and the NLP manager 1053 may transmit the received one or more keyword terms and links to the Toss application 1030 .

[0246] The Toss application 1030 may display the received one or more keyword terms on the display 180 .

[0247] according to Fig.10a In the prior art, the keyword search function is limited to only a portion of application actions set on the display device 100.

[0248] Reference Fig.10b, the Web content 1080 may include an execution screen of a Web application 1081 and a Web page 1083 .

[0249] The web engine 951 may include a web application manager 1091 and a web browser 1093 .

[0250] The web application manager 1091 may extract a plurality of candidate search terms from a web document corresponding to the execution screen of the web application 1081 .

[0251] The web browser 1093 may extract a plurality of candidate search terms from the web documents of the web 1083 .

[0252] The web application manager 1091 and the web browser 1093 can each transmit a plurality of candidate search terms to the Toss application 970 .

[0253] In another embodiment, the web application manager 1091 and the web browser 1093 may each extract a plurality of final search terms from a plurality of candidate search terms based on a preference or a search request for a target location.

[0254] The extracted plurality of final search terms may be transmitted to the Toss application 970 .

[0255] The Toss application 970 may transmit the received plurality of candidate search terms or the plurality of final search terms to the server 1070 through the service client 1050 .

[0256] The service client 1050 may be Figure 1 The configuration corresponds to either the network interface 133 or the external device interface 135.

[0257] The server 1070 may extract one or more keyword terms for each of the received plurality of candidate search terms or the plurality of final search terms.

[0258] The server 1070 may transmit the extracted one or more keyword terms to the service client 1050. The service client 1050 may transmit the extracted one or more keyword terms to the Toss application 970.

[0259] The Toss application 970 may display one or more keyword terms received from the server 1070 and keyword terms generated by itself on the display 180 .

[0260] That is, the Toss application 970 can obtain a plurality of first type keyword items generated by itself from each of a plurality of candidate search items or a plurality of final search items and a plurality of second type keyword items received from the server 1070, and display the obtained first type and second type keyword items on the display 180.

[0261] Thus, according to an embodiment of the present invention, unlike the prior art, the Web content can be analyzed in the Web engine 951 and provided to the Toss application 970 after keywords are extracted.

[0262] Thus, the Toss application 970 connection support that provides a keyword search function can also be implemented for third-party Web content and PWA applications.

[0263] In addition, the Toss application 970 may also be connected to the linkage function of the existing server 1070 .

[0264] In addition, when an image is to be analyzed and processed after being extracted, the Toss application 970 can be linked with the server 1070 to provide a search function for the image.

[0265] Fig.11 FIG. 1 is a diagram illustrating a process of providing search results for a keyword term selected from a plurality of keyword terms through a mini browser according to an embodiment of the present invention.

[0266] Reference Fig.11 , Web content 1100 is displayed on the display. Web content 1100 may be any one of an execution screen of a Web application and a Web page.

[0267] In addition, the display device 100 may display a keyword group 1110 including a plurality of keyword items acquired through the Web document analysis according to a request of a keyword search function of the Web content 1100 .

[0268] In case of receiving an instruction to select any one keyword item 1111 from a plurality of keyword items included in the keyword group 1110 , the display device 100 may display a mini browser 1130 including search results of the selected keyword item 1111 according to the received instruction.

[0269] At the same time, the display device 100 may make the keyword group 1110 disappear.

[0270] On the other hand, the keyword item 1111 may be selected by the pointer 205 (or cursor) which can be controlled by the remote control apparatus 200 .

[0271] In the case where an instruction to select a return key provided to the remote control apparatus 200 or an instruction to select a return key 1131 displayed on the display is received, the display apparatus 100 may redisplay the keyword group 1110 .

[0272] According to an embodiment of the present invention, the above method can be implemented as a processor-readable code in a medium having a program recorded thereon. Examples of processor-readable media include ROM, RAM, CD-ROM, magnetic disk, floppy disk, optical data storage device, etc.

[0273] The display device described above is not limited to the configuration and method of the above-mentioned multiple embodiments. The multiple embodiments can also be configured by selectively combining all or part of each embodiment to form various deformations.

Claims

1. A display device, wherein: include: Display, showing Web content; as well as The controller extracts a plurality of candidate search terms using a Web document of the Web content, and determines a plurality of final search terms from the plurality of candidate search terms based on classification conditions, then obtains a plurality of first-type keyword terms from the determined plurality of final search terms, and displays the obtained plurality of keyword terms on the display.

2. The display device according to claim 1, wherein: In case of receiving a search request for a position of a search term included in the plurality of candidate search terms, the controller acquires a plurality of candidate search terms located adjacent to the search term among the plurality of candidate search terms as the plurality of final search terms.

3. The display device according to claim 2, wherein: The controller obtains coordinate information of each of the plurality of candidate search terms including the search term, and determines a plurality of candidate search terms adjacent to the search term as the plurality of final search terms using the coordinate information.

4. The display device according to claim 1, wherein: In case a preference option is set, the controller determines a plurality of final search items from a plurality of candidate search items according to the preference option.

5. The display device according to claim 4, wherein: The preferred option is an option for extracting any one of the content names and clickable items among the plurality of candidate search items.

6. The display device according to claim 1, wherein: Also includes a network interface for performing communications with an external server; The controller transmits the plurality of final search terms to the external server, and receives a plurality of second-type keyword terms for each of the plurality of final search terms from the external server; The controller displays the first type keyword terms and the second type keyword terms on the display.

7. The display device according to claim 1, wherein: In case of receiving an instruction from a remote control device, the controller extracts a plurality of candidate search terms using a Web document of the Web content.

8. The display device according to claim 1, wherein: In case of receiving the API request, the controller extracts a plurality of candidate search terms using the Web document of the Web content.

9. The display device according to claim 1, wherein: The controller includes a Web engine that extracts a plurality of candidate search terms and coordinate information of each of the plurality of candidate search terms using a Web document of the Web content.

10. The display device according to claim 1, wherein: Each of the plurality of candidate search terms includes a clickable term, a link term, and an image term.

11. The display device according to claim 1, wherein: The web content is any one of an execution screen of a progressive web application and a web page executed by a web browser.

12. The display device according to claim 1, wherein: The controller includes a web interface that receives a trigger for providing a keyword search function.

13. The display device according to claim 1, wherein: The controller receives an instruction to select any one of the plurality of keyword items, and displays search results for the selected keyword item on the display in response to the received instruction.

14. The display device according to claim 13, wherein: The controller displays the search result for the selected keyword item using a mini browser while displaying the Web content.

15. A method for operating a display device, wherein: include: Steps to display web content; The step of extracting a plurality of candidate search terms using the Web document of the Web content; A step of determining a plurality of final search terms from a plurality of candidate search terms based on a classification condition; A step of obtaining a plurality of first type keyword terms from the determined plurality of final search terms; as well as Display the steps of obtaining multiple keyword items.

Images