Electronic device and operation method thereof

Abstract

An electronic device according to an embodiment of the present disclosure may comprise: a display; and a processor which recognizes the execution of a virtual keyboard on a display device, displays, on the display, a notification for displaying a text input window according to the recognition of the execution of the virtual keyboard, and displays, on the display, the text input window according to the selection of the notification.

Description

Electronic device and method of operation thereof

[0001] The present disclosure relates to an electronic device, and more particularly, to an electronic device capable of providing a text input window.

[0002] Digital TV services utilizing wired or wireless networks are becoming more widespread. Digital TV services can offer a variety of services not available with existing analog broadcasting services.

[0003] For example, IPTV (Internet Protocol Television), a type of digital TV service, and smart TV services offer interactivity, allowing users to actively choose the type of program they want to watch and when. Building on this interactivity, IPTV and smart TV services can also offer a variety of additional services, such as internet search, home shopping, and online games.

[0004] A virtual keyboard can be displayed on the TV for searching. However, entering text via the remote control is cumbersome and slow.

[0005] Here, the user goes to the text input page and enters text through a smartphone connected to the TV.

[0006] However, in the past, when a virtual keyboard was run on a TV, there was the inconvenience of having to run a home appliance management application through a smartphone, which could be inconvenient for users.

[0007] An object of the present disclosure may be to quickly provide a text input window without running a separate home appliance management application when a virtual keyboard is executed on a display device.

[0008] An object of the present disclosure may be to quickly provide a text input window to an electronic device corresponding to the same network and the same account without separately executing a home appliance management application when a virtual keyboard is executed on a display device.

[0009] The purpose of the present disclosure may be to quickly access a text input window by simply selecting a notification without running a separate home appliance management application when a virtual keyboard is running on a display device.

[0010] An electronic device according to an embodiment of the present disclosure may include a display; and a processor that recognizes execution of a virtual keyboard on the display device, displays a notification for displaying a text input window on the display upon recognizing execution of the virtual keyboard, and displays the text input window on the display upon selection of the notification.

[0011] A method of operating an electronic device according to an embodiment of the present disclosure may include a step of recognizing execution of a virtual keyboard on a display device, a step of displaying a notification for displaying a text input window upon recognizing execution of the virtual keyboard, and a step of displaying the text input window upon selection of the notification.

[0012] A computer-readable program for executing a method of operating an electronic device according to an embodiment of the present disclosure is recorded on a recording medium, wherein the method of operating the electronic device may include a step of recognizing execution of a virtual keyboard on a display device, a step of displaying a notification for displaying a text input window upon recognizing execution of the virtual keyboard, and a step of displaying the text input window upon selection of the notification.

[0013] According to various embodiments of the present disclosure, the process of entering text after launching a home appliance management application and entering the text input screen can be reduced by allowing the user to enter the process through a notification. This can significantly improve the user's convenience in entering text.

[0014] According to an embodiment of the present disclosure, a user can launch the home appliance management application and a text input window simply by selecting a notification, without having to run the home appliance management application. This allows the user to quickly and easily enter text and receive search results for the entered text, significantly enhancing the user experience.

[0015] Figure 1 is a block diagram illustrating the configuration of a display device according to one embodiment of the present invention.

[0016] Figure 2 is a block diagram of a remote control device according to one embodiment of the present invention.

[0017] Figure 3 shows an example of an actual configuration of a remote control device according to one embodiment of the present invention.

[0018] Figure 4 shows an example of utilizing a remote control device according to an embodiment of the present invention.

[0019] FIG. 5 is a block diagram illustrating the configuration of an electronic device according to an embodiment of the present disclosure.

[0020] FIG. 6 is a flowchart for explaining an operating method of an electronic device according to an embodiment of the present disclosure.

[0021] FIG. 7 is a drawing illustrating a virtual keyboard running on a display device according to one embodiment of the present disclosure.

[0022] FIG. 8 is a diagram illustrating a notification for displaying a text input window according to one embodiment of the present disclosure.

[0023] FIG. 9 is a drawing illustrating a process of inputting text through a text input window displayed on an electronic device according to an embodiment of the present disclosure.

[0024] FIG. 10 is a drawing illustrating an example of providing a search result of text entered through a text input window of an electronic device according to an embodiment of the present disclosure.

[0025] FIG. 11 is a diagram illustrating conditions for receiving a notification for text input according to one embodiment of the present disclosure.

[0026] FIG. 12 is a diagram illustrating a scenario for transmitting a notification for displaying a text input window to electronic devices on the same network according to one embodiment of the present disclosure.

[0027] FIG. 13 is a drawing illustrating an example of selecting a transmission target of a notification for displaying a text input window according to one embodiment of the present disclosure.

[0028] FIG. 14 is a diagram illustrating a scenario in which a user of an electronic device is not positioned in front of a display device according to one embodiment of the present disclosure.

[0029] FIG. 15 is a sequence diagram for explaining an operation method of a system according to an embodiment of the present disclosure.

[0030] FIG. 16 is a block diagram illustrating a configuration of a server according to an embodiment of the present disclosure.

[0031] Hereinafter, embodiments related to the present invention will be described in more detail with reference to the drawings. The suffixes "module" and "part" used in the following description for components are assigned or used interchangeably solely for the convenience of writing the specification, and do not in themselves have distinct meanings or roles.

[0032] A display device according to an embodiment of the present invention is, for example, an intelligent display device that adds computer-assisted functionality to its broadcast reception function. While faithfully performing the broadcast reception function, it can also be equipped with Internet functionality and other features, providing a more user-friendly interface, such as a manual input device, touch screen, or space remote control. Furthermore, with support for wired or wireless Internet functionality, it can connect to the Internet and a computer, enabling functions such as email, web browsing, banking, or gaming. A standardized, general-purpose operating system can be used for these various functions.

[0033] Accordingly, the display device described in the present invention can perform various user-friendly functions, for example, by allowing various applications to be freely added or deleted on a general-purpose operating system kernel. More specifically, the display device can be a network TV, HBB TV, smart TV, LED TV, OLED TV, etc., and in some cases, it can also be applied to smartphones.

[0034] FIG. 1 is a block diagram illustrating the configuration of a display device according to one embodiment of the present invention.

[0035] Referring to FIG. 1, a display device (100) may include a video receiver (130), an external device interface (135), a memory (140), a user input interface (150), a controller (170), a wireless communication interface (173), a display (180), a speaker (185), and a power supply circuit (190).

[0036] The video receiver (130) may include a tuner (131), a demodulator (132), and a network interface (133).

[0037] The tuner (131) can select a specific broadcast channel according to a channel selection command. The tuner (131) can receive a broadcast signal for the selected specific broadcast channel.

[0038] The demodulator (132) can separate the received broadcast signal into a video signal, an audio signal, and a data signal related to the broadcast program, and can restore the separated video signal, audio signal, and data signal into a form that can be output.

[0039] The external device interface (135) can receive an application or a list of applications within an adjacent external device and transmit it to the controller (170) or memory (140).

[0040] The external device interface (135) can provide a connection path between the display device (100) and the external device. The external device interface (135) can receive one or more of images and audio output from an external device connected wirelessly or wiredly to the display device (100) and transmit them to the controller (170). The external device interface (135) can include a plurality of external input terminals. The plurality of external input terminals can include an RGB terminal, one or more HDMI (High Definition Multimedia Interface) terminals, and a component terminal.

[0041] A video signal of an external device input through an external device interface (135) can be output through a display (180). A voice signal of an external device input through an external device interface (135) can be output through a speaker (185).

[0042] An external device that can be connected to the external device interface (135) may be any one of a set-top box, a Blu-ray player, a DVD player, a game console, a sound bar, a smartphone, a PC, a USB memory, and a home theater, but this is only an example.

[0043] The network interface (133) may provide an interface for connecting the display device (100) to a wired / wireless network including the Internet. The network interface (133) may transmit or receive data to or from other users or other electronic devices via the connected network or another network linked to the connected network.

[0044] Additionally, some content data stored in the display device (100) can be transmitted to a selected user or electronic device among other users or other electronic devices pre-registered in the display device (100).

[0045] The network interface (133) can access a predetermined web page through a connected network or another network linked to the connected network. That is, by accessing a predetermined web page through a network, data can be transmitted or received with the corresponding server.

[0046] In addition, the network interface (133) can receive content or data provided by a content provider or network operator. That is, the network interface (133) can receive content such as movies, advertisements, games, VOD, broadcast signals, etc. and information related thereto provided from a content provider or network provider via a network.

[0047] Additionally, the network interface (133) can receive firmware update information and update files provided by the network operator, and can transmit data to the Internet or content provider or network operator.

[0048] The network interface (133) can select and receive a desired application from among applications open to the public via a network.

[0049] The memory (140) stores a program for each signal processing and control within the controller (170), and can store signal-processed image, voice, or data signals.

[0050] In addition, the memory (140) may perform a function for temporary storage of video, audio, or data signals input from an external device interface (135) or a network interface (133), and may store information about a specific image through a channel memory function.

[0051] The memory (140) can store an application or a list of applications input from an external device interface (135) or a network interface (133).

[0052] The display device (100) can play content files (video files, still image files, music files, document files, application files, etc.) stored in the memory (140) and provide them to the user.

[0053] The user input interface (150) can transmit a signal input by the user to the controller (170) or transmit a signal from the controller (170) to the user. For example, the user input interface (150) can receive and process control signals such as power on / off, channel selection, and screen setting from the remote control device (200) according to various communication methods such as Bluetooth, Ultra Wideband (WB), ZigBee, Radio Frequency (RF) communication, or infrared (IR) communication, or process the control signals from the controller (170) to be transmitted to the remote control device (200).

[0054] In addition, the user input interface (150) can transmit control signals input from local keys (not shown) such as a power key, channel key, volume key, and setting value to the controller (170).

[0055] An image signal processed by the controller (170) can be input to the display (180) and displayed as an image corresponding to the image signal. In addition, an image signal processed by the controller (170) can be input to an external output device through an external device interface (135).

[0056] The voice signal processed by the controller (170) can be output as audio to the speaker (185). In addition, the voice signal processed by the controller (170) can be input to an external output device through the external device interface (135).

[0057] In addition, the controller (170) can control the overall operation within the display device (100).

[0058] In addition, the controller (170) can control the display device (100) by a user command or internal program input through the user input interface (150), and can connect to a network to enable the user to download a desired application or application list into the display device (100).

[0059] The controller (170) enables the user-selected channel information, etc. to be output through a display (180) or speaker (185) together with processed video or audio signals.

[0060] In addition, the controller (170) allows a video signal or audio signal from an external device, for example, a camera or camcorder, input through the external device interface (135) to be output through the display (180) or speaker (185) in accordance with an external device video playback command received through the user input interface (150).

[0061] Meanwhile, the controller (170) can control the display (180) to display an image, for example, a broadcast image input through a tuner (131), an external input image input through an external device interface (135), an image input through a network interface, or an image stored in a memory (140) can be controlled to be displayed on the display (180). In this case, the image displayed on the display (180) can be a still image or a moving image, and can be a 2D image or a 3D image.

[0062] In addition, the controller (170) can control the playback of content stored in the display device (100), received broadcast content, or external input content input from outside, and the content can be in various forms such as broadcast video, external input video, audio file, still image, connected web screen, and document file.

[0063] The wireless communication interface (173) can communicate with an external device through wired or wireless communication. The wireless communication interface (173) can perform short-range communication with the external device. To this end, the wireless communication interface (173) can support short-range communication using at least one of Bluetooth™, RFID (Radio Frequency Identification), Infrared Data Association (IrDA), UWB (Ultra Wideband), ZigBee, NFC (Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technologies. This wireless communication interface (173) can support wireless communication between the display device (100) and a wireless communication system, between the display device (100) and another display device (100), or between the display device (100) and a network in which the display device (100, or an external server) is located via a short-range wireless communication network (Wireless Area Network). The short-range wireless communication network can be a short-range wireless personal area network (Wireless Personal Area Network).

[0064] Here, the other display device (100) may be a wearable device (e.g., a smartwatch, smart glasses, a head-mounted display (HMD)) or a mobile terminal such as a smart phone that can exchange data with (or be linked to) the display device (100) according to the present invention. The wireless communication interface (173) may detect (or recognize) a wearable device capable of communication around the display device (100).

[0065] Furthermore, if the detected wearable device is a device certified to communicate with the display device (100) according to the present invention, the controller (170) can transmit at least a portion of the data processed in the display device (100) to the wearable device via the wireless communication interface (173). Accordingly, a user of the wearable device can utilize the data processed in the display device (100) via the wearable device.

[0066] The display (180) can generate a driving signal by converting a video signal, data signal, OSD signal processed by the controller (170) or a video signal, data signal, etc. received from an external device interface (135) into R, G, and B signals, respectively.

[0067] Meanwhile, since the display device (100) illustrated in FIG. 1 is merely an embodiment of the present invention, some of the illustrated components may be integrated, added, or omitted depending on the specifications of the display device (100) actually implemented.

[0068] That is, two or more components may be combined into a single component, or a single component may be subdivided into two or more components, as needed. Furthermore, the functions performed by each block are intended to illustrate embodiments of the present invention, and their specific operations or devices do not limit the scope of the present invention.

[0069] According to another embodiment of the present invention, the display device (100) may receive and play back an image through a network interface (133) or an external device interface (135) without having a tuner (131) and a demodulator (132), unlike that shown in FIG. 1.

[0070] For example, the display device (100) may be implemented separately as an image processing device, such as a set-top box, for receiving broadcast signals or contents according to various network services, and a content playback device for playing contents input from the image processing device.

[0071] In this case, the operating method of the display device according to the embodiment of the present invention to be described below may be performed by any one of the display device (100) described with reference to FIG. 1, as well as an image processing device such as the separated set-top box, or a content playback device having a display (180) and a speaker (185).

[0072] Next, a remote control device according to an embodiment of the present invention will be described with reference to FIGS. 2 and 3.

[0073] FIG. 2 is a block diagram of a remote control device according to an embodiment of the present invention, and FIG. 3 shows an example of an actual configuration of a remote control device (200) according to an embodiment of the present invention.

[0074] First, referring to FIG. 2, the remote control device (200) may include a fingerprint recognition device (210), a wireless communication circuit (220), a user input interface (230), a sensor (240), an output interface (250), a power supply circuit (260), a memory (270), a controller (280), and a microphone (290).

[0075] Referring to FIG. 2, the wireless communication circuit (220) transmits and receives signals with any one of the display devices according to the embodiments of the present invention described above.

[0076] The remote control device (200) may be equipped with an RF circuit (221) capable of transmitting and receiving signals with the display device (100) according to RF communication standards, and an IR circuit (223) capable of transmitting and receiving signals with the display device (100) according to IR communication standards. In addition, the remote control device (200) may be equipped with a Bluetooth circuit (225) capable of transmitting and receiving signals with the display device (100) according to Bluetooth communication standards. In addition, the remote control device (200) may be equipped with an NFC circuit (227) capable of transmitting and receiving signals with the display device (100) according to NFC (Near Field Communication) communication standards, and a WLAN circuit (229) capable of transmitting and receiving signals with the display device (100) according to WLAN (Wireless LAN) communication standards.

[0077] Additionally, the remote control device (200) transmits a signal containing information about the movement of the remote control device (200) to the display device (100) through a wireless communication circuit (220).

[0078] Meanwhile, the remote control device (200) can receive a signal transmitted by the display device (100) through the RF circuit (221), and, if necessary, can transmit commands for power on / off, channel change, volume change, etc. to the display device (100) through the IR circuit (223).

[0079] The user input interface (230) may be configured as a keypad, buttons, a touchpad, or a touch screen. The user can input commands related to the display device (100) to the remote control device (200) by operating the user input interface (230). If the user input interface (230) includes a hard key button, the user can input commands related to the display device (100) to the remote control device (200) by pushing the hard key button. This will be described with reference to FIG. 3.

[0080] Referring to FIG. 3, the remote control device (200) may include a plurality of buttons. The plurality of buttons may include a fingerprint recognition button (212), a power button (231), a home button (232), a live button (233), an external input button (234), a volume control button (235), a voice recognition button (236), a channel change button (237), a confirmation button (238), and a back button (239).

[0081] The fingerprint recognition button (212) may be a button for recognizing a user's fingerprint. In one embodiment, the fingerprint recognition button (212) may be capable of a push operation, and may receive a push operation and a fingerprint recognition operation.

[0082] The power button (231) may be a button for turning the power of the display device (100) on / off.

[0083] The home button (232) may be a button for moving to the home screen of the display device (100).

[0084] The live button (233) may be a button for displaying a real-time broadcast program.

[0085] The external input button (234) may be a button for receiving an external input connected to the display device (100).

[0086] The volume control button (235) may be a button for adjusting the size of the volume output by the display device (100).

[0087] The voice recognition button (236) may be a button for receiving a user's voice and recognizing the received voice.

[0088] The channel change button (237) may be a button for receiving a broadcast signal of a specific broadcast channel.

[0089] The confirmation button (238) may be a button for selecting a specific function, and the back button (239) may be a button for returning to the previous screen.

[0090] Let's explain Figure 2 again.

[0091] When the user input interface (230) has a touch screen, the user can input commands related to the display device (100) using the remote control device (200) by touching the soft keys of the touch screen. In addition, the user input interface (230) may have various types of input means that can be operated by the user, such as a scroll key or a jog key, and this embodiment does not limit the scope of the present invention.

[0092] The sensor (240) may include a gyro sensor (241) or an acceleration sensor (243), and the gyro sensor (241) may sense information about the movement of the remote control device (200).

[0093] For example, the gyro sensor (241) can sense information about the operation of the remote control device (200) based on the x, y, and z axes, and the acceleration sensor (243) can sense information about the movement speed of the remote control device (200). Meanwhile, the remote control device (200) can further be equipped with a distance measuring sensor, so as to sense the distance to the display (180) of the display device (100).

[0094] The output interface (250) can output a video or audio signal corresponding to an operation of the user input interface (230) or a signal transmitted from the display device (100).

[0095] The user can recognize whether the output interface (250) is manipulating the user input interface (230) or controlling the display device (100).

[0096] For example, the output interface (250) may include an LED (251) that lights up when the user input interface (230) is operated or a signal is transmitted and received with the display device (100) via a wireless communication circuit (220), a vibrator (253) that generates vibrations, a speaker (255) that outputs sound, or a display (257) that outputs images.

[0097] In addition, the power supply circuit (260) supplies power to the remote control device (200), and reduces power waste by stopping the power supply when the remote control device (200) does not move for a predetermined period of time.

[0098] The power supply circuit (260) can resume power supply when a predetermined key provided in the remote control device (200) is operated.

[0099] The memory (270) can store various types of programs, application data, etc. required for the control or operation of the remote control device (200).

[0100] When the remote control device (200) wirelessly transmits and receives signals through the display device (100) and the RF circuit (221), the remote control device (200) and the display device (100) transmit and receive signals through a predetermined frequency band.

[0101] The controller (280) of the remote control device (200) can store and reference information regarding the frequency band, etc., that can wirelessly transmit and receive signals with the display device (100) paired with the remote control device (200), in the memory (270).

[0102] The controller (280) controls all matters related to the control of the remote control device (200). The controller (280) can transmit a signal corresponding to a predetermined key operation of the user input interface (230) or a signal corresponding to the movement of the remote control device (200) sensed by the sensor (240) to the display device (100) through the wireless communication circuit (220).

[0103] Additionally, the microphone (290) of the remote control device (200) can acquire voice.

[0104] A plurality of microphones (290) may be provided.

[0105] Next, Figure 4 is described.

[0106] Figure 4 shows an example of utilizing a remote control device according to an embodiment of the present invention.

[0107] Figure 4 (a) illustrates that a pointer (205) corresponding to a remote control device (200) is displayed on a display (180).

[0108] The user can move or rotate the remote control device (200) up and down, left and right. The pointer (205) displayed on the display (180) of the display device (100) corresponds to the movement of the remote control device (200). This remote control device (200) can be called a space remote control because, as shown in the drawing, the pointer (205) moves and is displayed according to the movement in 3D space.

[0109] Figure 4 (b) illustrates that when a user moves the remote control device (200) to the left, the pointer (205) displayed on the display (180) of the display device (100) also moves to the left correspondingly.

[0110] Information about the movement of the remote control device (200) detected through the sensor of the remote control device (200) is transmitted to the display device (100). The display device (100) can calculate the coordinates of the pointer (205) from the information about the movement of the remote control device (200). The display device (100) can display the pointer (205) to correspond to the calculated coordinates.

[0111] Figure 4 (c) illustrates a case where a user moves the remote control device (200) away from the display (180) while pressing a specific button within the remote control device (200). As a result, a selection area within the display (180) corresponding to the pointer (205) can be zoomed in and displayed in an enlarged manner.

[0112] Conversely, when the user moves the remote control device (200) closer to the display (180), the selection area within the display (180) corresponding to the pointer (205) may be zoomed out and displayed in a reduced size.

[0113] Meanwhile, when the remote control device (200) moves away from the display (180), the selection area may be zoomed out, and when the remote control device (200) moves closer to the display (180), the selection area may be zoomed in.

[0114] Additionally, when a specific button within the remote control device (200) is pressed, recognition of up, down, left, and right movements may be excluded. That is, when the remote control device (200) moves away from or toward the display (180), up, down, left, and right movements may not be recognized, and only forward and backward movements may be recognized. When a specific button within the remote control device (200) is not pressed, only the pointer (205) moves in accordance with the up, down, left, and right movements of the remote control device (200).

[0115] Meanwhile, the movement speed or movement direction of the pointer (205) can correspond to the movement speed or movement direction of the remote control device (200).

[0116] Meanwhile, the pointer in this specification refers to an object displayed on the display (180) in response to the operation of the remote control device (200). Accordingly, objects of various shapes other than the arrow shape illustrated in the drawing can be used as the pointer (205). For example, the pointer may be a concept including a point, a cursor, a prompt, a thick outline, etc. In addition, the pointer (205) may be displayed corresponding to one point on the horizontal or vertical axis on the display (180), or may be displayed corresponding to multiple points such as lines or surfaces.

[0117] FIG. 5 is a block diagram illustrating the configuration of an electronic device according to an embodiment of the present disclosure.

[0118] Referring to FIG. 5, the electronic device (500) may include a wired communication interface (510), a wireless communication interface (520), a memory (530), an output interface (540), and a processor (590).

[0119] A wired communication interface (510) can provide a connection path with an external device. The wired communication interface (510) can receive one or more images and audio output from an external device wired to an electronic device (500) and transmit the received data to a processor (590).

[0120] The wired communication interface (510) may include a plurality of external input terminals. The plurality of external input terminals may include an RGB terminal, one or more HDMI (High Definition Multimedia Interface) terminals, and a component terminal.

[0121] The wireless communication interface (520) may provide an interface for connecting the electronic device (500) to a wired / wireless network, including the Internet. The network interface (523) may transmit or receive data to or from an external device or external server via the connected network or another network linked to the connected network.

[0122] The wireless communication interface (520) may include one or more of an Internet communication circuit, a Wi-Fi communication circuit, and a Bluetooth communication circuit.

[0123] The memory (530) stores a program for each signal processing and control within the processor (590), and can store signal-processed images, voices, or data signals.

[0124] The output interface (540) may include at least one of a display (541) that displays an image processed by the processor (590) or a speaker (543) that outputs audio processed by the processor (590).

[0125] The display (541) may be provided in the form of a touch screen that can display a screen and be touched at the same time.

[0126] The processor (590) can control the overall operation of the electronic device (500).

[0127] The processor (590) recognizes the execution of a virtual keyboard on the display device (100), and upon recognizing the execution of the virtual keyboard, displays a notification for displaying a text input window on the display (541), and can display the text input window on the display (541) according to selection of the notification.

[0128] The processor (590) can display the above notification when the network of the display device (100) and the network of the electronic device (500) are the same and the login account of the display device (100) and the login account of the electronic device (500) are the same.

[0129] Each login account may represent an account of a home appliance management application installed on each of the display devices and the electronic devices.

[0130] The processor (590) can transmit text entered through the text input window to the display device (100) through the wireless communication interface (520).

[0131] The processor (590) can recognize the execution of the virtual keyboard based on a signal received from the display device (100) via the wireless communication interface (520).

[0132] The processor (590) can automatically execute a home appliance management application for managing home appliances according to the selection of a notification, and display the text input window on the display (541) according to the execution of the home appliance management application.

[0133] The electronic device (500) may be any one of a smartphone, a smart pad, a laptop, a PC, and a wearable device.

[0134] FIG. 6 is a flowchart for explaining an operating method of an electronic device according to an embodiment of the present disclosure.

[0135] Below, a home appliance management application may be installed on each of the display device (100) and the electronic device (500). The home appliance management application may be an application for controlling and managing home appliances connected to the same network.

[0136] In particular, the home appliance management application may be software that can remotely control and manage home appliances via an electronic device (500). The home appliance management application may be driven according to commands from a processor (590).

[0137] Referring to FIG. 6, the processor (590) of the electronic device (500) can recognize the execution of a virtual keyboard on the display device (100) (S601).

[0138] The display device (100) can display a virtual keyboard on the display (180) upon receiving a user command to execute the virtual keyboard. The processor (590) can recognize that the virtual keyboard is executed on the display device (100).

[0139] In one embodiment, the display device (100) may transmit a signal indicating execution of the virtual keyboard to the electronic device (500) as the virtual keyboard is displayed.

[0140] In another embodiment, a server linked with a home appliance management application can recognize the execution of a virtual keyboard on a display device (100) and transmit a signal indicating the execution of the virtual keyboard to an electronic device (500).

[0141] The processor (590) can recognize that a virtual keyboard has been executed on the display device (100) based on a signal received from the display device (100) or a signal received from a server via a wireless communication interface (520).

[0142] The processor (590) can recognize that a virtual keyboard is displayed on the display device (100) based on a signal received from the display device (100) or a signal received from the server.

[0143] FIG. 7 is a drawing illustrating a virtual keyboard running on a display device according to one embodiment of the present disclosure.

[0144] Referring to FIG. 7, the display device (100) can display a search screen (700) on the display (180). The search screen (700) may be a screen displayed according to the execution of a specific application.

[0145] The search screen (700) may include a search window (710) and a virtual keyboard (730).

[0146] The display device (100) can display a virtual keyboard (730) on the display (180) according to a command received from the remote control device (200). The display device (100) can display a virtual keyboard (730) on the display (180) according to a command to select a search window (710) through a pointer (205) controlled by the movement of the remote control device (200).

[0147] The electronic device (500) can recognize the execution or display of the virtual keyboard (730) of the display device (100). The electronic device (500) can receive a signal indicating that the virtual keyboard (730) has been executed or displayed on the display device (100) from a server linked to the display device (100) or a home appliance management application.

[0148] Again, Figure 6 is explained.

[0149] The processor (590) can output a notification for displaying a text input window upon recognizing the execution of the virtual keyboard (S603).

[0150] The processor (590) can display a notification for displaying a text input window on the display (541) based on recognizing the execution of a virtual keyboard on the display device (100).

[0151] FIG. 8 is a diagram illustrating a notification for displaying a text input window according to one embodiment of the present disclosure.

[0152] Referring to FIG. 8, the electronic device (500) can display a notification (810) for displaying a text input window on the display (180).

[0153] An electronic device (500) can display a notification (810) while displaying a screen (800). The screen (800) may be an execution screen of an application other than a home appliance management application.

[0154] For example, a notification (810) for displaying a text input window may include text indicating that a notification for text input has been received.

[0155] The notification (810) for displaying a text input window may further include text indicating that a virtual keyboard has been launched on the display device (100).

[0156] Again, Figure 7 is explained.

[0157] The processor (590) can determine whether the output notification has been selected (S605).

[0158] The processor (590) can display a text input window on the display (541) based on the notification being selected (S607).

[0159] The processor (590) can automatically execute a home appliance management application based on the notification selection and simultaneously display a text input window on the display (541).

[0160] Accordingly, users can be exposed to a text input window without the complex actions of running a separate home appliance management application.

[0161] The selection of a notification for displaying a text input window may be a trigger for displaying a text input window simultaneously with the launch of the appliance management application.

[0162] The text input window may be a keyboard window of the same type or a different type from the virtual keyboard displayed on the display device (100).

[0163] The processor (590) can receive text input through a text input window (S609) and transmit the received text input to the display device (100) through a wireless communication interface (520) (S611).

[0164] In one embodiment, the processor (590) can receive text input through a text input window displayed on the display (541) and transmit text information corresponding to the received text input to the display device (100).

[0165] FIG. 9 is a drawing illustrating a process of inputting text through a text input window displayed on an electronic device according to an embodiment of the present disclosure.

[0166] When a notification for displaying a text input window is selected, the processor (590) can display a text input window (900) as shown in (a) of FIG. 9 on the display (541).

[0167] The text input window (900) may be a screen displayed according to the execution of the home appliance management application.

[0168] The text input window (900) may include a text input bar (910), a keyboard area (920), and a search button (930).

[0169] The text input bar (910) may be a bar where text entered by the user through the keyboard area (920) is displayed.

[0170] The keyboard area (920) may be an area where a virtual keyboard including multiple character items is displayed.

[0171] The search button (930) may be a button for requesting a search of text entered in the text input bar (910). When the processor (590) receives a command to select the search button (930) while a keyword is entered in the text input bar (910), the processor (590) may transmit a search request for the keyword to the display device (100).

[0172] The display device (100) can display search results for keywords on the display (180) upon receiving a search request for keywords.

[0173] The display device (100) may also display keywords received from the electronic device (500) in a search window (710).

[0174] When a keyword entered in the text input bar (910) is transmitted to the display device (100), the search button (930) can be changed to a complete button (940) as shown in (b) of FIG. 9.

[0175] As another example, after the search button (930) is selected, the search button (930) may be switched to a complete button (940) as shown in (b) of FIG. 9.

[0176] The display device (100) can obtain search results for keywords upon receiving a search request for keywords, and display the obtained search results on the display (180).

[0177] FIG. 10 is a drawing illustrating an example of providing a search result of text entered through a text input window of an electronic device according to an embodiment of the present disclosure.

[0178] Referring to FIG. 10, the electronic device (500) inputs a search word through a text input window. <trip>can be transmitted to the display device (100) via a wireless communication interface (520).

[0179] The display device (100) can receive a search word received from an electronic device (500) and display a search result (1000) of the received search word on the display (180).

[0180] In this way, according to an embodiment of the present disclosure, a user can execute the home appliance management application and launch a text input window simply by selecting a notification, without executing the home appliance management application.

[0181] Accordingly, users can easily and quickly input text and receive search results for the input text, greatly improving the user experience.

[0182] FIG. 11 is a diagram illustrating conditions for receiving a notification for text input according to one embodiment of the present disclosure.

[0183] In FIG. 11, each of the first electronic device (500-1), the second electronic device (500-2), and the third electronic device (500-3) may be an example of the electronic device (500) of FIG. 5.

[0184] In one embodiment, when a virtual keyboard is running on the display device (100), a notification for displaying a text input window may be transmitted only when the network and the account logged into each device are the same.

[0185] That is, the electronic device (500) can receive a notification for displaying a text input window only when it is connected to the same network as the display device (100) and the account logged into the display device (100) matches the account logged into the electronic device (500).

[0186] The login account may be an account for logging into the home appliance management application.

[0187] A home appliance management application, a server linked to the home appliance management application, or a display device (100) connected to the same network as the network of the display device (100) can transmit a notification for displaying a text input window only to an electronic device (500) with the same account as the login account of the display device (100).

[0188] The same network could mean that the Service Set Identifiers of the (WiFi) networks are the same.

[0189] Referring to FIG. 11, the login account of the display device (100) may be A, and the network SSID of the display device (100) may be ip_1. The login account of the first electronic device (500-1) may be A, and the network SSID of the first electronic device (500-1) may be ip_1. The login account of the second electronic device (500-2) may be A, and the network SSID of the second electronic device (500-2) may be ip_2. The login account of the third electronic device (500-3) may be B, and the network SSID of the third electronic device (500-3) may be ip_1.

[0190] When a home appliance management application, a server linked to the home appliance management application, or a display device (100) can transmit a notification for displaying a text input window only to a first electronic device (500-1) having the same network SSID and login account, when a virtual keyboard is running.

[0191] When the home appliance management application, the server or display device (100) linked with the home appliance management application executes the virtual keyboard, it can obtain the network SSID and login account of each electronic device.

[0192] A home appliance management application, a server linked to the home appliance management application, or a display device (100) can compare the network SSID and login account of each electronic device with the network SSID and login account of the display device (100) to determine the target of notification transmission.

[0193] In another embodiment, when the electronic device (500) recognizes the execution of a virtual keyboard on the display device (100), it can obtain the network SSID and login account of the display device (100).

[0194] If the network SSID of the display device (100) and the network SSID of the electronic device (500) match, and the login account of the display device (100) and the login account of the electronic device (500) match, the electronic device (500) can display a notification for displaying a text input window on the display (541).

[0195] The electronic device (500) can receive the network SSID and login account of the display device (100) from a server linked to the display device (100) or a home appliance management application through a wireless communication interface (520).

[0196] FIG. 12 is a diagram illustrating a scenario for transmitting a notification for displaying a text input window to electronic devices on the same network according to one embodiment of the present disclosure.

[0197] In one embodiment, when a virtual keyboard is executed on the display device (100), a notification for displaying a text input window on electronic devices of accounts set as group members may be transmitted through the home appliance management application.

[0198] It is assumed that login account A and login account B are each accounts belonging to the same group members pre-registered in the home appliance management application.

[0199] Referring to (a) of FIG. 12, the login account of the display device (100) may be A, and the network SSID of the display device (100) may be ip_1. The login account of the first electronic device (500-1) may be A, and the network SSID of the first electronic device (500-1) may be ip_1. The login account of the third electronic device (500-3) may be B, and the network SSID of the third electronic device (500-3) may be ip_1.

[0200] Each of the first electronic device (500-1) and the third electronic device (500-3) can receive a notification for displaying a text input window from the display device (100) as the virtual keyboard is executed on the display device (100).

[0201] That is, if the network SSID of the display device (100) is the same, the third electronic device (500-3) can output a notification for displaying the text input window even if the login account is different.

[0202] Meanwhile, the third electronic device (500-3) may display a text input window on the display (541) upon receiving a command to select a notification. The display device (100) may switch the login account of the display device (100) from A to B based on the notification being selected on the third electronic device (500-3). In other words, the login account of the display device (100) and the login account of the third electronic device (500-3) may be synchronized.

[0203] The third electronic device (500-3) can transmit a signal indicating the selection of a notification to the display device (100), and the display device (100) can switch the login account from A to B based on the received signal. The user of the third electronic device (500-3) can use the display device (100) while the display device (100) and the login account are synchronized.

[0204] FIG. 13 is a drawing illustrating an example of selecting a transmission target of a notification for displaying a text input window according to one embodiment of the present disclosure.

[0205] In Fig. 13, the embodiment of Fig. 7 is borrowed.

[0206] The display device (100) can display a search screen (700) including a search window (710) and a virtual keyboard (730).

[0207] The display device (100) may display a pop-up window (1300) on the display (180) to inquire about a destination for notification for displaying a text input window as the virtual keyboard (730) is executed. The pop-up window (1300) may include text requesting selection of a destination for notification for displaying a text input window and login accounts (A, B).

[0208] In one embodiment, the login accounts (A, B) may be accounts registered as members of a group in a home appliance management application.

[0209] In another embodiment, the login accounts (A, B) may be accounts whose network SSID is the same as the SSID of the display device (100) and are registered as members of a group in the home appliance management application.

[0210] When one of the login accounts (A, B) having the same network SSID is selected, the display device (100) can transmit a notification for displaying text input to the electronic device (500) of the selected account via the wireless communication interface (173).

[0211] In this way, according to an embodiment of the present disclosure, a transmission target of a notification for displaying a text input window when a virtual keyboard is executed on a display device (100) can be selected.

[0212] FIG. 14 is a diagram illustrating a scenario in which a user of an electronic device is not positioned in front of a display device according to one embodiment of the present disclosure.

[0213] Referring to FIG. 14, it is assumed that the first electronic device (500-1) and the user are not located in front of the display device (100), but are located in a different space.

[0214] The display device (100) can transmit a notification for displaying a text input window according to the execution of the virtual keyboard to the first electronic device (500-1) connected to the same network. The display device (100) can determine whether the user of the first electronic device (500-1) is in front of the display device (100).

[0215] The display device (100) can detect the presence of a user of the first electronic device (500-1) based on information sensed through a camera or infrared sensor. If the user of the first electronic device (500-1) is not present and the display device (100) recognizes the execution of a virtual keyboard, the display device (100) can transmit a notification and a mirroring screen for displaying a text input window to the first electronic device (500-1).

[0216] The first electronic device (500-1) can display a notification and mirroring screen (1400) for displaying a text input window on the display (541). Text explaining the status of the virtual keyboard's execution can be further displayed on one side of the mirroring screen (1400).

[0217] A user of the first electronic device (500-1) can recognize the execution of the virtual keyboard even if it is not located in front of the display device (100) and perform a search through a text input window remotely.

[0218] FIG. 15 is a sequence diagram for explaining an operation method of a system according to an embodiment of the present disclosure.

[0219] Referring to FIG. 15, the system may include a display device (100), an electronic device (500), and a server (1500).

[0220] The server (1500) may be a device for driving a home appliance management application installed in each of the display device (100) and the electronic device (500).

[0221] The display device (100) can execute a virtual keyboard (S1501) and transmit an execution signal indicating execution of the virtual keyboard to the server (1500) (S1503).

[0222] The display device (100) can display a search screen (700) on the display (180) according to the execution of an application. The search screen (700) may be a screen displayed according to the execution of a specific application.

[0223] The search screen (700) may include a search window (710) and a virtual keyboard (730).

[0224] The display device (100) can display a virtual keyboard (730) on the display (180) according to a command received from the remote control device (200).

[0225] The server (1500) can generate a notification for displaying a text input window (900) according to an execution signal received from the display device (100) and transmit the generated notification to the electronic device (500) (S1505).

[0226] In one embodiment, the server (1500) is connected to the same network as the network of the display device (100) and can transmit a notification for displaying a text input window only to an electronic device (500) with the same account as the login account of the display device (100).

[0227] In another embodiment, the server (1500) may send a notification for displaying a text input window to an electronic device (500) corresponding to an account belonging to the same group member pre-registered in the home appliance management application.

[0228] In another embodiment, if the network SSID of the display device (100) and the network SSID of the electronic device (500) are the same, the server (1500) can transmit a notification for displaying a text input window to the electronic device (500) even if the login accounts of each of the two devices are different.

[0229] The login account of the display device (100) is A, the login account of the electronic device (500) is B, and the display device (100) and the electronic device (500) are connected to the same network. The server (1500) can switch the login account of the display device (100) from A to B based on the notification selected on the electronic device (500). That is, the login account of the display device (100) and the login account of the electronic device (500) can be synchronized.

[0230] The server (1500) can cause a pop-up window (1300) to be displayed on the display device (100) to inquire about the destination of a notification for displaying a text input window as the virtual keyboard (730) is executed.

[0231] The electronic device (500) can display a notification received from the server (1500) on the display (541) (S1507).

[0232] The electronic device (500) can display a text input window (900) on the display (541) according to the selection of the notification (S1509).

[0233] The selection of a notification for displaying a text input window may be a trigger for displaying a text input window simultaneously with the launch of the appliance management application.

[0234] The electronic device (500) can transmit text entered through the text input window (900) to the server (1500) through the wireless communication interface (520) (S1511).

[0235] The server (1500) can transmit the received text to the display device (100) (S1513).

[0236] The display device (100) can display the received text in the search window (710) of the search screen (700) (S1515).

[0237] FIG. 16 is a block diagram illustrating a configuration of a server according to an embodiment of the present disclosure.

[0238] The server (1500) may include a communication interface (1510), a database (1530), and a hardware processor (1590).

[0239] The communication interface (1510) can perform Internet communication with the display device (100) and the electronic device (500). The communication interface (1510) can include a communication circuit for Internet communication.

[0240] The communication interface (1510) can transmit or receive data to or from the display device (100) or the electronic device (500) via the connected network or another network linked to the connected network.

[0241] The communication interface (1510) can receive an execution signal indicating execution of a virtual keyboard from the display device (100).

[0242] The database (1530) stores programs for each signal processing and control within the hardware processor (1590), and can store signal-processed images, voices, or data signals.

[0243] The database (1530) can store information related to a home appliance management application. It can store information about user accounts of the home appliance management application. The information about the user account can include one or more of the user ID, password, and network SSID.

[0244] The hardware processor (1590) can control the overall operation of the server (1500).

[0245] The hardware processor (1590) can generate a notification for displaying a text input window (900) according to an execution signal received from the display device (100) and transmit the generated notification to the electronic device (500). The hardware processor (1590) can transmit text received from the electronic device (500) to the display device (100).

[0246] According to one embodiment of the present disclosure, the above-described method can be implemented as processor-readable code on a medium in which a program is recorded. Examples of processor-readable media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, and optical data storage devices.

[0247] The display device described above is not limited to the configuration and method of the embodiments described above, and the embodiments may be configured by selectively combining all or part of each embodiment so that various modifications can be made.< / trip>

Claims

1. In electronic devices, display; and A processor comprising: a processor for recognizing execution of a virtual keyboard on a display device; displaying a notification for displaying a text input window on the display upon recognizing execution of the virtual keyboard; and displaying the text input window on the display upon selection of the notification. Electronic devices.

2. In paragraph 1, The above processor If the network of the display device and the network of the electronic device are the same, and the login account of the display device and the login account of the electronic device are the same, the notification is displayed. Electronic devices.

3. In paragraph 2, Each login account represents an account of the home appliance management application installed on each of the display devices and electronic devices. Electronic devices.

4. In paragraph 1, Further comprising a wireless communication interface, The above processor Transmitting text entered through the text input window to the display device through the wireless communication interface Electronic devices.

5. In paragraph 1, Further comprising a wireless communication interface, The above processor Recognizing the execution of the virtual keyboard based on a signal received from the display device through the wireless communication interface Electronic devices.

6. In paragraph 1, The above processor Automatically execute a home appliance management application for managing home appliances according to the selection of the above notification, and display the text input window on the display according to the execution of the home appliance management application. Electronic devices.

7. In paragraph 1, The type of the above virtual keyboard and the type of the above text input window are the same or different. Electronic devices.

8. In the method of operating an electronic device, A step of recognizing the execution of a virtual keyboard on a display device; A step of displaying a notification for displaying a text input window upon recognizing the execution of the above virtual keyboard; and Including a step of displaying the text input window according to the selection of the above notification. How electronic devices work.

9. In paragraph 8, The steps to display the above notification are If the network of the display device and the network of the electronic device are the same, and the login account of the display device and the login account of the electronic device are the same, the step of displaying the notification is included. How electronic devices work.

10. In paragraph 9, Each login account represents an account of the home appliance management application installed on each of the display devices and electronic devices. How electronic devices work.

11. In paragraph 8, Further comprising a step of transmitting text entered through the text input window to the display device. How electronic devices work.

12. In paragraph 8, The above recognition steps are A step of recognizing the execution of the virtual keyboard based on a signal received from the display device. How electronic devices work.

13. In paragraph 8, The steps to display the above notification are Steps for automatically executing a home appliance management application for managing home appliances according to the selection of the above notification; and Including a step of displaying the text input window according to the execution of the home appliance management application. How electronic devices work.

14. In paragraph 1, The type of the above virtual keyboard and the type of the above text input window are the same or different. How electronic devices work.

15. A recording medium having recorded thereon a computer-readable program for executing an operating method of an electronic device, The method of operation of the above electronic device is A step for recognizing the execution of a virtual keyboard on a display device; A step of displaying a notification for displaying a text input window upon recognizing the execution of the above virtual keyboard; and Including a step of displaying the text input window according to the selection of the above notification. Recording medium.

Images