Display device and control method thereof

Abstract

A display device includes: a display; a memory storing at least one instruction; a communicator configured to communicate with a mobile device via at least one wireless network including a Bluetooth Low Energy (BLE) communication network; and a controller. The controller includes at least one processor configured to execute at least one instruction stored in the memory to: identify the type of operating system of a mobile device registered in the display device when the display device operates in a normal mode by executing an environmental service that provides a screen image on the display; obtain BLE identification information for identifying a mobile device connected via a BLE communication network by selecting one of a first process and a second process for receiving BLE identification information based on the type of the operating system of the mobile device and executing the selected process; and execute one of a normal mode and a sleep mode based on the obtained BLE identification information.

Description

[0001] This application is a divisional application of an application with an application date of March 7, 2019, application number 201980017216.X and invention name “Display device and control method thereof”. Technical Field

[0002] The present disclosure relates to a display device configured to communicate with a mobile device via a wireless communication network and a control method thereof.

[0003] In detail, the present disclosure relates to a control method of a display device configured to communicate with a mobile device connected via a Bluetooth Low Energy (BLE) communication network and the display device. Background Art

[0004] As mobile devices become more widely used, technologies are being developed that enable mobile devices and electronic devices to connect to each other via a wireless communication network and allow multiple connected electronic devices to be used while interoperating with each other. Mobile devices may include portable user electronic devices.

[0005] Also, technology is being developed to control a plurality of non-portable electronic devices by using a home Internet of Things (IoT) platform or the like, and to use and / or control the plurality of non-portable electronic devices by connecting them with a mobile device.

[0006] The wireless communication network may include a communication network satisfying the Bluetooth communication standard for wireless communication using low power, for example, a BLE communication network. Summary of the invention

[0007]

Technical issues

[0008] As described above, there is a need for a control method of a display device capable of providing an environmental service and a display device executing the control method.

[0009]

Technical solution

[0010] According to an embodiment of the present disclosure, a control method of a display device capable of providing an environmental service while reducing power consumption of the display device and the display device are provided.

[0011] According to one aspect of the present disclosure, a display device includes: a display; a memory storing at least one instruction; a communicator configured to communicate with a mobile device via at least one wireless network including a Bluetooth Low Energy (BLE) communication network; and a controller including at least one processor configured to execute at least one instruction stored in the memory. It is characterized in that: the at least one processor is also configured to execute at least one instruction to: when the display device operates in normal mode by executing an environmental service that provides a screen image on the display, identify the type of operating system of the mobile device registered in the display device; obtain BLE identification information for identifying the mobile device connected via the BLE communication network by selecting one of the first and second processes for receiving BLE identification information based on the type of the operating system of the mobile device and executing the selected process; and execute one of the normal mode and the sleep mode based on the obtained BLE identification information.

[0012] According to another aspect of the present disclosure, a control method for a display device is provided. The display device includes: a memory storing at least one instruction, a communicator configured to communicate with a mobile device through at least one wireless network including a Bluetooth low energy BLE communication network, and a controller, the controller including at least one processor, the at least one processor configured to execute at least one instruction stored in the memory. The control method is characterized in that: when the display device operates in normal mode by executing an environmental service that provides a screen image on a display, the type of operating system of the mobile device registered in the display device is identified; by selecting one of a first process and a second process for receiving BLE identification information based on the type of the operating system of the mobile device and executing the selected process, BLE identification information for identifying a mobile device connected via a BLE communication network is obtained; and one of a normal mode and a sleep mode is executed based on the obtained BLE identification information.

[0013]

Beneficial Effects

[0014] According to an embodiment of the present disclosure, a control method of a display device capable of providing an environmental service while reducing power consumption of the display device and the display device are provided. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] The above and other aspects, features and advantages of certain embodiments of the present disclosure will become more apparent from the following description in conjunction with the accompanying drawings, in which:

[0016] Figure 1 shows a plurality of electronic devices that can be connected via a BLE communication network in a house;

[0017] Figure 2a A display device providing an ambient service for displaying a screen image is shown;

[0018] Figure 2b A display device providing an ambient service for displaying a screen image is shown;

[0019] Figure 3 A display device connected via a BLE wireless network is shown;

[0020] Figure 4 A display device and a mobile device connected via a BLE wireless network according to an embodiment are shown;

[0021] Figure 5 is a block diagram showing a display device according to an embodiment;

[0022] Figure 6 is a block diagram showing a display device according to an embodiment;

[0023] Figure 7a illustrates a user interface (UI) screen output from a portable device connected to a display device via a BLE network according to an embodiment;

[0024] Figure 7b is a diagram for describing an operation performed by a display device according to an embodiment;

[0025] Figure 8 is a diagram for describing a pairing operation performed by a display device according to an embodiment;

[0026] Fig. 9 is a diagram for describing an operation performed by a display device according to an embodiment;

[0027] Fig.10 is a diagram for describing an operation performed by a display device according to an embodiment;

[0028] Fig.11a , Fig.11b , Fig.11c and Fig.11d illustrates the operation of an ambient service performed in a display device paired with a mobile device according to an embodiment;

[0029] Fig.12a shows a BLE signal transmitted and received by a mobile device according to an embodiment;

[0030] Figure 12b is a diagram for describing an operation of an ambient service performed in a display device paired with a mobile device according to an embodiment;

[0031] Fig.12c is a diagram for describing an operation of an ambient service performed in a display device paired with a mobile device according to an embodiment;

[0032] Fig.13 is a flowchart illustrating a control method of a display device according to an embodiment; and

[0033] Fig.14 is a flowchart illustrating in detail a control method of a display device according to an embodiment.

[0034] Specific implementation method

[0035] This application is based on and claims the benefit of priority from Korean Patent Application No. 10-2018-0028309 filed on March 9, 2018, in the Korean Intellectual Property Office, and No. 10-2018-0058643 filed on May 23, 2018, in the Korean Intellectual Property Office, the entire contents of which are incorporated herein by reference.

[0036] According to one aspect of the present disclosure, a display device includes: a display; a memory storing at least one instruction; a communicator configured to communicate with a mobile device via at least one wireless network including a BLE communication network; and a controller including at least one processor configured to execute at least one instruction stored in the memory. The processor may be configured to: during a normal mode in which an environmental service is being executed, when BLE identification information for identifying a mobile device connected via a BLE communication network is received from a mobile device, execute at least one instruction to manage the BLE identification information, and the communicator may also be configured to determine whether to wake up the controller based on the BLE identification information received from the mobile device after a sleep mode starts, based on whether information corresponding to the BLE identification information is stored in the communicator.

[0037] The communicator may include an internal memory configured to store data, and may be further configured to wake up the controller when information corresponding to the BLE identification information exists in the internal memory.

[0038] When the information corresponding to the BLE identification information does not exist in the internal memory, the communicator may be further configured to maintain the sleep mode.

[0039] The processor may also be configured to execute at least one instruction in the normal mode to receive BLE identification information from the communicator, determine whether information corresponding to the BLE identification information exists in the memory, and determine the result to decide whether to maintain execution of the environmental service.

[0040] The memory may include a first memory and a second memory, and the processor may be further configured to execute the at least one instruction to control the storage of the BLE identification information in the first memory and the internal memory of the communicator based on the BLE identification information received from the mobile device in the normal mode, and when the normal mode is started, load a program corresponding to the first application for executing the environmental service into the second memory, and control the first application to be executed.

[0041] The processor may be further configured to execute the at least one instruction to receive first BLE identification information from a first mobile device to be paired with the display device to register the first mobile device, and to store the first BLE identification information in the memory, and to manage storage and updating of the BLE identification information to allow the first BLE identification information to be stored in the memory and the internal memory of the communicator.

[0042] The normal mode may include an operation mode in which the environmental service is performed, and the sleep mode may include an operation mode in which the environmental service is stopped and then the display is turned off.

[0043] The processor can be further configured to execute the at least one instruction to control first BLE identification information to be stored in the memory, wherein the first BLE identification information is sent from a first mobile device paired with the display device for executing the environmental service; and determine whether the first mobile device is within a predetermined distance from the display device through the first BLE identification information.

[0044] The processor may be further configured to execute at least one instruction to differently set a scheme for identifying the mobile device according to whether an operating system (OS) of the mobile device registered in the display device is the first OS or the second OS.

[0045] The first OS may be Android OS, and the second OS may be iOS.

[0046] When the mobile device is registered in the display device and the OS of the mobile device is the first OS, the processor may be further configured to execute at least one instruction to control the communicator to check reception of the BLE identification information at a specific time interval.

[0047] When the mobile device is registered in the display device and the OS of the mobile device is the second OS, the processor may be further configured to execute at least one instruction to control the communicator to send a first iBeacon at a specific time interval, a signal for requesting to send BLE identification information to the mobile device, and to check reception of a second iBeacon signal triggered by the first iBeacon signal and including the BLE identification information.

[0048] The BLE identification information may include a BLE Media Access Control (MAC) address of the mobile device or a random address of the mobile device that is convertible to a BLE MAC address by using an Identity Resolution Key (IRK).

[0049] According to one embodiment, a control method for a display device is provided, the display device comprising: a memory storing at least one instruction; a communicator configured to communicate with a mobile device via at least one wireless network including a Bluetooth Low Energy (BLE) communication network; and a controller comprising at least one processor configured to execute at least one instruction stored in the memory, the control method comprising: during a normal mode in which an environmental service is being executed, when BLE identification information for identifying a mobile device connected via a BLE communication network is received from a mobile device, managing the BLE identification information by the controller; and after starting a sleep mode, the communicator determining whether to wake up the controller based on the BLE identification information received from the mobile device and based on whether information corresponding to the BLE identification information is stored in the communicator.

[0050] [Invention method]

[0051] For those of ordinary skill in the art, the disclosure described below with reference to the accompanying drawings can be performed without difficulty. However, the disclosure can be implemented in many different forms and should not be construed as being limited to the embodiments set forth herein. In addition, in order to clearly describe the present invention, parts that are not related to the description of the present invention will be omitted in the accompanying drawings, and the same reference numerals will represent the same elements throughout the specification.

[0052] Throughout the specification, it will also be understood that when an element is referred to as being “connected to” or “coupled with” another element, it may be directly connected to or coupled with another element, or may be electrically connected to or coupled with another element by interposing an intermediate element therebetween. In addition, when a component “includes” or “comprises” an element, unless there is a specific description to the contrary, the component may further include other elements without excluding other elements.

[0053] Throughout the specification, the expression "in some embodiments" or "in an embodiment" is described, but the expression does not necessarily refer to the same embodiment.

[0054] Some embodiments can be described according to function block components and various processing steps. Some or all function blocks can be implemented by any number of hardware and / or software components configured to perform specified functions. For example, the function blocks of the present disclosure can be implemented by one or more processors or microprocessors, or can be implemented by circuit components for predetermined functions. For example, the function blocks of the present disclosure can be implemented with any programming or various scripting languages. The function blocks of the present disclosure can be implemented with algorithms executed on one or more processors. In addition, the present disclosure can adopt any number of technologies for electronic configuration, signal processing and / or data processing, etc. according to the prior art. The terms "module", "configuration", etc. can be used extensively and are not limited to mechanical or physical embodiments.

[0055] The connecting lines or connectors between the elements shown in the drawings are intended to represent exemplary functional connections and / or physical or logical connections between the elements. It should be noted that many alternative or additional functional connections, physical connections or logical connections may exist in actual devices.

[0056] Throughout the disclosure, the expression "at least one of a, b, or c" means only a; b; c; a and b; a and c; b and c; all or variations of a, b, and c.

[0057] An electronic device connected to a mobile device by using BLE can be controlled based on a BLE signal transmitted from the mobile device. The electronic device may be a fixed device such as a display device that is maintained at the same location in a house.

[0058] According to the related art, BLE is designed as a technology in which a fixed device transmits a BLE signal, and a mobile device periodically senses the BLE signal and determines its location. The mobile device can determine whether the fixed device is within a certain distance based on the BLE signal sent from the fixed device. As a result of the determination, the mobile device can control the screen of the fixed device to be turned on or off.

[0059] As another example, the mobile device may transmit a BLE signal and the fixed device may sense the BLE signal.

[0060] As described above, a method and apparatus for controlling the operation of a fixed device via BLE communication between the fixed device and the mobile device is being developed. In addition, a method and apparatus for controlling the operation of a fixed device to meet various needs of a user using the fixed device or the mobile device (e.g., a specific service must be provided, etc.) is being developed.

[0061] Therefore, there is a need for a method and apparatus for conveniently controlling the operation of a fixed device with minimum power consumption. In addition, there is a need for a method and apparatus for flexibly performing a control operation according to a provision direction of a service desired by a user.

[0062] In addition, a method and apparatus for controlling the operation of a fixed device to meet various demands (for example, a specific service must be provided, etc.) of a user who uses the fixed device or a mobile device are being developed.

[0063] Therefore, there is a need for a method and apparatus for conveniently controlling the operation of a fixed device with minimum power consumption. In addition, there is a need for a method and apparatus for flexibly performing a control operation according to a provision direction of a service desired by a user.

[0064] Figure 1 Shown are multiple electronic devices that can be connected via a BLE communication network in a house.

[0065] The electronic device according to the embodiment may include any electronic device that can be connected to another electronic device via a wireless communication network. The electronic device according to the embodiment may include a display device that can be connected to a mobile device via a BLE communication network.

[0066] The electronic device according to the embodiment may include a device that can exchange data with at least one adjacent electronic device, can be paired with at least one adjacent electronic device through a wireless communication network, can remotely control at least one adjacent electronic device, or can be remotely controlled by at least one adjacent electronic device. The wireless communication network may include a BLE communication network.

[0067] The electronic device according to the embodiment may include any electronic device that can be connected to a portable electronic device such as a mobile device via a BLE communication network. The electronic device may be an electronic device capable of receiving or scanning a BLE signal 165. An electronic device configured to send a BLE signal 165 may be an electronic device capable of continuously scanning a BLE signal 165 at periodic time intervals or at a set time.

[0068] The electronic device according to the embodiment is a display device 160 attached to a wall in a house 100 .

[0069] The display device according to the embodiment may be a device configured to visually output content, advertisement, guide information or UI screen to a user, and may variously include a television (TV), a terminal for digital broadcasting, etc. Moreover, the display device may be included in an electronic device such as a refrigerator (for example, the display device may be a display inserted into the front of the refrigerator, etc.). In addition, the display device may be fixed in a certain space.

[0070] Reference Figure 1, shows a plan view of a house 100. The space in the house 100 may be divided into bedrooms 120 and 130, a kitchen 140, and a living room 110. A display device 160 may be placed in the living room 110. The display device 160 may be a curved display device attached to a wall.

[0071] Any member of the household of the house 100 may be a user of the display device 160. The user may have a first portable device 152. The first portable device 152 and the display device 160 may be connected via a wireless communication network. The first portable device 152 may include a wearable device, a smart phone, a tablet personal computer (PC), a personal digital assistant (PDA), a laptop computer, a media player, a micro server, a global positioning system (GPS) device, etc.

[0072] The first portable device 152 and the display device 160 may be connected by using a home IoT platform. The display device 160 and the first portable device 152 may be connected to each other via a wireless communication network.

[0073] In one embodiment, the display device 160 can operate under the control of the first portable device 152, and can sense the location of the first portable device 152, and can automatically perform a specific service such as an environmental service or a specific operation. In the present disclosure, the term "environmental service" refers to a context-aware service related to the surrounding environment of a user or device.

[0074] When the first portable device 152 transmits a BLE signal and the display device 160 is located within a predetermined distance from the first portable device 152, the display device 160 may sense the BLE signal. That is, the display device 160 may sense the BLE signal only when the BLE signal is transmitted within a certain distance. For example, the BLE signal sensing range may be more or less than 10 meters. Therefore, when the second portable device 151 transmits a BLE signal at a location outside the house 100, the display device 160 may not sense the BLE signal.

[0075] By sensing the range using the BLE signal, the display device 160 may be turned on or off based on the BLE signal transmitted from the first portable device 152. That is, the display device 160 may sense that a user is approaching the display device 160 by using the user's portable device, and may be turned on or off in response to the sensing result.

[0076] Ambient service is a new application or new service for a display device (such as a TV). When the TV is turned off to the user, the ambient service is a service for providing a meaningful screen image instead of a black screen.

[0077] Figure 2a and Figure 2bA display device providing an ambient service for displaying a screen image is shown.

[0078] Normally, when the TV is turned off, the TV screen becomes black and does not display any image. The ambient service is a service for displaying a meaningful screen image (e.g., famous paintings, photos, clocks, etc.) on the display instead of a black screen when the TV is turned off. Also, when the user is not watching a specific content broadcasted from a broadcasting station, the ambient service allows a meaningful screen image (e.g., famous paintings, photos, clocks, etc.) to be displayed on the display.

[0079] Reference Figure 2a , the display device 210 may display a screen image 220 including at least one photo on the display of the display device 210. Because the display device 210 displays at least one photo, the user may recognize the display device 210 as a photo frame. Figure 2a In the illustrated embodiment, the display device 210 may be used as an electronic picture frame.

[0080] Reference Figure 2b , the display device 210 may display a screen image 260 including a clock on the display of the display device 210 .

[0081] When the display device 210 is performing the ambient service, the user may view famous paintings, photos, etc. on the display device 210. As another example, the user may know the time based on the clock of the screen image 260 displayed by the display device 210.

[0082] When the user is not viewing content, the environmental service displays the screen image according to the user's intention, thereby increasing the user's convenience. However, when the environmental service is executed, the display of the display device 210 remains in its turned-on state, so the service life of the panel of the display is reduced and power consumption is continuously generated.

[0083] Therefore, there is a need to reduce power consumption while providing environmental services that meet user expectations.

[0084] Therefore, in order to prevent the reduction of power consumption in the display device 210 and the service life of the display panel, the display can be turned off when the user is neither in the house 100 nor in front of the TV. In one embodiment, the BLE signal sent from the mobile device can be used to control the screen on which the environmental service is executed or to turn the display on or off.

[0085] Reference Figure 3 and Figure 4 , describes the operation of a display device performed based on a BLE signal.

[0086] Figure 3A display device 310 connected via a BLE wireless network is shown. The display device 310 may correspond to any one of the display devices 160 and 210.

[0087] Reference Figure 3 , the display device 310 according to the embodiment can sense the BLE signal sent from the mobile device 360. The display device 310 can scan the BLE signal constantly or periodically. As another example, the display device 310 can send a BLE signal to the mobile device 360, and in response thereto, when the mobile device 360 ​​sends a BLE signal to the display device 310, the display device 310 can scan the BLE signal sent from the mobile device 360. The BLE signal can be generated in one of various forms including a BLE packet, an iBeacon signal, and the like. Therefore, when the display device 310 receives a BLE signal, the BLE signal that the display device 310 can receive is any one of various forms including a BLE packet, an iBeacon signal, and the like.

[0088] That is, the mobile device 360 ​​can be used as a transmitting terminal for transmitting a BLE signal, and the display device 310 can be used as a receiving terminal for receiving a BLE signal. That is, the display device 310 can be a device that receives a BLE signal and is controlled in response to the received BLE signal (e.g., controlled to turn on or off the display of the display device 310).

[0089] The operation of receiving the BLE signal may include a case where the BLE signal is sensed by scanning the BLE signal at certain time intervals or by continuously scanning the BLE signal. The operation of receiving the BLE signal may include a case where a BLE signal is requested to be transmitted, and in response to the request, a BLE signal is received.

[0090] The BLE signal may be a signal generated according to a BLE communication protocol, and may include a BLE packet.

[0091] The transmitting terminal may include any one of the mobile device 360 ​​and other portable electronic devices (e.g., smart watches, tablet PCs, etc.). The receiving terminal may include not only the display device 310, but also any electronic device capable of performing a BLE scanning operation (e.g., speakers, refrigerators, etc.). The transmitting terminal may continuously transmit a BLE signal (e.g., a BLE packet), or transmit it in response to a periodic request, and the receiving terminal may perform a BLE scanning operation at a set time or at periodic time intervals, or may request a BLE signal (e.g., a BLE packet) from the mobile device 360, which is the transmitting terminal.

[0092] The mobile device 360 ​​as a transmitting terminal may include a Bluetooth communication module capable of transmitting a BLE signal, and may include an application in which the setting of a BLE advertisement is available. A BLE advertisement may refer to the transmission of a BLE signal according to a BLE communication protocol, or may refer to a transmitted BLE signal. According to the setting of the BLE advertisement, the BLE signal may be sent as a packet (e.g., a BLE advertisement packet, a BLE notification packet, etc.).

[0093] The display device 310 as a receiving terminal may include a Bluetooth communication module capable of receiving a BLE signal, and may include an application that can utilize on / off control for a display based on the received BLE signal.

[0094] exist Figure 3 In the example shown, d1 refers to the reception range of the BLE signal, and d2 is a value greater than d1 and exceeding the reception range of the BLE signal.

[0095] Reference Figure 3 , when the mobile device 360 ​​is located at position P1, the distance between the mobile device 360 ​​and the display device 310 is d1, which corresponds to the receivable range of the BLE signal. Therefore, when the mobile device 360 ​​sends a BLE signal, the display device 310 can receive the BLE signal sent from the mobile device 360 ​​by scanning the BLE signal. When the BLE signal is received, the display device 310 can continuously execute the environmental service or can start the environmental service, and can display a screen image corresponding to the environmental service on the display (e.g., a clock screen image, etc.).

[0096] refer to Figure 3 , when the mobile device 360 ​​is located at position P2, the distance between the mobile device 360 ​​and the display device 310 is d2, which exceeds the receivable range of the BLE signal. Therefore, when the mobile device 360 ​​sends a BLE signal, the display device 310 cannot receive the BLE signal sent from the mobile device 360 ​​by scanning the BLE signal. Therefore, the display device 310 ends the execution of the environmental service or does not start the environmental service.

[0097] Figure 4 A display device and a mobile device connected via a BLE wireless network according to an embodiment are shown.

[0098] Reference Figure 4 , the display device 310 according to the embodiment includes a controller 311 , a communicator 313 , a memory 315 , and a display 317 .

[0099] The mobile device 360 ​​connectable to the display device 310 via the BLE communication network 405 includes a controller 361 , a communicator 363 , and a memory 365 .

[0100] First, the configuration and operation of the mobile device 360 ​​are described in detail below.

[0101] The controller 361 may include at least one processor. The at least one processor may execute at least one instruction stored in the memory 365 to perform a specific operation.

[0102] In one embodiment, the controller 361 may control the BLE signal to be transmitted. The controller 361 may control the BLE signal to be transmitted in different ways according to the OS of the mobile device 360.

[0103] The communicator 363 may include at least one communication module configured to perform wireless communication with an external electronic device (e.g., display device 310, etc.) according to a predetermined wireless communication protocol. The communicator 363 may include a Bluetooth communication module configured to perform wireless communication according to a BLE communication protocol. The Bluetooth communication module may include a BLE module and may send or receive a BLE signal.

[0104] The communicator 363 may include not only a Bluetooth communication module but also a communication module configured to perform wireless communication according to a communication protocol including a wireless local area network (LAN), wired Ethernet, etc. The wireless LAN communication module may include a WiFi communication module configured to perform wireless communication according to a WiFi communication protocol.

[0105] The communicator 363 may transmit a BLE signal under the control of the controller 361 .

[0106] The memory 365 may store at least one instruction to be executed by the controller 361 and other data.

[0107] In one embodiment, the mobile device 360 ​​may transmit the BLE signal based on a request of the display device 310. As another example, the mobile device 360 ​​may transmit the BLE signal at regular time intervals.

[0108] The configuration and operation of the display device 310 according to the embodiment are described in detail below.

[0109] The display 317 displays an image under the control of the controller 311. The image may include all data visually recognizable to the user. The image may include a moving picture such as broadcast content, a screen image of a game, a photo, a clock, etc. The screen image corresponding to the environment service may include a famous painting image, a photo, a clock image, a landscape image, etc.

[0110] The memory 315 stores at least one instruction.

[0111] The controller 311 includes at least one processor to execute at least one instruction stored in the memory 315. The at least one processor included in the controller 311 may execute at least one instruction stored in the memory 315 to perform a specific operation.

[0112] The communicator 313 may communicate with the mobile device 360 ​​via at least one wireless network including the BLE communication network 405. The communicator 313 may receive a BLE signal via the BLE communication network 405. An operation of receiving or scanning a BLE signal transmitted from the mobile device 360 ​​is described in detail with reference to 11a to 12b.

[0113] In an embodiment, the BLE signal may include BLE identification information for identifying the mobile device 360. Hereinafter, it is assumed that the BLE identification information is included in the BLE signal transmitted from the mobile device 360.

[0114] In one embodiment, the operation of the display device 310 may include a normal mode and a sleep mode.

[0115] The normal mode indicates an operation state in which power is supplied to all elements of the display device 310. Therefore, in the normal mode, the display device 310 displays a specific image. The environmental service may be executed in the normal mode, and when it is not the normal mode, the execution of the environmental service may be stopped.

[0116] The sleep mode is a mode in which the power of the display device 310 is saved, and indicates an operation state in which power is supplied to the communicator 313 to exchange control signals or specific data with an external electronic device (e.g., the mobile device 360, a remote controller, etc.). In the sleep mode, power supply to elements other than the communicator 313 may be blocked. The sleep mode may be referred to as a standby mode or a power saving mode.

[0117] The term "wake up" may indicate that the display device 310 in the sleep mode is activated to start the operation of the normal mode. When the display device 310 is in the sleep mode, since only the communicator 313 is powered, the power supply to the controller 311 is blocked, so that the controller 311 does not operate, and only the communicator 313 operates. In this case, the communicator 313 may transmit a signal for waking up the controller 311 to the controller 311 in response to the scanned or received BLE signal.

[0118] When BLE identification information for identifying the mobile device 360 ​​connected via the BLE communication network 405 is received from the mobile device 360 ​​in the normal mode of executing the environment service, the processor included in the controller 311 manages the BLE identification information. The term "management" may include an operation of receiving the BLE identification information by the controller 311 and all operations performed by the controller 311 according to whether information corresponding to the BLE identification information exists in the memory 315.

[0119] When the BLE identification information is received from the mobile device 360 ​​after the sleep mode starts, the communicator 313 may wake up the processor included in the controller 311 according to a determination result of whether there is information corresponding to the BLE identification information.

[0120] The BLE identification information may be information for identifying the mobile device 360 ​​connected via the BLE communication network 405. That is, the BLE identification information may be information for identifying the mobile device 360 ​​that has transmitted the BLE signal. The BLE identification information may include a BLE address (eg, a BLE MAC address).

[0121] The BLE identification information may include a random address for decrypting the BLE address by using a predetermined decryption key. For example, when the BLE identification information includes the random address of the mobile device 360, the display device 310 may convert the received random address value into the BLE address that is the original address and has been sent from the mobile device 360 ​​in the BLE pairing by using the IRK obtained in the BLE pairing.

[0122] In addition to or alternatively to the BLE MAC address, the BLE identification information may include information for identifying an external electronic device connected via the BLE communication network 405 .

[0123] Reference Figure 7b In method 700, according to whether the display device 310 according to the embodiment is in a normal mode or a sleep mode (operation S720), at least one of the controller 311 or the communicator 313 becomes an operation subject for managing BLE identification information (operation S730 or S740).

[0124] When the display device 310 is in a normal mode in which the environment service is executed, the controller 311 may become an operating subject for managing BLE identification information (operation S730). When BLE identification information for identifying the mobile device 360 ​​connected via the BLE communication network 405 is received from the mobile device 360 ​​in the normal mode in which the environment service is executed, the processor included in the controller 311 manages the BLE identification information.

[0125] When the display device 310 is in sleep mode, the communicator 313 can become the operating subject of managing the BLE identification information (operation S740). When the BLE identification information is received from the mobile device 360 ​​after the sleep mode starts, the communicator 313 can wake up the processor included in the controller 311 according to the determination result of whether there is information corresponding to the BLE identification information.

[0126] After the sleep mode starts, the communicator 313 may obtain the BLE identification information included in the BLE signal transmitted from the mobile device 360. After the sleep mode starts, the communicator 313 does not transmit the obtained BLE identification information to the controller 311, but autonomously manages the BLE identification information, thereby reducing power consumption. The communicator 313 may wake up the processor based on the result of determining whether the information corresponding to the obtained BLE identification information is included in the memory in the communicator 313.

[0127] The communicator 313 may include an internal memory for storing specific data. The internal memory may store BLE identification information of an external electronic device (e.g., mobile device 360) paired with the display device 310. The external electronic device paired with the display device 310 may be an electronic device registered in the display device 310. In a pairing or registration operation, the display device 310 may obtain BLE identification information of an external electronic device, and may store the BLE identification information in the internal memory of the communicator 313 and the memory 315.

[0128] Therefore, when information corresponding to the received BLE identification information exists in the internal memory of the communicator 313, the communicator 313 may send a wake-up signal to the controller 311 to wake up the processor included in the controller 311. When information corresponding to the received BLE identification information does not exist in the internal memory of the communicator 313, the communicator 313 may cause the processor included in the controller 311 not to wake up, so that the sleep mode may be maintained.

[0129] For example, assuming that the first mobile device has first BLE identification information and the second mobile device has second BLE identification information, the first mobile device is a device registered in the display device 310 by performing a pairing operation, and the second mobile device is a device not registered in the display device 310.

[0130] In this case, when the display device 310 performs a pairing operation with respect to the first mobile device, the display device 310 stores the first BLE identification information in the internal memory of the communicator 313 and the memory 315 to which the controller 311 refers. After performing the pairing operation, when the communicator 313 senses or receives the first BLE identification information, the communicator 313 determines whether information corresponding to the sensed or received first BLE identification information is stored in the internal memory of the communicator 313, thereby determining whether the first mobile device that has transmitted the first BLE identification information is a device registered in the display device 310. In the aforementioned example, since information corresponding to the sensed or received first BLE identification information (i.e., information equal to the sensed or received first BLE identification information) is stored in the internal memory of the communicator 313, the communicator 313 may transmit a wake-up signal to the processor included in the controller 311 to wake up the controller 311. Moreover, when the controller 311 wakes up, the controller 311 may recognize that the user exists around the display device 310, thereby controlling the environmental service to be performed.

[0131] After performing the pairing operation, when the communicator 313 senses or receives the second BLE identification information, the communicator 313 determines whether the information corresponding to the sensed or received second BLE identification information is stored in the internal memory of the communicator 313, thereby determining whether the second mobile device that has sent the second BLE identification information is a device registered in the display device 310. In the aforementioned example, the information corresponding to the sensed or received second BLE identification information (i.e., information equal to the sensed or received first BLE identification information) is not stored in the internal memory of the communicator 313. Therefore, the communicator 313 can determine that the second mobile device is not a device registered in the display device 310, thereby operating not to wake up the controller 311 and operating to maintain the sleep mode. That is, the sensed or received second BLE identification information can be ignored, and the sleep mode can be maintained.

[0132] As described above, the display device 310 according to the embodiment allows the communicator 313 to be the main body for managing the BLE identification information before the display device 310 wakes up, so that the display device 310 can be prevented from waking up unnecessarily. Therefore, when the BLE identification information is received or sensed, the power consumed for determining whether the external electronic device that has sent the BLE identification information is a registered device and performing subsequent operations (e.g., performing a wake-up operation, maintaining a sleep mode, etc.) can be minimized.

[0133] Figure 5 5 is a block diagram showing a display device 500 according to an embodiment. The display device 500 may correspond to any one of the display devices 160, 210, and 310.

[0134] Reference Figure 5 , the display device 500 includes a controller 311, a communicator 313, a memory 315, a display 317, and a UI 550. The display device 500 can communicate via a BLE communication network (e.g., Figure 4 BLE communication network 405) communicates with the mobile device 360.

[0135] The display 317 displays an image under the control of the controller 311. The display 317 may display a screen image corresponding to the environmental service when the environmental service is executed. The screen image corresponding to the environmental service may include a famous painting image, a photo, a clock image, a landscape image, and the like.

[0136] When the display 317 is turned off, the screen of the display 317 may become black. In addition, when the display 317 is turned on, that is, when the display device 500 is in the normal mode, the display 317 may display a screen image corresponding to specific content. As another example, when an environmental service is executed after the display 317 is turned on, the display 317 may display a screen image corresponding to the environmental service.

[0137] The memory 315 stores at least one instruction.

[0138] The controller 311 includes at least one processor configured to execute at least one instruction stored in the memory 315. The at least one processor included in the controller 311 may execute the at least one instruction stored in the memory 315 to perform a specific operation.

[0139] The controller 311 may include a memory and at least one processor, the memory storing at least one program to perform the above-mentioned operations and the operations to be described below, and the at least one processor executing the stored at least one program. The memory included in the controller 311 may correspond to the memory 315, and may store at least one instruction. As another example, the controller 311 does not include a memory, and only the memory 315 may be arranged to store at least one program.

[0140] The controller 311 may include a random access memory (RAM) that stores a signal or data input from an external source of the display device 500 or is used as a storage area corresponding to various tasks performed in the display device 500; a read-only memory (ROM) that stores a control program for controlling the display device 500; and at least one processor. The RAM may include all memories that can write and read information or modify written information, and may be referred to as a volatile memory. The ROM may include a memory that can only read written information but cannot modify the information, and may be referred to as a non-volatile memory. The RAM and ROM described as being included in the controller 311 may be included in the memory 315.

[0141] The memory 315 may include at least one storage medium of flash memory, a hard disk, a multimedia card type memory, a card type memory (such as a secure digital (SD) or xD-Picture (xD) card memory), RAM, static random access memory (SRAM), ROM, electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic storage, a magnetic disk, or an optical disk.

[0142] Reference Figure 4 The described internal configuration of the controller 361 of the mobile device 360 ​​may equally correspond to the aforementioned detailed configuration of the controller 311 .

[0143] The memory 365 of the mobile device 360 ​​may equally correspond to the aforementioned detailed configuration of the memory 315 .

[0144] The processor included in the controller 311 may include a graphics processing unit (GPU) for processing graphics corresponding to a video.

[0145] The processor included in the controller 311 may be implemented as a system on chip (SoC) in which a core processor and a GPU are integrated. The processor may include a single-core processor, a dual-core processor, a triple-core processor, a quad-core processor, or a multi-core processor.

[0146] The communicator 313 may communicate with the mobile device 360 ​​via at least one wireless network including the BLE communication network 405. The communicator 313 may receive a BLE signal via the BLE communication network 405.

[0147] The communicator 313 may include at least one communication module capable of performing wireless communication. The communication module included in the communicator 313 may include a Bluetooth module 511 and a wireless LAN module 512. The communicator 313 may include an internal memory 513.

[0148] The Bluetooth module 511 receives a Bluetooth signal transmitted from an external electronic device such as the display device 210 according to the Bluetooth communication standard. The Bluetooth module 511 may be a BLE module and may receive a BLE signal.

[0149] The Bluetooth module 511 may constantly or temporarily scan the BLE signal to detect whether the BLE signal is received.

[0150] The communicator 313 may include a wireless LAN module 512. The wireless LAN module 512 may receive a WiFi signal transmitted from the display device 210 according to the WiFi communication standard.

[0151] In addition to the Bluetooth module 511 and the wireless LAN module 512 shown, or alternatively, the communicator 313 may include at least one wireless communication module capable of transmitting and receiving different wireless signals.

[0152] Hereinafter, it is assumed that the communicator 313 is provided as a BLE module and receives a BLE signal.

[0153] In one embodiment, the communicator 313 may include an internal memory 513 internally. The internal memory 513 may store BLE identification information included in the BLE signal received via the Bluetooth module 511. The internal memory 513 may store a plurality of data items required for the communicator 313 to wirelessly communicate with an external electronic device (e.g., a mobile device 360). For example, when the display device 500 is connected to the mobile device 360 ​​via a Bluetooth communication network, the display device 500 may receive the Bluetooth MAC address of the mobile device 360 ​​and perform a pairing operation with the mobile device 360. Therefore, the internal memory 513 may store the Bluetooth MAC address received from the mobile device 360.

[0154] The display 317 outputs a video signal such as a screen image, through which a user can visually recognize specific information.

[0155] The UI 550 may receive user input for controlling the display device 500. The UI 550 may include, but is not limited to: a touch panel for sensing a user's touch; a button for receiving a user's press manipulation; a scroll wheel for receiving a user's scroll wheel manipulation; and a user input device including a keyboard, a dome switch, etc.

[0156] In one embodiment, when a UI screen for pairing and / or registering with the mobile device 360 ​​is output under the control of the controller 311, the user may input data and / or a command for registering the mobile device 360 ​​via the UI 550. The controller 311 may then perform a pairing operation and / or a registration operation on the mobile device 360 ​​based on the user input.

[0157] Figure 6 is a block diagram showing a display device 600 according to an embodiment.

[0158] The display device 600 according to the embodiment may equally correspond to the display devices 160 , 210 , 310 , and 500 , and may be a display device that receives a BLE signal as a wireless signal.

[0159] Reference Figure 6 , the display device 600 includes a video processor 610, a display 615, an audio processor 620, an audio output unit 625, a power supply unit 630, one or more tuners 640, a communicator 650, a sensor 660, an input / output (I / O) unit 670, a controller 680 and a memory 690.

[0160] The controller 680 may correspond to Figure 5 The controller 311 of the display device 500 is shown. Figure 5 The communicator 313, the Bluetooth module 511, the wireless LAN module 512, the display 317 and the memory 315 shown in FIG. 3 may correspond to Figure 6 The display device 600 is shown as a communicator 650, a Bluetooth module 652, a wireless LAN module 651, a display 615, and a memory 690. The video processor 610 may perform processing on video data received by the display device 600. The video processor 610 may perform various image processing on the video data, such as decoding, scaling, noise filtering, frame rate conversion, resolution conversion, etc.

[0161] The controller 680 may receive a recording request regarding video data processed by the video processor 610 , and may control the video data to be encrypted and recorded on a storage device such as a RAM included in the controller 680 or the memory 690 .

[0162] The display 615 may display a video included in a broadcast signal received via the tuner 640 on a screen under the control of the controller 680. The display 615 may display content (eg, video) input via the communicator 650 or the I / O unit 670.

[0163] The display 615 may output the image stored to the memory 690 under the control of the controller 680. The display 615 may display a voice UI (e.g., a guide including voice instructions) for performing a voice recognition task corresponding to voice recognition, or a motion UI (e.g., a guide including user motions for motion recognition) for performing a motion recognition task corresponding to motion recognition.

[0164] The audio processor 620 may perform processing on the audio data. The audio processor 620 may perform various processing on the audio data, such as decoding, amplification, noise filtering, etc. The audio processor 620 may include a plurality of audio processing modules to process audio corresponding to a plurality of contents.

[0165] The audio output unit 625 may output audio included in a broadcast signal received via the tuner 640 under the control of the controller 680. The audio output unit 625 may output audio (e.g., voice, sound, etc.) input via the communicator 650 or the I / O unit 670. The audio output unit 625 may output audio stored to the memory 690 under the control of the controller 680. The audio output unit 625 may include at least one of a speaker 626, a headphone output terminal 627, or a Sony / Philips digital interface (S / PDIF) 628. The audio output unit 625 may include a combination of the speaker 626, the headphone output terminal 627, and the S / PDIF 628.

[0166] In an embodiment, the speaker 626 may output a sonic signal. The speaker 626 may output an ultrasonic signal.

[0167] The power supply unit 630 supplies power from an external power source to internal elements of the display device 600 under the control of the controller 680. In addition, the power supply unit 630 may supply power from one or more power sources provided in the display device 600 to internal elements of the display device 600 under the control of the controller 680.

[0168] The tuner 640 may tune and select only the frequency of a channel to be received by the display device 600 among many radio wave components based on amplification, mixing, resonance, etc. of a broadcast signal received wirelessly or by wire. The broadcast signal may include audio, video, and additional information (e.g., an electronic program guide (EPG)).

[0169] The tuner 640 can receive a broadcast signal of a bandwidth corresponding to a channel number (e.g., cable broadcast number 506) based on a user input (e.g., a control signal such as an input of a channel number, an input of increase / decrease of a channel number, or a channel input on an EPG screen received from an external controller (e.g., a remote controller)).

[0170] The tuner 640 may receive broadcast signals from various sources, such as ground wave broadcasting, cable broadcasting, satellite broadcasting, Internet broadcasting, etc. The tuner 640 may receive broadcast signals from sources such as analog broadcasting or digital broadcasting. The broadcast signals received via the tuner 640 may be decoded (e.g., audio decoding, video decoding, or additional information decoding) and then separated into audio, video, and / or additional information. The separated audio, video, and / or additional information may be stored in the memory 690 under the control of the controller 680.

[0171] When the display device 600 includes the tuner 640 according to an embodiment, a plurality of broadcast signals may be output to a plurality of windows of a multi-window screen provided to the display 615 .

[0172] The tuner 640 may be implemented as one body by being included in the display device 600, or may be implemented as a separate device (eg, a set-top box) having a tuner and electrically connected to the display device 600. As another example, the tuner 640 may be implemented to be connected to the I / O unit 670.

[0173] The communicator 650 may connect the display device 600 to an external device (e.g., an audio device, etc.) under the control of the controller 680. The controller 680 may transmit / receive content to / from an external device connected to the display 600 through the communicator 650, may download an application from the external device, or may perform web browsing. The communicator 650 may access a network and may receive content from an external device.

[0174] As described above, the communicator 650 may include at least one of a short-range communication module, a wired communication module, or a mobile communication module.

[0175] Figure 6 An example is shown in which the communicator 650 includes communication modules such as a wireless LAN module 651 , a Bluetooth module 652 , and a wired Ethernet 653 .

[0176] The communicator 650 may include a combination of a wireless LAN 651, Bluetooth 652, and a wired Ethernet 653. The communicator 650 may receive a control signal for controlling a device under the control of the controller 680. The control signal may be implemented as a Bluetooth type control signal, a radio frequency (RF) signal type control signal, or a WiFi type control signal.

[0177] In one embodiment, Bluetooth 652 may send or receive BLE signals according to the BLE communication standard.

[0178] In addition to the Bluetooth 652, the communicator 650 may alternatively include another short-range communication module (eg, a near field communication (NFC) module), a BLE module, or the like.

[0179] The sensor 660 senses a user's voice, a user's image, or a user's interaction.

[0180] The microphone 661 may receive a voice issued by a user. The microphone 661 may convert the received voice into an electrical signal, and may output the electrical signal to the controller 680. The user's voice may include, for example, a voice corresponding to a menu or function of the display device 600. For example, the recognition range of the microphone 661 may be within 4 meters (m) from the microphone 661 to the user's position. The recognition range of the microphone 661 may vary according to the sound level of the user's voice and the surrounding environment (e.g., speaker sound, surrounding noise, etc.).

[0181] The microphone 661 may be integrated in the display device 600, or may be separated from the display device 600. The separate microphone 661 may be electrically connected to the display device 600 through the communicator 650 or the I / O unit 670.

[0182] In one embodiment, in addition to the user's voice, the microphone 661 can also receive sound wave signals. The microphone 661 can receive ultrasonic signals.

[0183] However, based on the function and structure of the display device 600 , the microphone 661 may be excluded from the display device 600 .

[0184] One or more cameras 662 may receive images (e.g., continuous frames) corresponding to the user's motion, which includes gestures within the camera recognition range. For example, the recognition range of camera 662 may be a distance between about 0.1 m and about 5 m from camera 662 to the user. The user's motion may include motions of the user's body parts such as face, facial expressions, hands, fists, fingers, etc. The camera 662 may convert the received image into an electrical signal under the control of the controller 680 and may output the electrical signal to the controller 680.

[0185] The controller 680 may select a menu displayed on the display device 600 based on the received result of the motion recognition, or may perform a control operation corresponding to the result of the motion recognition. For example, the control operation may include channel adjustment, volume adjustment, pointer movement, etc.

[0186] The camera 662 may include a lens and an image sensor. The camera 662 may support an optical zoom function or a digital zoom function by using multiple lenses and image processing. The recognition range of the camera 662 may be set differently according to the angle of the camera 662 and the surrounding environment conditions. When multiple cameras 662 are arranged, a three-dimensional (3D) still image or 3D motion may be received by using the multiple cameras 662.

[0187] The camera 662 may be integrated in the display device 600 or may be separated from the display device 600. A separate device including the camera 662 may be electrically connected to the display device 600 via the communicator 650 or the I / O unit 670.

[0188] However, based on the function and structure of the display device 600 , the camera 662 may be excluded from the display device 600 .

[0189] The optical receiver 663 may receive an optical signal (including a control signal) received from an external control device via an optical window of the frame of the display 615. The optical receiver 663 may receive an optical signal corresponding to a user input (e.g., a touch operation, a press operation, a touch gesture, a voice, or a motion) from the external control device. The control signal may be extracted from the received optical signal under the control of the controller 680.

[0190] For example, the light receiver 663 may receive a signal corresponding to the pointing position of the control device, and may send the signal to the controller 680. For example, in the case of a UI screen for receiving data or a command from a user inputted through the display 615, and when the user moves the control device while the user's finger contacts the touch pad arranged on the control device, the user attempts to input data or a command to the display device 600 using the control device, the light receiver 663 may receive a signal corresponding to the movement of the control device, and may send the signal to the controller 680. The light receiver 663 may receive a signal indicating that a specific button disposed on the control device has been pressed, and may send the signal to the controller 680. For example, when the user presses a button-type touch pad arranged on the control device by using a finger, the light receiver 663 may receive a signal indicating that the button-type touch pad has been pressed, and may send the signal to the controller 680. For example, the signal indicating that the button-type touch pad has been pressed may be used as a signal for selecting one of the items.

[0191] The I / O unit 670 may receive video (e.g., moving images, etc.), audio (e.g., voice, music, etc.), additional information (e.g., EPG, etc.), etc. from an external source of the display device 600 under the control of the controller 680. The I / O unit 670 may include one of a high-definition multimedia interface (HDMI) port 671, a component jack 672, a PC port 673, and a universal serial bus (USB) port 674. The I / O unit 670 may include a combination of the HDMI port 671, the component jack 672, the PC port 673, and the USB port 674.

[0192] The configuration and operation of the I / O unit 670 may be variously embodied according to embodiments of the present disclosure.

[0193] The controller 680 may control general operations of the display device 600 and signal flows between components included in the display device 600, and may process data. The controller 680 may execute the OS and various applications stored in the memory 690 when there is a user input or when a stored predetermined condition is satisfied.

[0194] The controller 680 may include a RAM configured to store a signal or data input from outside the display device 600 or used as a storage area corresponding to various operations performed in the display device 600, a ROM storing a control program for controlling the display device 600, and a processor.

[0195] The processor may include a GPU for processing graphics corresponding to the video. The processor may be implemented as a SoC in which a core processor and a GPU are integrated. The processor may include a single-core processor, a dual-core processor, a triple-core processor, a quad-core processor, or a multi-core processor.

[0196] The processor may include a plurality of processors. For example, the processor may be implemented as a main processor and a sub-processor operating in a sleep mode.

[0197] The graphics processor may generate a screen image including various objects, such as icons, images, texts, etc., by using a calculator and a renderer. The calculator may calculate the coordinate values ​​of each object to be displayed thereon and the attribute values ​​of the object, such as shape, size, color, etc., based on the layout of the screen by using the user interaction sensed via the sensor 660. The renderer may generate screen images including various layouts of the object based on the attribute values ​​calculated by the calculator. The screen image generated by the renderer may be displayed on the display area of ​​the display 615.

[0198] Figure 7a A UI screen output from a portable device (eg, mobile device 360 ​​) connected to the display device 500 via a BLE network according to an embodiment is illustrated.

[0199] In one embodiment, the environmental service can be performed in a program or application installed in the mobile device 360. The application for performing the environmental service can be distributed through an application store that can be connected and used by the mobile device 360. An application store refers to a server that distributes, sells or provides application programs, and users of portable devices with a specific OS (e.g., Android OS) can purchase applications in the application store. The user of the mobile device 360 ​​can access the application store and can download an application for performing the environmental service, which is provided through the application store. Therefore, the application for performing the environmental service can be installed in the controller 361 or the memory 365 of the mobile device 360.

[0200] The application for executing the environment service may be developed by a manufacturer of the display device 500 , a seller of the display device 500 , or a developer of an application that can be used in association with the display device 500 .

[0201] In one embodiment, the manufacturer of the display device 500 may develop an application and provide it to an application store, the application being used to execute and control the environment service executable in the display device 500. Hereinafter, for ease of description, the application for executing and controlling the environment service is referred to as an "environment application". Then, a user of the mobile device 360 ​​who attempts to control the environment service executable in the display device 500 by using the mobile device 360 ​​may access the application store and download the environment application by using the communicator 363 of the mobile device 360. In response to user input, the mobile device 360 ​​may download, store, and execute the environment application.

[0202] Reference Figure 3 The mobile device 360 ​​and the display device 310, the operation of the display device 310 performing the environmental service is described in detail below with reference to 7a to 12a.

[0203] Figure 7a An example of an execution window 750 of an environment application is shown. The execution window 750 may correspond to a UI screen for controlling an environment service.

[0204] Reference Figure 7a , the execution window 750 of the environment application may include a menu window 760 for setting whether to execute the environment service. The user can set whether to execute the environment service by manipulating the slide key 765 of the menu window 760. For example, the user can switch the slide key 765 to the left to allow the environment service to be automatically executed, or can switch the slide key 765 to the right to end the environment service. The user manipulating the menu window 760 may be one of the family members in the house 100 (see Figure 1), and may attempt to control an environmental service executable in a display device by using a user's mobile device 360.

[0205] The mode of automatically executing the ambient service is called "ambient automatic on mode", and the mode of not executing the ambient service is called "ambient automatic off mode". In the ambient automatic on mode, the mobile device 360 ​​can be set to send a BLE signal to use and / or execute the TV ambient service. In the ambient automatic off mode, the mobile device 360 ​​does not send a BLE signal, so the user does not use the TV ambient service.

[0206] In the ambient automatic on mode, the display device 500 may automatically maintain, stop, or resume execution of the ambient service according to whether a BLE signal is received or scanned.

[0207] The display device 500 according to an embodiment may perform registration or pairing on the mobile device 360 ​​before the display device 500 performs the ambient service.

[0208] In TV-mobile device linking linking a display device 500 such as a TV with the mobile device 360, when the display device 500 to which the mobile device 360 ​​attempts to link is searched and selected, an execution window 750 of a UI screen for selecting BLE environment on or off is activated.

[0209] The operation of searching, selecting, and / or registering the display device 500 may be referred to as a “pairing operation”.

[0210] The pairing operation may be performed by using one of the communication networks. For example, the pairing operation may be performed via a general Bluetooth communication network instead of a BLE communication network.

[0211] In one embodiment, it is assumed that the two devices linked to each other are registered in the same account (e.g., Samsung account). When the mobile device 360 ​​searches for a specific TV as a display device 500 in a specific application (e.g., Samsung Connect App) and performs an add device operation, the two devices are linked in the same account. After linking the devices to the same account, the user can select the corresponding device (i.e., TV) from a UI screen (e.g., an IoT dashboard showing a list of registered devices). The mobile device 360 ​​can then output a UI screen including a menu window 760 as an environment on / off menu as a sub-item.

[0212] Reference again Figure 7b, when the environment service is activated in the menu window 760, the mobile device 360 ​​and the display device 310 perform a BLE pairing operation (operation S710). The BLE pairing operation is an operation different from a pairing operation of searching, selecting and / or registering the display device 310, and indicates a pairing process between devices connectable via a BLE communication network.

[0213] After performing BLE pairing, even when the BLE address of the mobile device 360 ​​is randomly changed, the display device 310 may determine whether the connected device is the registered mobile device 360 ​​that is BLE paired.

[0214] Reference below Figure 8 The BLE pairing (operation S710) is described in detail.

[0215] BLE pairing may be divided into Phase 1 involving request (operations S821 and S822 ), Phase 2 involving key agreement (operation S823 ), and Phase 3 involving key distribution (operations S824 and S825 ).

[0216] In phase 1 of BLE pairing, a pairing request and its response are performed. The mobile device 360 ​​may send a signal requesting pairing to the display device 310 (operation S821), and the display device 310 may send a response allowing pairing to the mobile device 360 ​​in response to the request (operation S822).

[0217] In phase 2, a secure channel will be generated to maintain security. In detail, in phase 2, a short-term key (STK) is generated between the mobile device 360 ​​and the display device 310, and thus a secure channel to be used temporarily is generated (operation S840).

[0218] In phase 3, the keys used in BLE pairing are shared. The IRK may be exchanged for converting a random address into a BLE address, which is sent by the mobile device 360 ​​after performing the BLE pairing, and the BLE address is the original address that has been sent in the BLE pairing. When the keys that are the long-term key (LTK), IRK, and connection signature resolution key (CSRK) for BLE pairing are shared, the BLE pairing is complete. Multiple information such as the BLE address, keys (LTK, IRK, and CSRK) sent in the BLE pairing may be stored in the internal memory of the communicator 313 (see Figure 5 internal memory 513).

[0219] In detail, in stage 1, when the mobile device 360 ​​sends a signal requesting pairing to the display device 310 (operation S821), the mobile device 360 ​​may send a BLE address for identifying the device sending the BLE signal to the display device 310. The BLE address may include a unique value for identifying the mobile device 360 ​​to allow the display device 310 to identify the source of the BLE signal sent by the mobile device 360. The BLE address may be information for identifying the mobile device 360 ​​connected to the display device 310 via a BLE communication network. For example, the BLE address may include a BLE MAC address of the mobile device 360. Therefore, the BLE address may be interpreted as having the same meaning as the BLE identification information, and may therefore also be referred to as BLE identification information.

[0220] Reference Figure 8 The pairing operation described in the embodiment complies with the Bluetooth communication standard. In addition, in an embodiment, for safety reasons, the mobile device 360 ​​and the display device 310 may perform a pairing operation according to the Bluetooth communication standard. Figure 8 The pairing operation to be paired is described, but one of the pairing methods according to the related art may be used.

[0221] During the pairing operation between the two devices, the two devices share information with each other. The mobile device 360 ​​can send information about its own OS type (eg, Android, iOS, etc.) to the display device 310.

[0222] In one embodiment, the display device 310 as a receiving terminal stores the BLE address of the mobile device 360 ​​in a BLE pairing, and uses the BLE address to identify a packet (eg, a BLE packet) including a random BLE address as a random address to be transmitted later.

[0223] Fig. 9 is a diagram for describing an operation performed by the display device 310 according to an embodiment.

[0224] In one embodiment, according to whether the display device 310 is in the normal mode or the sleep mode, at least one of the controller 311 or the communicator 313 may become an operation subject that manages the BLE identification information.

[0225] refer to Fig. 9 , block 901 indicates the operation of the display device 310 in the normal mode of executing the environment service. Block 902 indicates the operation of the display device 310 after the sleep mode of the display device 310 starts.

[0226] In one embodiment, the display device 310 performs the operations of block 901 during a normal mode of executing environmental services, and after the sleep mode begins, the display device 310 performs the operations of block 902. Fig. 9In FIG. 1 , blocks 901 and 902 are distinguished and described to make the operation in the normal mode different from the operation in the sleep mode. Therefore, although Fig. 9 Block 901 is shown to be performed first, and then block 902 is performed, but block 902 may be performed first, and then block 901 may be performed.

[0227] In one embodiment, the display device 310 can maintain or stop the execution of the environment service according to whether the user is nearby. In order to determine whether there is a user around the display device 310, the display device 310 can determine whether there is a registered mobile device 360 ​​around the display device 310. In order to determine whether there is a registered mobile device 360 ​​around the display device 310, the display device 310 uses a BLE signal sent from the mobile device 360. That is, when the display device 310 senses the BLE signal sent from the mobile device 360, the display device can determine that the registered mobile device 360 ​​exists around the display device 310. When the display device 310 does not sense the BLE signal sent from the mobile device 360, the display device can determine that there is no registered mobile device 360 ​​around the display device 310. Therefore, the display device 310 recognizes that the user is not present nearby, and when the environment service has been executed, the display device 310 can end the environment service and can start the sleep mode. As another example, when the sleep mode has started, the display device 310 can maintain the sleep mode.

[0228] Referring to block 901 , the operation of the display device 310 in a normal mode in which an ambient service is executed is described below.

[0229] Reference Fig. 9 , the mobile device 360 ​​can send a BLE signal. To this end, because the BLE signal includes BLE identification information, the BLE identification information is information for identifying the mobile device 360 ​​that sent the BLE signal, therefore, Fig. 9 It is shown that the BLE identification information is transmitted (operation S911). In addition, since the BLE signal is a BLE packet, hereinafter, the BLE signal and the BLE packet may be used to represent the same meaning.

[0230] In this regard, the "transmission of a BLE signal" or "transmitted BLE signal" of the mobile device 360 ​​may be referred to as a "BLE advertisement." Fig. 9 The operation S911 shown may correspond to a BLE advertising operation. Figure 8After the described pairing operation, the mobile device 360 ​​transmits a BLE signal including a random BLE address. Then, the display device 310 can convert the received random BLE address into a BLE address by using the IRK received in the previous operation S824, and can recognize the BLE address transmitted in operation S821 that occurs in the initial BLE pairing.

[0231] When the mobile device 360 ​​sends a BLE advertisement including a random BLE address in a periodic manner (e.g., every 15 minutes), the display device 310 as a receiving terminal can convert and / or identify the random BLE address into a BLE address by using the IRK, then the BLE address has been sent in the initial BLE pairing.

[0232] Here, the mobile device 360 ​​may generate a random BLE address that changes randomly and is used for confidentiality according to the Bluetooth communication standard in a periodic manner (eg, every 15 minutes), and may send a BLE packet. The random BLE address may be referred to as a private address.

[0233] When the display device 310 as a receiving terminal receives a BLE packet including a random BLE address, by using the received random BLE address and the internal memory 513 (see FIG. 5 ) stored in the communicator 313, Figure 5 ) is internally calculated based on the IRK in the display device 310, and the display device 310 can convert the random BLE address into the BLE address of the mobile device 360, which has been received and stored in the initial BLE pairing.

[0234] Private address management and address identification using IRK can comply with Bluetooth communication standards. Moreover, the storage and management of BLE addresses received and registered in BLE / pairing can be implemented differently in systems / applications.

[0235] According to the implementation of the mobile device 360, the management of BLE advertisements can be performed in two schemes. The first scheme corresponds to a method of continuously sending BLE advertisements, which is performed by the mobile device 360, and the second scheme corresponds to a method of sending BLE advertisements in response to a request of the display device 310 as a receiving terminal.

[0236] In the second scheme, the display device 310 as a receiving terminal may request a BLE packet from the mobile device 360 ​​as a transmitting terminal. In order for the mobile device 360 ​​to check the request of the display device 310 as a receiving terminal, the mobile device 360 ​​must periodically perform a BLE scanning operation. The BLE scanning operation may indicate an operation performed by the mobile device 360 ​​for sensing whether a signal requesting a BLE packet is received from the display device 310.

[0237] As described above, in the transmission and reception of BLE signals, the mobile device 360 ​​must constantly or periodically perform BLE scanning operations and / or BLE advertising operations. BLE scanning operations and BLE advertising operations can be performed by using a solution that requires lower power consumption. For example, for a mobile device 360 ​​whose OS is confirmed as an Android solution, a BLE advertising operation can always be selected. In the following, for ease of description, a mobile device 360 ​​that complies with the Android solution is referred to as an Android terminal.

[0238] In detail, for an iPhone whose OS is confirmed as an iOS scheme, the BLE advertising operation can be selected only in response to a request from the display device 310 as a receiving terminal. For example, when at least one Android terminal is registered in the display device 310 as a receiving terminal, the display device 310 operates as long as the Android terminal always performs the advertising operation. In addition, when at least one iPhone is registered in the display device 310 as a receiving terminal, the display device 310 sends an iBeacon signal as a signal requesting a BLE advertisement, and waits for a response from the iPhone.

[0239] When an Android terminal and an iPhone are registered in the display device 310 at the same time, the above operations can be performed simultaneously. When the environment mode using the environment service is set to be activated in the mobile device 360, the operation of scanning the BLE advertisement of the Android terminal and the operation of sending the iBeacon signal to the iPhone can be performed, and the operation performed by the display device 310. When the number of registered Android terminals is 0, the BLE scanning operation is not performed, and when the number of registered iPhones is 0, the operation of sending the iBeacon signal is not performed.

[0240] When the mobile device 360 ​​performs a BLE advertising operation of sending a BLE packet (or BLE signal) including BLE identification information (operation S911), the display device 310 can receive a BLE packet (or BLE signal) including BLE identification information (operation S912). The communicator 313 of the display device 310 receives a BLE packet including BLE identification information (operation S912). Here, the BLE identification information includes information for identifying the mobile device 360 ​​connected via the BLE communication network. Therefore, when the BLE identification information is identified, it can be determined which mobile device is connected via the BLE communication network.

[0241] Reference Fig. 9In block 901, when BLE identification information is received from a mobile device in a normal mode of executing an environment service, the BLE identification information is used to identify a mobile device connected via a BLE communication network, and a processor included in the controller 311 manages the BLE identification information.

[0242] When the communicator 313 of the display device 310 receives the BLE identification information in the normal mode of executing the environment service (operation S912), the communicator 313 sends the received BLE identification information to the controller 311 so that the controller 311 manages the BLE identification information (operation S913). Then, the controller 311 manages the BLE identification information. In this regard, the management of the BLE identification information may include all operations for controlling a specific operation to be performed based on the BLE identification information.

[0243] The processor of the controller 311 can determine whether the mobile device 360 ​​that has sent the BLE identification information is registered based on the BLE identification information (operation S914). In detail, in the BLE pairing operation, the display device 310 registers the paired mobile device 360 ​​by receiving and storing the BLE identification information of the mobile device 360. Therefore, when information corresponding to the BLE identification information (i.e., information equivalent to the BLE identification information) exists in the memory 315 of the display device 310, the display device 310 can determine that the mobile device 360 ​​that sent the BLE identification information is a registered device.

[0244] The processor included in the controller 311 may determine whether information corresponding to the BLE identification information is stored in the controller 311 of the display device 310 or in the memory 315 referenced by the controller 311 , thereby determining whether the mobile device 360 ​​is registered (operation S914 ).

[0245] Thereafter, the processor included in the controller 311 may perform a sequential operation according to the result of determining the registration (operation S915).

[0246] The sequential operation of S915 may be performed as follows.

[0247] When the processor included in the controller 311 determines that the mobile device 360 ​​that sent the BLE identification information is a registered device, the processor can maintain the execution of the currently executed environmental service. The fact that the display device 310 has received the BLE identification information sent by the mobile device 360 ​​registered in the display device 310 means that the mobile device 360 ​​is located around the display device 310. In addition, the fact that the registered mobile device 360 ​​is located around the display device 310 can be interpreted as the user who owns the registered mobile device 360 ​​is located around the display device 310. Therefore, the display device 310 can maintain the execution of the environmental service, so that the environmental service can be continuously provided to the user.

[0248] When the processor included in the controller 311 determines that the mobile device 360 ​​that has transmitted the BLE identification information is not a registered device, the processor may end the execution of the currently executing environment service.

[0249] Even when the display device 310 receives the BLE identification information, when the received BLE identification information has been transmitted from an unregistered mobile device, the display device 310 may determine that the user to whom the ambient service is to be provided, that is, the user of the registered mobile device 360, is not around the display device 310. Therefore, in order to prevent power consumption, the controller 311 of the display device 310 may perform an operation of ending the execution of the ambient service.

[0250] The controller 311 may control the display 317 to display a notification message such as “The environment service is now ending” or “The environment service will now end. When you want to keep executing, press the confirmation button.” Afterwards, when the user does not press the confirmation button, the controller 311 may end the environment service and may control the display device 310 to end the normal mode and start the sleep mode. When no user input is sensed within a predetermined period of time, the controller 311 may control the display device 310 to end the normal mode and start the sleep mode.

[0251] As described above, when the controller 311 determines that the BLE identification information is not received from the registered mobile device 360, the display device 310 may start the sleep mode (operation S916). The controller 311 may notify the communicator 313 of the start of the sleep mode (operation S917), and may control not to supply power to the elements of the display device 310 other than the communicator 313. Therefore, the display device 310 starts the sleep mode in which only the communicator 313 remains activated.

[0252] The memory 315 of the display device 310 may include a first memory and a second memory. The first memory may be a ROM or flash memory storage medium, and the second memory may be a RAM storage medium.

[0253] When BLE identification information is received from a mobile device during the normal mode, the processor included in the controller 311 may control the received BLE identification information to be stored in the first memory and the internal memory of the communicator 313. Moreover, if the identification information is changed or updated, the controller 311 may control the BLE identification information stored in the first memory and the internal memory of the communicator 313 to be changed or updated by reflecting the change or update thereof. Therefore, each of the first memory and the internal memory of the communicator 313 may store the finally updated BLE identification information.

[0254] When the display device 310 starts a normal mode, the controller 311 may load a program corresponding to a first application for executing an environment service to the second memory, and may control the first application to be executed.

[0255] refer to Fig. 9 902, the operation of the display device 310 after the sleep mode is initiated is described in detail below.

[0256] During the sleep mode, the communicator 313 may continuously perform monitoring as to whether a BLE signal is received (operation S918 ).

[0257] In block 902 , operations S919 and S920 equally correspond to the aforementioned operations S911 and S912 , and thus a detailed description thereof is not provided.

[0258] After the sleep mode starts, the communicator 313 manages the received BLE identification information. After the sleep mode starts, when BLE identification information is received from the mobile device, the communicator 313 wakes up the controller 311 based on the result of determining whether there is information corresponding to the received BLE identification information.

[0259] In the sleep mode, power is supplied only to the communicator 313, so only the communicator 313 remains in an activated state, and power can be blocked to other elements of the display device 310. Therefore, in the sleep mode, the display 317 is turned off, so a black screen can be shown. However, even after the sleep mode is started, the controller 311 can receive and recognize a signal requesting wakeup from the communicator 313.

[0260] In the BLE pairing performed when the mobile device 360 ​​is registered, the BLE identification information of the registered mobile device 360 ​​is stored in the internal memory of the communicator 313 (ie, Figure 5 Therefore, when the internal memory of the communicator 313 (i.e., Figure 5When there is information corresponding to the received BLE identification information in the internal memory 513 of the controller 311, that is, information equivalent to the received BLE identification information, the communicator 313 can determine that the mobile device 360 ​​that sent the BLE identification information is a registered device. Except for the operation subject, operation S921 is equivalent to operation S914. That is, operation S921 is performed by the communicator 313, and operation S914 is performed by the controller 311.

[0261] Afterwards, the communicator 313 may perform sequential operations based on the result of determining the registration of the mobile device 360 ​​that sent the BLE identification information. When the communicator 313 determines that the mobile device 360 ​​that sent the BLE identification information is a registered device, the communicator 313 notifies the controller 311 of the result (operation S922). Therefore, the controller 311 may receive the notification in operation S922 and may therefore wake up (operation S923).

[0262] The controller 311 may determine that the registered mobile device 360 ​​is located nearby, and may control the display device 310 to start the normal mode and perform the environmental service. The controller 311 may determine that the registered mobile device 360 ​​is located nearby, and may control the display device 310 to start the normal mode in which the display device 310 is turned on. After the normal mode starts, when the user has set the environmental service on mode or the default situation, the controller 311 may control the environmental service to be performed.

[0263] When the communicator 313 determines that the mobile device 360 ​​that sent the BLE identification information is not a registered device, the communicator 313 may maintain the sleep mode. That is, the communicator 313 does not send a notification to the controller 311 (operation S922), so the controller 311 does not wake up.

[0264] Fig.10 is a diagram for describing an operation performed by a display device according to an embodiment. The operation may be performed by any one of the above-mentioned display device and mobile device. Fig.10 The operations shown are described with reference to display device 310 and mobile device 360 ​​as examples. Fig.10 Operation 1000 shown in FIG.

[0265] In detail, Fig.10 The operation 1000 corresponds to Fig. 9 The operation of block 901. That is, Fig.10 Operations performed by the controller 311 of the display device 310 are shown in detail.

[0266] Reference Fig.10 , the display device 310 according to the embodiment performs a BLE pairing operation (operation S1010), and can register a specific mobile device. Figure 8The BLE pairing operation is described in detail, and therefore, a detailed description thereof is not provided here.

[0267] After the registration of the specific mobile device is completed, while the environmental service is executed, the display device 310 may determine whether the registered mobile device is sensed (operation S1020). The fact that the environmental service is executed indicates that the display device 310 is in the normal mode, so the controller 311 may determine whether the registered mobile device is sensed. That is, operation S1020 may correspond to Fig. 9 As described above with reference to operation S914, whether a registered mobile device is sensed may be determined based on whether information corresponding to the received BLE identification information is stored in the memory 315.

[0268] As a result of the determination in operation S1020 , when a registered mobile device is sensed, the controller 311 may maintain the execution of the environment service (operation S1030 ).

[0269] As a result of the determination in operation S1020, when the registered mobile device is not sensed, the controller 311 may output a notification message to receive confirmation of the end of execution of the environmental service (operation S1040). Here, the notification message may be output as an audio signal or a video signal. The controller 311 may control the display 317 to display a notification message such as "The environmental service is now ending" or "The environmental service will end now. When you want to keep executing, press the confirmation button."

[0270] Thereafter, when the user input is not sensed within a predetermined period of time, the controller 311 may end the environmental service (operation S1045 ), and may control the display device 310 to end the normal mode and start the sleep mode (operation S1050 ).

[0271] The operating systems of mobile devices currently provided are roughly divided into two types. The operating systems of mobile devices can be divided into iOS developed and provided by Apple Inc. and Android developed and provided by Google LLC.

[0272] The display device 310 according to an embodiment may differently set a scheme of identifying a mobile device or a scheme of receiving a BLE signal according to an OS of a specific mobile device.

[0273] According to the OS of the mobile device 360 ​​, the processor included in the controller 311 may differently set a scheme of identifying the mobile device 360 ​​to be paired to perform the ambient service.

[0274] When performing a BLE pairing operation for registration of the mobile device 360, an Operation Code Command Field (OCF) command may be transmitted from the mobile device 360 ​​to the display device 310. The OCF command includes a field for defining the type of the OS of the mobile device 360.

[0275] When the OS of the mobile device 360 ​​is Android, the display device 310 may receive the<OS=Android> Therefore, the display device 310 can recognize that the OS of the mobile device 360 ​​is the Android OS, and can set a scanning period or a scanning method corresponding to the Android OS.

[0276] When the OS of the mobile device 360 ​​is iOS, the display device 310 may receive a message including<OS=iOS> Therefore, the display device 310 can recognize that the OS of the mobile device 360 ​​is iOS, and can set a scanning period or a scanning method corresponding to iOS.

[0277] Figures 11a to 11d The operation of the environment service executed in the display device paired with the mobile device having the first OS is shown. For example, the first OS indicates Android OS.

[0278] Fig.11a An example is shown in which the display device 310 performs the environment service. Therefore, the display device 310 can output a clock screen image corresponding to the environment service to the display screen 1110.

[0279] Reference Fig.11a and 11c , the mobile device 360 ​​with Android OS sends the BLE advertisement 1120 at regular time intervals (operation S1131). For example, the mobile device 360 ​​may send the BLE advertisement 1120 at intervals of 1 second.

[0280] Then, the display device 310 may scan or check whether a BLE signal or a BLE packet is received at regular time intervals (operation S1132). For example, the display device 310 may scan or check whether a BLE signal or a BLE packet is received at intervals of 15 minutes. The display device 310 may perform a scanning operation or a checking operation for 1 minute at intervals of 15 minutes.

[0281] Operation S1132 may be performed by checking, by the communicator 313 , whether a BLE signal or a BLE packet is received.

[0282] Afterwards, the display device 310 can determine whether the mobile device 360 ​​that sent the BLE packet is a device registered in the display device 310 by using the received BLE packet, and can maintain the execution of the environmental service according to the determination result (operation S1133). Here, the BLE packet can indicate the presence of the mobile device 360 ​​by including BLE identification information (e.g., the random address of the mobile device 360). The display device 310 can convert the received random address to a BLE address that is sent as the original address and by BLE pairing by using the IRK obtained in the BLE pairing. Then, the display device 310 can determine whether the mobile device 360 ​​is a registered device by using the converted BLE address.

[0283] In addition, because the display device 310 is in the normal mode in which the environment service is executed, operation S1133 may be performed by a processor included in the controller 311 .

[0284] Reference Fig.11b and Fig.11d , the display device 310 starts a sleep mode and then turns off and outputs a black screen 1150. The mobile device 360 ​​having an Android OS transmits a BLE advertisement 1120 at a specific time interval (operation S1181).

[0285] After the sleep mode starts, the communicator 313 may scan or check whether a BLE signal or BLE packet is received from a registered mobile device at a specific time interval (operation S1182). For example, the communicator 313 may scan or check whether a BLE signal or BLE packet is received every 3 seconds.

[0286] As a result of the scanning, when a BLE packet is received from the registered mobile device 360, the communicator 313 can wake up the display device 310. Therefore, the display device 310 is turned on (operation S1183). In addition, after the display device 310 is woken up and then starts the normal mode, the controller 311 can control the execution of the environment service so that the clock screen image 1160 corresponding to the environment service is output.

[0287] As described above, when the OS of the mobile device 360 ​​as the transmitting terminal is Android OS, constant BLE advertising is possible. In this case, considering the battery life of the mobile device 360, the BLE advertising can be set to be performed once every 1 second. Fig.11a and Fig.11b In the illustrated embodiment, the display device 310 as a receiving terminal may perform a BLE scanning operation at a necessary time (eg, during a predetermined period of 15 minutes), and may check whether there is a registered mobile device around the display device 310 .

[0288] When the registered mobile device exists around the display device 310, the display device 310 determines that the presence of the user is confirmed, and thus keeps its screen turned on. Therefore, an image corresponding to the environmental service is continuously output on the display screen 1110. The display device 310 performs a BLE scanning operation at the next interval (for example, within 15 minutes), and determines whether to keep its screen turned on.

[0289] As a result of the scanning operation (operation S1132) performed by the display device 310, a situation in which a BLE packet including BLE identification information of an unregistered mobile device is received may occur. In this case, when the display device 310 does not find a registered mobile device as a result of performing the BLE scanning operation, the display device 310 may notify that the screen will be turned off within 1 minute by outputting a pop-up message, and may provide the user with an option to cancel screen turning off.

[0290] When the display device 310 determines that the mobile device 360 ​​does not exist, according to the result of the scanning operation (operation S1132), the display device 310 may turn off the screen of the display device 310. The display device 310 may indicate a window that the screen of the display device 310 will be turned off within a predetermined time, so the user may be notified that the screen will be turned off.

[0291] When the display device 310 is turned off and thus enters sleep mode, the display device 310 may record information about the previously BLE paired mobile device (e.g., BLE identification information, BLE setting information, BT setting information, etc.) to the communicator 313, for example, to Figure 5 The firmware (FW) of the Bluetooth module 511 in the display device 310 or in the internal memory 513 of the communicator 313, and necessary settings may be performed after the display device 310 is turned off to determine the proximity of the mobile device.

[0292] Even when the display device 310 is turned off, the display device 310 may continuously perform an operation of scanning a BLE packet. This is a specification necessary for communication between a remote controller and the display device 310 that conforms to the Bluetooth communication standard according to the related art.

[0293] After the display device 310 is turned off, the Bluetooth module (eg, Figure 5The operation mode in which the Bluetooth module 511 of the display device 310 operates is called low power mode (LPM). The aforementioned sleep mode may correspond to LPM. The communicator 313 of the display device 310 may periodically perform a BLE scanning operation of scanning the mobile device during LPM. For example, the communicator 313 of the display device 310 may perform a BLE scanning operation at intervals of 3 seconds, and the proximity of the mobile device may be determined. While performing the BLE scanning operation, when a previously BLE paired mobile device, i.e., a mobile device registered in the display device 310, is found, the process of turning on the display device 310 may be performed. When the display device 310 is turned on, the previous operation mode of the display device 310 may be executed just before the display device 310 is turned off. For example, when the previous operation mode is an operation mode in which TV content is output, the display device 310 may operate in an operation mode in which the display device 310 selects and outputs the previously output TV content. In addition, when the previous operation mode is an operation mode in which an environmental service is being executed, the display device 310 may operate in an operation mode in which an environmental service is executed in the display device 310.

[0294] Fig.12a FIG. 4 shows a BLE signal transmitted and received by a mobile device having a second OS. Here, the second OS is different from Figures 11a to 11d The first OS described in. For example, the second operating system indicates an iOS.

[0295] Figure 12b and Fig.12c is a diagram for describing the operation of an ambient service performed in a display device paired with a mobile device having a second OS.

[0296] In one embodiment, when the OS of the registered mobile device is a second type of OS, the controller 311 may control the communicator 313 to send a first iBeacon signal for requesting to send BLE identification information to the mobile device at a certain time interval, and check the reception of a second iBeacon signal triggered by the first iBeacon signal and including the BLE identification information.

[0297] The mobile device 360 ​​with iOS is triggered by receiving the iBeacon signal transmitted from the display device 310, thereby transmitting the iBeacon signal including the BLE identification information to the display device 310. When the registered mobile device has iOS, the display device 310 may transmit an iBeacon signal for requesting transmission of the iBeacon signal including the BLE identification information to the mobile device 360 ​​at a certain time interval (operation S1241).

[0298] Reference Fig.12a, the BLE signal exchanged with the mobile device with iOS can be an iBeacon signal. Fig.12a As shown, the iBeacon signal 1201 includes three fields, which are a universal unique identifier (UUID) 1203, a primary identification (ID) 1204, and a secondary ID 1205. The iBeacon signal 1201 may include two fields, iBeacon prefix 1202 and Tx power 1206. The iBeacon prefix 1202 may include fields for Adv flag 1211, Adv header 1212, company ID 1213, iBeacon signal type 1214, and iBeacon signal length 1215.

[0299] The UUID 1203 having 16 bytes can be used as an identifier of a service used as mobile presence in multiple iBeacon signals. The primary ID 1204 having 2 bytes and the secondary ID 1205 having 2 bytes can be used as a command and unique information of the display device 310 as a receiving terminal. For example, 3 bytes including the 2-byte primary ID 1204 and the 1-byte secondary ID 1205 can be used to send BLE identification information such as a BLE MAC address or a random address of the display device 310, and the remaining 1-byte secondary ID 1205 can be used as a command for each service.

[0300] The mobile device with iOS can be implemented to send a BLE packet in response to a set iBeacon signal. The mobile device with iOS can be implemented to send an iBeacon signal (BLE advertisement) in response to reception of an iBeacon signal as a command requesting that a BLE packet be sent from a display device.

[0301] Figure 12b An example is shown in which the display device 310 performs the environmental service. The display device 310 displays a clock screen image corresponding to the environmental service.

[0302] Reference Figure 12b , when the mobile device registered in the display device 310 has iOS, the display device 310 may transmit an iBeacon signal at regular time intervals (operation S1241). When the mobile device 360 ​​receives the iBeacon signal transmitted from the display device 310, the mobile device 360 ​​may respond thereto and thus may transmit an iBeacon signal including BLE identification information to the display device 310 (operation S1243).

[0303] Mobile devices with iOS cannot perform constant BLE advertising. Therefore, when the display device 310 as a receiving terminal attempts to determine the proximity of the mobile device (e.g., every 15 minutes), the display device 310 can send an iBeacon signal to request the mobile device to respond with an iBeacon signal.

[0304] The mobile device 360 ​​having received the iBeacon signal of the display device 310 transmits the iBeacon signal including the BLE identification information. The mobile device 360 ​​having received the iBeacon signal executes an application for providing an environmental service, and the application may transmit the iBeacon signal as a BLE advertisement to the registered display device 310 (operation S1243).

[0305] Therefore, the display device 310 can determine whether the registered mobile device is approaching. The sequential operations (eg, operations to maintain the execution of the environment service) performed when the registered mobile device is approaching are similar to those of the reference Fig.11a The operations described are the same.

[0306] Figure 12b The mobile device identification scheme shown in can be applied not only to mobile devices with iOS, but also to mobile devices in which constant BLE advertising cannot be enabled.

[0307] When a mobile device with iOS is registered in the display device 310 , after BLE pairing is completed, the display device 310 may set and store information about the mobile device and information required to exchange iBeacon signals.

[0308] The display device 310 may be configured so that when the display device 310 is turned off, the Bluetooth module 511 of the communicator 313 periodically (e.g., every 150 milliseconds (ms)) sends an iBeacon signal. The operation performed by the display device 310 according to whether the registered mobile device is close after the mobile device sends the iBeacon signal is similar to the reference signal. Figures 11a to 11d The operations described are the same, so a detailed description thereof is not provided here.

[0309] The interval at which the display device 310 sends the iBeacon signal can be set differently. For example, the display device 310 can send the iBeacon signal to the mobile device every 150 milliseconds, and when the mobile device sends a response to it, the display device 310 can check the reception of the response every 3 seconds.

[0310] refer to Fig.12c , the display device 310 which starts the sleep mode and is thus turned off outputs a black screen 1260 .

[0311] After the sleep mode starts, the communicator 313 may transmit an iBeacon signal to the mobile device 360 ​​having iOS at a certain time interval (operation S1281), and the mobile device 360 ​​having received the iBeacon signal may transmit the iBeacon signal to the communicator 313 of the display device 310 (operation S1283). The communicator 313 of the display device 310 may determine whether the received iBeacon signal has been transmitted from a registered mobile device, and may determine whether the registered mobile device is located nearby.

[0312] When the display device 310 determines that the registered mobile device is located nearby, the communicator 313 may wake up the display device 310. Thus, the display device 310 is turned on.

[0313] In addition, after the display device 310 is awakened and then starts a normal mode, the controller 311 may control an ambient service to be started and output a clock screen image 1270 corresponding to the ambient service.

[0314] Fig.13 1300 is a flowchart showing a control method 1300 of a display device according to an embodiment. The control method 1300 according to the embodiment is equivalent to the operation performed by the display device 310 according to the embodiment, which operation refers to Figures 1 to 12c Therefore, when describing the control method 1300 according to the embodiment, no description is provided about Figures 1 to 12c The repetitive description is repeated.

[0315] Reference below Figure 4 The display device 310 and the mobile device 360 ​​are shown to describe the control method 1300 in detail.

[0316] The control method 1300 according to the embodiment is a control method of the display device 310, and the display device 310 includes: a memory 315, storing at least one instruction; a communicator 313, configured to communicate with a mobile device via at least one wireless network including a BLE communication network; and a controller 311, including at least one processor, and the at least one processor is configured to execute at least one instruction stored in the memory.

[0317] Reference Fig.13 When BLE identification information as information for identifying a mobile device 360 ​​connected via a BLE communication network is received during a normal mode in which an ambient service is being executed, the control method 1300 of the display device 310 includes managing the BLE identification information by the controller 311 (operation S1310). Operation S1310 may be performed by the controller 311 of the display device 310.

[0318] Since operation S1310 corresponds to Fig. 9 , so a detailed description thereof is not provided here.

[0319] When BLE identification information is received from the mobile device 360 ​​after starting the sleep mode, the control method 1300 of the display device 310 includes waking up the controller 311 by the communicator 313 based on determining whether information corresponding to the received BLE identification information exists (operation S1320). Operation S1320 may be performed by the communicator 313 of the display device 310.

[0320] Since operation S1320 corresponds to Fig. 9 902, therefore, a detailed description thereof is not provided here.

[0321] In the control method 1300 of the display device according to the embodiment, operation S1310 and operation S1320 are distinguished according to whether the display device 310 is in the normal mode or starts the sleep mode, and the order of operation S1310 and operation S1320 may be switched therebetween.

[0322] Fig.14 is a flowchart illustrating in detail a control method 1400 of a display device according to an embodiment. Fig.14 The control method 1400 shown corresponds to Fig.13 A detailed description of a method 1300 for controlling a display device is shown. Fig.14 In the control method 1400 shown in FIG. Fig.13 The operations of those operations of control method 1300 are represented by similar reference numerals.

[0323] Reference Fig.14 , compared with the control method 1300 , the control method 1400 may include operation S1410 .

[0324] The control method 1400 may include an operation S1410 of performing a BLE pairing operation and registering a mobile device. Operation S1410 may be performed by the controller 311 of the display device 310. Figure 8 The BLE pairing operation is described in detail, so a detailed description thereof is not provided here.

[0325] According to the control method of the display device and the display device thereof according to the embodiments of the present disclosure, the power consumption of the display device providing environmental services can be reduced.

[0326] In addition, according to the control method of the display device and the display device of the embodiment of the present disclosure, the display device providing environmental services can easily turn on or off its screen while reducing the power consumption of the display device, thereby preventing the service life of the panel of the display device from being reduced.

[0327] Furthermore, according to the control method of the display device and the display device thereof according to an embodiment of the present disclosure, the display device can appropriately provide an environmental service according to the type of OS of a mobile device connected via a BLE communication network.

[0328] The control method of the display device according to the embodiment of the present disclosure can be embodied as a programming command to be executed in various computer units, and then can be recorded in a non-transitory computer-readable medium. The embodiment of the present disclosure can be implemented as a non-transitory computer-readable recording medium having one or more programs recorded thereon, the programs including instructions for executing the control method of the display device.

[0329] The non-transitory computer-readable recording medium may include one or more of programming commands, data files, data structures, etc. The programming commands recorded to the non-transitory computer-readable recording medium may be specially designed or configured for the present disclosure, or may be known to a person of ordinary skill in the art. Examples of non-transitory computer-readable recording media include: magnetic media (including hard disks, magnetic tapes, and floppy disks); optical media (including CD-ROMs and DVDs); magneto-optical media (including floppy disks); and hardware for storing and executing programmed commands in ROM, RAM, flash memory, etc. Examples of programming commands include not only machine codes generated by a compiler, but also high-level programming languages ​​to be executed in a computer by using an interpreter.

[0330] In addition, the control method of the display device according to the embodiment of the present disclosure can be implemented in a computer program product, which includes a non-transitory computer-readable medium on which a program is recorded, and the program is used to: obtain sentences in multiple languages, obtain vector values ​​corresponding to each word included in the sentence by using a multilingual translation model, convert the obtained vector values ​​into vector values ​​corresponding to the target language, and obtain the sentence in the target language based on the converted vector values.

[0331] Although the embodiments of the present disclosure have been described in detail, the spirit and scope of the present disclosure may also include various changes and modifications in form and details that may be made by one of ordinary skill in the art, given the basic concept of the present disclosure as defined in the appended claims.

Claims

1. A display device, comprising: monitor; A memory storing at least one instruction; a communicator configured to communicate with a mobile device via at least one wireless network including a Bluetooth Low Energy (BLE) communication network; and a controller comprising at least one processor configured to execute at least one instruction stored in the memory, Features: The at least one processor is further configured to execute at least one instruction to: identifying a type of an operating system of a mobile device registered in the display device when the display device operates in a normal mode by performing an environmental service that provides a predetermined screen image replacing a black screen on a display; obtaining BLE identification information for identifying a mobile device connected via a BLE communication network by selecting one of a first process and a second process for receiving BLE identification information based on a type of an operating system of the mobile device and executing the selected process; and Based on the obtained BLE identification information, one of the normal mode and the sleep mode is executed. The at least one processor is further configured to execute at least one instruction to: Identify the BLE identification information stored in the memory; identifying whether the BLE identification information obtained via the selected process of the first process and the second process corresponds to the BLE identification information stored in the memory; maintaining execution of the ambient service based on the obtained BLE identification information corresponding to the BLE identification information stored in the memory; and Based on the fact that the obtained BLE identification information does not correspond to the BLE identification information stored in the memory, the execution of the environment service is terminated, and control is performed to enter a sleep mode in which the display is turned off.

2. The display device according to claim 1, wherein: The at least one processor is further configured to execute at least one instruction to: The type of the operating system OS is identified as a first type OS or a second type OS, wherein the first type OS is Android OS and the second type OS is iOS.

3. The display device according to claim 2, wherein: The at least one processor is further configured to execute at least one instruction to: Based on the type of the operating system being identified as the first type OS, the communicator is controlled to check reception of the BLE identification information at specific time intervals.

4. The display device according to claim 2, wherein: The at least one processor is further configured to execute at least one instruction to: Based on the type of the operating system being identified as the second type OS, the communicator is controlled to send a first iBeacon signal to the mobile device at a specific time interval to request the transmission of the BLE identification information, and to check the reception of a second iBeacon signal triggered by the first iBeacon signal and including the BLE identification information.

5. The display device according to claim 1, wherein: The at least one processor is further configured to execute at least one instruction to: Based on the obtained BLE identification information not corresponding to the BLE identification information stored in the memory, a user interface regarding terminating the execution of the environment service is displayed.

6. The display device according to claim 1, wherein: The at least one processor is further configured to execute at least one instruction to: According to the entry of the sleep mode, the BLE identification information stored in the memory is recorded in the internal memory of the communicator.

7. A method for controlling a display device, the display device comprising: A memory storing at least one instruction, a communicator configured to communicate with a mobile device through at least one wireless network including a Bluetooth low energy BLE communication network, and a controller, the controller including at least one processor, the at least one processor configured to execute at least one instruction stored in the memory, the control method is characterized by: identifying a type of an operating system of a mobile device registered in the display device when the display device operates in a normal mode by performing an environmental service that provides a predetermined screen image replacing a black screen on a display; obtaining BLE identification information for identifying a mobile device connected via a BLE communication network by selecting one of a first process and a second process for receiving BLE identification information based on a type of an operating system of the mobile device and executing the selected process; and Based on the obtained BLE identification information, one of the normal mode and the sleep mode is executed. The control method is further characterized in that: Identify the BLE identification information stored in the memory; identifying whether the BLE identification information obtained via the selected process of the first process and the second process corresponds to the BLE identification information stored in the memory; maintaining execution of the ambient service based on the obtained BLE identification information corresponding to the BLE identification information stored in the memory; and Based on the fact that the obtained BLE identification information does not correspond to the BLE identification information stored in the memory, the execution of the environment service is terminated, and control is performed to enter a sleep mode in which the display is turned off.

8. The control method according to claim 7, further characterized in that: The type of the operating system OS is identified as a first type OS or a second type OS, wherein the first type OS is Android OS and the second type OS is iOS.

9. The control method according to claim 8, further characterized in that: Based on the type of the operating system being identified as the first type OS, the communicator is controlled to check reception of the BLE identification information at specific time intervals.

10. The control method according to claim 8, further characterized in that: Based on the type of the operating system being identified as the second type OS, the communicator is controlled to send a first iBeacon signal to the mobile device at a specific time interval to request the transmission of the BLE identification information, and to check the reception of a second iBeacon signal triggered by the first iBeacon signal and including the BLE identification information.

11. The control method according to claim 7, further characterized by: Based on the obtained BLE identification information not corresponding to the BLE identification information stored in the memory, a user interface regarding terminating the execution of the environment service is displayed.

12. The control method according to claim 7, further characterized by: According to the entry of the sleep mode, the BLE identification information stored in the memory is recorded in the internal memory of the communicator.

Images