Display apparatus and method of operating the same

Abstract

A display device and an operating method thereof are provided. The operating method of the display device includes detecting at least one sensing value corresponding to at least one sensor through the at least one sensor, identifying a contact area on the display device which is contacted by a mobile device based on the at least one sensing value, receiving state information about an operation being performed by the mobile device from the mobile device, and performing a function corresponding to the identified contact area based on the received state information.

Description

[0001] This application is based on and claims priority to Korean Patent Application No. 10-2020-0000453, filed on January 2, 2020, in the Korean Intellectual Property Office, the disclosure of which is incorporated by reference herein in its entirety. TECHNICAL FIELD

[0002] The disclosure relates to a display apparatus and an operating method thereof, and more particularly, to a display apparatus that performs a function corresponding to a contact area when the display apparatus is contacted by a mobile apparatus and an operating method thereof. BACKGROUND

[0003] Internet of Things (IoT) refers to connecting all electronic apparatuses (i.e., IoT apparatuses) existing in daily life, such as a television (TV), a smartphone, a personal computer (PC), a refrigerator, a washing machine, a wearable watch, and a car, via a wireless network. With IoT, a plurality of electronic apparatuses can be driven by exchanging and processing data between the plurality of electronic apparatuses.

[0004] As IoT technology develops, there is an increasing demand to connect IoT apparatuses that provide various services and to operate IoT apparatuses connected to each other.

[0005] A mobile apparatus having portability can have a small display screen, and a user can want to be provided with a service using a large-screen display apparatus. SUMMARY

[0006] A display apparatus that performs a function corresponding to a contact area when the display apparatus is contacted by a mobile apparatus and an operating method thereof are provided.

[0007] Additional aspects will be set forth in part in the description which follows, and in part will become apparent to those skilled in the art by reference to the description, or can be learned by practice of the presented embodiments.

[0008] According to an aspect of the disclosure, an operating method of a display apparatus includes detecting at least one sensing value corresponding to at least one sensor through the at least one sensor, identifying a contact area on the display apparatus contacted by a mobile apparatus based on the at least one sensing value, receiving, through a communicator, state information about an operation being performed by the mobile apparatus from the mobile apparatus, and performing, by the display apparatus, a preset function corresponding to the identified contact area based on the received state information.

[0009] According to an aspect of the disclosure, a display device includes a communicator, a sensing unit including at least one sensor, a memory storing one or more instructions, and a processor configured to execute the one or more instructions to detect at least one sensing value corresponding to the at least one sensor through the at least one sensor, identify a contact area on the display device contacted by a mobile device based on the at least one sensing value, receive state information about an operation being performed by the mobile device from the mobile device through the communicator, and perform a preset function corresponding to the identified contact area based on the received state information.

[0010] According to an aspect of the disclosure, a non-transitory computer-readable recording medium storing a program for executing the operation method in a computer is provided. BRIEF DESCRIPTION OF DRAWINGS

[0011] The above and other aspects, features, and advantages of certain embodiments of the disclosure will be more apparent from the following description taken in conjunction with the accompanying drawings, in which:

[0012] Figure 1 is a diagram schematically illustrating an example of operating a display device according to an embodiment;

[0013] Figure 2 is a flowchart of an operation method of a display device according to an embodiment;

[0014] Figure 3 is a diagram schematically illustrating an example of performing a function corresponding to a first contact area according to an embodiment;

[0015] Figure 4 is a diagram schematically illustrating an example of performing a function corresponding to a second contact area according to an embodiment;

[0016] Figure 5 is a diagram schematically illustrating an example of performing a function corresponding to a third contact area according to an embodiment;

[0017] Figure 6 is a diagram schematically illustrating an example of performing a function corresponding to a third contact area according to an embodiment;

[0018] Figure 7 is a diagram schematically illustrating an example of performing a function corresponding to a third contact area according to an embodiment;

[0019] Figure 8 is a flowchart illustrating an example of performing a function corresponding to a number of contacts according to an embodiment;

[0020] Figure 9Ais a diagram illustrating an example of performing a function corresponding to the number of contacts according to an embodiment;

[0021] Figure 9B is a diagram illustrating an example of performing a function corresponding to the number of contacts according to an embodiment;

[0022] Figure 10 is a flowchart illustrating an example of identifying a contact area based on a sensed value according to an embodiment;

[0023] Figure 11A is a diagram illustrating an example in which at least one sensor is disposed on a display device and an example of a contact area according to an embodiment;

[0024] Figure 11B is a diagram illustrating an example in which at least one sensor is disposed on a display device according to an embodiment;

[0025] Figure 12 is a flowchart illustrating an example of pre-setting a function corresponding to a contact area through a display device according to an embodiment;

[0026] Figure 13 is a flowchart of an operation method of a display device and a mobile device according to an embodiment;

[0027] Figure 14 is a block diagram of a display device according to an embodiment;

[0028] Figure 15 is a detailed block diagram of a display device according to an embodiment; and

[0029] Figure 16 is a block diagram of a mobile device according to an embodiment. DETAILED DESCRIPTION

[0030] Certain embodiments will be described with reference to the accompanying drawings. However, the disclosure can be embodied in many different forms and should not be construed as being limited to the embodiments set forth herein. For the sake of clarity, portions of the disclosure that are not related to the embodiments have been omitted from the drawings, and the same components are designated by the same reference numerals throughout the specification.

[0031] In the embodiments, general terms that have been widely used at present are selected considering functions referred to herein, but various other terms can be used according to the intention of those skilled in the art, precedents, new technology, etc. Therefore, the terms used herein should be defined based on the meaning and the entire context of the embodiments, not based on the names thereof.

[0032] As used herein, the expression "at least one of a, b, or c" indicates only a, only b, only c, both a and b, both a and c, both b and c, or all of a, b, and c, or variations thereof, only a, only b, only c, both a and b, both a and c, both b and c, or all of a, b, and c.

[0033] As used herein, the terms "1st" or "first" and "2nd" or "second" can use the corresponding components regardless of importance or order, and are used to distinguish one component from another component without limiting the components.

[0034] The terminology used herein is for the purpose of describing certain embodiments only and is not intended to be limiting. As used herein, singular forms are intended to include the plural forms, unless the context clearly indicates otherwise. As used herein, when an element is referred to as being "connected" to another element, it is understood that the element can be "directly connected" to the other element or "electrically connected" to the other element with another element in between. It will be understood that when an element is referred to as "including" another element, unless otherwise noted, the element can further include other elements.

[0035] As used herein, and specifically in the claims, the terms "the" and similar referents can indicate both the singular and the plural forms. Unless otherwise expressly specified, the operations of the methods according to the embodiments can be performed in any suitable order. The embodiments are not limited by the order in which the operations are performed.

[0036] As used herein, expressions such as "in some embodiments" or "in embodiments" do not necessarily refer to the same embodiments.

[0037] Some embodiments can be represented by functional blocks and various operations. Some or all of these functional blocks can be implemented by various numbers of hardware and / or software configurations for performing certain functions. For example, a functional block can be implemented by one or more microprocessors or by a circuit configuration for certain functions. For example, the functional blocks as set forth herein can be implemented in various programming or scripting languages. The functional blocks can be implemented with algorithms executed by one or more processors. Related technologies can be used for electronic configurations, signal processing, and / or data processing. Terms such as "mechanism," "element," "device," and "configuration" can be used broadly and are not limited to mechanical and physical configurations.

[0038] In the drawings, lines or members for connection between components only illustrate functional connection and / or physical or circuit connection. The connection between components of the device can be represented by various functional connections, physical connections, or circuit connections that can be replaced or added.

[0039] Embodiments will now be described in detail with reference to the accompanying drawings.

[0040] Figure 1 FIG. 1 is a diagram schematically illustrating an example of operating a display apparatus according to an embodiment.

[0041] Referring to Figure 1 When a region on the display apparatus 100 (e.g., a TV) is contacted by a mobile device 200 (e.g., a smart phone), the display apparatus 100 can perform a function related to the mobile device 200.

[0042] In an embodiment, the display apparatus 100 can perform a preset function corresponding to a contact region contacted by the mobile device 200. For example, the display apparatus 100 can perform a preset function related to an operation being performed by the mobile device 200, such as a function of executing the same application as an application being executed by the mobile device 200 (a first function 101), a multi-screen function (a second function 102), or a screen mirroring function (a third function 103), corresponding to each contact region on the display apparatus 100.

[0043] Referring to Figure 1 For example, the display apparatus 100 is set to perform the first function 101 when a contact of a left bezel region thereof is sensed, to perform the second function 102 when a contact of an upper bezel region thereof is sensed, and to perform the third function 103 when a contact of a right bezel region thereof is sensed.

[0044] In an embodiment, pairing between the display apparatus 100 and the mobile device 200 can be performed simply by a region on the display apparatus 100 being contacted by the mobile device 200, without a separate complicated entry process, and the display apparatus 100 can subsequently perform a function related to an operation being performed in the mobile device 200.

[0045] Accordingly, it is possible to seamlessly provide a user of a mobile device 200 (e.g., a smart phone) having a small display with a service being executed by the mobile device 200 through a display apparatus 100 (e.g., a TV) having a large display.

[0046] In an embodiment, a user can directly set a desired function to be performed or change a desired function by contacting a region that is convenient to use, such as among four bezel regions of the display apparatus 100, in consideration of a location where the display apparatus 100 is installed. Accordingly, a convenient user-customized user interface environment can be implemented.

[0047] In an embodiment, a case where a bezel region of the display apparatus 100 is contacted by the mobile device 200 is described as an example, but the embodiment is not limited thereto. The contact region can be at least a region on the display apparatus 100.

[0048] In an embodiment, the display apparatus 100 can be an electronic apparatus including a display, for example, a TV. The display apparatus 100 can be implemented in various forms such as a desktop computer, a laptop computer, a tablet personal computer (PC), a mobile phone, an e-book terminal, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a digital camera, a camcorder, a navigation apparatus, an MP3 player, a wearable apparatus, etc. Alternatively, the display apparatus 100 can be a stationary electronic apparatus arranged at a fixed location or a mobile electronic apparatus having a portable form, or can be a digital broadcasting receiver capable of receiving a digital broadcasting service.

[0049] In particular, the embodiment can be easily implemented by the display apparatus 100 such as a TV as a large-sized display, but is not limited thereto.

[0050] In an embodiment, the mobile apparatus 200 can include, but is not limited to, a mobile computing apparatus such as a smart phone, a wearable apparatus, a tablet PC, a PDA, a laptop computer, a media player, a micro server, and a global positioning system (GPS) apparatus.

[0051] In an embodiment, the display apparatus 100 and the mobile apparatus 200 can transmit and receive data to and from each other through a communication network. For example, the display apparatus 100 can be connected to or paired with the mobile apparatus 200.

[0052] In an embodiment, the communication network can be configured as at least one of a wired communication network or a wireless communication network. In detail, mobile communication (for example, wireless broadband (Wibro), worldwide interoperability for microwave access (Wimax), code division multiple access (CDMA), wideband CDMA (WCDMA), third generation (3G), 4G, or 5G), short-range communication (for example, near field communication (NFC), Bluetooth, wireless local area network (WLAN), or Wi-Fi), and / or low power long range communication (for example, TV white space (TVWS) or Weightless) can be used as a communication network for implementing IoT.

[0053] Figure 1 This is merely an example, and the embodiment is not limited thereto.

[0054] Figure 14 is a block diagram of a display apparatus according to an embodiment. Figure 15 is a detailed block diagram of a display apparatus according to an embodiment. Figure 16 is a block diagram of a mobile apparatus according to an embodiment.

[0055] As Figure 14As illustrated in FIG. 1, the display device 100 according to an embodiment can include a memory 120, a processor 130, a communicator 150 (e.g., a communication circuit or a communication interface), and a sensing unit 191. However, not all of the illustrated components are essential components. The display device 100 can include more or less components than those illustrated.

[0056] For example, as Figure 15 As illustrated in FIG. 1, the display device 100 according to an embodiment can further include a display 110, one or more tuners 140, a detector 160, an inputter / outputter 170, a video processor 180, an audio processor 115, an audio outputter 126, and a power supply 190.

[0057] The processor 130 controls overall operations of the display device 100 and signal flow between internal components of the display device 100, and performs a data processing function. When there is a user input or a preset and stored condition is satisfied, the processor 130 can execute an operating system (OS) and various applications stored in the memory 120.

[0058] The processor 130 can include a random access memory (RAM) that stores a signal or data input from an external of the display device 100 or is used as a storage area corresponding to various operations performed by the display device 100, and a read-only memory (ROM) that stores a control program for control of the display device 100.

[0059] The processor 130 can include a graphic processing unit (GPU) that processes graphics corresponding to a video. The processor 130 can be implemented as a system on chip (SoC) that is a combination of a core and a GPU. The processor 130 can include a single core, a dual core, a triple core, a quad core, or a multi core.

[0060] Alternatively, the processor 130 can include a plurality of processors. For example, the processor 130 can be implemented to include a main processor and a sub-processor operating in a sleep mode.

[0061] In an embodiment, the processor 130 can execute at least one instruction stored in the memory 120 to detect at least one sensing value corresponding to at least one sensor through the sensing unit 191 including the at least one sensor.

[0062] In an embodiment, the processor 130 can execute one or more instructions stored in the memory 120 to determine that the display device 100 is contacted by the mobile device 200 when it is determined that the detected at least one sensing value is equal to or greater than a preset threshold value.

[0063] In an embodiment, the processor 130 can execute one or more instructions stored in the memory 120 to compare the detected at least one sensing value with a sensing value of the mobile device 200 received from the mobile device 200 in order to determine whether the display device 100 is contacted by the mobile device 200.

[0064] In an embodiment, the processor 130 can execute one or more instructions stored in the memory 120 to request identification information of the mobile device 200 and receive the identification information of the mobile device 200. The processor 130 can identify whether the mobile device 200 is a device previously registered to the display device 100 based on the identification information of the mobile device 200.

[0065] In an embodiment, the processor 130 can execute one or more instructions stored in the memory 120 to identify a contact area on the display device 100 contacted by the mobile device 200 based on the at least one sensing value.

[0066] In an embodiment, the processor 130 can execute one or more instructions stored in the memory 120 to compare at least one sensing value detected as corresponding to at least one sensor and identify at least one sensor located close to a point on the display device 100 contacted by the mobile device 200 based on a result of the comparison. In addition, the processor 130 can identify a contact area based on the identified one or more sensors.

[0067] In an embodiment, the processor 130 can receive state information about an operation being performed by the mobile device 200 from the mobile device 200 through the communicator 150.

[0068] In an embodiment, the processor 130 can execute one or more instructions stored in the memory 120 to perform a preset function corresponding to the identified contact area based on the received state information of the mobile device 200.

[0069] In an embodiment, the processor 130 can execute one or more instructions stored in the memory 120 to identify a number of times the display device 100 is contacted by the mobile device 200 based on the at least one sensing value.

[0070] In an embodiment, the processor 130 can execute one or more instructions stored in the memory 120 to perform a preset function corresponding to the number of times the display device 100 is contacted.

[0071] In an embodiment, the processor 130 can execute one or more instructions stored in the memory 120 to pre-set a function corresponding to at least one contact area on the display device 100 based on a user input.

[0072] In addition, the processor 130 can execute one or more instructions stored in the memory 120 to pre-set a function corresponding to a number of times at least one contact area on the display device 100 is touched, based on a user input.

[0073] The memory 120 can store various data, programs, or applications for driving and controlling the display device 100 under the control of the processor 130. The memory 120 can store signals or data input / output in correspondence to the driving of the video processor 180, the display 110, the audio processor 115, the audio outputter 126, the power supply 190, the tuner 140, the communicator 150, the detector 160, and the inputter / outputter 170.

[0074] The memory 120 can store an operating system 121 for the control of the display device 100 and the processor 130, an application 122 initially provided from a manufacturer or downloaded from the outside, a graphical user interface (GUI) related to the application, objects (e.g., images, texts, icons, buttons, etc.) for providing the GUI, user information, documents, databases, or related data.

[0075] The memory 120 can further include a TV viewer module 123 storing one or more instructions for receiving an input signal from a remote control device and performing channel control corresponding to the input signal or entering a channel scroll user interface mode when the input signal corresponds to a pre-allocated input, a character recognition module 124 storing one or more instructions for recognizing information from content received from an external device, and a memory buffer register (MBR) module 125 storing one or more instructions for channel control from an external device.

[0076] For example, software (e.g., a program) including one or more instructions can be stored in a machine-readable (e.g., computer-readable) storage medium (e.g., an internal memory) or an external memory.

[0077] The memory 120 includes a ROM, a RAM, or a memory card (e.g., a micro SD card or a USB memory) installed in the display device 100. Alternatively, the memory 120 can include a nonvolatile memory, a volatile memory, a hard disk drive (HDD), or a solid state drive (SSD).

[0078] In an embodiment, the storage 120 can include at least one of a flash memory type storage medium, a hard disk type storage medium, a multimedia card micro type storage medium, a card type memory (e.g., an SD memory or an XD memory), a RAM, a static RAM (SRAM), a ROM, an electrically erasable programmable ROM (EEPROM), a PROM, a magnetic memory, a magnetic disk, and an optical disk.

[0079] The display 110 displays a video included in a broadcast signal received via the tuner 140 on a screen under the control of the processor 130. The display 110 can display content (e.g., a moving image) input via the communicator 150 or the inputter / outputter 170. The display 110 can output an image stored in the storage 120 under the control of the processor 130.

[0080] The display 110 generates a driving signal by converting an image signal, a data signal, an on screen display (OSD) signal, a control signal, etc. processed by the processor 130. The display 110 can be implemented as a plasma display panel (PDP), a liquid crystal display (LCD), an organic light emitting diode (OLED), a cathode ray tube (CRT), a flexible display, etc. or can be implemented as a three-dimensional (3D) display. Alternatively, the display 110 can be configured as a touch screen used as an input device and an output device.

[0081] The tuner 140 can tune only a frequency of a channel to be received by the display device 100 by performing amplification, mixing, or resonance on a broadcast signal received via a wire or wirelessly, thereby selecting only a frequency of a channel to be received by the display device 100 among various radio wave components. The broadcast signal includes audio data, a video, and additional information (e.g., an electronic program guide (EPG)).

[0082] The tuner 140 can receive a broadcast signal in a frequency band corresponding to a channel number according to a user input (e.g., a control signal received from a remote control device, such as a channel number input, a channel up / down input, and a channel input in an EPG screen).

[0083] The tuner 140 can receive a broadcast signal from various sources such as terrestrial broadcasting, cable broadcasting, satellite broadcasting, Internet broadcasting, etc. The tuner 140 can receive a broadcast signal from a source such as analog broadcasting or digital broadcasting. Decoding (e.g., audio decoding, video decoding, or supplementary information decoding) is performed on a broadcast signal received via the tuner 140 to divide the broadcast signal into audio data, a video, and / or additional information. The audio data, the video, and / or the additional information can be stored in the storage 120 under the control of the processor 130.

[0084] The display apparatus 100 can include one or more tuners 140. The tuners 140 can be implemented as an integrated device including the display apparatus 100, a separate device (e.g., a set-top box including a tuner electrically connected to the display apparatus 100), or a tuner connected to the inputter / outputter 170.

[0085] The communicator 150 can connect the display apparatus 100 to an external apparatus (e.g., an audio apparatus) under the control of the processor 130. The processor 130 can transmit or receive content to or from an external apparatus connected thereto via the communicator 150, download an application from the external apparatus, or perform web browsing. The communicator 150 can include one of a wireless LAN 151, a Bluetooth module 152, and a wired Ethernet module 153 corresponding to the performance and structure of the display apparatus 100. Alternatively, the communicator 150 can include a combination of the wireless LAN 151, the Bluetooth module 152, and the wired Ethernet module 153.

[0086] The communicator 150 can receive a control signal from a remote control apparatus under the control of the processor 130. The control signal can be implemented as a Bluetooth type, an RF signal type, or a Wi-Fi type.

[0087] The communicator 150 can include a short-range communication module (e.g., an NFC module) or a Bluetooth low energy (BLE) module in addition to the Bluetooth module 152.

[0088] The detector 160 can sense a user's voice, video, or interaction, and includes a microphone 161, one or more cameras 162, and a light receiver 163.

[0089] The microphone 161 receives a user's uttered voice. The microphone 161 can convert the received voice into an electrical signal and output the electrical signal to the processor 130. The user's voice can include, for example, a voice corresponding to a menu or a function of the display apparatus 100.

[0090] The camera 162 can obtain an image frame, for example, a still image or a video. An image obtained by an image sensor can be processed by the processor 130 or a separate image processor.

[0091] An image frame processed by the camera 162 can be stored in the storage 120 or transmitted to the outside via the communicator 150. Two or more cameras 162 can be provided according to the configuration of the display apparatus 100.

[0092] The light receiver 163 receives a light signal (including a control signal) from an external remote control device. The light receiver 163 can receive a light signal corresponding to a user input (e.g., contact, press, contact gesture, voice, or motion) from the remote control device. A control signal can be extracted from the received light signal under the control of the processor 130. For example, the light receiver 163 can receive a control signal corresponding to a channel up / down button for channel switching from the remote control device.

[0093] The inputter / outputter 170 receives a video (e.g., moving picture), an audio signal (e.g., voice or music), and additional information (e.g., EPG) from the outside of the display device 100 under the control of the processor 130. The inputter / outputter 170 can include at least one of a high-definition multimedia interface (HDMI) port 171, a component jack 172, a PC port 173, or a USB port 174. The inputter / outputter 170 can include at least one combination of the HDMI port 171, the component jack 172, the PC port 173, and the USB port 174. An external image providing device can be connected through the HDMI port 171.

[0094] The video processor 180 processes video data received by the display device 100. The video processor 180 can perform various image processing, such as decoding, scaling, noise filtering, frame rate conversion, and resolution conversion, on the video data.

[0095] The graphic processor 181 generates a screen including various objects such as icons, images, and text using an operation unit and a renderer. The operation unit calculates attribute values such as coordinates, shapes, sizes, and colors of each object to be displayed according to a layout of the screen by using a user input sensed by the detector 160. The renderer generates a screen including various layouts of objects based on the attribute values calculated by the operation unit. The screen generated by the renderer is displayed on a display area of the display 110.

[0096] The audio processor 115 processes audio data. The audio processor 115 can perform various operations such as decoding, amplification, and noise filtering on the audio data. The audio processor 115 can include a plurality of audio processing modules for processing audio data corresponding to a plurality of pieces of content.

[0097] The audio outputter 126 outputs audio data included in a broadcast signal received via the tuner 140 under the control of the processor 130. The audio outputter 126 can output audio data (e.g., voice or sound) input via the communicator 150 or the inputter / outputter 170. The audio outputter 126 can output audio data stored in the storage 120 under the control of the processor 130. The audio outputter 126 can include at least one of a speaker 127, a headphone output terminal 128, or a Sony / Philips Digital Interface (S / PDIF) output terminal 129. The audio outputter 126 can include a combination of the speaker 127, the headphone output terminal 128, and the S / PDIF output terminal 129.

[0098] The power supply 190 supplies power from an external power source to internal components of the display device 100 under the control of the processor 130. Alternatively, the power supply 190 supplies power output from one or more batteries included in the display device 100 to the internal components under the control of the processor 130.

[0099] The sensing unit 191 can sense a state of the display device 100 or a state of an ambient environment of the display device 100, and transmit the sensed information to the processor 130.

[0100] The sensing unit 191 can include, but is not limited to, at least one of a geomagnetic sensor 192, an acceleration sensor 193, a temperature / humidity sensor 194, an infrared sensor 195, a gyro sensor 196, a location sensor (e.g., GPS) 197, a barometric sensor 198, a proximity sensor 199, or an RGB sensor (illuminance sensor) 201. The functions of each of these sensors can be intuitively inferred from their names by one of ordinary skill in the art, and thus a detailed description thereof will be omitted here.

[0101] In an embodiment, the sensing unit 191 can sense an external impact applied to the display device 100. For example, as the display device 100 is contacted by the mobile device 200, the sensing unit 191 of the display device 100 can output a sensed value.

[0102] The display device 100 including the display 110 can be electrically connected to a separate external device (e.g., a set-top box) including the tuner 140.

[0103] The display device 100 can be implemented as, but is not limited to, an analog TV, a digital TV, a 3D-TV, a smart TV, an LED TV, an OLED TV, a plasma TV, a monitor, etc.

[0104] The block diagram of the illustrated display apparatus 100 is a block diagram according to an embodiment. Components of the block diagram can be combined together or components of the block diagram can be omitted, or new components can be added to the block diagram, according to the specification of the actually implemented display apparatus 100. That is, two or more components can be combined into one component, or one component can be divided into two or more components, according to the need. The functions performed in each block are provided only to explain an embodiment, and the scope of the disclosure should not be construed as being limited to the specific operations or the apparatus for the specific operations.

[0105] Referring to Figure 16 , the mobile apparatus 200 according to an embodiment can include at least some of the components shown in Figure 14 and 15 .

[0106] As shown in Figure 16 , the mobile apparatus 200 according to an embodiment can include a display 210, a memory 220, a communicator 250 (e.g., a communication circuit or a communication interface), a sensing unit 291, and a processor 230. However, not all of the components shown in Figure 16 are essential components of the mobile apparatus 200. The mobile apparatus 200 can include more or less components than those shown in Figure 16 .

[0107] In an embodiment, the display 210 of the mobile apparatus 200 generates a driving signal by converting an image signal, a data signal, an OSD signal, a control signal, etc. processed by the processor 230.

[0108] The display 210 can display content (e.g., a moving image) input via the communicator 250 or the inputter / outputter. The display 210 can output an image stored in the memory 220 under the control of the processor 230.

[0109] In an embodiment, the memory 220 of the mobile apparatus 200 can store a program for processing and control by the processor 230, and store data input to or output from the mobile apparatus 200.

[0110] In an embodiment, generally, the processor 230 controls the overall operation of the mobile apparatus 200. For example, the processor 230 can execute a program stored in the memory 220 to control the overall operation of the sensing unit 291, the communicator 250, etc. The processor 230 can control the operation of the mobile apparatus 200 to perform the functions of the mobile apparatus 200 described above with reference to the embodiments described herein.

[0111] The processor 230 can include one or more processors. In this case, the one or more processors can be a general-purpose processor (e.g., a central processing unit (CPU), an application processor (AP), or a digital signal processor (DSP)) or a graphic special-purpose processor (e.g., a graphic processing unit (GPU) or a vision processing unit (VPU)). The one or more processors control input data to be processed according to a pre-defined operation rule stored in the memory 220.

[0112] In an embodiment, the processor 230 can receive a radio signal transmitted from the display apparatus 100 through the communicator 250.

[0113] In addition, the processor 230 can receive a request for transmitting identification information of the mobile apparatus 200 from the display apparatus 100 through the communicator 250. The processor 230 can control the communicator 250 to transmit the identification information of the mobile apparatus 200 to the display apparatus 100.

[0114] The processor 230 can control the communicator 250 to transmit a sensing value detected by the sensing unit 291 to the display apparatus 100.

[0115] The processor 230 can receive a request for transmitting status information about an operation being performed by the mobile apparatus 200 through the communicator 250. The processor 230 can generate the status information about the operation being performed. In addition, the processor 230 can control the communicator 250 to transmit the status information about the operation being performed to the display apparatus 100.

[0116] The memory 220 can include at least one of a flash memory type storage medium, a hard disk type storage medium, a multimedia card micro type storage medium, a card type memory (e.g., SD or XD memory), a RAM, a static RAM (SRAM), a ROM, an EEPROM, a PROM, a magnetic memory, a magnetic disk, and an optical disk.

[0117] In an embodiment, the communicator 250 can include one or more components that enable the mobile apparatus 200 to communicate with the outside (e.g., with one or more external apparatuses). For example, the communicator 250 can include a short-range communicator, a mobile communicator, and a broadcast receiver.

[0118] The short-range wireless communicator can include, but is not limited to, a Bluetooth communicator, a BLE communicator, a near field communication communicator, a WLAN (or Wi-Fi) communicator, a Zigbee communicator, an infrared data association (IrDA) communicator, a Wi-Fi direct (WFD) communicator, an ultra wide band (UWB) communicator, an Ant+ communicator, etc.

[0119] The mobile communicator transmits and receives radio signals to and from at least one of a base station, an external terminal, or a server in a mobile communication network. Here, the radio signals can include voice call signals, video call signals, or various types of data according to transmission and reception of text / multimedia messages.

[0120] The broadcast receiver receives a broadcast signal and / or information related to a broadcast through a broadcasting channel from the outside. The broadcasting channel can include a satellite channel and a terrestrial channel. In an embodiment, the broadcast receiver can be omitted.

[0121] The sensing unit 291 can sense a state of the mobile device 200 or a state of an ambient environment of the mobile device 200, and transmit the sensed information to the processor 230.

[0122] The sensing unit 291 can include, but is not limited to, at least one of a geomagnetic sensor, an acceleration sensor, a temperature / humidity sensor, an infrared sensor, a gyro sensor, a location sensor (e.g., GPS), an illuminance sensor or an optical sensor, a proximity sensor, or an RGB sensor. The function of each of these sensors can be intuitively inferred from its name by one of ordinary skill in the art, and thus a detailed description thereof will be omitted here.

[0123] In an embodiment, the sensing unit 191 can sense an external impact applied to the mobile device 200. In an embodiment, an acceleration sensor included in the mobile device 200 can sense an impact caused when the display device 100 is contacted by the mobile device 200. In addition, the acceleration sensor included in the mobile device 200 can sense a moving speed and acceleration of the mobile device 200.

[0124] The above description with reference to Figure 14 and Figure 15 The description of the display 110, the memory 120, the communicator 150, the sensing unit 191, and the processor 130 of the display device 100 can be applied to the display 210, the memory 220, the communicator 250, the sensing unit 291, and the processor 230 of the mobile device 200.

[0125] Figure 2 is a flowchart of an operation method of a display device according to an embodiment.

[0126] In Figure 2 Operation S201 of the display device 100 according to an embodiment can detect at least one sensing value corresponding to at least one sensor.

[0127] For example, when a region on the display device 100 is contacted by the mobile device 200, the display device 100 can detect a sensing value sensed by at least one sensor included in the sensing unit 191 mounted thereon.

[0128] In an embodiment, the display device 100 can include a sensing unit 191, wherein the sensing unit 191 includes at least one sensor. The at least one sensor can be a sensor capable of sensing a physical impact of an outside (e.g., a bezel) of the display device 100. The at least one sensor can include an acceleration sensor 193. For example, the at least one sensor can include a 6-axis sensor and / or a 9-axis sensor, but is not limited thereto.

[0129] In an embodiment, the at least one sensor can be mounted in a bezel region of the display device 100. For example, the at least one sensor can be disposed at a position on all bezel regions of the display device 100, at which an external impact applied to the display device 100 is more easily detected. For example, when a plurality of sensors are mounted, the plurality of sensors can be disposed such that a distance between each sensor can be maximized as much as possible.

[0130] For example, four sensors can be disposed close to a corner region of a bezel region of the display device 100 (see Figure 11A ). The number and position of the sensors mounted on the display device 100 are not limited thereto.

[0131] In operation S202 of Figure 2 , the display device 100 according to an embodiment can identify a contact region contacted by the mobile device 200 based on at least one sensing value.

[0132] In an embodiment, the display device 100 can identify a region to which a physical impact is applied, i.e., a contact region contacted by the mobile device 200, based on a position of a sensor that detects a relatively large sensing value.

[0133] For example, when a sensing value is sensed by, for example, the first sensor 1101 (see Figure 11A ) due to a physical impact, the display device 100 can identify a region close to a position of the first sensor 1101 as a contact region contacted by the mobile device 200.

[0134] In operation S203 of Figure 2 , the display device 100 according to an embodiment can receive state information about an operation being performed by the mobile device 200 from the mobile device 200.

[0135] In an embodiment, the mobile device 200 can transmit state information about an operation being performed by the mobile device 200 to the display device 100 in response to a request signal from the display device 100.

[0136] In an embodiment, the state information about the operation being performed by the mobile device 200 can include information about an application being executed in the mobile device 200. Alternatively, the state information can include information about a screen being displayed on the mobile device 200.

[0137] For example, the information about the application can include, but is not limited to, at least one of a type of the application, download information of the application, or content information related to execution of the application.

[0138] In Figure 2 Operation S204, the display device 100 according to an embodiment can perform a preset function corresponding to the identified contact area based on the received state information.

[0139] In an embodiment, the display device 100 can perform a preset function corresponding to the identified contact area based on the information about the screen being displayed on the mobile device 200. For example, when the preset function corresponding to the identified contact area is a screen mirroring function, the display device 100 can display an application execution screen being displayed on the mobile device 200 on the display 110 of the display device 100.

[0140] Figure 1 and Figure 2 are examples only, and embodiments are not limited thereto.

[0141] Figure 3 is a diagram schematically showing an example of performing a preset function corresponding to a first contact area according to an embodiment.

[0142] Figure 3 shows an example in which a left bezel area of the display device 100 is contacted by the mobile device 200.

[0143] In an embodiment, when contact of the left bezel area is sensed, the display device 100 can be set to perform a function of running an application identical to an application being executed in the mobile device 200.

[0144] As Figure 3 shown in, when a game application (execution screen 302) is executed by the mobile device 200 and contact of the left bezel area of the display device 100 by the mobile device 200 is sensed, the display device 100 can execute the same game application being executed by the mobile device 200.

[0145] When the display apparatus 100 executes the game application, the display apparatus 100 can display the application screen 303 (e.g., mobile device application content related to the mobile device application) on the display 110 instead of the previously displayed screen 301. When the game application is executed, the mobile device 200 can display the operation screen 304 for game control. Accordingly, the display apparatus 100 can execute the game application while using the display 110 of the display apparatus 100 and the display of the mobile device 200 in a multi-perspective manner, e.g., the display 110 and the display of the mobile device 200 can form a multi-perspective.

[0146] In an embodiment, the display apparatus 100 can execute an application that is pre-installed in the display apparatus 100 and is the same as the application being executed in the mobile device 200 based on the state information including information about the application being executed in the mobile device 200. In an embodiment, the display apparatus 100 can execute the same application by requesting an external server to provide the same application and receiving and installing the same application based on information about the application being executed in the mobile device 200.

[0147] Figure 4 is a diagram schematically illustrating an example of executing a function corresponding to a second contact area according to an embodiment.

[0148] Figure 4 An example in which the upper bezel area of the display apparatus 100 is contacted by the mobile device 200 is illustrated.

[0149] In an embodiment, when contact of the upper bezel area is sensed, the display apparatus 100 can be set to execute a multi-perspective function of displaying a screen being displayed on the mobile device 200 in a multi-perspective manner.

[0150] The multi-perspective function is a function of displaying an execution screen being displayed on one display together with an execution screen displayed on another display on an area of the other display in a multi-perspective manner.

[0151] As Figure 4 As illustrated in FIG. 4B, when contact of the upper bezel area of the display apparatus 100 by the mobile device 200 is sensed, the display apparatus 100 can display an execution screen 402 being displayed on the mobile device 200, e.g., mobile device application content related to the mobile device application (execution screen 403), on the display 110. In this case, the display apparatus 100 can provide a multi-perspective by displaying an execution screen 401 being displayed on the display apparatus 100 on an area 404 of the display 110.

[0152] Additionally, when running a game application, the mobile device 200 can display a control screen 405 for game operations. Therefore, the mobile device 200 can run the game application by using the display 110 of the display device 100 and the display of the mobile device 200 in a multi-screen manner.

[0153] Figure 5 This is a schematic diagram illustrating an example of performing a function corresponding to the third contact area according to an embodiment.

[0154] Figure 5 An example is shown where the right frame area of ​​the display device 100 is touched by the moving device 200.

[0155] In one embodiment, when a touch is sensed in the right frame area, the display device 100 can be configured to perform a screen mirroring function for the screen being displayed on the mobile device 200.

[0156] Screen mirroring is a feature that displays the execution screen, which is being shown on one monitor, on another monitor.

[0157] like Figure 5 As shown, when the mobile device 200 senses contact with the right frame area of ​​the display device 100, the display device 100 can display the game application execution screen 502 (execution screen 503) that is being displayed on the mobile device 200 on the display 110 of the display device 100. Therefore, the screen 501 displayed on the display device 100 is no longer displayed on the display 110.

[0158] Figure 6 This is a schematic diagram illustrating an example of performing a function corresponding to the third contact area according to an embodiment. Figure 7 This is a schematic diagram illustrating an example of performing a function corresponding to the third contact area according to an embodiment.

[0159] In an embodiment, when a touch of the mobile device 200 is sensed, the display device 100 may be configured to perform a screen mirroring function on the screen being displayed on the mobile device 200, and to display a mirrored screen on the display 110 of the display device 100 in an area close to the touch area touched by the mobile device 200.

[0160] Figure 6 An example is shown where the upper region of the right frame area of ​​the display device 100 is touched by the moving device 200.

[0161] like Figure 6As shown, when the mobile device 200 is sensed to contact the upper region of the right frame region of the display device 100, the display device 100 may display the execution screen 602 that is being displayed on the mobile device 200 on the area of ​​its display 110 that is close to the contact area that is contacted by the mobile device 200.

[0162] For example, the display device 100 can continuously display the screen 601 displayed on the display device 100 while simultaneously displaying the execution screen 603 displayed on the mobile device 200 in picture-in-picture (PIP) format.

[0163] Figure 7 An example is shown where the lower area of ​​the right frame region of the display device 100 is touched by the moving device 200.

[0164] like Figure 7 As shown, when the contact between the mobile device 200 and the lower region of the right frame region of the display device 100 is sensed, the display device 100 may display the execution screen 702 that is being displayed on the mobile device 200 on the area of ​​its display 110 that is close to the contact area touched by the mobile device 200.

[0165] For example, the display device 100 can continuously display the screen 701 displayed on the display device 100 while simultaneously displaying the execution screen 703 displayed on the mobile device 200 in PIP format.

[0166] Figures 3 to 7 This is merely an example, and the implementation is not limited thereto.

[0167] Figure 8 This is a flowchart illustrating an example of a function that performs a function corresponding to the number of contacts according to an embodiment. Figure 9A This is a diagram illustrating an example of a function that corresponds to the number of times a contact is performed according to an embodiment. Figure 9B This is a diagram illustrating an example of a function that corresponds to the number of times a contact is performed according to an embodiment.

[0168] exist Figure 8 In operation S801, according to the embodiment, the display device 100 can identify the number of times the display device 100 is touched by the moving device 200 based on at least one sensing value.

[0169] According to an embodiment, the display device 100 can identify the number of times the display device 100 is touched based on at least one sensing value sensed by at least one sensor of a sensing unit 191 mounted on the display device 100.

[0170] In an embodiment, the display device 100 may be pre-configured to perform a predetermined function corresponding to the number of times the display device 100 is touched by the mobile device 200, for example, a preset function.

[0171] In operation S802 according to an embodiment, the display device 100 can perform a preset function corresponding to the number of times the display device 100 is contacted. Figure 8

[0172] Referring to Figure 9A and Figure 9B , for example, the display device 100 can be set to perform a screen mirroring function when the number of times the display device 100 is contacted is one, and to perform a multi-picture function when the number of times the display device 100 is contacted is two or more.

[0173] Figure 9A An example in which the display device 100 is contacted once by the mobile device 200 is shown. When it is determined that the display device 100 is contacted once by the mobile device 200, the display device 100 according to an embodiment can perform a screen mirroring function. Accordingly, the display device 100 can display an execution screen 902 (execution screen 903) being displayed on the mobile device 200 instead of the display screen 901 on the display 110 of the display device 100.

[0174] Figure 9B An example in which the display device 100 is contacted twice by the mobile device 200 is shown. In an embodiment, when it is determined that the display device 100 is contacted twice by the mobile device 200, the display device 100 can perform a multi-picture function. Accordingly, the display device 100 can display an execution screen 906 (execution screen 907) being displayed on the mobile device 200 on the display 110 of the display device 100, and display a screen 905 displayed on the display device 100 on a region 908 on the display 110, thereby providing a multi-picture.

[0175] In an embodiment, the display device 100 can be pre-set to perform a predetermined function corresponding to the number of times the display device 100 is contacted by the mobile device 200 and a contact region.

[0176] The display device 100 can identify a contact region and the number of times the display device 100 is contacted based on at least one sensing value, and perform a preset function corresponding to the contact region and the number of times the display device 100 is contacted. For example, referring to Figure 9A When the number of times the display device 100 is contacted is one and a right bezel region of the display device 100 is a contact region, the display device 100 can be set to perform a screen mirroring function. The display device 100 can identify that the contact region contacted by the mobile device 200 is the right bezel region, and that the number of times the display device 100 is contacted is one, and perform a preset screen mirroring function.

[0177] Figures 8 to 9B This is merely an example, and embodiments are not limited thereto. ​

[0178] Figure 10 is a flowchart illustrating an example of determining a contact area based on a sensed value according to an embodiment.

[0179] In operation S1001 of FIG. 1, Figure 10 In operation S1001 of FIG. 1, Figure 10 Operation S1001 of FIG. 1 can correspond to operation S201 of FIG. 2. Figure 2 Operation S1001 of FIG. 1 can correspond to operation S201 of FIG. 2.

[0180] In an embodiment, when the display device 100 (e.g., a bezel of the display device 100) is contacted by the mobile device 200, the display device 100 can obtain a sensed value by sensing an impact on the display device 100 by at least one sensor (e.g., the acceleration sensor 193).

[0181] In operation S1002 of FIG. 1, Figure 10 In operation S1002 of FIG. 1,

[0182] In an embodiment, when the degree of the physical influence on the display device 100 is greater than or equal to a predetermined threshold value, the display device 100 can determine that the contact of the mobile device 200 is intentional.

[0183] In operation S1003, because it is determined that the detected at least one sensed value is greater than or equal to the preset threshold value, the display device 100 according to an embodiment can determine that the display device 100 is contacted by the mobile device 200. In this case, the display device 100 can transmit a pairing request signal (e.g., a BLE pairing signal). In addition, the display device 100 can receive a response signal from the mobile device 200.

[0184] For example, when it is determined that the display device 100 is contacted by the mobile device 200, the display device 100 can be paired with the mobile device 200 through a Bluetooth communication connection. Alternatively, the display device 100 can be paired with the mobile device 200 through a WFD communication connection, for example, by a WFD communicator, but embodiments are not limited thereto.

[0185] In an embodiment, the mobile device 200 can receive the pairing request signal from the display device 100, and transmit the response signal in response to the pairing request signal. Alternatively, the mobile device 200 can be changed to a pairing mode (e.g., a BLE pairing mode) with the display device 100 and paired with the display device 100.

[0186] In an embodiment, when the display apparatus 100 is contacted by the mobile apparatus 200, the mobile apparatus 200 can sense an impact to the mobile apparatus 200 by using the sensing unit 291 included in the mobile apparatus 200. The acceleration sensor included in the mobile apparatus 200 can sense an impact caused when the display apparatus 100 is contacted by the mobile apparatus 200. In addition, the acceleration sensor included in the mobile apparatus 200 can detect a sensing value including a moving speed or acceleration of the mobile apparatus 200, for example, a second sensing value.

[0187] In an embodiment, it is determined that the display apparatus 100 is contacted by the mobile apparatus 200 when the second sensing value is greater than or equal to a preset threshold value.

[0188] When it is determined that the display apparatus 100 is contacted by the mobile apparatus 200, the mobile apparatus 200 can enter a pairing mode. In addition, the display apparatus 100 can receive a pairing request signal (for example, a BLE pairing signal) from the mobile apparatus 200 and transmit a response signal to the mobile apparatus 200.

[0189] The mobile apparatus 200 can be paired with the display apparatus 100 through a communication connection (for example, a Bluetooth communication connection, a Wi-Fi direct communication connection, etc.), but embodiments are not limited thereto.

[0190] In an embodiment, when the detected sensing value is less than a preset threshold value, the display apparatus 100 can wait for a determination as to whether another sensing value is detected without recognizing a contact area. When the detected sensing value is less than a preset threshold value, the display apparatus 100 can determine that the contact by the mobile apparatus 200 is not intentional.

[0191] In an embodiment, the display apparatus 100 can receive a second sensing value sensed by the sensing unit 291 included in the mobile apparatus 200 from the mobile apparatus 200. The display apparatus 100 can determine whether the second sensing value is greater than or equal to a preset threshold value.

[0192] In an embodiment, when it is determined that the second sensing value is greater than or equal to a preset threshold value, the display apparatus 100 can determine that the display apparatus 100 is contacted by the mobile apparatus 200. When it is determined that the second sensing value is less than a preset threshold value, the display apparatus 100 can determine that the contact of the mobile apparatus 200 to the display apparatus 100 is not intentional.

[0193] In an embodiment, the display apparatus 100 can determine whether the display apparatus 100 is contacted by the mobile apparatus 200 by comparing a result of at least one sensing value detected by the sensing unit 191 with a result of a second sensing value received from the mobile apparatus 200. When it is determined that a difference between the at least one sensing value detected by the sensing unit 191 and the second sensing value received from the mobile apparatus 200 is within a preset range, the display apparatus 100 can determine that the display apparatus 100 is contacted by the mobile apparatus 200.

[0194] In this configuration, the display device 100 may send a pairing request signal (e.g., a BLE pairing signal). Additionally, the display device 100 may receive a response signal from the mobile device 200. The display device 100 may pair with the mobile device 200 via a communication connection (e.g., a Bluetooth communication connection), but the embodiments are not limited thereto.

[0195] exist Figure 10 In operation S1004, the display device 100 according to the embodiment can perform a comparison between at least one sensing value corresponding to at least one sensor and sensing values ​​corresponding to other sensors included in the display device 100.

[0196] In other words, when a sensed value is detected by a plurality of sensors included in the display device 100, during operation S1004, the display device 100 according to the embodiment can compare the sensed values ​​corresponding to the plurality of sensors with each other.

[0197] exist Figure 10 In operation S1005, according to the embodiment, the display device 100 can identify one or more sensors whose positions are close to the point on the display device 100 that is touched by the moving device 200 based on the comparison result.

[0198] According to an embodiment, the display device 100 can determine that the sensor that detects the maximum value among a plurality of sensed values ​​is closest to the point on the display device 100 that is touched by the moving device 200.

[0199] exist Figure 10 In operation S1006, the display device 100 according to the embodiment can identify the contact area based on one or more identified sensors.

[0200] For example, refer to Figure 11A When the sensor values ​​obtained from multiple sensors are from the sensor values ​​obtained from multiple sensors, Figure 11A When the sensor value obtained by the first sensor 1101 is detected as the maximum value, based on the position of the first sensor 1101, region 1111 or region 1113 in the border area of ​​the display device 100 can be identified as the contact area.

[0201] The display device 100 according to the embodiment can perform a preset function corresponding to the identified contact area. For example, when Figure 11A When region 1111 or region 1113 is identified as a contact region, a preset function corresponding to region 1111 or region 1113 can be executed.

[0202] Figure 11A This is a diagram illustrating an example of at least one sensor arranged on a display device according to an embodiment and an example of a contact area.

[0203] Figure 11A An example in which the first sensor 1101, the second sensor 1102, the third sensor 1103, and the fourth sensor 1104 are disposed close to four corner regions of the display apparatus 100 is illustrated.

[0204] In an embodiment, the display apparatus 100 can identify at least one sensor having a relatively large value among the sensed values detected by the first sensor 1101 through the fourth sensor 1104, and determine a region close to a position of the identified at least one sensor.

[0205] For example, when the sensed values detected by the first sensor 1101 and the third sensor 1103 are the maximum values, the display apparatus 100 can determine the regions 1113 and 1115 close to the positions of the first sensor 1101 and the third sensor 1103 as the contact regions. The display apparatus 100 according to an embodiment can perform a preset function corresponding to the regions 1113 and 1115.

[0206] For example, when the sensed values detected by the first sensor 1101 and the second sensor 1102 are the maximum values, the display apparatus 100 can determine the regions 1111 and 1112 close to the positions of the first sensor 1101 and the second sensor 1102 as the contact regions. The display apparatus 100 according to an embodiment can perform a preset function corresponding to the regions 1111 and 1112.

[0207] Referring to Figure 11A For example, the contact regions can be disposed as the regions 1111 through 1118 on the bezel of the display apparatus 100.

[0208] In an embodiment, different specific functions can be set corresponding to the regions 1111 through 1118. Alternatively, the same function can be set corresponding to one or more contact regions, but the embodiment is not limited thereto.

[0209] Figure 11B is a view illustrating an example in which at least one sensor according to an embodiment is disposed on a display apparatus.

[0210] Figure 11B An example in which a fifth sensor 1105 and a sixth sensor 1106 are disposed on the display apparatus 100 is illustrated.

[0211] As Figure 11B illustrated in Figure 11AThe areas 1111, 1113, 1115, and 1117 of the display 110 can be contact areas corresponding to the fifth sensor 1105, and can be set to correspond to one specific function. Alternatively, Figure 11A The areas 1112, 1114, 1116, and 1118 of the display 110 can be contact areas corresponding to the sixth sensor 1106, and can be set to correspond to one specific function.

[0212] Figure 11A and 11B Embodiments are illustrated, and thus the present disclosure is not limited thereto. More or less sensors can be arranged on the display device 100. In addition, more or less contact areas can be provided on the display device 100.

[0213] Figure 12 is a flowchart illustrating an example of pre-setting a function corresponding to a contact area by a display device according to an embodiment.

[0214] In Figure 12 Operation S1201, the display device 100 according to an embodiment can pre-set a function corresponding to at least one contact area on the display device 100 based on a user input.

[0215] The display device 100 according to an embodiment can provide a user interface for setting a specific function related to the mobile device 200 to be performed by the display device 100 by contacting the display device 100 by the mobile device 200.

[0216] For example, the display device 100 can present a plurality of contact areas (e.g., areas 1111 to 1118 of the display 110) that can be set, and provide a user interface for receiving a user input to select at least one area on the display 110. Figure 11A

[0217] Alternatively, for example, the display device 100 can present an example of a list of functions that can be selected to correspond to a selected contact area, and set a specific function to correspond to the selected area by receiving a user input for selecting the specific function from the list.

[0218] Alternatively, the display device 100 according to an embodiment can be pre-set to perform a specific function corresponding to a specific contact area during manufacturing of the display device 100. The display device 100 can re-set or change a contact area of a default and / or specific function pre-set to correspond to a contact area based on a user input.

[0219] In Figure 12 ​According to an embodiment, the display device 100 can set a function to be executed according to a number of times a specific area of the display device 100 is contacted, based on a user input.

[0220] In an embodiment, the display device 100 can set a specific function to be executed according to a specific number of times the display device 100 is contacted.

[0221] For example, the display device 100 can provide an example of a list of contactable numbers of times, and provide a user interface for receiving a user input to select a specific number of times to the display 110.

[0222] In an embodiment, the display device 100 can set a specific function to be executed when a specific area of the display device 100 is contacted a specific number of times is sensed.

[0223] For example, the display device 100 can present an example of a list of settable numbers of times and contact areas, and provide a user interface for receiving a user input to select a specific contact area and a specific number of times to the display 110.

[0224] Provided Figure 12 Embodiments are described to illustrate the embodiments, and thus the embodiments are not limited thereto.

[0225] Figure 13 is a flowchart of an operation method of a display device and a mobile device according to an embodiment.

[0226] In Figure 13 According to an embodiment, the display device 100 can detect at least one sensing value corresponding to at least one sensor, in operation S1301. Figure 13 Operation S1301 of Figure 2 may correspond to operation S201.

[0227] In an embodiment, when the display device 100 is contacted by the mobile device 200, the display device 100 can detect a sensing value due to a physical impact through the sensing unit 191.

[0228] In operation S1302, the display device 100 can request identification information of the mobile device 200. According to an embodiment, the display device 100 can transmit a request signal requesting identification information of the mobile device 200 when the sensing value is detected.

[0229] In operation S1303, the mobile device 200 can transmit its identification information. The mobile device 200 can transmit the identification information to the display device 100 in response to the request signal.

[0230] The display apparatus 100 can identify whether the mobile apparatus 200 is an apparatus that was previously registered to the display apparatus 100, at operation S1304. The display apparatus 100 can identify whether the mobile apparatus 200 is an apparatus that was previously registered, based on the received identification information of the mobile apparatus 200.

[0231] The display apparatus 100 can identify a contact area contacted by the mobile apparatus 200, based on the at least one sensed value detected in operation S1301, at operation S1305. Figure 13 Operation S1305 of the display apparatus 100 can correspond to Figure 2 Operation S202 of the mobile apparatus 200.

[0232] The display apparatus 100 can request state information about an operation being performed by the mobile apparatus 200, at operation S1306.

[0233] The display apparatus 100 according to an embodiment can request state information about an operation that the mobile apparatus 200 is currently performing, to perform a preset function corresponding to a contact area with respect to the mobile apparatus 200.

[0234] The mobile apparatus 200 can generate state information about an operation being performed, at operation S1307. For example, the state information can include information about an application being performed. In addition, the state information can include information about a screen being displayed.

[0235] For example, the information about the application can include, but is not limited to, at least one of a type of the application, download information of the application, or content information related to execution of the application.

[0236] The mobile apparatus 200 can transmit the state information, at operation S1308. In an embodiment, the mobile apparatus 200 can transmit the state information of the mobile apparatus 200 to the display apparatus 100 in response to the request signal.

[0237] The display apparatus 100 can receive the state information about an operation being performed by the mobile apparatus 200, at operation S1309. Figure 13 Operation S1309 of the display apparatus 100 can correspond to Figure 2 Operation S203 of the mobile apparatus 200.

[0238] The display apparatus 100 can perform a preset function corresponding to the contact area identified at operation S1305, based on the state information of the mobile apparatus 200, at operation S1310. Figure 13 Operation S1310 of the display apparatus 100 can correspond to Figure 2 Operation S204 of the mobile apparatus 200.

[0239] It is provided Figure 13 to describe the embodiments, and thus the embodiments are not limited thereto.

[0240] The above-described embodiments can be implemented as a computer-executable program and implemented in a computer for executing the program by using a computer-readable recording medium. The data structure used in the above-described embodiments can be recorded on the computer-readable recording medium by various means. In addition, the above-described embodiments can also be implemented in the form of a recording medium storing instructions executable by a computer, such as a program module executable by a computer. For example, a method implemented by a software module or an algorithm can be stored in a computer-readable medium in the form of a computer-readable and executable code or program instructions.

[0241] The computer-readable medium can be any recording medium accessible to a computer, and can include a volatile storage medium, a non-volatile storage medium, a removable storage medium, and a non-removable storage medium. The computer-readable medium can include, but is not limited to, a magnetic storage medium (such as a ROM, a floppy disk, a hard disk, etc.), and an optical storage medium (such as a CD-ROM, a DVD, etc.). Alternatively, the computer-readable medium can include a computer storage medium and a communication medium.

[0242] A plurality of computer-readable recording media can be distributed on a network-connected computer system, and data (e.g., program instructions and codes) stored in the distributed computer recording medium can be executed by at least one computer.

[0243] The embodiments described herein are merely non-limiting examples. For the sake of simplicity of the description, the description of existing electronic configurations, control systems, software, and other functional aspects of the system can be omitted.

[0244] The above-described embodiments are intended to provide examples, and those of ordinary skill in the art will understand that various modifications can be made without changing the technical spirit or essential features of the present disclosure. Therefore, it should be understood that the above-described embodiments are merely examples in all aspects and are not limiting. For example, each component described as a single type can be implemented in a distributed manner, and similarly, a component described as distributed can be implemented in a combined form.

[0245] All examples or example terms (e.g., "or") set forth herein are for the purpose of illustrating embodiments, and are not to be construed as limiting.

[0246] In addition, unless expressions such as "essential" and "important" are specified, the components described herein can not be indispensable components for implementing the embodiments.

[0247] Although the embodiments have been particularly shown and described with reference to the accompanying drawings, the embodiments are provided for the purpose of illustration, and those of ordinary skill in the art will understand that various modifications and other embodiments equivalent to the present disclosure can be made. Therefore, the true technical scope of the present disclosure is defined by the technical spirit of the appended claims.

[0248] The terms such as "unit", "module" and the like, when used herein, refer to a unit for processing at least one function or operation, which can be implemented by hardware, software, or a combination of hardware and software.

[0249] The "unit" and "module" can be stored in an addressable storage medium and implemented by a program executable by a processor.

[0250] For example, the "unit" and "module" can be implemented by components such as software components, object-oriented software components, class components, and task components, processes, functions, attributes, procedures, sub-routines, program code segments, drivers, firmware, microcode, circuits, data, database, data structures, tables, arrays, and parameters.

[0251] As used herein, the description "A can include one of a1, a2, and a3" should be broadly understood to mean that an example element that can be included in element A is a1, a2, or a3.

[0252] It should not be understood from the above description that the elements that can constitute element A are limited to a1, a2, or a3. Therefore, it should not be understood that the elements that constitute element A exclude other elements not mentioned herein, i.e., the above description should not be exclusively interpreted.

[0253] The above description can be understood to mean that A can include a1, a2, or a3. The above description should not be understood that the elements that constitute element A must be selectively determined within a certain set. For example, the above description should not be understood in a restrictive manner that a1, a2, or a3 constitutes component A selected from a set consisting of a1, a2, and a3.

Claims

1. A method for operating a display device, the method comprising: At least one sensing value corresponding to the at least one sensor is detected by at least one sensor; Based on the at least one sensing value, an external area touched by a mobile device is identified among a plurality of external areas of the display device, wherein each of the plurality of external areas is mapped to a corresponding function among a plurality of functions, and the plurality of external areas includes at least a first external area mapped to a first function among the plurality of functions and a second external area mapped to a second function among the plurality of functions. The display device performs one of the multiple functions based on the identified external area. The steps for performing the functions among the plurality of functions include: Based on the identification that the external region is a first external region, the display device performs a first function of an application that runs on the mobile device when the mobile device touches the display device, and Based on the fact that the identified external region is a second external region, the display device performs a second function of displaying a screen on the mobile device when the mobile device touches the display device.

2. The operating method according to claim 1 further includes: Based on the at least one sensed value, the number of times the display device is touched by the mobile device is identified. The preset function is executed in a plurality of preset functions corresponding to the number of times the display device is touched, wherein the plurality of preset functions are predetermined in advance in a manner corresponding to the number of times the display device is touched by the mobile device.

3. The operating method according to claim 1, wherein, The second function includes at least one of the following functions: The function of displaying the screen on the mobile device when the mobile device touches the display device in a multi-screen manner; and A function to mirror the screen displayed on the mobile device when the mobile device touches the display device.

4. The operating method according to claim 1 further includes: Based on determining that the at least one sensed value is equal to or greater than a threshold, it is determined that the display device is contacted by the mobile device.

5. The operating method according to claim 1 further includes: The at least one sensing value is compared with a sensing value received from the mobile device to determine whether the display device is being touched by the mobile device.

6. The operating method according to claim 1, wherein, The at least one sensor is at least one of a plurality of sensors disposed on the display device and configured to provide a plurality of sensing values, and The steps for identifying the external region include: The plurality of sensed values ​​corresponding to the plurality of sensors are compared with each other; Based on the comparison, the at least one sensor is identified as the sensor among the plurality of sensors whose position is closest to the point on the display device that is touched by the moving device; and The external area is identified based on the position of the at least one sensor on the display device.

7. The operating method according to any one of claims 1 to 6, further comprising: Request the identification information of the mobile device; Receive the identification information from the mobile device; and The identification information is used to determine whether the mobile device has been previously registered to the display device.

8. The operating method according to claim 1, further comprising: Based on user input, the functions corresponding to the external area are pre-set.

9. The operating method according to claim 1, further comprising: Based on user input, several preset functions are pre-configured corresponding to the number of times the external area is touched. The aforementioned function is one of the multiple preset functions.

10. A display device, comprising: Communication circuits; The sensing unit includes at least one sensor; Memory, which stores one or more instructions; as well as The processor is configured to execute one or more instructions to perform the following operations: At least one sensing value corresponding to the at least one sensor is detected by the at least one sensor. Based on the at least one sensed value, an external area touched by a moving device is identified among a plurality of external areas of the display device, wherein each of the plurality of external areas is mapped to a corresponding function among a plurality of functions, and the plurality of external areas includes at least a first external area mapped to a first function among the plurality of functions and a second external area mapped to a second function among the plurality of functions. The function among the multiple functions is executed based on the identified external region. The steps for performing the functions among the plurality of functions include: Based on the identification that the external region is a first external region, the display device performs a first function of an application that runs on the mobile device when the mobile device touches the display device, and Based on the fact that the identified external region is a second external region, the display device performs a second function of displaying a screen on the mobile device when the mobile device touches the display device.

11. The display device according to claim 10, wherein, The processor is also configured to execute one or more instructions to perform the following operations: Based on the at least one sensing value, identify the number of times the display device is touched by the mobile device, and The preset function is executed in a plurality of preset functions corresponding to the number of times the display device is touched, wherein the plurality of preset functions are predetermined in advance in a manner corresponding to the number of times the display device is touched by the mobile device.

12. The display device according to claim 10, wherein, The second function includes at least one of the following functions: The function of displaying the screen on the mobile device when the mobile device touches the display device in a multi-screen manner; or A function to mirror the screen displayed on the mobile device when the mobile device touches the display device.

13. The display device according to claim 10, wherein, The processor is also configured to execute one or more instructions to determine that the display device is contacted by the mobile device based on determining that the at least one sensed value is equal to or greater than a threshold.

14. The display device according to claim 10, wherein, The processor is also configured to execute one or more instructions to compare the at least one sensed value with a sensed value received from the mobile device to determine whether the display device is being touched by the mobile device.

15. The display device according to claim 10, wherein, The at least one sensor is at least one of a plurality of sensors that provide multiple sensing values, and The processor is also configured to execute one or more instructions to perform the following operations: The multiple sensed values ​​corresponding to the multiple sensors are compared with each other. Based on the comparison, the at least one sensor is identified as the sensor among the plurality of sensors whose position is closest to the point on the display device that is touched by the moving device, and The external region is identified based on the location of the at least one sensor.

Images