Wireless device and wireless display system
By judging the OSD event in the control unit of the wireless device and adjusting the image capture time point, the problem of video and OSD image transmission in the screen sharing service is solved, and the user's audio-visual experience is improved.
Patent Information
- Application Number
- CN202280098863.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2022-07-15
- Publication Date
- 2025-03-18
AI Technical Summary
When providing screen sharing services, the prior art cannot determine whether video and OSD images need to be sent, resulting in the receiving side device being unable to receive complete video information, which causes inconvenience to the user.
Whether an OSD event occurs in the control unit of the wireless device is determined, and if it occurs, the OSD image is displayed on the display unit and transmitted to the receiving device, and video and OSD image signals are transmitted at the same time.
When providing screen sharing services, adjust the image capture time point according to the occurrence of OSD events, ensure that the user on the receiving side obtains complete audio-visual information, and improves the user's audio-visual experience.
Smart Images

Figure CN119654871A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a wireless device, and more particularly to a wireless device providing a screen sharing service. Background Art
[0002] In recent years, with the development of information and communication technology, various wireless communication technologies have been developed. Among them, wireless local area network (WLAN) is a technology based on radio frequency technology that can access the Internet wirelessly in homes, businesses or specific service provision areas using portable terminals such as personal digital assistants (PDAs), laptops, and portable multimedia players (PMPs).
[0003] As a direct communication technology that enables devices to easily connect to each other without the wireless access point (AP) that is basically required in the existing wireless LAN system, the introduction of Wireless High Fidelity Direct (Wi-Fi Direct) or Wi-Fi P2P (peer-to-peer) is being discussed. According to the Wireless High Fidelity Direct standard technology, multiple devices can be connected without complicated setting procedures, and it can support the action of sending and receiving data to each other at the communication speed of ordinary wireless LAN systems to provide users with a variety of services.
[0004] In recent years, various Wi-Fi devices have been used, among which Wi-Fi devices can be used without an AP.
[0005] The number of devices supporting Wi-Fi Direct for communication between devices is gradually increasing. The Wi-Fi Alliance (WFA) is discussing the introduction of a platform that supports various services (e.g., Send, Play, Display, Print, etc.) that utilize Wi-Fi Direct links. This technology may be referred to as Wireless Fidelity Direct Service (Wi-Fi Service, WFDS).
[0006] Among the display services in WFDS, there is a service that can share screens between devices. From the perspective that wireless devices display the same image by transferring images, the screen sharing service is also called screen mirroring technology.
[0007] Currently, the sending device transmits video to the receiving device. If the sending device does not output the video, such as the output of the audio channel, the output of the no signal channel, or the output of the screen lock setting channel, the receiving device may not be able to receive the video.
[0008] In this case, since the receiving-side device outputs the previous image stop state or a black screen, it may cause inconvenience to the user's viewing and hearing.
[0009] In addition, when the sending device turns on the subtitle setting, the receiving device only receives the video without subtitles, resulting in the problem that the user of the receiving device cannot see the subtitles. Summary of the invention
[0010] Problem to be solved
[0011] The purpose of the present invention is to determine whether the sending device needs to transmit only video to the receiving device or transmit the video and OSD (On Screen Display) together when providing screen sharing service, thereby providing users with a more comfortable audio-visual experience.
[0012] Another object of the present invention is to change the image capturing time point at the transmitting device by determining whether only the video needs to be transmitted or the video and the OSD (On Screen Display) need to be transmitted together.
[0013] Technical solutions to the problem
[0014] A wireless device that provides a screen sharing service with an external device in an embodiment of the present invention may include: a display unit that displays a content image; a wireless communication unit that transmits a content image signal corresponding to the content image to the external device; and a control unit that senses whether an OSD (On Screen Display) event has occurred based on information, and when the OSD event has occurred, displays an OSD image on the display unit, and transmits the content image signal and an OSD image signal corresponding to the OSD image to the external device.
[0015] A wireless display system including a wireless device and an external device providing a screen sharing service according to an embodiment of the present invention may include: a wireless device displaying a content image, transmitting a content image signal corresponding to the content image to the external device, judging whether an OSD (On Screen Display) event has occurred based on information, displaying an OSD image on the display unit when the OSD event has occurred, and transmitting the content image signal and an OSD image signal corresponding to the OSD image to the external device; and an external device displaying a content mirror image and an OSD mirror image based on the content image signal and the OSD image.
[0016] Effects of the Invention
[0017] According to various embodiments of the present invention, even if an OSD event occurs in the transmitting device when providing a screen sharing service, the receiving device can confirm the OSD event by receiving an OSD image, thereby making the viewing and listening condition of the receiving user more comfortable. BRIEF DESCRIPTION OF THE DRAWINGS
[0018] Figure 1 The block diagram shows the structure of a display device according to an embodiment of the present invention.
[0019] Figure 2 is a block diagram of a remote control device according to an embodiment of the present invention.
[0020] Figure 3 An actual configuration example of a remote control device according to an embodiment of the present invention is shown.
[0021] Figure 4 An example of using a remote control device according to an embodiment of the present invention is shown.
[0022] Figure 5 It is a diagram for explaining the structure of a wireless display system according to an embodiment of the present invention.
[0023] Figure 6 is a ladder diagram for explaining a process of providing a screen sharing service by establishing a WFD session between a WFD source and a WFD sink according to an embodiment of the present invention.
[0024] Figure 7 This is a diagram for explaining a process of changing a capture time point in accordance with the viewing and listening situation of a transmission-side display device when providing a screen sharing service according to an embodiment of the present invention.
[0025] Figure 8 is a timing diagram for illustrating an operation method of a wireless display system according to an embodiment of the present invention.
[0026] Figure 9a and Figure 9b It is a diagram comparing the prior art and the embodiment of the present invention when “no signal” is sensed.
[0027] Fig.10a and Fig.10b It is a diagram comparing the prior art and the embodiment of the present invention in the case where the channel to be switched is set to be locked.
[0028] Fig.11a and Fig.11b This is a diagram comparing the prior art and the embodiment of the present invention when a subtitle image exists in a broadcast image.
[0029] Fig.12a and Figure 12b This is a diagram comparing the prior art and the embodiment of the present invention when a disaster notification occurs.
[0030] Fig.13 and Fig.14 It is a diagram for explaining channel status information acquired by a transmitting-side display device according to an embodiment of the present invention.
[0031] Figures 15a to 15c This is a diagram for explaining disaster notification information for each country according to an embodiment of the present invention.
[0032] Fig.16 It is a diagram for explaining subtitle information according to an embodiment of the present invention.
[0033] Fig.17 FIG. 1 is a diagram for explaining a process of not transmitting an OSD image generated by a user input during mirroring according to an embodiment of the present invention.
[0034] Fig.18 The diagram is used to explain a process of not transmitting an OSD image including user information during mirroring according to an embodiment of the present invention.
[0035] Fig.19 The diagram is used to explain a process of mirroring only a portion of an image, rather than the entire image, under a specific situation according to an embodiment of the present invention. DETAILED DESCRIPTION
[0036] The following is a more detailed description of embodiments related to the present invention with reference to the accompanying drawings. The suffixes "module" and "unit" used in the following description for the constituent elements are only given or used interchangeably for the convenience of writing the specification, and they do not have any meaning or function to distinguish between them.
[0037] The display device of the embodiment of the present invention is a smart display device that adds a computer support function to a broadcast receiving function, for example. It can be faithful to the broadcast receiving function while adding an Internet function, etc., and can have a more convenient interface such as a handwriting input device, a touch screen or a space remote control. In addition, it can be connected to the Internet and a computer by supporting a wired or wireless Internet function, so as to perform functions such as email, web browsing, banking or games. For such a variety of functions, a standardized general-purpose OS (Operating System) can be used.
[0038] Therefore, the display device described in the present disclosure can freely add or delete various applications on a general OS kernel, so that various user-friendly functions can be performed. Specifically, the display device can be a network TV, HBBTV (Hybrid Broadcast / Broadband TV), smart TV, LED TV, OLED TV, etc., and can also be applied to smart phones according to the situation.
[0039] Figure 1 The block diagram shows the structure of a display device according to an embodiment of the present invention.
[0040] Reference Figure 1 The display device 100 may include a broadcast receiving unit 130 , an external device interface unit 135 , a storage unit 140 , a user input interface unit 150 , a control unit 170 , a wireless communication unit 173 , a display unit 180 , an audio output unit 185 , and a power supply unit 590 .
[0041] The broadcast receiving unit 130 may include a tuner 131 , a demodulation unit 132 , and a network interface unit 133 .
[0042] The tuner 131 may select a specific broadcast channel according to a channel selection instruction. The tuner 131 may receive a broadcast signal for the selected specific broadcast channel.
[0043] The demodulation unit 132 may separate the received broadcast signal into a video signal, an audio signal, and a data signal related to the broadcast program, and restore the separated video signal, audio signal, and data signal into an outputtable form.
[0044] The external device interface unit 135 may receive an application or an application directory in a neighboring external device and transfer the application or application directory to the control unit 170 or the storage unit 140 .
[0045] The external device interface unit 135 may provide a connection path between the display device 100 and an external device. The external device interface unit 135 may receive one or more of an image and audio output from an external device connected to the display device 100 in a wireless or wired manner, and transmit it to the control unit 170. The external device interface unit 135 may include a plurality of external input terminals. The plurality of external input terminals may include RGB terminals, one or more high-definition multimedia interface (HDMI) terminals, and color difference component interface (Component) terminals.
[0046] The image signal of the external device input through the external device interface part 135 may be output through the display part 180. The voice signal of the external device input through the external device interface part 135 may be output through the audio output part 185.
[0047] The external device connectable to the external device interface portion 135 may be any one of a set-top box, a Blu-ray player, a DVD player, a game console, a sound bar, a smartphone, a PC, a universal serial bus (USB) memory, and a home theater, but this is only an example.
[0048] The network interface unit 133 may provide an interface for connecting the display device 100 to a wired / wireless network including the Internet. The network interface unit 133 may transmit and receive data with other users or other electronic devices through the network to which it is connected or other networks linked to the network to which it is connected.
[0049] In addition, a part of the content data stored in the display device 100 may be transmitted to other users pre-registered in the display device 100 or to selected users or selected electronic devices from among other electronic devices.
[0050] The network interface unit 133 can access a specified web page through the network to which it is connected or other networks linked to the network to which it is connected. That is, it can access a specified web page through the network and transmit and receive data with a corresponding server.
[0051] In addition, the network interface unit 133 can receive content or data provided by a content provider or a network operator. That is, the network interface unit 133 can receive content such as movies, advertisements, games, VOD, broadcast signals, etc. provided by a content provider or a network provider and information related thereto through the network.
[0052] In addition, the network interface part 133 may receive firmware update information and update files provided by a network operator, and transmit data to the Internet or a content provider or a network operator.
[0053] The network interface unit 133 can select and receive a desired application from among applications that are open to the public through the network.
[0054] The storage unit 140 may store programs for various signal processing and control in the control unit 170 , and store image, voice, or data signals that have been signal processed.
[0055] In addition, the storage unit 140 may also perform a function for temporarily storing images, voices, or data signals input from the external device interface unit 135 or the network interface unit 133, and may also store information related to a specified image through a channel memory function.
[0056] The storage unit 140 may store applications or application directories input from the external device interface unit 135 or the network interface unit 133 .
[0057] The display device 100 can play content files (video files, still image files, music files, document files, application files, etc.) stored in the storage unit 140 and provide them to the user.
[0058] The user input interface unit 150 can transmit a signal input by the user to the control unit 170, or transmit a signal from the control unit 170 to the user. For example, the user input interface unit 150 can receive and process control signals such as power on / off, channel selection, and screen setting from the remote control device 200 using various communication methods such as Bluetooth, WB (UltraWideband), ZigBee, RF (Radio Frequency) communication, or infrared (IR) communication, or send a control signal from the control unit 170 to the remote control device 200.
[0059] In addition, the user input interface unit 150 may transmit a control signal input from a local key (not shown) such as a power key, a channel key, a volume key, and a setting key to the control unit 170 .
[0060] The image signal processed by the control unit 170 can be input to the display unit 180 and displayed as an image corresponding to the image signal. In addition, the image signal processed by the control unit 170 can be input to an external output device through the external device interface unit 135.
[0061] The voice signal processed in the control unit 170 may be audio-outputted from the audio output unit 185. In addition, the voice signal processed in the control unit 170 may be inputted to an external output device through the external device interface unit 135.
[0062] In addition, the control unit 170 can control the overall operation of the display device 100 .
[0063] In addition, the control part 170 may control the display device 100 by a user instruction or an internal program input through the user input interface part 150 , and may download an application or an application directory desired by the user into the display device 100 by connecting to a network.
[0064] The control portion 170 enables channel information or the like selected by the user to be output through the display portion 180 or the audio output portion 185 together with the processed image or voice signal.
[0065] In addition, the control unit 170 enables the image signal or voice signal of the external device, such as a camera or camcorder, input through the external device interface unit 135 to be output through the display unit 180 or the audio output unit 185 according to the external device image playback instruction received through the user input interface unit 150.
[0066] On the other hand, the control unit 170 may control the display unit 180 to display an image, for example, the display unit 180 may be controlled to display a broadcast image input through the tuner 131, an external input image input through the external device interface unit 135, an image input through the network interface unit, or an image stored in the storage unit 140. In this case, the image displayed on the display unit 180 may be a still image or a video, and may be a 2D image or a 3D image.
[0067] In addition, the control unit 170 can control the playback of content stored in the display device 100, or received broadcast content, external input content input from the outside, and the content can be in various forms such as broadcast images, external input images, audio files, still images, visited web page screens, and document files.
[0068] The wireless communication unit 173 can communicate with the external device through wired or wireless communication. The wireless communication unit 173 can perform short range communication with the external device. To this end, the wireless communication unit 173 can use Bluetooth. TM), Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband, ZigBee, Near Field Communication, Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless Universal Serial Bus technologies to support short-range communication. The wireless communication unit 173 can support wireless communication between the display device 100 and a wireless communication system, between the display device 100 and other display devices 100, or between the display device 100 and a network in which the display device 100 (or an external server) is located through a short-range wireless communication network (Wireless Area Networks). The short-range wireless communication network can be a short-range wireless personal communication network (Wireless Personal Area Networks).
[0069] Here, other display devices 100 may be mobile terminals such as wearable devices (for example, smartwatches, smartglasses, head mounted displays (HMD: head mounted display)) and smartphones that can exchange data with the display device 100 of the present invention (or can be linked). The wireless communication unit 173 can sense (or identify) communicative wearable devices around the display device 100. In addition, when the sensed wearable device is a device authenticated as communicating with the display device 100 of the present invention, the control unit 170 can send at least a portion of the data processed in the display device 100 to the wearable device through the wireless communication unit 173. Therefore, the user of the wearable device can use the data processed in the display device 100 through the wearable device.
[0070] The display portion 180 may generate a driving signal by converting an image signal, a data signal, an OSD signal processed in the control portion 170 or an image signal, a data signal, etc. received from the external device interface portion 135 into R, G, and B signals, respectively.
[0071] on the other hand, Figure 1 The display device 100 shown is only one embodiment of the present invention, and some of the components shown in the figure may be integrated, added, or omitted according to the configuration of the display device 100 actually implemented.
[0072] That is, as required, two or more components can be combined into one component, or one component can be subdivided into two or more components. In addition, the functions performed in each block are used to illustrate the embodiments of the present invention, and the specific operations or devices thereof do not limit the scope of the present invention.
[0073] According to another embodiment of the present invention, the display device 100 may also be connected to Figure 1 Differently from the example shown, an image is received and played through the network interface section 133 or the external device interface section 135 without the tuner 131 and the demodulation section 132 .
[0074] For example, the display device 100 may be implemented by being divided into an image processing device such as a set-top box for receiving broadcast signals or contents according to various network services, and a content playing device for playing contents input from the image processing device.
[0075] In this case, the operation method of the display device according to the embodiment of the present invention to be described below can be referred to as Figure 1 The above-described display device 100 may be used to perform the operation, but the operation may also be performed by any of an image processing device such as a separate set-top box or a content playback device having a display unit 180 and an audio output unit 185 .
[0076] Next, refer to Figures 2 to 3 , a remote control device according to an embodiment of the present invention is described.
[0077] Figure 2 is a block diagram of a remote control device according to an embodiment of the present invention, Figure 3 An actual configuration example of the remote control device 200 according to an embodiment of the present invention is shown.
[0078] First, refer to Figure 2 The remote control device 200 may include a fingerprint recognition unit 210 , a wireless communication unit 220 , a user input unit 230 , a sensor unit 240 , an output unit 250 , a power supply unit 260 , a storage unit 270 , a control unit 280 , and a voice acquisition unit 290 .
[0079] Reference Figure 2 The wireless communication unit 225 can send and receive signals with any one of the display devices in the aforementioned embodiments of the present invention.
[0080] The remote control device 200 may include an RF module 221 capable of transmitting and receiving signals with the display device 100 according to the RF communication standard, and an IR module 223 capable of transmitting and receiving signals with the display device 100 according to the IR communication standard. In addition, the remote control device 200 may include a Bluetooth module 225 capable of transmitting and receiving signals with the display device 100 according to the Bluetooth communication standard. In addition, the remote control device 200 may also include an NFC module 227 capable of transmitting and receiving signals with the display device 100 according to the Near Field Communication (NFC) standard, and may include a WLAN module 229 capable of transmitting and receiving signals with the display device 100 according to the Wireless LAN (WLAN) communication standard.
[0081] In addition, the remote control device 200 transmits a signal including information on the movement of the remote control device 200 and the like to the display device 100 via the wireless communication unit 220 .
[0082] On the other hand, the remote control device 200 can receive signals transmitted by the display device 100 through the RF module 221, and can transmit instructions on power on / off, channel change, volume change, etc. to the display device 100 through the IR module 223 as needed.
[0083] The user input unit 230 may be composed of a keyboard, a key, a touch panel, or a touch screen. The user may input instructions related to the display device 100 to the remote control device 200 by operating the user input unit 230. In the case where the user input unit 230 has a hard key, the user may input instructions related to the display device 100 to the remote control device 200 by pressing the hard key. Figure 3 Provide explanation.
[0084] Reference Figure 3 The remote control device 200 may include a plurality of buttons. The plurality of buttons may include a fingerprint recognition button 212, a power button 231, a home button 232, a live button 233, an external input button 234, a volume adjustment button 235, a voice recognition button 236, a channel change button 237, a confirmation button 238, and a return button 239.
[0085] The fingerprint recognition button 212 may be a button for identifying the user's fingerprint. As an embodiment, the fingerprint recognition button 212 may implement a pressing action, thereby receiving a pressing action and a fingerprint recognition action. The power button 231 may be a button for turning on / off the power of the display device 100. The home button 232 may be a button for moving to the main screen of the display device 100. The live button 233 may be a button for displaying a real-time broadcast program. The external input button 234 is a button for receiving an external input connected to the display device 100. The volume adjustment button 235 may be a button for adjusting the volume output by the display device 100. The voice recognition button 236 may be a button for receiving the user's voice and recognizing the received voice. The channel change button 237 may be a button for receiving a broadcast signal of a specific broadcast channel. The confirmation button 238 may be a button for selecting a specific function, and the return button 239 may be a button for returning to the previous screen.
[0086] Again Figure 2 .
[0087] In the case where the user input unit 230 has a touch screen, the user can input instructions related to the display device 100 to the remote control device 200 by touching the soft keys of the touch screen. In addition, the user input unit 230 can have various types of input means that can be operated by the user, such as a scroll key or a jog key, and this embodiment does not limit the protection scope of the present invention.
[0088] The sensor part 240 may have a gyro sensor 241 or an acceleration sensor 243 , and the gyro sensor 241 may detect information on the movement of the remote control device 200 .
[0089] For example, the gyro sensor 241 can detect information related to the movement of the remote control device 200 based on the x, y, and z axes, and the acceleration sensor 243 can detect information related to the moving speed of the remote control device 200. On the other hand, the remote control device 200 may further include a distance measurement sensor, thereby being able to detect the distance to the display unit 180 of the display device 100.
[0090] The output unit 250 may output an image or voice signal corresponding to the operation of the user input unit 235 or a signal transmitted from the display device 100. The user may recognize the operation of the user input unit 235 or the control of the display device 100 through the output unit 250.
[0091] For example, the output unit 250 may have an LED module 251 that is lit when the user input unit 235 is operated or a signal is sent and received with the display device 100 through the wireless communication unit 225, a vibration module 253 that generates vibration, a sound output module 255 that outputs sound, or a display module 257 that outputs an image.
[0092] In addition, the power supply unit 260 supplies power to the remote control device 200, and can reduce power waste by interrupting the power supply if the remote control device 200 does not move for a predetermined period of time. The power supply unit 260 can restart the power supply when a predetermined key provided on the remote control device 200 is operated.
[0093] The storage unit 270 may store various types of programs, application data, etc. required for controlling or operating the remote control device 200. If the remote control device 200 can wirelessly transmit and receive signals with the display device 100 through the RF module 221, the remote control device 200 and the display device 100 may transmit and receive signals through a prescribed frequency band.
[0094] The control unit 280 of the remote control device 200 may store information on a frequency band in which signals can be wirelessly transmitted and received with the display device 100 paired with the remote control device 200 in the storage unit 270 for reference.
[0095] The control unit 280 controls various matters related to the control of the remote control device 200. The control unit 280 may transmit a signal corresponding to a predetermined key operation of the user input unit 235 or a signal corresponding to the movement of the remote control device 200 detected by the sensor unit 240 to the display device 100 through the wireless communication unit 225.
[0096] In addition, the voice acquisition unit 290 of the remote control device 200 may acquire voice.
[0097] The voice acquisition unit 290 may include at least one microphone 291 , and acquires voice through the microphone 291 .
[0098] Then Figure 4 Provide explanation.
[0099] Figure 4 An example of using a remote control device according to an embodiment of the present invention is shown.
[0100] Figure 4 (a) illustrates an example of a case where a pointer 205 corresponding to the remote control device 200 is displayed on the display unit 180 .
[0101] The user can move the remote control device 200 up, down, left, right, or rotate. The pointer 205 displayed on the display unit 180 of the display device 100 corresponds to the movement of the remote control device 200. As shown in the figure, since the corresponding pointer 205 moves and is displayed as the remote control device 200 moves in the 3D space, this remote control device 200 can be named a spatial remote controller.
[0102] Figure 4 (b) illustrates a case where, when the user moves the remote control device 200 to the left, the pointer 205 displayed on the display unit 180 of the display device 100 also moves to the left accordingly.
[0103] Information about the movement of the remote control apparatus 200 sensed by the sensor of the remote control apparatus 200 is transmitted to the display apparatus 100. The display apparatus 100 may calculate the coordinates of the pointer 205 from the information about the movement of the remote control apparatus 200. The display apparatus 100 may display the pointer 205 to correspond to the calculated coordinates.
[0104] Figure 4 (c) illustrates a case where the user moves the remote control device 200 away from the display unit 180 while pressing a specific key in the remote control device 200. As a result, the selection area corresponding to the pointer 205 in the display unit 180 can be displayed in an enlarged manner.
[0105] On the contrary, when the user brings the remote control device 200 close to the display unit 180 , the selection area corresponding to the pointer 205 in the display unit 180 may be displayed in a reduced size.
[0106] On the other hand, when the remote control device 200 is away from the display unit 180 , the selected area may be reduced, and when the remote control device 200 is close to the display unit 180 , the selected area may be enlarged.
[0107] In addition, the recognition of the up-down and left-right movement may be excluded when a specific button in the remote control device 200 is pressed. That is, when the remote control device 200 is away from or close to the display unit 180, only the forward and backward movement may be recognized without recognizing the up-down, left-right and left-right movement. When the specific button in the remote control device 200 is not pressed, only the pointer 205 moves with the up-down, left-right and left-right movement of the remote control device 200.
[0108] On the other hand, the moving speed or moving direction of the pointer 205 may correspond to the moving speed or moving direction of the remote control device 200 .
[0109] On the other hand, the pointer in this specification refers to an object displayed on the display unit 180 corresponding to the action of the remote control device 200. Therefore, in addition to the arrow shape shown in the drawings, the pointer 205 can be an object in various shapes. For example, it can be a concept including a point, a cursor, a prompt, a thick outline, etc. In addition, the pointer 205 can be displayed in correspondence with any point in the horizontal axis and the vertical axis of the display unit 180, and can also be displayed in correspondence with a plurality of points such as a line and a surface.
[0110] Figure 5 It is a diagram for explaining the structure of a wireless display system according to an embodiment of the present invention.
[0111] The wireless display system may include a first display apparatus 100 - 1 and a second display apparatus 100 - 2 .
[0112] The first display apparatus 100 - 1 and the second display apparatus 100 - 2 may each include Figure 1 All components shown.
[0113] The first display apparatus 100 - 1 may be a WFD source described later, and the second display apparatus 100 - 2 may be a WFD sink described later.
[0114] The first display apparatus 100 - 1 may provide a mirroring service with the second display apparatus 100 - 2 .
[0115] The first display apparatus 100 - 1 may transmit image data for an image being displayed by the first display apparatus 100 - 1 to the second display apparatus 100 - 2 in a wireless manner.
[0116] In this case, the Wireless HiFi Direct standard may be used in the transmission of the image data.
[0117] Next, refer to Figure 6 , an example of providing a screen sharing service by establishing a WFD session between a WFD source and a WFD sink is described.
[0118] Figure 6 is a ladder diagram for explaining a process of providing a screen sharing service by establishing a WFD session between a WFD source and a WFD sink according to an embodiment of the present invention.
[0119] Figure 6 At least one of the steps may be supported by the Wireless High Fidelity Direct standard document.
[0120] The display service in WFDS may refer to services and applications that enable screen sharing between P2P devices. The P2P service that utilizes the display service may be referred to as a WFD device, the device in the WFD device that supports the streaming of multimedia content through a device P2P link may be referred to as a wireless high-fidelity display (WFD) source, and the device that receives and presents multimedia content from the WFD source device through a P2P link may be referred to as a WFD sink.
[0121] The WFD source 10 may be Figure 5 The mobile terminal 500 is shown. Thus, the WFD source 10 may include Figure 5 All components of the mobile terminal 500 are shown.
[0122] The WFD sink 20 may be Figure 1 The display device 100 shown in FIG. Thus, the WFD sink 20 may include Figure 1 All components of the mobile terminal 500 are shown.
[0123] Reference Figure 6 , the WFD source 10 may display an image on the screen ( S600 ).
[0124] In one embodiment, the image displayed on the screen may be an image of media content.
[0125] In another embodiment, when the WFD source 10 is Figure 5 In the case of the mobile terminal 500 shown, the image displayed on the screen may be an image currently displayed on the mobile terminal 500, such as a main screen of the mobile terminal 500, a running screen of an application set in the mobile terminal 500, or the like.
[0126] Afterwards, the WFD source 10 and the WFD sink 20 can discover each other's existence through WFD Device Discovery in the early stage before the WFD connection is established (S601). Specifically, the WFD devices can recognize each other's existence through a probe request frame and a probe response frame containing a WFD Information Element (WFD IE). The WFD Information Element may contain basic information such as device type and device status for establishing an optimal connection between WFD devices. If the WFD device receives a probe request frame containing a WFD IE, it may transmit a probe response frame containing its own WFD IE as a response thereto. If the WFD device is connected to an AP and acts as a Wi-Fi P2P device, logically there are more than two Wi-Fi transceivers acting in one physical device. At this time, for WFD device discovery, the wireless high-fidelity direct connection transceiver is used. The probe request frame for discovering the WFD device includes not only the WFD IE, but also the P2P information element (IE), which can be decoded by the wireless high-fidelity direct connection transceiver.
[0127] Afterwards, the WFD source 10 and the WFD sink 20 may discover each other's service capabilities before establishing a WFD connection (S603). Specifically, if any WFD device transmits a service discovery request frame including the WFD capability as an information sub element, the other WFD device may transmit a service discovery response frame including its own WFD capability as an information sub element in response thereto. The service discovery step is an optional step, and a WFD device supporting the service discovery step may perform the service discovery step with a discovered WFD device supporting the service discovery step. For the execution of the service discovery step, the probe request frame and the response frame used in the device discovery step may include information indicating whether the WFD device has the capability to support the service discovery step.
[0128] Afterwards, the WFD source 10 or the WFD sink 20 may select a peer WFD device for establishing a WFD connection. The peer WFD device to be used for establishing a WFD connection may be selected by a user input or automatically according to a policy.
[0129] Afterwards, the WFD device may select a method for establishing a WFD connection with the selected peer WFD device (S605). Specifically, the WFD device may establish a WFD connection through any one of Wi-Fi P2P and TDLS (Tunneled Direct Link Setup) connectivity schemes. The WFD device may determine the connectivity scheme based on the preferred connectivity information and the associated BSSID sub-element transmitted with the WFD information element.
[0130] If WFD establishment is successfully performed between WFD devices through Wi-Fi P2P or TDLS, the WFD devices may perform WFD capability negotiation (S607). Specifically, the WFD source 10 and the WFD sink 20 may exchange messages using the RTSP (Real-Time Streaming Protocol) protocol, thereby determining a parameter set defining an audio / video payload during a WFD session. The WFD source 10 and the WFD sink 20 may exchange their own specification information with each other.
[0131] The WFD source 10 may use the RTSP protocol to inquire about the capabilities of the WFD sink 20, and the WFD sink 20 may transmit its own capability information to the WFD source 10 in response. For example, the WFD sink 20 may transmit resolution information including resolutions that it can support to the WFD source 10. For example, the WFD sink 20 may transmit resolution information including resolutions corresponding to the screen ratio of 16:9 or 4:3 to the WFD source 10. Here, the resolution corresponding to 16:9 or 4:3 is only an example, and may be a resolution corresponding to a screen ratio in which the horizontal length is greater than the vertical length.
[0132] Conversely, the WFD source 10 may also transmit resolution information including resolutions that the WFD source 10 can support to the WFD sink 20 .
[0133] The WFD source 10 may transmit a required request message to the WFD sink 20 using the RTSP protocol during the WFD capability negotiation process with the WFD sink 20 (S609). For example, the WFD source 10 may transmit a message to the WFD sink 20 using the RTSP protocol, the message including content that an image of a video content corresponding to a specific resolution will be delivered based on the resolution information received from the WFD sink 20. More specifically, the WFD source 10 may select any one of a plurality of resolutions that the WFD sink 20 can support, and transmit a message to the WFD sink 20 indicating that an image of the video content having the selected resolution will be delivered. That is, the WFD source 10 may select any one of a plurality of resolutions, and transmit a message to the WFD sink 20 indicating that an image of the selected resolution will be delivered.
[0134] The WFD sink 20 may transmit a response message through the RTSP protocol based on the request message received from the WFD source 10 ( S611 ).
[0135] In one embodiment, the resolution selected by the WFD source 10 may not be included in the resolutions supportable by the WFD source 10. That is, the resolution of the image being displayed by the WFD source 10 may not be included in the resolutions supportable by the WFD sink 20. Steps S609 and S611 may be included in the WFD capability negotiation step (S607).
[0136] If the WFD capability negotiation step ends successfully, a WFD session (or Miracast session) is established between the WFD source 10 and the WFD sink 20, and audio and video content can be streamed from the WFD source 10 to the WFD sink 20 (S613).
[0137] In one embodiment, the WFD sink 20 may display the entire image of the streamed video content.
[0138] In the following figures, it is assumed that the WFD source 10 may be Figure 5 The mobile terminal 500 described in the WFD sink 20 is Figure 1 The display device 100 described in the accompanying drawings is described below.
[0139] Thus, the WFD source 10 may include Figure 5 The WFD sink 20 may also include all components of the mobile terminal 500 shown in FIG. Figure 1 All components of display 100 are shown.
[0140] Figure 7 This is a diagram for explaining a process of changing a capture time point in accordance with the viewing and listening situation of a transmission-side display device when providing a screen sharing service according to an embodiment of the present invention.
[0141] The first display apparatus 100 - 1 may be a transmission-side apparatus functioning as a source apparatus, and the second display apparatus 100 - 2 may be a reception-side apparatus functioning as a sink apparatus.
[0142] The first display device 100 - 1 may include an image decoding part 710 , a first scaler 720 , a sub-scaler 730 , an encoder 740 , a PQ controller 750 , a second scaler 760 , a wireless communication part 173 , and a display part 180 .
[0143] The image decoding part 710 , the first scaler 720 , the PQ controller 750 , the second scaler 760 , the sub-scaler 730 , and the encoder 740 may be constituent elements included in the control part 170 .
[0144] The image decoding unit 710 may decode an image received from an external device. That is, the image decoding unit 710 may decode an encrypted image. The image may be a video or a streaming image.
[0145] The first scaler 720 may perform a first scaling on the decoded image. The first scaling may be a reduction.
[0146] The capture time point of the video output from the first scaler 720 may be a first capture time point. The first capture time point may mean a time point at which only the video is captured except for the OSD or the subtitle.
[0147] In the prior art, the image captured at the first capture time point is transmitted to the second display device 100-2. The image captured at the second capture time point is an image whose image quality is adjusted to match the specifications of the first display device 100-2, because if the image in the state of image quality adjustment is transmitted without knowing the configuration of the second display device 100-2, degradation of the mirror image may occur.
[0148] The sub-scaler 730 may perform additional scaling on the first scaled video.
[0149] The encoder 740 may encode the video output from the sub-scaler 730 .
[0150] The encoder 740 may transmit the encoded video to the wireless communication unit 173 .
[0151] The PQ (Picture Quality) controller 750 may process the picture quality of the first scaled video.
[0152] The PQ controller 750 may perform Dolby Vision or HDR settings on the first scaled video. The PQ controller 750 may apply values of one or more picture quality factors for Dolby Vision or HDR to the first scaled video.
[0153] The second scaler 760 may perform a second scaling on the image processed by the PQ controller 750 to make it suitable for output on the display unit 180. The second scaling may be enlargement.
[0154] The second zoomed-in video may be displayed on the display unit 180 .
[0155] In addition, the second scaled video and OSD image may be overlapped and transmitted to the display portion 180 .
[0156] That is, the OSD image may be added before the video is output to the display unit 180 .
[0157] The time point at which the video and OSD output from the display part 180 are captured may be a second capture time point.
[0158] The wireless communication unit 173 may transmit the encoded image to the second display device 100 - 2 according to the short-distance wireless communication standard.
[0159] The wireless communication unit 173 or the control unit 170 may determine any one of the first capturing time point and the second capturing time point according to the viewing and listening status of the first display apparatus 100 - 1 .
[0160] For example, when it is determined to be the first capturing time point, only the video may be transmitted to the second display apparatus 100 - 2 through the wireless communication unit 173 .
[0161] When it is determined to be the second capturing time point, the video and the OSD image, or the video and the subtitle may be transmitted to the second display apparatus 100 - 2 through the wireless communication part 173 .
[0162] The first display apparatus 100-1 may transmit the content image captured according to the first capturing time point to the second display apparatus 100-2. In this case, the content image may be an image that has not been subjected to image quality processing.
[0163] The first display apparatus 100-2 may transmit the entire image (content image and OSD image) captured according to the second capturing time point to the second display apparatus 100-2. In this case, the entire image may be an image subjected to picture quality processing by the PQ controller 750.
[0164] The second display apparatus 100 - 2 may additionally receive image quality information on which image quality processing has been performed on the entire image from the first display apparatus 100 - 1 .
[0165] The embodiments of the present invention may be supported by standard documents disclosed by at least one of the IEEE (Institute of Electrical and Electronics Engineers) 802 system, the 3GPP (3rd Generation Partnership Project) system, the 3GPP LTE and LTE-A (LTE-Advanced) system, the 3GPP 2 system, and the Wi-Fi Alliance (WFA) system as wireless access systems. That is, the steps or parts that are not described in the embodiments of the present invention in order to clarify the technical ideas of the present invention may be supported by the documents. In addition, all terms disclosed in this specification may be explained by the standard documents.
[0166] Figure 8 is a timing diagram for illustrating an operation method of a wireless display system according to an embodiment of the present invention.
[0167] The wireless display system may include a first display apparatus 100 - 1 and a second display apparatus 100 - 2 .
[0168] The first display device 100 - 1 and the second display device 100 - 2 may each include Figure 1 The components shown.
[0169] In addition, it is assumed that the first display apparatus 100-1 and the second display apparatus 100-2 are both connected to each other through a short-range wireless communication standard. The short-range wireless communication standard may be any one of the wireless high fidelity and the wireless high fidelity direct connection standards.
[0170] The control unit 170 of the first display device 100 - 1 displays a content image on the display unit 180 ( S801 ).
[0171] The control unit 170 of the first display apparatus 100 - 1 transmits an image signal corresponding to the content image being displayed to the second display apparatus 100 - 2 through the wireless communication unit 173 ( S803 ).
[0172] The wireless communication unit 173 may include a wireless high-fidelity circuit or a wireless high-fidelity direct connection circuit.
[0173] The second display apparatus 100 - 2 displays a mirror image based on the received image signal ( S805 ).
[0174] Thereafter, the control unit 170 of the first display device 100 - 1 determines whether an OSD (On Screen Dipslay) event occurs based on the information ( S807 ).
[0175] In one embodiment, the control unit 170 may determine whether an OSD event occurs based on broadcast information. The broadcast information may be signal information or channel lock information.
[0176] The control unit 170 may determine that an OSD event has occurred when no signal information is sensed.
[0177] When switching channels, the control unit 170 may determine that an OSD event has occurred if it is determined based on the channel lock information that the channel switched to is set to be locked.
[0178] In another embodiment, the control unit 170 may determine whether an OSD event has occurred based on the subtitle information. The control unit 170 may determine that an OSD event has occurred when the subtitle setting is enabled based on the subtitle information while the content image is displayed.
[0179] In another embodiment, the control unit 170 may determine whether an OSD event has occurred based on the disaster notification information. The control unit 170 may determine that an OSD event has occurred when a disaster notification is received based on the disaster notification information.
[0180] When determining that an OSD event has occurred, the control unit 170 of the first display device 100 - 1 displays an OSD image on the display unit 180 ( S809 ).
[0181] When it is determined that an OSD event has occurred, the control unit 170 may display an OSD image corresponding to the OSD event on the display unit 180 .
[0182] The control unit 170 may display the OSD image by overlapping the content image.
[0183] The control part 170 of the first display apparatus 100 - 1 transmits an OSD image signal corresponding to the OSD image to the second display apparatus 100 - 2 through the wireless communication part 173 ( S811 ).
[0184] The control part 170 of the first display apparatus 100 - 1 may transmit a content image signal corresponding to a content image and an OSD image signal to the second display apparatus 100 - 2 .
[0185] The second display apparatus 100 - 2 displays an OSD mirror image based on the received OSD image signal ( S813 ).
[0186] Figure 9a and Figure 9b is a diagram comparing the prior art and the embodiment of the present invention in a case where “no signal” is sensed.
[0187] Reference Figure 9a , the first display apparatus 100 - 1 may display the first OSD image 910 indicating that there is no input signal when sensing “no signal” when switching channels.
[0188] According to the related art, the first display apparatus 100 - 1 does not transmit an OSD image signal corresponding to the first OSD image 910 to the second display apparatus 100 - 2 .
[0189] Therefore, the second display apparatus 100-2 displays the mirror image that was being displayed before sensing “no signal.” That is, the second display apparatus 100-2 displays the still image 900 of the previous channel.
[0190] Reference Figure 9b , the first display apparatus 100 - 1 may display the first OSD image 910 indicating that there is no input signal when sensing “no signal” when switching channels.
[0191] According to an embodiment of the present invention, the first display apparatus 100 - 1 may transmit an OSD image signal corresponding to the first OSD image 910 to the second display apparatus 100 - 2 .
[0192] The first display device 100-1 may set the capture time point to Figure 7 The second capture time point of the display device 100-2 is displayed, and the captured OSD image frame is transmitted to the second display device 100-2.
[0193] Thus, the second display apparatus 100 - 2 may display the first mirrored OSD image 930 corresponding to the OSD image signal.
[0194] As described above, according to the embodiments of the present invention, even if "no signal" is sensed during the screen sharing service, the user of the receiving device does not view or listen to a still image, and can grasp the viewing and listening status of the transmitting device through the OSD image.
[0195] Fig.10a and Fig.10b This is a diagram comparing the prior art and the embodiment of the present invention in a case where the channel to be switched is set to be locked.
[0196] Reference Fig.10a , the first display apparatus 100 - 1 may display a second OSD image 1010 indicating that the channel is in a locked state when the channel is switched and the switched channel is set to be locked.
[0197] According to the related art, the first display apparatus 100 - 1 does not transmit an OSD image signal corresponding to the second OSD image 1010 to the second display apparatus 100 - 2 .
[0198] Therefore, the second display apparatus 100-2 displays a mirror image corresponding to the broadcast image provided by the previous channel. That is, the second display apparatus 100-2 displays the still image 1000 of the previous channel (the channel before switching).
[0199] Reference Fig.10b , the first display apparatus 100 - 1 may display a second OSD image 1010 indicating that the channel is in a locked state when the channel is switched and the switched channel is set to be locked.
[0200] According to an embodiment of the present invention, the first display apparatus 100-1 may transmit an OSD image signal corresponding to the second OSD image 1010 to the second display apparatus 100-2. That is, the first display apparatus 100-1 may determine the capture time point of the image for mirroring as Figure 7 The second capture time point.
[0201] The first display apparatus 100 - 1 may transmit the captured OSD image frame to the second display apparatus 100 - 2 in real time.
[0202] Therefore, the second display apparatus 100 - 1 may display a second mirrored OSD image 1030 corresponding to the OSD image frame.
[0203] As described above, according to the embodiments of the present invention, even when switching to a locked channel during the screen sharing service, the user of the receiving device does not view still images and can understand the viewing status of the transmitting device through the OSD image.
[0204] Fig.11a and Fig.11b This is a diagram comparing the prior art and the embodiment of the present invention when a subtitle image exists in a broadcast image.
[0205] Reference Fig.11a , the first display device 100-1 may display a broadcast image 1100 and a subtitle image 1110. The subtitle image 1110 may be a kind of OSD image.
[0206] According to the related art, the first display apparatus 100 - 1 does not transmit an OSD image signal corresponding to the subtitle image 1110 to the second display apparatus 100 - 2 .
[0207] Therefore, the second display device 100-2 displays a mirror image 1130 corresponding to the broadcast image 1100. That is,
[0208] Reference Fig.11b , the first display device 100 - 1 may display a broadcast image 1100 and a subtitle image 1110 .
[0209] According to an embodiment of the present invention, the first display apparatus 100-1 may transmit an OSD image signal corresponding to the subtitle image 1110 to the second display apparatus 100-2. That is, the first display apparatus 100-1 may determine the capture time point of the image for mirroring as Figure 7 The second capture time point.
[0210] The first display apparatus 100 - 1 may transmit the captured frame of the subtitle image 1110 to the second display apparatus 100 - 2 in real time.
[0211] Thus, the second display apparatus 100 - 1 may display a mirrored subtitle image 1150 corresponding to the frame of the subtitle image 1110 .
[0212] As described above, according to the embodiments of the present invention, when a content image has a subtitle in providing a screen sharing service, a user of a reception-side device can view and hear both the content image and the subtitle image.
[0213] As a result, the viewing and listening situation of the user on the receiving side becomes more comfortable.
[0214] Fig.12a and Figure 12b This is a diagram comparing the prior art and an embodiment of the present invention in the case of disaster notification.
[0215] Reference Fig.12a , the first display apparatus 100 - 1 may display a third OSD image 1210 indicating a disaster notification while playing the broadcast image 1200 .
[0216] According to the related art, the first display apparatus 100 - 1 does not transmit an OSD image signal corresponding to the third OSD image 1210 to the second display apparatus 100 - 2 .
[0217] Therefore, the second display apparatus 100 - 2 displays only the mirroring image 1230 corresponding to the broadcast image 1200 .
[0218] Reference Figure 12b , the first display apparatus 100 - 1 may display a third OSD image 1210 indicating a disaster notification while displaying the broadcast image 1200 .
[0219] According to an embodiment of the present invention, the first display apparatus 100-1 may transmit an OSD image signal corresponding to the third OSD image 1210 to the second display apparatus 100-2. That is, the first display apparatus 100-1 may determine the capture time point of the image for mirroring as Figure 7 The second capture time point.
[0220] The first display apparatus 100 - 1 may transmit the captured OSD image frame to the second display apparatus 100 - 2 in real time.
[0221] Therefore, the second display apparatus 100 - 1 may display a mirror image 1230 corresponding to the broadcast image 1200 and a third mirror OSD image 1250 corresponding to the OSD image frame.
[0222] As described above, according to the embodiments of the present invention, when a disaster notification occurs while viewing a broadcast image, the user of the receiving device can also view an OSD image for the disaster notification, thereby quickly understanding the mirroring status and the disaster status.
[0223] Fig.13 and Fig.14 The figure is used to illustrate the channel status information acquired by the transmitting-side display device according to an embodiment of the present invention.
[0224] Reference Fig.13 , the control unit 170 of the first display device 100 - 1 can obtain the channel status information 1300 .
[0225] The control unit 170 may acquire the first channel state information 1300 including information on the switched channel from a UTP (Unshileded Twisted Pair) module provided inside the first display apparatus 100 - 1 .
[0226] The UTP (Unshileded Twisted Pair) module may be included in the network interface unit 133 or the tuner 131 . The first channel state information 1300 may be received from a broadcasting station connected to the network interface unit 133 or the tuner 131 .
[0227] The first channel status information 1300 may include a channel screen saver type (Channel Screen saverType) field.
[0228] The control unit 170 may receive channel status information every time a channel is switched.
[0229] The channel screen saver type may include information indicating whether the channel has been set to be locked. For example, when the channel screen saver type is "Channel Blocked" 1310, the channel may be set to be locked.
[0230] The control unit 170 may determine that the switched channel is set to be locked when the channel screen saver type included in the first channel status information 1300 is the "ChannelBlocked" type. The control unit 170 may display an OSD image indicating that the channel is locked on the display unit 180 when the switched channel is set to be locked.
[0231] Reference Fig.14 , illustrating second channel status information 1400. The second channel status information 1400 may include a channel screen saver type indicating whether there is no signal provided by the channel.
[0232] For example, a channel screen saver type may include “No Signal” 1410 .
[0233] The control unit 170 may determine that there is no broadcast signal provided by the switched channel when the channel screen saver type included in the second channel status information 1400 is the "NoSignal" type. The control unit 170 may display an OSD image indicating the "NoSignal" state on the display unit 180 when the state of the switched channel is determined to be the "NoSignal" state.
[0234] As described above, according to the embodiment of the present invention, the transmitting-side device can determine whether the converted channel is in a locked state or a no-signal state based on the channel state information.
[0235] Figures 15a to 15c It is a diagram for explaining disaster notification information for each country according to an embodiment of the present invention.
[0236] The control part 170 of the first display apparatus 100-1 may receive disaster notification information from the UTP module. The disaster notification information may include information for notifying a disaster state.
[0237] The format of disaster notification information may vary from country to country.
[0238] Fig.15a The first disaster notification information 1510 may be information received by a display device provided to Indonesia, the second disaster notification information 1530 may be information received by a display device provided to Japan, and the third disaster notification information 1550 may be information received by a display device provided to North America.
[0239] The control unit 170 may determine that a disaster notification has occurred when the value of the status field included in the first disaster notification information 1510 is “AWAS” 1511 .
[0240] The control unit 170 may determine that a disaster notification has occurred when the value of the class field included in the second disaster notification information 1530 is “EWS” 1531 .
[0241] The control unit 170 may determine that a disaster notification has occurred when the value of the title field included in the third disaster notification information 1550 is “BlueAlert” 1551 .
[0242] When the control unit 170 senses the occurrence of a disaster notification, the control unit 170 may display an OSD image indicating the occurrence of the disaster notification on the display unit 180 .
[0243] As described above, the transmission-side display device may sense the occurrence of the disaster notification based on the disaster notification information.
[0244] Fig.16 It is a diagram for explaining subtitle information according to an embodiment of the present invention.
[0245] Reference Fig.16 , subtitle information 1600 is illustrated. The subtitle information 1600 may be received from the network interface unit 133 together with the content image.
[0246] The subtitle information 1600 may include a caption Enable field indicating whether the subtitle is activated or not. The control unit 170 may determine that there are subtitles for the content image when the value of the caption Enable field is "On" 1610. The control unit 170 may display a subtitle OSD image corresponding to the subtitle on the display unit 180 together with the content image.
[0247] On the contrary, when the value of the Caption Enable field is “off”, the control unit 170 may determine that there is no subtitle for the content image.
[0248] Fig.17 is a diagram for explaining a process of not transmitting an OSD image generated by a user input during mirroring according to an embodiment of the present invention.
[0249] Reference Fig.17 , the first display apparatus 100 - 1 displays the content image 1700 , and the second display apparatus 100 - 2 displays the mirror image 1730 corresponding to the content image 1700 .
[0250] The first display apparatus 100 - 1 may receive an instruction for outputting a menu image from the remote controlling apparatus 200 , and display the OSD menu image 1710 on the display portion 180 according to the received instruction.
[0251] In the case where the first display apparatus 100 - 1 displays the OSD menu image 1710 based on the user input as instructed by the remote control apparatus 200 , the first display apparatus 100 - 1 may not transmit an image signal corresponding to the OSD menu image 1710 to the second display apparatus 100 - 2 .
[0252] This is because the OSD menu image 1710 is an image for a menu operation of the first display apparatus 100 - 1 , and thus there is no need to display the OSD menu image 1710 to a user of the second display apparatus 100 - 2 .
[0253] In the case where the first display apparatus 100 - 1 displays an OSD image based on a command received through the user input interface portion 150 , the first display apparatus 100 - 1 may not transmit an image signal corresponding to the OSD image to the second display apparatus 100 - 2 .
[0254] In a case where the first display apparatus 100 - 1 displays an OSD image based on an instruction received through the user input interface portion 150 , the capture time point of the image may be determined as a first capture time point.
[0255] Fig.18 FIG. 1 is a diagram for explaining a process of not transmitting an OSD image including user information during mirroring according to an embodiment of the present invention.
[0256] Reference Fig.18 , the first display apparatus 100 - 1 displays a content image 1800 and an OSD image 1810 which are an execution screen of an application providing a streaming service, and the second display apparatus 100 - 2 displays a mirror image 1830 corresponding to the content image 1800 .
[0257] When the OSD image 1810 includes user information, the first display apparatus 100-1 may not transmit an OSD image signal corresponding to the OSD image 1810 to the second display apparatus 100-2. The user information may include one or more of a user's viewing and listening record and a user's subscription information.
[0258] As described above, according to the embodiments of the present invention, during mirroring, the transmitting device may not transmit an image containing user information to the receiving device, thereby protecting the privacy of the user of the transmitting device.
[0259] Fig.19 2 is a diagram for explaining a process of mirroring only a portion of an image instead of the entire image under a specific situation according to an embodiment of the present invention.
[0260] Reference Fig.19 , the first display apparatus 100 - 1 is displaying a first contents image 1910 and a second contents image 1930 .
[0261] The first content image 1910 and the second content image 1930 may be images of broadcast channels, respectively, and may be being played through a multi-view function.
[0262] The first display apparatus 100 - 1 may transmit only an image signal corresponding to the first content image 1910 to the second display apparatus 100 - 1 in a case where an age restriction is set for a channel corresponding to the second content image 1930 .
[0263] The second display apparatus 100 - 2 may display only the mirror image 1950 corresponding to the first content image 1910 .
[0264] As described above, according to the embodiments of the present invention, only a portion of an image rather than the entire image may be mirrored according to a specific situation when mirroring.
[0265] According to an embodiment of the present invention, the aforementioned method can be implemented in a medium having a program recorded thereon as a processor-readable code. Examples of the processor-readable medium include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like.
[0266] The display device as described above is not limited to the configuration and method of the above-mentioned embodiments, and may also selectively combine all or part of the various embodiments so that the embodiments can be modified in various ways.
Claims
1. A wireless device that provides a screen sharing service with an external device, wherein: include: A display unit, which displays content images; a wireless communication unit for transmitting a content image signal corresponding to the content image to the external device; as well as The control unit senses whether an OSD event occurs based on the information, displays an OSD image on the display unit when the OSD event occurs, and transmits the content image signal and an OSD image signal corresponding to the OSD image to the external device.
2. The wireless device according to claim 1, wherein: The information includes channel locking information for whether the channel is set to be locked; The control unit determines that the OSD event has occurred when the channel is switched based on the channel lock information and the switched channel is set to be locked. And the OSD image signal corresponding to the OSD image indicating the channel locked state is transmitted to the external device.
3. The wireless device according to claim 1, wherein: The information includes signal presence information regarding whether a signal provided by the channel exists; The control unit determines that the OSD event has occurred when there is no signal provided by the switched channel when switching the channel based on the signal presence / absence information. And the OSD image signal corresponding to the OSD image indicating a no-signal state is transmitted to the external device.
4. The wireless device according to claim 1, wherein: The information includes disaster notification information notifying the occurrence of a disaster; The control unit determines that the OSD event has occurred when it is determined based on the disaster notification information that a disaster notification has occurred. And the OSD image signal corresponding to the OSD image indicating the occurrence of a disaster is transmitted to the external device.
5. The wireless device according to claim 1, wherein: The information includes subtitle information indicating whether there is a subtitle for the content image; The control unit determines that the OSD event has occurred when the subtitle exists based on the subtitle information, And the OSD image signal corresponding to the OSD image representing the subtitle is transmitted to the external device.
6. The wireless device according to claim 1, wherein: When the OSD event does not occur, the control unit transmits only the content image signal to the external device.
7. The wireless device according to claim 1, wherein: The control unit changes a capture time point of an image transmitted to the external device according to whether the OSD event occurs.
8. The wireless device according to claim 7, wherein: When the OSD event occurs, the control unit captures the image on which image quality processing is performed and output from the display unit, and transmits the captured image to the external device; When the OSD event does not occur, the control unit captures the content image without performing the image quality processing, and transmits the captured content image to the external device.
9. A wireless display system comprising a wireless device and an external device providing a screen sharing service, in, include: a wireless device that displays a content image, transmits a content image signal corresponding to the content image to the external device, senses whether an OSD event has occurred based on the information, displays an OSD image on a display unit when the OSD event has occurred, and transmits the content image signal and an OSD image signal corresponding to the OSD image to the external device; as well as The external device displays a content mirroring image and an OSD mirroring image based on the content image signal and the OSD image.
10. The wireless display system according to claim 9, wherein: The information includes channel locking information for whether the channel is set to be locked; The wireless device determines that the OSD event has occurred when the channel is switched based on the channel lock information and the switched channel is set to be locked. And the OSD image signal corresponding to the OSD image indicating the channel locked state is transmitted to the external device.
11. The wireless display system according to claim 9, wherein: The information includes signal presence information regarding whether a signal provided by the channel exists; The wireless device determines that the OSD event has occurred when the channel is switched based on the signal presence / absence information and when there is no signal provided by the switched channel, And the OSD image signal corresponding to the OSD image indicating a no-signal state is transmitted to the external device.
12. The wireless display system according to claim 9, wherein: The information includes disaster notification information notifying the occurrence of a disaster; The wireless device determines that the OSD event has occurred when it is determined based on the disaster notification information that a disaster notification has occurred, And the OSD image signal corresponding to the OSD image indicating the occurrence of a disaster is transmitted to the external device.
13. The wireless display system according to claim 9, wherein: The information includes subtitle information indicating whether there is a subtitle for the content image; The wireless device determines that the OSD event has occurred when the subtitle exists based on the subtitle information, And the OSD image signal corresponding to the OSD image representing the subtitle is transmitted to the external device.
14. The wireless display system according to claim 9, wherein: The wireless device changes a capture time point of an image transmitted to the external device according to whether the OSD event occurs.
15. The wireless display system according to claim 14, wherein: When the OSD event occurs, the wireless device captures the image that has been subjected to image quality processing and is output from the display unit, and transmits the captured image to the external device; In a case where the OSD event does not occur, the wireless device captures the content image without performing the image quality processing, and transmits the captured content image to the external device.