Gateway apparatus, method for controlling gateway apparatus, and handshaking system
The gateway device optimizes media transmission by determining optimal formats and bit rates based on sink device capabilities, overcoming limitations in existing wireless transmission methods to provide high-quality media output.
Patent Information
- Application Number
- PCT/KR2024/095812
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-31
- Filing Date
- 2024-05-17
- Publication Date
- 2024-12-05
AI Technical Summary
Current wireless transmission methods, such as WIFI Miracast, limit media data transmission to predetermined specifications regardless of the sink device's capabilities, resulting in reduced video and audio quality even if the source device provides high-definition content.
A gateway device that performs wired connections with source devices and wireless connections with sink devices, obtaining EDID and communication performance information to determine optimal media formats and bit rates, allowing for the transmission of media data that maximizes the sink device's performance.
Enables the delivery of high-quality media by converting media data to optimal specifications for the sink device, ensuring optimal video and audio output even in wireless network environments.
Smart Images

Figure KR2024095812_05122024_PF_FP_ABST
Abstract
Description
Gateway device, control method of gateway device and handshaking system
[0001] The disclosed invention relates to a gateway device, a method for controlling the gateway device, and a handshaking system.
[0002] Recent advancements in video and audio processing technology have led to the production of a large volume of high-definition and high-quality content. Furthermore, advancements in communications technology have created a need for wireless transmission of this content. However, the typical wireless transmission method, WIFI Miracast, has a limitation in that it can only transmit data with a predetermined, limited specification, regardless of the output specifications of the sink device. Consequently, even if the content provided by the source device is high-definition or high-quality, or the sink device supports high specifications, the quality of the video or audio that can be viewed or heard is inevitably reduced.
[0003] The disclosed invention provides a gateway device (1), a control method of the gateway device, and a handshaking system for providing media data of optimal specifications to a sink device (3) connected wirelessly using the gateway device.
[0004] A gateway device (1) according to one embodiment comprises a communication unit (10) that performs a wired connection with a source device (2) and a wireless connection with a sink device (3) that outputs media;
[0005] An interface section (20) that receives user input from a user or outputs information to the user; And a control unit (30) that controls the communication unit (10) and the interface unit (20); wherein the control unit (30) obtains, from the sink device (3) through the communication unit (10), EDID (Extended Display Identification data) including an outputtable format of the sink device (3) and communication performance information of the sink device (3), obtains information about an environment in which wireless communication with the sink device (3) is performed from a user through the interface unit (20), determines a current maximum transmission speed of wireless communication with the sink device (3) based on the obtained communication performance information of the sink device (3) and the obtained information about the environment in which wireless communication with the sink device (3) is performed, determines a bit rate required for wirelessly transmitting data related to the media in the obtained outputtable format included in the EDID to the sink device (3) in order to output the media from the sink device (3), and determines an untransmittable format among the outputtable formats based on the determined required bit rate and the current maximum transmission speed.
[0006] A method for controlling a gateway device (1) according to one embodiment comprises: performing a wired connection with a source device (2) through a communication unit (10) and performing a wireless connection with a sink device (3) that outputs media; obtaining EDID (Extended Display Identification data) including an outputtable format of the sink device (3) and communication performance information of the sink device (3) from the sink device (3) through the communication unit (10); obtaining information on an environment in which wireless communication is performed with the sink device (3) from a user through an interface unit (20); determining a current maximum transmission speed of wireless communication with the sink device (3) based on the obtained communication performance information of the sink device (3) and the obtained information on the environment in which wireless communication is performed with the sink device (3); determining a bit rate required for wirelessly transmitting data related to the media in the obtained outputtable format included in the EDID to the sink device (3) in order to output the media from the sink device (3); And, based on the determined required bit rate and the current maximum transmission speed, it may include determining a non-transmittable format among the outputtable formats.
[0007] A handshaking system according to one embodiment comprises: a source device (2); a sink device (3) outputting media; A gateway device (1) connected to the source device (2) by a wire and connected to the sink device (3) wirelessly; wherein the gateway device (1) obtains, from the sink device (3), EDID (Extended Display Identification data) including an outputtable format of the sink device (3) and communication performance information of the sink device (3), obtains information on an environment in which wireless communication with the sink device (3) is performed from a user through an interface unit (20), determines a current maximum transmission speed of wireless communication with the sink device (3) based on the obtained communication performance information of the sink device (3) and the obtained information on the environment in which wireless communication with the sink device (3) is performed, determines a bit rate required for wirelessly transmitting data related to the media in the obtained outputtable format included in the EDID to the sink device (3) in order to output the media from the sink device (3), and determines an untransmittable format among the outputtable formats based on the determined required bit rate being greater than the current maximum transmission speed.
[0008] According to the disclosed invention, there is an effect of providing a user with an experience of viewing or listening to high-quality media by supplying media data that has been converted so that it can be output as optimal voice or image from a sink device (3) even in a wireless network environment.
[0009] The technical tasks and effects to be achieved in this document are not limited to those described above, and other technical tasks and effects other than those mentioned can be clearly understood by those skilled in the art to which the present invention pertains from the description below.
[0010] Figure 1 illustrates the basic structure of a handshaking system according to one embodiment.
[0011] Figure 2 is a flowchart illustrating a control method of a gateway device according to one embodiment.
[0012] Figure 3 illustrates metadata containing information related to a source device.
[0013] Figure 4 illustrates the basic data format of EDID 1.4, which stores specification information of a sink device.
[0014] FIG. 5 illustrates selection of a source device and a sink device through an interface section of a gateway device according to one embodiment.
[0015] FIG. 6 illustrates selection of a source device and a sink device through a user interface of a sink device according to one embodiment.
[0016] Fig. 7 is a flowchart showing a method for modifying the EDID of a sink device (3) according to one embodiment.
[0017] FIG. 8 is a flowchart illustrating a method for determining a current maximum transmission speed according to one embodiment.
[0018] Figure 9 is an example of a conversion table showing the theoretical maximum transmission speed corresponding to communication performance information.
[0019] Fig. 10 is an example showing the maximum transmission speed corresponding to the driving environment of wireless transmission according to one embodiment.
[0020] FIG. 11 is an example of a table showing actual measured values of the current maximum transmission speed that varies depending on the distance to the sink device (3) and the angle of the antenna in an environment where wireless communication is performed with the sink device (3) according to one embodiment.
[0021] Figure 12 is an example of a conversion table defining the bit rate required to transmit a media format.
[0022] Figure 13 illustrates a flowchart of a handshaking system according to one embodiment.
[0023] Figure 14 is an example showing a handshaking scenario when there is one selected source device and multiple selected sink devices.
[0024] Figure 15 is an example showing a handshaking scenario when there are multiple source devices and only one selected sink device.
[0025] Figure 16 is an example showing a handshaking scenario when there are multiple source devices and sink devices.
[0026] It should be understood that the various embodiments and terms used in this document are not intended to limit the technical features described in this document to specific embodiments, but rather to encompass various modifications, equivalents, or alternatives of the embodiments.
[0027] In connection with the description of the drawings, similar reference numerals may be used for similar or related components.
[0028] The singular form of a noun corresponding to an item may include one or more items, unless the context clearly indicates otherwise.
[0029] In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" may include any one of the items listed together in that phrase, or all possible combinations thereof.
[0030] Terms such as "first," "second," or "first" or "second" may be used simply to distinguish one component from another and do not limit the components in any other respect (e.g., importance or order).
[0031] When a component (e.g., a first component) is referred to as being “coupled” or “connected” to another component (e.g., a second component), with or without the terms “functionally” or “communicatively,” it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.
[0032] The terms “include” or “have” are intended to specify the presence of a feature, number, step, operation, component, part or combination thereof described in this document, but do not preclude the presence or addition of one or more other features, numbers, steps, operations, components, parts or combinations thereof.
[0033] When a component is said to be “connected,” “coupled,” “supported,” or “in contact with” another component, this includes not only cases where the components are directly connected, coupled, supported, or in contact, but also cases where the components are indirectly connected, coupled, supported, or in contact through a third component.
[0034] When we say that a component is "on" another component, this includes not only cases where the component is in contact with the other component, but also cases where there is another component between the two components.
[0035] *The term “and / or” includes any combination of multiple related described components or any one of multiple related described components.
[0036] The operating principle and embodiments of the present invention will be described with reference to the attached drawings below.
[0037] *
[0038] Figure 1 illustrates the basic structure of a handshaking system according to one embodiment.
[0039] Referring to FIG. 1, the handshaking system may include a gateway device (1), at least one source device (2) connected to the gateway device (1), and at least one sink device (3) connected to the gateway device (1).
[0040] Here, the source device (2) may include a device such as a game console, PC, STB, or BD Player that supplies media data including video data and audio data.
[0041] The source device (2) may include a port for coupling with a connector that performs a connection with the gateway device (1). Here, the connector may include HDMI, DisplayPort, etc.
[0042] Additionally, the source device (2) may include at least one processor for controlling the operation of the source device (2) and at least one memory in which a program for controlling the operation of the source device (2) is stored.
[0043] The sink device (3) may include a media device that outputs images or sounds based on media data supplied from the source device (2). The sink device (3) may include a TV, monitor, etc. that includes a display that outputs images and a speaker that outputs sounds.
[0044] The sink device (3) may include a communication module capable of communicating with a source device (2) or a gateway device (1), a user interface for receiving user input or outputting information to a user, at least one processor for controlling the operation of the sink device (3), and at least one memory in which a program for controlling the operation of the sink device (3) is stored.
[0045] A gateway device (1) may include a communication module capable of communicating with another gateway device (1), a source device (2), or a sink device (3), at least one processor (31) capable of processing data received from another gateway device (1), a source device (2), or a sink device (3), and at least one memory (32) capable of storing a program for processing data or processed data.
[0046] These gateway devices (1) can be implemented as various computing devices such as workstations, clouds, data drives, data stations, etc. The gateway devices (1) can be implemented as one or more gateway devices (1) that are physically or logically separated based on function, detailed configuration of function, or data, etc., and can transmit and receive data and process the transmitted and received data through communication between each gateway device (1).
[0047] The gateway device (1) can perform functions such as managing user accounts, registering source devices (2) and sink devices (3) by linking them to user accounts, and managing or controlling the registered source devices (2) and sink devices (3).
[0048] For example, a user can access the gateway device (1) through the user interface of the sink device (3) and create a user account. The user account can be identified by an ID and password set by the user. The gateway device (1) can register the source device (2) and the sink device (3) to the user account according to a set procedure. For example, the gateway device (1) can register, manage, and control the source device (2) or the sink device (3) by linking the identification information (e.g., serial number or MAC address) of the source device (2) or the sink device (3) to the user account.
[0049] In addition, the user can perform functions such as managing or controlling the source device (2) or sink device (3) as described above through the interface unit (20) included in the gateway device (1) as described below.
[0050] Additionally, the gateway device (1) can communicate with at least one server. The server mentioned here may include a server for performing wireless communication with the sink device (3), another server for performing communication with a user device, etc.
[0051] The functions of managing or controlling the aforementioned source device (2) or sink device (3), and a series of controls of the gateway device (1) for handshaking of the present invention described later, can also be performed through a user device.
[0052] This means that users can access a single server via their device and create a user account. The user account can be identified by a user ID and password set by the user.
[0053] The server can register a gateway device (1), a source device (2), or a sink device (3) to a user account according to a set procedure. For example, the server can register, manage, and control a gateway device (1), a source device (2), or a sink device (3) by linking identification information (e.g., serial number or MAC address) of the gateway device (1), the source device (2), or the sink device (3) to a user account.
[0054] The user device may include a communication module capable of communicating with a gateway device (1), a source device (2), a sink device (3) or a server (3), a user interface for receiving user input or outputting information to a user, at least one processor for controlling the operation of the user device, and at least one memory storing a program for controlling the operation of the user device.
[0055] The user device may be carried by the user or placed in the user's home or office. The user device may include, but is not limited to, a personal computer, a terminal, a portable telephone, a smart phone, a handheld device, a wearable device, etc.
[0056] The memory of the user device may store a program, i.e., an application, for controlling the gateway device (1), source device (2), or sink device (3). The application may be sold installed on the user device or downloaded and installed from an external server.
[0057] A user can access a server by executing an application installed on a user device, create a user account, and perform communication with the server based on the logged-in user account to register a gateway device (1), source device (2), or sink device (3).
[0058] For example, when the gateway device (1), source device (2), or sink device (3) is operated according to the procedure guided by the application installed on the user device so that the gateway device (1), source device (2), or sink device (3) can be connected to the server, the gateway device (1), source device (2), or sink device (3) can be registered in the user account by registering the identification information (e.g., serial number or MAC address) of the gateway device (1), source device (2), or sink device (3) in the corresponding user account on the server.
[0059] A user can control a gateway device (1), a source device (2), or a sink device (3) using an application installed on the user device. For example, when a user logs into a user account using an application installed on the user device (2), a gateway device (1), a source device (2), or a sink device (3) registered to the user account appears, and when a control command for the gateway device (1), the source device (2), or the sink device (3) is input, the control command can be transmitted to the gateway device (1), the source device (2), or the sink device (3) via the server.
[0060]
[0061] The gateway device (1) can be connected to at least one source device (2) by wire and can be connected wirelessly to at least one sink device (3). Wired connection methods may include HDMI, DisplayPort, etc. In addition, wireless connection methods may include WiBro, Bluetooth (IEEE 802.15.1), Zigbee (IEEE 802.15.4), Wi-Fi AP (Wi-Fi Access Point), Wi-Fi Direct, NFC (Near Field Communication), Z-Wave, etc.
[0062] When the source device (2) supplies media data using a wired transmission method, detailed specifications including performance information of the sink device (3) can be transmitted to the source device (2), and the source device (2) can supply high-quality media data through a rendering process so that audio or video can be output at the optimal quality from among several rendering options that the source device (2) can provide based on the performance information.
[0063] On the other hand, when the source device (2) supplies media data using a wireless transmission method, unlike the aforementioned wired transmission method, the media data can only be transmitted with predetermined, limited specifications regardless of the performance of the sink device (3). Accordingly, no matter how high the sink device (3) supports, the quality of the video and audio that can be viewed or heard is inevitably low.
[0064] Recently, wireless transmission methods have inevitably emerged, and accordingly, the present invention aims to transmit media data having optimal specifications that can maximize the performance of the source device (2) and the sink device (3) by adopting a separate configuration called a gateway device (1) between the source device (2) and the sink device (3).
[0065]
[0066] The gateway device (1) may include a communication unit (10), an interface unit (20), and a control unit (30).
[0067] The communication unit (10) can communicate with at least one sink device (3), at least one source device (2), and other external devices. That is, through the communication unit (10), each of the source device (2) and the sink device (3) can receive data from the gateway device (1) or transmit data to the gateway device (1). In addition, as a representative example of other external devices, data can be received from a remote control or a user device that can remotely control the gateway device (1).
[0068] Accordingly, the communication unit (10) may include a configuration capable of wired and wireless connection. For example, it may include a communication port for wired connection with the connector of the source device (2).
[0069] In addition, it may include a wireless communication circuit for connecting to a wireless network through an access point (AP) or for Wi-Fi direct connection to connect wirelessly to the sink device (3).
[0070] Data transmitted and received through the communication unit (10) may include identification information for identifying a source device (2), performance information for identifying a sink device (3), a selection signal of a source device (2) input by a user, network profile information for implementing a wireless transmission method, and media data for outputting images or voices.
[0071] The interface unit (20) can receive user input or output information to the user.
[0072] For example, the interface unit (20) can receive a selection signal corresponding to a user's input for selecting a source device (2) to supply media data from among at least one wired source device (2). In addition, the interface unit (20) can receive a selection signal corresponding to a user's input for selecting a sink device (3) to output media from among at least one wirelessly connected sink device (3).
[0073] Additionally, the interface unit (20) can obtain environmental information from the user indicating information about the space where wireless communication is performed with the sink device (3).
[0074] The environmental information may include at least one of the number of obstacles located on the wireless communication path to the sink device (3), the distance to the sink device (3), and the direction of the antenna.
[0075] At least one meaning above means that it can include the number of obstacles located on the path to the sink device (3), the distance from the sink device (3), the direction of the antenna, the number of obstacles located on the path to the sink device (3) and the distance from the sink device (3), the number of obstacles located on the path to the sink device (3) and the direction of the antenna, the distance from the sink device (3) and the direction of the antenna, and a case that includes all three configurations.
[0076] The interface unit (20) can be provided using an input interface and an output interface.
[0077] The input interface may include keys, a touch screen, a microphone, etc. The input interface may receive user input and transmit it to the processor (31).
[0078] The output interface may include a display, a speaker, etc. The output interface may output various notifications, messages, information, etc. generated by the processor (31).
[0079]
[0080] Each piece of information received through the communication unit (10) can be transmitted to the control unit (30).
[0081] The control unit (30) is electrically connected to the communication unit (10) and the interface unit (20) and can control the communication unit (10) and the interface unit (20). The control unit (30) can include at least one processor (31) for controlling the communication unit (10) and the interface unit (20) and at least one memory (32) for storing data received through the communication unit (10) and the interface unit (20).
[0082] The memory (32) and the processor (31) may be implemented as separate chips. The processor (31) may include one or more processor (31) chips or one or more processing cores. The memory (32) may include one or more memory (32) chips or one or more memory (32) blocks. In addition, the memory (32) and the processor (31) may be implemented as a single chip.
[0083] The processor (31) can process user input of the interface unit (20) and control the operation of the interface unit (20) according to a program and / or data stored / memorized in the memory (32). The processor (31) can receive user input from the interface unit (20). In addition, the processor (31) can transmit an output signal and image data for outputting an image or voice to the interface unit (20) in response to the user input to the interface unit (20).
[0084] In Fig. 1, a case in which there is one gateway device (1) is exemplified, but this is not limited to the case, and a plurality of gateway devices (1) may be configured.
[0085]
[0086] Figure 2 is a flowchart illustrating a method for controlling a server according to one embodiment.
[0087] Referring to Fig. 2, the control method of the gateway device (1) can be broadly divided into three stages: initial connection (210) - device selection (220) - data processing and transmission (230).
[0088] The first step is to perform the initial physical connection with each source device (2) and each sink device (3) (210).
[0089] As described above, the initial connection between the gateway device (1) and the source device (2) can be performed via the communication unit (10) when the user connects the two devices with a wire (211).
[0090] Meanwhile, in the case where there are multiple gateway devices (1), the user can determine which source device (2) to connect to each gateway device (1) among the multiple gateway devices (1) by wire.
[0091] For example, if there are a first gateway device (1) and a second gateway device (1) capable of performing handshaking, and there are source devices A and B that supply audio data, source devices C that supply video data, and source devices D, a user can connect source devices A and B that supply audio data to the first gateway device (1) by wire, and connect source devices C and D that supply video data to the second gateway device (1) by wire.
[0092] When configured with multiple gateway devices (1) as above, the source device (2) can be connected differently depending on the type of media data supplied to each gateway device (1) or depending on the media data that the user wants to be supplied to each gateway device (1).
[0093] As described above, the initial connection between the gateway device (1) and the sink device (3) can be performed via the communication unit (10) when the user wirelessly connects the two devices (212). For example, the user may select to connect the gateway device (1) to the sink device (3) among the connectable devices connected to the wireless network.
[0094] In order for the user to select the gateway device (1) from the sink device (3), a manual for wireless connection may be output via the interface unit (20). The output may be in the form of video or audio, and it is sufficient that the user can recognize a connectable device connected to the wireless network, and there are no restrictions on the method of expression.
[0095] Selection methods may include, but are not limited to, input dials, input buttons, remote control input, touch screen panels, voice recognition, etc.
[0096] Here, when performing a wireless connection via remote control input, the remote control may be pre-connected to the gateway device (1). Accordingly, the control unit (30) can automatically connect the remote control and the gateway device (1) via the communication unit (10), thereby directly controlling the gateway device (1) via remote control operation, thereby performing a wireless connection with the sink device (2).
[0097] In addition, if the remote control and the gateway device (1) are not connected in advance and automatic connection is not performed, the control unit (30) can perform separate settings so that the remote control and the gateway device (1) are connected wirelessly through the communication unit (10).
[0098] In order to wirelessly connect a gateway device (1) and a remote control, a manual for selecting a remote control to be connected may be output through the interface unit (20) of the gateway device (1). The output format may be video or audio, and it is sufficient for the user to be able to recognize a connectable remote control, and there are no restrictions on the method of expression.
[0099] Selection methods may include, but are not limited to, input dials, input buttons, touch screen panels, voice recognition, etc.
[0100] For example, a manual is provided that asks the user whether the Bluetooth of the remote control has been detected and connected through the interface unit (20) of the gateway device (1), and the user can input a remote control connection signal through a touch screen panel or voice recognition unit provided in the interface unit (20). Accordingly, a wireless connection between the remote control and the gateway device (1) can be performed.
[0101] Additionally, in order to allow the user to select the gateway device (1) from the sink device (3), a selection manual may be output through the user interface of the sink device (3). The output format may be video or audio, and it is sufficient that the user can recognize the sink device (3) as a connectable device connected to a wireless network, and there is no limitation on the method of expression.
[0102] Selection methods may include, but are not limited to, input dials, input buttons, remote control input, touch screen panels, voice recognition, etc.
[0103] When selecting via remote control input here, the remote control may be pre-connected to the sink device (3). That is, the remote control can transmit the user's input signal to the sink device (3) via the user interface of the sink device (3).
[0104] Meanwhile, when the sink device (3) and the gateway device (1) are connected wirelessly, the control unit (30) of the gateway device (1) according to one embodiment can receive network profile information from the sink device (3) through the communication unit (10), and the memory (32) can store the received network profile information.
[0105] Network profile information is information for the control unit (30) of the gateway device (1) to identify the sink device (3) on the wireless network, and may include IP address, MAC (Media Access Control) address, SSID (Service Set Identifier), port information, etc.
[0106] In addition, in order to set the gateway device (1) and the sink device (3) to be automatically connected wirelessly, the control unit (30) can receive a constant connection signal from the sink device (3) through the communication unit (10). In addition, the memory (32) can store automatic connection permission information corresponding to the received constant connection signal.
[0107] As above, by storing and managing network profile information, when a user attempts to reconnect a sink device (3) and a gateway device (1) after the sink device (3) is initially connected to the gateway device (1), the sink device (3) and the gateway device (1) can be set to automatically connect when both the sink device (3) and the gateway device (1) are powered on without the user having to perform separate control for wireless connection. This is because the server (1) stores all information required for wireless connection between the gateway device (1) and the sink device (3).
[0108] Meanwhile, in case there are multiple gateway devices (1), the user can select which sink device (3) to wirelessly connect to each gateway device (1) among the multiple gateway devices (1).
[0109] That is, the initial wireless connection between the sink device (3) and each gateway device (1) can be performed by selecting and connecting the gateway device (1) to be connected to each sink device (3) from among multiple gateway devices (1) connected to the wireless network from each sink device (1). Here, the number of gateway devices (1) connected to each sink device (3) can also be multiple.
[0110] For example, if there are a first gateway device (1) and a second gateway device (1) capable of performing handshaking, and there are a sink device X and a sink device Y, a user can wirelessly connect to the first gateway device (1) from the sink device X, and wirelessly connect to the second gateway device (1) from the sink device Y. In addition, the user can wirelessly connect to the first gateway device (1) and the second gateway device (1) from the sink device X.
[0111] When configured with multiple gateway devices (1) as above, each gateway device (1) can be connected to a different sink device (3) depending on the type or specification of the media output or according to the user's preference.
[0112] Referring to FIG. 2, the second step is a step in which the user selects a source device (2) to supply media data and a sink device (3) to receive media data (220).
[0113] That is, the user can select at least one sink device (3) to receive media data among wirelessly connected sink devices (3), and select at least one source device (2) to supply media data among wiredly connected source devices (2).
[0114] In order to allow the user to select some of the connected source devices (2) and sink devices (3), the gateway device (1) needs to receive information that can identify the source device (2) and sink device (3) through the communication unit (10).
[0115] In order to implement the above steps, the control unit (30) of the gateway device (1) according to one embodiment can receive identification information of a wired source device (2) through the communication unit (10) (221).
[0116] Specifically, the control unit (30) can determine whether the source device (2) is operable based on a power-on signal supplied from a power pin of a connector connected to the source device (2). In addition, if the control unit (30) determines that the source device (2) is operable, the control unit (30) can receive identification information from the source device (2) via the communication unit (10).
[0117] Here, the identification information of the source device (2) may include at least one metadata (SPDIF; Source Product Description InfoFrame) related to the product and manufacturer.
[0118] Figure 3 illustrates metadata containing information related to a source device.
[0119] Referring to Fig. 3, the left column of Fig. 3 represents the item names contained in the metadata, and the right column represents the descriptions of the item names. That is, the format of the metadata according to Fig. 3 is 0x03, the version is 0x01, and the length of the metadata is 25 bytes. In addition, bytes 1 to 8 may represent information related to the manufacturer according to 7-bit ASCII code, and bytes 9 to 24 may represent information related to the product according to 7-bit ASCII code.
[0120] Manufacturer-related information may include the manufacturer name of the source device. Product-related information may include the product name, model name, serial number, and specifications of the source device.
[0121] In addition, the control unit (30) of the gateway device (1) according to one embodiment can receive performance information of a wirelessly connected sink device (3) through the communication unit (10) (222).
[0122] Additionally, the control unit (30) can store performance information of the wirelessly connected sink device (3) in the memory (32) (223).
[0123] Performance information here may include EDID (Extended Display Identification data) and communication performance information.
[0124] EDID is a data standard that conveys AV specifications supported by display devices such as TVs, monitors, and projectors to video sources.
[0125] That is, EDID can contain information related to the media formats that the sink device (3) can output.
[0126] The latest version of EDID is EDID 1.4, and EDID 1.2 and later are generally referred to as E-EDID (Enhanced EDID), but the EDID in this specification includes all E-EDID.
[0127] Figure 4 illustrates the basic data format of EDID 1.4, which stores specification information of a sink device.
[0128] Referring to Fig. 4, the EDID of the sink device (3) may include information related to details such as the manufacturer, product, video input support, and video timing. The basic data size of EDID is 128 bytes, and more information can be stored through 126 additional extended data designations, and the size of each extended data may be 32 bytes. The maximum size of EDID may be limited to 32 kilobytes.
[0129] CTA-861, HDMI, etc. can be customized through a dedicated data block format in EDID, and various extension data used in the CTA-861 standard can include more detailed information than the specification information exemplified in Fig. 6, such as supported audio / video format information, vendor-exclusive feature information, speaker / room information for multi-channel audio, and static / dynamic HDR metadata.
[0130] Communication performance information is information for estimating the possible bandwidth through which the sink device (3) can receive media data from the gateway device (1).
[0131] Communication performance information may include Wi-Fi version, frequency band, MU-MIMO (Multiple User-Multiple Input Multiple Output) information, antenna information, or other metadata.
[0132] For example, the version of Wi-Fi may include information about the specifications of Wi-Fi supported by the device, and may include information related to protocols such as IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, IEEE 802.11n, IEEE 802.11ac, IEEE 802.11ax, IEEE 802.11be, or versions such as WifI 4, 5, 6, 6E, and 7.
[0133] Additionally, the frequency band may include information related to the radio frequency used by the device, such as frequency information such as 2.4 GHz, 5 GHz, 6 GHz, or whether multiple bands are supported.
[0134] MU-MIMO stands for Multi-User Multiple Input Multiple Output, and refers to the ability to transmit and receive data to multiple devices simultaneously. MU-MIMO specifications include 2X2, 3X3, and 4X4. The numbers indicate the number of antennas in the base station and terminal. For example, 4X4 means 4 antennas in the base station and 4 antennas in the terminal.
[0135] Information related to the antenna may include metadata such as whether it is directional, whether it supports beamforming, and whether it supports band aggregation.
[0136] Meanwhile, when wireless communication with the sink device (3) passes through a communication relay device such as a Wi-Fi AP or extender, the gateway device (1) can obtain communication performance information of the communication relay device from the communication relay device in addition to the communication performance information of the sink device (3). This is because, during the wireless transmission process, the performance of the entire communication may be degraded depending on the performance of the communication relay device as it passes through the communication relay devices.
[0137] As described below, the control unit (30) can determine the maximum transmission bandwidth for the wireless transmission path between the sink device (3) and the gateway device (1) based on the communication performance information of each communication relay device used for wireless communication, including the sink device (3).
[0138]
[0139] The user may select the source device (2) and the sink device (3) through the interface unit (20) of the gateway device (1) or through the user interface of the sink device (3).
[0140] Referring again to FIG. 2, the gateway device (1) can generate list information of the source device (2) based on the identification information received from the source device (2) and store it in the memory (32) (224).
[0141] In addition, in order for a user to select a sink device (3) through the interface unit (20) of the gateway device (1), the control unit (30) can generate list information of wirelessly connected sink devices (3) based on performance information of the wirelessly connected sink devices (3), and the gateway device (1) can store this in the memory (32) (225).
[0142] Fig. 5 illustrates selecting a source device (2) and a sink device (3) through the interface section (20) of the gateway device (1).
[0143] Referring to (a) of Fig. 5, the control unit (30) can output the list information of wirelessly connected sink devices (3) stored in the memory (32) to the interface unit (20).
[0144] The output format may be video or audio, and is not limited in the method of expression as long as the user can perceive the performance information about the sink device (3).
[0145] Referring to (b) of Fig. 5, in order to allow a user to select a source device (2) through the interface unit (20) of the gateway device (1), the control unit (30) can output the generated source device (2) list information to the interface unit (20) of the gateway device (1).
[0146] The output format may be video or audio, and is not limited to the method of expression as long as the user can recognize the information about the source device (2).
[0147] The user can select a sink device (3) to receive media data from the gateway device (1) based on the list information of the sink device (3) output to the interface unit (20).
[0148] Additionally, the user can select a source device (2) to supply media data to each previously selected sink device (3) based on the list of source devices (2) output to the interface unit (20).
[0149] Selection methods may include, but are not limited to, input dials, input buttons, remote control input, touch screen panels, voice recognition, etc.
[0150] Here, when selecting a source device (2) and a sink device (3) via remote control input, the remote control may be pre-connected to the gateway device (1). Accordingly, the control unit (30) can automatically connect the remote control and the gateway device (1) via the communication unit (10), thereby directly controlling the gateway device (1) via remote control operation.
[0151] The communication method between the remote control and the gateway device (1) may include various communication methods such as BT (Bluetooth), BLE (Bluetooth Low Energy), WI-FI (Wireless Fidelity), Zigbee, IR (Infrared), Serial Interface, USB (Universal Serial Bus), NFC (Near Field Communication), etc.
[0152] Accordingly, the communication unit (10) can receive any one of an IR signal, a BT signal, a BLE signal, and a Zigbee signal, and is not limited thereto, and can receive signals in various frequency ranges.
[0153] In addition, if the remote control and the gateway device (1) are not connected in advance and automatic connection is not performed, the control unit (30) can perform separate settings so that the remote control and the gateway device (1) are connected wirelessly through the communication unit (10).
[0154] In order to wirelessly connect the gateway device (1) and the remote control, a selection manual can be output through the interface unit (20) of the gateway device (1). The output format can be video or audio, and it is sufficient if the user can recognize the connectable remote control, and there are no restrictions on the method of expression.
[0155] Selection methods may include, but are not limited to, input dials, input buttons, touch screen panels, voice recognition, etc.
[0156] For example, a manual is provided that asks the user whether the Bluetooth of the remote control has been detected and connected through the interface unit (20) of the gateway device (1), and the user can input a remote control connection signal through a touch screen panel or voice recognition unit provided in the interface unit (20). Accordingly, a wireless connection between the remote control and the gateway device (1) can be performed.
[0157] Accordingly, the gateway device (1) can receive a user's sink device (3) selection signal through the interface unit (20), and the gateway device (1) can receive a user's source device (2) selection signal through the interface unit (20) (226).
[0158] Fig. 6 illustrates selecting a source device (2) and a sink device (3) through the user interface of the sink device (3).
[0159] Referring to FIG. 2, the difference between selecting a source device (2) and a sink device (3) through the interface section (20) of the gateway device (1) of FIG. 5 and selecting through the user interface of the sink device (3) of FIG. 6 will be explained.
[0160] When selecting a source device (2) and a sink device (3) through the interface section (20) of the gateway device (1), the gateway device (1) must manage a list of sink devices (3), so a step (225) of creating and storing list information of the sink devices (3) may be performed.
[0161] However, when selecting through the user interface of the sink device (3), instead of the step (225) of generating and storing the list information of the sink device (3), a step of transmitting the list information of the source device (2) to the sink device (3) is required.
[0162] Below, we will specifically describe the selection through the user interface of the sink device (3), including the step of transmitting the list information of the source device (2) to the sink device (3).
[0163] Referring to FIG. 6, in order to allow a user to select a source device (2) through a user interface of a sink device (3), the control unit (30) can transmit list information of the source device (2) to a wirelessly connected sink device (3) through a communication unit (10).
[0164] The sink device (3) can output the list information of the source device (2) transmitted from the gateway device (1) through the user interface of the sink device (3).
[0165] The user can select a source device (2) from which media data is to be supplied through the sink device (3) based on the list information of source devices (2) output to the sink device (3).
[0166] In order to allow a user to select a source device (2) from a sink device (3), a selection manual may be output via the user interface of the sink device (3). The output format may be video or audio, and it is sufficient if the user can recognize the list information of the source device (2), and there are no restrictions on the method of expression.
[0167] Selection methods may include, but are not limited to, input dials, input buttons, remote control input, touch screen panels, voice recognition, etc.
[0168] When selecting via remote control input here, the remote control may be pre-connected to the sink device (3). That is, the remote control can transmit the user's input signal to the sink device (3) via the user interface of the sink device (3).
[0169] Accordingly, the control unit (30) can receive a user selection signal for at least one source device (2) from the sink device (3) through the communication unit (10).
[0170] The sink device (3) into which the selection signal for the source device (2) is input from the user corresponds to the sink device (3) from which the user desires to output media data in the form of audio or video. Consequently, the gateway device (1) can simultaneously obtain the selection signal for the sink device (3) desired by the user by obtaining the selection signal for the source device (2) desired by the user from the sink device (3) desired by the user.
[0171] Therefore, the user's selection of the source device (2) and sink device (3) can be implemented.
[0172] The control unit (30) can transmit performance information of the selected sink device (3) to each of at least one source device (2) based on a selection signal for the source device (2) (227).
[0173] That is, when the gateway device (1) receives a selection signal for the source device (2) and the sink device (3) from the interface unit (20) or the user interface of the sink device (3), it can transmit performance information of the selected sink device (3) to the selected source device (2).
[0174] Here, the performance information of the sink device (3) transmitted to the selected source device (2) refers to the performance information of the sink device (3) that transmitted the source device (2) selection signal among the performance information of the wirelessly connected sink devices (3) stored in the memory (32).
[0175] Fig. 7 is a flowchart showing a method for modifying the EDID of a sink device (3) according to one embodiment.
[0176] Referring to FIG. 7, the gateway device (1) can modify the EDID of the selected sink device (3) transmitted to the selected source device (2).
[0177] The step of modifying the EDID according to FIG. 7 may be performed between the step (226) of receiving a user selection signal in FIG. 2 and the step (227) of transmitting performance information of the selected sink device to the selected source device.
[0178] That is, the control unit (30) can appropriately modify the EDID of the selected sink device (3) through the communication unit (10) as described below and then transmit it to the selected source device (2).
[0179] The control unit (30) can obtain performance information of the sink device (3) from the sink device (3) through the communication unit (10). In addition, the control unit (30) can also obtain performance information of a selected sink device (3) from among the performance information of the sink devices (3) stored in the memory (32). (710)
[0180] Here, the performance information may include EDID including the outputtable format of the sink device (3) and communication performance information, as described above.
[0181] The control unit (30) can obtain user input regarding environmental information from the user through the interface unit (20) (720).
[0182] Here, environmental information refers to information about the space where wireless communication is performed with the sink device (3). For example, the environmental information may include at least one of the number of obstacles located on the wireless communication path to the sink device (3), the distance from the sink device (3), and the direction of the antenna.
[0183] The control unit (30) can determine the current maximum transmission speed in the wireless communication environment with the sink device (3) based on the acquired communication performance information and environmental information of the sink device (3) (730).
[0184] FIG. 8 is a flowchart illustrating a method for determining a current maximum transmission speed according to one embodiment.
[0185] Referring to FIG. 8, the control unit (30) can first determine the theoretical maximum transmission speed in order to determine the current maximum transmission speed.
[0186] The control unit (30) can obtain communication performance information of the sink device (3) according to the method described above (810).
[0187] Next, the control unit (30) can determine whether a communication relay device is additionally used in addition to the sink device (3) along the wireless communication path (820). In the case of performing wireless communication solely with the sink device (3) without using a communication relay device, the theoretical maximum transmission speed can be determined based solely on the communication performance information of the sink device (3) (821).
[0188] However, when passing through a communication relay device, the control unit (30) can additionally obtain communication performance information from the communication relay device through the communication unit (10) (822). In this case, the control unit (30) can determine the theoretical maximum transmission speed based on both the communication performance information of the sink device (3) and the communication performance information of the communication relay device (823).
[0189] Let's explain specifically how to determine the theoretical maximum transmission speed.
[0190] Specifically, the processor (31) can calculate the theoretical maximum transmission speed using the communication performance information stored in the memory (32) and a conversion table indicating the corresponding maximum transmission speed.
[0191] If the acquired communication performance information is not included in a pre-stored conversion table, the processor (31) can calculate the theoretical maximum transmission speed based on the communication performance information included in the conversion table.
[0192] That is, the theoretical maximum transmission speed is defined as being proportional to the number of antennas and the bandwidth (channel width), and the theoretical maximum transmission speed corresponding to the communication performance information included in the conversion table can be calculated by multiplying the theoretical maximum transmission speed corresponding to the communication performance information included in the conversion table by a multiple of the number of antennas and the bandwidth of the acquired communication performance information.
[0193] Figure 9 is an example of a conversion table showing the theoretical maximum transmission speed corresponding to communication performance information.
[0194] Referring to FIG. 9, the theoretical maximum transmission speed can be determined according to the mode corresponding to the protocol of Wi-Fi and the number and bandwidth of antennas.
[0195] For example, if the control unit (30) obtains communication performance information in a mode in which the Wi-Fi protocol is 802.11ax, the number of antennas is 2X2, and the bandwidth is 80 MHz, the corresponding theoretical maximum transmission speed can be determined to be 1200 Mbps.
[0196] However, when the control unit (30) obtains communication performance information of a communication device having a Wi-Fi protocol of 802.11ax, a number of antennas of 4X4, and a bandwidth of 80MHz, there may be cases where the theoretical maximum transmission speed corresponding to the above communication performance information is not described in the conversion table as in FIG. 9.
[0197] In this case, the control unit (30) can determine the theoretical maximum transmission speed corresponding to the communication performance information of the mode in which the Wi-Fi protocol described in the conversion table is 802.11ax, the number of antennas is 2X2, and the bandwidth is 80MHz, by using the fact that the theoretical maximum transmission speed is 1200 Mbps.
[0198] That is, since the number of antennas is doubled and the bandwidth is the same, the control unit (30) can determine 2400 Mbps as the theoretical maximum transmission speed by multiplying 1200 Mbps by 2.
[0199] Meanwhile, when there are multiple communication devices including a sink device (3), the control unit (30) can determine the theoretical maximum transmission speed for each communication device according to the method described above.
[0200] The control unit (30) can determine the lowest theoretical maximum transmission speed of each communication device as the theoretical maximum transmission speed of the entire wireless transmission path. This is because the slowest speed section becomes the bottleneck section, and the speed of the entire path is determined based on that section.
[0201] The control unit (30) can determine the current maximum transmission speed based on the determined theoretical maximum transmission speed and the current wireless communication operating environment. In other words, the current maximum transmission speed refers to the practical maximum transmission speed that takes into account the wireless transmission operating environment.
[0202] The difference between the theoretical maximum transmission rate and the current maximum transmission rate can be primarily due to signal attenuation due to distance or obstacles, as well as interference from Wi-Fi bandwidth sharing. Interference from Wi-Fi bandwidth sharing is based on the number of users, which varies over time, making it difficult to use as a variable. Therefore, it is excluded. In this invention, spatial factors such as signal attenuation due to distance or obstacles are considered.
[0203] Referring again to FIG. 8, the control unit (30) can obtain environmental information corresponding to the current wireless communication driving environment from the user through the interface unit (20) (830).
[0204] Additionally, the control unit (30) can determine an attenuation ratio based on the acquired environmental information (840). The attenuation ratio represents a rate of decrease that takes into account spatial factors of the actual operating environment of wireless communication when determining the current maximum transmission speed based on the theoretical maximum transmission speed.
[0205] The spatial factors referred to here may include, as described above, the number of obstacles on the path of wireless communication, the distance to the sink device (3), and the direction of the antenna.
[0206] Therefore, the control unit (30) can determine the current maximum transmission speed by applying the attenuation ratio to the determined theoretical maximum transmission speed (840).
[0207] Fig. 10 is an example showing the current maximum transmission speed corresponding to the driving environment of wireless transmission according to one embodiment.
[0208] Fig. 10 (a) is a drawing showing the locations of a gateway device (1) and a sink device (3) according to one embodiment within a home, and Fig. 10 (b) is a graph showing an example of the trend of the maximum transmission speed according to the location of the sink device (3).
[0209] Referring to (a) of Fig. 10, a gateway device (1) is installed in area G (1001) in a living room (1010). A sink device (3) is installed in the same living room (1010) as area G (1001), in a living room (1020) through which one door passes on a wireless transmission path, in a bathroom (1030) through which two doors pass, and in an entrance (1040) through which three doors pass.
[0210] It is assumed that as you go from the bedroom (1010), living room (1020), bathroom (1030), to the entrance (1040), the number of obstacles such as doors on the wireless transmission path increases, and the distance of the wireless transmission path also increases.
[0211] The maximum transmission speed corresponding to the position of each sink device (3) is shown in (b) of Fig. 10. Referring to (b) of Fig. 10, the X-axis represents the number of (a) of Fig. 10 according to the position of each sink device (3), and the Y-axis represents the signal strength when the signal transmitted from the gateway device (1) is received by the sink device (3) as a logarithmic function. It can be seen that the stronger the received signal strength, the higher the maximum transmission speed.
[0212] Referring to (b) of Fig. 10, when the sink device (3) is located in the living room (1010), which is the space closest to the gateway device (1), it has the highest maximum transmission speed (1011).
[0213] Additionally, it can be confirmed that the maximum transmission speed becomes increasingly lower as the distance from the gateway device (1) increases or as the number of obstacles such as doors increases. Accordingly, it can be confirmed in (b) of Fig. 10 that the maximum transmission speed decreases in the order of the living room (1021), bathroom (1031), and entrance (1041).
[0214] In this way, in order to derive the current maximum transmission speed by considering the above effects, the control unit (30) can determine an attenuation ratio corresponding to the operating environment of the wireless transmission. In addition, the control unit (30) can determine the current maximum transmission speed by multiplying the determined attenuation ratio by the theoretical maximum transmission speed.
[0215] For example, when there are multiple spaces divided by doors or walls, the attenuation ratio for use within a space can be set to 0.4, and the attenuation ratio for use between spaces divided by a single door or wall can be determined to be 0.2.
[0216] Accordingly, referring to FIG. 9, in the case of a mode in which the Wi-Fi protocol is 802.11ac wave1, the number of antennas is 2X2, and the bandwidth is 80MHz, the theoretical maximum transmission speed is 866Mbps, but the current maximum transmission speed can be determined to be 346.4Mbps by applying an attenuation ratio of 0.4 for use within a space, and 173.2Mbps by applying an attenuation ratio of 0.2 for use between spaces partitioned by a single door or wall.
[0217] FIG. 11 is an example of a table showing actual measured values of the current maximum transmission speed that varies depending on the distance to the sink device (3) and the angle of the antenna in an environment where wireless communication is performed with the sink device (3) according to one embodiment.
[0218] Here, the antenna angle refers to the angle formed by the directions of the antennas of the sink device (3) and the gateway device (1) that exchange communications. For example, 0 degrees means that the antennas of the two devices are facing each other, 180 degrees means that they are pointing in the same direction, and values in between mean that they are pointing in different directions depending on the angle formed.
[0219] Looking at the actual measurements in Figure 11, we can see that the original performance is maintained up to 2 m, performance increases due to reflected waves at 5 m, and performance tends to deteriorate at 10 m. Furthermore, the antenna angle is 90 degrees, and when misaligned, performance tends to deteriorate rapidly.
[0220] Accordingly, based on actual measurement data such as in Fig. 11, a conversion table or look-up table for the attenuation ratio in each driving environment can be created, and by using the conversion table, the attenuation ratio corresponding to the driving environment can be determined.
[0221] The above mentioned attenuation ratio figures are only examples and are not limited thereto, and any method that can be determined differently depending on the driving environment is possible.
[0222]
[0223] Next, a method for determining a transmittable media format based on the determined current maximum transmission speed is described.
[0224] The control unit (30) can determine a media format that can be transmitted wirelessly among the media formats included in the EDID of the sink device (3) based on the determined current maximum transmission speed.
[0225] The media format included in EDID is something that the sink device (3) can process, but considering the current maximum transmission speed, there may be media formats that cannot be transmitted.
[0226] Referring again to FIG. 7, first, the control unit (30) can determine the required bit rate for wireless transmission to the sink device (3) in an outputtable media format included in the EDID of the sink device (3) (740).
[0227] The control unit (30) compares the requested bit rate determined here with the previously determined current maximum transmission rate (750), and if the requested bit rate is lower than the current maximum transmission rate, the media format can be determined as a media format that can be transmitted. In addition, the control unit (30) can determine the media format as a media format that cannot be transmitted if the requested bit rate exceeds the current maximum transmission rate (760).
[0228] Determining the required bit rate for an outputtable media format included in the EDID of the sink device (3) may be done by using a conversion table that defines the media format and its corresponding bit rate.
[0229] That is, the memory (32) can store the bit rate required for all media formats that the gateway device (1) can process based on the processing performance of the gateway device (1). In addition, the bit rate can be metadata in the form of a conversion table as described above.
[0230] If there is a media format among the media formats included in the EDID of the sink device (3) whose bit rate is not defined in the conversion table, the control unit (30) can determine the bit rate by calculating it by considering the performance difference such as frame size and frame rate based on the media format defined in the conversion table.
[0231] For example, you can decide to reflect the ratio of frame size as it is in the bit rate, the ratio of frame rate as 2:1.3, and the ratio of H.264 codec to HEVC codec as 2:1.
[0232] Figure 12 is an example of a conversion table defining the bit rate required to transmit a media format.
[0233] The VIC (Video Identification Code) in Fig. 12 refers to code information that indexes the video format of CTA-864-H, an extended standard of EDID. Referring to Fig. 12, the bit rate for each VIC can be confirmed.
[0234] Referring to Figure 12, it can be confirmed that the bit rate of 1920x1080p, 60Hz HEVC, which is VIC 16, is 15Mbps. In this case, the bit rate of 3840x2160p, 60Hz HEVC, which has a frame size 4 times larger, can be determined as 60Mbps by applying 4 times as much.
[0235] Also, the bit rate of 3840x2160p, 120Hz HEVC can be determined as 78Mbps by applying 1.3 times the frame rate of 3840x2160p, 60Hz HEVC because the bit rate is twice as high.
[0236] Also, the bit rate of 7680x4320p, 60Hz H.264 is 4 times that of 3840x2160p, 60Hz HEVC, and since it is an H.264 codec, it can be determined as 480Mbps, which is 8 times in total by applying 2 times more.
[0237] In this case, in the example above, if the Wi-Fi protocol is 802.11ac wave1, the number of antennas is 2X2, and the bandwidth is 80MHz, and the attenuation ratio is 0.2 applied to the space partitioned by one door or wall, and the current maximum transmission speed is determined to be 173.2Mbps, a media format that requires a bit rate exceeding 173.2Mbps may be determined as an untransmittable media format. Accordingly, 7680x4320p, 60Hz H.264, which is 480Mbps above, or 240Mbps, such as VIC 199 in FIG. 12, will be determined as an untransmittable media format.
[0238] While the above examples exemplify video formats among media formats, the required bitrate for audio formats can also be determined using the same method. While the data volume is generally relatively small compared to video formats and can be transmitted wirelessly, multi-channel audio and professional audio formats may require bitrates comparable to those for video formats.
[0239] Meanwhile, the control unit (30) can determine a media format that cannot be transmitted based on the performance of the gateway device (1). This may be necessary in the case of an old gateway device (1) or a dongle form factor that is being developed with limited performance.
[0240] This is because a bottleneck may occur in the gateway device (1) if the required bit rate for the media format that the gateway device (1) itself can process is limited.
[0241] Accordingly, the control unit (30) can determine that a media format requiring a bit rate greater than the largest value among the requested bit rates for media formats that can be processed by the gateway device (1) is an untransmittable media format.
[0242]
[0243] *
[0244] Next, the control unit (30) can modify the stored EDID based on the determined transmittable media format (770) and transmit the modified EDID to the selected source device (2) via the communication unit (10) (780).
[0245] The processor (31) can delete media formats that cannot be transmitted from the EDID of the sink device (3) and store them in the memory (32), and transmit them to the selected source device (2) through the communication unit (10).
[0246] Specifically, if the processor (31) is a video format, it may delete VIC codes that cannot be transmitted among the VIC codes included in the existing stored EDID and transmit them to the source device (2).
[0247] Referring to Fig. 2, the third step is a step of processing and transmitting media data (230).
[0248] According to one embodiment, the control unit (30) of the gateway device (1) can receive media data from the source device (2) through the communication unit (10). The media data supplied from the source device (2) may be rendered and encoded according to specifications corresponding to the EDID of the sink device (3) (231).
[0249] Rendering is a type of data processing method that converts data of a three-dimensional modeled object into two-dimensional image data. That is, the source device (2) of the present invention can perform rendering processing to generate media data that can be played back on the sink device (3).
[0250] Encoding refers to a type of data processing method that converts the capacity or format of data. That is, the source device (2) of the present invention can convert media data generated through the aforementioned rendering processing into appropriate specifications based on the EDID of the sink device (3).
[0251] Therefore, when generating media data from a source device (2), rendering and encoding processing are involved. It is acceptable to understand that the rendering processing described herein may include encoding processing.
[0252] That is, at least one source device (2) can determine the specifications of media data to be transmitted to the gateway device (1) based on the EDID of the received sink device (3), and can render the data with the specifications to generate media data to be supplied to the gateway device (1).
[0253] Accordingly, unlike the existing method that can only transmit data of predetermined, limited specifications regardless of the output specifications of the sink device, the user can experience high-quality media from the sink device (3) by providing media data optimized for the performance of the sink device (3) from the source device (2).
[0254] Next, the control unit (30) can perform data conversion processing for wirelessly transmitting media data to the sink device (3) (232). The media data that undergoes data conversion processing refers to media data corresponding to the EDID of the sink device (3) obtained from the source device (2).
[0255] That is, the control unit (30) can perform reformatting processing to convert a large amount of RAW data transmitted from the source device (2) into a transmission amount appropriate for the band situation based on wireless network band information.
[0256] Reformatting refers to data processing that changes data from an existing format to a different format as needed. That is, the control unit (30) can perform data reformatting processing to change media data into a data format with an appropriate transmission capacity for wireless transmission.
[0257] Reformatting may include downsampling and compression processes for wirelessly transmitting media data to a sink device in limited wireless bandwidth situations.
[0258] Here, downsampling is a type of data processing method that reduces the amount of data transmitted when transmission speed limits make it difficult to transmit large amounts of data at once. Downsampling may involve lowering the size, frame rate, or sampling ratio to reduce the amount of data transmitted.
[0259] Additionally, the control unit (30) can perform re-encoding processing on the media data to match the amount of data for wireless transmission during the data compression process.
[0260] Additionally, the control unit (30) can perform packet processing to wirelessly transmit reformatted data.
[0261] Packetization is a data processing method that divides data into packets, the basic units of data transmission, for transmission. Therefore, after data is received, it can be reassembled into its original form. Packet size can vary depending on network bandwidth and standardized protocols.
[0262] Packet processing may include multiplexing video, audio, and metadata for outputting video or voice from a sink device (3).
[0263] Multiplexing refers to the process of combining multiple independent signals into a single signal and transmitting the signal through a common communication channel. In the present invention, this refers to transmitting audio data, video data, metadata, etc. as a single data stream.
[0264] Multiplexing processing includes time-division multiplexing (TDM), frequency-division multiplexing (FDM), and code-division mulitplexing (CDM).
[0265] The control unit (30) can transmit media data that has undergone the aforementioned conversion process to the sink device (3) via the communication unit (10) (233). Accordingly, the sink device (3) can output the transmitted media data with optimized specifications.
[0266] Figure 13 illustrates a flowchart of a handshaking system according to one embodiment.
[0267] Referring to FIG. 13, a handshaking system according to one embodiment may include a source device (2) that supplies media data, a sink device (3) that outputs at least one of video or audio based on the media data, and a gateway device (1) that is connected to the source device by wire and is connected to the sink device (3) wirelessly.
[0268] In order for handshaking to be performed on the system, an initial connection process is required in which the user first connects the source device (2) to the gateway device (1) by wire (1311) and then connects the sink device (3) to the gateway device (1) wirelessly (1312). Here, the number of source devices (2) and sink devices (3) connected may be multiple.
[0269] Next, the user can select a source device (2) to supply media data and a sink device (3) to output the media. Selecting the source device (2) and selecting the sink device (3) can be performed independently.
[0270] First, the gateway device (1) can receive identification information of the source device (2) from the wired source device (2) (1321). In addition, the gateway device (1) can receive performance information of the sink device (3) from the wirelessly connected sink device (3) (1322).
[0271] Additionally, the gateway device (1) can store the performance information of the received sink device (3) in the memory (32).
[0272] The following is a step in which the user selects a source device (2) and a sink device (3). The user's selection may be input through the interface unit (20) of the gateway device (1) or through the user interface of the sink device (3).
[0273] When a user's selection signal is input through the interface section (20) of the gateway device (1), the gateway device (1) can create a list of source devices (2) based on identification information and store it in the memory (32), and can create a list of sink devices (3) based on performance information and store it in the memory (32).
[0274] In addition, a list of source devices (2) and a list of sink devices (3) can be output to the interface unit (20). Based on the outputted list information, a user can input a selection signal for the source device (2) and the sink device (3) to the gateway device (1) through the interface unit (20).
[0275] As described above, when a user's selection signal is input through the interface unit (20) of the gateway device (1), the step of generating a list of source devices (2) described below and transmitting it to the sink device (3) and the step of receiving the user's selection signal through the user interface of the sink device (3) are not required.
[0276] When a user's selection signal is input through the user interface of the sink device (3), the gateway device (1) can create a list of source devices (2) based on the identification information, store it in the memory (32), and transmit it to the sink device (3) (1330).
[0277] The sink device (3) can output a list of source devices (2) so that the user can recognize them, and the user can select a source device (2) that supplies media data based on the outputted list of source devices (2).
[0278] This is to provide information about the source device (2) so that the user can select at least one source device (2) to supply media data to the sink device (3).
[0279] Accordingly, the user can select at least one source device (2) from the user interface of the sink device (3), and the sink device (3) can transmit a source device (2) selection signal to the gateway device (1) (1340).
[0280] The gateway device (1) can transmit performance information of the sink device (3) that transmitted the selection signal based on the selection signal to the selected source device (2) (1350). Here, the performance information includes EDID, and the EDID can include EDID modified into a transmittable format as described above.
[0281] The source device (2) can render media data with specifications corresponding to the performance information of the received sink device (3) and transmit the rendered media data to the gateway device (1) (1360).
[0282] A gateway device (1) may perform data conversion processing on media data corresponding to performance information of a sink device (3) in order to wirelessly transmit media data received from a source device (2) to the sink device (3). The data conversion may include reformatting, which involves downsampling and compressing the data based on wireless network bandwidth information. In addition, packetization of the reformatted media data for wireless transmission may be additionally performed.
[0283] Media data converted for wireless transmission in a gateway device (1) can be transmitted to a sink device (3) (1370). The sink device (3) can output media based on the transmitted media data.
[0284] The above describes all cases where the user selects one or more source devices (2) and sink devices (3). Below, each handshaking scenario is described according to the number of source devices (2) and sink devices (3) selected by the user.
[0285] Figure 14 is an example showing a handshaking scenario when there is one selected source device (2) and multiple selected sink devices (3).
[0286] Referring to FIG. 14, the source device (2) list information and the sink device (3) list information may be output to the interface unit (20) of the gateway device (1), and the user may select only one source device (2) among at least one source device (2) and select multiple sink devices (3).
[0287] Alternatively, the source device (2) list information may be output to the user interface of multiple sink devices (3), and the user may select the same source device (2) from all sink devices (3).
[0288] For example, (a) of Fig. 14 illustrates a case where a user selects multiple sink devices and one source device among sink devices X, Y and source devices A, B, and C through the interface unit (20) of the gateway device (1).
[0289] When a user selects a sink device X through a manual provided by an interface unit (20) as in Fig. 5, the interface unit (20) can provide a manual for selecting a source device (2). Accordingly, the user can select A as the source device that will supply media data to the sink device X through the manual provided by the interface unit (20).
[0290] Next, when the user selects the sink device Y through the manual provided by the interface unit (20) as in Fig. 5, the interface unit (20) can similarly provide a manual for selecting the source device (2). Accordingly, the user can also select A as the source device that will supply media data to the sink device Y.
[0291] In the above situation, source device A can receive performance information of both sink devices X and Y from the gateway device (1).
[0292] In addition, as shown in (b) of Fig. 14, since the source device (2) supplying media data is the same as A, the video and audio output from the sink devices X and Y selected by the user are the same.
[0293] However, the specifications of media data transmitted to the gateway device (1) may vary depending on the performance information of the sink devices (3).
[0294] Accordingly, the source device (2) can render media data having specifications corresponding to the performance information of each sink device (3) and transmit the media data, which is rendered differently for each sink device (3), to each sink device (3) through the gateway device (1).
[0295] That is, in a scenario such as (a) of Fig. 14, source device A can render the same media data with specifications corresponding to the performance information of sink device X, and then render it again with specifications corresponding to the performance information of sink device Y, thereby generating multiple rendered media data.
[0296] Finally, the gateway device (1) can convert the previously rendered media data again based on the wireless network band information of each sink device (3) for wireless transmission to each sink device (3).
[0297] Figure 15 is an example showing a handshaking scenario when there are multiple source devices (2) and one selected sink device (3).
[0298] Referring to FIG. 15, the source device (2) list information and the sink device (3) list information may be output to the interface unit (20) of the gateway device (1), and the user may select multiple source devices (2) among at least one source device (2) and select only one sink device (3).
[0299] Alternatively, the source device (2) list information may be output to the user interface of at least one sink device (3), and the user may select the source device (2) from only one sink device (3).
[0300] For example, looking at (a) of Fig. 15, it is shown assuming that a user selects one sink device and multiple source devices among sink devices X, Y and source devices A, B, C through the interface unit (20) of the gateway device (1).
[0301] When a user selects a sink device X through a manual provided by an interface unit (20) as in Fig. 5, the interface unit (20) can provide a manual for selecting a source device (2). The user can select A or B as the source devices that will supply media data to the sink device X through the manual provided by the interface unit (20).
[0302] Next, when the user selects the sink device Y through the manual provided by the interface unit (20), the interface unit (20) may provide a manual for selecting the source device (2). The user may not select a source device to supply media data to the sink device Y through the manual provided by the interface unit (20).
[0303] Or, if the user does not select the sink device Y from the beginning, the interface unit (20) of the gateway device (1) does not provide a manual for selecting the source device (2), so media data is not supplied to the sink device Y.
[0304] In the above situation, the gateway device (1) can transmit performance information of the sink device X to the source devices A and B. Since there is only one piece of performance information, the quality of media that can be output from the sink device X selected by the user is the same even if the source devices (2) are different. In addition, since the specifications of the media data transmitted to the gateway device (1) correspond to the performance information of the sink device (3), they can be the same even if the source devices (2) are different.
[0305] However, the types of media data supplied from multiple source devices (2) may differ from each other. Accordingly, the video and audio output from a single sink device (3) may differ from each source device.
[0306] Each source device (2) can render media data with specifications corresponding to the performance information of the sink device (3) and transmit the media data to the gateway device (1).
[0307] The gateway device (1) can convert media data previously rendered from each source device (2) based on wireless network band information in order to wirelessly transmit it to the sink device (3).
[0308] Meanwhile, if the media data supplied to each source device (2) is different, the sink device (3) can perform a multi-view function.
[0309] The multi-view function refers to a function that can play multiple videos simultaneously by splitting the screen of the sync device (3).
[0310] Referring to (b) of Fig. 15, the sink device X can receive media data rendered in source devices A and B from the gateway device (1), and the multi-view function can be used as a method of simultaneously outputting the same.
[0311] Figure 16 is an example showing a handshaking scenario when there are multiple source devices (2) and sink devices (3).
[0312] Referring to Fig. 16, the source device (2) list information and the sink device (3) list information may be output to the interface unit (20) of the gateway device (1), and the user may select multiple source devices (2) and multiple sink devices (3).
[0313] As above, when a user selects multiple sink devices (3) and multiple source devices (2) in the interface section (20) of the gateway device (1), the user can select a source device (2) that supplies media data to each sink device (3) by considering the type of media to be output from each sink device (3).
[0314] When a user selects multiple sink devices (3) in the interface section (20) of the gateway device (1), the gateway device (1) can provide a manual for the user to select a source device (2) for each sink device (3) through the interface section (20).
[0315] Alternatively, the list information of the source device (2) may be output to the user interface of multiple sink devices (3), and the types of source devices (2) selected by the user from the multiple sink devices (3) may be multiple.
[0316] For example, as shown in (a) of Fig. 16, it is shown assuming a case where a user selects multiple sink devices and multiple source devices among sink devices X, Y and source devices A, B, C.
[0317] When a user selects a sink device X through a manual provided by an interface unit (20) as in Fig. 5, the interface unit (20) can provide a manual for selecting a source device (2). The user can select A as the source device that will supply media data to the sink device X through the manual provided by the interface unit (20).
[0318] Next, when the user selects the sink device Y through the manual provided by the interface unit (20), the interface unit (20) can provide a manual for selecting the source device (2). The user can select B and C as the source devices that will supply media data to the sink device Y through the manual provided by the interface unit (20).
[0319] As above, when there are multiple types of source devices (2) selected by the user from multiple sink devices (3), the user can select a source device (2) by considering the type of media to be output from each sink device (3).
[0320] In the above situation, the gateway device (1) can transmit performance information of the sink device X to the source device A, and transmit performance information of the sink device Y to the source devices B and C. Accordingly, the specifications of the media data transmitted to the gateway device (1) may differ depending on the received performance information.
[0321] In addition, since the source device (2) that supplies media data for outputting media from each sink device (3) is different, the output video or audio may also be different for each sink device (3).
[0322] Each source device (2) can render media data to have specifications corresponding to the performance information of a sink device (3) that receives media data through a gateway device (1) and transmit the rendered media data to the gateway device (1).
[0323] The gateway device (1) can convert the rendered media data again based on wireless network band information in order to wirelessly transmit the media data rendered by each source device (2) to each sink device (3).
[0324] The gateway device (1) can transmit the rendered media data of each converted source device (2) to each sink device (3) selected by the user.
[0325] If the media data supplied to each source device (2) is different, the sink device (3) can perform a multi-view function. The multi-view function refers to a function that can play multiple videos simultaneously by splitting the screen of the sink device (3).
[0326] Referring to FIG. 16, sink device X can receive media data rendered in source device A from gateway device (1), and sink device Y can simultaneously receive media data rendered in source devices B and C from gateway device (1).
[0327] Accordingly, since sink device Y receives different media data generated from source devices B and C through the gateway device (1), the multi-view function can be used to simultaneously output them, similar to the scenario described in Fig. 12.
[0328] A gateway device (1) according to one embodiment comprises a communication unit (10) that performs a wired connection with a source device (2) and a wireless connection with a sink device (3) that outputs media;
[0329] An interface section (20) that receives user input from a user or outputs information to the user; And a control unit (30) that controls the communication unit (10) and the interface unit (20); wherein the control unit (30) obtains, from the sink device (3) through the communication unit (10), EDID (Extended Display Identification data) including an outputtable format of the sink device (3) and communication performance information of the sink device (3), obtains information on an environment in which wireless communication is performed with the sink device (3) from a user through the interface unit (20), determines a current maximum transmission speed of wireless communication with the sink device (3) based on the obtained communication performance information of the sink device (3) and the obtained information on the environment in which wireless communication is performed with the sink device (3), determines a bit rate required for wirelessly transmitting data related to the media in the obtained outputtable format included in the EDID to the sink device (3) in order to output the media from the sink device (3), and determines an untransmittable format among the outputtable formats based on the determined required bit rate and the current maximum transmission speed.
[0330] Additionally, the control unit (30) can determine a format that cannot be transmitted based on the above-determined bit rate being greater than the current maximum transmission speed.
[0331] In addition, the control unit (30) can generate a modified EDID that deletes the non-transmittable format from the EDID of the sink device (3) and transmit the modified EDID to the source device (2).
[0332] In addition, the control unit (30) of the gateway device (1) according to one embodiment can determine the theoretical maximum transmission speed based on the communication performance information of the acquired sink device (3).
[0333] In addition, the control unit (30) of the gateway device (1) according to one embodiment can determine an attenuation ratio based on information about the environment in which wireless communication is performed with the sink device (3), and determine a current maximum transmission speed based on the determined theoretical maximum transmission speed and the determined attenuation ratio.
[0334] In addition, information about the environment in which wireless communication is performed with the sink (3) includes at least one of the number of obstacles located on the path to the sink device (3), the distance to the sink device (3), and the direction of the antenna, a gateway device (1).
[0335] In addition, the control unit (30) can determine a transmittable format among the outputtable formats based on the determined bit rate being less than or equal to the maximum bit rate that the gateway device (1) can process.
[0336] In addition, the control unit (30) is a gateway device (1) that obtains each media data corresponding to the modified EDID from the source device (2) through the communication unit (10).
[0337] In addition, the control unit (30) can perform data conversion on each of the acquired media data to wirelessly transmit it to the sink device (3), and transmit the converted media data to the sink device (3) through the communication unit (10).
[0338] In addition, the control unit (30) further obtains communication performance information of the communication relay device from the communication relay device through the communication unit (10) based on the fact that wireless communication with the sink device (3) passes through a communication relay device, and determines the theoretical maximum transmission speed based on the communication performance information of the sink device (3) and the communication performance information of the communication relay device (1).
[0339] A method for controlling a gateway device (1) according to one embodiment comprises: performing a wired connection with a source device (2) through a communication unit (10) and performing a wireless connection with a sink device (3) that outputs media; obtaining EDID (Extended Display Identification data) including an outputtable format of the sink device (3) and communication performance information of the sink device (3) from the sink device (3) through the communication unit (10); obtaining information about an environment in which wireless communication is performed with the sink device (3) from a user through an interface unit (20); determining a current maximum transmission speed of wireless communication with the sink device (3) based on the obtained communication performance information of the sink device (3) and the obtained information about the environment in which wireless communication is performed with the sink device (3); determining a bit rate required for wirelessly transmitting data related to the media in the obtained outputtable format included in the EDID to the sink device (3) in order to output the media from the sink device (3); And, based on the determined bit rate and the current maximum transmission speed, it may include determining a non-transmittable format among the outputtable formats.
[0340] Additionally, determining the untransmittable format may include determining the untransmittable format based on the determined bit rate being greater than the current maximum transmission rate.
[0341] In addition, it may further include generating a modified EDID by deleting the non-transmittable format from the EDID of the sink device (3); and transmitting the modified EDID to the source device (2).
[0342] *In addition, determining the current maximum transmission speed may include determining a theoretical maximum transmission speed based on the communication performance information of the acquired sink device (3).
[0343] In addition, determining the current maximum transmission speed may include determining an attenuation ratio based on information about an environment in which wireless communication is performed with the sink device (3); and determining the current maximum transmission speed based on the determined theoretical maximum transmission speed and the determined attenuation ratio.
[0344] In addition, information about the environment in which wireless communication is performed with the sink device (3) may include at least one of an obstacle located on the path to the sink device (3), a distance to the sink device (3), and a direction of an antenna.
[0345] In addition, determining the non-transmittable format may include determining the non-transmittable format among the outputtable formats based on the determined bit rate being greater than or equal to the maximum bit rate that the gateway device (1) can process.
[0346] In addition, a control method of a gateway device (1) further including obtaining each media data corresponding to the modified EDID from the source device (2) through the communication unit (10).
[0347] In addition, the method may further include performing data conversion on each of the acquired media data to wirelessly transmit the data to the sink device (3); and transmitting each of the converted media data to the sink device (3) via the communication unit (10).
[0348] In addition, determining the theoretical maximum transmission speed may include further obtaining communication performance information of the communication relay device from the communication relay device through the communication unit (10) based on the fact that wireless communication with the sink device (3) has passed through the communication relay device; and determining the theoretical maximum transmission speed based on the communication performance information of the sink device (3) and the communication performance information of the communication relay device.
[0349] A handshaking system according to one embodiment comprises: a source device (2); a sink device (3) outputting media; A gateway device (1) connected to the source device (2) by a wire and connected to the sink device (3) wirelessly; wherein the gateway device (1) obtains, from the sink device (3), EDID (Extended Display Identification data) including an outputtable format of the sink device (3) and communication performance information of the sink device (3), obtains information on an environment in which wireless communication with the sink device (3) is performed from a user through an interface unit (20), determines a current maximum transmission speed of wireless communication with the sink device (3) based on the obtained communication performance information of the sink device (3) and the obtained information on the environment in which wireless communication with the sink device (3) is performed, determines a bit rate required for wirelessly transmitting data related to the media in the obtained outputtable format included in the EDID to the sink device (3) in order to output the media from the sink device (3), and determines an untransmittable format among the outputtable formats based on the determined required bit rate being greater than the current maximum transmission speed.
[0350] According to the disclosed gateway device, the control method of the gateway device, and the handshaking system, there is an effect of providing a user with an experience of viewing or listening to high-quality media by supplying media data that has been converted so that it can be output as optimal voice or image from a sink device (3) even in a wireless network environment.
[0351] Meanwhile, the disclosed embodiments may be implemented in the form of a storage medium storing computer-executable instructions. The instructions may be stored in the form of program code, and when executed by a processor (31), may generate program modules to perform the operations of the disclosed embodiments.
[0352] A device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, the term "non-transitory storage medium" simply means a tangible device that does not contain signals (e.g., electromagnetic waves). This term does not distinguish between cases where data is permanently stored in the storage medium and cases where data is temporarily stored. For example, a "non-transitory storage medium" may include a buffer in which data is temporarily stored.
[0353] According to one embodiment, the method according to various embodiments disclosed in the present document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product (e.g., downloadable app) may be temporarily stored or temporarily generated in a machine-readable storage medium, such as a memory (32) of a manufacturer's server, an application store's server, or an intermediary server.
[0354] The effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the art to which the present disclosure belongs from the description below.
[0355] The above illustrates and describes specific embodiments. However, the invention is not limited to the above-described embodiments, and those skilled in the art will readily appreciate that various modifications and implementations can be made without departing from the spirit and scope of the invention as set forth in the claims below.
Claims
1. A communication unit (10) that performs a wired connection with a source device (2) and a wireless connection with a sink device (3) that outputs media; An interface section (20) that receives user input from a user or outputs information to a user; and It includes a control unit (30) that controls the above communication unit (10) and interface unit (20); The above control unit (30) Through the communication unit (10), EDID (Extended Display Identification data) including the outputtable format of the sink device (3) and communication performance information of the sink device (3) are obtained from the sink device (3), Information about the environment in which wireless communication is performed with the sink device (3) is obtained from the user through the above interface unit (20), Based on the acquired communication performance information of the sink device (3) and the acquired information on the environment in which wireless communication is performed with the sink device (3), the current maximum transmission speed of wireless communication with the sink device (3) is determined, Determine the bit rate required to wirelessly transmit data related to the media within the acquired outputtable format included in the EDID to the sink device (3) to output the media from the sink device (3); A gateway device (1) that determines a format that cannot be transmitted among the outputtable formats based on the determined required bit rate and the current maximum transmission speed.
2. In paragraph 1, The above control unit (30) A gateway device (1) that determines a format that cannot be transmitted based on the above-determined bit rate being greater than the current maximum transmission speed.
3. In paragraph 2, The above control unit (30) Generate a modified EDID that deletes the non-transmittable format from the EDID of the above sink device (3), A gateway device (1) that transmits the above modified EDID to the source device (2).
4. In paragraph 1, The above control unit (30) A gateway device (1) that determines the theoretical maximum transmission speed based on the communication performance information of the above-mentioned acquired sink device (3).
5. In paragraph 4, The above control unit (30) The attenuation ratio is determined based on information about the environment in which wireless communication is performed with the above sink device (3), A gateway device (1) that determines the current maximum transmission speed based on the above-determined theoretical maximum transmission speed and the above-determined attenuation ratio.
6. In paragraph 5, Information about the environment in which wireless communication is performed with the sink (3) includes at least one of the number of obstacles located on the path to the sink device (3), the distance to the sink device (3), and the direction of the antenna, a gateway device (1).
7. In paragraph 1, The above control unit (30) A gateway device (1) that determines a transmittable format among the outputtable formats based on the above-determined bit rate being less than or equal to the maximum bit rate that the gateway device (1) can process.
8. In paragraph 3, The above control unit (30) A gateway device (1) that obtains each media data corresponding to the modified EDID from the source device (2) through the communication unit (10).
9. In paragraph 8, The above control unit (30) In order to wirelessly transmit to the above sink device (3), data conversion is performed on each of the acquired media data, A gateway device (1) that transmits each of the converted media data to the sink device (3) through the communication unit (10).
10. In paragraph 4, The above control unit (30) Based on the fact that wireless communication with the above sink device (3) passes through a communication relay device, information on the communication performance of the communication relay device is further obtained from the communication relay device through the communication unit (10). A gateway device (1) that determines the theoretical maximum transmission speed based on the communication performance information of the above sink device (3) and the communication performance information of the above communication relay device.
11. Performing a wired connection with a source device (2) through a communication unit (10) and performing a wireless connection with a sink device (3) that outputs media; Obtaining EDID (Extended Display Identification data) including an outputtable format of the sink device (3) and communication performance information of the sink device (3) from the sink device (3) through the communication unit (10); Obtaining information about the environment in which wireless communication is performed with the sink device (3) from the user through the interface section (20); Determining the current maximum transmission speed of wireless communication with the sink device (3) based on the acquired communication performance information of the sink device (3) and the acquired information on the environment in which wireless communication is performed with the sink device (3); Determining a bit rate required to wirelessly transmit data related to said media within said acquired outputtable format included in said EDID to said sink device (3) for outputting said media from said sink device (3); and A control method of a gateway device (1) including determining a non-transmittable format among the outputtable formats based on the determined required bit rate and the current maximum transmission speed.
12. In paragraph 11, Determining the above untransmittable formats is: A control method of a gateway device (1) including determining a format that cannot be transmitted based on the above-determined bit rate being greater than the current maximum transmission speed.
13. In paragraph 12, Generating a modified EDID that deletes the non-transmittable format from the EDID of the above sink device (3); and A control method of a gateway device (1) further comprising transmitting the modified EDID to the source device (2).
14. In paragraph 11, Determining the current maximum transmission speed is: A control method of a gateway device (1), including determining a theoretical maximum transmission speed based on the communication performance information of the above-mentioned acquired sink device (3).
15. In paragraph 14, Determining the current maximum transmission speed is: Determining the attenuation ratio based on information about the environment in which wireless communication is performed with the above sink device (3); and A control method of a gateway device (1), comprising determining a current maximum transmission speed based on the determined theoretical maximum transmission speed and the determined attenuation ratio.
Citation Information
Patent Citations
Adaptor device for source apparatus, and method of controlling adaptor device for source apparatus
JP2009284047A
Method for displaying on display, electronic apparatus, function expansion device and display
JP2017135482A
Repeater apparatus and method for controlling the same
KR1020070073990A
Method and apparatus for transmitting / receiving in wireless transmitter / receiver system environments
KR1020090081617A
Traffic lamp pole structure
KR102190352B1
