Electronic device and data transmission method thereof

Abstract

An electronic device (100) is disclosed. The electronic device includes: a first communication interface (110); a second communication interface (120) for wirelessly communicating with a display device; a third communication interface (130) for communicating with the display device through a connection relay (4000) wirelessly communicating with the display device; and one or more processors (150) for receiving data from an external device (300) through the first communication interface, generating repair packets by encoding source packets containing the data using FEC code, transmitting first repair packets selected from among the repair packets and source packets to the display device through the second communication interface, and transmitting second repair packets other than the first repair packets among the repair packets to the display device through the connection relay using the third communication interface.

Description

Electronic devices and their data transmission methods

[0001] The present disclosure relates to an electronic device for transmitting data and a method for transmitting data.

[0002] Recent advancements in electronic technology have enabled display devices like televisions to connect wirelessly to peripherals. This reduces the need for wired connections and cables, while enhancing the aesthetics and functionality of the display devices.

[0003] Meanwhile, data between display devices and peripheral devices is transmitted in packet units, and data loss can occur at the individual transmission packet level. Packet loss can occur due to various issues, such as wired connections (especially at the connection point), network interfaces, hardware, network congestion, and server issues. Therefore, if a packet is lost, the receiver cannot receive the lost packet or its contained data. In some cases, packet loss can lead to retransmission, which can result in delays. Therefore, considering the potential data loss on the network, a solution is needed to ensure stable packet reception at the receiver.

[0004] An electronic device is disclosed. The electronic device includes a first communication interface, a second communication interface for wirelessly communicating with a display device, a third communication interface for wirelessly communicating with the display device via a connection relay that communicates with the display device, and at least one processor. The at least one processor receives data from an external device via the first communication interface. The at least one processor encodes source packets containing the data using an FEC code to generate repair packets. The at least one processor transmits first repair packets selected from among the repair packets and the source packets to the display device via the second communication interface. The at least one processor transmits second repair packets, excluding the first repair packets, from among the repair packets to the display device via the connection relay using the third communication interface.

[0005] Additionally, the one or more processors may transmit the source packets and the first repair packets to the display device through a first path, which is a direct communication path between the electronic device and the display device that does not go through the connection relay, using the second communication interface, and transmit the second repair packets to the display device through a second path, which is a communication path between the electronic device and the display device through the connection relay, using the third communication interface.

[0006] Additionally, the one or more processors may reduce the number of the first repair packets transmitted to the display device via the first path if the display device is identified as having restored the source packets using packets received via the first path.

[0007] Additionally, the one or more processors may lower the code rate of the FEC code if the display device is identified as not being able to restore the source packets using the packets received through the first path and the second path.

[0008] Additionally, the one or more processors can receive from the display device through the second communication interface information about the number of packets received by the display device through the first path and the number of packets received by the display device through the second path, and can identify whether the display device has restored the source packets based on the received information.

[0009] Additionally, the one or more processors can identify that the display device has restored the source packets using the packets received through the first path, if the number of packets received by the display device through the first path is greater than the number of source packets.

[0010] Additionally, the one or more processors can identify that the display device has failed to restore the source packets using the packets received through the first path and the second path if the sum of the number of packets received by the display device through the first path and the number of packets received by the display device through the second path is less than or equal to the number of source packets.

[0011] In addition, when the one or more processors identify that the display device has failed to restore the source packets using packets received through the first path and the second path, the display device may identify a network status of the first path based on the number of packets received through the first path, identify a network status of the second path based on the number of packets received through the second path, and when the network status of the first path is identified as poor and the network status of the second path is identified as good, transmit the second repair packets to the display device through the second communication interface, and transmit the source packets and the first repair packets to the display device through the access relay using the third communication interface.

[0012] Additionally, the external device may be an electronic device or server capable of transmitting video and audio data.

[0013] A data transmission method of an electronic device is disclosed. The data transmission method includes the steps of receiving data from an external device, encoding source packets including the data using an FEC code to generate repair packets, directly transmitting first repair packets selected from among the repair packets and the source packets to the display device, and transmitting second repair packets, excluding the first repair packets, from among the repair packets to the display device through the connection relay.

[0014] In addition, the step of directly transmitting may transmit the source packets and the first repair packets to the display device through a first path, which is a direct communication path between the electronic device and the display device that does not pass through the connection relay, and the step of transmitting through the connection relay may transmit the second repair packets to the display device through a second path, which is a communication path between the electronic device and the display device through the connection relay.

[0015] Additionally, the method may further include a step of reducing the number of the first repair packets transmitted to the display device via the first path if the display device is identified as having restored the source packets using packets received via the first path.

[0016] Additionally, the method may further include a step of lowering the code rate of the FEC code when it is determined that the display device has failed to restore the source packets using the packets received through the first path and the second path.

[0017] Additionally, the method may further include a step of receiving, from the display device, information about the number of packets received by the display device through the first path and the number of packets received by the display device through the second path, and a step of identifying whether the display device has restored the source packets based on the received information.

[0018] In addition, the identifying step may identify that the display device has restored the source packets using the packets received through the first path, if the number of packets received by the display device through the first path is greater than the number of source packets.

[0019] A non-transitory computer-readable medium storing computer instructions that, when executed by one or more processors of an electronic device, cause the electronic device to perform an operation is disclosed. The operation includes the steps of receiving data from an external device, encoding source packets including the data using an FEC code to generate repair packets, directly transmitting first repair packets selected from among the repair packets and the source packets to the display device, and transmitting second repair packets, excluding the first repair packets, from among the repair packets to the display device through the connection relay.

[0020] FIG. 1 is a diagram schematically illustrating an electronic device transmitting data according to an embodiment of the present disclosure.

[0021] Figure 2 is a block diagram for explaining the configuration of the above electronic device.

[0022] FIG. 3 is a flowchart for explaining the operation of the electronic device of FIG. 1 transmitting data to a display device.

[0023] FIG. 4 is a drawing for explaining the operation of the electronic device of FIG. 1.

[0024] Figure 5 is a block diagram for explaining the configuration of a display device.

[0025] FIG. 6 is a flowchart for explaining an operation of the display device of FIG. 5 to restore source packets using packets received from an electronic device.

[0026] Figure 7 is a drawing for explaining the operation of the display device of Figure 5.

[0027] FIG. 8 is a flowchart for explaining an operation performed by the electronic device of FIG. 1 using information received from the display device of FIG. 5.

[0028] It should be understood that the various embodiments of the present disclosure and the terminology used therein are not intended to limit the technical features described in the present disclosure to specific embodiments, but rather to encompass various modifications, equivalents, or alternatives of the embodiments.

[0029] In connection with the description of the drawings, similar reference numerals may be used for similar or related components.

[0030] The singular form of a noun corresponding to an item may include one or more items, unless the context clearly indicates otherwise.

[0031] In this disclosure, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B, or C," "at least one of A, B, and C," and "at least one of A, B, or C" can each include any one of the items listed together in that phrase, or all possible combinations thereof. For example, "A or B," "at least one of A and B," or "at least one of A or B" can all refer to (1) including at least one A, (2) including at least one B, or (3) including both at least one A and at least one B.

[0032] Terms such as "first," "second," or "first" or "second" may be used simply to distinguish one component from another and do not qualify the components in any other respect (e.g., importance or order).

[0033] When a component (e.g., a first component) is referred to as being “coupled” or “connected” to another component (e.g., a second component), with or without the terms “functionally” or “communicatively,” it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0034] The terms "include" or "have" are intended to specify the presence of a feature, number, step, operation, component, part or combination thereof described in this document, but do not preclude the presence or addition of one or more other features, numbers, steps, operations, components, parts or combinations thereof.

[0035] When a component is said to be “connected,” “coupled,” “supported,” or “in contact with” another component, this includes not only cases where the components are directly connected, coupled, supported, or in contact, but also cases where the components are indirectly connected, coupled, supported, or in contact through a third component.

[0036] When we say that a component is "on" another component, this includes not only cases where the component is in contact with the other component, but also cases where there is another component between the two components.

[0037] The term "and / or" includes any combination of a plurality of related described elements or any one of a plurality of related described elements.

[0038] In some contexts, the phrase "a device configured to" may mean that the device, in conjunction with other devices or components, is "capable of" performing A, B, and C. For example, the phrase "a processor configured (or set) to perform A, B, and C" may refer to a dedicated processor (e.g., an embedded processor) for performing those operations, or a general-purpose processor (e.g., a CPU or application processor) that can perform those operations by executing one or more software programs stored in a memory device.

[0039] In the embodiments, a "module" or "part" performs at least one function or operation and may be implemented as hardware or software, or as a combination of hardware and software. Furthermore, a plurality of "modules" or "parts" may be integrated into at least one module and implemented as at least one processor (not shown), excluding any "module" or "part" that needs to be implemented as specific hardware.

[0040] Meanwhile, the various elements and areas in the drawings are schematically drawn. Therefore, the technical concept of the present invention is not limited by the relative sizes or spacing depicted in the attached drawings.

[0041] Hereinafter, embodiments of the present disclosure will be described in more detail with reference to the attached drawings.

[0042] FIG. 1 is a diagram schematically illustrating an electronic device transmitting data according to an embodiment of the present disclosure.

[0043] The electronic device (100) may be implemented as various types and forms of electronic devices that can be connected to a display device (200), an external device (300), and an access point (AP) (400). For example, the electronic device (100) may be, but is not limited to, an OC (One Connect) box, a data transmitter, or a wireless transmitter.

[0044] The electronic device (100) can receive data from an external device (300). The data can include image and audio data (e.g., A / V (audio-visual) data, video data, etc.).

[0045] The external device (300) can be connected to the electronic device (100) and can be implemented as an electronic device of any type and form capable of transmitting video and audio data. For example, the external device (300) can be implemented as an electronic device such as a console game machine, a Blu-ray disc player, a set-top box, a smartphone, a tablet PC, a laptop PC, etc., or can be implemented as a server providing a game service, but is not limited thereto.

[0046] The electronic device (100) can transmit source packets containing data received from an external device (300) to the display device (200).

[0047] For example, the electronic device (100) may packetize data to generate packets. The packets generated in this manner may be referred to as "source packets." The electronic device (100) may encode the source packets to generate repair packets. Then, the electronic device (100) may transmit the source packets and the repair packets to the display device (200).

[0048] In one embodiment, the electronic device (100) may divide the set of repair packets into a first part of repair packets and a second part of repair packets and transmit them to the display device (200). For example, the electronic device (100) may divide the set of repair packets into two parts, transmit some of the repair packets to the display device (200) through a first path, and transmit the remaining repair packets to the display device (200) through a second path. A path may be referred to as a communication path, a channel, or a network, but is not limited thereto.

[0049] The first path is a direct communication path (e.g., ① in FIG. 1) between the electronic device (100) and the display device (200), that is, a path that does not pass through a connection relay (400).

[0050] For example, the electronic device (100) can be wirelessly connected directly to the display device (200) without going through a connection relay (400).

[0051] The first path may be referred to as, but is not limited to, the main path, the normal path, or the primary path.

[0052] The second path is a communication path (e.g., ② in FIG. 1) between an electronic device (100) and a display device (200) via a connection relay (400).

[0053] For example, the electronic device (100) can communicate with the display device (200) through the access relay (400). In one example, the access relay (400) can be connected to the electronic device (100) via a wire and / or wireless connection, and can be connected to the display device (200) wirelessly. In this case, the wired communication can include wired network communication such as Ethernet, High Definition Multimedia Interface (HDMI), Universal Serial Bus (USB), USB C-type, or Display Port (DP). However, the wired communication is not limited thereto, and the wired communication can be communication that can perform data communication using a cable. The wireless communication can include wireless network communication such as Wi-Fi, Wi-Fi Direct, Bluetooth, or Zigbee. However, the wireless communication is not limited thereto, and the wireless communication can be communication that can perform data communication by transmitting and receiving radio waves without a cable, for example.

[0054] The second path may be referred to as, but is not limited to, a sub path, an additional path, or a secondary path.

[0055] The display device (200) can receive source packets and repair packets from the electronic device (100), and restore the source packets using the repair packets. In addition, the display device (200) can output an image on the screen of the display device (200) using the image data included in the packets, and can output an audio signal through the speaker of the display device (200) using the audio data included in the packets. For example, the display device (200) can be an electronic device of any type and form that can be connected to the electronic device (100) and receive and output image and audio data. For example, the display device (200) can be an electronic device such as a TV, a monitor, a projector, etc., but is not limited thereto.

[0056] In one embodiment, the display device (200) can restore source packets using repair packets received through the first path, or can restore source packets using repair packets received through the first path and the second path.

[0057] If some or all packets are lost on the network, the data included in the lost packets is not received. That is, the display device (200) cannot receive the lost packets. Therefore, the quality of images and audio output by the display device (200) may deteriorate. According to the present disclosure, in order to reduce the impact of such data loss, the electronic device (100) may generate repair packets using an application layer forward error correction (AL-FEC) method and transmit the repair packets to the display device (200). At this time, the electronic device (100) may divide the repair packets into sets and transmit the repair packets to the display device (200) using multiple paths. Accordingly, even if a packet is lost on the first path, the display device (200) may restore the source packets using the repair packets received through the second path.

[0058] In this way, the quality of service (QoS) of data transmission can be improved by reducing or eliminating the need for packet retransmissions, for example, by reducing or eliminating the need for Automatic Repeat Request (ARQ) requests to retransmit packets. This may also mean that the delay associated with such retransmissions is reduced or eliminated. Furthermore, failure to restore source packets can result in degraded video and audio quality.

[0059] The specific operations in which the electronic device (100) transmits repair packets to the display device (200) and the display device (200) uses the received packets to restore the source packets will be described in more detail.

[0060] FIG. 2 is a block diagram illustrating the configuration of an electronic device according to an embodiment of the present disclosure.

[0061] Referring to FIG. 2, the electronic device (100) may include a first communication interface (110), a second communication interface (120), a third communication interface (130), a memory (140), and one or more processors (150). However, this configuration is exemplary, and it is to be understood that some components may be omitted or new components may be added in this configuration when implementing the present disclosure.

[0062] The first communication interface (110) can communicate with an external device (300). This can be performed under the control of one or more processors (150). For example, the electronic device (100) can be connected to the external device (300) using the first communication interface (110).

[0063] The first communication interface (110) may include a communication module. The communication module may include a communication circuit capable of performing data communication between the electronic device (100) and the external device (300) using wired or wireless communication. Wired communication may include wired network communication such as HDMI, USB, USB C-type, DP, or Ethernet. However, wired communication is not limited thereto, and may include various wired communications capable of performing data communication using a cable.

[0064] Additionally or alternatively, the first communication interface (110) may connect the electronic device (100) to a wide area network (WAN) to which an external device (300) (e.g., a server) is connected. The electronic device (100) may be connected to the external device (300) via the wide area network.

[0065] The second communication interface (120) can communicate wirelessly with the display device (200). This can be performed under the control of one or more processors (150). For example, the electronic device (100) can be directly connected wirelessly to the display device (200) using the second communication interface (120).

[0066] For example, the second communication interface (120) may include a communication module. The communication module may include a communication circuit capable of performing data communication between the electronic device (100) and the display device (200) using wireless communication. The wireless communication may include Wi-Fi Direct. However, the wireless communication is not limited thereto and may include various wireless communications capable of performing data communication by transmitting and receiving radio waves.

[0067] The third communication interface (130) can communicate with the display device (200) via the connection relay (400). This can be performed under the control of one or more processors (150). The connection relay (400) can communicate with the display device (200) wirelessly. For example, the electronic device (100) can be connected to the display device (200) via the connection relay (400) using the third communication interface (120).

[0068] The third communication interface (130) may include a communication module. The communication module may include a communication circuit capable of performing data communication between the electronic device (100) and the access repeater (400) using wired or wireless communication. Wired communication may include wired network communication such as HDMI, USB, USB C-type, DP, or Ethernet. However, wired communication is not limited thereto and may include various wired network communication methods capable of performing data communication using a cable. In addition, wireless communication may include wireless network communication such as Wi-Fi, Bluetooth, or Zigbee. However, wireless communication is not limited thereto and may include various wireless network communication methods capable of performing data communication by transmitting and receiving radio waves.

[0069] The memory (140) stores instructions, data structures, and program codes that can be read by one or more processors (150). Operations performed by one or more processors (150) can be implemented by executing instructions or codes of a program stored in the memory (140).

[0070] The memory (140) may include a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), and may include a non-volatile memory including at least one of a ROM (Read-Only Memory), an EEPROM (Electrically Erasable Programmable Read-Only Memory), a PROM (Programmable Read-Only Memory), a magnetic memory, a magnetic disk, and an optical disk, and a volatile memory such as a RAM (Random Access Memory) or an SRAM (Static Random Access Memory).

[0071] The memory (140) may store one or more instructions and / or programs that cause the electronic device (100) to operate according to the present disclosure.

[0072] One or more processors (150) can control the overall operations of the electronic device (100). For example, one or more processors (150) can be operatively connected to the first communication interface (110), the second communication interface (120), the third communication interface (130), and the memory (140) to control the electronic device (100). In addition, one or more processors (150) can control the operation of the electronic device (100) according to the present disclosure by executing one or more instructions stored in the memory (140). One or more processors (150) can be one or more processors.

[0073] The one or more processors (150) may include one or more processors such as a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), an Accelerated Processing Unit (APU), a Many Integrated Core (MIC), a Digital Signal Processor (DSP), a Neural Processing Unit (NPU), a hardware accelerator, or a machine learning accelerator. The one or more processors (150) may control one or more other elements or components of the electronic device (100) and perform operations or data processing related to communication.

[0074] For example, one or more processors (150) may perform a method according to an embodiment of the present disclosure by executing one or more instructions stored in a memory (140).

[0075] When a method according to an embodiment of the present disclosure includes a plurality of operations, the plurality of operations may be performed by one processor or by a plurality of processors. For example, when a first operation, a second operation, and a third operation are performed by a method according to an embodiment, the first operation, the second operation, and the third operation may all be performed by a first processor, or the first operation and the second operation may be performed by a first processor (e.g., a generic-purpose processor) and the third operation may be performed by a second processor (e.g., a purpose-specific processor such as an artificial intelligence-only processor).

[0076] One or more processors (150) may be a single core processor including one core, or may be implemented as one or more multicore processors including multiple cores (e.g., homogeneous multicores or heterogeneous multicores). When one or more processors (150) are implemented as multicore processors, each of the multiple cores included in the multicore processor may include internal processor memory, such as cache memory or on-chip memory, and a common cache shared by the multiple cores may be included in the multicore processor. In addition, each of the multiple cores (or some of the multiple cores) included in the multicore processor may independently read and execute a program instruction for implementing a method according to an embodiment of the present disclosure, or all (or some) of the multiple cores may be linked to read and execute a program instruction for implementing a method according to an embodiment of the present disclosure.

[0077] When a method according to an embodiment of the present disclosure includes a plurality of operations, the plurality of operations may be performed by one core among the plurality of cores included in a multi-core processor, or may be performed by the plurality of cores. For example, when a first operation, a second operation, and a third operation are performed by a method according to an embodiment, the first operation, the second operation, and the third operation may all be performed by a first core included in the multi-core processor, or the first operation and the second operation may be performed by a first core included in the multi-core processor, and the third operation may be performed by a second core included in the multi-core processor.

[0078] In embodiments of the present disclosure, a processor may mean a system on a chip (SoC) in which one or more processors and other electronic components are integrated, a single-core processor, a multi-core processor, or a core included in a single-core processor or a multi-core processor, wherein the core may be implemented as a CPU, a GPU, an APU, a MIC, a DSP, an NPU, a hardware accelerator, or a machine learning accelerator, but embodiments of the present disclosure are not limited thereto.

[0079] For convenience of explanation, one or more processors (150) are referred to as processors (150) below.

[0080] FIG. 3 is a flowchart illustrating an operation of an electronic device transmitting data to a display device according to one embodiment of the present disclosure.

[0081] In operation S310, the processor (150) may receive data from an external device (300) via the first communication interface (110). The data may include at least one of video and audio data.

[0082] In operation S320, the processor (150) can encode source packets containing data using an FEC code to generate repair packets.

[0083] At this time, the processor (150) can encode source packets using the AL-FEC method.

[0084] The AL-FEC method applies packet-level FEC at the application layer, the layer of the protocol stack that transmits and receives data for a specific layer. AL-FEC can be used to reduce packet loss due to errors that may occur on the network. Since AL-FEC encodes source packets at the sender and generates and transmits repair packets, even if some packets are lost on the network, the receiver can decode and restore the source packets.

[0085] The FEC code used in AL-FEC can be a Reed Solomon (RS) code, a Fountain code, or a Raptor code, for example. If the number of received packets exceeds a certain number, regardless of whether the packets received by the receiver are source packets or repair packets, the lost packets can be recovered. For example, if the total number of received packets is greater than the number of source packets, the receiver can decode the received packets to restore the source packets.

[0086] Repair packets may include parity bits or parity information for loss recovery. Repair packets may be used by the receiver to restore source packets. Repair packets may also be referred to as error correction packets.

[0087] The number of source packets K and the code rate R are examples of FEC parameters. For example, the code rate R is R=K / n, where n=K+r, and r is the number of repair packets. The initial values ​​of the FEC parameters may be preset according to system requirements.

[0088] In operation S320, the processor (150) may transmit the first repair packets and the source packets selected from among the repair packets to the display device (200) through the second communication interface (120). For example, the processor (150) may transmit the source packets and the first repair packets to the display device (200) through the first path between the electronic device (100) and the display device (200) that does not pass through the connection relay (400) by using the second communication interface (120). That is, the electronic device (100) may directly transmit the source packets and the first repair packets to the display device (200).

[0089] For example, when K source packets are encoded, K / RK repair packets can be generated. Here, R is a code rate of the FEC code. The processor (150) can randomly select M repair packets from among the K / RK repair packets. M has a preset value according to system requirements and can be changed depending on whether the decoding of the display device (200) is successful. Then, the processor (150) can transmit the K source packets and the M repair packets to the display device (200) through the second communication interface (120). The electronic device (100) can transmit the K source packets and the M repair packets to the display device (200) through the first path.

[0090] In operation S340, the processor (150) may transmit the second repair packets, excluding the first repair packets, from among the repair packets to the display device (200) through the connection relay (400) using the third communication interface (130). For example, the processor (150) may transmit the second repair packets to the display device (200) through the second path between the electronic device (100) and the display device (200) through the connection relay (400) using the third communication interface (130). That is, the electronic device (100) may transmit the second repair packets to the display device (200) through the connection relay (400).

[0091] In the above example, the processor (150) can transmit the remaining repair packets, excluding M repair packets, among the K / RK repair packets to the display device (200) through the third communication interface (130). That is, the number of the remaining repair packets is K / R-(K+M). That is, the electronic device (100) can transmit K / R-(K+M) repair packets to the display device (200) through the second path.

[0092] In operations S350 and S360, when a packet retransmission request is received from the display device (200) through the second communication interface (120) (S350-Y), the processor (150) can transmit packets to the display device (200) through the second communication interface (120) in response to the packet retransmission request. In fact, when a packet retransmission request is received from the display device (200) through the second communication interface (120), the processor (150) can transmit packets to the display device (200) through the communication interface (120).

[0093] For example, the retransmission request may include a request for retransmission of a lost packet, where the lost packet may be recovered from source packets and / or repair packets. That is, the display device (200) may transmit information about the number of packets required to recover the lost packet to the electronic device (100). The processor (150) may select a requested number of packets from among the source packets and / or repair packets based on the received information, and transmit the selected packets to the display device (200) via the second communication interface (120).

[0094] FIG. 4 is a drawing for explaining the operation of an electronic device according to an embodiment of the present disclosure.

[0095] Referring to FIG. 4, the electronic device (100) may include an AV encoder (410), a packetization module (420), and an AL-FEC encoder (430). The components illustrated in FIG. 4 may be implemented as hardware controlled by a processor (150), or may be configurations implemented by the processor (150) executing a program or command stored in a memory (140).

[0096] The AV encoder (410) can encode and compress video and audio data received from an external device (300).

[0097] The packetization module (420) can packetize data compressed by the AV encoder (410) into packets.

[0098] The AL-FEC encoder (430) can encode packets generated by the packetization module (420), i.e., source packets, to generate repair packets. For example, the AL-FEC encoder (430) can encode K source packets using an FEC code to generate K / RK repair packets. R is the code rate of the FEC code.

[0099] The electronic device (100) can select M repair packets from among K / RK repair packets and transmit the K source packets and M repair packets to the display device (200) through a first path. Then, the electronic device (100) can transmit the remaining repair packets, i.e., K / R-(K+M) repair packets, to the display device (200) through a second path.

[0100] FIG. 5 is a block diagram illustrating the configuration of a display device according to an embodiment of the present disclosure.

[0101] Referring to FIG. 5, the display device (200) may include a first communication interface (210), a second communication interface (220), a memory (230), a display (240), a speaker (250), and one or more processors (260). However, this configuration is exemplary, and components may be omitted or added when implementing the present disclosure.

[0102] The first communication interface (210) can wirelessly communicate with the electronic device (100) under the control of one or more processors (260). For example, the display device (200) can be wirelessly connected to the electronic device (100) using the first communication interface (210).

[0103] For example, the first communication interface (210) may include a communication module. The communication module may include a communication circuit capable of performing data communication between the display device (200) and the electronic device (100) using wireless communication. The wireless communication may include Wi-Fi Direct. However, the wireless communication is not limited thereto.

[0104] The second communication interface (220) can communicate with a connection relay (400) that communicates with the electronic device (100) under the control of one or more processors (260). For example, the display device (200) can be connected to the electronic device (100) through the connection relay (400) using the second communication interface (220).

[0105] The second communication interface (220) may include a communication module. The communication module may include a communication circuit capable of performing data communication between the display device (200) and the access relay (400) using wireless communication. The wireless communication may include wireless network communication such as Wi-Fi, Bluetooth, or Zigbee. However, wireless communication is not limited thereto.

[0106] Memory (230) may store instructions, data structures, and program codes that can be read by one or more processors (260). Operations performed by one or more processors (260) may be implemented by executing instructions or codes of a program stored in memory (230).

[0107] The memory (230) may include a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), and may include a non-volatile memory including at least one of a ROM, an EEPROM, a PROM, a magnetic memory, a magnetic disk, and an optical disk, and a volatile memory such as a RAM or SRAM.

[0108] The memory (230) may store one or more instructions and / or programs that cause the display device (200) to operate according to the present disclosure.

[0109] The display (240) can display an image under the control of one or more processors (260). The one or more processors (260) can process image data received from the electronic device (100) and output the image on the screen of the display (240).

[0110] The display (240) may be implemented as a display including a self-luminous element or a display including a non-luminous element and a backlight. For example, the display (240) may be implemented as various types of displays such as an LCD (Liquid Crystal Display), an OLED (Organic Light Emitting Diodes) display, an LED (Light Emitting Diodes) display, a micro LED display, a Mini LED display, a PDP (Plasma Display Panel), a QD (Quantum dot) display, a QLED (Quantum dot light-emitting diodes) display, etc. In order to detect a touch input, a touch sensor for detecting a touch operation may be arranged on the front of the display (240). In addition, the display (240) may be implemented as a flat display, a curved display, a foldable or / and rollable flexible display, etc.

[0111] The speaker (250) can output audio, notification sounds, voice messages, etc. under the control of one or more processors (260). For example, one or more processors (260) can process audio data received from the electronic device (100) and output audio signals through the speaker (250).

[0112] One or more processors (260) can control the overall operations of the display device (200). For example, one or more processors (260) can be connected to the first communication interface (210), the second communication interface (220), the memory (230), the display (240), and the speaker (250) to control the display device (200). In addition, one or more processors (260) can control the operation of the display device (200) according to the present disclosure by executing one or more instructions stored in the memory (230). One or more processors (260) can be one or more processors.

[0113] The one or more processors (260) may include one or more of a CPU, a GPU, an APU, a MIC, a DSP, an NPU, a hardware accelerator, or a machine learning accelerator. The one or more processors (260) may control one or more other elements or components of the display device (200) and may perform operations or data processing related to communication.

[0114] For example, one or more processors (260) may perform a method according to an embodiment of the present disclosure by executing one or more instructions stored in a memory (230).

[0115] When a method according to an embodiment of the present disclosure includes multiple operations, the multiple operations may be performed by one processor or by multiple processors. For example, when a first operation, a second operation, and a third operation are performed by a method according to an embodiment, the first operation, the second operation, and the third operation may all be performed by the first processor, or the first operation and the second operation may be performed by the first processor (e.g., a general-purpose processor) and the third operation may be performed by the second processor (e.g., a special-purpose processor such as an artificial intelligence-only processor).

[0116] One or more processors (260) may be a single core processor including one core, or may be implemented as one or more multicore processors including multiple cores (e.g., homogeneous multicores or heterogeneous multicores). When one or more processors (260) are implemented as multicore processors, each of the multiple cores included in the multicore processor may include an internal processor memory, such as a cache memory or an on-chip memory, and a common cache shared by the multiple cores may be included in the multicore processor. In addition, each of the multiple cores (or some of the multiple cores) included in the multicore processor may independently read and execute a program instruction for implementing a method according to an embodiment of the present disclosure, or all (or some) of the multiple cores may be linked to read and execute a program instruction for implementing a method according to an embodiment of the present disclosure.

[0117] When a method according to an embodiment of the present disclosure includes a plurality of operations, the plurality of operations may be performed by one core among the plurality of cores included in a multi-core processor, or may be performed by the plurality of cores. For example, when a first operation, a second operation, and a third operation are performed by a method according to an embodiment, the first operation, the second operation, and the third operation may all be performed by a first core included in the multi-core processor, or the first operation and the second operation may be performed by a first core included in the multi-core processor, and the third operation may be performed by a second core included in the multi-core processor.

[0118] In embodiments of the present disclosure, a processor may mean a system on a chip (SoC) in which one or more processors and other electronic components are integrated, a single-core processor, a multi-core processor, or a core included in a single-core processor or a multi-core processor, wherein the core may be implemented as a CPU, a GPU, an APU, a MIC, a DSP, an NPU, a hardware accelerator, or a machine learning accelerator, but embodiments of the present disclosure are not limited thereto.

[0119] For convenience of explanation, one or more processors (260) are referred to as processors (260) below.

[0120] FIG. 6 is a flowchart illustrating an operation of a display device restoring source packets using packets received from an electronic device according to an embodiment of the present disclosure.

[0121] The display device (200) can receive information about the FEC parameters as described above from the electronic device (100). The FEC parameters (e.g., K) can be used to identify / determine whether the display device (200) can restore source packets using the received packets.

[0122] In operation S610, the processor (260) may receive packets from the electronic device (100) via the first communication interface (210). For example, the display device (200) may receive packets via a first path between the electronic device (100) and the display device (200) that does not pass through the connection relay (400).

[0123] In operation S620, the processor (260) may receive packets from the electronic device (100) via the connection relay (400) using the second communication interface (220) (S620). For example, the display device (200) may receive packets via a second path between the electronic device (100) and the display device (200) via the connection relay (400).

[0124] During transmission, packets may be lost on the first path and / or the second path. If some or all of the packets transmitted from the sender do not arrive at the receiver, or some or all of the packets transmitted from the sender arrive at the receiver after a transmission time exceeding a certain (e.g., preset) time, it may be identified that packet loss has occurred. Packet loss may occur on a packet-by-packet basis. For example, the processor (260) may identify whether packet loss has occurred using an identifier of a received packet. In one example, the identifier may be a number. The processor (260) may identify that packet loss has occurred if the numbers of packets sequentially received are not consecutive.

[0125] As described above, the electronic device (100) can encode K source packets to generate K / RK repair packets, transmit the K source packets and M repair packets to the display device (200) through a first path, and transmit K / R-(K+M) repair packets to the display device (200) through a second path.

[0126] If the packet loss rate of the first path is p, the number of packets received by the display device (200) through the first path is N1. Here, N1 = (K+M)(1-p). If the packet loss rate of the second path is q, the number of packets received by the display device (200) through the second path is N2. Here, N2 = (K / R-(K+M))(1-q).

[0127] The processor (260) can identify whether the source packets can be restored using the packets (e.g., the number of packets) received from the electronic device (100).

[0128] Restoring the source packets can be replaced with the expression decryption success, and failing to restore the source packets can be replaced with the expression decryption failure.

[0129] Whether the source packets can be restored can be determined based on the number of packets received by the display device (200) and the number of source packets. In this case, the packets received by the display device (200) may include packets received by the display device (200) via the first path or packets received by the display device (200) via the first path and the second path. For example, if the number of packets received via the first path is greater than the number of source packets, the source packets can be restored by decoding the received packets. For example, if the number of packets received via the first path and the second path is greater than the number of source packets, the source packets can be restored by decoding the received packets.

[0130] The processor (260) can identify whether the source packets can be restored using the packets received through the first path.

[0131] For example, the processor (260) can identify that if the number of packets received through the first path is greater than the number of source packets (e.g., N1 > K), the source packets can be restored using only the packets received through the first path, i.e., not the packets received through the second path.

[0132] In operations S630 and S640, if the number of packets received through the first path is greater than the number of source packets (S630-Y), the display device (200) can decode the packets received through the first path using the FEC code to restore the source packets (S640).

[0133] If the number of packets received through the first path is less than or equal to the number of source packets, the processor (260) can identify that the source packets cannot be restored using only the packets received through the first path, that is, not the packets received through the second path. In this case, the processor (260) can identify whether the source packets can be restored additionally using the packets received through the second path, that is, using the packets received through the first path and the packets received through the second path.

[0134] For example, the processor (260) may identify that the source packets can be restored using the packets received through the first path and the second path if the total number of packets received through the first path and the second path is greater than the number of source packets (e.g., N1+N2 > K).

[0135] In operations S630, S650, and S660, the display device (200) can identify whether the sum of the number of packets received through the first path and the number of packets received through the second path is greater than the number of source packets if the number of packets received through the first path is less than or equal to the number of source packets (S630-N). The display device (200) can restore the source packets if the sum of the number of packets received through the first path and the number of packets received through the second path is greater than the number of source packets (S650-N). The display device (200) can decode the packets received through the first path and the packets received through the second path using an FEC code to restore the source packets (S660).

[0136] The processor (260) can identify that the source packets cannot be restored if the total number of packets received through the first path and the second path is less than or equal to the number of source packets (e.g., N1+N2≤K). This is because, if a large number of packets are lost on the network, the source packets cannot be restored. In this case (i.e., if N1+N2≤K), the processor (260) can transmit a packet retransmission request to the electronic device (100) through the first communication interface (210).

[0137] To transmit a packet retransmission request, the processor (260) may identify the number of packets required to recover the lost packets and transmit information about the identified number to the electronic device (100). For example, the number of packets required to recover the lost packets is β. Here, β = K-(N1+N2)+x. Here, K is the number of source packets, N1 is the number of packets received by the display device (200) through the first path, N2 is the number of packets received by the display device (200) through the second path, and x is a natural number. With respect to x, if more than K packets are received using a sub-optimal ALFEC code, it may mean that the source packets can be decoded (e.g., N1+N2>K).

[0138] When the requested packets are received through the second communication interface (210), the processor (260) can restore the source packets using the received requested packets.

[0139] In operations S650, S670, and S680, if the sum of the number of packets received through the first path and the number of packets received through the second path is less than or equal to the number of source packets (S650-N), the display device (200) can transmit a packet retransmission request to the electronic device (100) (S670). Then, when packets are received in accordance with the packet transmission request, the display device (200) can decode the first packets received (i.e., packets received through the first path and the second path) and the second packets received in accordance with the packet transmission request (i.e., received requested packets) using an FEC code to restore the source packets (S680).

[0140] Meanwhile, in the above-described example, the requested packets are transmitted via the first path, but the present disclosure is not limited thereto. For example, the electronic device (100) may also transmit the requested packets to the display device (200) via the second path.

[0141] In operation S690, the processor (260) may transmit information about the number of packets received through the first path and the number of packets received through the second path to the electronic device (100) via the first communication interface (210) (S690). For example, the display device (200) may transmit the number of packets received through the first path (e.g., N1) and the number of packets received through the second path (e.g., N2) to the electronic device (100).

[0142] Meanwhile, in the above-described example, information on the number of packets received by the display device (200) is described as being transmitted to the electronic device (200) via the first path, but this is not limited thereto. For example, the display device (200) may also transmit information on the number of packets received to the electronic device (200) via the second path.

[0143] FIG. 7 is a drawing for explaining the operation of a display device according to one embodiment of the present disclosure.

[0144] Referring to FIG. 7, the display device (200) may include an AL-FEC decoder (710), a depacketization module (720), and an AV decoder (730). The components illustrated in FIG. 7 may be implemented as hardware controlled by a processor (260), or may be configurations implemented by the processor (260) executing a program or command stored in a memory (230).

[0145] The AL-FEC decoder (710) can decode packets received from the electronic device (100) using an FEC code to restore source packets. The received packets may include packets received through the first path, packets received through the first and second paths, or packets received through the first and second paths and packets received in response to a packet retransmission request (i.e., requested packets).

[0146] The depacketization module (720) can depacketize source packets to obtain compressed data.

[0147] The AV decoder (730) can decode compressed data, decompress the compressed data, and obtain data.

[0148] The data may include video and audio data. The display device (200) may use the video data to output a video on the screen of the display (240), and may use the audio data to output an audio signal through the speaker (250).

[0149] In operation S690 of FIG. 6, the display device (200) may transmit information about the number of packets received through the first path and the number of packets received through the second path to the electronic device (100). The electronic device (100) may use the information received from the display device (200) to adjust the number of repair packets transmitted to the display device (200) through the first path or to adjust the code rate of the FEC code. Specific details regarding such adjustments will be described later. This may be particularly useful for repeated or future transmissions.

[0150] FIG. 8 is a flowchart illustrating an operation performed by an electronic device using information received from a display device according to an embodiment of the present disclosure.

[0151] In operation S810, the processor (150) of the electronic device (100) may receive information from the display device (200) including the number N1 of packets received by the display device (200) through the first path and the number N2 of packets received by the display device (200) through the second path. The electronic device (100) may receive this information through the second communication interface (120), but the present disclosure is not limited thereto.

[0152] The processor (150) can use the received information to identify whether the display device (200) has restored the source packets or is capable of restoring the source packets. For example, the processor (150) can identify whether the display device (200) has restored the source packets using packets received only through the first path, whether the display device (200) has restored the source packets using packets received through both the first path and the second path, or whether the display device (200) has failed to restore the source packets.

[0153] The processor (150) can identify whether the display device (200) has restored the source packets using packets received only through the first path.

[0154] For example, if the number of packets received by the display device (200) through the first path is greater than the number of source packets (e.g., N1 > K), the processor (150) can identify that the display device (200) has restored the source packets using the packets received through the first path.

[0155] In operations S820 and S830, if the processor (150) identifies that the display device (200) has restored the source packets using packets received only through the first path (S820-Y), the processor may reduce the number of first repair packets transmitted to the display device (200) through the first path (S830).

[0156] For example, the electronic device (100) can transmit M repair packets from among K / RK repair packets generated by encoding to the display device (200) through the first path. Thereafter, if the electronic device (100) determines that the display device (200) has restored the source packets using packets received only through the first path, the electronic device (100) can reduce the number of repair packets transmitted to the display device (200) through the first path to M-α. At this time, α can be a natural number. With respect to α, a number of repair packets less than M can be transmitted to the display device (200). The electronic device (100) can select M-α repair packets from among K / RK repair packets and transmit the K source packets and the M-α repair packets to the display device (200) through the first path. The selection of M-α repair packets among K / RK repair packets may be random. Then, the electronic device (100) may transmit K / R-(K+M-α) repair packets among K / RK repair packets to the display device (200) through the second path.

[0157] In this way, the display device (200) does not need to use packets received through the second path, and can restore the source packets only using packets received through the first path. This may indicate that the channel condition of the first path is good, so that many packets are not lost, and a sufficient number of packets for restoring the source packets are received by the display device (200) only through the first path. Accordingly, if the electronic device (100) determines that the display device (200) has successfully restored the source packets only using packets received through the first path, the electronic device (100) can reduce the number of packets transmitted to the display device (200) through the first path, thereby reducing power consumption.

[0158] If the number of packets received by the display device (200) through the first path is less than or equal to the number of source packets (e.g., N1≤K), the processor (150) can identify that the display device (200) has not restored the source packets using only the packets received through the first path. In this case, the processor (150) can identify that the display device (200) has restored the source packets using additional packets received through the second path.

[0159] For example, the processor (150) may determine that the display device (200) has restored the source packets using the packets received through the first path and the second path if the number of packets received by the display device (200) through the first path is less than or equal to the number of source packets (e.g., N1≤K) and the sum of the number of packets received by the display device (200) through the first path and the number of packets received through the second path is greater than the number of source packets (e.g., N1+N2>K). In this case, the processor (150) may maintain (i.e., not adjust) the code rate and the number of repair packets transmitted to the display device (100) through the first path.

[0160] The processor (150) can identify that the display device (200) has failed to restore the source packets using the packets received through the first path and the second path if the sum of the number of packets received through the first path and the number of packets received through the second path is less than or equal to the number of source packets (e.g., N1+N2≤K).

[0161] In operations S820, S840, and S850, if the processor (150) determines that the display device (200) cannot restore source packets using packets received only through the first path (S820-N) and that the display device (200) cannot restore source packets using packets received through the first and second paths (S840-N), the processor (150) can lower the code rate of the FEC code (S850).

[0162] For example, the electronic device (100) encodes K source packets using an FEC code having a code rate of R to generate K / RK repair packets. Thereafter, if the electronic device (100) determines that the display device (200) has failed to restore the source packets using the packets received through the first path and the second path, the electronic device (100) may lower the code rate to K / (K / R+β). As described above, β is the number of packets requested for retransmission from the display device (200).

[0163] If the code rate is lowered from R to K / (K / R+β), β more repair packets can be generated. That is, the electronic device (100) can encode K source packets using an FEC code having a code rate of K / (K / R+β) to generate K / R+β-K repair packets. The electronic device (100) can select M repair packets from among the K / R+β-K repair packets and transmit the K source packets and the M repair packets to the display device (200) through a first path. This selection can be random. In addition, the electronic device (100) can transmit K / R+β-(K+M) repair packets from among the K / R+β-K repair packets to the display device (200) through a second path.

[0164] That is, if the channel condition of the first path and / or the second path is poor and many packets are lost, the display device (200) cannot restore the source packets using the received packets. Therefore, the electronic device (100) can lower the code rate, generate more repair packets using the number of retransmissions requested, and transmit the additional repair packets to the display device (200). Accordingly, a degradation in the quality of video and audio that may occur due to the display device (200) failing to restore the source packets can be prevented.

[0165] In this way, the electronic device (100) can adaptively change the code rate and the number of repair packets transmitted through the first path depending on whether the display device (200) was previously able to restore the source packets.

[0166] Additionally or alternatively, if the electronic device (100) identifies that the display device (200) has failed to restore the source packets using the packets received through the first path and the second path, the electronic device (100) may transmit the source packets and the first repair packets previously transmitted to the display device (200) through the first path to the display device (200) through the second path, and transmit the second repair packets previously transmitted to the display device (200) through the second path to the display device (200) through the first path.

[0167] For example, if the processor (150) identifies that the display device (200) has failed to restore source packets using packets received through the first path and the second path, the processor (150) may identify the network status of the first path based on the number of packets received by the display device (200) through the first path, and may identify the network status of the second path based on the number of packets received by the display device (200) through the second path.

[0168] The network may include a wireless network. The network status may be replaced with expressions such as network quality, network conditions, channel conditions, channel quality, and channel conditions.

[0169] Network health can be determined based on the packet loss rate. The packet loss rate is the number of lost packets out of the total number of transmitted packets, and can be expressed as a fraction.

[0170] For example, the processor (150) can identify the number of packets lost on the first path based on the number of packets transmitted to the display device (200) through the first path and the number of packets received by the display device (200) through the first path. In addition, the processor (150) can identify the packet loss rate (i.e., p) of the first path based on the number of packets transmitted to the display device (200) through the first path and the number of packets lost on the first path. For example, if the number of packets transmitted to the display device (200) through the first path is K+M and the number of packets lost on the first path is (K+M)-N1, the packet loss rate is ((K+M)-N1) / (K+M).

[0171] Additionally, the processor (150) can identify the number of packets lost on the second path based on the number of packets transmitted to the display device (200) via the second path and the number of packets received by the display device (200) via the second path. In addition, the processor (150) can identify the packet loss rate (i.e., q) of the second path based on the number of packets transmitted to the display device (200) via the second path and the number of packets lost on the second path. For example, if the number of packets transmitted to the display device (200) via the second path is K / R-(K+M) and the number of packets lost on the second path is K / R-(K+M)-N2, the packet loss rate is (K / R-(K+M)-N2) / (K / R-(K+M)).

[0172] In this case, the processor (150) can identify that the network status of the path is good if the related packet loss rate is less than a threshold value (i.e., a preset threshold value), and can identify that the network status of the path is bad if the packet loss rate is greater than or equal to the threshold value.

[0173] Meanwhile, in the above-described example, the network status is described as being measured based on the packet loss rate, but it is not limited thereto. For example, the network status between the electronic device (100) and the display device (200) can be determined by various indicators such as bandwidth, time delay, jitter (i.e., change in time delay), etc. As described above, the processor (150) can identify that the network status of the path is good if the associated indicator is greater than (e.g., bandwidth) or less than (e.g., time delay, jitter) a threshold value. As described above, the processor (150) can identify that the network status of the path is bad if the associated indicator is less than, less than, greater than, or greater than the threshold value. In practice, the network status of the path may be good if it is higher than the threshold network status, and bad if it is lower than the threshold network status.

[0174] In the present disclosure, poor network conditions may include low channel throughput due to interference or other reasons. Accordingly, poor network conditions may result in packet loss, which may increase the packet loss rate.

[0175] If the processor (150) determines that the network status of the first path is not good and the network status of the second path is good, the processor (150) can transmit second repair packets to the display device (200) via the second communication interface (120) (i.e., via the first path) and transmit the source packets and the first repair packets to the display device (200) via the connection relay (400) using the third communication interface (130) (i.e., via the second path). That is, the processor (150) can switch the paths along which packets are transmitted.

[0176] If the network condition of the first path is not good and more packets are transmitted through the first path than through the second path, more packets may be lost from the first path (than those lost from the second path), and as a result, the display device (200) may not be able to restore the source packets even if it additionally uses packets received through the second path. Accordingly, if the network condition of the first path is not good, the electronic device (100) may transmit the source packets and the first repair packets to the display device (200) through the second path, and transmit the second repair packets to the display device (200) through the first path. Accordingly, the degradation of the quality of the image and audio that may occur due to the display device (200) failing to restore the source packets may be reduced or prevented.

[0177] Meanwhile, the various embodiments described above may be implemented in a computer-readable recording medium or similar device using software, hardware, or a combination thereof. In some cases, the embodiments described herein may be implemented by the processor itself. In a software implementation, embodiments, such as the procedures and functions described herein, may be implemented as separate software modules. Each of the software modules may perform one or more functions and operations described herein.

[0178] Meanwhile, computer instructions for performing processing operations of an electronic device according to various embodiments of the present disclosure described above may be stored in a non-transitory computer-readable medium. When the computer instructions stored in such a non-transitory computer-readable medium are executed by a processor of a specific device, the computer instructions cause the specific device to perform processing operations in a modular display device (100) according to various embodiments described above.

[0179] A non-transitory computer-readable medium refers to a medium that permanently stores data and can be read by a device, rather than a medium that stores data for a short period of time, such as a register, cache, or memory. Specific examples of non-transitory computer-readable media include CDs, DVDs, hard disks, Blu-ray discs, USBs, memory cards, and ROMs.

[0180] Although the preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above.

Claims

1. In electronic devices, First communication interface (110); A second communication interface (120) for communicating with a display device (200); A third communication interface (130) for communicating with the display device (200) through an access point (400) communicating with the display device (200); and Receive data from an external device (300) through the first communication interface (110), Encode source packets containing the above data using FEC (Forward Error Correction) code to generate repair packets, Transmitting first repair packets selected from among the above source packets and the above repair packets to the display device through the second communication interface (120), An electronic device including at least one processor (150) that transmits second repair packets, excluding the first repair packets, from among the repair packets to the display device (200) through the connection relay (400) using the third communication interface.

2. In paragraph 1, The above one or more processors (150) By using the second communication interface (120), the source packets and the first repair packets are transmitted to the display device (200) through the first path, which is a direct communication path between the electronic device (100) and the display device (200) that does not pass through the connection relay (400), An electronic device that transmits the second repair packets to the display device through a second path, which is a communication path between the electronic device and the display device (200) via the connection relay (400), using the third communication interface (130).

3. In paragraph 2, The above one or more processors (150) An electronic device that reduces the number of first repair packets transmitted to the display device (200) via the first path when it is identified that the display device (200) has restored the source packets using the packets received via the first path.

4. In paragraph 2 or 3, The above one or more processors (150) An electronic device that lowers the code rate of the FEC code when it is determined that the display device (200) has failed to restore the source packets using the packets received through the first path and the second path.

5. In any one of paragraphs 2 to 4, The above one or more processors (150) The display device (200) receives information about the number of packets received by the display device (200) through the first path and the number of packets received by the display device through the second path from the display device (200), An electronic device that identifies whether the display device (200) has restored the source packets based on the received information.

6. In paragraph 5, The above one or more processors (150) An electronic device that identifies that the display device (200) has restored the source packets using packets received only through the first path, if the number of packets received by the display device (200) through the first path is greater than the number of source packets.

7. In paragraph 5 or 6, The above one or more processors (150) An electronic device that identifies that the display device (200) has failed to restore the source packets using packets received through the first path and the second path if the sum of the number of packets received by the display device (200) through the first path and the number of packets received by the display device (200) through the second path is less than or equal to the number of source packets.

8. In any one of paragraphs 5 to 7, The above one or more processors (150) If the display device (200) is identified as not being able to restore the source packets using the packets received through the first path and the second path, the display device identifies the network status of the first path based on the number of packets received through the first path, The display device (200) identifies the network status of the second path based on the number of packets received through the second path, An electronic device that transmits the second repair packets to the display device (200) through the second communication interface and transmits the source packets and the first repair packets to the display device (200) through the connection relay using the third communication interface (130) when the network status of the first path is identified as not being good and the network status of the second path is identified as being good.

9. In any one of the 8 clauses of Article 1, The above external device is, An electronic device or server capable of transmitting video and audio data.

10. In a data transmission method of an electronic device (100), Step of receiving data from an external device (S310); A step (S320) of generating repair packets by encoding source packets containing the above data using an FEC (Forward Error Correction) code; Step (S330) of directly transmitting first repair packets selected from among the above source packets and the above repair packets to the display device; and A data transmission method comprising a step (S340) of transmitting second repair packets, excluding the first repair packets, from among the repair packets to the display device through the connection relay.

11. In paragraph 10, The above direct transmission step (S330) is Transmitting the source packets and the first repair packets to the display device through a first path, which is a direct communication path between the electronic device and the display device that does not pass through the connection relay, The step (S340) of transmitting through the above connection relay is A data transmission method for transmitting the second repair packets to the display device through a second path, which is a communication path between the electronic device and the display device through the connection relay.

12. In paragraph 11, A data transmission method further comprising a step (S830) of reducing the number of the first repair packets transmitted to the display device via the first path, if it is identified that the display device has restored the source packets using the packets received via the first path.

13. In paragraph 11 or 12, A data transmission method further comprising a step (S850) of lowering the code rate of the FEC code when it is determined that the display device has failed to restore the source packets using the packets received through the first path and the second path.

14. In any one of paragraphs 11 to 13, A step (S810) of receiving information about the number of packets received by the display device through the first path and the number of packets received by the display device through the second path from the display device; and A data transmission method further comprising a step (S820) of identifying whether the display device has restored the source packets based on the received information.

15. In paragraph 14, The above identifying step (S820) is A data transmission method that identifies that the display device has restored the source packets using the packets received through the first path if the number of packets received by the display device through the first path is greater than the number of source packets.

Images