Method and apparatus for transmitting image content using edge computing services

Abstract

The present invention relates to a method and apparatus for transmitting image content by using an edge computing service (e.g., a multi-access edge computing (MEC) service). According to one embodiment, the present invention may include: a step in which an edge data network obtains orientation information and focus position information from an electronic device connected to the edge data network; and a step in which a single filter determined based on the focus position information performs filtering on a first partial image corresponding to the orientation information to generate a filtered first partial image.

Description

Technical Field

[0001] The present disclosure relates to a method and apparatus for transmitting image content by using an edge computing service (eg, a multi-access edge computing (MEC) service). Background Art

[0002] Recently, edge computing technology for sending data by using an edge server has been discussed. Edge computing technology may include, for example, multi-access edge computing (MEC) or fog computing (FOC). Edge computing technology may refer to a technology for providing data to an electronic device via a separate server (hereinafter referred to as an "edge data network" or "MEC server"), which is set at a location geographically close to the electronic device, for example, inside or around a base station. For example, an application requiring low latency among at least one application installed in an electronic device can send and receive data via an edge server set at a geographically close location rather than via a server located in an external data network (DN) (e.g., the Internet).

[0003] Recently, services using edge computing technology (hereinafter referred to as "MEC-based services" or "MEC services") have been discussed, and research and development of electronic devices supporting MEC-based services have been conducted. For example, an application of an electronic device can send edge computing-based data to an edge server (or an application of an edge server) in an application layer and receive edge computing-based data from an edge server (or an application of an edge server).

[0004] As research and development supporting MEC-based services progress, technology for providing high-resolution image content to electronic devices by using MEC has been discussed. Summary of the invention

[0005] Technical issues

[0006] Based on the above discussion, the present disclosure relates to a method and apparatus for transmitting image content by using edge computing services.

[0007] In detail, a method for transmitting image content to an electronic device performed by an edge data network and the edge data network for providing the image content to the electronic device are provided.

[0008] In addition, a method for receiving image content from an edge data network performed by an electronic device and the electronic device for receiving image content from the edge data network are provided.

[0009] Technical Solution

[0010] According to an embodiment, a method performed by an edge data network includes:

[0011] obtaining position information and focal position information from an electronic device connected to the edge data network;

[0012] determining a filter among a plurality of filters based on the focus position information;

[0013] generating a filtered first partial image by performing filtering on a first partial image corresponding to the orientation information using the filter determined based on the focus position information;

[0014] Generate a first frame by encoding the filtered first partial image; and

[0015] The generated first frame is sent to the electronic device.

[0016] The first partial image may be a partial image within a first VR image having a predetermined frame index of a VR sequence including a plurality of frames, and the first partial image may include position information indicating a position of the partial image.

[0017] The method may further include: generating information of a region corresponding filter corresponding to each of a plurality of predetermined regions within the image;

[0018] storing the generated information of the plurality of region-corresponding filters; and

[0019] The information of the plurality of area-corresponding filters is sent to the electronic device.

[0020] Determining the one filter among the plurality of filters based on the focus position information may include:

[0021] One of the plurality of regions is determined based on the focus position information, and a region-corresponding filter corresponding to the determined region is determined.

[0022] Generating the filtered first partial image by filtering the first partial image corresponding to the orientation information using the one filter determined based on the focus position information may include:

[0023] A reduced first partial image is generated by performing filtering on the first partial image corresponding to the orientation information based on the stored information about the region corresponding filter corresponding to the determined region.

[0024] Sending the generated first frame to the electronic device may include:

[0025] The generated first frame and index information indicating one of the plurality of region-corresponding filters are transmitted.

[0026] Obtaining the position information and the focus position information from the electronic device connected to the edge data network may include:

[0027] The orientation information, the focus position information and the focus movement vector information are obtained from the electronic device.

[0028] Determining the one filter among the plurality of filters based on the focus position information may include:

[0029] Based on the focus position information and the focus movement vector information, one area correspondence filter is determined among the plurality of area correspondence filters.

[0030] Generating the filtered first partial image by filtering the first partial image corresponding to the orientation information using the one filter determined based on the focus position information may include:

[0031] A reduced first partial image is generated by performing filtering on the first partial image corresponding to the orientation information based on the stored information about the determined one region corresponding filter.

[0032] The focus position information may include first focus position information and second focus position information.

[0033] Determining the one filter among the plurality of filters based on the focus position information may include:

[0034] Based on the first focus position information and the second focus position information, one area corresponding filter is determined among a plurality of area corresponding filters.

[0035] Generating the filtered first partial image by filtering the first partial image corresponding to the orientation information using the one filter determined based on the focus position information may include:

[0036] A reduced first partial image is generated by performing filtering on the first partial image corresponding to the position information using the determined one filter.

[0037] The method may further include: generating information of filter groups corresponding to a plurality of regions;

[0038] storing the generated information of the plurality of region corresponding filter groups; and

[0039] The information on the filter groups corresponding to the multiple regions is sent to the electronic device.

[0040] Each of the plurality of region correspondence filter groups may include a region correspondence filter corresponding to each of a plurality of predetermined regions within the image.

[0041] Determining the one filter among the plurality of filters based on the focus position information may include:

[0042] One area corresponding filter group is determined among the plurality of area corresponding filters based on the network information, and one area corresponding filter is determined among the plurality of area corresponding filters included in the one area corresponding filter group based on the focus position information.

[0043] Generating the filtered first partial image by filtering the first partial image corresponding to the orientation information using the one filter determined based on the focus position information may include:

[0044] A reduced first partial image is generated by performing filtering on the first partial image corresponding to the orientation information based on the determined one region correspondence filter.

[0045] Sending the generated first frame to the electronic device may include:

[0046] The generated first frame and first index information indicating a region corresponding filter group among the plurality of region corresponding filters are transmitted to the electronic device.

[0047] Sending the generated first frame and the first index information to the electronic device may include:

[0048] The generated first frame, the first index information, and second index information indicating one region corresponding filter included in the one region corresponding filter group are transmitted to the electronic device.

[0049] The method may further include: generating information of filter groups corresponding to a plurality of regions;

[0050] storing the generated information of the plurality of region corresponding filter groups; and

[0051] The information on the filter groups corresponding to the multiple regions is sent to the electronic device.

[0052] Each of the plurality of region correspondence filter groups may include a region correspondence filter corresponding to each of a plurality of predetermined regions within the image.

[0053] Obtaining the position information and the focus position information from the electronic device connected to the edge data network may include:

[0054] The orientation information, the focus position information and the focus movement vector information are obtained from the electronic device.

[0055] Determining the one filter among the plurality of filters based on the focus position information may include:

[0056] Based on the focus position information and the focus movement vector information, one area corresponding filter group is determined among the multiple area corresponding filters, and based on the focus position information, one area corresponding filter is determined among the multiple area corresponding filters included in the one area corresponding filter group.

[0057] Generating the filtered first partial image by filtering the first partial image corresponding to the orientation information using the one filter determined based on the focus position information may include:

[0058] A reduced first partial image is generated by performing filtering on the first partial image corresponding to the orientation information based on the determined one region correspondence filter.

[0059] The number of coefficients greater than or equal to a first value in a filter applied to a predetermined area corresponding to the area-corresponding filter may be greater than the number of coefficients greater than or equal to the first value in a filter applied to an area other than the predetermined area.

[0060] An overlapping area may be included between predetermined areas corresponding to the respective area-corresponding filters.

[0061] According to an embodiment, an edge data network for transmitting image content to an electronic device includes:

[0062] Network interface;

[0063] a memory storing one or more instructions; and

[0064] a processor configured to execute the one or more instructions,

[0065] Wherein, the processor is configured to execute the one or more instructions to:

[0066] obtaining position information and focal position information from an electronic device connected to the edge data network;

[0067] determining a filter among a plurality of filters based on the focus position information;

[0068] generating a filtered first partial image by filtering a first partial image corresponding to the orientation information using the one filter determined based on the focus position information;

[0069] Generate a first frame by encoding the filtered first partial image; and

[0070] The generated first frame is sent to the electronic device.

[0071] The processor may be further configured to execute the one or more instructions to:

[0072] generating information of a region corresponding filter corresponding to each of a plurality of predetermined regions within the image;

[0073] Storing information of the generated multiple region corresponding filters;

[0074] Sending the information of the filters corresponding to the multiple regions to the electronic device;

[0075] When determining a filter among a plurality of filters based on the focus position information,

[0076] determining one of the plurality of areas based on the focus position information, and determining an area-corresponding filter corresponding to the determined area;

[0077] When the filtered first partial image is generated by filtering the first partial image corresponding to the azimuth information using the one filter determined based on the focus position information,

[0078] generating a reduced first partial image by performing filtering on the first partial image corresponding to the orientation information based on stored information about the region corresponding filter corresponding to the determined region; and

[0079] When the generated first frame is sent to the electronic device,

[0080] The generated first frame and index information indicating one of the plurality of region-corresponding filters are transmitted.

[0081] The processor may be further configured to execute the one or more instructions to:

[0082] When the orientation information and the focus position information are obtained from the electronic device connected to the edge data network,

[0083] Obtaining the orientation information, the focus position information and the focus movement vector information from the electronic device;

[0084] When determining a filter among a plurality of filters based on the focus position information,

[0085] determining one area correspondence filter among the plurality of area correspondence filters based on the focus position information and the focus movement vector information; and

[0086] When the filtered first partial image is generated by filtering the first partial image corresponding to the azimuth information using the one filter determined based on the focus position information,

[0087] A reduced first partial image is generated by performing filtering on the first partial image corresponding to the orientation information based on the stored information about the determined one region corresponding filter.

[0088] The processor may be further configured to execute the one or more instructions to:

[0089] When the focus position information includes first focus position information and second focus position information and one filter is determined among a plurality of filters based on the focus position information,

[0090] determining an area-corresponding filter among a plurality of area-corresponding filters based on the first focus position information and the second focus position information; and

[0091] When the filtered first partial image is generated by filtering the first partial image corresponding to the azimuth information using the one filter determined based on the focus position information,

[0092] A reduced first partial image is generated by performing filtering on the first partial image corresponding to the position information using the determined one filter.

[0093] The processor may be further configured to execute the one or more instructions to:

[0094] Generate information of filter groups corresponding to multiple regions;

[0095] Storing the generated information of the plurality of region corresponding filter groups;

[0096] Sending the information of the plurality of region-corresponding filter groups to the electronic device, wherein each of the plurality of region-corresponding filter groups includes a region-corresponding filter corresponding to each of a plurality of predetermined regions within an image;

[0097] When determining a filter among a plurality of filters based on the focus position information,

[0098] determining one region corresponding filter group among the plurality of region corresponding filters based on the network information, and determining one region corresponding filter among the plurality of region corresponding filters included in the one region corresponding filter group based on the focus position information; and

[0099] When the filtered first partial image is generated by filtering the first partial image corresponding to the azimuth information using the one filter determined based on the focus position information,

[0100] A reduced first partial image is generated by performing filtering on the first partial image corresponding to the orientation information based on the determined one region correspondence filter.

[0101] The processor may be further configured to execute the one or more instructions to:

[0102] When the generated first frame is sent to the electronic device,

[0103] The generated first frame and first index information indicating a region corresponding filter group among the plurality of region corresponding filters are transmitted to the electronic device.

[0104] The processor may be further configured to execute the one or more instructions to:

[0105] When the generated first frame and the first index information are sent to the electronic device,

[0106] The generated first frame, the first index information, and second index information indicating one region corresponding filter included in the one region corresponding filter group are transmitted to the electronic device.

[0107] The processor may be further configured to execute the one or more instructions to:

[0108] Generate information of filter groups corresponding to multiple regions;

[0109] storing the generated information of the plurality of region-corresponding filter groups and transmitting the information of the plurality of region-corresponding filter groups to the electronic device, wherein each of the plurality of region-corresponding filter groups includes a region-corresponding filter corresponding to each of a plurality of predetermined regions within an image;

[0110] When the orientation information and the focus position information are obtained from the electronic device connected to the edge data network,

[0111] Obtaining the orientation information, the focus position information and the focus movement vector information from the electronic device;

[0112] When determining a filter among a plurality of filters based on the focus position information,

[0113] Based on the focus position information and the focus movement vector information, determine one region corresponding filter group among the plurality of region corresponding filters, and based on the focus position information, determine one region corresponding filter among the plurality of region corresponding filters included in the one region corresponding filter group; and

[0114] When the filtered first partial image is generated by filtering the first partial image corresponding to the azimuth information using the one filter determined based on the focus position information,

[0115] A reduced first partial image is generated by performing filtering on the first partial image corresponding to the orientation information based on the determined one region correspondence filter.

[0116] According to an embodiment, a computer-readable recording medium has a program recorded thereon, and when the program is executed by a computer, a method performed by an edge data network is performed, the method comprising:

[0117] obtaining position information and focal position information from an electronic device connected to the edge data network;

[0118] determining a filter among a plurality of filters based on the focus position information;

[0119] generating a filtered first partial image by performing filtering on a first partial image corresponding to the orientation information using the filter determined based on the focus position information;

[0120] Generate a first frame by encoding the filtered first partial image; and

[0121] The generated first frame is sent to the electronic device.

[0122] According to an embodiment, a method performed by an electronic device for providing image content from an edge data network connected to the electronic device includes:

[0123] Sending position information and focal position information to the edge data network;

[0124] obtaining a first frame from the edge data network by filtering and encoding a first partial image corresponding to the orientation information based on the focus position information;

[0125] Obtaining a first partial image by decoding the first frame;

[0126] reconstructing the first partial image by using one filter determined based on the focus position information among a plurality of filters; and

[0127] The reconstructed first partial image is reproduced. BRIEF DESCRIPTION OF THE DRAWINGS

[0128] Figure 1 It is a schematic diagram for illustrating the multi-access edge computing (MEC) technology in a network environment according to an embodiment of the present disclosure.

[0129] Figure 2a is a diagram for illustrating motion-to-photon (MTP) latency that occurs while an edge data network is providing content to an electronic device based on a field-of-view (Fov) transmission technique according to an embodiment of the present disclosure.

[0130] Figure 2b is a view for explaining MTP delay occurring while an edge data network is providing content to an electronic device according to a separation rendering technology according to an embodiment of the present disclosure.

[0131] Figure 2c 2 is a view for explaining MTP delay that variably occurs when movement occurs in an electronic device by a user in a process of providing contents according to the Fov transmission technology and the separation rendering technology according to an embodiment of the present disclosure.

[0132] Figure 3 is a view used to illustrate concave rendering.

[0133] Figure 4 It is a view used to schematically illustrate the operation process between an electronic device and an edge data network.

[0134] Figure 5 It is a view used to schematically illustrate the operation process between an electronic device and an edge data network.

[0135] Figure 6 is a view for explaining a process by which an edge data network encodes and transmits a reduced image by using a filter according to an embodiment.

[0136] Figure 7 is a view for explaining a process by which an electronic device expands and interpolates a decoded image by using a filter and renders an interpolated image according to an embodiment.

[0137] Figure 8a is a flowchart of an operation process between an electronic device and an edge data network according to an embodiment of the present disclosure.

[0138] Figure 8bis a flowchart of an operation process between an electronic device and an edge data network according to an embodiment of the present disclosure.

[0139] Figure 9a 2 is a view for explaining a plurality of region correspondence filters according to an embodiment of the present disclosure.

[0140] Figure 9b is a view for explaining a method of performing filtering by using a region corresponding filter corresponding to a focus region among a plurality of region corresponding filters according to an embodiment of the present disclosure.

[0141] Fig.9c is a view for explaining a method of performing filtering by using a region corresponding filter corresponding to a focus region among a plurality of region corresponding filters according to an embodiment of the present disclosure.

[0142] Fig.10a is a flowchart of an operation process between an electronic device and an edge data network according to an embodiment of the present disclosure.

[0143] Fig.10b is a flowchart of an operation process between an electronic device and an edge data network according to an embodiment of the present disclosure.

[0144] Fig.11a is a view for explaining an overlapping area between a plurality of filtering areas according to an embodiment of the present disclosure.

[0145] Fig.11b 2 is a view for explaining a method of performing filtering by using a plurality of region corresponding filters having an overlapping region between adjacent regions, which is performed by the edge data network 2000 according to an embodiment of the present disclosure.

[0146] Fig.11c 2 is a view for explaining a method of performing filtering by using a plurality of region corresponding filters having an overlapping region between adjacent regions, which is performed by the edge data network 2000 according to an embodiment of the present disclosure.

[0147] Fig.12a is a flowchart of an operation process between an electronic device and an edge data network according to an embodiment of the present disclosure.

[0148] Figure 12b is a flowchart of an operation process between an electronic device and an edge data network according to an embodiment of the present disclosure.

[0149] Fig.12c is a flowchart of an operation process between an electronic device and an edge data network according to an embodiment of the present disclosure.

[0150] Fig.13ais a view for explaining a filter used when a network situation is good or a focus area of ​​a user is clear according to an embodiment of the present disclosure.

[0151] Fig.13b is a view for explaining a filter used when a network situation is not good or a focus area of ​​a user is unclear according to an embodiment of the present disclosure.

[0152] Fig.14a is a flowchart of an operation process between an electronic device and an edge data network according to an embodiment of the present disclosure.

[0153] Fig.14b is a flowchart of an operation process between an electronic device and an edge data network according to an embodiment of the present disclosure.

[0154] Fig.14c is a flowchart of an operation process between an electronic device and an edge data network according to an embodiment of the present disclosure.

[0155] Fig.14d is a flowchart of an operation process between an electronic device and an edge data network according to an embodiment of the present disclosure.

[0156] Fig.15 It is a view used to schematically illustrate the operation process between electronic devices, edge data networks and VR game interface devices.

[0157] Fig.16 3 is a view for explaining an operation of additionally filtering a focus movement prediction area and an interface area in a VR game field according to an embodiment of the present disclosure.

[0158] Fig.17a is a flowchart of a method for streaming image content performed by an edge data network according to an embodiment of the present disclosure.

[0159] Fig.17b It is a flowchart for illustrating in detail a method of the following operations performed by an edge data network according to an embodiment of the present disclosure: determining a region corresponding filter based on focus position information, and filtering a first local image based on information about the determined region corresponding filter stored in advance.

[0160] Fig.17c It is a flowchart for illustrating in detail a method of the following operation performed by an edge data network according to another embodiment of the present disclosure: determining a region corresponding filter based on focus position information, and filtering a first local image based on information about the determined region corresponding filter stored in advance.

[0161] Fig.17dIt is a flowchart for illustrating in detail a method of the following operation performed by an edge data network according to another embodiment of the present disclosure: determining a region corresponding filter based on focus position information, and filtering a first local image based on information about the determined region corresponding filter stored in advance.

[0162] Fig.18a is a flowchart of a method for streaming image content obtained from an edge data network and performed by an electronic device according to an embodiment of the present disclosure.

[0163] Fig.18b is a flowchart of a method for streaming image content obtained from an edge data network and performed by an electronic device according to another embodiment of the present disclosure.

[0164] Fig.18c is a flowchart of a method for streaming image content obtained from an edge data network and performed by an electronic device according to another embodiment of the present disclosure.

[0165] Fig.18d is a flowchart of a method for streaming image content obtained from an edge data network and performed by an electronic device according to another embodiment of the present disclosure.

[0166] Fig.19 is a block diagram of an electronic device according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0167] Embodiments of the present disclosure will now be described more fully with reference to the accompanying drawings.

[0168] In the following description of the embodiments of the present disclosure, descriptions of technologies that are well known in the art and are not directly related to the present disclosure are omitted. This is to clearly convey the gist of the present disclosure by omitting any unnecessary explanations.

[0169] For the same reason, some elements in the drawings are exaggerated, omitted or schematically illustrated. In addition, the actual size of the corresponding elements is not necessarily represented in the drawings. In the drawings, the same or corresponding elements are represented by the same reference numerals.

[0170] With reference to the embodiments of the present disclosure described in detail below with reference to the accompanying drawings, the advantages and features of the present disclosure and the methods for achieving these advantages and features will become apparent. However, the present disclosure can be embodied in many different forms and should not be construed as being limited to the embodiments set forth herein; on the contrary, these embodiments are provided so that the present disclosure will be thorough and complete and will fully convey the concept of the present disclosure to those of ordinary skill in the art. The scope of the present disclosure is limited only in the claims. Throughout the specification, the same reference numerals or characters refer to the same elements.

[0171] It should be understood that each block of the flowchart diagram and the combination of blocks of the flowchart diagram can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that the instructions executed by the processor of the computer or other programmable data processing device generate a device for performing the functions specified in the flowchart block. These computer program instructions can also be stored in a computer-usable or computer-readable memory, which can guide the computer or other programmable data processing device to function in a specific manner, so that the instructions stored in the computer-usable or computer-readable memory produce a product including an instruction means for performing the specified functions in the flowchart block. The computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are performed on the computer or other programmable data processing device to generate a computer executable process, so that the instructions executed on the computer or other programmable data processing device provide steps for implementing the functions specified in one or more flowchart blocks.

[0172] In addition, each block may represent a module, segment or portion of a code that includes one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in each block may not occur in the order presented. For example, depending on the functionality involved, two blocks shown in succession may actually be executed substantially concurrently, or blocks may sometimes be executed in reverse order.

[0173] The term "unit" or "applicator" used in the embodiment indicates a software component or a hardware component, such as a field programmable gate array (FPGA) or an application specific integrated circuit (ASIC), and the term "unit" or "applicator" performs certain functions. However, the term "unit" or "applicator" is not limited to software or hardware. The term "unit" or "applicator" can be configured to be included in an addressable storage medium or reproduce one or more processors. Therefore, as an example, the term "unit" or "applicator" can include object-oriented software components, class components and task components, as well as processes, functions, attributes, procedures, subroutines, program code segments, drivers, firmware, microcodes, circuits, data, databases, data structures, tables, arrays and variables. The functions provided by components and "units" or "applicators" can be combined into smaller number components and "units" or "applicators" can be further divided into additional components and "units" or "applicators". In addition, the components and "units" or "processors" may be implemented to operate one or more central processing units (CPUs) in a device or a secure multimedia card. According to an embodiment of the present disclosure, a "unit" or "processor" may include one or more processors.

[0174] Figure 1 It is a schematic diagram for illustrating the multi-access edge computing (MEC) technology in a network environment according to an embodiment of the present disclosure.

[0175] Reference Figure 1 , the network environment 100 of the present disclosure may include an electronic device 1000, an edge data network 2000, a cloud server 3000, and an access network (AN) 1100. However, the components included in the network environment 100 are not limited thereto.

[0176] According to an embodiment, each component included in the network environment 100 may refer to a physical entity unit, or may refer to a software or module unit capable of performing an individual function.

[0177] According to an embodiment, the electronic device 1000 may refer to a device used by a user. For example, the electronic device 1000 may refer to a terminal, a user equipment (UE), a mobile station, a subscriber station, a remote terminal, a wireless terminal, or a user device.

[0178] The electronic device 1000 may be a terminal for providing content so that a user is immersed in a virtual environment including at least one of virtual reality (VR), augmented reality (AR), or mixed reality (MR). That is, according to an embodiment, the electronic device 1000 may be a head mounted display (HMD) or a virtual reality headset (VRH) for providing content for VR, AR, or MR.

[0179] Reference Figure 1 , the electronic device 1000 may include a first application client (or application client) 122, a second application client 124, and an edge enabler client (or MEC enabling layer (MEL)) 130. In order to use the MEC service, the electronic device 1000 may perform necessary operations by using the edge enabler client 130. The edge enabler client 130 will be described in detail below.

[0180] According to an embodiment, the electronic device 1000 may execute multiple applications. For example, the electronic device 1000 may execute a first application client 122 and a second application client 124. Multiple applications may require different network services based on at least one of the following: required data transmission rate, delay time (or speed), reliability, the number of electronic devices that have accessed the network, the network access cycle of the electronic device 1000, or the average data usage. Different network services may include, for example, enhanced mobile broadband (eMBB) services, ultra-reliable and low-latency communication (URLLC) services, or massive machine type communication (mMTC) services.

[0181] The application client of the electronic device 1000 may refer to a default application previously installed in the electronic device 1000 or an application provided by a third party. That is, the application client of the electronic device 1000 may refer to a client application for a specific application service running in the electronic device 1000. Several application clients may run in the electronic device 1000. At least one of the application clients may use the service provided by the edge data network 2000. For example, the application client is an application installed and executed in the electronic device 1000, and may provide a function of sending and receiving data via the edge data network 2000. The application client of the electronic device 1000 may refer to an application software executed in the electronic device 1000 to use the functions provided by one or more specific edge applications.

[0182] According to an embodiment, multiple applications in the electronic device 1000 (i.e., the first application client 122 and the second application client 124) may perform data transmission with the cloud server 3000 based on the required network service type, or perform data transmission with the edge data network 2000 based on edge computing. For example, when the first application client 122 does not require low latency, the first application client 122 may perform data transmission with the cloud server 3000. As another example, when the second application client 124 requires low latency, the second application client 124 may perform MEC-based data transmission with the edge data network 2000.

[0183] According to an embodiment, the application in the electronic device 1000 may be referred to as an application client, a client application (client App) or a UE application (UE App). For convenience, hereinafter, in the present disclosure, the application in the electronic device 1000 is referred to as an application client.

[0184] According to an embodiment, the AN 1100 may provide a channel for wireless communication with the electronic device 1000. For example, the AN 1100 may refer to a radio access network (RAN), a base station, an evolved Node B (eNodeB or eNB), a fifth generation (5G) node, a transmission / reception point (TRP), or a 5G NodeB (5GNB).

[0185] According to an embodiment, the edge data network 2000 may refer to a server that the electronic device 1000 accesses to use MEC services. The edge data network 2000 may be set at a location geographically close to the electronic device 1000, for example, inside or around a base station. According to an embodiment, the edge data network 2000 may send data to the electronic device 1000 and receive data from the electronic device 1000 without passing through an external data network (DN) (e.g., the Internet). According to an embodiment, MEC may represent multi-access edge computing or mobile edge computing.

[0186] According to an embodiment, the edge data network 2000 may be referred to as an MEC host, an edge computing server, a mobile edge host, an edge computing platform, an MEC server, or the like. For convenience, hereinafter, in the present disclosure, the edge data network 2000 may be referred to as an MEC server. Figure 1 , the edge data network 2000 may include a first edge application 142, a second edge application 144, and an edge enabler server (or MEC platform (MEP)) 146. The edge enabler server 146 provides MEC services or performs business control in the edge data network 2000, and a detailed description of the edge enabler server 146 will be made below.

[0187] According to an embodiment, the edge data network 2000 can execute multiple applications. For example, the edge data network 2000 can execute a first edge application 142 and a second edge application 144. According to an embodiment, an edge application may refer to an application provided by a third party in an edge data network that provides MEC services, and may also be referred to as an edge application. The edge application may be used to establish a data session with an application client in order to send and receive data associated with the application client. That is, the edge application may establish a data session with the application client. According to an embodiment, a data session may refer to a communication path established for an application client in an electronic device 1000 and an edge application in an edge data network 2000 to send data to each other and receive data from each other.

[0188] According to an embodiment, the application in the edge data network 2000 may be referred to as an MEC application (MEC App), an ME (MEC) application, an edge application server, or an edge application. For convenience, hereinafter, in the present disclosure, the application in the edge data network 2000 is referred to as an edge application. Although the term "application" is used in the present disclosure, an edge application may refer to an application server present in an edge data network.

[0189] According to an embodiment, the cloud server 3000 may provide content associated with an application. For example, the cloud server 3000 may be managed by a content provider. According to an embodiment, the cloud server 3000 may send data to the electronic device 1000 and receive data from the electronic device 1000 via an external DN (e.g., the Internet).

[0190] Despite Figure 1Although not shown in the figure, the core network (CN) and the DN may be located between the AN 1100 and the edge data network 2000. According to an embodiment, the DN may provide services (e.g., Internet services or Internet Protocol (IP) Multimedia Subsystem (IMS) services) by sending data (or data packets) to the electronic device 1000 via the CN and the AN 1100 and receiving data from the electronic device 1000. For example, the DN may be managed by a communication provider. According to an embodiment, the edge data network 2000 may be connected to the AN 1100 or the CN via a DN (e.g., a local DN).

[0191] According to an embodiment, when the first application client 122 or the second application client 124 is executed in the electronic device 1000, the electronic device 1000 may access the edge data network 2000 via the AN 1100 to send and receive data for executing the application client.

[0192] In the present disclosure, a method for streaming image content between the above-mentioned electronic device 1000, edge data network 2000 and cloud server 3000 may be provided. In more detail, a method for effectively providing a user with content for VR, AR or MR based on the user's interactive information about an image reproduced by the electronic device 1000 is described. An embodiment of a method for streaming image content based on orientation information and focus position information about image content reproduced by the electronic device 1000, performed by the edge data network 2000, will now be described.

[0193] Figure 2a is a diagram for illustrating motion-to-photon (MTP) latency that occurs while an edge data network is providing content to an electronic device based on a field-of-view (Fov) transmission technique according to an embodiment of the present disclosure.

[0194] Reference Figure 2a , the electronic device 1000 can obtain sensor information including orientation information and the like through the sensing module, and can periodically or non-periodically send the sensor information to the edge data network 2000 when the value of the sensor information changes. The edge data network 2000 can obtain the Fov frame 220 from the first frame 210 in the VR sequence based on the orientation information. The edge data network 2000 can encode the Fov frame 220 to generate encoded Fov frame information, and can send the encoded Fov frame information to the electronic device 1000.

[0195] The electronic device 1000 may obtain the Fov reconstructed frame 230 by decoding the encoded Fov frame information, and perform rendering on the Fov reconstructed frame, and then the electronic device 1000 may display the rendered Fov frame 240 on the display of the electronic device 1000 .

[0196] In this case, the time period from detecting the user's movement by using sensor information obtained by the electronic device 1000, receiving the encoded Fov frame information through the edge data network 2000 based on the sensor information, and performing decoding and rendering to displaying the rendered Fov frame on the display can be defined as motion to photon (MTP) delay. When the MTP delay is large, the user may feel that a delay occurs in the frame reproduced by the electronic device 1000, and therefore, the user may feel that the frame reproduction is not smooth. When the MTP delay is small enough, the user may not feel that a delay occurs in the frame reproduced by the electronic device 1000, and therefore, the user may feel that the frame reproduction is smooth.

[0197] Therefore, when the MTP delay can be sufficiently reduced, the user can feel that the frame reproduction is smooth while the edge data network is providing content to the electronic device according to the Fov transmission technology.

[0198] Figure 2b is a view for explaining MTP delay occurring while an edge data network is providing content to an electronic device according to a separation rendering technology according to an embodiment of the present disclosure.

[0199] Reference Figure 2b ,and Figure 2a Differently, the edge data network 2000 can obtain an enlarged Fov frame 265 having a size enlarged by a predetermined range from the size of the Fov frame 260, instead of obtaining the Fov frame based on the orientation information. The electronic device 1000 can receive the encoded enlarged Fov frame information, obtain the enlarged reconstructed Fov frame 270 by decoding the enlarged Fov frame information, determine the Fov portion 275 within the enlarged reconstructed Fov frame based on the enlarged reconstructed Fov frame 270, and perform rendering on the determined Fov portion (Fov frame) 275, and then the electronic device 1000 can display the rendered Fov frame 280 on the display of the electronic device 1000. That is, the delay can be reduced by rendering and displaying the Fov frame based on the orientation information sensed at the time of post-recovery rendering, which is sensor information closer than the sensor information used when obtaining the enlarged Fov frame 265.

[0200] As in Figure 2a As in the example, MTP delay may occur in the process of the edge data network providing content to the electronic device according to the separated rendering technology, and when the MTP delay is small enough (for example, less than 20ms), the user can feel that the frame reproduction is smooth.

[0201] Figure 2c 2 is a view for explaining MTP delay that variably occurs when movement occurs in an electronic device by a user in a process of providing contents according to the Fov transmission technology and the separation rendering technology according to an embodiment of the present disclosure.

[0202] When the user moves while wearing the electronic device 1000 , movement 285 may occur in the electronic device 1000 .

[0203] The electronic device 1000 may transmit sensor information about movement and receive encoded Fov frame information or expanded Fov frame information based on the sensor information to reproduce the Fov frame. In this case, the generated MTP delay may be variable. That is, the total delay may be variable according to the time point when the edge data network 2000 encodes and transmits the Fov frame or the expanded Fov frame 290 based on the sensor information.

[0204] Therefore, it is necessary to reduce the processing delay when the edge data network 2000 encodes and sends the Fov frame or the expanded Fov frame based on the sensor information. For example, when the edge data network 2000 is able to encode and send the Fov frame or the expanded Fov frame based on the sensor information so that the processing delay is guaranteed to be within 14ms, the user can feel that the frame reproduction through the display of the electronic device 1000 is smooth.

[0205] A technique for reducing processing delay among MTP delays according to various embodiments of the present disclosure will now be described.

[0206] Figure 3 is a view used to illustrate concave rendering.

[0207] Reference Figure 3 , when the user views the VR image 300 through the electronic device 1000, the VR image actually seen by the user may change according to the focus of the user's eyes. For example, when the user gazes at the central part of the VR image 300, the focus is located at the central part, only the focus area 315 located at the center of the VR image 310 is clearly visible, and the area outside the focus area 315 is blurred. When the user gazes at the lower part of the VR image 300, the focus is located at the lower part, only the focus area 325 located in the lower part of the VR image 320 is clearly visible, and the area outside the focus area 325 is blurred. When the user gazes at the left part of the VR image 300, the focus is located at the left part, only the focus area 335 located in the left part of the VR image 330 is clearly visible, and the area outside the focus area 335 is blurred.

[0208] Even when the surroundings of the focus area of ​​the VR image are blurred, the user's eyes may not be able to distinguish that the surroundings are blurred. That is, the role of cones is important for the human eye to distinguish objects, and the cones are concentrated on the image formed on the retina at about ±10°, and, in the area outside ±10°, the image formed on the retina is difficult to distinguish clearly because it is blurred. Therefore, even when the surroundings of the focus area of ​​the VR image are blurred, the user's eyes may not be able to distinguish that the surroundings are blurred.

[0209] As a result, when a VR image is processed according to the concave rendering technique, the processed image data can be reduced.

[0210] A technique for reducing processing delay among MTP delays in consideration of concave rendering according to various embodiments of the present disclosure will now be described.

[0211] Figure 4 It is a view used to schematically illustrate the operation process between an electronic device and an edge data network.

[0212] Reference Figure 4 , the edge data network 2000 may perform an operation by using one VR image (e.g., the first image) of the VR image sequence as an input image. In this case, the image cropper 2010 included in the edge data network 2000 may obtain a first partial image from the first image by cropping the first image based on the orientation information included in the sensor information received from the electronic device 1000. According to an embodiment, it may take about 4 to 5 ms for the image cropper 2010 to obtain the first partial image from the first image.

[0213] The VR view shader 2020 included in the edge data network 2000 may perform a process of transforming the 3D first partial image into the plane first partial image. According to an embodiment, the VR view shader 2020 may perform a process of transforming the 3D first partial image into the plane first partial image, which may take about 1 ms.

[0214] The encoder 2040 included in the edge data network 2000 may encode the first partial image by using various conventional codecs (e.g., H.264, HEVC, VP9, ​​and AV1). The transmitter 2050 included in the edge data network 2000 may transmit the encoded first partial image information to the electronic device 1000. In this case, the encoded first partial image information may be transmitted in a bit stream form and in particular in a packet form. According to an embodiment, encoding and transmitting the first partial image may take about 5 to 6 ms.

[0215] The receiver 1010 included in the electronic device 1000 may receive the encoded first partial image information from the edge data network 2000. The receiver 1010 included in the electronic device 1000 may obtain the first partial image information from the encoded first partial image information in a packet form and output the first partial image information to the decoder 1020. According to an embodiment, it may take about 1 to 2 ms for the receiver 1010 to receive the first partial image information from the edge data network 2000 and output the first partial image information to the decoder 1020.

[0216] The decoder 1020 included in the electronic device 1000 may decode the encoded first partial image information to obtain a reconstructed first partial image. According to an embodiment, it may take about 1 ms for the decoder 1020 to decode the first partial image information.

[0217] The renderer 1040 included in the electronic device 1000 may receive the reconstructed first partial image in a plane form and project the reconstructed first partial image onto a virtual sphere to output the reconstructed first partial image in a 3D form.

[0218] The sensor unit 1050 of the electronic device 1000 may periodically or aperiodically obtain sensor information such as orientation information or focus position information of the electronic device 1000 when the value of the sensor information changes, and may transmit the sensor information to the edge data network 2000. The sensor information receiver 2060 included in the edge data network 2000 may receive the sensor information from the electronic device 1000.

[0219] In the technology for reducing the processing delay among the MTP delay, according to various embodiments of the present disclosure, the edge data network 2000 may include a filtering unit 2030 located between the VR view shader 2020 and the encoder 2040. The electronic device 1000 may include a filtering unit 1030 located between the decoder 1020 and the renderer 1040.

[0220] The filtering unit 2030 may perform filtering on the planar first partial image output by the VR view shader 2020 to obtain a filtered first partial image, and may output the filtered first partial image to the encoder 2040. By compressing the first partial image through filtering, the filtering unit 2030 may reduce the size of the encoded first partial image, thereby reducing the time required for encoding, and also reducing the network bandwidth. Therefore, the edge data network 2000 may reduce the operation time of the encoder 2040 and the transmitter 2050. According to an embodiment, the processing delay may be about 10 to 12 ms in the edge data network 2000 and about 2 to 3 ms in the electronic device 1000, and therefore, the total processing delay may be the sum of the network delay and the processing delay of the electronic device 1000 and the edge data network 2000 (about 12 to 15 ms), but the processing delay may be reduced by the operation of the filtering unit 2030 and the filtering unit 1030.

[0221] The electronic device 1000 can reduce the operation time of the receiver 1010 and the decoder 1020 by receiving and decoding the compression-coded first partial image whose size is reduced by filtering. The filtering unit 1030 can reconstruct the first partial image in a concave form by interpolating the reconstructed first partial image through an interpolation technique.

[0222] As a result, the filtering unit 2030 can obtain the focus area so that the focus area can be encoded without change, and can obtain only a part of the area other than the focus area so that only the part can be encoded by filtering, or can compress the information of the area other than the focus area by filtering (for example, a low-pass filter, such as a Gaussian blur filter).

[0223] After the electronic device 1000 receives the image obtained by filtering by the filtering unit 2030 from the edge data network 2000 and decodes it, the filtering unit 1030 can interpolate the remaining unobtained part of the first local image obtained by the filtering unit 2030 except for a part of the area outside the focus area through interpolation technology, or process the reconstructed image obtained by the decoder 1020 through filtering, thereby reconstructing the first local image, so that the user can feel that the area except the focus area is not rough.

[0224] Figure 5 It is a view used to schematically illustrate the operation process between an electronic device and an edge data network.

[0225] According to an embodiment, the electronic device 1000 may include a sensing module 510, a network interface 520, a processor 530, and a memory 540. However, the structure of the electronic device is not limited thereto, and the electronic device may include more than Figure 5More or fewer components than those shown.

[0226] The electronic device 1000 may decode an image received from the edge data network 2000 or the cloud server 3000, and may display the decoded image on a display of the electronic device. The electronic device 1000 may obtain sensor information by using the sensing module 510, the sensor information including orientation information and focus position information about the reproduced image. The orientation information may include a gaze angle value desired by a user of the electronic device measured using the sensing module. The focus position information may be information indicating the position of the focus of the user's pupil.

[0227] For example, the sensor information may include first orientation information corresponding to the first partial image, and the position of the first partial image may be determined within the first VR image based on the first orientation information. That is, the orientation information may indicate the corresponding position of the partial image relative to the VR image, and the position of each partial image may be determined within the VR image based on the orientation information. According to an embodiment, the range of the partial image within the VR image that can be discerned based on the orientation information may vary according to the display area (e.g., the size of the viewport area) that can be viewed by the user of the electronic device 1000 in the display device.

[0228] According to an embodiment, the electronic device 1000 can sense the orientation information (e.g., roll value, pitch value, and yaw value) of the user's gaze staring at a specific partial image within the VR image by using a sensing module (e.g., a 3-axis tilt sensor), and can match the sensed orientation information with the partial image corresponding to the orientation information. The electronic device 1000 can share information about which part of the VR image the user of the current electronic device is viewing with the edge data network 2000 by sending the sensed orientation information to the edge data network 2000.

[0229] The electronic device 1000 transmits the orientation information and the focus position information 552 to the edge data network 2000 by using the network interface 520. At this time, the electronic device 1000 may transmit the frame index information to the edge data network 2000 when the orientation information and the focus position information are sensed. However, the present disclosure is not limited thereto, and the electronic device 1000 may transmit the reference frame information included in the frame reconstructed before the orientation information and the focus position information are sensed to the edge data network 2000. The frame index may be information indicating the encoding / decoding order of the frames, but is not limited thereto and may be information indicating the rendering order of the frames.

[0230] The processor 530 may control the overall operation of the electronic device 1000 by executing one or more instructions stored in the memory 540. For example, the processor 530 may control the sensing module 510 and the network interface 520 by executing one or more instructions stored in the memory 540. According to an embodiment, the processor 530 may obtain a first partial image from the edge data network 2000 based on first position information about a first partial image reproduced by the electronic device 1000. In this case, the first partial image may be an intra-coded (I) frame or a predictive coded (P) frame (or a bidirectional coded (B) frame).

[0231] For example, the edge data network 2000 may store a VR sequence including all frames in a database (DB). The edge data network 2000 may identify a first partial image from the VR sequence stored in the DB by using the first position information obtained by the electronic device 1000.

[0232] According to an embodiment, the processor 530 may receive the encoded frame information 554 from the edge data network 2000, and may decode the first partial image based on the encoded frame information 554 to obtain the first partial image. The processor 530 may reconstruct the first partial image by using a filter determined based on the focus position information from among a plurality of filters. The processor 530 may determine a filter from among a plurality of filters based on the focus position information, and may perform filtering on the first partial image using the determined filter to reconstruct the first partial image. For example, the processor 530 may enlarge the first partial image by using the filter information, and may obtain the first partial image by interpolating the enlarged first partial image using an interpolation technique (e.g., using an interpolation filter). This will be referred to later. Figure 7 The operation of processing the frame 554 received from the edge data network 2000 based on the filter information 546 is described in detail.

[0233] The processor 530 may reproduce the reconstructed first partial image.

[0234] The processor 530 may receive information of a region corresponding filter corresponding to each of a plurality of regions from the edge data network 2000 , and may store the information of the plurality of region corresponding filters in the memory 540 .

[0235] The processor 530 may receive information of a plurality of region correspondence filter groups and may store the information of the plurality of region correspondence filter groups in the memory 540. Each of the plurality of region correspondence filter groups may include a region correspondence filter corresponding to each of a plurality of predetermined regions within the image.

[0236] According to an embodiment, the memory 540 may include: a decoder module 542 for storing instructions for decoding a coded frame received from the edge data network 2000; and a filter module 544 for performing filtering on the decoded image, and the memory 540 may store filter information 546 used in the filter module 544, but the present disclosure is not limited thereto. For example, the filter module 544 may include but is limited to a module for storing instructions for the following operations: a method for reconstructing a first partial image by using one filter determined using focus position information among a plurality of filters in a computer.

[0237] According to an embodiment, the edge data network 2000 may include a network interface 560, a processor 570, and a memory 580. However, the structure of the edge data network 2000 is not limited to the above structure, and the edge data network 2000 may include more than Figure 5 The components shown in the figure are more components, or may be omitted Figure 5 Some of the components shown.

[0238] The edge data network 2000 may obtain the orientation information and the focus position information from the electronic device 1000 by using the network interface 560 , and may transmit the encoded frame information from the edge data network 2000 to the electronic device.

[0239] The processor 570 controls the overall operation of the edge data network 2000 by executing one or more instructions stored in the memory 580. For example, the processor 570 may determine one filter among a plurality of filters based on the focus position information, and may perform filtering on the first partial image corresponding to the orientation information by using the one filter to generate a filtered first partial image.

[0240] The processor 570 may generate information of a region corresponding filter corresponding to each of a plurality of predetermined regions within the image based on the focus position information, and may store the generated information in the memory 580. The server 570 may transmit information of a plurality of region corresponding filters to the electronic device 1000.

[0241] The processor 570 may generate information of a plurality of region-corresponding filter groups (eg, filter information 588) and may store the information in the memory 580. One region-corresponding filter group may include a plurality of region-corresponding filters.

[0242] The processor 570 may determine one region among a plurality of regions based on the focus position information, and may determine a region-corresponding filter corresponding to the determined region.

[0243] The processor 570 may generate a reduced first partial image by performing filtering on the first partial image corresponding to the orientation information based on the stored information about the region corresponding filter corresponding to the determined region. Figure 6 An operation of processing the first partial image by using the azimuth information and focus position information 552 received from the electronic device 1000 and the filter information 588 stored in the memory 580 is described in detail.

[0244] According to an embodiment, the memory 580 may include: an encoder module 582 for storing instructions for encoding an image to be sent by the edge data network 2000 to the electronic device 1000; and a filter module 584 for performing filtering before encoding. And the memory 580 may store filter information 588 and a VR sequence 586 including overall image data about the VR sequence, but the present disclosure is not limited thereto.

[0245] Figure 6 is a view for explaining a process by which an edge data network encodes and transmits a reduced image by using a filter according to an embodiment.

[0246] Reference Figure 6 , the edge data network 2000 can obtain an original image 610 corresponding to the orientation information included in the VR image. The edge data network 2000 can obtain a filtered image 630 by using a filter 620. For example, the filter may be a digital filter in which the coefficient is expressed as 0 or 1. Preferably, considering the focus position, the coefficient of the filter corresponding to the focus area may be 1, and only a part of the coefficient of the filter corresponding to the area other than the focus area may be 1 and may decrease in the direction away from the focus area.

[0247] The edge data network 2000 may obtain a filtered image 630 by multiplying the elements of the matrix of the original image 610 by the elements of the filter matrix including the coefficients of the filter 620. When the filter coefficient is 1, the edge data network 2000 may obtain data of pixels in the image corresponding to only the filter coefficient, and when the filter coefficient is 0, the edge data network 2000 may not obtain data of pixels in the image corresponding to the filter coefficient. As a result, the filtered image may be an image in which a portion has no data.

[0248] The edge data network 2000 can reduce a portion without data by rearranging pixels with data (data pixels) in the filtered image 630, and thus a reduced image 640 can be obtained. The pixels with data can be rearranged according to a predetermined method. For example, the predetermined method refers to a method of rearranging pixels with data in the order of data pixels scanned in the filtered image 630 according to a predetermined scanning order. The predetermined scanning order may be, but is not limited to, one of the following: a raster scanning order, a vertical scanning order, a horizontal scanning order, or a zigzag scanning order. The predetermined method is not limited to a method based on a predetermined scanning order, and may be any of a variety of methods.

[0249] The edge data network 2000 may generate a coded reduced image 650 by encoding the reduced image 640 , and may transmit the coded reduced image 650 .

[0250] The edge data network 2000 may perform filtering using the filter 620 to obtain a reduced image 640 , and encode the reduced image 640 , thereby reducing the amount of encoded image data and thus reducing processing delay.

[0251] Figure 7 is a view for explaining a process by which an electronic device expands and interpolates a decoded image by using a filter and renders an interpolated image according to an embodiment.

[0252] Reference Figure 7 , the electronic device 1000 can obtain the decoded image 710 by receiving the encoded reduced image 650 from the edge data network 2000 and decoding it.

[0253] The electronic device 1000 may expand the decoded image 710. At this time, based on the filter information received from the edge data network 2000, the electronic device 1000 may move the pixels with data to the positions of the pixels with data originally located by reversing the rearrangement of the pixels with data by the edge data network 2000 according to a predetermined method, and may obtain an expanded image 720, and pixels without data may exist in the expanded image 720.

[0254] The electronic device 1000 may obtain the interpolated image 730 by performing an interpolation method on the extended image 720. The electronic device 1000 may render the interpolated image 730.

[0255] The electronic device 1000 can expand the reduced image obtained by the edge data network 2000 to obtain an image of the same size as the original image 610, and interpolate the area without data generated by filtering in the edge data network 2000, thereby reconstructing an image from the data of the reduced image that does not make the user feel rough when viewed by the user.

[0256] Figure 8a is a flowchart of an operation process between an electronic device and an edge data network according to an embodiment of the present disclosure.

[0257] Reference Figure 8a In operation S802, the electronic device 1000 may obtain orientation information and focus position information. According to an embodiment, the orientation information may include information indicating the position of a first partial image reproduced by the electronic device 1000 within the first VR image. According to an embodiment, the focus position information refers to information indicating the position of a focus of a user's pupil within the first partial image reproduced by the electronic device 1000, and may be gaze information of a user's pupil obtained by an eye tracker.

[0258] In operation S804 , the electronic device 1000 may send the orientation information and the focus position information to the edge data network 2000 .

[0259] In operation S806, the edge data network 2000 may determine a filter among a plurality of filters based on the focus position information. In this case, when at least one of the area to which the filter is applied (e.g., the area excluding the focus area), the size of the mask, and the value of the coefficient within the mask is different between the filters, the plurality of filters may be considered to be different filters. For example, even when a Gaussian filter is used, when at least one of the size of the mask of the Gaussian filter, the area to which the Gaussian filter is applied, and the value of the coefficient within the mask is different between the Gaussian filters, the plurality of Gaussian filters may be considered to be different filters.

[0260] In operation S808 , the edge data network 2000 may generate a filtered first partial image by performing filtering on the first partial image corresponding to the orientation information using a filter determined based on the focus position information.

[0261] In operation S810, the edge data network 2000 may generate a first frame by encoding the filtered first partial image. For example, the edge data network 2000 may generate a first frame, such as an I frame or a P frame (or a B frame), by encoding the first partial image. The aforementioned I frame, P frame, and B frame may be data frames for compressing images according to a lossy compression algorithm developed by the International Organization for Standardization Moving Picture Experts Group (MPEG). In addition, the B frame may represent a data frame for compressing an image at a high compression rate by referring to at least one of the P frame or the I frame.

[0262] In operation S812 , the edge data network 2000 may transmit a first frame to the electronic device 1000 .

[0263] In operation S814, the electronic device 1000 may obtain a first partial image by decoding the first frame.

[0264] In operation S816, the electronic device 1000 may determine one filter among a plurality of filters based on the focus position information, and may reconstruct the first partial image by filtering the first partial image using the one filter. In this case, the focus position information may be information obtained in operation S802, but is not limited thereto, and may be information re-obtained at the time for determining the current filter.

[0265] In operation S818, the electronic device 1000 may reproduce the reconstructed first partial image.

[0266] Figure 8b is a flowchart of an operation process between an electronic device and an edge data network according to an embodiment of the present disclosure.

[0267] exclude Figure 8b The operations S828, S830, S836 and S838 may correspond to Figure 8a operation, therefore, its detailed description will be omitted.

[0268] In operation S828, the edge data network 2000 may generate a reduced first partial image by performing filtering on the first partial image corresponding to the orientation information using a filter determined based on the focus position information. Figure 6 An example of generating a reduced first partial image by performing filtering is described.

[0269] In operation S830 , the edge data network 2000 may generate a first frame by encoding the reduced first partial image.

[0270] In operation S836, the electronic device 1000 may determine a filter among a plurality of filters based on the focus position information, and may expand the first partial image by using the determined one filter. Figure 7 An example of extending the first partial image by using a filter is described.

[0271] In operation S838, the electronic device 1000 may reconstruct the first partial image by interpolating the expanded first partial image.

[0272] Figure 9a 2 is a view for explaining a plurality of region correspondence filters according to an embodiment of the present disclosure.

[0273] Reference Figure 9a, the edge data network 2000 may generate a plurality of separated regions (e.g., regions A, B, C, D, E, F, G, H, and I) within the image 900, and may store region-corresponding filters corresponding to the plurality of separated regions, respectively (e.g., filter a corresponding to region A, filter b corresponding to region B, ..., and filter i corresponding to region I). In this case, the region near each separated region is a high-definition region, and the region is classified into a medium-definition region and a low-definition region in a direction away from each separated region, so that the coefficients of the region-corresponding filters may be determined. In this case, most of the coefficients of the high-definition region may be coefficients greater than or equal to the first value, the coefficients of the medium-definition region may have a smaller number of coefficients greater than or equal to the first value than the coefficients of the high-definition region, and the coefficients of the low-definition region may have a smaller number of coefficients greater than or equal to the first value than the coefficients of the medium-definition region. The first value may be 1, but is not limited thereto.

[0274] The edge data network 2000 obtains data of a high-definition area corresponding to the focus area without change by filtering the first local image based on information of an area corresponding filter of an area where the focus of the pupil of a user using the electronic device 1000 is located from information of a plurality of area corresponding filters stored, and selectively obtains only a portion of the data of a medium-definition area and a low-definition area, thereby reducing the size of the data.

[0275] Figure 9b is a view for explaining a method of performing filtering by using a region corresponding filter corresponding to a focus region among a plurality of region corresponding filters according to an embodiment of the present disclosure.

[0276] Reference Figure 9b , the edge data network 2000 may determine the position of the focus 915 within the first partial image 910 based on the focus position information received from the electronic device 1000. The edge data network 2000 may perform filtering by performing a multiplication operation on a matrix 920 stored for a region corresponding to the filter d corresponding to the region D (which is the region where the focus 915 is located) and a matrix of the first partial image 910.

[0277] Fig.9c is a view for explaining a method of performing filtering by using a region corresponding filter corresponding to a focus region among a plurality of region corresponding filters according to an embodiment of the present disclosure.

[0278] Reference Fig.9c, the edge data network 2000 may determine the position of the focus 935 within the first partial image 930 based on the focus position information received from the electronic device 1000. The edge data network 2000 may perform filtering by performing a multiplication operation on a matrix 940 stored for a region corresponding to a filter f corresponding to a region F where the focus 935 is located and a matrix of the first partial image 910.

[0279] Fig.10a is a flowchart of an operation process between an electronic device and an edge data network according to an embodiment of the present disclosure.

[0280] Reference Fig.10a In operation S1002, the edge data network 2000 may generate a plurality of region correspondence filters within a predetermined image, and may store the generated plurality of region correspondence filters. Each region correspondence filter may be stored in the form of a lookup table (LUT).

[0281] In operation S1004 , the edge data network 2000 may send information of filters corresponding to a plurality of regions to the electronic device 1000 .

[0282] In operation S1006, the electronic device 1000 may store information of a plurality of area correspondence filters.

[0283] In operation S1008, the electronic device 1000 may obtain orientation information and focus position information.

[0284] In operation S1010 , the electronic device 1000 may transmit orientation information and focus position information to the edge data network 2000 .

[0285] In operation S1012, the edge data network 2000 may determine an area among a plurality of areas based on the focus position information, and may generate a reduced first partial image by performing filtering on the first partial image corresponding to the orientation information based on stored information about an area corresponding filter corresponding to the determined area.

[0286] In operation S1014 , the edge data network 2000 may generate a first frame by encoding the filtered first partial image.

[0287] In operation S1016 , the edge data network 2000 may transmit a first frame to the electronic device 1000 .

[0288] In operation S1018, the electronic device 1000 may obtain a first partial image by decoding the first frame.

[0289] In operation S1020, the electronic device 1000 may determine one region correspondence filter among a plurality of region correspondence filters based on the focus position information, and may expand the first partial image by using stored information about the determined region correspondence filter.

[0290] In operation S1022, the electronic device 1000 may reconstruct the first partial image by interpolating the expanded first partial image.

[0291] In operation S1024, the electronic device 1000 may reproduce the reconstructed first partial image.

[0292] Fig.10b is a flowchart of an operation process between an electronic device and an edge data network according to an embodiment of the present disclosure.

[0293] Fig.10b The operations of the exclusion operations S1044, S1046 and S1050 may correspond to Fig.10a operation, therefore, its detailed description will be omitted.

[0294] Reference Fig.10b In operation S1044, the edge data network 2000 may generate a first frame and index information indicating one of a plurality of region corresponding filters by encoding the reduced first partial image.

[0295] In operation S1046 , the edge data network 2000 may transmit the first frame and index information to the electronic device 1000 .

[0296] In operation S1050, the electronic device 1000 may determine one region correspondence filter among a plurality of region correspondence filters according to the index information, and may expand the first partial image by using stored information about the determined region correspondence filter.

[0297] Fig.11a is a view for explaining an overlapping area between a plurality of filtering areas according to an embodiment of the present disclosure.

[0298] Reference Fig.11a , regions A, B, C, D, E, F, G, H, and I used to determine the region correspondence filter may include overlapping regions 1105 between adjacent regions.

[0299] For example, the right side portion of region A and the left side portion of region B may be an overlapping region. In the overlapping region, a region corresponding to region A may be determined to correspond to filter a, and a region corresponding to region B may be determined to correspond to filter b. The reason for determining a plurality of regions so that there are overlapping regions is to allow an image to be naturally reproduced in a boundary region between adjacent regions.

[0300] Now refer to Fig.11b and Fig.11c A method of performing filtering by using a plurality of region correspondence filters having an overlapping region between adjacent regions, which is performed by the edge data network 2000 according to an embodiment of the present disclosure, is described.

[0301] Fig.11b 2 is a view for explaining a method of performing filtering by using a plurality of region corresponding filters having an overlapping region between adjacent regions, which is performed by the edge data network 2000 according to an embodiment of the present disclosure.

[0302] The edge data network 2000 may determine a region-corresponding filter in the overlapping region 1110 between regions A and B based on the current focus position information and the focus movement vector information. Fig.11b , when the current focus is located in the overlapping area 1110, the size of the focus moving vector is greater than or equal to the predetermined size, and the direction of the focus moving vector is from area A to area B, the edge data network 2000 may determine a filter b corresponding to area B in the overlapping area 1110, and may perform filtering on the first partial image corresponding to the orientation information by applying the filter b. However, the present disclosure is not limited thereto, and when the size of the focus moving vector is less than or equal to the predetermined size, the edge data network 2000 may determine a filter a corresponding to area A.

[0303] Fig.11c 2 is a view for explaining a method of performing filtering by using a plurality of region corresponding filters having an overlapping region between adjacent regions, which is performed by the edge data network 2000 according to an embodiment of the present disclosure.

[0304] refer to Fig.11c , when the current focus is located in the overlapping area 1120 between areas A and B, the size of the focus moving vector is greater than or equal to the predetermined size, and the direction of the focus moving vector is from area B to area A, the edge data network 2000 may determine a filter a corresponding to area A in the overlapping area 1120, and may perform filtering on the first partial image corresponding to the orientation information by applying the filter a. However, the present disclosure is not limited thereto, and when the size of the focus moving vector is less than or equal to the predetermined size, the edge data network 2000 may determine a filter b corresponding to area B.

[0305] Fig.12a is a flowchart of an operation process between an electronic device and an edge data network according to an embodiment of the present disclosure.

[0306] Reference Fig.12aIn operation S1202, the edge data network 2000 may generate a region correspondence filter corresponding to each of a plurality of predetermined regions and may store the generated plurality of region correspondence filters.

[0307] In operation S1204 , the edge data network 2000 may send information of filters corresponding to a plurality of regions to the electronic device 1000 .

[0308] In operation S1206, the electronic device 1000 may store information of a plurality of area correspondence filters.

[0309] In operation S1208, the electronic device 1000 may obtain orientation information, focus position information, and focus movement vector information. In this case, the focus movement vector may refer to a vector having a focus position before a predetermined time as a starting point and a current focus position as an end point.

[0310] In operation S1210 , the electronic device 1000 may transmit orientation information, focus position information, and focus movement vector information to the edge data network 2000 .

[0311] In operation S1212, the edge data network 2000 may determine one region corresponding filter among a plurality of region corresponding filters based on the focus position information and the focus moving vector information, and may generate a reduced first partial image by filtering the first partial image corresponding to the orientation information based on the stored information about the determined one region corresponding filter. Fig.11b and Fig.11c An example is described in which the electronic device 1000 determines one area corresponding filter among a plurality of area corresponding filters by using the focus position information and the focus movement vector information.

[0312] In operation S1214, the edge data network 2000 may generate a first frame by encoding the reduced first partial image.

[0313] In operation S1216 , the edge data network 2000 may transmit a first frame to the electronic device 1000 .

[0314] In operation S1218, the electronic device 1000 may obtain a first partial image by decoding the first frame.

[0315] In operation S1220, the electronic device 1000 may determine one region correspondence filter among a plurality of region correspondence filters based on the focus position information and the focus movement vector information, and may expand the first partial image by using stored information about the determined region correspondence filter.

[0316] In operation S1222, the electronic device 1000 may reconstruct the first partial image by interpolating the expanded first partial image.

[0317] In operation S1224, the electronic device 1000 may reproduce the reconstructed first partial image.

[0318] Figure 12b is a flowchart of an operation process between an electronic device and an edge data network according to an embodiment of the present disclosure.

[0319] Figure 12b The operations of the exclusion operations S1244, S1246 and S1250 may correspond to Fig.12a operation, therefore, its detailed description will be omitted.

[0320] In operation S1244, the edge data network 2000 may transmit the first frame and index information indicating one of a plurality of region corresponding filters by encoding the reduced first partial image.

[0321] In operation S1246 , the edge data network 2000 may transmit the first frame and index information to the electronic device 1000 .

[0322] In operation S1250, the electronic device 1000 may determine one region correspondence filter among a plurality of region correspondence filters based on the index information, and may expand the first partial image by using stored information about the determined one region correspondence filter.

[0323] Fig.12c is a flowchart of an operation process between an electronic device and an edge data network according to an embodiment of the present disclosure.

[0324] Fig.12c The operations of the exclusion operations S1262 to S1270 may correspond to Fig.12a Therefore, the detailed description thereof will be omitted. Fig.12c Not shown, but as mentioned above Fig.12a and Figure 12b As described, the edge data network 2000 may generate a region-corresponding filter corresponding to each of a plurality of regions, and may store the generated plurality of region-corresponding filters in the edge data network 2000 and the electronic device 1000 .

[0325] Reference Fig.12c, in operation S1262, the electronic device 1000 may obtain the first orientation information and the first focus position information. According to an embodiment, the electronic device 1000 may obtain the three-axis angle value indicating the position of the first partial image within the first VR image as the first orientation information by using a sensing module included in the electronic device. According to another embodiment, the first orientation information may include a plurality of orientation information of the partial image reproduced before the first partial image is reproduced by the electronic device.

[0326] According to an embodiment, in addition to the first orientation information, the edge data network 2000 may further receive information about a frame index indicating a frame number within a VR sequence (for example, the frame number of the first partial image to be currently reproduced, but the present disclosure is not limited to this, or the frame number of a partial image reproduced before the first partial image is reproduced by the electronic device) from the electronic device 1000.

[0327] In operation S1264, the electronic device 1000 may send the first orientation information and the first focus position information to the edge data network 2000. Thereafter, the electronic device 1000 and the edge data network 2000 may perform Fig.10a Operations S1012 to S1024.

[0328] In operation S1266, the electronic device 1000 may obtain second position information and second focus position information. In this case, the electronic device 1000 may obtain the second position information and the second focus position information after a predetermined period of time after obtaining the first position information and the first focus position information.

[0329] In operation S1268, the electronic device 1000 may transmit the second position information and the second focus position information to the edge data network 2000. At this time, the electronic device 1000 may transmit only the changed information among the position information and the focus position information to the edge data network 2000.

[0330] In operation S1270, the edge data network 2000 can determine an area corresponding filter among multiple area corresponding filters based on the first focus position information and the second focus position information, and can generate a reduced second local image by filtering the second local image corresponding to the second orientation information based on the stored information about the determined area corresponding filter.

[0331] According to an embodiment, the edge data network 2000 may determine whether there is a location change based on the first location information and the second location information.

[0332] When the difference between the first orientation and the second orientation is within a predetermined range, the edge data network 2000 may determine that there is no orientation change. When there is an orientation change, the electronic device 1000 and the edge data network 2000 may perform Fig.10a For example, when the average value of the difference value of each angle component (e.g., pitch value, roll value, or yaw value) between the first orientation information and the second orientation information is greater than a preset critical value, the edge data network 2000 can determine that the first orientation information and the second orientation information are inconsistent with each other (there is an orientation change).

[0333] When it is determined that there is no difference between the first position indicated by the first position information and the second position indicated by the second position information, the electronic device 1000 may not send the second position information. In this case, the edge data network 2000 may recognize that the second position information is not sent and determine that there is no position change from the first position.

[0334] When there is no change in orientation, the edge data network 2000 can determine an area corresponding filter from among a plurality of area corresponding filters based on the first focus position information and the second focus position information, and can generate a reduced second local image by filtering the second local image corresponding to the second orientation information based on the stored information about the determined area corresponding filter. For example, the edge data network 2000 can determine an area corresponding filter from among a plurality of area corresponding filters based on the difference between a first focus position indicated by the first focus position information and a second focus position indicated by the second focus position information. At this time, the focus movement vector information can be obtained from the difference between the first focus position and the second focus position, and the edge data network 2000 can perform filtering with respect to the second local image corresponding to the second orientation information. Fig.12a The operation is similar to operation S1212.

[0335] In operation S1272, the edge data network 2000 may generate a second frame by encoding the downscaled second partial image. The edge data network 2000 may generate a second frame by encoding the downscaled second partial image.

[0336] In operation S1274 , the edge data network 2000 may transmit the second frame to the electronic device 1000 .

[0337] In operation S1276, the electronic device 1000 may obtain a second partial image by decoding the second frame.

[0338] In operation S1278, the electronic device 1000 may determine one region corresponding filter among a plurality of region corresponding filters based on the first focus position information and the second focus position information, and may expand the first partial image by using stored information about the determined one region corresponding filter.

[0339] In operation S1280, the electronic device 1000 may reconstruct the second partial image by interpolating the expanded second partial image.

[0340] In operation S1282, the electronic device 1000 may reproduce the reconstructed second partial image.

[0341] However, the present disclosure is not limited to this, and, unlike the description given in operations S1272, S1274 and S1278, the edge data network 2000 can generate index information indicating one of multiple area corresponding filters and send the index information to the electronic device 1000, and the electronic device 1000 can determine a region corresponding filter among the multiple area corresponding filters based on the index information.

[0342] Fig.13a is a view for explaining a filter used when a network situation is good or a focus area of ​​a user is clear according to an embodiment of the present disclosure.

[0343] Reference Fig.13a , when the network condition connected to the electronic device 1000 is poor or the user's focus area is clear, the edge data network 2000 may filter the first partial image 1300 by using one area corresponding filter 1310 corresponding to the focus position among the first filter group including a plurality of area corresponding filters having narrow high-definition areas, thereby generating a filtered first partial image 1320. In this case, the focus area being clear may mean being in focus because the pupil does not move much.

[0344] Fig.13b is a view for explaining a filter used when a network situation is not good or a focus area of ​​a user is unclear according to an embodiment of the present disclosure.

[0345] Reference Fig.13b, when the network condition connected to the electronic device 1000 is good or the focus area of ​​the user is unclear, the edge data network 2000 may filter the first partial image 1330 by using one region corresponding filter 1340 corresponding to the focus position among the second filter group including a plurality of region corresponding filters having a wide high-definition area, thereby generating a filtered first partial image 1350. Unclear focus area may mean out of focus because the movement of the pupil is large (the movement speed of the pupil is high).

[0346] Fig.14a is a flowchart of an operation process between an electronic device and an edge data network according to an embodiment of the present disclosure.

[0347] Reference Fig.14a In operation S1401, the edge data network 2000 may generate a plurality of region-corresponding filter groups, and may store the generated plurality of region-corresponding filter groups. One region-corresponding filter group may include a plurality of region-corresponding filters. In this case, the region-corresponding filter groups may differ from each other in the size of the plurality of regions and the number of regions.

[0348] In operation S1402 , the edge data network 2000 may transmit information of filter groups corresponding to a plurality of regions to the electronic device 1000 .

[0349] In operation S1403, the electronic device 1000 may store information of a plurality of region corresponding filter groups.

[0350] In operation S1404, the electronic device 1000 may obtain orientation information and focus position information.

[0351] In operation S1405, the electronic device 1000 may send the orientation information and the focus position information to the edge data network 2000. At this time, the network information may also be sent.

[0352] In operation S1406, the edge data network 2000 may determine a region corresponding filter group among a plurality of region corresponding filter groups based on the network information. As described above, the network information may be received from the electronic device 1000, but the present disclosure is not limited thereto, and the edge data network 2000 may not receive the network information from the electronic device 1000. The network information is information about a network condition (e.g., a connection state), but the present disclosure is not limited thereto, and pieces of information such as a target bit rate and a target resolution may also be used as information for determining a corresponding filter group.

[0353] The edge data network 2000 can determine a region corresponding filter among multiple region corresponding filters included in a region corresponding filter group based on focus position information, and can generate a reduced first local image by performing filtering on the first local image corresponding to the orientation information based on stored information about the determined region corresponding filter.

[0354] In operation S1407 , the edge data network 2000 may generate a first frame by encoding the reduced first partial image.

[0355] In operation S1408 , the edge data network 2000 may transmit a first frame to the electronic device 1000 .

[0356] In operation S1409, the electronic device 1000 may obtain a first partial image by decoding the first frame.

[0357] In operation S1410, the electronic device 1000 may determine one region corresponding filter group among a plurality of region corresponding filter groups based on network information. The electronic device 1000 may determine one region corresponding filter among a plurality of region corresponding filters included in one region corresponding filter group based on focus position information, and may expand the first partial image by using stored information about the determined one region corresponding filter.

[0358] In operation S1411, the electronic device 1000 may reconstruct the first partial image by interpolating the expanded first partial image.

[0359] In operation S1412, the electronic device 1000 may reproduce the reconstructed first partial image.

[0360] Fig.14b is a flowchart of an operation process between an electronic device and an edge data network according to an embodiment of the present disclosure.

[0361] Fig.14b The operations of the exclusion operations S1427, S1428 and S1430 may correspond to Fig.14a operation, therefore, its detailed description will be omitted.

[0362] In operation S1427, the edge data network 2000 may generate a first frame and first index information indicating one region corresponding filter group among a plurality of region corresponding filter groups by encoding the reduced first partial image.

[0363] In operation S1428 , the edge data network 2000 may transmit the first frame and the first index information to the electronic device 1000 .

[0364] In operation S1430, the electronic device 1000 may determine one region corresponding filter group among a plurality of region corresponding filter groups based on the first index information, and may expand the first partial image by using stored information about one region corresponding filter included in the region corresponding filter group determined based on the focus position information.

[0365] Fig.14c is a flowchart of an operation process between an electronic device and an edge data network according to an embodiment of the present disclosure.

[0366] Fig.14c The operations of the exclusion operations S1447, S1448 and S1450 may correspond to Fig.14a operation, therefore, its detailed description will be omitted.

[0367] In operation S1447, the edge data network 2000 may generate a first frame, first index information indicating one region corresponding filter group among a plurality of region corresponding filter groups, and second index information indicating one region corresponding filter group among a plurality of region corresponding filters included in the region corresponding filter group by encoding the reduced first local image.

[0368] In operation S1448 , the edge data network 2000 may transmit the first frame, the first index information, and the second index information to the electronic device 1000 .

[0369] In operation S1450, the electronic device 1000 may determine one region corresponding filter group among a plurality of region corresponding filter groups based on the first index information. The electronic device 1000 may determine one region corresponding filter included in the one region corresponding filter group based on the second index information, and may expand the first partial image based on the stored information about the determined one region corresponding filter.

[0370] Fig.14d is a flowchart of an operation process between an electronic device and an edge data network according to an embodiment of the present disclosure.

[0371] Fig.14d The operations of the exclusion operations S1464, S1465, S1466 and S1470 may correspond to Fig.14a operation, therefore, its detailed description will be omitted.

[0372] In operation S1464, the electronic device 1000 may obtain azimuth information, focus position information, and focus movement vector information.

[0373] In operation S1465 , the electronic device 1000 may transmit the orientation information, the focus position information, and the focus movement vector information to the edge data network 2000 .

[0374] In operation S1466, the edge data network 2000 can determine a region corresponding filter group among multiple region corresponding filter groups, and determine a region corresponding filter among multiple region corresponding filters included in the region corresponding filter group based on focus position information and focus movement vector information, and can generate a reduced first local image by performing filtering based on stored information about the determined region corresponding filter.

[0375] In operation S1470, the electronic device 1000 may determine one region corresponding filter group among a plurality of region corresponding filter groups based on the focus position information and the focus moving vector information, and determine one region corresponding filter among a plurality of region corresponding filters included in the one region corresponding filter group. The electronic device 1000 may expand the first partial image based on the stored information about the determined one region corresponding filter.

[0376] However, the present disclosure is not limited thereto, and it will be appreciated by those skilled in the art that a region corresponding filter may be determined using previously acquired focus position information instead of focus movement vector information. Figure 14b to Figure 14c As described, it can be understood by ordinary technicians in this field that the electronic device 1000 can determine the region corresponding filter by further sending first index information indicating one region corresponding filter group among multiple region corresponding filter groups and second index information indicating one region corresponding filter among multiple region corresponding filters included in the region corresponding filter group together with the first frame.

[0377] Fig.15 It is a view used to schematically illustrate the operation process between electronic devices, edge data networks and VR game interface devices.

[0378] Reference Fig.15 ,and Figure 5 Different, a VR game interface device 4000 is further illustrated. In the field of VR games, unlike the field of VR streaming, there is user interaction, so the VR game interface device 4000 can also be used in addition to the electronic device 1000.

[0379] Already referenced above Figure 5 The operation process between the electronic device and the edge data network in the VR streaming field is described, so its repeated description will be omitted. The operation process between the electronic device, the edge data network and the VR game interface device in the VR game field will be described below.

[0380] The edge data network 2000 can generate VR game images (interactive VR images) included in the VR sequence based on the instructions of the VR game processing module 1586.

[0381] In detail, the VR game processing module 1586 may store instructions for generating a first partial image of a VR game image based on the orientation information, the focus position information, and the VR game interface device sensing information 1552. The VR game processing module 1586 may store instructions for outputting the VR game interface device control information 1554.

[0382] The electronic device 1000 may send the VR game interface device sensing information 1552 to the edge data network 2000 in order to perform VR game processing. In this case, the electronic device 1000 may receive the VR game interface device sensing information from the VR game interface device 4000.

[0383] The VR game interface device 4000 may include a network interface 4020, a sensing module 4010, and an actuation module 4030. The network interface 4020 may be a module for communicating with the outside, and the sensing module 4010 may be a module for sensing the user's motion. The sensing module 4010 may obtain VR game interface device sensing information.

[0384] The actuation module 4030 may be a module that provides various types of outputs (e.g., tactile feedback) such as vibration to the user. The actuation module 4030 may provide various types of outputs to the user based on the VR game interface device sensing control information.

[0385] The VR game interface device 4000 may send VR game interface device sensing information to the electronic device 1000. The VR game interface device 4000 may receive VR game interface device control information from the electronic device 1000.

[0386] It has been described above that the VR interface device sensing information is transmitted to the edge data network 2000 via the electronic device 1000, or the VR interface device sensing information and the VR game interface device control information are transmitted to the VR game interface device 4000 via the electronic device 1000. However, the present disclosure is not limited thereto, and the VR game interface device 4000 may be directly exchanged with the edge data network 2000. In this case, synchronization information for synchronization with the electronic device 1000 may also be transmitted.

[0387] Although it has been mentioned above Fig.15The operation process between electronic devices, edge data networks and VR game interface devices in the VR game field is described, but the present disclosure is not limited to this, and it should be understood by ordinary technicians in the field that interactive VR can be mainly utilized in many fields (for example, simulation, training or similar fields) where users can directly intervene in content and perform activities.

[0388] Fig.16 3 is a view for explaining an operation of additionally filtering a focus movement prediction area and an interface area in a VR game field according to an embodiment of the present disclosure.

[0389] Reference Fig.16 , when the user is watching a VR racing game image, the focus of the user's pupil may be on the road in front of the vehicle. However, based on the expected driving direction of the vehicle, the user is highly likely to see the road to be reached in the future. That is, the edge data network 2000 may additionally filter the focus movement expected area 1610 other than the focus area 1600 based on the expected driving direction of the vehicle. The interface area 1620 or the main terrain feature area 1630 may be difficult to identify when it becomes blurred because it is displayed with text or may be an important part in the game progress. The edge data network 2000 may further filter the interface area 1620 or the main terrain feature area 1630.

[0390] The electronic device 1000 and the edge data network 2000 may predetermine a portion of the area to be filtered additionally other than the focus area when executing the VR game application, or the edge data network 2000 may dynamically send information about the area to be filtered additionally to the electronic device 1000. The information about the area to be filtered may be index information indicating at least one of the predetermined separated areas of the image. The present disclosure is not limited to this, and when the area to be filtered is a rectangular area, the information about the area to be filtered may be information about the position of the upper left vertex (reference point) of the area and the size of the area, and when the area to be filtered is a circular area, the area to be filtered may be information about the center position and radius (in the case of an ellipse, the radius passes through the major axis and the minor axis). In this case, in order to reduce the amount of information, limited candidates may be determined and the information about the area to be filtered may be sent in the form of index information indicating one of the limited candidates. However, the present disclosure is not limited to this, and various techniques for reducing the amount of information may be used.

[0391] Fig.17a is a flowchart of a method for streaming image content performed by an edge data network according to an embodiment of the present disclosure.

[0392] Reference Fig.17a, in operation S1702, the edge data network 2000 may obtain orientation information and focus position information from the electronic device.

[0393] In operation S1704 , the edge data network 2000 may determine one filter among a plurality of filters based on the focus position information.

[0394] In operation S1706, the edge data network 2000 may generate a filtered first partial image by performing filtering on the first partial image corresponding to the orientation information using a filter determined based on the focus position information.

[0395] In operation S1708 , the edge data network 2000 may generate a first frame by encoding the filtered first partial image.

[0396] In operation S1710, the edge data network 2000 may transmit a first frame to the electronic device.

[0397] Fig.17b It is a flowchart for illustrating in detail a method of the following operations performed by an edge data network according to an embodiment of the present disclosure: determining a region corresponding filter based on focus position information, and filtering a first local image based on information about the determined region corresponding filter stored in advance.

[0398] Reference Fig.17b In operation S1712, the edge data network 2000 may determine a region corresponding filter among a plurality of region corresponding filters based on the focus position information, and may generate a reduced first partial image by performing filtering on the first partial image based on information about the determined region corresponding filter stored in advance.

[0399] In operation S1714, the edge data network 2000 may generate a first frame by encoding the reduced first partial image.

[0400] Fig.17c It is a flowchart for illustrating in detail a method of the following operation performed by an edge data network according to another embodiment of the present disclosure: determining a region corresponding filter based on focus position information, and filtering a first local image based on information about the determined region corresponding filter stored in advance.

[0401] refer to Fig.17cIn operation S1716, the edge data network 2000 may determine a region corresponding filter group among a plurality of region corresponding filter groups based on the network information, may determine a region corresponding filter included in the region corresponding filter group based on the focus position information, and may generate a reduced first local image by performing filtering on the first local image based on information about the determined region corresponding filter stored in advance.

[0402] In operation S1718, the edge data network 2000 may generate a first frame by encoding the reduced first partial image.

[0403] Fig.17d It is a flowchart for illustrating in detail a method of the following operation performed by an edge data network according to another embodiment of the present disclosure: determining a region corresponding filter based on focus position information, and filtering a first local image based on information about the determined region corresponding filter stored in advance.

[0404] In operation S1720, the edge data network 2000 can determine a region corresponding filter group from multiple region corresponding filter groups based on focus position information and focus movement vector information, can determine a region corresponding filter from multiple region corresponding filters included in the determined region corresponding filter group, and can generate a reduced first local image for the first local image based on information about the determined region corresponding filter stored in advance.

[0405] In operation S1722, the edge data network 2000 may generate a first frame by encoding the reduced first partial image.

[0406] Fig.18a is a flowchart of a method for streaming image content obtained from an edge data network and performed by an electronic device according to an embodiment of the present disclosure.

[0407] In operation S1802 , the electronic device 1000 may send orientation information and focus position information to the edge data network 2000 .

[0408] In operation S1804, the electronic device 1000 may obtain a first frame from the edge data network 2000, where the first frame is obtained by filtering and encoding a first partial image corresponding to the orientation information based on the focus position information.

[0409] In operation S1806, the electronic device 1000 may obtain a first partial image by decoding the first frame.

[0410] In operation S1808, the electronic device 1000 may reconstruct the first partial image by using a filter determined based on the focus position information among the plurality of filters. The present disclosure is not limited thereto, and in some cases, this operation may be omitted, and the first partial image obtained by decoding the first frame may be the reconstructed first partial image.

[0411] In operation S1810, the electronic device 1000 may reproduce the reconstructed first partial image.

[0412] Fig.18b is a flowchart of a method for streaming image content obtained from an edge data network 2000 and performed by an electronic device according to another embodiment of the present disclosure.

[0413] In operation S1812 , the electronic device 1000 may transmit the orientation information and the focus position information to the edge data network 2000 .

[0414] In operation S1814, the electronic device 1000 may obtain a first frame from the edge data network 2000 by filtering and encoding a first partial image corresponding to the orientation information based on the focus position information.

[0415] In operation S1816, the electronic device 1000 may obtain a first partial image by decoding the first frame.

[0416] In operation S1818, the electronic device 1000 may determine one region corresponding filter among a plurality of region corresponding filters based on the focus position information, and may expand the first partial image by using information about the determined region corresponding filter stored in advance.

[0417] In operation S1820, the electronic device 1000 may reconstruct the first partial image by interpolating the expanded first partial image.

[0418] In operation S1822, the electronic device 1000 may reproduce the reconstructed first partial image.

[0419] Fig.18c is a flowchart of a method for streaming image content obtained from an edge data network 2000 and performed by an electronic device according to another embodiment of the present disclosure.

[0420] Reference Fig.18c , in operation S1824, the electronic device 1000 may send orientation information, focus position information, and focus movement vector information to the edge data network 2000.

[0421] In operation S1826, the electronic device 1000 may obtain a first frame from the edge data network 2000, where the first frame is obtained by filtering and encoding a first partial image corresponding to the orientation information based on the focus position information and the focus movement vector information.

[0422] In operation S1828, the electronic device 1000 may obtain a first partial image by decoding the first frame.

[0423] In operation S1830, the electronic device 1000 can determine an area corresponding filter group from multiple area corresponding filter groups based on focus position information and focus movement vector information, can determine an area corresponding filter from multiple area corresponding filters included in the determined area corresponding filter group, and can expand the first local image based on information about the determined area corresponding filter stored in advance.

[0424] In operation S1832, the electronic device 1000 may reconstruct the first partial image by interpolating the expanded first partial image.

[0425] In operation S1834, the electronic device 1000 may reproduce the reconstructed first partial image.

[0426] Fig.18d is a flowchart of a method for streaming image content obtained from an edge data network 2000 and performed by an electronic device according to another embodiment of the present disclosure.

[0427] In operation S1836 , the electronic device 1000 may transmit the orientation information and the focus position information to the edge data network 2000 .

[0428] In operation S1838, the electronic device 1000 may obtain a first frame from the edge data network 2000, where the first frame is obtained by filtering and encoding a first partial image corresponding to the orientation information based on the focus position information.

[0429] In operation S1840, the electronic device 1000 may obtain a first partial image by decoding the first frame.

[0430] In operation S1842, the electronic device 1000 can determine an area corresponding filter group among multiple area corresponding filter groups based on network information, can determine an area corresponding filter among multiple area corresponding filters included in the determined area corresponding filter group based on focus position information, and can expand the first local image based on information about the determined area corresponding filter stored in advance.

[0431] In operation S1844, the electronic device 1000 may reconstruct the first partial image by interpolating the expanded first partial image.

[0432] In operation S1846, the electronic device 1000 may reproduce the reconstructed first partial image.

[0433] Fig.19 is a block diagram of an electronic device according to an embodiment of the present disclosure.

[0434] Connect to Figure 1 to Figure 1 8 The electronic devices of the edge data network can correspond to Fig.19 The electronic device 110 of the network environment 100. For example, in the network environment 100, the electronic device 110 may communicate with the electronic device 1702 (here, the electronic device includes a VR game interface device) via the first network 1798 (e.g., a short-range wireless communication network), or may communicate with the electronic device 1704 or the server 1708 via the second network 1799 (e.g., a long-range wireless communication network). According to an embodiment, the electronic device 110 may communicate with the electronic device 1704 via the server 1708. According to an embodiment, the electronic device 110 may include a processor 1720, a memory 1730, an input device 1750, a sound output device 1755, a display device 1760, an audio module 1770, a sensor module 1776, an interface 1777, a haptic module 1779, a camera module 1780, a power management module 1788, a battery 1789, a communication module 1790, a subscriber identification module 1796, or an antenna module 1797. In some embodiments, in the electronic device 110, at least one component (e.g., display device 1760 or camera module 1780) may be omitted, or one or more other components may be further included. In some embodiments, some components may be implemented by an integrated circuit. For example, the sensor module 1776 (e.g., a fingerprint sensor, an iris sensor, or an illumination sensor) may be implemented by being embedded in the display device 1760 (e.g., a display).

[0435] The processor 1720 can control one or more other components (e.g., hardware components or software components) of the electronic device 110 connected to the processor 1720 by executing software (e.g., program 1740), and can perform various data processing or calculations. According to an embodiment, as at least some of the data processing or calculations, the processor 1720 can load a command or data received from another component (e.g., sensor module 1776 or communication module 1790) in the volatile memory 1732, process the command or data stored in the volatile memory 1732, and store the result data in the non-volatile memory 1734.

[0436] According to an embodiment, the processor 1720 may execute an application client, and according to the execution of the application client, the processor 1720 may send a request message for checking the network protocol to be used by the application client to the edge data network 2000. In addition, the processor 1720 may receive a response message indicating the network protocol to be used by the application client from the edge data network 2000. The processor 1720 may update the network protocol to be used by the UE application based on the response message. The processor 1720 may select a network socket corresponding to the updated network protocol. The processor 1720 may receive data generated for the application client from the edge data network 2000 by using the selected network socket.

[0437] According to an embodiment, the processor 1720 may include a main processor 1721 (e.g., a CPU or an application processor (AP)) and an auxiliary processor 1723 (e.g., a graphics processing unit (GPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP)) that can operate independently of or together with the main processor 1724. Additionally or alternatively, the auxiliary processor 1723 may be configured to use lower power than the main processor 1721 or to be dedicated to a specified function. The auxiliary processor 1723 may be implemented separately from the main processor 1721 or as part of the main processor 1721.

[0438] The auxiliary processor 1723 may control at least some functions or states related to at least one of the components of the electronic device 110 (e.g., the display device 1760, the sensor module 1776, or the communication module 1790), instead of the main processor 1721 when the main processor 1721 is in an inactive state (e.g., a sleep state), or together with the main processor 1721 when the main processor 1721 is in an active state (e.g., an application execution state). According to an embodiment, the auxiliary processor 1723 (e.g., an image signal processor or a communication processor) may be implemented as a part of other functionally related components (e.g., the camera module 1780 or the communication module 1790).

[0439] The memory 1730 may store various data used by at least one component of the electronic device 110 (e.g., the processor 1720 or the sensor module 1776). The data may include, for example, software (e.g., program 1740) and input data or output data about commands related to the software. The memory 1730 may include a volatile memory 1732 or a non-volatile memory 1734.

[0440] The program 1740 may be stored in the memory 1730 as software, and may include, for example, an operating system (OS) 1742, middleware 1744, or an application 1746. According to an embodiment, the program 1740 may include Figure 1 The first application client 122 and the second application client 124. The program 1740 may include Figure 1 The edge enabler client 130 of the embodiment of the present invention.

[0441] The input device 1750 may receive a command or data intended for a component (eg, the processor 1720 ) of the electronic device 1710 from the outside of the electronic device 1710 (eg, a user).

[0442] The sound output device 1755 may output an audio signal to the outside of the electronic device 110. The sound output device 1755 may include, for example, a speaker. The speaker may be used for general purposes such as multimedia playback or recording playback.

[0443] The display device 1760 can visually provide information to the outside of the electronic device 110. The display device 1760 may include, for example, a display, a hologram device, or a projector, and a control circuit for controlling a corresponding device. According to an embodiment, the display device 1760 may include a touch circuit configured to detect a touch, or a sensor circuit (e.g., a pressure sensor) configured to measure the strength of a force generated by a touch.

[0444] The audio module 1770 may convert sound into an electrical signal or vice versa. According to an embodiment, the audio module 1770 may obtain sound through the input device 1750, or may output sound through the sound output device 1755 or an external electronic device (e.g., electronic device 1702) (e.g., speaker or earphone) directly or wirelessly connected to the electronic device 110.

[0445] The sensor module 1776 can detect the operating state (e.g., power or temperature) or the external environment state (e.g., user state) of the electronic device 110, and can generate an electrical signal or data value corresponding to the detected state. According to an embodiment, the sensor module 1776 may include, for example, a gesture sensor, a gyroscope sensor, a barometer sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor (e.g., an RGB (red, green, blue) sensor), an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, an illumination sensor, or a sensor related to an autonomous vehicle (e.g., an inertial measurement unit (IMU), a global positioning system (GPS) sensor, a camera, a light imaging detection and ranging (LIDAR) sensor, and a radio detection and ranging (RADAR) sensor).

[0446] The interface 1777 may support one or more designated protocols, which may be used for the electronic device 110 to directly or wirelessly connect to an external electronic device (eg, the electronic device 1702 ).

[0447] The connection terminal 1778 may include a connector through which the electronic device 110 may be physically connected to an external electronic device (eg, the electronic device 1702 ).

[0448] The haptic module 1779 may convert the electrical signal into mechanical stimulation (eg, vibration or movement) or electrical stimulation, which can be sensed by the user through tactile or kinesthetic sense.

[0449] The camera module 1780 may capture still images and videos. Depending on the embodiment, the camera module 1780 may include one or more lenses, an image sensor, an image signal processor, or a flash.

[0450] The power management module 1788 may manage power supplied to the electronic device 1710 .

[0451] The battery 1789 may supply power to at least one component of the electronic device 1710 .

[0452] The communication module 1790 can establish a direct (e.g., wired) communication channel and / or a wireless communication channel between the mobile device 110 and an external electronic device (e.g., electronic device 1702, electronic device 1704, or server 1708), and can support communication through the established communication channel. The communication module 1790 can be operated independently of the processor 1720 (e.g., an application processor), and can include one or more communication processors that support direct (e.g., wired) communication and / or wireless communication. According to an embodiment, the communication module 1790 may include a wireless communication module 1792 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 1794 (e.g., a local area network (LAN) communication module or a power line communication module). A corresponding communication module among the above-mentioned communication modules can communicate with an external electronic device through a first network 1798 (e.g., a short-range communication network such as Bluetooth, WiFi Direct, or Infrared Data Association (IrDA)) or a second network 1799 (e.g., a long-range communication network such as a cellular network, the Internet, or a computer network (e.g., a LAN or a wide area network (WAN)). These various types of communication modules may be integrated into one component (e.g., a single chip) or may be implemented as multiple separate components (e.g., multiple chips).

[0453] The wireless communication module 1792 may verify and authenticate the electronic device 110 in a communication network such as the first network 1798 or the second network 1799 by using subscriber information (eg, an International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 1796 .

[0454] The antenna module 1797 may transmit or receive a signal or power to or from the outside (eg, an external electronic device).

[0455] At least some components may be connected to each other via a communication method between peripheral devices (e.g., a bus, general purpose input and output (GPIO), a serial peripheral interface (SPI), or a mobile industry processor interface (MIPI)) and may exchange signals (e.g., commands or data) with each other.

[0456] According to an embodiment, a command or data may be transmitted or received between the electronic device 110 and the external electronic device 1704 through the server 1708 connected to the second network 1799. The electronic devices 1702 and 1704 may be of the same type as or different from the electronic device 110.

[0457] According to an embodiment, all or some of the operations performed in the electronic device 110 may be performed in one or more external electronic devices among the external electronic devices (i.e., electronic devices 1702 and 1704 and server 1708). For example, when the electronic device 110 needs to automatically or in response to a request from a user or another device to perform a function or service, the electronic device 110 may request one or more external electronic devices 1702 and 1704 to perform part or all of the function or service, rather than performing the function or service or as a supplement to performing the function or service. The one or more electronic devices receiving the request may perform at least a portion of the requested function or service or an additional function or service related to the request, and may send the result of the execution to the electronic device 110. The electronic device 110 may process the received result unchanged or otherwise, and provide the processed result as at least a portion of the response to the request. For this purpose, for example, cloud computing technology, distributed computing technology, or client-server computing technology may be used.

Claims

1. A method for sending image content performed by an edge data network, the method comprising: Obtaining orientation information and focus position information from an electronic device connected to the edge data network, wherein the focus position information indicates a position of a focus of a pupil of a user; determining a filter among a plurality of filters based on the focus position information, wherein the plurality of filters include a plurality of area-corresponding filters corresponding to a plurality of predetermined areas within the image; filtering a first partial image corresponding to the orientation information using the filter determined based on the focus position information, wherein the first partial image is a first image cropped based on the orientation information; generating a reduced first partial image by rearranging pixels having data in the filtered first partial image; generating a first frame by encoding the reduced first partial image; and The generated first frame is sent to the electronic device.

2. The method according to claim 1, wherein: The first partial image is a partial image within a first VR image having a predetermined frame index of a VR sequence including a plurality of frames, and the first partial image includes position information indicating a position of the partial image.

3. The method according to claim 1, further comprising: generating information of a region corresponding filter corresponding to each of the plurality of predetermined regions within the image; Storing information of the generated multiple region corresponding filters; as well as sending the information of the plurality of area corresponding filters to the electronic device, Determining the filter among the plurality of filters based on the focus position information comprises: determining a region among the plurality of regions based on the focus position information, and determining a region-corresponding filter corresponding to the determined region, Filtering the first partial image includes: filtering the first partial image corresponding to the orientation information based on the stored information about the region corresponding filter corresponding to the determined region, and Sending the generated first frame to the electronic device includes: The generated first frame and index information indicating the region correspondence filter among the plurality of region correspondence filters are transmitted.

4. The method according to claim 1, wherein: Obtaining the orientation information and the focus position information from the electronic device connected to the edge data network includes: obtaining the orientation information, the focus position information and the focus movement vector information from the electronic device, Determining the filter among the plurality of filters based on the focus position information comprises: determining a region correspondence filter among the plurality of region correspondence filters based on the focus position information and the focus movement vector information, and Filtering the first partial image includes: The first partial image corresponding to the position information is filtered based on the stored information about the determined area corresponding filter.

5. The method according to claim 1, wherein: The focus position information includes first focus position information and second focus position information, Determining the filter among the plurality of filters based on the focus position information comprises: determining an area corresponding filter among the plurality of area corresponding filters based on the first focus position information and the second focus position information, and Filtering the first partial image includes: The first partial image corresponding to the position information is filtered using the determined filter.

6. The method according to claim 1, further comprising: Generate information of filter groups corresponding to multiple regions; Storing the generated information of the plurality of region corresponding filter groups; as well as sending the information of the plurality of regions corresponding to the filter groups to the electronic device, Each of the plurality of region correspondence filter groups includes a region correspondence filter corresponding to each of the plurality of predetermined regions within the image, and Determining the filter among the plurality of filters based on the focus position information comprises: determining a region corresponding filter group among the plurality of region corresponding filter groups based on network information, and determining a region corresponding filter among the plurality of region corresponding filters included in the region corresponding filter group based on the focus position information, and Filtering the first partial image includes: The first partial image corresponding to the orientation information is filtered based on the determined region correspondence filter.

7. The method according to claim 6, wherein: Sending the generated first frame to the electronic device includes: The generated first frame and first index information indicating the region corresponding filter group among the plurality of region corresponding filter groups are transmitted to the electronic device.

8. The method according to claim 7, wherein: Sending the generated first frame and the first index information to the electronic device includes: The generated first frame, the first index information, and second index information indicating the region corresponding filter included in the region corresponding filter group are transmitted to the electronic device.

9. The method according to claim 1, further comprising: Generate information of filter groups corresponding to multiple regions; Storing the generated information of the plurality of region corresponding filter groups; as well as sending the information of the plurality of regions corresponding to the filter groups to the electronic device, Each of the plurality of region correspondence filter groups includes a region correspondence filter corresponding to each of the plurality of predetermined regions within the image, Obtaining the orientation information and the focus position information from the electronic device connected to the edge data network includes: obtaining the orientation information, the focus position information and the focus movement vector information from the electronic device, Determining the filter among the plurality of filters based on the focus position information comprises: Based on the focus position information and the focus movement vector information, a region corresponding filter group is determined among the plurality of region corresponding filter groups, and based on the focus position information, one region corresponding filter is determined among the plurality of region corresponding filters included in the one region corresponding filter group, and Filtering the first partial image includes: The first partial image corresponding to the orientation information is filtered based on the determined region correspondence filter.

10. The method according to claim 3, wherein: The number of coefficients greater than or equal to a first value in a filter applied to a predetermined area corresponding to the area-corresponding filter is greater than the number of coefficients greater than or equal to the first value in a filter applied to an area other than the predetermined area.

11. The method according to claim 10, wherein: The predetermined areas corresponding to the respective area-corresponding filters include overlapping areas.

12. An edge data network for transmitting image content to an electronic device, the edge data network comprising: Network interface; a memory storing one or more instructions; as well as a processor configured to execute the one or more instructions, Wherein, the processor is configured to execute the one or more instructions to: obtaining, through the network interface, orientation information and focus position information from an electronic device connected to the edge data network, wherein the focus position information indicates a position of a focus of a user's pupil; determining a filter among a plurality of filters based on the focus position information, wherein the plurality of filters include a plurality of area-corresponding filters corresponding to a plurality of predetermined areas within the image; filtering a first partial image corresponding to the orientation information using the filter determined based on the focus position information, wherein the first partial image is a first image cropped based on the orientation information; generating a reduced first partial image by rearranging pixels having data in the filtered first partial image; generating a first frame by encoding the reduced first partial image; and The generated first frame is sent to the electronic device through the network interface.

13. The edge data network according to claim 12, wherein: The processor is further configured to execute the one or more instructions to: generating information of a region corresponding filter corresponding to each of the plurality of predetermined regions within the image; Storing information of the generated multiple region corresponding filters; Sending the information of the filters corresponding to the multiple regions to the electronic device; When the filter is determined among a plurality of filters based on the focus position information, determining a region among the plurality of regions based on the focus position information, and determining a region-corresponding filter corresponding to the determined region; When filtering the first partial image, filtering the first partial image corresponding to the orientation information based on the stored information about the region corresponding filter corresponding to the determined region, and When the generated first frame is sent to the electronic device, The generated first frame and index information indicating the region correspondence filter among the plurality of region correspondence filters are transmitted.

14. The edge data network according to claim 12, wherein: The processor is further configured to execute the one or more instructions to: When the orientation information and the focus position information are obtained from the electronic device connected to the edge data network, Obtaining the orientation information, the focus position information and the focus movement vector information from the electronic device; When the filter is determined among a plurality of filters based on the focus position information, determining a region correspondence filter among the plurality of region correspondence filters based on the focus position information and the focus movement vector information, and When filtering the first partial image, The first partial image corresponding to the position information is filtered based on the stored information about the determined area corresponding filter.

15. A computer-readable recording medium having a program recorded thereon, wherein when the program is executed by a computer, a method performed by an edge data network is executed, the method comprising: Obtaining orientation information and focus position information from an electronic device connected to the edge data network, wherein the focus position information indicates a position of a focus of a pupil of a user; determining a filter among a plurality of filters based on the focus position information, wherein the plurality of filters include a plurality of area-corresponding filters corresponding to a plurality of predetermined areas within the image; filtering a first partial image corresponding to the orientation information using the filter determined based on the focus position information, wherein the first partial image is a first image cropped based on the orientation information; generating a reduced first partial image by rearranging pixels having data in the filtered first partial image; generating a first frame by encoding the reduced first partial image; and The generated first frame is sent to the electronic device.

Images