User terminal, server, and system for encoding video data, and method therefor

Abstract

A server is proposed. The server may comprise: a transceiver for transmitting and receiving data to and from a user terminal; and a processor for controlling the transceiver, wherein the processor is configured to acquire QoE traffic information, generate control information including information on a region of interest on the basis of the acquired QoE traffic information, and transmit the generated control information to the user terminal.

Description

User terminal, server and system for encoding video data, and method therefor

[0001] The present invention relates to a user terminal, a server and a system for encoding video data, and a method therefor.

[0002] 3GPP(3 rd The 5G Media Streaming (5G) project partner (PPP) is continuing to standardize technologies for media streaming in 5G environments. Among these, 3GPP TS26.501 defines a system architecture for providing fast and stable media solutions using Mobile Edge Computing (MEC). TS26.501 defines the 5G Media Streaming (5GMS) AF (Application Function) in MEC, which interfaces with User Equipment (UE) and Application Providers.

[0003] In addition, the 5GMS AF communicates with the 5G core system's Policy Control Function (PCF) to determine the status of the 5G network. The standard defines a 5GMS AS (5G Media Streaming Application Server) to provide download streaming services for content received from application providers to UEs (User Equipment) or to support uplink streaming from UEs to the 5GMS application server (AS). Figure 1 illustrates the architecture of 5G media streaming as defined in 3GPP TS26.501.

[0004] Regarding Figure 1, streaming is defined as the continuous delivery of media over time. Streaming primarily refers to the fact that media is transmitted primarily in one direction and consumed as it is received. Media content can also be streamed as it is created, a process known as live streaming. When already created content is streamed, it is known as on-demand streaming.

[0005] The present invention proposes a user terminal, a server, and a system for encoding video data, and a method therefor.

[0006] More specifically, we propose a device, method, etc. for encoding video data using variable, adaptive, or dynamic parameters when adjustment of uplink stream bit rate is required depending on network or service conditions.

[0007] The problems to be solved by the present invention are not limited to the problems to be solved above, and other problems not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present invention belongs from the description below.

[0008] A user terminal is proposed, the user terminal including a transceiver for transmitting and receiving data to and from a server; a processor configured to encode video data for transmission to the server, wherein the processor is configured to receive control information including information about a region of interest (ROI) from the server, and perform encoding for each of an ROI of an acquired image and a non-ROI of the acquired image based on the received control information.

[0009] Additionally or alternatively, the control information may include x-axis coordinates and y-axis coordinates, width, height, and QP (Quantization Parameter) delta values ​​of the ROI.

[0010] Additionally or alternatively, the control information may include x-axis coordinates and y-axis coordinates, width, height, and QP (Quantization Parameter) delta values ​​of the non-ROI.

[0011] Additionally or alternatively, the control information may be determined based on Quality of Experience (QoE) traffic information.

[0012] Additionally or alternatively, the processor may be configured to transmit video data including an encoded ROI of the acquired image and an encoded non-ROI of the acquired image to the server.

[0013] A server is proposed, the server including a transceiver for transmitting and receiving data with a user terminal; and a processor for controlling the transceiver, wherein the processor can be configured to obtain QoE traffic information, generate control information including information on a region of interest based on the obtained QoE traffic information, and transmit the generated control information to the user terminal.

[0014] Additionally or alternatively, the processor may be configured to determine the need for adjusting a bit rate of an uplink stream of the user terminal based on the acquired QoE traffic information.

[0015] Additionally or alternatively, the processor may be configured to analyze a region of interest of the acquired image as needed to adjust the bit rate of the uplink stream of the user terminal.

[0016] Additionally or alternatively, the control information may include x-axis coordinates and y-axis coordinates, width, height, and QP (Quantization Parameter) delta values ​​of the ROI.

[0017] Additionally or alternatively, the control information may include x-axis coordinates and y-axis coordinates, width, height, and QP (Quantization Parameter) delta values ​​of the non-ROI.

[0018] Additionally or alternatively, the processor may be configured to receive video data from the user terminal, the video data including an encoded ROI of an image acquired according to the control information and an encoded non-ROI of the image acquired.

[0019] A system is proposed, comprising a user terminal; and a server providing control information to the user terminal, wherein the server is configured to transmit control information including information on a region of interest (ROI) of the acquired image to the user terminal, the server generates control information including information on the region of interest based on acquired QoE traffic information, and the user terminal can perform encoding for each of the ROI of the acquired image and the non-ROI of the acquired image based on the control information.

[0020] Additionally or alternatively, the control information may include x-axis coordinates and y-axis coordinates, width, height, and QP (Quantization Parameter) delta values ​​of the ROI.

[0021] Additionally or alternatively, the control information may include x-axis coordinates and y-axis coordinates, width, height, and QP (Quantization Parameter) delta values ​​of the non-ROI.

[0022] Additionally or alternatively, the video data may include a ROI of the acquired image encoded with a first QP and a non-ROI of the acquired image encoded with a second QP.

[0023] The above problem solving methods are only some of the embodiments of the present invention, and various embodiments reflecting the technical features of the present invention can be derived and understood by a person having ordinary knowledge in the relevant technical field based on the detailed description of the present invention described below.

[0024] The present invention has the following effects.

[0025] The present invention can transmit information on a region of interest for encoding video data from a server to a user terminal.

[0026] The present invention can ensure appropriate video data quality depending on network or service quality.

[0027] The effects according to the present invention are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art to which the present invention pertains from the detailed description of the invention below.

[0028] The accompanying drawings, which are included as part of the detailed description to aid in understanding the present invention, provide embodiments of the present invention and, together with the detailed description, explain the technical idea of ​​the present invention.

[0029] Figure 1 illustrates an architecture representing specific 5GMS functions within a 5G system.

[0030] Figure 2 shows a generalized view of the architecture illustrated in Figure 1.

[0031] Figure 3 illustrates a 5G unicast downlink media streaming architecture.

[0032] FIG. 4 illustrates a 5GMS architecture according to one embodiment of the present invention.

[0033] FIG. 5 illustrates a procedure for encoding video data based on information about a region of interest according to one embodiment of the present invention.

[0034] Figure 6 illustrates a system diagram in a scenario according to one embodiment of the present invention.

[0035] FIG. 7 illustrates encoded video data in a scenario according to one embodiment of the present invention.

[0036] Figure 8 illustrates a system diagram in a scenario according to another embodiment of the present invention.

[0037] Figure 9 illustrates a block diagram of a server and a user terminal of the present invention.

[0038] Hereinafter, embodiments disclosed in this specification will be described in detail with reference to the attached drawings. Regardless of the drawing numbers, identical or similar components will be given the same reference numbers, and redundant descriptions thereof will be omitted. The suffixes "module" and "part" used for components in the following description are assigned or used interchangeably only for the convenience of writing the specification, and do not in themselves have distinct meanings or roles. In addition, when describing the embodiments disclosed in this specification, if it is determined that a specific description of a related known technology may obscure the gist of the embodiments disclosed in this specification, a detailed description thereof will be omitted. In addition, the attached drawings are only intended to facilitate easy understanding of the embodiments disclosed in this specification, and the technical ideas disclosed in this specification are not limited by the attached drawings, and should be understood to include all modifications, equivalents, and substitutes included in the spirit and technical scope of the present invention.

[0039] Terms that include ordinal numbers, such as first, second, etc., may be used to describe various components, but the components are not limited by these terms. These terms are used solely to distinguish one component from another.

[0040] When a component is referred to as being "connected" or "connected" to another component, it should be understood that it may be directly connected or connected to that other component, but that there may be other components intervening. Conversely, when a component is referred to as being "directly connected" or "connected" to another component, it should be understood that there are no other components intervening.

[0041] Singular expressions include plural expressions unless the context clearly indicates otherwise.

[0042] In this application, terms such as “include” or “have” are intended to specify the presence of a feature, number, step, operation, component, part or combination thereof described in the specification, but should be understood not to exclude in advance the possibility of the presence or addition of one or more other features, numbers, steps, operations, components, parts or combinations thereof.

[0043]

[0044] 5GMS application providers use 5GMS for streaming services. Streaming services provide 5GMS-aware applications using interfaces and APIs defined in 5GMS to leverage 5GMS clients and network capabilities on UEs.

[0045] 5GMS Application Providers and 5GMS Aware Applications are defined as follows:

[0046] - 5GMS Application Provider: An entity that interacts with the functions of the 5GMS system and provides 5GMS-Aware applications that interact with the functions of the 5GMS system.

[0047] - 5GMS-Aware Application: An application within the UE provided by a 5GMS application provider, which contains the service logic of the 5GMS application service and interacts with other 5GMS clients and network functions through interfaces and APIs defined in the 5GMS architecture.

[0048]

[0049] The architecture in Figure 1 represents specific 5GMS functions within a 5G system (5GS). The architecture defines three key functions:

[0050] - 5GMS AF: Application functions similar to those defined in section 6.2.10 of TS 23.501, which are dedicated to 5G media streaming.

[0051] - 5GMS AS: Application server dedicated to handling 5G media streaming.

[0052] 5GMS Client: A UE internal function dedicated to handling 5G media streaming. The 5GMS Client is a logical function, and sub-functions may be distributed within the UE depending on implementation choices.

[0053] 5GMS AF and 5GMS AS are data network (DN) functions and communicate with UE via N6 as defined in TS 23.501.

[0054] Functions within a Trusted DN, such as 5GMS AFs within a Trusted DN, are trusted by the operator network as shown in Figure 4.2.3-5 of TS 23.501. Therefore, these AFs can communicate directly with the relevant 5G core functions.

[0055] Functions within an External DN, for example, 5GMS AF within an External DN, can only communicate with 5G core functions using N33 via NEF.

[0056] The 5GMS architecture maps the overall high-level architecture shown in Figure 1 above to the general architecture shown in Figure 2.

[0057] The architecture addresses two main scenarios for individual media streaming tasks:

[0058] - Downlink streaming: The network is the origin of the media and the UE acts as the consuming device.

[0059] - Uplink streaming: The UE is the origin of the media and the network acts as the consuming entity.

[0060] The functional entities and interfaces of the media streaming general architecture can be described with specific reference to downlink and uplink streaming. In this specification, only the downlink will be described, and for this purpose, the description will include the appropriate downlink functionality in each case with a "d" suffix.

[0061] Figure 3 illustrates a 5G unicast downlink media streaming architecture. The following is a description of the interfaces defined for 5G unicast downlink media streaming, as illustrated in Figure 3.

[0062] M1d (5GMSd Provisioning API): An external API exposed in 5GMSd AF that allows 5GMSd application providers to provision and receive feedback on the use of the 5G media streaming system for downlink media streaming.

[0063] M2d (5GMSd Ingest API): An optional external API used when selected in a 5GMSd AS to host content for streaming services within a trusted DN.

[0064] M3d: (Internal and Unspecified): An internal API used to exchange information about content hosting with 5GMSd AS within a trusted DN.

[0065] M4d (Media Streaming API): An API exposed to stream media content to media players in 5GMSd AS.

[0066] M5d (Media Session Handling API): An API exposed to the media session handler in 5GMSd AF, used for media session handling, control, reporting and support, and includes appropriate security mechanisms such as authorization and authentication.

[0067] M6d (UE Media Session Handling API): An API exposed from the media session handler to the media player, used for internal client communication, and exposed to 5GMSd-Aware applications to utilize 5GMS capabilities.

[0068] M7d (UE Media Player API): An API exposed to 5GMSd-Aware applications and media session handlers in the media player, enabling them to utilize the media player.

[0069] M8d: (Application API): An application interface used for information exchange between 5GMSd-Aware applications and 5GMSd application providers, which is external to the 5G system and not specified by 5GMS.

[0070] 3GPP TS26.501 was proposed with the technical goal of transmitting data for media streaming, file downloads, etc. to multiple user equipment (UEs) at the same time over 5G networks.

[0071] 5G media streaming supports two media formats: HTTP-based MPEG DASH and Apple HLS. 5GMS (5G Media Streaming) technology allows multiple user devices to receive the same multimedia data at the same time, offering the advantage of providing services without the additional load caused by an increase in the number of user devices within the same cell. This technology can be applied to various services, including mobile TV, IoT, connected cars, software updates for devices and applications during idle time, real-time information delivery to customers in specific locations, and data offloading.

[0072]

[0073] The 3GPP TS26.501 standard was proposed with the technical goal of transmitting data for media streaming, file downloads, etc. to most terminals at the same time over 5G networks.

[0074] 5GMS (5G Media Streaming) technology offers the advantage of enabling a majority of users to receive the same multimedia data at the same time, eliminating the additional overhead associated with increasing numbers of devices within the same cell. This technology can be applied to a wide range of services, including CCTV video surveillance, mobile TV, IoT, connected cars, software updates for devices and applications during idle periods, real-time information delivery to customers within specific locations, and data offloading.

[0075] In particular, as the demand for integrated control and intelligent application services with MEC servers increases in the Smart Factory transition market, CCTV video surveillance functions require high-efficiency / lossless transmission technology to overcome uplink transmission throughput constraints and customized services through customer-specific functions.

[0076] However, as shown in Fig. 1, the 5GMS standard does not define specific operations to support customized services through high-efficiency / lossless transmission technology and customer-specific functions, and there is no means to provide it based on the 5GMS architecture in the CCTV video surveillance field, so it cannot be expanded to application services.

[0077] The present invention proposes a transmitter / receiver, a packet structure, and an identification method capable of controlling image quality for each region of interest in a 5GMS transmission / reception environment based on a standard 5GMS architecture.

[0078]

[0079] FIG. 4 illustrates a 5GMS architecture according to one embodiment of the present invention.

[0080] FIG. 4 illustrates an operation method by defining a module that constitutes a 5GMS transceiver server (100) and a terminal (200) that are capable of adjusting image quality by region of interest within a video frame in order to efficiently control an uplink stream bit rate according to a 5G network traffic situation based on a 5GMS architecture.

[0081] In this proposal, a ROI handler (204) is defined as a new module in a 5GMS receiver to provide a function for adjusting image quality by region of interest (ROI) within a video frame based on a standard 5GMS architecture.

[0082]

[0083] Table 1 defines the detailed roles of the uplink transmission system modules for 5GMS region of interest configuration.

[0084] ModuleDescriptionMedia Session Handler (202) Communicates with 5GMSu AF to establish and control media sessions, provides consumption collection and reporting, QoE Metric collection and reporting, and interfaces for use in 5GMSu-Aware Applications. Media Streamer (203) Communicates with 5GMSu AS to stream media content to the Uplink path, provides APIs to 5GMSu-Aware Applications for media playback, and to Media Session Handler for media session control. ROI Handler (204) Operates a transmitter Media Encoder to compress and encode media content. It performs the role of content and service synchronization based on encoded data through streaming encoder, file encoder, and upload encoder, and is in charge of ROI-based picture quality adjustment function through AV rate control and monitoring so that IP-based AV data can be synchronized and transmitted to Packetizer for wireless transmission through 5G Physical layer. 5GMSu Aware Application (201) 5GMSu Client control and service provider logic, an application that sets up media sessions, uses the 5GMSu interface and API to use client and network functions. Packetizer (or transmitter) (205) It is in charge of the function of generating packets for 5G media transmission. 5GMSu Application Server (103) An application server that hosts 5G media functions, which can be another server such as a CDN.5GMSu Application Function (102) Provides various control functions to the Media Session Handler and can request different policies through PCF or NEF, which are 5G Core Network Functions. 5GMSu Application Provider (101) Provides external application or content-specific media functions such as media creation, encoding, and formatting for streaming through the uplink path. ROI Server (104) A server for setting 5G media ROI areas, which can be another server such as a CDN. De-packetizer (or receiver) (105) Responsible for parsing SRT packets for 5G media reception.

[0085] FIG. 5 illustrates a procedure for encoding video data based on information about a region of interest according to one embodiment of the present invention.

[0086] A procedure for providing a function for adjusting the output bit rate of a video encoder (206) of a user terminal through a control that can adjust the image quality for each region of interest within a video frame in a DN (data network) server based on a standard 5GMS architecture is illustrated. A detailed description of each step is as follows.

[0087] 1) A user terminal (200) (or 5G Aware-application (201)) and a server (100) (or ROI server (104)) can perform a handshake operation to adjust the output bit rate of a video encoder based on a region of interest. Through the handshake process, a provisioning session can be created and uplink streaming can be performed based on the 5GMS standard.

[0088] 2) The server (100) (or ROI server (104)) can obtain QoE traffic information in real time through the 5G core NEF (network exposure function). If it is determined that the uplink stream bit rate needs to be adjusted at the user terminal (200) based on the QoE traffic information, the server (100) (or ROI server (104)) can perform ROI analysis processing on the video data so as to perform control to adjust the video compression transmission bit rate for the ROI region and the non-ROI region.

[0089] 3) The server (100) (or ROI server (104)) can analyze ROI and non-ROI and generate control information for setting ROI for the user terminal (200).

[0090] 4) The server (100) (or ROI server (104)) can transmit control information for setting ROI to the receiver (105) so that a packet for transmitting control information can be generated.

[0091] 5) The server (100) (or ROI server (104)) can generate a packet including control information so that the user terminal (200) can adjust the image quality for each ROI within the video frame. In addition, the server (100) (or ROI server (104)) can include information regarding ROI settings in the control information field of the generated packet. The server (100) (or ROI server (104)) can transmit the generated packet to the user terminal (200). As described above, since it is a transaction through a handshake, packet transmission is possible from the receiver (105) of the server (100) to the transmitter (205) of the user terminal (200).

[0092] 6) The transmitter (205) of the user terminal (200) can parse the received packet and obtain a control information field therefrom. The transmitter (205) of the user terminal (200) can transmit the obtained control information field to the ROI handler (204).

[0093] 7) The user terminal (200) (or ROI handler (204)) can parse the control information field and transmit it to the media streamer (203). The media streamer (2030) can use the control information field to specify QP (Quantization Parameter) delta values ​​for each ROI and non-ROI through pre-processing of the video encoder and transmit them to the video encoder (206).

[0094] 8) The user terminal (200) (or video streamer (203)) can adjust the uplink streaming quality by adjusting the video compression transmission bit rate to the video quality set in the server (100) by reflecting the QP delta value input through video pre-processing during encoding.

[0095] The control information fields for setting ROI, as mentioned above, can be expressed as follows:

[0096] Property nameTypeDescriptionresolutionInt16ResolutionframerateInt16Frame ratebitrateInt16Bit rateqp_rangeInt16QP Delta value range (0~50)ratecontrol-enableboolWhether to control rateInsert-sps-ppsboolWhether to insert SPS, PPS informationiframeintervalI Frame generation intervalRegionForROI[]xInt16x coordinateyInt16y coordinatewidthInt16WidthheightInt16Heightqp_deltaInt16QP Delta value (-10~+10)

[0097] If there are multiple ROIs in one video frame, RegionForROI can contain multiple ones.

[0098] Additionally, although not shown in Table 2, information about non-ROIs may be obtained from the ROI information or may be included separately in the control information field.

[0099] Information about a non-ROI, like information about a ROI, can include the x-coordinate, y-coordinate, width, height, and QP delta value of the non-ROI.

[0100]

[0101] Recently, CCTV applications are expanding for purposes such as real-time object or threat detection and tracking, and criminal evidence collection. High-quality image acquisition is a key element of these technologies. When transmitting data via 5G, image quality at the decoder is a trade-off with the network transmission rate. While high-quality image quality can be achieved by transmitting at a high bit rate, 5G networks typically have limited uplink resources, making it impossible to increase transmission rates. Therefore, image processing is crucial for achieving optimal image quality for objects in a given environment.

[0102] The method proposed in the present invention is a media processing and transmission technology that can be commonly applied to various 5G vertical fields, and can be widely applied not only to 5G public networks and 5G-specific networks, but also to the Cooperative-Intelligent Transport Systems (C-ITS) field. In particular, it is expected to be highly utilized in the V2X (Vehicle-to-X) field.

[0103]

[0104] Figure 6 illustrates a system diagram in a scenario according to one embodiment of the present invention.

[0105] Figure 6 illustrates a transmitter-receiver system capable of adjusting image quality for each region of interest within a video frame, enabling efficient control of uplink stream bit rates depending on 5G network traffic conditions. The present invention illustrates a 5G-based media transmission solution capable of efficiently managing transmission bandwidth by lowering the quality and bit rate of overlapping regions when storing or transmitting multiple videos with overlapping regions in video surveillance over a 5G network.

[0106]

[0107] Figure 7 illustrates an example of a surveillance screen that allows an administrator to adaptively adjust image quality according to the ROI and non-ROI in the video surveillance according to Figure 6. The ROI and non-ROI can be separated in the video surveillance to increase media transmission efficiency by reducing the bit rate for overlapping areas. An actual example of setting the ROI and non-ROI on the video surveillance screen is illustrated.

[0108]

[0109] Figure 8 illustrates a system diagram of a scenario according to another embodiment of the present invention.

[0110] Figure 8 illustrates an overall system diagram of a traffic safety solution that predicts collisions with other users and provides advance warnings when a collision is likely, preventing accidents by installing a traffic safety app for pedestrians (soft V2X app) on a smartphone. The soft V2X app enables the exchange of V2X data between V2X devices, such as connected vehicles (2) that support V2X, and general vehicles (1) or pedestrians (3) that do not.

[0111] The soft V2X app periodically exchanges location information and movement information (direction, speed, etc.) with surrounding soft V2X apps, and utilizes the exchanged information (i.e., information on surrounding pedestrians or vehicles, etc.) to predict the possibility of collision with itself in real time. The soft V2X app can communicate with a smart RSU (4) that acquires information on surrounding objects or moving objects or V2X data from objects or moving objects through various sensors.

[0112] In cases where the possibility of a collision is high, the user can be notified of the possibility of a collision using sound, vibration, etc. It supports various modes such as vehicles, pedestrians, two-wheeled vehicles, and emergency vehicles. In order to efficiently transmit the uplink transmission bit rate according to the 5G network traffic situation on a road where there are many detection target objects, a transmitter / receiver system that can adjust the image quality (video quality) by region of interest within a video frame can be applied. It can also be useful for detecting overlapping detection areas by multiple cameras.

[0113] Additionally, although not shown, the bit rate adjustment per region of interest within a video frame, as previously described, may be applied to the driving control of an autonomous robot or mobile device. The control server may receive images acquired from a camera sensor installed on the autonomous robot or mobile device. However, even in this case, there may be restrictions or limitations on uplink resources depending on 5G network traffic. In this case, a region of interest may be set in a video frame acquired from the camera sensor of the autonomous robot or mobile device, and the region of interest may be encoded by applying a first QP, and the region of interest may be encoded by applying a second QP to the non-interested region.

[0114]

[0115] Figure 9 illustrates a block diagram of a server (100) and a user terminal (200) of the present invention.

[0116] The server (100) includes a transceiver (110) for transmitting and receiving data with a user terminal (200) and a processor (120) for controlling the transceiver. In addition, the server (100) may include a memory (130) for generating and storing information, such as, for example, Table 1, related to the present invention.

[0117] The processor (120) can obtain QoE traffic information from the 5G NEF. In addition, the processor (120) can be configured to generate control information including information on an area of ​​interest based on the acquired QoE traffic information, and transmit the generated control information to the user terminal (200).

[0118] Here, the control information may include the x-axis coordinates and y-axis coordinates, width, height, and QP (Quantization Parameter) delta value of the ROI. In addition, the control information may include the x-axis coordinates and y-axis coordinates, width, height, and QP (Quantization Parameter) delta value of the non-ROI. The control information may be determined based on QoE (Quality of Experience) traffic information.

[0119] The processor (120) may be configured to determine the need for adjusting the bit rate of the uplink stream of the user terminal (200) based on the acquired QoE traffic information.

[0120] The processor (120) may be configured to analyze a region of interest of the acquired image as adjustment of the bit rate of the uplink stream of the user terminal (200) is required.

[0121] The processor (120) may be configured to receive video data including an encoded ROI of an image acquired according to control information and an encoded non-ROI of the image acquired from the user terminal (200).

[0122] The user terminal (200) may include a transceiver (210) for transmitting and receiving data with the server (100) and a processor (230) configured to encode video data to be transmitted to the server (100). In addition, the user terminal (200) may include a display (220) for outputting video data to be transmitted to the server (100) or outputting information received from the server (100). In addition, the user terminal (200) may include a memory (240) for generating and storing information, such as, for example, Table 1, related to the present invention.

[0123] The processor (230) may be configured to receive control information including information about a region of interest (ROI) from the server (100). In addition, the processor (230) may be configured to perform encoding for each of the ROI of the acquired image and the non-ROI of the acquired image based on the received control information.

[0124] Additionally, the processor (230) may be configured to transmit video data including an encoded ROI of the acquired image and an encoded non-ROI of the acquired image to the server (100).

[0125] The contents described above with reference to FIGS. 1 to 8, which are not described with reference to FIG. 9, may be applied to the server (100) or terminal (200).

[0126]

[0127] Meanwhile, the present invention can be implemented as a system comprised of a server (100) and a user terminal (200), as illustrated in FIG. 9. The system can perform the operations of the server (100) or user terminal (200) described with reference to FIG. 9 and the contents, features, and procedures related to FIGS. 4 and 5 described above. To avoid redundant explanation, a detailed description of the system will be omitted.

[0128]

[0129] In addition, as another aspect of the present invention, the operation of the proposal or invention described above may be implemented, performed or executed by a “computer” (a comprehensive concept including a system on chip (SoC) or a (micro) processor, etc.), or may be provided as a code or a computer-readable storage medium storing or including the code or a computer program product, and the scope of the present invention may be extended to the code or the computer-readable storage medium storing or including the code or the computer program product.

[0130]

[0131] The detailed description of the preferred embodiments of the present invention disclosed above has been provided to enable those skilled in the art to implement and practice the present invention. While the above description has been made with reference to preferred embodiments of the present invention, those skilled in the art will appreciate that various modifications and variations of the present invention, as defined by the following claims, are possible. Accordingly, the present invention is not intended to be limited to the embodiments disclosed herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. As a user terminal, A transceiver that transmits and receives data to and from the server; comprising a processor configured to encode video data for transmission to the server; The above processor: Receive control information including information about a region of interest (ROI) from the above server, A user terminal configured to perform encoding for each of an ROI of an acquired image and a non-ROI of the acquired image based on the received control information.

2. In paragraph 1, the control information is: Including the x-axis coordinate and y-axis coordinate, width, height, and QP (Quantization Parameter) delta value of the above ROI. , user terminal.

3. In paragraph 1, the control information is: Including the x-axis coordinates and y-axis coordinates, width, height, and QP (Quantization Parameter) delta value of the above non-ROI. , user terminal.

4. In any one of the second to third paragraphs, the control information is: A user terminal determined based on QoE (Quality of Experience) traffic information.

5. In any one of paragraphs 1 and 2, the processor: A user terminal configured to transmit video data including an encoded ROI of the acquired image and an encoded non-ROI of the acquired image to the server.

6. As a server, A transceiver for transmitting and receiving data with a user terminal; and comprising a processor for controlling the above transceiver, The above processor: A server configured to obtain QoE traffic information, generate control information including information on an area of ​​interest based on the obtained QoE traffic information, and transmit the generated control information to the user terminal.

7. In paragraph 6, the processor: A server configured to determine the necessity of adjusting the bit rate of the uplink stream of the user terminal based on the acquired QoE traffic information.

8. In paragraph 7, the processor: A server configured to analyze a region of interest of an acquired image, as the bit rate of the uplink stream of the user terminal needs to be adjusted.

9. In paragraph 6, the control information is: Including the x-axis coordinate and y-axis coordinate, width, height, and QP (Quantization Parameter) delta value of the above ROI. , server.

10. In paragraph 6, the control information is: Including the x-axis coordinates and y-axis coordinates, width, height, and QP (Quantization Parameter) delta value of the above non-ROI. , server.

11. In paragraph 6, the processor: A server configured to receive video data including an encoded ROI of an image acquired according to the above control information and an encoded non-ROI of the image acquired from the user terminal.

12. A system including a user terminal; and a server that provides control information to the user terminal, The user terminal is configured to transmit video data encoded with the acquired image to the server, The server is configured to transmit control information including information about a region of interest (ROI) of the acquired image to the user terminal, The above server generates control information including information about the area of ​​interest based on the acquired QoE traffic information, A system in which the user terminal performs encoding for each of the ROI of the acquired image and the non-ROI of the acquired image based on the control information.

13. In paragraph 12, the control information is: Including the x-axis coordinate and y-axis coordinate, width, height, and QP (Quantization Parameter) delta value of the above ROI. , system.

14. In paragraph 12, the control information is: Including the x-axis coordinates and y-axis coordinates, width, height, and QP (Quantization Parameter) delta value of the above non-ROI. , system 15. In paragraph 12, the video data, A ROI of the acquired image encoded with a first QP and a non-ROI of the acquired image encoded with a second QP. , system.

Images