Image system apparatus comprising image transmission apparatus and image reception apparatus, and operation method of image system apparatus

Abstract

The present invention relates to an image system apparatus comprising an image transmission apparatus and an image reception apparatus, wherein the image transmission apparatus may: encode the current image through inter estimation by using a first reference image of the current image, which is stored in a first memory; on the basis of a first memory requirement which can be allocated for encoding of the current image of the first memory, acquire a first operation setting value used for encoding a reconstructed image acquired by decoding the encoded current image; encode the reconstructed image on the basis of the first operation setting value; store the encoded reconstructed image in the first memory; and provide the image reception apparatus with a bitstream generated so as to include the encoded current image and the first operation setting value.

Description

An image system device including an image transmitting device and an image receiving device, and an operating method of the image system device

[0001] The present disclosure relates to an image system device including an image transmitting device and an image receiving device, and an operating method of the image system device. Specifically, the present disclosure relates to an image system device including an image transmitting device for encoding an image and an image receiving device for decoding an image, and an operating method of the image system device.

[0002] As video-centric media services expand and demand for high-resolution, high-refresh rate, high-quality video grows, the amount of video data continues to explode.

[0003] In this situation, the role and utilization of video compression codecs are becoming more important to efficiently manage video data and reduce transmission burden.

[0004] Most imaging systems contain one or more Intellectual Property (IP) cores for image processing. These cores are pipelined and operate simultaneously and sequentially to process images. Memory is a key system resource shared by these IP cores, and is particularly heavily utilized by video codecs.

[0005] Inter prediction can be used to achieve high levels of image compression efficiency. Because inter prediction utilizes reference images, it may require memory to store and access the reference images.

[0006] One embodiment of the present disclosure provides an image system device including an image transmitting device and an image receiving device. The image transmitting device can encode a current image through inter-estimation using a first reference image of the current image stored in a first memory. The image transmitting device can obtain a first motion setting value used to encode a restored image obtained by decoding the encoded current image based on a first memory requirement that can be allocated for encoding the current image in the first memory. The image transmitting device can encode the restored image based on the first motion setting value. The image transmitting device can store the restored image in the first memory. The image transmitting device can provide a bitstream generated to include the encoded current image and the first motion setting value to the image receiving device.

[0007] One embodiment of the present disclosure provides an image transmission device for encoding an image. The image transmission device may include a memory storing at least one instruction. The image transmission device may include at least one processor including a processing circuit. By having at least one processor individually or collectively execute at least one instruction stored in the memory, the image transmission device may encode a current image through inter-estimation using a reference image of the current image. By having at least one processor execute at least one instruction stored in the memory, the image transmission device may decode the encoded current image to obtain a reconstructed image corresponding to the current image. By having at least one processor execute at least one instruction stored in the memory, the image transmission device may obtain a memory requirement that can be allocated for encoding the current image in the memory. By having at least one processor execute at least one instruction stored in the memory, the image transmission device may obtain an operation setting value used to encode the reconstructed image based on the memory requirement. By having at least one processor execute at least one command stored in memory, the video transmission device can encode a restored image based on the motion setting value. By having at least one processor execute at least one command stored in memory, the video transmission device can store the encoded restored image in the memory. By having at least one processor execute at least one command stored in memory, the video transmission device can generate a bitstream including the encoded current image and the motion setting value.

[0008] In one embodiment of the present disclosure, a method of operating an image system device including an image transmitting device and an image receiving device is provided. The method of operating the image system device may include a step of encoding a current image through inter-estimation using a first reference image of the current image stored in a first memory included in the image transmitting device. The method of operating the image system device may include a step of obtaining a first motion setting value used to encode a restored image obtained by decoding the encoded current image based on a first memory requirement that can be allocated for encoding the current image in the first memory. The method of operating the image system device may include a step of encoding the restored image based on the first motion setting value. The method of operating the image system device may include a step of storing the encoded restored image in the first memory. The method of operating the image system device may include a step of providing a bitstream generated to include the encoded current image and the first motion setting value to the image receiving device.

[0009] The technical problems to be achieved in this document are not limited to the technical problems mentioned above, and other technical problems not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present disclosure belongs from the description below.

[0010] The present disclosure may be understood in conjunction with the following detailed description and accompanying drawings, wherein reference numerals refer to structural elements.

[0011] FIG. 1 is a drawing for explaining the operation of an image system device according to one embodiment of the present disclosure.

[0012] FIG. 2 is a drawing for explaining the configuration of an image system device according to one embodiment of the present disclosure.

[0013] FIG. 3 is a drawing for explaining an image transmission device according to one embodiment of the present disclosure.

[0014] FIG. 4 is a drawing for explaining an image receiving device according to one embodiment of the present disclosure.

[0015] FIG. 5 is a flowchart for explaining the operation of an image transmission device according to one embodiment of the present disclosure.

[0016] FIG. 6 is a drawing for explaining the operation of an image transmission device according to one embodiment of the present disclosure.

[0017] FIG. 7 is a flowchart for explaining an operation of performing encoding through inter prediction using a reference image according to one embodiment of the present disclosure.

[0018] FIG. 8 is a diagram for explaining an operation of performing encoding through inter prediction using a reference image according to one embodiment of the present disclosure.

[0019] FIG. 9 is a flowchart illustrating an operation for obtaining a first operation setting value according to one embodiment of the present disclosure.

[0020] FIG. 10 is a flowchart for explaining the operation of an image receiving device according to one embodiment of the present disclosure.

[0021] FIG. 11 is a drawing for explaining the operation of an image receiving device according to one embodiment of the present disclosure.

[0022] FIG. 12 is a flowchart for explaining an operation of performing decoding through inter prediction using a reference image according to one embodiment of the present disclosure.

[0023] FIG. 13 is a diagram for explaining an operation of performing decoding through inter prediction using a reference image according to one embodiment of the present disclosure.

[0024] FIG. 14 is a flowchart illustrating an operation for obtaining a second operation setting value and a final operation setting value according to one embodiment of the present disclosure.

[0025] The terms used in this disclosure will be briefly explained, and one embodiment of the present disclosure will be specifically described.

[0026] The terms used in this disclosure are selected from widely used, current terms, taking into account the functions of one embodiment of the disclosure. However, these terms may vary depending on the intentions of those skilled in the art, precedents, the emergence of new technologies, etc. Furthermore, in certain cases, terms may be arbitrarily selected by the applicant, and in such cases, their meanings will be described in detail in the description of the relevant embodiments of the disclosure. Therefore, the terms used in this disclosure should not be defined simply as names of terms, but rather based on the meanings of the terms and the overall content of the disclosure.

[0027] Singular expressions may include plural expressions unless the context clearly indicates otherwise. Terms used herein, including technical or scientific terms, have the same meaning as commonly understood by a person of ordinary skill in the art described herein.

[0028] Unless the context clearly dictates otherwise, the singular forms "a," "an," and "the" are to be understood to include plural referents. Thus, for example, the description "a constituent surface" may also include reference to one or more of such surfaces.

[0029] Throughout this disclosure, when a part is said to "include" a component, this does not exclude other components, but rather implies the inclusion of other components, unless otherwise specifically stated. Furthermore, terms such as "part," "module," and the like described herein refer to a unit that processes at least one function or operation, which may be implemented in hardware or software, or a combination of hardware and software.

[0030] The expression “configured to” as used herein can be used interchangeably with, for example, “suitable for,” “having the capacity to,” “designed to,” “adapted to,” “made to,” or “capable of.” The term “configured to” does not necessarily mean something that is “specifically designed to” in terms of hardware. Instead, in some contexts, the expression “a system configured to” can mean that the system is “capable of” doing something together with other devices or components. For example, the phrase “a processor configured (or set) to perform A, B, and C” may mean a dedicated processor (e.g., an embedded processor) for performing those operations, or a generic-purpose processor (e.g., a CPU or application processor) that can perform those operations by executing one or more software programs stored in memory.

[0031] Additionally, when a component is referred to as being “connected” or “connected” to another component in the present disclosure, it should be understood that the component may be directly connected or connected to the other component, but may also be connected or connected via another component in between, unless otherwise specifically stated.

[0032] It should be understood that the blocks and combinations of flowcharts in each flowchart can be executed by one or more computer programs containing computer-executable instructions. The one or more computer programs may be stored entirely in a single memory, or may be stored in separate portions across multiple different memories.

[0033] All functions or operations described in this document may be performed by a single processor or a combination of processors. A single processor or a combination of processors is a circuitry that performs processing, and may include circuitry such as an Application Processor (AP), a Communication Processor (CP), a Graphical Processing Unit (GPU), a Neural Processing Unit (NPU), a Microprocessor Unit (MPU), a System on Chip (SoC), or an Integrated Chip (IC).

[0034] Below, with reference to the attached drawings, embodiments of the present disclosure are described in detail so that those skilled in the art can easily implement the present disclosure. However, one embodiment of the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein. In addition, in the drawings, parts irrelevant to the description are omitted to clearly describe one embodiment of the present disclosure, and similar parts are designated with similar drawing reference numerals throughout the present disclosure.

[0035] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings.

[0036] FIG. 1 is a drawing for explaining the operation of an image system device according to one embodiment of the present disclosure.

[0037] Referring to FIG. 1, in one embodiment of the present disclosure, FIG. 1 illustrates an image system device (300) including an image transmitting device (100) and an image receiving device (200).

[0038] In one embodiment of the present disclosure, the video transmission device (100) may be implemented as an electronic device of various shapes, such as a desktop, set-top box, or server device including a video encoder. The video transmission device (100) may provide video data for displaying a video (211) to an video reception device (200) connected via an input / output interface or a communication interface.

[0039] However, the present disclosure is not limited thereto, and the video transmission device (100) may be implemented as an electronic device in the form of a notebook computer including a video encoder, a tablet personal computer, a personal computer, a mobile phone, a smart phone, a wearable device, a head mounted display device, etc.

[0040] The video transmission device (100) may be referred to as a source device in terms of providing video data to the video reception device (200), or may be referred to as a content providing device.

[0041] In one embodiment of the present disclosure, the image receiving device (200) may be an electronic device having various shapes, such as a television including an image decoder, a portable communication terminal, a smart phone, a tablet PC, a wearable device, a personal computer, a laptop computer, a media player, or an automotive device such as a navigation device.

[0042] In one embodiment of the present disclosure, the image receiving device (200) can display an image (211) based on image data acquired from the image transmitting device (100) via an input / output interface or a communication interface. The image receiving device (200) can provide the image (211) via the display (210).

[0043] The video receiving device (200) may also be referred to as a sink device, a content display device, or a display device in that it receives video data from the video transmitting device (100).

[0044] In one embodiment of the present disclosure, the image data provided by the image transmission device (100) may be an encoded image. The image reception device (200) may decode the encoded image and display the image (211).

[0045] In one embodiment of the present disclosure, the video system device (300) can provide an image (211) to a user through an image transmitting device (100) and an image receiving device (200). Although FIG. 1 illustrates that the image transmitting device (100) and the image receiving device (200) are wirelessly connected to each other, the present disclosure is not limited thereto. The image transmitting device (100) and the image receiving device (200) may also be connected to each other by wire.

[0046] In one embodiment of the present disclosure, the video system device (300) can provide wireless TV, cloud gaming services, AR (Augmented Reality) images, VR (Virtual Reality) images, etc. to the user through the video transmission device (100) and the video reception device (200). However, the present disclosure is not limited thereto, and the video system device (300) can of course provide various services to the user based on operations that can be performed through the video transmission device (100) and the video reception device (200).

[0047] In one embodiment of the present disclosure, the image (211) to be provided by the image system device (300) may be a high-resolution or high-frame image. Accordingly, through encoding and decoding of the image performed by the image transmitting device (100) and the image receiving device (200), respectively, the delay that may occur in the transmission and reception of image data between the image transmitting device (100) and the image receiving device (200) can be minimized, and the amount of image data transmitted can be reduced.

[0048] In one embodiment of the present disclosure, the image transmission device (100) may perform image encoding through infra estimation, which predicts the image of the current frame by reducing spatial redundancy using the correlation between pixels within the image of the same frame, or inter estimation, which predicts the image of the current frame by reducing temporal redundancy by referring to information of the image of another frame.

[0049] In one embodiment of the present disclosure, the image receiving device (200) can restore image data acquired from the image transmitting device (100) to acquire an image of the current frame.

[0050] At this time, in order to perform image encoding through inter prediction, the image transmission device (100) may require an image other than the current image. Hereinafter, an image other than the current image may be referred to as a "reference image."

[0051] As encoding technology advances, multiple reference images may be required to encode images using inter prediction. This increases the memory size required to store the multiple reference images required for encoding, as well as the memory bandwidth and power required to utilize the multiple reference images.

[0052] In the present disclosure, a device and a method of operating the device are disclosed for reducing the memory requirements required to perform encoding by encoding a plurality of reference images and storing them in memory.

[0053] In the present disclosure, a device and an operating method of the device are disclosed for performing encoding of a plurality of reference images by taking into account the states of memories included in each of an image transmitting device (100) and an image receiving device (200). In addition, the present disclosure discloses a device and an operating method of the device for performing encoding and decoding of reference images by reflecting the memory states of each device by taking into account the memory requirements of the image transmitting device (100) and the memory requirements of the image receiving device (200).

[0054] According to the present disclosure, the image transmission device (100) and the image reception device (200) constituting the image system device (300) can perform encoding of a reference image by reflecting each memory state and store the encoded image in memory.

[0055] In addition, by providing the operation setting values ​​for performing encoding determined by taking into account the memory status of the image transmitting device (100) to the image receiving device (200), it is possible to consider not only the memory status of the image receiving device (200) but also the memory status of the image transmitting device (100) when determining the operation setting values ​​for performing encoding of a reference image in the image receiving device (200).

[0056] The present disclosure is not limited thereto, and it is possible to provide the image transmission device (100) with an operation setting value for performing encoding determined by taking into account the memory status of the image reception device (200), so that the image transmission device (100) can consider not only the memory status of the image transmission device (100) but also the memory status of the image reception device (200) when determining the operation setting value for performing encoding of a reference image.

[0057] The video transmission device (100), video reception device (200), and video system device (300) of the present disclosure, and their operating methods, can minimize delays in video encoding and decoding operations. Accordingly, a codec suitable for embodiments requiring low-delay characteristics can be provided.

[0058] According to the present disclosure, stability in an image transmission system can be improved by determining an operation setting value for performing encoding of a reference image by considering the memory status of electronic devices transmitting and receiving images.

[0059] In addition, by encoding a reference image and storing it in memory while considering the memory status of each of the image transmitting device (100) and the image receiving device (200) according to the present disclosure, the size of the memory, the bandwidth of the memory, and the power of the memory required for performing the encoding operation can be reduced.

[0060] The effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned will be clearly understood by a person having ordinary skill in the art to which the present disclosure pertains from the present disclosure.

[0061] FIG. 2 is a drawing for explaining the configuration of an image system device according to one embodiment of the present disclosure. Hereinafter, the same configuration as that described in FIG. 1 is assigned the same drawing reference numerals, and redundant descriptions are omitted.

[0062] Referring to FIGS. 1 and 2, in one embodiment of the present disclosure, an image system device (300) may include an image transmitting device (100) and an image receiving device (200).

[0063] In one embodiment of the present disclosure, the video transmission device (100) may include a memory (110), at least one processor (120), an input / output interface (130), and a communication interface (140). The memory (110), at least one processor (120), the input / output interface (130), and the communication interface (140) may each be electrically and / or physically connected to each other.

[0064] Hereinafter, the memory (110) included in the video transmission device (100) may be referred to as a first memory (110), at least one processor (120) may be referred to as at least one first processor (120), the input / output interface (130) may be referred to as a first interface (130), and the communication interface (140) may be referred to as a first communication interface (140).

[0065] In one embodiment of the present disclosure, the image receiving device (200) may include a display (210), a memory (220), at least one processor (230), an input / output interface (240), and a communication interface (250). The display (210), the memory (220), at least one processor (230), the input / output interface (240), and the communication interface (250) may each be electrically and / or physically connected to each other.

[0066] Hereinafter, the memory (220) included in the image receiving device (200) may be referred to as a second memory (220), at least one processor (230) may be referred to as at least one second processor (230), the input / output interface (240) may be referred to as a second interface (240), and the communication interface (250) may be referred to as a second communication interface (250).

[0067] However, not all of the components illustrated in FIG. 2 are essential components. The image transmitting device (100), the image receiving device (200), or the image system device (300) may be implemented with more components than the components illustrated in FIG. 2, or the image transmitting device (100), the image receiving device (200), or the image system device (300) may be implemented with fewer components.

[0068] In one embodiment of the present disclosure, the display (210) may include any one of a liquid crystal display, a plasma display, an organic light emitting diode display, and an inorganic light emitting diode display. However, the present disclosure is not limited thereto, and the display (210) may include other types of displays capable of displaying an image (211).

[0069] In one embodiment of the present disclosure, at least one second processor (230) can display an image (211) through a display (210) and provide it to a user.

[0070] In one embodiment of the present disclosure, the first memory (110) may store instructions, data structures, and program codes that can be read by at least one first processor (120). Operations performed by the at least one first processor (120) may be implemented by executing instructions or codes of a program stored in the first memory (110). In one embodiment of the present disclosure, there may be one or more first memories (110).

[0071] In one embodiment of the present disclosure, the second memory (220) may store instructions, data structures, and program codes that can be read by at least one second processor (230). Operations performed by the at least one second processor (230) may be implemented by executing instructions or codes of a program stored in the second memory (220). In one embodiment of the present disclosure, there may be one or more second memories (220).

[0072] In one embodiment of the present disclosure, the first memory (110) and the second memory (220) may each include at least one of a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), a random access memory (RAM), a static random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a mask ROM, a flash ROM, a flash ROM, etc.), a hard disk drive (HDD), or a solid state drive (SSD).

[0073] In one embodiment of the present disclosure, commands or program codes for performing functions or operations of the image transmitting device (100) may be stored in the first memory (110). Commands or program codes for performing functions or operations of the image receiving device (200) may be stored in the second memory (220).

[0074] The commands, algorithms, data structures, program codes, and application programs stored in the first memory (110) and the second memory (220) may be implemented in a programming or scripting language such as, for example, C, C++, Java, assembler, etc.

[0075] In one embodiment of the present disclosure, the first memory (110) may include a module for performing encoding on an image. The second memory (220) may include a module for performing decoding on an image. However, the present disclosure is not limited thereto, and the first memory (110) and the second memory (220) may include modules for performing various image processing such as encoding, decoding, scaling, noise filtering, frame rate conversion, resolution conversion, etc. on an image.

[0076] In one embodiment of the present disclosure, a 'module' included in the first memory (110) and the second memory (220) may mean a unit that processes a function or operation performed by at least one first processor (120) and a second processor (230). The 'module' included in the first memory (110) and the second memory (220) may be implemented as software such as instructions, an algorithm, a data structure, or a program code.

[0077] In one embodiment of the present disclosure, the first memory (110) may include a decryption image buffer (190, see FIG. 3). The second memory (220) may include a decryption image buffer (280, see FIG. 4). In one embodiment of the present disclosure, the decryption image buffers (190, 280) may include DDR-SRAM, etc.

[0078] In one embodiment of the present disclosure, at least one first processor (120) may perform encoding and decoding of an image by executing instructions or program codes of a first memory (110). At least one second processor (230) may perform encoding and decoding of an image by executing instructions or program codes of a second memory (220).

[0079] In one embodiment of the present disclosure, at least one first processor (120) can individually or collectively execute at least one instruction in the first memory (110). At least one second processor (230) can individually or collectively execute at least one instruction in the second memory (220).

[0080] In one embodiment of the present disclosure, at least one first processor (120) and at least one second processor (230) may each be configured as a processing circuit, such as a system on chip (SoC) or an integrated circuit (IC).

[0081] In one embodiment of the present disclosure, at least one first processor (120) and at least one second processor (230) may be individually and / or collectively configured to perform various functions described herein in the form of a Central Processing Unit (CPU), a microprocessor, a Graphic Processing Unit (GPU), an Application Processor (AP), or Application Specific Integrated Circuits (ASICs). As used herein, “processor,” “at least one processor,” and “one or more processors” may be configured to perform various functions. However, these terms may, without limitation, cover situations where one processor performs some of the functions and other processor(s) perform other parts of the functions, and situations where a single processor can perform all of the functions.

[0082] Additionally, at least one first processor (120) and at least one second processor (230) may comprise a combination of processors that each perform various functions of the disclosed functions in a distributed manner. At least one first processor (120) and at least one second processor (230) may execute program instructions to achieve or perform various functions.

[0083] In one embodiment of the present disclosure, a module that performs encoding and decoding of an image in an image transmission device (100) may be designed as a separate hardware configuration using a hardware description language, for example, Verilog or VHDL (VHSIC Hardware Description Language), and may be implemented as an ASIC (Application-Specific Integrated Circuit), FPGA (Field-Programmable Gate Array), or hardware accelerator device and included in the image transmission device (100).

[0084] In one embodiment of the present disclosure, a module that performs encoding and decoding of an image in an image receiving device (200) may be designed as a separate hardware configuration using a hardware description language, for example, Verilog or VHDL (VHSIC Hardware Description Language), and may be implemented as an ASIC (Application-Specific Integrated Circuit), FPGA (Field-Programmable Gate Array), or hardware accelerator device and included in the image receiving device (200).

[0085] In one embodiment of the present disclosure, the decryption image buffer (190, 280) may be included in the image transmitting device (100) and the image receiving device (200) designed as separate hardware configurations, respectively.

[0086] In one embodiment of the present disclosure, the first input / output interface (130) can provide image data to the image receiving device (200) under the control of at least one first processor (120). In one embodiment of the present disclosure, the image transmitting device (100) can obtain a current image through the first input / output interface (130). The second input / output interface (240) can obtain image data from the image transmitting device (100) under the control of at least one second processor (230).

[0087] In one embodiment of the present disclosure, the first input / output interface (130) and the second input / output interface (240) may perform input / output operations between the image transmitting device (100) and the image receiving device (200) using at least one of input / output methods including a High-Definition Multimedia Interface (HDMI) port, a Digital Visual Interface (DVI), a component jack, a PC port, or a Universal Serial Bus (USB) port. However, the present disclosure is not limited to the above-described input / output methods. The first input / output interface (130) and the second input / output interface (240) may be implemented according to wired technology or wireless technology.

[0088] In one embodiment of the present disclosure, the first communication interface (140) can perform data communication with the image receiving device (200) under the control of at least one first processor (120). The second communication interface (250) can perform data communication with the image transmitting device (100) under the control of at least one second processor (230).

[0089] However, the present disclosure is not limited thereto, and the first communication interface (140) and the second communication interface (250) may also be connected to an external server or an external electronic device. It goes without saying that the image transmission device (100) can perform data communication with an external server or an external electronic device through the first communication interface (140). It goes without saying that the image reception device (200) can perform data communication with an external server or an external electronic device through the second communication interface (250).

[0090] In one embodiment of the present disclosure, the first communication interface (140) and the second communication interface (250) may perform data communication between the image transmitting device (100) and the image receiving device (200) using at least one of data communication methods including wired LAN, wireless LAN, Wi-Fi, Bluetooth, zigbee, Wi-Fi Direct (WFD), infrared Data Association (IrDA), Bluetooth Low Energy (BLE), Near Field Communication (NFC), Wireless Broadband Internet (Wibro), World Interoperability for Microwave Access (WiMAX), Shared Wireless Access Protocol (SWAP), Wireless Gigabit Alliance (WiGig), or RF communication.

[0091] FIG. 3 is a drawing for explaining an image transmission device according to one embodiment of the present disclosure.

[0092] Referring to FIGS. 2 and 3, in one embodiment of the present disclosure, FIG. 3 illustrates an encoding unit (180) and a decoding image buffer (190) for explaining an encoding operation performed in an image transmission device (100).

[0093] In one embodiment of the present disclosure, the encoding unit (180) illustrated in FIG. 3 may be implemented as a module included in the first memory (110), or may be implemented as a hardware configuration that performs an encoding operation included in the video transmission device (100).

[0094] In one embodiment of the present disclosure, the encoding unit (180) may include a mode prediction unit (150), a restoration unit (160), and a filter unit (170).

[0095] In one embodiment of the present disclosure, a current image (400) may be provided to a mode prediction unit (150). In one embodiment of the present disclosure, the mode prediction unit (150) may determine a prediction mode to be used in encoding the current image (400).

[0096] In one embodiment of the present disclosure, the mode prediction unit (150) may include an intra prediction unit (151) that performs intra prediction and an inter prediction unit (152) that performs inter prediction. The mode prediction unit (150) may determine an appropriate prediction mode for encoding the current image (400). The mode prediction unit (150) may determine a mode for encoding the image using RDO (Rate-Distortion Optimization), etc.

[0097] In one embodiment of the present disclosure, the encoding unit (180) may further include a block division unit. The block division unit may divide the current image (400) into at least one processing unit for encoding and decoding. The mode prediction unit (150) may determine an appropriate prediction mode for encoding using the divided blocks.

[0098] In one embodiment, whether to apply intra-prediction or inter-prediction may be determined for each block (e.g., maximum coding unit, coding unit, prediction unit, or transform unit) segmented from the current image (400). For example, intra-prediction may be applied to a first block segmented from the current image (400), and inter-prediction may be applied to a second block.

[0099] In one embodiment of the present disclosure, a reference image (410) may be provided to the mode prediction unit (150) from the decoded image buffer (190). When the reference image (410) is encoded and stored in the decoded image buffer (190), the encoded reference image (410) may be decoded and provided to the mode prediction unit (150). In one embodiment of the present disclosure, the reference image (410) stored in the decoded image buffer (190) included in the encoding unit (180) may be referred to as a first reference image (410).

[0100] In one embodiment of the present disclosure, the mode prediction unit (150) can determine whether inter prediction is an appropriate mode for encoding the current image (400) based on the provided first reference image (410).

[0101] In one embodiment, when inter prediction is applied to the current image (400), the inter prediction unit may obtain motion information of the current image (400). In one embodiment, the motion information may include an index of the first reference image (410) and / or a motion vector pointing to a reference block within the first reference image (410).

[0102] In one embodiment, when intra prediction is applied to a current image (400), the intra prediction unit may determine an intra prediction mode of the current image (400) from among a plurality of intra prediction modes. The plurality of intra prediction modes may include directional intra prediction modes and non-directional intra prediction modes.

[0103] In one embodiment of the present disclosure, the restoration unit (160) may include an intra compensation unit (161), an inter compensation unit (162), a compression restoration unit (163) that performs transform-quantization (TQ) and inverse transform-dequantization (IT-DQ), an entropy coding unit (164), and a reconstruction unit (165).

[0104] In one embodiment of the present disclosure, the intra-compensation unit (161) and the inter-compensation unit (162) can perform encoding of the current image (400) according to the determined prediction mode. The intra-compensation unit (161) can generate a prediction block by referring to surrounding blocks of the block to be encoded among the current image (400). The intra-prediction mode determined by the intra-prediction unit can be used to generate the prediction block.

[0105] In one embodiment of the present disclosure, the intra compensation unit (161) can generate a residual block between the current image (400) and the prediction block.

[0106] The inter-compensation unit (162) can generate a prediction block for the current image (400) by referring to the first reference image (410) provided from the decoded image buffer (190) according to the motion information determined by the inter-prediction unit (152). The inter-compensation unit (162) can generate a residual block between the current image (400) and the prediction block.

[0107] In one embodiment of the present disclosure, the compression and decompression unit (163) may perform a transformation on the residual block. At this time, the compression and decompression unit (163) may perform the transformation on the residual block using a Discrete Cosine Transform (DCT) or a Discrete Sine Transform (DST).

[0108] In one embodiment of the present disclosure, the compression and decompression unit (163) can quantize the transformed residual values.

[0109] In one embodiment of the present disclosure, the entropy coding unit (164) may perform entropy encoding on quantized transformed residual values. At this time, the entropy coding unit (164) may perform entropy encoding using Huffman coding, arithmetic coding, or the like.

[0110] In one embodiment of the present disclosure, the entropy coding unit (164) may output data on which entropy encoding has been performed as a bitstream (420). The bitstream (420) may include information on a prediction mode determined by the mode prediction unit (150), information on a block divided by the block division unit, information on a residual block predicted by the intra compensation unit (161) and the inter compensation unit (162), etc.

[0111] In one embodiment of the present disclosure, the compression and decompression unit (163) can de-quantize the quantized transformed residual values.

[0112] In one embodiment of the present disclosure, the compression decompression unit (163) can inversely transform the inversely quantized transformed residual values.

[0113] In one embodiment of the present disclosure, the reconstruction unit (165) can generate a restored image based on the prediction block and residual block generated by the intra compensation unit (161) and the inter compensation unit (162).

[0114] In one embodiment of the present disclosure, the filter unit (170) can filter the generated restored image to remove distortion between blocks, etc. The filter unit (170) can perform filtering using a de-blocking filter, a sample adaptive filter (SAO), an adaptive loop filter (ALF), etc.

[0115] However, the present disclosure is not limited thereto, and the encoding unit (180) may not include the filter unit (170).

[0116] In one embodiment of the present disclosure, a restored image (430) filtered by a restored image or a filter unit (170) may be stored in the decrypted image buffer (190). Hereinafter, for convenience of explanation, the image stored in the decrypted image buffer (190) will be referred to as a restored image (430).

[0117] In one embodiment of the present disclosure, the restored image (430) stored in the decoded image buffer (190) can be provided as a reference image (410) in the operation of the inter prediction unit (152) or the inter compensation unit (162). The restored image (430) stored in the decoded image buffer (190) can be provided as a reference image (410) in the operation of the inter prediction unit (152) or the inter compensation unit (162) in the next image. However, the present disclosure is not limited thereto, and the restored image (430) can be used as a reference image in performing encoding through inter prediction in an image other than the current image.

[0118] In one embodiment of the present disclosure, the restored image (430) may be encoded and stored in a decoded image buffer (190). In addition, the encoded restored image stored in the decoded image buffer (190) may be decoded and provided to a mode prediction unit (150) and a restoration unit (160).

[0119] In one embodiment of the present disclosure, the encoding unit (180) can obtain an operation setting value for encoding a restored image (430) based on the memory requirement of the first memory (110). The encoding unit (180) can obtain an operation setting value based on the memory requirement of the first memory (110) and the encoding requirement for encoding the current image (400).

[0120] In one embodiment of the present disclosure, the motion setting value may be a value including information on environmental variables required to encode a restored image (430) or to decode an encoded reference image in an image receiving device (200) described later. The motion setting value may include a codec algorithm, memory information, a compression ratio, and the like.

[0121] At this time, the memory requirement of the first memory (110) may be referred to as the first memory requirement. The encoding requirement for encoding the current image (430) in the encoding unit (180) may be referred to as the first encoding requirement.

[0122] Additionally, the encoding unit (180) may include information on the operation setting value in the bitstream (420) and provide it to the decoding unit (270). In one embodiment of the present disclosure, the information on the operation setting value of the encoding unit (180) may be included as additional information included in the bitstream (420) and arranged in the form of metadata.

[0123] Hereinafter, the operation of the encoding unit (180) obtaining the operation setting value and performing encoding and decoding of the restored image (430) will be described later with reference to FIGS. 5 to 9.

[0124] FIG. 4 is a drawing for explaining an image receiving device according to one embodiment of the present disclosure.

[0125] Referring to FIGS. 2 and 4, in one embodiment of the present disclosure, FIG. 4 illustrates a decoding unit (270) and a decoding image buffer (280) for explaining a decoding operation performed in an image receiving device (200).

[0126] In one embodiment of the present disclosure, the decoding unit (270) illustrated in FIG. 4 may be implemented as a module included in the second memory (220), or may be implemented as a hardware configuration that performs a decoding operation included in the image receiving device (200).

[0127] In one embodiment of the present disclosure, the decoding unit (270) may include an entropy decoding unit (261), an intra compensation unit (262), an inter compensation unit (263), an inverse transform-inverse quantization unit (264), a reconstruction unit (265), and a filter unit (266).

[0128] In one embodiment of the present disclosure, a bitstream (420) may be provided to the entropy decoding unit (261). In one embodiment of the present disclosure, the bitstream (420) may be generated by encoding the current image (400) by the encoding unit (180).

[0129] In one embodiment of the present disclosure, the bitstream (420) provided to the decoding unit (270) can be decoded by the reverse process of the process by which the current image (400) is encoded in the encoding unit (180).

[0130] In one embodiment of the present disclosure, the entropy decoding unit (261) can perform entropy decoding on the bitstream (420). Information for generating a prediction block from the entropy-decoded bitstream (420) can be provided to the intra-compensation unit (262) and the inter-compensation unit (263). Information for generating a residual block from the entropy-decoded bitstream (420) can be provided to the inverse-transformation-dequantization unit (264).

[0131] In one embodiment of the present disclosure, the intra compensation unit (262) can generate a prediction block based on information for generating the acquired prediction block. The inter compensation unit (263) can generate a prediction block based on information for generating the acquired prediction block and a reference image (500) provided in the decoded image buffer (190). In one embodiment of the present disclosure, the reference image (500) stored in the decoded image buffer (280) included in the decoding unit (270) may be referred to as a second reference image (500).

[0132] In one embodiment of the present disclosure, the inverse transform-dequantization unit (264) can inverse quantize an entropy decoded bit stream.

[0133] In one embodiment of the present disclosure, the inverse transform-inverse quantization unit (264) can inverse transform the inverse-quantized bit stream to generate a residual block.

[0134] In one embodiment of the present disclosure, the reconstruction unit (265) can generate a restored image using the prediction block generated by the intra compensation unit (262) and the inter compensation unit (263) and the residual block generated by the inverse transformation-inverse quantization unit (264).

[0135] In one embodiment of the present disclosure, the filter unit (266) can filter the generated restored image. However, the present disclosure is not limited thereto, and the decoding unit (270) may not include the filter unit (266).

[0136] In one embodiment of the present disclosure, a restored image or a restored image (510) filtered by a filter unit (266) may be stored in the decrypted image buffer (280). Hereinafter, for convenience of explanation, the image stored in the decrypted image buffer (190) will be referred to as a restored image (510).

[0137] In one embodiment of the present disclosure, the restored image (510) stored in the decoded image buffer (280) may be provided as a reference image (500) in the operation of the inter-compensation unit (263). The restored image (510) stored in the decoded image buffer (280) may be provided as a reference image in the operation of the inter-compensation unit (263) in the next image. However, the present disclosure is not limited thereto, and the restored image (510) may be used as a reference image in performing decoding through inter-prediction in an image other than the current image.

[0138] In one embodiment of the present disclosure, the restored image (510) may be encoded and stored in a decoded image buffer (280). In addition, the encoded restored image stored in the decoded image buffer (280) may be decoded and provided to an inter-compensation unit (263).

[0139] In one embodiment of the present disclosure, the decoding unit (270) can obtain an operation setting value for encoding the restored image (510) based on the second memory requirement of the second memory (220). The decoding unit (270) can obtain an operation setting value based on the second memory requirement of the second memory (220) and the decoding requirement for decoding the encoded current image.

[0140] Additionally, the decoding unit (270) can parse information on the operation setting value of the encoding unit (180) included in the bitstream (420). The decoding unit (270) can obtain the operation setting value by considering the parsed operation setting value of the encoding unit (180).

[0141] Hereinafter, the operation of the decoding unit (270) obtaining the operation setting value and performing encoding and decoding of the restored image (510) will be described later with reference to FIGS. 10 to 14.

[0142] In addition, in order to explain the encoding and decoding of the reference image (410, 500), it will be explained that the encoding and decoding of the image are performed through inter prediction in the encoding unit (180) and the decoding unit (270).

[0143] FIG. 5 is a flowchart illustrating the operation of an image transmission device according to one embodiment of the present disclosure. FIG. 6 is a diagram illustrating the operation of an image transmission device according to one embodiment of the present disclosure.

[0144] Referring to FIGS. 2, 3, 5, and 6, in one embodiment of the present disclosure, FIG. 5 illustrates an operation method of an image system device (300). However, the present disclosure is not limited thereto, and the operation method illustrated in FIG. 5 may also refer to an operation method of an image transmission device (100).

[0145] In one embodiment of the present disclosure, the operating method of the image system device (300) may include a step (S100) of encoding the current image (400) through inter prediction using a first reference image (620) of the current image (400).

[0146] In one embodiment of the present disclosure, the first reference image (620) used in the step (S100) of encoding the current image (400) through inter prediction may be an image stored in the first memory (110) included in the image transmission device (100). The first memory (110) in which the first reference image (620) is stored may refer to a decoding image buffer (190) included in the image transmission device (100).

[0147] In the step (S100) of encoding the current image (400) through inter prediction using the first reference image (620), at least one first processor (120) can encode the current image (400) through inter prediction using the first reference image (620) of the current image (400).

[0148] In one embodiment of the present disclosure, the operating method of the image system device (300) may include a step (S200) of obtaining a first operation setting value for encoding a restored image (650) generated by decoding an encoded current image based on a first memory requirement of a first memory (110) in the current image.

[0149] Hereinafter, the operation setting value for encoding the restored image (650) in the image transmission device (100) is referred to as the first operation setting value.

[0150] In one embodiment of the present disclosure, the encoded current image may be information about the current image (400) included in the bitstream (420).

[0151] In the step (S200) of obtaining a first operation setting value for encoding a restored image (650), at least one first processor (120) can obtain a first memory requirement of a first memory (110) in a current image. At least one first processor (120) can obtain a first operation setting value for encoding a restored image (650) generated by decoding the encoded current image based on the first memory requirement.

[0152] In one embodiment of the present disclosure, the operating method of the video system device (300) may include a step (S300) of providing a bitstream (420) generated to include an encoded current video and a first operation setting value to the video receiving device (200).

[0153] In the step (S300) of providing a bitstream (420) generated to include the encoded current image and the first motion setting value to the image receiving device (200), at least one first processor (120) can generate the bitstream (420) by arranging the encoded current image and the first motion setting value. At least one first processor (120) can provide the generated bitstream (420) to the image receiving device (200).

[0154] In one embodiment of the present disclosure, FIG. 6 illustrates an encoding unit (180), a reference image control unit (600), and a decoding image buffer (190) for explaining an encoding operation performed in an image transmission device (100). Hereinafter, the same components as those described in FIG. 3 are given the same reference numerals, and redundant descriptions are omitted.

[0155] In one embodiment of the present disclosure, the encoding unit (180) and the reference image control unit (600) illustrated in FIG. 6 may be implemented as a module included in the first memory (110), or may be implemented as a hardware configuration that performs an encoding operation included in the image transmission device (100).

[0156] In one embodiment of the present disclosure, the reference image control unit (600) can control an operation of providing the first reference image (620) stored in the decoding image buffer (190) to the encoding unit (180) for performing an encoding operation of the current image (400) performed in the encoding unit (180).

[0157] In one embodiment of the present disclosure, the reference image control unit (600) may provide the first reference image (630) obtained by decoding the encoded first reference image (620) to the encoding unit (180). The reference image control unit (600) may decode the encoded first reference image (620) using a reference motion setting value. The reference motion setting value may be a value set in consideration of the first memory requirement (610) of the first memory (110) in the reference image, not the current image, and the encoding requirement for encoding the image in the reference image. In one embodiment of the present disclosure, the reference motion setting value may be a value used for encoding a restored image in the reference image. Hereinafter, the reference motion setting value provided by the reference image control unit (600) to the encoding unit (180) will be referred to as a first reference motion setting value.

[0158] In one embodiment of the present disclosure, the reference image control unit (600) can obtain a first memory requirement (610) of a first memory (110) in a current image. In one embodiment of the present disclosure, the first memory requirement (610) can include at least one of a bandwidth of the first memory (110), a size of the first memory (110), and a power of the first memory (110).

[0159] In one embodiment of the present disclosure, the bandwidth of the first memory (110) may refer to a memory bandwidth that can be allocated for encoding an image in the imaging system device (300). The size of the first memory (110) may refer to a size of the memory that can be allocated for encoding an image in the imaging system device (300). The power of the first memory (110) may refer to the power of the memory that can be allocated for encoding an image in the imaging system device (300).

[0160] Specifically, the first memory requirement (610) may mean, among the specifications of the first memory (110) in the video transmission device (100), the bandwidth of the first memory (110) allocated to the encoding unit (180) and the reference video control unit (600), the size of the first memory (110), and the power of the first memory (110).

[0161] In one embodiment of the present disclosure, the reference image control unit (600) may obtain a first encoding requirement for encoding the current image (400). In one embodiment of the present disclosure, the first encoding requirement may be a requirement expected to be required when encoding the current image (400) in the image transmission device (100). The first encoding requirement may include at least one of an expected memory bandwidth, an expected memory size, or an expected memory power.

[0162] In one embodiment of the present disclosure, the first encoding requirement may be determined based on the codec technology or codec standard used to encode the current video. Additionally, the first encoding requirement may be determined based on the resolution, size, frame rate, complexity, etc. of the current video to be encoded.

[0163] In one embodiment of the present disclosure, the reference image control unit (600) can obtain a first operation setting value (640) for encoding a restored image (650) based on a first memory requirement (610) and a first encoding requirement.

[0164] In one embodiment of the present disclosure, the reference image control unit (600) can encode a restored image (650) based on the first operation setting value (640). The reference image control unit (600) can store the encoded restored image (660) in the decoded image buffer (190) as a reference image for inter prediction for the next image.

[0165] In one embodiment of the present disclosure, the first motion setting value (640) can be used as a first reference motion setting value used to decode an encoded restored image (660) for the next image.

[0166] In one embodiment of the present disclosure, the reference image control unit (600) may provide a first motion setting value (640) to the encoding unit (180). The encoding unit (180) may generate a bitstream (420) including the encoded current image and the acquired first motion setting value (640). In one embodiment of the present disclosure, the encoding unit (180) may arrange the first motion setting value (640) in the form of metadata in the bitstream (420).

[0167] Hereinafter, the specific operation of the reference image control unit (600) will be described later with reference to FIGS. 7 and 8.

[0168] FIG. 7 is a flowchart illustrating an operation of performing encoding through inter prediction using a reference image according to an embodiment of the present disclosure. FIG. 8 is a diagram illustrating an operation of performing encoding through inter prediction using a reference image according to an embodiment of the present disclosure. Hereinafter, the same configurations and steps as those described in FIGS. 5 and 6 are given the same reference numerals, and redundant descriptions are omitted.

[0169] Referring to FIGS. 2, 3, 7, and 8, in one embodiment of the present disclosure, FIG. 7 illustrates an operation method of an image system device (300). However, the present disclosure is not limited thereto, and the operation method illustrated in FIG. 7 may also refer to an operation method of an image transmission device (100).

[0170] In one embodiment of the present disclosure, the operating method of the video system device (300) may include a step (S110) of obtaining an encoded first reference image (620) from a first memory (110).

[0171] In one embodiment of the present disclosure, in the step (S110) of obtaining an encoded first reference image (620) from a first memory (110), at least one first processor (120) may obtain the encoded first reference image (620) from the first memory (110). At this time, the encoded first reference image (620) may be stored in a decoded image buffer (190).

[0172] In one embodiment of the present disclosure, the operating method of the video system device (300) may include a step (S120) of decoding an encoded first reference image (620) using a first reference operation setting value (811) to obtain a first reference image (630).

[0173] In one embodiment of the present disclosure, in the step (S120) of decoding the encoded first reference image (620) to obtain the first reference image (630), at least one first processor (120) can decode the encoded first reference image (620) using the first reference motion setting value (811) to obtain the first reference image (630).

[0174] In one embodiment of the present disclosure, the operating method of the image system device (300) may include a step (S130) of encoding a current image (400) through inter prediction using an acquired first reference image (630).

[0175] In one embodiment of the present disclosure, in the step (S130) of encoding a current image (400) through inter prediction, at least one first processor (120) may perform inter prediction using a first reference image (630) to encode the current image (400).

[0176] In one embodiment of the present disclosure, the operating method of the image system device (300) may include a step (S200) of obtaining a first operation setting value (801) for a restored image (650) based on a first memory requirement (610) in a current image. The first operation setting value (801) may be a value for encoding the restored image (650).

[0177] Hereinafter, the step (S200) and operation of obtaining the first operation setting value (801) for encoding the restored image (650) will be described later with reference to FIGS. 8 and 9.

[0178] In one embodiment of the present disclosure, the operating method of the video system device (300) may include a step (S300) of providing a bitstream (420) generated to include an encoded current video and a first operation setting value to the video receiving device (200).

[0179] In one embodiment of the present disclosure, in the step (S300) of providing a bitstream (420) to an image receiving device (200), at least one first processor (120) may provide a bitstream generated to include an encoded current image and a first motion setting value to the image receiving device (200).

[0180] In one embodiment of the present disclosure, the step (S300) of providing a bitstream (420) to an image receiving device (200) may be configured with a step of generating a bitstream (420) including an encoded current image and a first motion setting value, and a step of providing the generated bitstream (420) to the image receiving device (200).

[0181] In one embodiment of the present disclosure, the operating method of the image system device (300) may include a step (S400) of decoding an encoded current image to obtain a restored image (650) corresponding to the current image (400).

[0182] In one embodiment of the present disclosure, in the step (S400) of generating a restored image (650), at least one first processor (120) can decode the encoded current image to generate the restored image (650).

[0183] In one embodiment of the present disclosure, the operating method of the image system device (300) may include a step (S410) of encoding a restored image based on a first operation setting value.

[0184] In one embodiment of the present disclosure, in the step (S410) of encoding a restored image, at least one first processor (120) can encode the restored image based on a first operation setting value.

[0185] In one embodiment of the present disclosure, the operating method of the image system device (300) may include a step (S420) of storing the encoded restored image (660) in the first memory (110) as a first reference image for inter prediction for the next image.

[0186] In one embodiment of the present disclosure, in the step (S420) of storing the encoded restored image (660) in the first memory (110), at least one first processor (120) may store the encoded restored image (660) in the first memory (110) as a first reference image for inter prediction for the next image. At this time, the first memory (110) may include a decoded image buffer (190). At least one first processor (120) may store the encoded restored image (660) in the decoded image buffer (190).

[0187] In one embodiment of the present disclosure, FIG. 8 illustrates an encoding unit (180), a reference image control unit (600), and a decoding image buffer (190) for explaining an encoding operation performed in an image transmission device (100). Hereinafter, the same components as those described in FIGS. 3 and 6 are given the same reference numerals, and redundant descriptions are omitted.

[0188] In one embodiment of the present disclosure, the reference image control unit (600) may include a first reference operation setting unit (800), a first reference operation management unit (810), a first reference decoder (820), and a first reference encoder (830). The first reference operation setting unit (800), the first reference operation management unit (810), the first reference decoder (820), and the first reference encoder (830) may be implemented as modules included in the first memory (110), or may be implemented as hardware components that perform encoding operations included in the image transmission device (100).

[0189] Not all components of the reference image control unit (600) illustrated in FIG. 8 are essential components. The reference image control unit (600) may be implemented with more components than those illustrated in FIG. 8, or may be implemented with fewer components.

[0190] In one embodiment of the present disclosure, the first reference decoder (820) and the first reference encoder (830) may be video codecs for encoding a restored image (650) stored in a decoded image buffer (190) or for decoding an encoded reference image (620) stored in a decoded image buffer (190). The video codecs used in the first reference decoder (820) and the first reference encoder (830) may be different codec technologies or codec standards from the video codecs for encoding and decoding the current image (400) in the encoding unit (180) and the decoding unit (270, see FIG. 4). However, the present disclosure is not limited thereto, and the video codec used in the first reference decoder (820) and the first reference encoder (830) may be the same codec technology or codec standard as the video codec used in the encoding unit (180) and the decoding unit (270).

[0191] In one embodiment of the present disclosure, the first reference decoder (820) can obtain an encoded first reference image (620) stored in the decoded image buffer (190). The first reference decoder (820) can decode the encoded first reference image (620). The first reference decoder (820) can obtain a first reference motion setting value (811) from the first reference motion management unit (810) and decode the encoded first reference image (620) using the obtained first reference motion setting value (811).

[0192] At this time, the first reference motion setting value (811) may be a motion setting value used when encoding a restored image from a reference image and storing it in a decoded image buffer (190).

[0193] In one embodiment of the present disclosure, the first reference decoder (820) can provide a decoded first reference image (630) to the encoding unit (180). The encoding unit (180) can encode the current image (400) through inter prediction using the decoded first reference image (630).

[0194] In one embodiment of the present disclosure, the first reference motion setting unit (800) can obtain the first memory requirement (610) of the first memory (110) in the current image.

[0195] In one embodiment of the present disclosure, the first reference operation setting unit (800) can obtain a first encoding requirement for encoding the current image (400) from the encoding unit (180).

[0196] In one embodiment of the present disclosure, the first reference operation setting unit (800) can obtain a first operation setting value (801) based on a first memory requirement (610) and a first encoding requirement. The first reference operation setting unit (800) can compare the first memory requirement (610) and the first encoding requirement, and set the first operation setting value (801) based on the first memory requirement (610) being smaller than the first encoding requirement. At this time, the first operation setting value (801) can include a compression ratio of the restored image (650).

[0197] In one embodiment of the present disclosure, the first reference operation setting unit (800) can provide a first operation setting value (801) to the first reference operation management unit (810).

[0198] Hereinafter, the operation of the first reference operation setting unit (800) will be described later in FIG. 9.

[0199] In one embodiment of the present disclosure, the first reference motion management unit (810) may provide a first motion setting value (801) to the encoding unit (180). In one embodiment of the present disclosure, the first reference motion management unit (810) may provide the first motion setting value (801) to the encoding unit (180). The first motion setting value (801) provided to the encoding unit (180) may be arranged together with the encoded current image to be generated as a bitstream (420).

[0200] In one embodiment of the present disclosure, the first reference motion management unit (810) can convert the format of the first motion setting value (801) into a codec standard used to encode the current image (400) in the encoding unit (180) or into the form of metadata used in codec technology.

[0201] In one embodiment of the present disclosure, when an MPEG series standard (e.g., HEVC, H264, etc.) is used in the encoding unit (180), the first reference operation management unit (810) can convert the first operation setting value (801) to have a format of SEI (Supplement Enhancement Information). The first reference operation management unit (810) can provide the first operation setting value (640) converted into the SEI format to the encoding unit (180).

[0202] In one embodiment of the present disclosure, the encoding unit (180) can transmit the first motion setting value (640) converted into SEI format by including it in the High-Level Syntax of the bitstream (420) including the encoded image of the current frame.

[0203] In one embodiment of the present disclosure, data in SEI format can be used to provide additional information in a codec of the MPEG family, and can be information that is distinct from the image data of the bitstream (420).

[0204] In one embodiment of the present disclosure, the first operation setting value (640) converted into SEI format included in the bitstream (420) may be composed of a 3-byte SEI start code capable of finding an SEI payload and a 1-byte payloadType capable of distinguishing an SEI Type. In this case, the first operation setting value (640) information may be transmitted using a pre-reserved code among the payloadType.

[0205] In one embodiment of the present disclosure, the first operation setting value (640) may be transmitted using an unused payloadType, for example, 200, in addition to the payloadType already defined and used in the MPEG video standard. At this time, in addition to the first operation setting value (640) indicating compression ratio information of the restored image (650), the bitstream (420) may also provide activation or deactivation information of a reference image encoding mode to be described later.

[0206] Accordingly, the video receiving device (200) can obtain information on whether the reference video in the video transmitting device (100) is encoded and information on the compression ratio of the reference video by parsing information in the SEI format included in the bitstream (420). In addition, the video receiving device (200) can obtain information on the first memory requirement (610) in the video transmitting device (100) to determine the final operation setting value (1302, see FIG. 13) in the video receiving device (200).

[0207] However, the present disclosure is not limited thereto, and it goes without saying that the first operation setting value (801) may be converted into metadata having a different format depending on the codec standard used in the encoding unit (180).

[0208] In one embodiment of the present disclosure, the image transmitting device (100) can provide the generated bitstream (420) to the image receiving device (200) via the communication interface (140).

[0209] In one embodiment of the present disclosure, the first reference motion management unit (810) can provide a first motion setting value (801) to the first reference encoder (830). The first reference encoder (830) can encode a restored image (650) using the first motion setting value (801). The first reference encoder (830) can store the encoded restored image (660) in the decoded image buffer (190) as a first reference image for inter prediction for the next image.

[0210] Accordingly, the size of the decryption image buffer (190) required to store the first reference image, the bandwidth required to read the first reference image, power consumption, etc. can be reduced.

[0211] FIG. 9 is a flowchart illustrating an operation for obtaining a first operation setting value according to one embodiment of the present disclosure.

[0212] Referring to FIGS. 7, 8 and 9, in one embodiment of the present disclosure, the operating method of the video system device (300) may include a step (S210) of obtaining a first encoding requirement for encoding a current video (400).

[0213] In one embodiment of the present disclosure, in the step of obtaining a first encoding requirement (S210), at least one first processor (120) can obtain a first encoding requirement for encoding a current image (400).

[0214] In one embodiment of the present disclosure, the operating method of the video system device (300) may include a step (S220) of obtaining a first memory requirement (610) in a current video.

[0215] In one embodiment of the present disclosure, in the step (S220) of obtaining the first memory requirement (610), at least one first processor (120) can obtain the first memory requirement (610) in the current image.

[0216] In one embodiment of the present disclosure, the operating method of the video system device (300) may include a step of obtaining a first operation setting value (801) based on a first memory requirement (610) and a first encoding requirement.

[0217] In one embodiment of the present disclosure, the step of obtaining the first operation setting value (801) may include a step (S230) of comparing a first memory requirement (610) with a first encoding requirement. In the step (S230) of comparing the first memory requirement (610) with the first encoding requirement, at least one first processor (120) may determine whether the first memory requirement (610) is smaller than the first encoding requirement.

[0218] In one embodiment of the present disclosure, the "reference image encoding mode" may be a mode for determining whether to encode an image stored as a reference image in the decoded image buffer (190). In one embodiment of the present disclosure, when the "reference image encoding mode" is activated, the restored image (650) may be encoded using the first reference encoder (830) and stored in the decoded image buffer (190). When the "reference image encoding mode" is deactivated, the restored image (650) may be stored in the decoded image buffer (190) without being encoded.

[0219] In one embodiment of the present disclosure, if the reference image encoding mode has a value of "1", it may mean that the reference image encoding mode is activated. If the reference image encoding mode has a value of "0", it may mean that the reference image encoding mode is deactivated.

[0220] In one embodiment of the present disclosure, at least one first processor (120) may activate a reference image encoding mode when it is determined that the first memory requirement (610) is less than the first encoding requirement.

[0221] In one embodiment of the present disclosure, when it is determined that the first memory requirement (610) is less than the first encoding requirement, the operating method of the video system device (300) may include a step (S240) of obtaining a first operation setting value (801) based on the first memory requirement (610) and the first encoding requirement.

[0222] In one embodiment of the present disclosure, as it is determined that the first memory requirement (610) is less than the first encoding requirement, at least one first processor (120) may obtain the first operation setting value (801) based on the first memory requirement (610) and the first encoding requirement.

[0223] In one embodiment of the present disclosure, the first operation setting value (801) can be determined by the following mathematical expression (1).

[0224] Mathematical formula (1):

[0225] At this time, can mean the first action setting 1 value. may mean the first memory requirement. may mean the first encoding requirement. Among the requirements required for encoding performed in the video transmission device (100), it may be a ratio of the requirements required for encoding the restored image (650) in the first reference encoder (830).

[0226] In one embodiment of the present disclosure, , and It can be adjusted in units of frames, frame groups, scenes, and sequences of the current image (400), and can change when the operation scenario or operating environment of the image system device (300) changes.

[0227] In one embodiment of the present disclosure, may mean the compression ratio of the restored image (650). may mean any one of the bandwidth of the first memory (110), the size of the first memory (110), or the power of the first memory (110). may include at least one of the expected memory bandwidth, expected memory size, or expected memory power required to encode the current image (400). can be a real number between 0 and 1.

[0228] In one embodiment of the present disclosure, The bandwidth of the first memory (110) has a value of 4 GB / sec, has a value of 2GB / sec, which is the expected memory bandwidth, If this is obtained as 0.5, can be determined to be 0.25.

[0229] Accordingly, the first reference encoder (830) can encode the restored image (650) with the first motion setting value (801) having a value of 0.25 and store it in the decoded image buffer (190).

[0230] In one embodiment of the present disclosure, has a value of the size of the first memory (110), By mathematical expression (1) when has the value of expected memory size can be calculated. Also, has the value of the power of the first memory (110), By mathematical expression (1) when has the value of expected memory power can be calculated.

[0231] In one embodiment of the present disclosure, at least one first processor (120) may determine a smallest value among first operation setting values ​​calculated using at least one of a bandwidth of the first memory (110), a size of the first memory (110), or a power of the first memory (110), and an expected memory bandwidth, an expected memory size, or an expected memory power corresponding thereto. The first memory requirement used to calculate the first operation setting value having the smallest value may be a requirement with the highest importance in determining the encoding operation of the first reference encoder (830).

[0232] In one embodiment of the present disclosure, the operating method of the video system device (300) may include a method of performing step S300 or step S400 using the first operation setting value (801) acquired in step S240 of acquiring the first operation setting value.

[0233] In one embodiment of the present disclosure, the operating method of the imaging system device (300) may not encode the restored image (650) if the first memory requirement (610) is equal to or greater than the first encoding requirement. The operating method of the imaging system device (300) may include a step of storing the restored image (650) in the decoded image buffer (190) as a reference image for inter prediction for the next image if the first memory requirement (610) is equal to or greater than the first encoding requirement.

[0234] In one embodiment of the present disclosure, at least one first processor (120) may deactivate the reference image encoding mode when the first memory requirement (610) is determined to be equal to or greater than the first encoding requirement.

[0235] In one embodiment of the present disclosure, as the reference image encoding mode is deactivated, at least one first processor (120) may not encode the reconstructed image (650). At least one first processor (120) may store the unencoded reconstructed image (650) in the decoded image buffer (190) as a reference image for inter prediction for the next image.

[0236] In one embodiment of the present disclosure, when the reference image encoding mode is deactivated, the specifications of the memory that can be allocated for encoding the image in the image transmission device (100) may be equal to or higher than the specifications required for encoding the image. Accordingly, even if the restored image (650) is stored in the decoded image buffer (190) without encoding, the problem of delay in the operation of the image transmission device (100) may not occur.

[0237] Fig. 10 is a flowchart illustrating the operation of an image receiving device according to one embodiment of the present disclosure. Fig. 11 is a diagram illustrating the operation of an image receiving device according to one embodiment of the present disclosure. Hereinafter, the same configurations and steps as those described in Figs. 4 and 5 are assigned the same drawing reference numerals, and redundant descriptions are omitted.

[0238] Referring to FIGS. 2, 4, 5, 10, and 11, in one embodiment of the present disclosure, FIG. 10 illustrates an operation method of an image system device (300). However, the present disclosure is not limited thereto, and the operation method illustrated in FIG. 10 may also refer to an operation method of an image receiving device (200).

[0239] In one embodiment of the present disclosure, the operating method of the image system device (300) may include a step (S500) of decoding an encoded current image included in a bitstream (420) using a second reference image (500) of a current image (400) to obtain a restored image (510).

[0240] The second reference image (500) used in the step (S500) of decoding the encoded current image to obtain a restored image (510) may be an image stored in the second memory (220) included in the image receiving device (200).

[0241] In one embodiment of the present disclosure, in the step (S500) of decoding the encoded current image included in the bitstream (420), the second memory (220) in which the encoded second reference image (500) is stored may mean a decoded image buffer (280) included in the image receiving device (200).

[0242] In the step (S500) of decoding the encoded current image included in the bitstream (420), at least one second processor (230) can obtain a restored image (510) by decoding the encoded current image through inter prediction using a second reference image (500).

[0243] In one embodiment of the present disclosure, the operating method of the video system device (300) may include a step (S600) of parsing a first operation setting value (1120) from a bitstream (420).

[0244] In one embodiment of the present disclosure, in the step (S600) of parsing the first operation setting value (1120) from the bitstream (420), the first operation setting value (1120) parsed may be data included in the bitstream (420) in the format of metadata.

[0245] In one embodiment of the present disclosure, in the step (S600) of parsing the first operation setting value (1120) from the bitstream (420), at least one second processor (230) may parse the first operation setting value (1120) from the bitstream (420) provided from the video transmission device (100). In one embodiment of the present disclosure, at least one second processor (230) may also parse activation or deactivation information of a reference video encoding mode from the bitstream (420).

[0246] In one embodiment of the present disclosure, the operating method of the video system device (300) may include a step (S700) of obtaining a final motion setting value (1130) for a restored image (510) based on a second memory requirement (1110) of a second memory (220) and a first motion setting value (1120) in a current frame. The final motion setting value (1130) may be a value for encoding the restored image (510).

[0247] In one embodiment of the present disclosure, in the step (S700) of obtaining the final operation setting value (1130), at least one second processor (230) may obtain the final operation setting value (1130) based on the second memory requirement (1110) of the second memory (220) in the current image and the first operation setting value (1120).

[0248] In one embodiment of the present disclosure, the second memory requirement (1110) may include at least one of a bandwidth of the second memory (220), a size of the second memory (220), and a power of the second memory (220).

[0249] In one embodiment of the present disclosure, the bandwidth of the second memory (220) may refer to a memory bandwidth that can be allocated for decoding an image in the imaging system device (300). The size of the second memory (220) may refer to a size of memory that can be allocated for decoding an image in the imaging system device (300). The power of the second memory (220) may refer to the power of memory that can be allocated for decoding an image in the imaging system device (300).

[0250] Specifically, the second memory requirement (1110) may refer to the bandwidth of the second memory (220), the size of the second memory (220), and the power of the second memory (220) allocated to the decoding unit (270) and the reference image control unit (1100) among the specifications of the second memory (220) in the image receiving device (200).

[0251] Below, the step (S700) and operation of obtaining the final operation setting value (1130) based on the second memory requirement (1110) and the first operation setting value (1120) will be described later in FIGS. 11 to 14.

[0252] In one embodiment of the present disclosure, the operating method of the video system device (300) may include a step (S800) of encoding a restored image (510) based on a final operation setting value (1130).

[0253] In one embodiment of the present disclosure, in the step (S800) of encoding the restored image (510), at least one second processor (230) may encode the restored image (510) based on the final motion setting value (1130).

[0254] In one embodiment of the present disclosure, the operating method of the image system device (300) may include a step (S900) of storing the encoded restored image (1160) in the second memory (220) as a second reference image for inter prediction for the next image. The encoded restored image (1160) may be used as a second reference image for inter prediction for the next image.

[0255] In one embodiment of the present disclosure, in the step (S900) of storing the encoded restored image (1160) as a second reference image for the next image, at least one second processor (230) may store the encoded restored image (1160) as an encoded second reference image for the next image in the second memory (220). At this time, the second memory (220) may include a decoded image buffer (280). At least one second processor (230) may store the encoded restored image (1160) in the decoded image buffer (280).

[0256] In one embodiment of the present disclosure, a decoding unit (270), a reference image control unit (1100), and a decoding image buffer (280) for explaining a decoding operation performed in an image receiving device (200) are illustrated in FIG. 11. Hereinafter, the same components as those described in FIG. 4 are given the same reference numerals, and redundant descriptions are omitted.

[0257] In one embodiment of the present disclosure, the decoding unit (270) and the reference image control unit (1100) illustrated in FIG. 11 may be implemented as a module included in the second memory (220), or may be implemented as a hardware configuration that performs a decoding operation included in the image receiving device (200).

[0258] In one embodiment of the present disclosure, the reference image control unit (1100) can control an operation of providing a second reference image (500) stored in a decoded image buffer (280) for performing a decoding operation of an encoded current image included in a bitstream (420) performed in a decoding unit (270).

[0259] In one embodiment of the present disclosure, the reference image control unit (1100) may provide the second reference image (1130) obtained by decoding the encoded second reference image (500) to the decoding unit (270). The reference image control unit (1100) may decode the encoded second reference image (500) using a reference motion setting value. The reference motion setting value may be a value set in consideration of the second memory requirement (1110) of the second memory (220) in the reference image, not the current image, and the decoding requirement for decoding the image in the reference image. In one embodiment of the present disclosure, the reference motion setting value may be a value used for decoding an image encoded in the reference image. Hereinafter, the reference motion setting value provided by the reference image control unit (1100) to the decoding unit (270) will be referred to as a second reference motion setting value.

[0260] In one embodiment of the present disclosure, the reference image control unit (1100) can obtain the second memory requirement (1110) of the second memory (220) in the current image.

[0261] In one embodiment of the present disclosure, the reference image control unit (1100) may obtain decoding requirements for decoding an encoded current image. In one embodiment of the present disclosure, the decoding requirements may be requirements expected to be required when decoding the encoded current image in the image receiving device (200). The decoding requirements may include at least one of an expected memory bandwidth, an expected memory size, or an expected memory power.

[0262] In one embodiment of the present disclosure, decoding requirements may be determined based on codec technology or codec standards for decoding the encoded current video. Furthermore, decoding requirements may also be determined based on the resolution, size, frame rate, complexity, etc. of the encoded current video to be decoded.

[0263] At this time, the encoded current image may be included in the bitstream (420) provided from the image transmission device (100).

[0264] In one embodiment of the present disclosure, the reference image control unit (1100) may obtain an operation setting value for decoding the encoded current image based on the second memory requirement (1110) and the decoding requirement. At this time, the operation setting value set based on the second memory requirement (1110) and the decoding requirement may be referred to as a second operation setting value.

[0265] In one embodiment of the present disclosure, the reference image control unit (1100) can parse the first operation setting value (1120) from the bitstream (420) provided to the decoding unit (270). In one embodiment of the present disclosure, the first operation setting value (1120) parsed by the reference image control unit (1100) from the bitstream (420) may be information whose format has been changed in the form of metadata.

[0266] In one embodiment of the present disclosure, the reference image control unit (1100) can change the format of the first operation setting value (1120) having the format of metadata.

[0267] In one embodiment of the present disclosure, the reference image control unit (1100) can obtain a final operation setting value for encoding a restored image (510) obtained by decoding the encoded current image based on the first operation setting value (1120) and the second operation setting value.

[0268] In one embodiment of the present disclosure, the reference image control unit (1100) can encode a restored image (510) based on the final motion setting value. The reference image control unit (1100) can store the encoded restored image (1140) in the decoded image buffer (280) as an encoded reference image for inter prediction for the next image.

[0269] In one embodiment of the present disclosure, the final motion setting value can be used as a second reference motion setting value for decoding a reference image encoded in the next image.

[0270] Hereinafter, the specific operation of the reference image control unit (1100) will be described later with reference to FIGS. 7 and 8.

[0271] FIG. 12 is a flowchart illustrating an operation of performing decoding through inter prediction using a reference image according to an embodiment of the present disclosure. FIG. 13 is a diagram illustrating an operation of performing decoding through inter prediction using a reference image according to an embodiment of the present disclosure. Hereinafter, the same configurations and steps as those described in FIGS. 10 and 11 are given the same reference numerals, and redundant descriptions are omitted.

[0272] Referring to FIGS. 2, 4, 12, and 1, in one embodiment of the present disclosure, FIG. 12 illustrates an operating method of an image system device (300). However, the present disclosure is not limited thereto, and the operating method illustrated in FIG. 12 may also refer to an operating method of an image receiving device (200).

[0273] In one embodiment of the present disclosure, the operating method of the video system device (300) may include a step (S510) of obtaining an encoded second reference image (500) from a second memory (220).

[0274] In one embodiment of the present disclosure, in the step (S510) of obtaining an encoded second reference image (500) from a second memory (220), at least one second processor (230) may obtain the encoded second reference image (500) stored in the second memory (220). At this time, the encoded second reference image (500) may be stored in a decoded image buffer (280).

[0275] In one embodiment of the present disclosure, the operating method of the video system device (300) may include a step (S520) of decoding an encoded second reference image (500) to obtain a second reference image (1130) based on a second reference operation setting value (1311).

[0276] In one embodiment of the present disclosure, in the step (S520) of decoding the encoded second reference image (500) to obtain the second reference image (1130), at least one second processor (230) can decode the encoded second reference image (500) based on the second reference motion setting value (1311) to obtain the second reference image (1130).

[0277] In one embodiment of the present disclosure, the step (S510) of obtaining an encoded second reference image (500) and the step (S520) of decoding the encoded second reference image (500) may be performed after the step (S300) of providing a bitstream (420) generated to include the encoded current image and the first motion setting value to the image receiving device (200).

[0278] In one embodiment of the present disclosure, the operating method of the video system device (300) may include a step (S530) of decoding a current video encoded through inter prediction using a second reference video (1130).

[0279] In one embodiment of the present disclosure, in the step of decoding the encoded current image (S530), at least one second processor (230) can decode the encoded current image by performing inter prediction using the second reference image (1130).

[0280] In one embodiment of the present disclosure, the operating method of the video system device (300) may include a step (S710) of obtaining a decoding requirement for decoding an encoded current video.

[0281] In one embodiment of the present disclosure, the operating method of the video system device (300) may include a step (S720) of obtaining a second memory requirement (1110) of a second memory (220) in a current video.

[0282] In one embodiment of the present disclosure, the operating method of the video system device (300) may include a step (S730) of obtaining a second operation setting value based on a second memory requirement (1110) and a decoding requirement.

[0283] In one embodiment of the present disclosure, the operating method of the video system device (300) may include a step (S740) of obtaining a final operation setting value (1302) based on a first operation setting value and a second operation setting value.

[0284] Hereinafter, steps S710 to S740 will be described later with reference to FIGS. 13 and 14.

[0285] In one embodiment of the present disclosure, a decoding unit (270), a reference image control unit (1100), and a decoding image buffer (280) for explaining a decoding operation performed in an image receiving device (200) are illustrated in FIG. 13. Hereinafter, the same components as those described in FIG. 4 and FIG. 11 are given the same reference numerals, and redundant descriptions are omitted.

[0286] In one embodiment of the present disclosure, the reference image control unit (1100) may include a second reference operation setting unit (1300), a second reference operation management unit (1310), a second reference decoder (1320), and a second reference encoder (1330). The second reference operation setting unit (1300), the second reference operation management unit (1310), the second reference decoder (1320), and the second reference encoder (1330) may be implemented as modules included in the second memory (220), or may be implemented as hardware components that perform a decoding operation included in the image receiving device (200).

[0287] Not all components of the reference image control unit (1100) illustrated in FIG. 13 are essential components. The reference image control unit (1100) may be implemented with more components than the components illustrated in FIG. 13, or may be implemented with fewer components.

[0288] In one embodiment of the present disclosure, the second reference decoder (1320) and the second reference encoder (1330) may be video codecs for encoding a restored video (510) stored in a decoded video buffer (280) or for decoding an encoded reference video (500) stored in a decoded video buffer (280). The video codecs used in the second reference decoder (1320) and the second reference encoder (1330) may be different codec technologies or codec standards from the video codecs for encoding and decoding the current video (400) in the encoding unit (180, see FIG. 3) and the decoding unit (270). However, the present disclosure is not limited thereto, and the video codec used in the second reference decoder (1320) and the second reference encoder (1330) may be the same codec technology or codec standard as the video codec used in the encoding unit (180) and the decoding unit (270).

[0289] In one embodiment of the present disclosure, the second reference decoder (1320) can obtain an encoded second reference image (500) stored in the decoded image buffer (280). The second reference decoder (1320) can decode the encoded second reference image (500). The second reference decoder (1320) can obtain a second reference motion setting value (1311) from the second reference motion management unit (1310) and decode the encoded second reference image (500) based on the obtained second reference motion setting value (1311).

[0290] At this time, the second reference motion setting value (1311) may be a motion setting value used when encoding a restored image (510) from a reference image and storing it in a decoded image buffer (280).

[0291] In one embodiment of the present disclosure, the second reference decoder (1320) can provide a decoded second reference image (1130) to the decoding unit (270). The decoding unit (270) can decode the encoded current image through inter prediction using the decoded second reference image (1130).

[0292] In one embodiment of the present disclosure, the second reference operation setting unit (1300) can obtain the second memory requirement (1110) of the second memory (220) in the current image.

[0293] In one embodiment of the present disclosure, the second reference operation setting unit (1300) can obtain decoding requirements for decoding the current image encoded in the decoding unit (270).

[0294] In one embodiment of the present disclosure, the second reference operation setting unit (1300) can obtain a second operation setting value based on the second memory requirement (1110) and the decoding requirement. The second reference operation setting unit (1300) can compare the second memory requirement (1110) with the decoding requirement, and set the second operation setting value based on the second memory requirement (1110) being smaller than the decoding requirement.

[0295] In one embodiment of the present disclosure, the second reference operation management unit (1310) may obtain data (1120) including information on a first operation setting value by parsing the data from the bitstream (420) provided to the decoding unit (270). At this time, the information on the first operation setting value parsed from the bitstream (420) may be an operation setting value (1120) in a metadata format.

[0296] The second reference operation management unit (1310) can obtain the first operation setting value (1301) by reverse-converting the format when the first operation setting value (1120) included in the bitstream (420) is converted into a format in the form of metadata.

[0297] In one embodiment of the present disclosure, the second reference motion setting unit (1300) can obtain a first motion setting value (1301). The second reference motion setting unit (1300) can compare the first motion setting value (1301) and the second motion setting value to obtain a final motion setting value (1302). At this time, the final motion setting value (1302) can include a compression ratio of the restored image (510).

[0298] In one embodiment of the present disclosure, the second reference motion setting unit (1300) can provide the final motion setting value (1302) to the second reference motion management unit (1310).

[0299] Hereinafter, the operation of the second reference operation setting unit (1300) will be described later in FIG. 14.

[0300] In one embodiment of the present disclosure, the second reference motion management unit (1310) can provide the final motion setting value (1302) to the second reference encoder (1330). The second reference encoder (1330) can encode the restored image (510) using the final motion setting value (1302). The second reference encoder (1330) can store the encoded restored image (1140) as an encoded second reference image for inter prediction for the next image in the decoded image buffer (280). Accordingly, the size of the decoded image buffer (280) required to store the second reference image, or the bandwidth and power consumption required to read the second reference image can be reduced.

[0301] FIG. 14 is a flowchart illustrating an operation for obtaining a second operation setting value and a final operation setting value according to one embodiment of the present disclosure.

[0302] Referring to FIGS. 12, 13 and 14, in one embodiment of the present disclosure, the operating method of the video system device (300) may include a step (S710) of obtaining a decoding requirement for decoding an encoded current video.

[0303] In one embodiment of the present disclosure, in the step of obtaining decoding requirements (S710), at least one second processor (230) can obtain decoding requirements for decoding the encoded current image.

[0304] In one embodiment of the present disclosure, the operating method of the video system device (300) may include a step (S720) of obtaining a second memory requirement (1110) of a second memory (220) in a current video.

[0305] In one embodiment of the present disclosure, in the step (S720) of obtaining the second memory requirement (1110), at least one second processor (230) can obtain the second memory requirement (1110) in the current image.

[0306] In one embodiment of the present disclosure, the operating method of the video system device (300) may include a step of obtaining a second operation setting value based on a second memory requirement (1110) and a decoding requirement.

[0307] In one embodiment of the present disclosure, the step of obtaining the second operation setting value may include a step (S721) of comparing the second memory requirement (1110) with the decoding requirement. In the step (S721) of comparing the second memory requirement (1110) with the decoding requirement, at least one second processor (230) may determine whether the second memory requirement (1110) is smaller than the decoding requirement.

[0308] In one embodiment of the present disclosure, at least one processor (230) may activate a reference image encoding mode when it is determined that the second memory requirement (1110) is less than the decoding requirement.

[0309] In one embodiment of the present disclosure, when the "reference image encoding mode" is activated, the restored image (510) can be encoded using the second reference encoder (1330) and stored in the decoded image buffer (280). When the "reference image encoding mode" is deactivated, the restored image (510) can be stored in the decoded image buffer (280) without encoding.

[0310] In one embodiment of the present disclosure, when it is determined that the second memory requirement (1110) is less than the decoding requirement, the operating method of the video system device (300) may include a step (S731) of obtaining a second operation setting value based on the second memory requirement (1110) and the decoding requirement.

[0311] In one embodiment of the present disclosure, as it is determined that the second memory requirement (1110) is less than the decoding requirement, at least one second processor (230) can obtain a second operation setting value based on the second memory requirement (1110) and the decoding requirement.

[0312] In one embodiment of the present disclosure, the second operation setting value can be determined by the following mathematical expression (2).

[0313] Mathematical formula (2):

[0314] At this time, may mean a second action setting value. may mean a second memory requirement. may mean decoding requirements. Among the requirements required for decoding performed in the image receiving device (100), it may be a ratio of the requirements required for encoding the restored image (510) in the second reference encoder (1330).

[0315] In one embodiment of the present disclosure, , and It can be adjusted in units of frames, frame groups, scenes, and sequences of the current image (400), and can change when the operation scenario or operating environment of the image system device (300) changes.

[0316] In one embodiment of the present disclosure, may mean the compression ratio of the restored image (510). may mean any one of the bandwidth of the second memory (220), the size of the second memory (220), or the power of the second memory (220). may include at least one of the expected memory bandwidth, expected memory size, or expected memory power required for encoding the restored image (510). can be a real number between 0 and 1.

[0317] In one embodiment of the present disclosure, at least one second processor (230) may determine a smallest value among second operation setting values ​​calculated using at least one of a bandwidth of the second memory (220), a size of the second memory (220), or a power of the second memory (220), and an expected memory bandwidth, an expected memory size, or an expected memory power corresponding thereto. The second memory requirement used to calculate the second operation setting value having the smallest value may be a requirement with the highest importance in determining the encoding operation of the second reference encoder (1330).

[0318] In one embodiment of the present disclosure, the operating method of the video system device (300) may include a step (S741) of comparing a first operation setting value (1301) with a second operation setting value. In the step (S741) of comparing the first operation setting value (1301) with the second operation setting value, at least one second processor (230) may determine whether the first operation setting value (1301) is smaller than the second operation setting value.

[0319] In one embodiment of the present disclosure, the operating method of the video system device (300) may include a step of obtaining a smaller value between the first operation setting value (1301) and the second operation setting value as the final operation setting value (1302). In one embodiment of the present disclosure, at least one second processor (230) may set a smaller value between the first operation setting value (1301) and the second operation setting value as the final operation setting value (1302).

[0320] In one embodiment of the present disclosure, when it is determined that the first operation setting value (1301) is smaller than the second operation setting value, the operating method of the video system device (300) may include a step (S742) of obtaining the first operation setting value (1301) as the final operation setting value (1302). In one embodiment of the present disclosure, when it is determined that the first operation setting value (1301) is smaller than the second operation setting value, at least one second processor (230) may set the first operation setting value (1301) as the final operation setting value (1302).

[0321] In one embodiment of the present disclosure, when it is determined that the first operation setting value (1301) is equal to or greater than the second operation setting value, the operating method of the video system device (300) may include a step (S743) of acquiring the second operation setting value as the final operation setting value (1302). In one embodiment of the present disclosure, when it is determined that the first operation setting value (1301) is equal to or greater than the second operation setting value, at least one second processor (230) may set the second operation setting value as the final operation setting value (1302).

[0322] In one embodiment of the present disclosure, the operating method of the image system device (300) may include a method of performing a step (S800) of encoding a restored image (510) using the acquired final operation setting value (1302).

[0323] In one embodiment of the present disclosure, the operating method of the imaging system device (300) may not encode the restored image (510) if it is determined that the second memory requirement (1110) is equal to or greater than the decoding requirement. The operating method of the imaging system device (300) may include a step of storing the restored image (510) as a reference image in the next image in the decoded image buffer (280) if the second memory requirement (1110) is equal to or greater than the decoding requirement.

[0324] In one embodiment of the present disclosure, at least one second processor (230) may deactivate the reference image encoding mode when it is determined that the second memory requirement (1110) is equal to or greater than the decoding requirement.

[0325] In one embodiment of the present disclosure, when the reference image encoding mode is deactivated, at least one second processor (230) may not encode the reconstructed image (510). At least one second processor (230) may store the unencoded current image (510) as a reference image in the next image in the decoded image buffer (280).

[0326] In one embodiment of the present disclosure, when the reference image encoding mode is deactivated, the specifications of the memory that can be allocated for image decoding in the image receiving device (200) may be equal to or higher than the specifications required for image decoding. Accordingly, even if the restored image (510) is stored in the decoded image buffer (280), the operation of the image receiving device (200) may not be delayed.

[0327] However, the present disclosure is not limited thereto. In one embodiment of the present disclosure, the operating method of the video system device (300) may further include a step of providing the acquired final operation setting value (1302) to the video transmission device (100).

[0328] In one embodiment of the present disclosure, in the step of providing the acquired final motion setting value (1302) to the image transmission device (100), at least one second processor (230) may provide the acquired final motion setting value (1302) to the image transmission device (100) through the communication interface (250).

[0329] Referring to FIG. 8, in one embodiment of the present disclosure, a first reference motion setting unit (800) included in an image transmission device (100) can obtain a final motion setting value (1302). The first reference motion setting unit (800) can determine a motion setting value for encoding a restored image in a next image based on the obtained final motion setting value (1302). In one embodiment of the present disclosure, the first reference motion setting unit (800) can determine a motion setting value based on a first memory requirement of a first memory (110) in the next image, a requirement for encoding a restored image in the next image, and the final motion setting value (1302).

[0330] Accordingly, when encoding a restored image in the image transmission device (100), the state of the second memory (220) in the image reception device (200) can be taken into consideration. The image transmission device (100) can perform image encoding by taking into consideration the hardware specifications of the image reception device (200). Accordingly, delays in encoding and decoding operations that may occur when providing an image to a user in the image system device (300) can be minimized. In addition, a codec suitable for an embodiment requiring low delay characteristics can be provided.

[0331] In order to solve the above-described technical problem, one embodiment of the present disclosure provides an image system device including an image transmitting device and an image receiving device. The image transmitting device can encode a current image through inter-estimation using a first reference image of the current image stored in a first memory. The image transmitting device can obtain a first motion setting value used to encode a restored image obtained by decoding the encoded current image based on a first memory requirement that can be allocated for encoding the current image in the first memory of the current image. The image transmitting device can encode the restored image based on the first motion setting value. The image transmitting device can store the encoded restored image in the first memory. The image transmitting device can provide a bitstream generated to include the encoded current image and the first motion setting value to the image receiving device.

[0332] In one embodiment of the present disclosure, an image transmission device may include a first memory. The image transmission device may include the first memory storing at least one instruction. The image transmission device may include at least one first processor including a processing circuit. The image transmission device may obtain an encoded first reference image from the first memory by having the at least one first processor individually or collectively execute at least one instruction stored in the first memory. The image transmission device may obtain the first reference image by decoding the encoded first reference image based on a first reference motion setting value used to encode a restored image in the reference image by having the at least one first processor execute at least one instruction stored in the first memory. The image transmission device may encode a current image using the obtained first reference image by having the at least one first processor execute at least one instruction stored in the first memory. The encoded restored image may be used as a first reference image for inter prediction of a next image. The first motion setting value can be used as the first reference motion setting value in the following video.

[0333] In one embodiment of the present disclosure, an image transmission device can obtain a first encoding requirement for encoding a current image by having at least one first processor individually or collectively execute at least one instruction stored in a first memory. By having at least one first processor execute at least one instruction stored in the first memory, the image transmission device can obtain an operation setting value based on the first memory requirement and the first encoding requirement. The first memory requirement may include at least one of a bandwidth of the first memory, a size of the first memory, or a power of the first memory. The first encoding requirement may include at least one of an expected memory bandwidth, an expected memory size, or an expected memory power expected when encoding the current image. By having at least one first processor execute at least one instruction stored in the first memory, the image transmission device can encode a restored image using the first operation setting value when the first memory requirement is less than the first encoding requirement. The first operation setting value may include a compression ratio of the restored image.

[0334] In one embodiment of the present disclosure, an image receiving device can obtain a restored image by decoding an encoded current image included in a bitstream through inter prediction using a second reference image of the current image stored in a second memory. The image receiving device can parse a first motion setting value from the bitstream. The image receiving device can obtain a final motion setting value used for encoding the restored image based on the first motion setting value and a second memory requirement that can be allocated for decoding the encoded current image in the second memory. The image receiving device can encode the restored image based on the final motion setting value. The image receiving device can store the encoded restored image in the second memory.

[0335] In one embodiment of the present disclosure, an image receiving device may include a second memory storing at least one instruction. The image receiving device may include at least one second processor including a processing circuit. The image receiving device may obtain an encoded second reference image from the second memory by having the at least one second processor individually or collectively execute at least one instruction stored in the second memory. The image receiving device may obtain a second reference image by decoding the encoded second reference image based on a second reference motion setting value used to encode a reconstructed image in the reference image by having the at least one second processor individually or collectively execute at least one instruction stored in the second memory. The image receiving device may decode an encoded current image using the obtained second reference image by having the at least one second processor individually or collectively execute at least one instruction stored in the second memory. The encoded restored image can be used as a second reference image for inter prediction for the next image. The final motion setting value can be used as the second reference motion setting value in the next image.

[0336] In one embodiment of the present disclosure, the video receiving device can obtain a decoding requirement for decoding an encoded current video by having at least one second processor individually or collectively execute at least one instruction stored in a second memory. The video receiving device can obtain a second operation setting value based on the second memory requirement and the decoding requirement by having at least one second processor individually or collectively execute at least one instruction stored in a second memory. The video receiving device can obtain a final operation setting value based on the first operation setting value and the second operation setting value by having at least one second processor individually or collectively execute at least one instruction stored in the second memory.

[0337] In one embodiment of the present disclosure, the second memory requirement may include at least one of the bandwidth of the second memory, the size of the second memory, or the power of the second memory. The decoding requirement may include at least one of the expected memory bandwidth, the expected memory size, or the expected memory power expected when decoding the encoded current image. The final operation setting value may include the compression ratio of the restored image.

[0338] In one embodiment of the present disclosure, the image receiving device can encode the restored image using the final motion setting value, as the second memory requirement is smaller than the decoding requirement, by having at least one second processor individually or collectively execute at least one instruction stored in the second memory. The image receiving device can obtain a smaller value between the first motion setting value and the second motion setting value as the final motion setting value, by having at least one second processor individually or collectively execute at least one instruction stored in the second memory.

[0339] To solve the above-described technical problem, in one embodiment of the present disclosure, an image transmission device for encoding an image is provided. The image transmission device may include a memory storing at least one instruction. The image transmission device may include at least one processor including a processing circuit. By having at least one processor individually or collectively execute at least one instruction stored in the memory, the image transmission device may encode the current image through inter-estimation using a reference image of the current image. By having at least one processor execute at least one instruction stored in the memory, the image transmission device may decode the encoded current image to obtain a restored image corresponding to the current image. By having at least one processor execute at least one instruction stored in the memory, the image transmission device may obtain a memory requirement that can be allocated for encoding the current image in the memory. By having at least one processor execute at least one instruction stored in the memory, the image transmission device may obtain an operation setting value used for encoding the restored image based on the memory requirement. By having at least one processor execute at least one command stored in memory, the video transmission device can encode a restored image based on the motion setting value. By having at least one processor execute at least one command stored in memory, the video transmission device can store the encoded restored image in the memory. By having at least one processor execute at least one command stored in memory, the video transmission device can generate a bitstream including the encoded current image and the motion setting value.

[0340] In one embodiment of the present disclosure, an image transmission device can obtain an encoded reference image from a memory by having at least one processor individually or collectively execute at least one command stored in a memory. By having at least one processor execute at least one command stored in the memory, the image transmission device can obtain a reference image by decoding the encoded reference image based on a reference motion setting value used to encode a restored image in the reference image. By having at least one processor execute at least one command stored in the memory, the image transmission device can encode a current image using the obtained reference image.

[0341] In one embodiment of the present disclosure, the encoded restored image can be used as a reference image for inter prediction for the next image. The motion setting value can be used as a reference motion setting value in the next image.

[0342] In one embodiment of the present disclosure, an image transmission device can obtain encoding requirements for encoding a current image by having at least one processor individually or collectively execute at least one instruction stored in memory. By having at least one processor execute at least one instruction stored in memory, the image transmission device can obtain operation setting values ​​based on the memory requirements and encoding requirements.

[0343] In one embodiment of the present disclosure, the memory requirement may include at least one of memory bandwidth, memory size, or memory power. The encoding requirement may include at least one of the expected memory bandwidth, expected memory size, or expected memory power expected when encoding the current image. The operation setting value may include the compression ratio of the restored image.

[0344] In one embodiment of the present disclosure, the image transmission device can encode a restored image using an operation setting value as the memory requirement is less than the encoding requirement by having at least one processor individually or collectively execute at least one instruction stored in a memory.

[0345] In one embodiment of the present disclosure, at least one processor can generate a bitstream by individually or collectively executing at least one instruction stored in a memory, such that an operation setting value is included as a Supplemental Enhancement Information (SEI) message.

[0346] In order to solve the above-described technical problem, one embodiment of the present disclosure provides an operating method of an image system device including an image transmitting device and an image receiving device. The operating method of the image system device may include a step of encoding a current image through inter-estimation using a first reference image of the current image stored in a first memory included in the image transmitting device. The operating method of the image system device may include a step of obtaining a first motion setting value used to encode a restored image obtained by decoding the encoded current image based on a first memory requirement that can be allocated for encoding the current image in the first memory. The operating method of the image system device may include a step of encoding the restored image based on the first motion setting value. The operating method of the image system device may include a step of storing the encoded restored image in the first memory. The operating method of the image system device may include a step of providing a bitstream generated to include the encoded current image and the first motion setting value to the image receiving device.

[0347] In one embodiment of the present disclosure, the step of encoding a current image may include the step of obtaining an encoded first reference image from a first memory. The step of encoding the current image may include the step of obtaining a first reference image by decoding the encoded first reference image based on a first reference motion setting value used to encode a reconstructed image in the reference image. The step of encoding the current image may include the step of encoding the current image using the obtained first reference image. The step of obtaining the first motion setting value may include the step of obtaining a first encoding requirement for encoding the current image. The step of obtaining the first motion setting value may include the step of obtaining the first motion setting value based on the first memory requirement and the first encoding requirement. The encoded reconstructed image may be used as a first reference image for inter prediction for a next image. The first motion setting value may be used as a first reference motion setting value in the next image.

[0348] In one embodiment of the present disclosure, an operating method of an imaging system device may include a step of decoding an encoded current image included in a bitstream through inter prediction using a second reference image of the current image stored in a second memory included in an imaging receiving device to obtain a restored image. The operating method of the imaging system device may include a step of parsing a first motion setting value from the bitstream. The operating method of the imaging system device may include a step of obtaining a final motion setting value used for encoding the restored image based on a second memory requirement that can be allocated for decoding the encoded current image of the second memory and the first motion setting value. The operating method of the imaging system device may include a step of encoding the restored image based on the final motion setting value. The operating method of the imaging system device may include a step of storing the encoded restored image in the second memory.

[0349] In one embodiment of the present disclosure, the step of decoding the encoded current image may include the step of obtaining an encoded second reference image from a second memory. The step of decoding the encoded current image may include the step of obtaining a second reference image by decoding the encoded second reference image based on a second reference motion setting value used to encode a reconstructed image in the reference image. The step of decoding the encoded current image may include the step of decoding the encoded current image using the obtained second reference image. The step of obtaining a final motion setting value may include the step of obtaining a decoding requirement for decoding the encoded current image. The step of obtaining a final motion setting value may include the step of obtaining a second motion setting value based on the second memory requirement and the decoding requirement. The step of obtaining a final motion setting value may include the step of obtaining a final motion setting value based on the first motion setting value and the second motion setting value. The encoded reconstructed image may be used as a second reference image for inter prediction for a next image. The final motion setting value may be used as a second reference motion setting value in the next image.

[0350] In one embodiment of the present disclosure, in the step of encoding a restored image according to a final motion setting value, the restored image may be encoded using the final motion setting value, as the second memory requirement is smaller than the decoding requirement. In the step of obtaining the final motion setting value, the smaller value between the first motion setting value and the second motion setting value may be obtained as the final motion setting value.

[0351] A computer-readable recording medium having recorded thereon a program for performing at least one method of operating an electronic device disclosed in the present disclosure on a computer can be provided.

[0352] The program executed by the electronic device described in this disclosure may be implemented as hardware components, software components, and / or a combination of hardware components and software components. The program may be executed by any system capable of executing computer-readable instructions.

[0353] Software may include a computer program, code, instructions, or a combination of one or more of these, which may configure a processing device to do a desired thing or may independently or collectively command a processing device to do a desired thing.

[0354] Software may be implemented as a computer program containing instructions stored on a computer-readable storage medium. Examples of computer-readable storage media include magnetic storage media (e.g., read-only memory (ROM), random-access memory (RAM), floppy disks, hard disks, etc.) and optical readable media (e.g., CD-ROMs, DVDs (Digital Versatile Discs)). The computer-readable storage media may be distributed across network-connected computer systems, so that computer-readable code may be stored and executed in a distributed manner. The storage media may be readable by a computer, stored in a memory, and executed by a processor.

[0355] Computer-readable storage media may be provided in the form of non-transitory storage media. Here, the term "non-transitory storage media" simply means a tangible device that does not contain signals (e.g., electromagnetic waves). This term does not distinguish between cases where data is permanently stored in the storage media and cases where data is temporarily stored. For example, a "non-transitory storage medium" may include a buffer in which data is temporarily stored.

[0356] Additionally, programs according to the embodiments disclosed herein may be provided as part of a computer program product. The computer program product may be traded as a commodity between sellers and buyers.

[0357] A computer program product may include a software program and a computer-readable storage medium storing the software program. For example, a computer program product may include a product in the form of a software program (e.g., a downloadable application) distributed electronically by an electronic device manufacturer or through an electronic marketplace (e.g., the Samsung Galaxy Store). For electronic distribution, at least a portion of the software program may be stored on a storage medium or temporarily created. In this case, the storage medium may be a server of the electronic device manufacturer, a server of the electronic marketplace, or a storage medium of an intermediary server that temporarily stores the software program.

[0358] Although the embodiments described above have been described with limited examples and drawings, those skilled in the art will appreciate that various modifications and variations can be made based on the above description. For example, appropriate results can still be achieved even if the described techniques are performed in a different order than described, and / or components such as the described computer system or modules are combined or combined in a different manner than described, or are replaced or substituted with other components or equivalents.

[0359] The effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned will be clearly understood by a person having ordinary skill in the art to which the present disclosure pertains from the present disclosure.

Claims

1. In an image system device (300) including an image transmitting device (100) and an image receiving device (200), The above video transmission device (100) is Encode the current image through inter estimation using the first reference image of the current image stored in the first memory (110), Based on the first memory requirement that can be allocated for encoding the current image of the first memory (110), a first operation setting value used for encoding a restored image obtained by decoding the encoded current image is obtained, Encode the restored image based on the first motion setting value, Store the encoded restored image in the first memory (110), An image system device (300) that provides a bitstream generated to include the encoded current image and the first motion setting value to the image receiving device (200).

2. In paragraph 1, The above video transmission device (100) is The first memory (110) storing at least one instruction; and At least one first processor (120) comprising a processing circuit, The image transmission device (100) executes the at least one first processor (120) individually or collectively the at least one command stored in the first memory (110), Obtaining the encoded first reference image from the first memory (110), Based on the first reference motion setting value used to encode the restored image in the reference image, the encoded first reference image is decoded to obtain the first reference image, Encode the current image using the first reference image obtained above, The above encoded restored image is used as the first reference image for inter prediction for the next image, The above first motion setting value is an image system device (300) used as the first reference motion setting value in the next image.

3. In paragraph 2, The image transmission device (100) executes the at least one first processor (120) individually or collectively the at least one command stored in the first memory (110), Obtain encoding requirements for encoding the current video above, Based on the first memory requirement and the encoding requirement, the first operation setting value is obtained, The first memory requirement includes at least one of a bandwidth of the first memory, a size of the first memory, or a power of the first memory, The encoding requirement includes at least one of an expected memory bandwidth, an expected memory size, or an expected memory power expected when encoding the current image, Since the first memory requirement is less than the encoding requirement, the restored image is encoded using the first operation setting value, The first operation setting value is an image system device (300) including a compression ratio of the restored image.

4. In any one of the first to third clauses, The above image receiving device (200) is, The encoded current image included in the bitstream is decoded through inter prediction using a second reference image of the current image stored in the second memory (220) to obtain a restored image, Parsing the first operation setting value from the bitstream, Based on the second memory requirement that can be allocated for decoding the encoded current image of the second memory (220) and the first operation setting value, the final operation setting value used for encoding the restored image is obtained, Encode the restored image based on the final motion setting value, An image system device (300) that stores the encoded restored image in the second memory (220).

5. In paragraph 4, The above image receiving device (200) is, The second memory (220) storing at least one instruction; and At least one second processor (230) comprising a processing circuit, The image receiving device (200) causes the at least one second processor (230) to individually or collectively execute the at least one instruction stored in the second memory (220), Obtaining the encoded second reference image from the second memory (220), Based on the second reference motion setting value used to encode the restored image in the reference image, the encoded second reference image is decoded to obtain the second reference image, Using the second reference image obtained above, decode the encoded current image, The above encoded restored image is used as a second reference image for inter prediction for the next image, The above final motion setting value is used as the second reference motion setting value in the next video, the video system device (300).

6. In paragraph 5, The image receiving device (200) causes the at least one second processor (230) to individually or collectively execute the at least one instruction stored in the second memory (220), Obtaining the decoding requirements for decoding the above encoded current image, Obtain a second operation setting value based on the second memory requirement and the decoding requirement, An image system device (300) that obtains the final motion setting value based on the first motion setting value and the second motion setting value.

7. In paragraph 6, The second memory requirement includes at least one of a bandwidth of the second memory, a size of the second memory, or a power of the second memory, The above decoding requirement includes at least one of the expected memory bandwidth, expected memory size, or expected memory power expected when decoding the encoded current image, The above final operation setting value is an image system device (300) including a compression ratio of the restored image.

8. In either of paragraphs 6 or 7, The image receiving device (200) causes the at least one second processor (230) to individually or collectively execute the at least one instruction stored in the second memory (220), Since the second memory requirement is less than the decoding requirement, the restored image is encoded using the final motion setting value, An image system device (300) that obtains a smaller value between the first operation setting value and the second operation setting value as the final operation setting value.

9. In a video transmission device (100) that encodes a video, A memory (110) storing at least one instruction; and At least one processor (120) comprising a processing circuit, The image transmission device (100) causes the at least one processor (120) to individually or collectively execute the at least one instruction stored in the memory (110), Encode the current image using inter estimation using the reference image of the current image, Decoding the encoded current image to obtain a restored image corresponding to the current image, Obtain the memory requirements that can be allocated for encoding the current image of the above memory, Obtaining the motion setting values ​​used to encode the restored image based on the above memory requirements, Encode the restored image based on the above motion setting values, Store the encoded restored image in the memory (110), An image transmission device (100) that generates a bitstream including the encoded current image and the motion setting values.

10. In paragraph 9, The image transmission device (100) causes the at least one processor (120) to individually or collectively execute the at least one instruction stored in the memory (110), Obtaining an encoded reference image from the memory (110), Based on the reference motion setting value used to encode the restored image in the reference image, the encoded reference image is decoded to obtain the reference image, An image transmission device (100) that encodes the current image using the reference image obtained above.

11. In paragraph 10, The above encoded restored image is used as a reference image for inter prediction for the next image, The above motion setting value is used as the reference motion setting value in the following video, and the video transmission device (100) is used.

12. In any one of the clauses 9 to 11, The image transmission device (100) causes the at least one processor (120) to individually or collectively execute the at least one instruction stored in the memory (110), Obtain encoding requirements for encoding the current video above, An image transmission device (100) that obtains the operation setting value based on the above memory requirements and the above encoding requirements.

13. In paragraph 12, The above memory requirement includes at least one of the bandwidth of the memory, the size of the memory, or the power of the memory, The encoding requirement includes at least one of an expected memory bandwidth, an expected memory size, or an expected memory power expected when encoding the current image, The above operation setting value is an image transmission device (100) including a compression ratio of the restored image.

14. In paragraph 13, The image transmission device (100) causes the at least one processor (120) to individually or collectively execute the at least one instruction stored in the memory (110), An image transmission device (100) that encodes the restored image using the operation setting value, as the above memory requirement is less than the above encoding requirement.

15. In the operating method of an image system device (300) including an image transmitting device (100) and an image receiving device (200), A step (S100) of encoding the current image through inter estimation using a first reference image of the current image stored in a first memory (110) included in the image transmission device (100); A step (S200) of obtaining a first operation setting value used to encode a restored image obtained by decoding the encoded current image based on a first memory requirement that can be allocated for encoding the current image of the first memory (110); A step (S410) of encoding the restored image based on the first motion setting value; A step of storing the encoded restored image in the first memory (S420); and An operating method of an image system device (300), including a step (S300) of providing a bitstream generated to include the encoded current image and the first motion setting value to the image receiving device.

Images