Image coding method and system based on region of interest
By obtaining the distance between the face and the display and the changing angle of the eyes in real time, the focus area of the eyes in the display is dynamically determined and used for image encoding, which solves the problem that the fixed area of interest cannot be effectively encoded, and realizes the More efficient image encoding.
Patent Information
- Application Number
- CN202411523384.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-29
- Publication Date
- 2025-02-07
AI Technical Summary
In the existing image encoding technology based on the region of interest, fixed region of interest cannot be effectively encoded because the changes in the video cause the actual region of interest to change.
By obtaining the distance between the face and the display, the changing angle of the eye's focus relative to the acquisition device in real time, and the focus area of the eye is dynamically determined, and sending it to the encoder as the area of interest for encoding.
The accuracy and real-time determination of the region of interest are improved, thereby improving the effect and efficiency of image encoding.
Smart Images
Figure CN119402657A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of image processing technology, and in particular to a method and system for image encoding based on a region of interest. Background Art
[0002] In the image coding process, in order to resolve the contradiction between high-fidelity data coding and limited bandwidth, image coding technology based on region of interest becomes a feasible solution. Region of interest image coding can reduce a large amount of data redundancy for many image processing and analysis systems, so it has very important practical value in practical applications.
[0003] At present, the region of interest in the encoding process is mainly based on advance division, but due to the continuous changes in the video, the actual region of interest is also constantly changing, which makes it impossible to effectively encode the fixed region of interest. Summary of the invention
[0004] The present application provides a method and system for image coding based on a region of interest, which can improve the coding effect of image coding based on a region of interest.
[0005] In order to achieve the above objectives, this application adopts the following technical solutions:
[0006] In a first aspect of an embodiment of the present application, a method for image coding based on a region of interest is provided, which is applied to an image coding system based on a region of interest, wherein the system includes a display, and a collection device is provided on the display. The method includes:
[0007] Acquire a first distance, a change angle, and a focal length of an eye in a face in real time, wherein the first distance is the distance between the face and the display, and the change angle is the change angle of the focus of the eye relative to the acquisition device;
[0008] Determine a focus area of the eye in a current frame image in the display according to the first distance, the change angle, the focal length, and a preset display size;
[0009] The focus area is sent to an encoder, so that the encoder encodes the current frame image by taking the focus area as a region of interest.
[0010] As a possible implementation manner, determining a focus area of an eye in a current frame image of the display according to the first distance, the change angle, the focal length, and a preset display size includes:
[0011] Determine a first position according to the change angle and the first distance, where the first position is the position of the focus of the eye relative to the acquisition device;
[0012] Determine a second position according to the change angle, the first distance and the focal length, where the second position is the position of the focus of the eye relative to the display;
[0013] The focus area is determined according to the first position, the second position, the display size and the focal length.
[0014] As a possible implementation manner, the change angle includes a horizontal change angle and a vertical change angle, the first position includes a first horizontal distance and a first vertical distance, and determining the first position according to the change angle and the first distance includes:
[0015] Determine a first horizontal distance according to the horizontal change angle and the first distance, wherein the first horizontal position is the distance in the horizontal direction between the focus of the eye and the acquisition device;
[0016] A second vertical distance is determined according to the vertical change angle and the first distance, where the second vertical distance is the distance in the vertical direction between the focus of the eye and the acquisition device.
[0017] As a possible implementation manner, the second position includes a second horizontal distance and a second vertical distance, and determining the second position according to the change angle, the first distance and the focal length includes:
[0018] Determine the second horizontal distance according to the horizontal change angle, the first distance and the focal length, where the second horizontal distance is the horizontal distance of the focus of the eye relative to the display screen;
[0019] The second vertical distance is determined according to the first vertical distance and preset parameters, where the second vertical distance is the vertical distance of the focus of the eye relative to the display screen.
[0020] As a possible implementation manner, determining the focus area according to the first position, the second position, the display size, and the focal length includes:
[0021] Obtaining the first focusing area according to the second horizontal distance, the first horizontal distance, the second vertical distance and the first vertical distance, where the first focusing area is the focusing area of the eye;
[0022] The first focus area is mapped to a screen of the display according to the size of the display to obtain the focus area.
[0023] As a possible implementation, the acquisition device is integrated with a distance sensor, and the real-time acquisition of the first distance, the change angle, and the focal length of the eyes in the face includes:
[0024] Acquire a first distance collected by the distance sensor;
[0025] The face image collected by the collection device is acquired, and the change angle and the focal length are obtained based on the human image detection.
[0026] As a possible implementation manner, before acquiring the first distance, the change angle, and the focal length of the eyes in the face in real time, the method further includes:
[0027] The size and resolution of the image in the encoder are configured according to the size and resolution of the image in the display.
[0028] In a second aspect of the embodiments of the present application, there is provided an image coding system based on a region of interest, the system comprising: a display, an encoder, a processor, and a collection device arranged on the display;
[0029] The processor is used to: acquire a first distance, a change angle, and a focal length of an eye in a face in real time, wherein the first distance is the distance between the face and the display, and the change angle is a change angle of the focus of the eye relative to the acquisition device; determine a focal area of the eye in a current frame image in the display according to the first distance, the change angle, the focal length, and a preset display size; and send the focal area to an encoder;
[0030] The encoder is used to encode the current frame image by taking the focus area as the region of interest.
[0031] As a possible implementation manner, the processor is specifically configured to:
[0032] Determine a first position according to the change angle and the first distance, where the first position is the position of the focus of the eye relative to the acquisition device;
[0033] Determine a second position according to the change angle, the first distance and the focal length, where the second position is the position of the focus of the eye relative to the display;
[0034] The focus area is determined according to the first position, the second position, the display size and the focal length.
[0035] As a possible implementation manner, the processor is specifically configured to:
[0036] Determine a first horizontal distance according to the horizontal change angle and the first distance, wherein the first horizontal position is the distance in the horizontal direction between the focus of the eye and the acquisition device;
[0037] A second vertical distance is determined according to the vertical change angle and the first distance, where the second vertical distance is the distance in the vertical direction between the focus of the eye and the acquisition device.
[0038] According to a third aspect of an embodiment of the present application, an electronic device is provided, including a memory and the above-mentioned processor, wherein the memory stores a computer program, and when the computer program is executed by the processor, an image encoding method based on a region of interest in the first aspect of an embodiment of the present application is implemented.
[0039] According to a fourth aspect of the embodiments of the present application, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, an image encoding method based on a region of interest in the first aspect of the embodiments of the present application is implemented.
[0040] The beneficial effects brought by the technical solution provided by the embodiment of the present application include at least:
[0041] The image encoding method of the region of interest provided in the embodiment of the present application is applied to the image encoding system based on the region of interest, and the system includes a display, and a collection device is arranged on the display. By acquiring the first distance, the change angle and the focal length of the eyes in the face in real time, wherein the first distance is the distance between the face and the display, and the change angle is the change angle of the focus of the eyes relative to the collection device; according to the first distance, the change angle, the focal length and the preset display size, the focus area of the eyes in the current frame image in the display is determined; the focus area is sent to the encoder, so that the encoder encodes the current frame image with the focus area as the region of interest, which can improve the accuracy and real-time performance of the determination of the region of interest, and thus improve the encoding effect and encoding efficiency. BRIEF DESCRIPTION OF THE DRAWINGS
[0042] Figure 1 A structural diagram of an image coding system based on a region of interest provided in an embodiment of the present application;
[0043] Figure 2 A method for encoding an image based on a region of interest provided in an embodiment of the present application Figure 1 ;
[0044] Figure 3 A method for encoding an image based on a region of interest provided in an embodiment of the present application Figure 2 ;
[0045] Figure 4A schematic diagram of a first focusing area provided in an embodiment of the present application;
[0046] Figure 5 A schematic diagram of a focusing area provided in an embodiment of the present application;
[0047] Figure 6 A structural diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0048] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.
[0049] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of the embodiments of the present disclosure, unless otherwise specified, "plurality" means two or more.
[0050] Additionally, the use of “based on” or “according to” is meant to be open and inclusive, as a process, step, calculation, or other action “based on” or “according to” one or more conditions or values may, in practice, be based on additional conditions or beyond values.
[0051] In the image encoding process, in order to solve the contradiction between high-fidelity data encoding and limited bandwidth, image encoding technology based on regions of interest has become a feasible solution. Region of interest image encoding can reduce a large amount of data redundancy for many image processing and analysis systems, so it has very important practical value in practical applications. For example, when we edit the current text, our eyes focus on the current line and the lines above and below, while the focus around the editing software is not high or not concerned at all. In this way, we use the camera on the display to identify where the eyes are currently focused on the screen, set a certain range of it as the region of interest, set a smaller quantization parameter (Quantization Parameter, QP) for this area, so that the encoded picture is clearer, and other areas that are not focused on by the eyes are set with a larger QP, which will reduce the size of the generated code stream, which is more conducive to network transmission, reduce the delay of interaction and improve user experience.
[0052] At present, the region of interest in the encoding process is mainly based on advance division, but due to the continuous changes in the video, the actual region of interest is also constantly changing, which makes it impossible to effectively encode the fixed region of interest.
[0053] In order to solve the above problems, the embodiment of the present application provides an image coding system based on a region of interest, such as Figure 1 As shown, the system includes: a display 10, an encoder 20, a processor 30, and a collection device 40 arranged on the display, wherein the processor 30 is communicatively connected with the display 10, the encoder 20 and the collection device 40.
[0054] Optionally, the acquisition device 40 can be set in the middle of the top of the screen of the display 10 to acquire the face image in front of the display 10 and the first distance between the face and the display 10 .
[0055] The processor 30 detects the change angle of the eye focus relative to the acquisition device 40 and the focal length of the eye based on the facial image acquired by the acquisition device 40, and then determines the focus area of the eye in the current frame image of the display 10 based on the first distance, the change angle, the focal length and the preset display size, and finally sends the focus area to the encoder 20, so that the encoder 20 encodes the current frame image with the focus area as the region of interest.
[0056] Based on the above-mentioned image coding system based on the region of interest, the embodiment of the present application provides an image coding method based on the region of interest, such as Figure 2 As shown, the method comprises the following steps:
[0057] Step 201, acquiring a first distance, a change angle, and a focal length of an eye in a face in real time, wherein the first distance is the distance between the face and a display, and the change angle is a change angle of a focus of the eye relative to the acquisition device.
[0058] Optionally, the acquisition device is integrated with a distance sensor, and the first distance acquired by the distance sensor can be used to acquire a face image acquired by the acquisition device, and then detect the change angle and the focal length based on the face image.
[0059] Specifically, after acquiring multiple frames of facial images, the changing angle of the eye focus relative to the acquisition device and the focal length of the eye in the face can be detected based on the image detection model of the neural network.
[0060] Step 202: Determine a focus area of the eye in a current frame image on the display according to the first distance, the change angle, the focal length, and a preset display size.
[0061] Step 203: Send the focus area to an encoder, so that the encoder encodes the current frame image using the focus area as a region of interest.
[0062] Among them, after receiving the focus area corresponding to the current frame image, the encoder sets a smaller QP for the area of interest according to the preset encoding parameters, so that the encoded picture in the area of interest is clearer, while other areas that are not focused on by the eyes are set with a larger QP. This will reduce the size of the generated bitstream, which is more conducive to network transmission, reduce the interaction delay and improve the user experience.
[0063] The image encoding method of the region of interest provided in the embodiment of the present application is applied to the image encoding system based on the region of interest, and the system includes a display, and a collection device is arranged on the display. By acquiring the first distance, the change angle and the focal length of the eyes in the face in real time, wherein the first distance is the distance between the face and the display, and the change angle is the change angle of the focus of the eyes relative to the collection device; according to the first distance, the change angle, the focal length and the preset display size, the focus area of the eyes in the current frame image in the display is determined; the focus area is sent to the encoder, so that the encoder encodes the current frame image with the focus area as the region of interest, which can improve the accuracy of the determination of the region of interest, and thus improve the encoding effect and encoding efficiency.
[0064] like Figure 3 As shown, the process of determining the focus area of the eye in the current frame image of the display according to the first distance, the change angle, the focal length and the preset display size in the above step 202 may be:
[0065] Step 301: determining a first position according to the change angle and the first distance, where the first position is the position of the focus of the eye relative to the acquisition device;
[0066] Step 302: determining a second position according to the change angle, the first distance and the focal length, where the second position is a position of the focus of the eye relative to the display;
[0067] Step 303: Determine the focus area according to the first position, the second position, the display size and the focal length.
[0068] Optionally, the change angle includes a horizontal change angle and a vertical change angle, the first position includes a first horizontal distance and a first vertical distance, and the process of determining the first position according to the change angle and the first distance in step 301 may be:
[0069] Determine a first horizontal distance according to the horizontal change angle and the first distance, wherein the first horizontal position is the distance in the horizontal direction between the focus of the eye and the acquisition device;
[0070] A second vertical distance is determined according to the vertical change angle and the first distance, where the second vertical distance is the distance in the vertical direction between the focus of the eye and the acquisition device.
[0071] Furthermore, the first distance can be represented by Y, the horizontal change angle is A, the vertical change angle is B, and the first horizontal distance is w 1 , the first vertical distance is h 1 , then, w 1 =tan(A)*Y,h 1 =tan(B)*Y.
[0072] Optionally, the second position includes a second horizontal distance and a second vertical distance, and the process of determining the second position according to the change angle, the first distance and the focal length in step 302 may be:
[0073] Determine the second horizontal distance according to the horizontal change angle, the first distance and the focal length, where the second horizontal distance is the horizontal distance of the focus of the eye relative to the display screen;
[0074] The second vertical distance is determined according to the first vertical distance and preset parameters, where the second vertical distance is the vertical distance of the focus of the eye relative to the display screen.
[0075] The second horizontal distance can be expressed as w 2 The second vertical distance can be expressed as h 2 It means, then,
[0076] w 2 =2*tan(A / 2)*Y+L,h 2 =Y*x, where L is the focal length and x is a preset parameter, which is set according to the actual scene and is generally set to 20%.
[0077] Optionally, the process of determining the focus area in step 303 according to the first position, the second position, the display size and the focal length may be:
[0078] Obtaining the first focusing area according to the second horizontal distance, the first horizontal distance, the second vertical distance and the first vertical distance, where the first focusing area is the focusing area of the eye;
[0079] The first focus area is mapped to a screen of the display according to the size of the display to obtain the focus area.
[0080] like Figure 4 As shown, the first focus area may be an area consisting of four points i, j, k, and g. Then, the process of obtaining the first focus area according to the second horizontal distance, the first horizontal distance, the second vertical distance, and the first vertical distance may be:
[0081] The coordinates of point i = (w 1 -w 2 / 2,h 1 +h 2 / 2), the coordinates of point j = (w 1 +w 2 / 2,h 1 +h 2 / 2), the coordinates of point k = (w 1 -w 2 / 2,h 1 -h 2 / 2), the coordinates of point g = (w 1 +w 2 / 2,h 1 -h 2 / 2).
[0082] It is understandable that after determining the focus area of the eye, due to the limitation of the display size, it is also necessary to map the focus area of the eye to the screen of the display according to the display size, so as to obtain the focus area of the display, such as Figure 5 As shown, the focus area can be an area consisting of four points iˋ, jˋ, kˋ, and gˋ. The width and height of the display can be represented by W and H respectively. Figure 4 and Figure 5 The lw in the above refers to the w 1 , 1h refers to the above h 1 , w refers to the above w 2 , h refers to the above h 2 .
[0083] Then, when (w 1 -w 2 / 2) is greater than W / 2, the coordinate of point i = (W / 2-L, h 1 +h 2 / 2), the coordinates of point j = (W / 2, h 1 +h 2 / 2), the coordinates of point k = (W / 2-L, h 1 -h 2 / 2), the coordinates of point g = (W / 2, h 1 -h2 / 2).
[0084] When (w 1 -w 2 / 2) is greater than W / 2, the coordinate of point i = (w 1 -w 2 / 2-L,h 1 +h 2 / 2), the coordinates of point j = (w 1 +w 2 / 2-W / 2,h 1 +h 2 / 2), the coordinates of point k = (w 1 -w 2 / 2-L,h 1 -h 2 / 2), the coordinates of point g = (w 1 -w 2 / 2-W / 2,h 1 -h 2 / 2).
[0085] Optionally, before executing step 201 of acquiring the first distance, the change angle, and the focal length of the eyes in the face in real time, the method further includes:
[0086] The size and resolution of the image in the encoder are configured according to the size and resolution of the image in the display.
[0087] It should be noted that before executing step 201 to obtain the first distance, change angle and focal length of the eyes in the face in real time, the image size and resolution in the display can be configured to be consistent with the image size and resolution in the encoder, which can improve encoding efficiency.
[0088] The present application also provides an image coding system based on a region of interest, such as Figure 1 As shown, the system includes: a display 10, an encoder 20, a processor 30 and a collection device 40 arranged on the display, wherein the processor 30 is communicatively connected with the display 10, the encoder 20 and the collection device 40.
[0089] The processor 30 is used to: acquire a first distance, a change angle, and a focal length of an eye in a face in real time, wherein the first distance is the distance between the face and the display 10, and the change angle is a change angle of the focus of the eye relative to the acquisition device 40; determine a focal area of the eye in a current frame image of the display 10 according to the first distance, the change angle, the focal length, and a preset size of the display 10; and send the focal area to the encoder 20;
[0090] The encoder 20 is used to encode the current frame image by taking the focus area as the region of interest.
[0091] In one embodiment, the processor 30 is specifically configured to:
[0092] Determine a first position according to the change angle and the first distance, where the first position is the position of the focus of the eye relative to the acquisition device 40;
[0093] Determine a second position according to the change angle, the first distance and the focal length, where the second position is the position of the focus of the eye relative to the display 10;
[0094] The focus area is determined according to the first position, the second position, the size of the display 10 and the focal length.
[0095] In one embodiment, the processor 30 is specifically configured to:
[0096] Determine a first horizontal distance according to the horizontal change angle and the first distance, wherein the first horizontal position is the distance in the horizontal direction between the focus of the eye and the acquisition device 40;
[0097] A second vertical distance is determined according to the vertical change angle and the first distance, where the second vertical distance is the distance in the vertical direction between the focus of the eye and the acquisition device 40 .
[0098] In one embodiment, the processor 30 is specifically configured to:
[0099] Determine the second horizontal distance according to the horizontal change angle, the first distance and the focal length, where the second horizontal distance is the horizontal distance of the focus of the eye relative to the screen of the display 10;
[0100] The second vertical distance is determined according to the first vertical distance and preset parameters, where the second vertical distance is the vertical distance of the focus of the eye relative to the screen of the display 10.
[0101] In one embodiment, the processor 30 is specifically configured to:
[0102] Obtaining the first focusing area according to the second horizontal distance, the first horizontal distance, the second vertical distance and the first vertical distance, where the first focusing area is the focusing area of the eye;
[0103] The first focus area is mapped to the screen of the display 10 according to the size of the display 10 to obtain the focus area.
[0104] In one embodiment, the acquisition device 40 is integrated with a distance sensor, and the processor 30 is specifically used for:
[0105] Acquire a first distance collected by the distance sensor;
[0106] The face image collected by the collection device 40 is acquired, and the change angle and the focal length are obtained based on the face image detection.
[0107] In one embodiment, the processor 30 is specifically configured to configure the size and resolution of the image in the encoder 20 according to the size and resolution of the image in the display 10 .
[0108] The processor in the region-of-interest based image coding system provided in the embodiment of the present application can execute the embodiment of the region-of-interest based image coding method in the above-mentioned image, and its implementation principle and technical effect are similar, which will not be elaborated here.
[0109] The specific definition of the image coding system based on the region of interest can be found in the definition of the image coding method based on the region of interest above, which will not be repeated here. The processor in the above-mentioned image coding system based on the region of interest can be embedded in or independent of the electronic device.
[0110] The executor of the region of interest-based image encoding method provided in the embodiment of the present application may be a processor, which may be embedded in an electronic device, which may be a computer device, a terminal device, a server or a server cluster, and the embodiment of the present application does not specifically limit this.
[0111] Figure 6 This is a schematic diagram of the internal structure of an electronic device provided in an embodiment of the present application. Figure 6 As shown, the electronic device includes a processor and a memory connected via a system bus. The processor is used to provide computing and control capabilities. The memory may include a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The computer program can be executed by the processor to implement the steps of the image encoding method based on the region of interest provided in each of the above embodiments. The internal memory provides a cache operating environment for the operating system and the computer program in the non-volatile storage medium.
[0112] Those skilled in the art will understand that Figure 6 The internal structure diagram of the electronic device shown in the figure is only a block diagram of a partial structure related to the scheme of the present application, and does not constitute a limitation on the electronic device to which the scheme of the present application is applied. The specific electronic device may include more or fewer components than shown in the figure, or combine certain components, or have a different arrangement of components.
[0113] In another embodiment of the present application, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps of the image encoding method based on the region of interest in the embodiment of the present application are implemented.
[0114] In another embodiment of the present application, a computer program product is provided. The computer program product includes computer instructions. When the computer instructions execute the various steps of the image encoding method based on the region of interest in the method flow shown in the above method embodiment,
[0115] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using a software program, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loading and executing computer execution instructions on a computer, the process or function according to the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. Computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, computer instructions can be transmitted from a website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (digital subscriber line, DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server, data center, etc. that contains one or more servers that can be integrated with a medium. The available medium may be a magnetic medium (eg, a floppy disk, a hard disk, a magnetic tape), an optical medium (eg, a DVD), or a semiconductor medium (eg, a solid state disk (SSD)).
[0116] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0117] The above embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the invention patent. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the patent of the present application shall be subject to the attached claims.
Claims
1. A method for image coding based on a region of interest, characterized in that: Applied to an image coding system based on a region of interest, the system includes a display, a collection device is arranged on the display, and the method includes: Acquire a first distance, a change angle, and a focal length of an eye in a face in real time, wherein the first distance is the distance between the face and the display, and the change angle is the change angle of the focus of the eye relative to the acquisition device; Determine a focus area of the eye in a current frame image in the display according to the first distance, the change angle, the focal length, and a preset display size; The focus area is sent to an encoder, so that the encoder encodes the current frame image by taking the focus area as a region of interest.
2. The method according to claim 1, characterized in that The step of determining a focus area of an eye in a current frame image of the display according to the first distance, the change angle, the focal length, and a preset display size includes: Determine a first position according to the change angle and the first distance, where the first position is the position of the focus of the eye relative to the acquisition device; Determine a second position according to the change angle, the first distance and the focal length, where the second position is the position of the focus of the eye relative to the display; The focus area is determined according to the first position, the second position, the display size and the focal length.
3. The method according to claim 2, characterized in that The change angle includes a horizontal change angle and a vertical change angle, the first position includes a first horizontal distance and a first vertical distance, and determining the first position according to the change angle and the first distance includes: Determine a first horizontal distance according to the horizontal change angle and the first distance, wherein the first horizontal position is the distance in the horizontal direction between the focus of the eye and the acquisition device; A second vertical distance is determined according to the vertical change angle and the first distance, where the second vertical distance is the distance in the vertical direction between the focus of the eye and the acquisition device.
4. The method according to claim 3, characterized in that The second position includes a second horizontal distance and a second vertical distance, and determining the second position according to the change angle, the first distance and the focal length includes: Determine the second horizontal distance according to the horizontal change angle, the first distance and the focal length, where the second horizontal distance is the horizontal distance of the focus of the eye relative to the display screen; The second vertical distance is determined according to the first vertical distance and preset parameters, where the second vertical distance is the vertical distance of the focus of the eye relative to the display screen.
5. The method according to claim 4, characterized in that The determining the focus area according to the first position, the second position, the display size and the focal length includes: Obtaining the first focusing area according to the second horizontal distance, the first horizontal distance, the second vertical distance and the first vertical distance, where the first focusing area is the focusing area of the eye; The first focus area is mapped to a screen of the display according to the size of the display to obtain the focus area.
6. The method according to claim 1, characterized in that The acquisition device is integrated with a distance sensor, and the real-time acquisition of the first distance, the change angle, and the focal length of the eyes in the face includes: Acquire a first distance collected by the distance sensor; The face image collected by the collection device is acquired, and the change angle and the focal length are obtained based on the face image detection.
7. The method according to claim 1, characterized in that Before acquiring the first distance, the change angle, and the focal length of the eyes in the face in real time, the method further includes: The size and resolution of the image in the encoder are configured according to the size and resolution of the image in the display.
8. An image coding system based on a region of interest, characterized in that: The system comprises: a display, an encoder, a processor and a collection device arranged on the display; The processor is used to: acquire a first distance, a change angle, and a focal length of an eye in a face in real time, wherein the first distance is the distance between the face and the display, and the change angle is a change angle of the focus of the eye relative to the acquisition device; determine a focal area of the eye in a current frame image in the display according to the first distance, the change angle, the focal length, and a preset display size; and send the focal area to an encoder; The encoder is used to encode the current frame image by taking the focus area as the region of interest.
9. The system according to claim 8, characterized in that The processor is specifically used for: Determine a first position according to the change angle and the first distance, where the first position is the position of the focus of the eye relative to the acquisition device; Determine a second position according to the change angle, the first distance and the focal length, where the second position is the position of the focus of the eye relative to the display; The focus area is determined according to the first position, the second position, the display size and the focal length.
10. The system according to claim 9, characterized in that The processor is specifically used for: Determine a first horizontal distance according to the horizontal change angle and the first distance, wherein the first horizontal position is the distance in the horizontal direction between the focus of the eye and the acquisition device; A second vertical distance is determined according to the vertical change angle and the first distance, where the second vertical distance is the distance in the vertical direction between the focus of the eye and the acquisition device.