Image smoothing method and apparatus for close-up picture, and device and storage medium

Abstract

The present application relates to the technical field of display devices. Provided are an image smoothing method and apparatus for a close-up picture, and a device and a storage medium. The solution comprises: acquiring a display picture collected by means of a conference tablet, and a first pixel position of an existing close-up picture, wherein the existing close-up picture is used for tracking a target person, and the existing close-up picture corresponds to a cropping frame; on the basis of the display picture, determining a target person area corresponding to the target person, and a second pixel position of the target person area in the display picture; on the basis of the first pixel position and the second pixel position, performing calculation to obtain a third pixel position that meets a pixel alignment limitation condition; on the basis of the third pixel position, moving the cropping frame, so as to obtain a moved cropping frame; on the basis of the moved cropping frame, performing cropping in the display picture to obtain a target close-up picture that includes the target person area; and controlling the conference tablet to display the target close-up picture. The solution can ensure that no picture jitter occurs when a cropping frame moves along with a target human image, such that picture movement can be smoother.

Description

Close-up image smoothing method, device, equipment and storage medium

[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office on October 25, 2023, with application number 202311390600.9 and invention name “Image smoothing method, device, equipment and storage medium for close-up images”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the technical field of display devices, for example, to a method, apparatus, device and storage medium for smoothing close-up images. Background Art

[0003] During a video conference, the conference tablet can close up the speaker's image, display the speaker's close-up image separately, and track the speaker through the close-up image as the speaker moves to ensure that the speaker always appears in the close-up image.

[0004] When displaying a close-up of the speaker, due to pixel alignment limitations in the conference tablet's hardware, the movement between the close-up and the speaker may be uneven in speed, resulting in inconsistent display and jitter.

[0005] Summary of the Invention

[0006] One purpose of the embodiments of the present application is to provide a close-up image smoothing method, device, equipment and storage medium, which is used to solve the technical problem that when close-up images are displayed in a video conference, the close-up images are used to track the conference participants, and the images are not coherent, resulting in jittery display images.

[0007] In a first aspect, an embodiment of the present application provides a method for smoothing a close-up image, comprising:

[0008] Obtaining the first pixel position of the display image and the existing close-up image captured by the conference tablet, wherein the existing close-up image is used to track the target person and the existing close-up image corresponds to the capture frame;

[0009] Determining a target person area corresponding to the target person and a second pixel position of the target person area on the display screen according to the display screen;

[0010] Calculating a third pixel position that satisfies a pixel alignment constraint condition based on the first pixel position and the second pixel position;

[0011] moving the capture frame according to the third pixel position to obtain a moved capture frame;

[0012] intercepting a target close-up image containing the target person area in the display image according to the moved interception frame;

[0013] Control the conference tablet to display the target close-up image.

[0014] In combination with the first aspect, in a possible implementation method, calculating the third pixel position that meets the pixel alignment restriction condition based on the first pixel position and the second pixel position includes: calculating the movement speed based on the first pixel position and the second pixel position; obtaining a preset pixel alignment restriction value; and calculating the third pixel position that meets the pixel alignment restriction condition based on the movement speed, the first pixel position, and the preset pixel alignment restriction value.

[0015] In combination with the first aspect, in a possible implementation, the display screen is configured with a coordinate system, the first pixel position includes a first horizontal coordinate and a first vertical coordinate, the third pixel position includes a second horizontal coordinate and a second vertical coordinate, and the calculation of the third pixel position that meets the pixel alignment restriction condition based on the moving speed, the first pixel position and the preset pixel alignment limit value includes: determining the horizontal speed of the moving speed in the x-axis direction and the vertical speed in the y-axis direction of the coordinate system; calculating the second horizontal coordinate that meets the pixel alignment restriction condition based on the horizontal speed, the first horizontal coordinate and the preset pixel alignment restriction value; calculating the second vertical coordinate that meets the pixel alignment restriction condition based on the vertical speed, the first vertical coordinate and the preset pixel alignment restriction value.

[0016] In combination with the first aspect, in a possible implementation method, calculating the second horizontal coordinate that meets the pixel alignment restriction condition based on the horizontal speed, the first horizontal coordinate and the preset pixel alignment restriction value includes: calculating the sum of the horizontal speed and the first horizontal coordinate to obtain a candidate horizontal coordinate; determining the horizontal coordinate that is closest to the candidate horizontal coordinate and is an integer multiple of the preset pixel alignment restriction value as the second horizontal coordinate.

[0017] In combination with the first aspect, in a possible implementation method, determining the horizontal coordinate that is closest to the candidate horizontal coordinate and is an integer multiple of the preset pixel alignment limit value as the second horizontal coordinate includes: if the decimal value of the candidate horizontal coordinate is less than 0.5, then selecting a horizontal coordinate that is smaller than the candidate horizontal coordinate, closest to the candidate horizontal coordinate, and is an integer multiple of the preset pixel alignment limit value as the second horizontal coordinate; if the decimal value of the candidate horizontal coordinate is greater than or equal to 0.5 and less than 1, then selecting a horizontal coordinate that is larger than the candidate horizontal coordinate, closest to the candidate horizontal coordinate, and is an integer multiple of the preset pixel alignment limit value as the second horizontal coordinate.

[0018] In combination with the first aspect, in a possible implementation, before calculating the candidate horizontal coordinate, it also includes: determining whether the horizontal speed is less than the preset pixel alignment limit value; if less than, setting the value of the second horizontal coordinate to the value of the first horizontal coordinate; if greater than or equal to, calculating the sum of the horizontal speed and the first horizontal coordinate to obtain the candidate horizontal coordinate.

[0019] In combination with the first aspect, in a possible implementation method, calculating the second vertical coordinate that meets the pixel alignment restriction condition based on the longitudinal speed, the first vertical coordinate and the preset pixel alignment restriction value includes: rounding the longitudinal speed according to the preset pixel alignment restriction value to obtain an integer reference speed, and the reference speed is an integer multiple of the preset pixel alignment restriction value; calculating the sum of the reference speed and the first vertical coordinate to obtain the second vertical coordinate.

[0020] In combination with the first aspect, in a possible implementation, the rounding operation is performed on the longitudinal speed according to the preset pixel alignment limit value to obtain an integer reference speed, including: if the decimal value of the longitudinal speed is less than 0.5, then a speed that is smaller than the longitudinal speed, closest to the longitudinal speed, and is an integer multiple of the preset pixel alignment limit value is selected as the reference speed; if the decimal value of the longitudinal speed is greater than or equal to 0.5 and less than 1, then a speed that is larger than the longitudinal speed, closest to the longitudinal speed, and is an integer multiple of the preset pixel alignment limit value is selected as the reference speed.

[0021] In a second aspect, an embodiment of the present application provides an image smoothing device for a close-up image, comprising:

[0022] An acquisition unit, configured to acquire a first pixel position of a display image and an existing close-up image captured by the conference tablet, wherein the existing close-up image is used to track a target person and the existing close-up image corresponds to a capture frame;

[0023] A determining unit, configured to determine, based on the display image, a target person area corresponding to the target person and a second pixel position of the target person area on the display image;

[0024] a calculation unit, configured to calculate a third pixel position satisfying a pixel alignment constraint condition based on the first pixel position and the second pixel position;

[0025] a moving unit, configured to move the capture frame according to the third pixel position to obtain a moved capture frame;

[0026] A capture unit, configured to capture a target close-up image containing the target person area in the display image according to the moved capture frame;

[0027] The display unit is used to control the conference tablet to display the target close-up image.

[0028] In a third aspect, an embodiment of the present application provides a conference tablet, including:

[0029] A camera is used to capture and display images;

[0030] Microphone array, used to collect voice information;

[0031] Memory;

[0032] A processor is communicatively connected to the camera, the microphone array and the memory, respectively, wherein the processor is used to execute one or more computer programs stored in the memory, and when the processor executes the one or more computer programs, the electronic device implements the method described in the first aspect.

[0033] In a fourth aspect, a computer device is provided, comprising a memory and one or more processors, wherein the memory is connected to the one or more processors, and the one or more processors are used to execute one or more computer programs stored in the memory. When the one or more processors execute the one or more computer programs, the computer device implements the method described in the first aspect above.

[0034] In a fifth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, wherein the computer program includes program instructions, and when the program instructions are executed by a processor, the processor executes the method as described in the first aspect.

[0035] In the scheme implemented by the above-mentioned close-up image smoothing method, device, equipment, and storage medium, the first pixel position of the display image and the existing close-up image captured by the conference tablet is first obtained. The existing close-up image is used to track the target person, and the existing close-up image corresponds to the capture frame. Secondly, the target person area corresponding to the target person and the second pixel position of the target person area on the display image are determined based on the display image. Then, based on the first pixel position and the second pixel position, a third pixel position that meets the pixel alignment constraint condition is calculated. The capture frame is moved according to the third pixel position to obtain the moved capture frame. Finally, based on the moved capture frame, a target close-up image containing the target person area is captured in the display image, and the conference tablet is controlled to display the target close-up image. This scheme calculates the third pixel position that meets the pixel alignment constraint condition through the first pixel position of the close-up image and the second pixel position of the target person, so that the capture frame corresponding to the close-up image continuously approaches the target person in focus when tracking the target person. In this process, the close-up image is ensured to be displayed continuously during tracking, thereby ensuring image stability, reducing image jitter, and providing a better visual experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following is a brief introduction to the drawings required for use in the description of the embodiments of the present application. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0037] FIG1A is a hardware architecture diagram of a conference tablet in one embodiment of the present application;

[0038] FIG1B is a module diagram of a conference tablet in one embodiment of the present application;

[0039] FIG1C is a scene diagram of a conference tablet in one embodiment of the present application;

[0040] FIG2 is a flow chart of a method for smoothing a close-up image in accordance with an embodiment of the present application;

[0041] FIG3A is a schematic diagram of a focus point of a capture frame in one embodiment of the present application;

[0042] FIG3B is a schematic diagram of a coordinate system for display screen configuration in one embodiment of the present application;

[0043] FIG3C is a schematic diagram of reference points in a target person area according to an embodiment of the present application;

[0044] FIG3D is a schematic diagram of a coordinate system for display screen configuration in one embodiment of the present application;

[0045] FIG3E is a schematic diagram of a pixel movement according to an embodiment of the present application;

[0046] FIG4 is a schematic structural diagram of an image smoothing device for close-up images according to an embodiment of the present application;

[0047] FIG5 is a schematic structural diagram of an electronic device in an embodiment of the present application. DETAILED DESCRIPTION

[0048] In order to make the purpose, technical solutions and advantages of this application more clearly understood, the present application is further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are only used to explain this application and are not intended to limit this application. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0049] It should be noted that, if there is no conflict, the various features in the embodiments of the present application can be combined with each other and are all within the scope of protection of the present application. In addition, although the functional modules are divided in the device schematic and the logical order is shown in the flow chart, in some cases, the steps shown or described can be performed in a different order than the module division in the device or the order in the flow chart. Furthermore, the words "first", "second", "third", etc. used in this application do not limit the data and execution order, but only distinguish between the same items or similar items with basically the same functions and effects.

[0050] The technical solution of this application can be applied to various conference scenarios, such as remote conferences.

[0051] The technical solution of the present application can be applied to conference tablets, wherein the conference tablet can be a tablet device with multifunctional imaging functions such as display, broadcasting, and recording, for example, a television screen, a display, and an electronic whiteboard. For ease of understanding, the conference tablet of the present application is first introduced.

[0052] Referring to FIG1A , FIG1A is a schematic diagram of the hardware structure of a conference tablet provided in an embodiment of the present application. As shown in FIG1A , the conference tablet 10 includes a display panel 101, a microphone array 102, a camera module 103, a processor 104, and a memory 105. The display panel 101 is used to display the video stream image captured by the conference tablet and the close-up image captured by the capture frame; the microphone array 102 is used to locate the sound source information in the scene and calculate the sound source orientation angle. The layout of the microphone array 102 can be a linear array, a planar array, or a stereo array; the camera module 103 includes at least one camera, which is mainly used to obtain scene images or video streams. It can be a fixed-focus camera, a zoom camera, or a combination of the two; the processor 104 and the memory 105 are devices for storing and processing various sensor signals, such as processing audio information collected by the microphone array 102, or processing video information collected by the camera.

[0053] 1B , the conference tablet 10 includes four major functional modules: an image and video input module for obtaining image or video data input by a camera; a speed calculation module for calculating the current image movement speed according to the current display state; an original coordinate processing module for calculating the new original coordinates after superimposing the current original coordinates according to the image movement speed; a pixel alignment processing module for calculating the actual coordinates after processing according to the original coordinate information and pixel alignment requirements; and an image and video cropping module for cropping the corresponding image or video according to the calculated actual coordinates, and outputting a cropped close-up picture.

[0054] As shown in Figure 1C, the screen displayed on the display panel of the conference tablet shown in Figure 1C. For example, in a remote meeting, the display screen of the conference tablet is shown as A in Figure 1C. The content in the dotted box in A can be the content of the PowerPoint presentation or other meeting materials. In A, area a is the independent display area for participants A, B, and C. Area B shows an enlarged image of area a. Area C is the specific image of person C obtained by cutting out the person in area a when person C is selected as the target person to speak. Area D is the final display effect of the specific image of area C presented on the display screen of the conference tablet.

[0055] In view of this, the present application proposes a method for smoothing close-up images to solve the above technical problems, which is described below.

[0056] Please refer to FIG2 , which is a flow chart of a method for smoothing a close-up image provided by an embodiment of the present application. The method includes the following steps:

[0057] S10: Acquire the first pixel position of the display image and the existing close-up image captured by the conference tablet, where the existing close-up image is used to track the target person and the existing close-up image corresponds to a capture frame.

[0058] Among them, the displayed screen is the real-time scene captured by the conference tablet.

[0059] The conference tablet may be equipped with a camera module, and the display image is captured by controlling the camera module. The size of the capture area corresponding to the display image is set according to the capture range of the camera module itself.

[0060] Alternatively, the above-mentioned conference tablet can be connected to an external camera device, and the external camera receives the control instructions of the conference tablet to collect the current space. The camera device can communicate with the conference tablet to transmit audio and video. The above-mentioned external camera device needs to cover the area where the conference tablet is located. The external camera device can be placed above the spatial area where the conference tablet is located or on both sides parallel to the conference tablet, etc. There is no sole limitation on the above-mentioned external camera here.

[0061] The above-mentioned close-up picture is a picture containing the target person area displayed on the conference tablet, and has been displayed through the display panel.

[0062] Among them, the above-mentioned first pixel position is the focus point position of the capture frame corresponding to the close-up image, and the steps for obtaining the focus point are: obtaining the midpoint of the horizontal line of the capture frame and the third line perpendicular to the horizontal line, and determining the intersection of the midpoint of the horizontal point and the third line as the focus point. The position of the focus point is the position of the first pixel, which can be shown in Figure 3A.

[0063] Among them, the first pixel position includes a first horizontal coordinate and a first vertical coordinate, and the first horizontal coordinate and the first vertical coordinate can be obtained through the coordinate system configured by the display screen. The configuration of the display coordinate system usually follows the standard screen or image coordinate system. The following are examples of common display coordinate configuration methods. The first is the upper left corner origin coordinate system, and the coordinate origin is located in the upper left corner of the display screen. The horizontal coordinate (X-axis) usually increases from left to right, and the vertical coordinate (Y-axis) increases from top to bottom. Under this coordinate, the first horizontal coordinate of the first pixel position represents the horizontal position of the pixel from the left boundary, and the first vertical coordinate represents the vertical position of the pixel from the upper boundary; the second is the lower left corner origin coordinate system, and the coordinate origin is located in the lower left corner of the display screen. The horizontal coordinate (X-axis) increases from left to right, and the vertical coordinate (Y-axis) increases from bottom to top. Under this coordinate system, the first horizontal coordinate of the first pixel position represents the horizontal position of the pixel from the left boundary, and the first vertical coordinate represents the vertical position of the pixel from the bottom boundary. The third type is the center origin coordinate system. Some applications use a coordinate system with the center of the display screen as the origin. Under this coordinate system, the positive direction of the horizontal and vertical coordinates is usually relative to the center of the screen, with negative values ​​on the left and top, and positive values ​​on the right and bottom.

[0064] For example, referring to FIG3B , FIG3B is a schematic diagram of a coordinate system for display screen configuration, with the upper left corner of the display screen as the coordinate origin, establishing a Y-axis with a vertically downward positive direction and an X-axis with a rightward positive direction, wherein area A is the display screen and area B is a specific screen, and the current first pixel position can be obtained as (X1, Y1).

[0065] Among them, the screenshot corresponding to the above close-up picture can automatically track the target person, and finally make the target person appear in focus. The screenshot is the area set for framing the target person area in the conference tablet, and the steps for framing the target person are not limited here.

[0066] It can be seen that by obtaining the existing close-up images and the corresponding screenshots, the target person can be tracked. The acquisition of the first pixel position can be used to stabilize the display image, reduce image jitter and unnecessary movement, and make the meeting image smoother and easier to watch.

[0067] S20 , determining a target person area corresponding to the target person and a second pixel position of the target person area on the display screen according to the display screen.

[0068] The target person area is any person area in the display screen. The target person area must include the complete person area of ​​each person, and other people except the target person may also exist in the area.

[0069] The target person area may include the target person or other objects or people other than the target person. Such irrelevant people may be processed by Gaussian blurring or virtualization.

[0070] For example, as shown in FIG1C , person C is identified as speaking in area a, person C is selected as the target person, and the area corresponding to C is framed.

[0071] Among them, the above-mentioned second pixel position is the reference point position corresponding to the moving position of the target person before the close-up picture is displayed. The reference point can be obtained through the following steps: generate a face recognition frame of the target person area, obtain the midpoint of the horizontal line of the face recognition frame and the three-point line perpendicular to the horizontal line, and determine the intersection of the midpoint of the horizontal point and the three-point line as the reference point. The position of the reference point is the second pixel position, and you can refer to Figure 3C.

[0072] In the coordinate system described in step 10, as shown in FIG3D , the second pixel position (X2, Y2) may be as shown in the figure.

[0073] It can be seen that this solution can automatically adjust the camera focal length and viewing angle according to the position of the target person to ensure that the target person appears in focus, reducing the need to manually adjust the camera. In one embodiment, obtaining the second pixel position can achieve real-time dynamic tracking of the target person. No matter how the target person moves or changes position, the target person's position information can be updated in time to ensure that he or she is visible in the picture.

[0074] S30: Calculate a third pixel position that meets a pixel alignment constraint condition based on the first pixel position and the second pixel position.

[0075] The third pixel position is the pixel movement position of the close-up image at the time of the i+1 movement corresponding to the i+1-th pixel movement of the capture frame that meets the pixel alignment restriction condition during the i-th movement.

[0076] For example, the existing close-up shot is the i-1th close-up shot. Assuming that the coordinates of the focus point of the i-1th close-up shot are (Xi-1, Yi-1), at this time the person moves, and the coordinates (Xi, Yi) of the i-th close-up shot are calculated based on the movement speed v1 of the first frame, and then the i-th close-up shot is output. At this time, the target person area of ​​the i-th close-up shot has not yet appeared in the focus point; then, the conference tablet calculates the coordinates (Xi+1, Yi+1) of the i+1th close-up shot based on the movement speed v2 of the second frame, and then outputs the i+1th close-up shot. At this time, the target person area of ​​the i+1th close-up shot still has not appeared in the focus point. The conference tablet calculates the coordinates (Xi+2, Yi+2) of the i+2th close-up shot based on the movement speed v3 of the third frame, and then outputs the i+2th close-up shot. At this time, the target person area of ​​the i+2th close-up shot appears in the focus point. At the same time, since d=0, the moving speed v4=0, and this embodiment does not move the capture frame to capture the close-up picture.

[0077] Among them, the above-mentioned pixel alignment constraint is a constraint in image processing or moving operations, which requires that image elements or objects be aligned or adjusted in units of pixels when moving, scaling or resizing to maintain the overall stability and consistency of the image. This alignment is based on the discrete nature of pixels, where each pixel represents a point or color value in the image. The pixel alignment constraint conditions usually include the following aspects: position alignment, size alignment, rotation alignment, pixel grid alignment, etc. In this solution, the preset pixel alignment constraint value corresponding to the pixel alignment constraint condition can be set to 2, and the pixels are rounded down to the maximum integer multiple of 2. The pixel alignment constraint value is not uniquely limited here. The pixel alignment constraint value may depend on many factors, including image processing requirements, application design, and image processing tasks.

[0078] For example, given the coordinates of the first pixel position (X1, Y1) and the coordinates of the second pixel position (X2, Y2), the movement vector (ΔX, ΔY) from the first pixel position to the second pixel position is calculated, where ΔX = X2-X1, ΔY = Y2-Y1, and the preset pixel alignment limit value that meets the pixel alignment limit condition is obtained, which can be calculated by the formula: X3 = X1+round(ΔX / pixel alignment limit value)*pixel alignment limit value, Y3 = Y1+round(ΔY / pixel alignment limit value)*pixel alignment limit value, where the round() function is used to round the calculation result to the nearest integer multiple of the pixel alignment limit value, thereby obtaining the third pixel position (X3, Y3) that meets the pixel alignment limit condition.

[0079] It can be seen that this step ensures that the third pixel position meets the pixel alignment constraint condition, thereby achieving smooth movement and adjustment of the image, reducing jitter and irregular movement, and improving image quality and stability.

[0080] S40: Move the capture frame according to the third pixel position to obtain a moved capture frame.

[0081] Among them, the above-mentioned moved screenshot frame is a relative concept. For the screenshot frame presented on the conference tablet, it will not move in position, nor will it jump from a fixed display area to another area; but for the target person that the screenshot frame needs to capture, it is not a fixed position. The screenshot frame will track the target person according to the moving speed, that is, the area size of the screenshot frame remains unchanged, but the content of the screenshot frame will chase the target person and move dynamically to ensure that the screenshot frame can completely capture the target person area.

[0082] Optionally, moving the capture frame according to the third pixel position to obtain the moved capture frame includes: determining four vertex coordinates according to the third pixel position, and moving the capture frame according to the four vertex coordinates to obtain the moved capture frame.

[0083] In determining the coordinates of the four vertices based on the third pixel position, the steps are as follows: based on the information of the first pixel position and the second pixel position, the coordinates of the center point of the interception frame are determined, and the coordinates of the center point will be used as the center point of the interception frame. Then, the width and height of the interception frame are calculated. Generally, the width and height can be determined by the distance from the first pixel position to the third pixel position, and are calculated using the following formula: width (w) = x coordinate of the third pixel position - x coordinate of the first pixel position; height (h) = y coordinate of the third pixel position - y coordinate of the first pixel position ; In one embodiment, the vertex coordinates can be calculated by the following formula: upper left corner vertex coordinates: (center point x-width / 2, center point y-height / 2); upper right corner vertex coordinates: (center point x+width / 2, center point y-height / 2); lower left corner vertex coordinates: (center point x-width / 2, center point y+height / 2); lower right corner vertex coordinates: (center point x+width / 2, center point y+height / 2), and the four vertex coordinates of the screenshot frame are calculated based on the coordinates of the third pixel position, thereby moving the screenshot frame and obtaining the moved screenshot frame.

[0084] It can be seen that by moving the capture frame to the third pixel position that meets the pixel alignment constraint condition, the smoothness of the image can be ensured.

[0085] S50 , capturing a target close-up image including the target person area in the display image according to the moved capture frame.

[0086] For example, in a remote meeting, the conference tablet only displays the screen in the left image of Figure 3A, the screenshot is the border of the right image, and the target close-up screen is the right image in Figure 3A.

[0087] S60: Control the conference tablet to display the target close-up image.

[0088] The close-up image may be an image including the target person area, or an image containing only the target person area.

[0089] The conference tablet may partially display a close-up image in a specific area or may display a close-up image entirely on the display panel of the conference tablet, which is not a sole limitation.

[0090] For example, if the conference tablet displays a close-up image in a specific area, the specific area can be displayed according to area D in Figure 1C.

[0091] In the related art, at a specific speed, the image movement is not coherent over time and there are pauses. As shown in Figure 3E, it can be seen that when the image wants to move to the right at a speed of 3 pixels per frame, the coordinates of the intermediate process are not integer multiples of 2. At this time, it is necessary to force alignment to an integer multiple of 2. In the first movement, the coordinates that should have been (123, 40) were forced to be aligned to (122, 40). In the second movement, the expected coordinates (126, 40) meet the alignment and the coordinates are retained. Then the actual speed during the first movement is 2 pixels / frame, and the actual speed during the second movement is 4 pixels / frame. The speed goes back and forth between 2 and 4, and the movement will cause the picture to shake due to uneven speed.

[0092] This solution calculates the third pixel position that meets the pixel alignment constraints through the first pixel position of the close-up image and the second pixel position of the target person, so that the corresponding capture frame of the close-up image continuously approaches the target person when tracking the target person, and in this process ensures that the close-up image is displayed coherently during tracking, thereby ensuring image stability, reducing image jitter, and providing a better visual experience.

[0093] In one embodiment, calculating the third pixel position that satisfies the pixel alignment restriction condition based on the first pixel position and the second pixel position includes: calculating a moving speed based on the first pixel position and the second pixel position; obtaining a preset pixel alignment restriction value; and calculating the third pixel position that satisfies the pixel alignment restriction condition based on the moving speed, the first pixel position, and the preset pixel alignment restriction value.

[0094] The above-mentioned moving speed is the moving speed of the capture frame relative to the target person. By moving the capture frame according to the moving speed, the purpose of tracking the target person can be achieved.

[0095] The above movement speed can be divided into speed components in the horizontal and vertical directions. The horizontal speed component (Vx) = (x coordinate of the second pixel position - x coordinate of the first pixel position) / time interval; the vertical speed component (Vy) = (y coordinate of the second pixel position - y coordinate of the first pixel position) / time interval, where the time interval is the time it takes to move between the two pixel positions.

[0096] For example, the moving speed can be calculated according to the first pixel position (X1, Y1) and the second pixel position (X2, Y2), where the horizontal speed = X2-X1 and the vertical speed = Y2-Y1.

[0097] The preset pixel alignment limit is a parameter set based on user needs or conference tablet settings that determines the alignment rules for pixel positions. For example, a preset pixel alignment limit of 2 indicates that the system expects pixels to move at most 2 pixels at a time. The choice of the preset pixel alignment limit depends on the specific application scenario and requirements. It controls the granularity of pixel alignment, thereby affecting the smoothness and stability of the image.

[0098] Among them, the x coordinate of the third pixel position = the x coordinate of the first pixel position + (horizontal velocity component * preset pixel alignment limit value); the y coordinate of the third pixel position = the y coordinate of the first pixel position + (vertical velocity component * preset pixel alignment limit value).

[0099] It can be seen that by calculating the difference between the first pixel position and the second pixel position, the movement direction and speed of the target object can be accurately determined. By obtaining the preset pixel alignment limit value, the pixel alignment behavior of the image can be adjusted according to needs, ensuring that the image can be adjusted according to the specified pixel alignment rules when moving, avoiding image jitter or irregular movement.

[0100] In one embodiment, the display screen is configured with a coordinate system, the first pixel position includes a first horizontal coordinate and a first vertical coordinate, the third pixel position includes a second horizontal coordinate and a second vertical coordinate, and the calculation of the third pixel position that meets the pixel alignment restriction condition based on the moving speed, the first pixel position and the preset pixel alignment restriction value includes: determining the horizontal speed of the moving speed in the x-axis direction and the vertical speed in the y-axis direction of the coordinate system; calculating the second horizontal coordinate that meets the pixel alignment restriction condition based on the horizontal speed, the first horizontal coordinate and the preset pixel alignment restriction value; calculating the second vertical coordinate that meets the pixel alignment restriction condition based on the vertical speed, the first vertical coordinate and the preset pixel alignment restriction value.

[0101] The display screen is configured with a coordinate system, and the description of the coordinate system in step 10 may be referred to, which will not be repeated here.

[0102] The second horizontal coordinate = the first horizontal coordinate + (horizontal speed * preset pixel alignment limit value); the second vertical coordinate = the first vertical coordinate + (vertical speed * preset pixel alignment limit value).

[0103] It can be seen that the movement speed, the first pixel position and the preset pixel alignment limit value are used to ensure that the pixel alignment conditions are met. During the tracking process, the position of the capture frame is adjusted based on the relative movement between the close-up image and the face recognition frame to achieve the pixel alignment effect.

[0104] In one embodiment, calculating the second horizontal coordinate that meets the pixel alignment restriction condition based on the horizontal speed, the first horizontal coordinate and the preset pixel alignment restriction value includes: calculating the sum of the horizontal speed and the first horizontal coordinate to obtain a candidate horizontal coordinate; determining the horizontal coordinate that is closest to the candidate horizontal coordinate and is an integer multiple of the preset pixel alignment restriction value as the second horizontal coordinate.

[0105] The candidate abscissa represents the next abscissa position estimated based on the speed.

[0106] For example, the horizontal speed = 4.5 pixels / frame; the first horizontal coordinate = 23.8 pixels;

[0107] The preset pixel alignment limit value = 10 pixels; the candidate horizontal coordinate = the horizontal velocity + the first horizontal coordinate, i.e., 4.5 + 23.8 = 28.3 pixels. When determining the second horizontal coordinate that is closest to and satisfies the pixel alignment limit condition, in this case, the horizontal coordinate that is closest to and satisfies the pixel alignment limit condition is 30 pixels, because it is an integer multiple of the candidate horizontal coordinate 28.3 pixels and is an integer multiple of the preset pixel alignment limit value of 10 pixels. Therefore, based on the horizontal velocity, the first horizontal coordinate, and the preset pixel alignment limit value, the second horizontal coordinate that satisfies the pixel alignment limit condition is calculated to be 30 pixels.

[0108] It can be seen that by calculating the candidate horizontal coordinate of the sum of the horizontal velocity and the first horizontal coordinate, the next horizontal coordinate position estimated according to the velocity is reflected, ensuring the alignment of the new position with the current pixel. Among all possible horizontal coordinates, the one closest to the candidate horizontal coordinate is selected, and the horizontal coordinate meets the pixel alignment restriction condition, that is, it is an integer multiple of the preset pixel alignment restriction value, ensuring that the selected second horizontal coordinate meets the pixel alignment requirements.

[0109] In one embodiment, determining the horizontal coordinate that is closest to the candidate horizontal coordinate and is an integer multiple of the preset pixel alignment limit value as the second horizontal coordinate includes: if the decimal value of the candidate horizontal coordinate is less than 0.5, selecting a horizontal coordinate that is smaller than the candidate horizontal coordinate, closest to the candidate horizontal coordinate, and is an integer multiple of the preset pixel alignment limit value as the second horizontal coordinate; if the decimal value of the candidate horizontal coordinate is greater than or equal to 0.5 and less than 1, selecting a horizontal coordinate that is larger than the candidate horizontal coordinate, closest to the candidate horizontal coordinate, and is an integer multiple of the preset pixel alignment limit value as the second horizontal coordinate.

[0110] Among them, if the decimal value of the candidate horizontal coordinate is less than 0.5, then the horizontal coordinate that is smaller than the candidate horizontal coordinate, closest to the candidate horizontal coordinate, and is an integer multiple of the preset pixel alignment limit value is selected as the second horizontal coordinate. Assume the following values: horizontal speed = 6 pixels / second, first horizontal coordinate = 28 pixels, preset pixel alignment limit value = 10 pixels. Candidate horizontal coordinate = first horizontal coordinate + horizontal speed = 28 pixels + 6 pixels / second = 34 pixels; the decimal part of the candidate horizontal coordinate is 0.4 (less than 0.5); since the decimal value is less than 0.5, we should select a horizontal coordinate that is smaller than the candidate horizontal coordinate and is an integer multiple of the preset pixel alignment limit value; the preset pixel alignment limit value is 10 pixels, so we need to select an integer that is closest to 34 pixels and is an integer multiple of 10, so that the second horizontal coordinate that meets the pixel alignment limit condition is 30 pixels.

[0111] Among them, if the decimal value of the candidate horizontal coordinate is greater than or equal to 0.5 and less than 1, the horizontal coordinate that is larger than the candidate horizontal coordinate, closest to the candidate horizontal coordinate, and is an integer multiple of the preset pixel alignment limit value is selected as the second horizontal coordinate. Assume the following values: horizontal speed = 8 pixels / second, first horizontal coordinate = 45 pixels, preset pixel alignment limit value = 12 pixels. Candidate horizontal coordinate = first horizontal coordinate + horizontal speed = 45 pixels + 8 pixels / second = 53 pixels; since the decimal part of the candidate horizontal coordinate is 0.125 (greater than or equal to 0.5 but less than 1), a horizontal coordinate that is larger than the candidate horizontal coordinate and is an integer multiple of the preset pixel alignment limit value is selected. The preset pixel alignment limit value is 12 pixels, so we need to select an integer that is closest to 53 pixels and is an integer multiple of 12. The second horizontal coordinate that meets the pixel alignment limit condition is 60 pixels.

[0112] It can be seen that, on the one hand, when the decimal value of the candidate horizontal coordinate is less than 0.5, it means that it is closer to the previous integer pixel. By selecting a horizontal coordinate that is smaller than the candidate horizontal coordinate, the closest distance, and an integer multiple of the preset pixel alignment limit value, it is ensured that the second horizontal coordinate is closer to the previous integer pixel than the candidate horizontal coordinate, which helps to maintain the alignment of the image; on the other hand, when the decimal value of the candidate horizontal coordinate is greater than or equal to 0.5 and less than 1, it means that it is closer to the next integer pixel. By selecting a horizontal coordinate that is larger than the candidate horizontal coordinate, the closest distance, and an integer multiple of the preset pixel alignment limit value, it is ensured that the second horizontal coordinate is closer to the next integer pixel than the candidate horizontal coordinate, which helps to maintain the alignment of the image.

[0113] In one embodiment, before calculating the candidate horizontal coordinate, the method further includes: determining whether the horizontal speed is less than the preset pixel alignment limit value; if less than, setting the value of the second horizontal coordinate to the value of the first horizontal coordinate; if greater than or equal to, calculating the sum of the horizontal speed and the first horizontal coordinate to obtain the candidate horizontal coordinate.

[0114] When the horizontal speed is less than the preset pixel alignment limit, it indicates that the horizontal speed is too slow to cross an integer pixel unit. In this case, the value of the second horizontal coordinate is set to the same value as the first horizontal coordinate. Due to the pixel alignment requirement, it is impossible to move to the next integer pixel position, so the current pixel position must be maintained.

[0115] When the horizontal speed is greater than or equal to the preset pixel alignment limit, it indicates that the horizontal speed is fast enough to cross one or more integer pixel units. In this case, the sum of the horizontal speed and the first horizontal coordinate is calculated to obtain the candidate horizontal coordinate, ensuring that the pixel alignment requirements can be met without misalignment even when the speed is fast.

[0116] It can be seen that this step ensures that the second horizontal coordinate finally obtained can meet the pixel alignment constraint condition regardless of the speed.

[0117] In one embodiment, calculating the second vertical coordinate that meets the pixel alignment restriction condition based on the vertical speed, the first vertical coordinate and the preset pixel alignment restriction value includes: rounding the vertical speed according to the preset pixel alignment restriction value to obtain an integer reference speed, and the reference speed is an integer multiple of the preset pixel alignment restriction value; calculating the sum of the reference speed and the first vertical coordinate to obtain the second vertical coordinate.

[0118] The longitudinal velocity is used to describe the value of the moving speed in the vertical direction.

[0119] The vertical speed is rounded to the integer of the preset pixel alignment limit, constraining the vertical speed to an integer multiple of the pixel alignment limit. For example, if the preset pixel alignment limit is 2 pixels and the calculated speed is 3.5 pixels per frame, the rounding operation constrains it to 4 pixels per frame.

[0120] It can be seen that by ensuring pixel alignment in the longitudinal direction through this step, the stability and accuracy of movement can be improved.

[0121] In one embodiment, the rounding operation is performed on the longitudinal speed according to the preset pixel alignment limit value to obtain an integer reference speed, including: if the decimal value of the longitudinal speed is less than 0.5, then a speed that is smaller than the longitudinal speed, has the closest numerical distance to the longitudinal speed, and is an integer multiple of the preset pixel alignment limit value is selected as the reference speed; if the decimal value of the longitudinal speed is greater than or equal to 0.5 and less than 1, then a speed that is larger than the longitudinal speed, has the closest numerical distance to the longitudinal speed, and is an integer multiple of the preset pixel alignment limit value is selected as the reference speed.

[0122] If the decimal value of the vertical velocity is less than 0.5, the speed smaller than the vertical velocity, closest to the vertical velocity, and an integer multiple of the preset pixel alignment limit is selected as the reference speed. For example: the first vertical coordinate is 85 pixels; the vertical velocity is 2.3 pixels / frame; the preset pixel alignment limit is 4 pixels; the decimal portion of the vertical velocity is 0.3, which is less than 0.5. Therefore, we will select a speed smaller than 2.3 pixels / frame and an integer multiple of 4 pixels. The closest speed that meets the requirements is 0 pixels / frame, because the integer multiple of 0 and 4 is 0. Therefore, the reference speed is 0 pixels / frame, and the second vertical coordinate = 85 pixels + 0 pixels / frame = 85 pixels, which meets the pixel alignment limit.

[0123] If the decimal value of the longitudinal velocity is greater than or equal to 0.5 and less than 1, a speed that is greater than the longitudinal velocity, closest to the longitudinal velocity, and an integer multiple of the preset pixel alignment limit is selected as the reference speed. For example: the first vertical coordinate is 125 pixels; the longitudinal velocity is 3.7 pixels / frame; and the preset pixel alignment limit is 5 pixels. The decimal portion of the longitudinal velocity is 0.7, which is greater than or equal to 0.5 and less than 1. Therefore, we will select a speed that is greater than 3.7 pixels / frame and an integer multiple of 5 pixels. The closest speed that meets the conditions is 5 pixels / frame, because 5 is an integer multiple of 5. Therefore, the reference speed is 5 pixels / frame, and the second vertical coordinate = 125 pixels + 5 pixels / frame = 130 pixels.

[0124] It can be seen that by rounding the longitudinal speed, the reference speed is ensured to be an integer, which makes it easier to perform pixel alignment when calculating the second longitudinal coordinate. By selecting the closest integer speed, the error introduced by the speed calculation and rounding operation is reduced, thereby improving the accuracy of pixel alignment.

[0125] Based on the above steps, we can give an example: Assume that the preset pixel alignment limit is 2, that is, the coordinates must be integer multiples of 2. The initial coordinates (x, y) are (100, 100), and the speed is calculated to obtain the current speed V on the x-axis. fx is 7.3, and the moving speed V on the y-axis fy On the x-axis, according to X i-1 , that is, X i-1 =100, plus the current speed V fx Record the latest X f The coordinate is 107.3, and after aligning downwards, we get X i = 106. On the y-axis, the actual instantaneous speed 4.2 is taken down to the maximum integer multiple of 2, which is 4. Then V y The speed of downward movement is 4, and the Y-axis coordinate Y of the next step is obtained. i is 104. The coordinates of the first step are (106,104).

[0126] Repeat the above steps. If the speed is calculated to get the current speed V on the x-axis fx is 5.8, the moving speed on the y-axis is V fy On the x-axis, according to the recorded coordinate X i-1 is 107.3, plus the instantaneous speed V fx , get the latest X f The coordinate is 113.1, and after aligning downwards, we get X i is 112. On the y-axis, i-1 The actual instantaneous speed 2.4 is rounded down to the maximum integer multiple of 2, which is 2. Then Vy The speed of downward movement is 2, and the Y-axis coordinate Y of the next step is obtained. i is 106. The coordinates of the second step are (112,106). If you need to continue processing the image, repeat the above steps. For example, when the speed is calculated to get a new V fx 5.8 and V fy When it is 2.4, the coordinate positions on the X-axis and Y-axis are repeatedly calculated and the coordinates are updated in sequence.

[0127] In summary, this section describes an algorithm or method that processes image coordinates according to pixel alignment (align=2), ensuring they are always integer multiples of 2, and updates the coordinate positions based on calculated velocity information, thereby achieving image smoothing. This processing method can be used on devices such as conference tablets to improve image or video display quality.

[0128] The method of the present application is introduced above, and the device of the present application is introduced below.

[0129] See Figure 4, which is a schematic diagram of the structure of a close-up image smoothing device provided in an embodiment of the present application. As shown in Figure 4, the close-up image smoothing device includes:

[0130] An acquisition unit 401 is configured to acquire a first pixel position of a display image and an existing close-up image captured by the conference tablet, wherein the existing close-up image is used to track a target person and corresponds to a capture frame.

[0131] A determining unit 402 is configured to determine, based on the display image, a target person area corresponding to the target person and a second pixel position of the target person area on the display image;

[0132] A calculation unit 403 is configured to calculate a third pixel position that satisfies a pixel alignment constraint condition based on the first pixel position and the second pixel position;

[0133] A moving unit 404 is configured to move the capture frame according to the third pixel position to obtain a moved capture frame;

[0134] A capture unit 405 is configured to capture a target close-up image containing the target person area in the display image according to the moved capture frame;

[0135] The display unit 406 is used to control the conference tablet to display the target close-up image.

[0136] In one embodiment, in the calculation of the third pixel position that meets the pixel alignment restriction condition based on the first pixel position and the second pixel position, the calculation unit 403 is further used to: calculate the movement speed based on the first pixel position and the second pixel position; obtain a preset pixel alignment restriction value; and calculate the third pixel position that meets the pixel alignment restriction condition based on the movement speed, the first pixel position, and the preset pixel alignment restriction value.

[0137] In one embodiment, the display screen is configured with a coordinate system, the first pixel position includes a first horizontal coordinate and a first vertical coordinate, the third pixel position includes a second horizontal coordinate and a second vertical coordinate, and in the calculation of the third pixel position that meets the pixel alignment restriction condition based on the moving speed, the first pixel position and the preset pixel alignment restriction value, the calculation unit 403 is further used to: determine the horizontal speed of the moving speed in the x-axis direction and the vertical speed in the y-axis direction of the coordinate system; calculate the second horizontal coordinate that meets the pixel alignment restriction condition based on the horizontal speed, the first horizontal coordinate and the preset pixel alignment restriction value; calculate the second vertical coordinate that meets the pixel alignment restriction condition based on the vertical speed, the first vertical coordinate and the preset pixel alignment restriction value.

[0138] In one embodiment, in the calculation of the second horizontal coordinate that meets the pixel alignment restriction condition based on the horizontal speed, the first horizontal coordinate and the preset pixel alignment restriction value, the calculation unit 403 is further used to: calculate the sum of the horizontal speed and the first horizontal coordinate to obtain a candidate horizontal coordinate; and determine the horizontal coordinate that is closest to the candidate horizontal coordinate and is an integer multiple of the preset pixel alignment restriction value as the second horizontal coordinate.

[0139] In one embodiment, in determining the horizontal coordinate that is closest to the candidate horizontal coordinate and is an integer multiple of the preset pixel alignment limit value as the second horizontal coordinate, the calculation unit 403 is further used to: include: if the decimal value of the candidate horizontal coordinate is less than 0.5, then select a horizontal coordinate that is smaller than the candidate horizontal coordinate, closest to the candidate horizontal coordinate, and is an integer multiple of the preset pixel alignment limit value as the second horizontal coordinate; if the decimal value of the candidate horizontal coordinate is greater than or equal to 0.5 and less than 1, then select a horizontal coordinate that is larger than the candidate horizontal coordinate, closest to the candidate horizontal coordinate, and is an integer multiple of the preset pixel alignment limit value as the second horizontal coordinate.

[0140] In one embodiment, before calculating the candidate horizontal coordinate, the calculation unit 403 is further used to: determine whether the horizontal speed is less than the preset pixel alignment limit value; if less than, set the value of the second horizontal coordinate to the value of the first horizontal coordinate; if greater than or equal to, calculate the sum of the horizontal speed and the first horizontal coordinate to obtain the candidate horizontal coordinate.

[0141] In one embodiment, in the calculation of the second vertical coordinate that meets the pixel alignment restriction condition based on the vertical speed, the first vertical coordinate and the preset pixel alignment restriction value, the calculation unit 403 is further used to: round the vertical speed according to the preset pixel alignment restriction value to obtain an integer reference speed, and the reference speed is an integer multiple of the preset pixel alignment restriction value; calculate the sum of the reference speed and the first vertical coordinate to obtain the second vertical coordinate.

[0142] In one embodiment, in the rounding operation of the longitudinal speed according to the preset pixel alignment limit value to obtain an integer reference speed, the calculation unit 403 is further used to: if the decimal value of the longitudinal speed is less than 0.5, select a speed that is smaller than the longitudinal speed, closest to the longitudinal speed, and is an integer multiple of the preset pixel alignment limit value as the reference speed; if the decimal value of the longitudinal speed is greater than or equal to 0.5 and less than 1, select a speed that is larger than the longitudinal speed, closest to the longitudinal speed, and is an integer multiple of the preset pixel alignment limit value as the reference speed.

[0143] This solution calculates the third pixel position that meets the pixel alignment constraints through the first pixel position of the close-up image and the second pixel position of the target person, so that the corresponding capture frame of the close-up image continuously approaches the target person when tracking the target person, and in this process ensures that the close-up image is displayed coherently during tracking, thereby ensuring image stability, reducing image jitter, and providing a better visual experience.

[0144] 5 , which is a schematic diagram of the structure of a computer device provided in an embodiment of the present application. As shown in FIG5 , the computer device 50 includes a processor 501 and a memory 502. The memory 502 is connected to the processor 501, for example, via a bus.

[0145] The processor 501 is configured to support the computer device 50 in executing the corresponding functions of the method in the above method embodiment. The processor 501 can be a central processing unit (CPU), a network processor (NP), a hardware chip, or any combination thereof. The above hardware chip can be an application specific integrated circuit (ASIC), a programmable logic device (PLD), or a combination thereof. The above PLD can be a complex programmable logic device (CPLD), a field-programmable gate array (FPGA), a generic array logic (GAL), or any combination thereof.

[0146] In one embodiment, the processor 501 may include a sending card, a receiving card, and a driver chip.

[0147] Memory 502 is used to store program code, etc. Memory 502 may include volatile memory (VM), such as random access memory (RAM); non-volatile memory (NVM), such as read-only memory (ROM), flash memory, hard disk drive (HDD), or solid-state drive (SSD); or a combination of the aforementioned types of memory.

[0148] The processor 501 may call the program code to perform the following operations:

[0149] Obtaining the first pixel position of the display image and the existing close-up image captured by the conference tablet, wherein the existing close-up image is used to track the target person and the existing close-up image corresponds to the capture frame;

[0150] Determining a target person area corresponding to the target person and a second pixel position of the target person area on the display screen according to the display screen;

[0151] Calculating a third pixel position that satisfies a pixel alignment constraint condition based on the first pixel position and the second pixel position;

[0152] moving the capture frame according to the third pixel position to obtain a moved capture frame;

[0153] intercepting a target close-up image containing the target person area in the display image according to the moved interception frame;

[0154] Control the conference tablet to display the target close-up image.

[0155] An embodiment of the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, wherein the computer program includes program instructions, and when the program instructions are executed by a computer, the computer executes the method as described in the above embodiment.

[0156] Those skilled in the art will appreciate that all or part of the processes in the above-described method embodiments can be implemented by instructing related hardware through a computer program. The program can be stored in a computer-readable storage medium, and when executed, the program can include the processes in the above-described method embodiments. The storage medium can be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).

[0157] The above disclosures are merely some embodiments of the present application and are certainly not intended to limit the scope of the present application. Therefore, equivalent changes made according to the claims of the present application are still within the scope covered by the present application.

Claims

1. A close-up image smoothing method, applied to a conference tablet, wherein: include: Acquire the first pixel position of the display image and the existing close-up image captured by the conference tablet, wherein the existing close-up image is used to track the target person, and the existing close-up image corresponds to the capture frame; Determine, according to the display picture, a target person area corresponding to the target person and a second pixel position of the target person area in the display picture; Calculating a third pixel position satisfying a pixel alignment constraint condition according to the first pixel position and the second pixel position; Moving the capture frame according to the third pixel position to obtain a moved capture frame; intercepting a target close-up image including the target person area in the display image according to the moved interception frame; Control the conference tablet to display the target close-up image.

2. The method according to claim 1, wherein: The calculating, according to the first pixel position and the second pixel position, a third pixel position satisfying the pixel alignment restriction condition comprises: Calculating a moving speed according to the first pixel position and the second pixel position; Get the preset pixel alignment limit value; A third pixel position satisfying a pixel alignment restriction condition is calculated according to the moving speed, the first pixel position and the preset pixel alignment restriction value.

3. The method according to claim 2, wherein: The display screen is configured with a coordinate system, the first pixel position includes a first horizontal coordinate and a first vertical coordinate, the third pixel position includes a second horizontal coordinate and a second vertical coordinate, and the calculating the third pixel position satisfying the pixel alignment restriction condition according to the moving speed, the first pixel position and the preset pixel alignment restriction value includes: Determine the lateral speed of the moving speed in the x-axis direction and the longitudinal speed in the y-axis direction of the coordinate system; Calculating a second horizontal coordinate satisfying a pixel alignment restriction condition according to the horizontal speed, the first horizontal coordinate and the preset pixel alignment restriction value; A second vertical coordinate satisfying a pixel alignment restriction condition is calculated according to the vertical speed, the first vertical coordinate and the preset pixel alignment restriction value.

4. The method according to claim 3, wherein: The calculating, according to the horizontal speed, the first horizontal coordinate and the preset pixel alignment restriction value, a second horizontal coordinate satisfying a pixel alignment restriction condition comprises: Calculating the sum of the lateral velocity and the first horizontal coordinate to obtain a candidate horizontal coordinate; The horizontal coordinate that is closest to the candidate horizontal coordinate and is an integer multiple of the preset pixel alignment limit value is determined as the second horizontal coordinate.

5. The method according to claim 4, wherein: The step of determining the abscissa that is closest to the candidate abscissa and is an integer multiple of the preset pixel alignment limit value as the second abscissa comprises: If the decimal value of the candidate horizontal coordinate is less than 0.5, a horizontal coordinate that is smaller than the candidate horizontal coordinate, closest to the candidate horizontal coordinate, and is an integer multiple of the preset pixel alignment limit value is selected as the second horizontal coordinate; If the decimal value of the candidate horizontal coordinate is greater than or equal to 0.5 and less than 1, a horizontal coordinate that is larger than the candidate horizontal coordinate, closest to the candidate horizontal coordinate, and is an integer multiple of the preset pixel alignment limit value is selected as the second horizontal coordinate.

6. The method according to claim 4, wherein: Before calculating the candidate horizontal coordinates, the method further includes: Determining whether the lateral speed is less than the preset pixel alignment limit value; If it is less than, setting the value of the second horizontal coordinate to the value of the first horizontal coordinate; If it is greater than or equal to, then the sum of the lateral velocity and the first horizontal coordinate is calculated to obtain a candidate horizontal coordinate.

7. The method according to claim 3, wherein: The calculating, according to the longitudinal speed, the first longitudinal coordinate and the preset pixel alignment restriction value, a second longitudinal coordinate satisfying a pixel alignment restriction condition comprises: According to the preset pixel alignment limit value, the longitudinal speed is rounded to obtain an integer reference speed, where the reference speed is an integer multiple of the preset pixel alignment limit value; The sum of the reference speed and the first ordinate is calculated to obtain a second ordinate.

8. The method according to claim 7, wherein: The rounding operation of the longitudinal speed according to the preset pixel alignment limit value to obtain an integer reference speed includes: If the decimal value of the longitudinal speed is less than 0.5, a speed that is smaller than the longitudinal speed, closest to the longitudinal speed and an integer multiple of the preset pixel alignment limit value is selected as the reference speed; If the decimal value of the longitudinal speed is greater than or equal to 0.5 and less than 1, a speed that is greater than the longitudinal speed, closest to the longitudinal speed, and is an integer multiple of the preset pixel alignment limit value is selected as the reference speed.

9. A computer-readable storage medium, wherein: The computer-readable storage medium stores a computer program, wherein the computer program includes program instructions, and when the program instructions are executed by a processor, the processor executes the image smoothing method for a close-up picture according to any one of claims 1 to 8.

10. A conference tablet, wherein: include: A camera, used to collect and display images; Microphone array, used to collect voice information; Memory; A processor is communicatively connected to the camera, the microphone array and the memory, respectively, wherein the processor is used to execute one or more computer programs stored in the memory, and when the processor executes the one or more computer programs, the electronic device implements the image smoothing method for close-up images as described in any one of claims 1-8.

Images