Image annotation method, device, electronic device and storage medium

Abstract

The embodiments of the present application provide an image annotation method, device, electronic device and storage medium, which relate to the field of machine vision technology. In the image annotation interface of the machine vision task, the image to be annotated is displayed, and the region of interest of the image to be annotated includes a preset number of sliding windows; in response to the attribute adjustment operation issued by the user for the sliding window, the attributes of the sliding window are adjusted; in response to the sliding window confirmation operation, the area included in each sliding window is used as the detection area. When performing image annotation, the region of interest of the image to be annotated displayed in the image annotation interface includes a preset number of sliding windows, and the user can issue an attribute adjustment operation for the sliding window through the image annotation interface. The user can adjust the sliding window attributes based on the existing preset number of sliding windows without having to manually annotate the detection area where each target to be detected in the image to be annotated is located, which can improve the efficiency of image annotation in the machine vision task and reduce labor costs.

Description

Technical Field

[0001] The present application relates to the field of machine vision technology, and in particular to an image annotation method, device, electronic device, and storage medium. Background Art

[0002] Before training deep learning models for machine vision tasks like defect detection and category recognition, image datasets need to be annotated. For each image in the dataset, the detection area where the target to be detected is located needs to be annotated.

[0003] In the current related technology, the detection area where each target to be detected is located in each image included in the image data set is manually labeled in sequence. The efficiency of image labeling is low and it consumes a lot of manpower costs. Summary of the Invention

[0004] The purpose of the embodiments of the present application is to provide an image annotation method, apparatus, electronic device, and storage medium to improve the efficiency of image annotation in machine vision tasks and reduce the labor cost required for image annotation. The specific technical solution is as follows:

[0005] In a first aspect, an embodiment of the present application provides an image annotation method, the method comprising:

[0006] In an image annotation interface of a machine vision task, an image to be annotated is displayed, wherein a region of interest of the image to be annotated includes a preset number of sliding windows;

[0007] In response to a property adjustment operation issued by a user on the sliding window, adjusting the properties of the sliding window;

[0008] In response to a sliding window confirmation operation issued by the user, the area included in each sliding window in the current image annotation interface is used as the detection area of ​​the image to be annotated.

[0009] Optionally, the step of adjusting the properties of the sliding window in response to a property adjustment operation issued by the user on the sliding window includes:

[0010] In response to a user dragging operation on the sliding window, determining a location targeted by the dragging operation; adjusting properties of the sliding window based on the location targeted by the dragging operation; and / or,

[0011] In response to an adjustment operation issued by a user on a property adjustment control included in the image annotation interface, the property of the sliding window is adjusted based on the sliding window property value indicated by the adjusted adjustment control.

[0012] Optionally, the step of determining, in response to a drag operation initiated by a user on the sliding window, a position targeted by the drag operation; and adjusting properties of the sliding window based on the position targeted by the drag operation includes:

[0013] In response to a user dragging an edge of a selected target sliding window, following the dragging operation and adjusting the size of the target sliding window based on the direction of the dragging operation until the position where the dragging operation stops is within a preset drag limit range, or the position indicated by the dragging operation exceeds the preset drag limit range;

[0014] and / or,

[0015] In response to a drag operation initiated by a user on the interior of a selected target sliding window, the position of the target sliding window is adjusted based on the direction of the drag operation following the drag operation.

[0016] Optionally, before the step of responding to a drag operation initiated by the user on an edge of the selected target sliding window and adjusting the size of the target sliding window based on the direction of the drag operation, the method further includes:

[0017] In response to a cursor hovering over a window edge hot zone corresponding to a selected target window, the cursor is adjusted to a telescopic state, wherein the window edge hot zone is an area of ​​the edge of the target window that does not overlap with the border of the region of interest, and the telescopic state is used to prompt the user that the edge corresponding to the cursor can be dragged.

[0018] Optionally, in response to a user dragging an edge of a selected target sliding window, following the dragging operation and adjusting the size of the target sliding window based on a direction of the dragging operation until a position where the dragging operation stops is within a preset drag limit range, or a position indicated by the dragging operation exceeds the preset drag limit range, includes:

[0019] In response to a user dragging an edge of a selected target sliding window, following the dragging operation, adjusting the size of the target sliding window based on a direction of the dragging operation, and calculating a sliding window overlap ratio, wherein the sliding window overlap ratio is used to represent an overlapping area between the target sliding window and an adjacent sliding window;

[0020] When the sliding window overlap ratio of the target sliding window is within a preset overlap ratio range when the dragging operation stops, completing the resizing of the target sliding window;

[0021] When the sliding window overlap rate of the target sliding window exceeds the preset overlap rate range, the size of the target sliding window is adjusted to a size corresponding to a maximum value of the preset overlap rate range, thereby completing the size adjustment of the target sliding window. When the dragging operation causes the size of the target sliding window to increase, the maximum value of the preset overlap rate range is a maximum value; when the dragging operation causes the size of the target sliding window to decrease, the maximum value of the preset overlap rate range is a minimum value.

[0022] Optionally, the method further includes:

[0023] When the size of the target sliding window is adjusted based on the direction of the drag operation, the sizes of other sliding windows are adjusted in the same manner as that of the target sliding window.

[0024] Optionally, in response to an adjustment operation issued by a user on a property adjustment control included in the image annotation interface, the step of adjusting the property of the sliding window based on the sliding window property value indicated by the adjusted adjustment control includes:

[0025] In response to a quantity adjustment instruction issued by a user to a sliding window quantity adjustment control included in the image annotation interface, adjusting the number of sliding windows based on the adjusted number of sliding windows indicated by the sliding window quantity adjustment control; and / or,

[0026] In response to an overlap rate adjustment instruction issued by a user for a sliding window overlap rate adjustment control included in the image annotation interface, the size of the sliding window is adjusted based on the sliding window overlap rate indicated by the adjusted sliding window overlap rate adjustment control to complete the size adjustment of the sliding window.

[0027] Optionally, the sliding window overlap rate adjustment control includes a range adjustment component;

[0028] The step of adjusting the size of the sliding window based on the sliding window overlap ratio indicated by the adjusted sliding window overlap ratio adjustment control in response to an overlap ratio adjustment instruction issued by a user to a sliding window overlap ratio adjustment control included in the image annotation interface comprises:

[0029] In response to a drag operation issued by a user on the range adjustment component, following the drag operation, the sizes of the sliding windows are adjusted so that the sliding window overlap ratios of the respective sliding windows are the same as the sliding window overlap ratio corresponding to the drag operation on the range adjustment component.

[0030] Optionally, the sliding window quantity adjustment control includes a first sliding window quantity adjustment control and a second sliding window quantity adjustment control;

[0031] The step of adjusting the number of sliding windows based on the number of sliding windows indicated by the adjusted sliding window number adjustment control in response to a quantity adjustment instruction issued by a user to a sliding window quantity adjustment control included in the image annotation interface comprises:

[0032] In response to the user setting the number of horizontal sliding windows based on the first sliding window number adjustment control and the number of vertical sliding windows based on the second sliding window number adjustment control, displaying all selected sliding windows as unselected;

[0033] In the image annotation interface, the unselected sliding window is displayed according to a default arrangement;

[0034] According to the number of horizontal sliding windows and the number of vertical sliding windows, the number of sliding windows included in the image to be annotated is adjusted in the image annotation interface.

[0035] Optionally, after the step of adjusting the number of sliding windows based on the number of sliding windows indicated by the adjusted sliding window quantity adjustment control in response to a quantity adjustment instruction issued by the user to the sliding window quantity adjustment control included in the image annotation interface, the method further includes:

[0036] Based on the number of horizontal sliding windows and the number of vertical sliding windows, determining a sliding window located at a central position of the region of interest from the sliding windows included in the image to be annotated after the number of sliding windows is adjusted;

[0037] The determined sliding window is displayed as selected.

[0038] Optionally, the step of determining, based on the number of horizontal sliding windows and the number of vertical sliding windows, a sliding window located at a central position of the region of interest from among the sliding windows included in the image to be annotated after the number of sliding windows is adjusted, includes:

[0039] In response to the number of the horizontal sliding windows and the number of the vertical sliding windows being both odd numbers, determining a sliding window located at a center position of the region of interest from the sliding windows included in the image to be labeled after the number of sliding windows is adjusted;

[0040] In response to the number of the horizontal sliding windows and the number of the vertical sliding windows being both even numbers, determining a sliding window closest to the center position and located in a first direction from the sliding windows included in the image to be labeled after the number of sliding windows is adjusted;

[0041] In response to the number of the horizontal sliding windows being an odd number and the number of the vertical sliding windows being an even number, determining a sliding window closest to the center position and located in a second direction from the sliding windows included in the image to be labeled after the number of sliding windows is adjusted;

[0042] In response to the number of the horizontal sliding windows being an even number and the number of the vertical sliding windows being an odd number, a sliding window closest to the center position and located in the third direction is determined from the sliding windows included in the image to be labeled after the number of sliding windows is adjusted.

[0043] Optionally, after the step of displaying the image to be annotated in the image annotation interface of the machine vision task, the method further includes:

[0044] In response to a property adjustment operation issued by a user on the region of interest, the properties of the region of interest are adjusted.

[0045] Optionally, the step of adjusting the attributes of the region of interest in response to an attribute adjustment operation issued by the user on the region of interest includes at least one of the following:

[0046] In response to a user drag operation on a vertex or an edge of the region of interest, following the drag operation and adjusting a size of the region of interest based on a direction of the drag operation;

[0047] In response to a drag operation initiated by a user on the interior of the region of interest, adjusting a position of the region of interest following the drag operation;

[0048] In response to a user's dragging operation on a rotating hotspot displayed at a preset position of the region of interest, the angle of the region of interest is adjusted following the dragging operation.

[0049] Optionally, the method further includes:

[0050] During the process of adjusting the size of the sliding windows, overlapping areas between the sliding windows are highlighted;

[0051] After the sliding window size adjustment is completed, the overlapping area between the sliding windows is displayed in a non-highlighted state.

[0052] Optionally, the centers of the preset number of sliding windows are displayed with identification points, and the method further includes:

[0053] When adjusting the position or size of the sliding window, the center point of each sliding window is displayed based on the current position and size of each sliding window.

[0054] Optionally, the step of adjusting the properties of the sliding window in response to a property adjustment operation issued by the user on the sliding window includes:

[0055] In response to a property adjustment operation issued by a user on the sliding window, where a triggering position of the property adjustment operation is in an overlapping area of ​​multiple sliding windows, properties of a corresponding sliding window with the highest priority among the multiple sliding windows are adjusted.

[0056] In a second aspect, an embodiment of the present application provides an image annotation device, the device comprising:

[0057] An image display module, configured to display an image to be annotated in an image annotation interface of a machine vision task, wherein the region of interest of the image to be annotated includes a preset number of sliding windows;

[0058] a sliding window attribute adjustment module, configured to adjust the attributes of the sliding window in response to an attribute adjustment operation issued by a user on the sliding window;

[0059] The detection area confirmation module is configured to, in response to a sliding window confirmation operation issued by a user, use the area included in each sliding window in the current image annotation interface as the detection area of ​​the image to be annotated.

[0060] Optionally, the sliding window attribute adjustment module includes:

[0061] a first sliding window attribute adjustment submodule, configured to, in response to a drag operation initiated by a user on the sliding window, determine a position targeted by the drag operation; and adjust attributes of the sliding window based on the position targeted by the drag operation;

[0062] The second sliding window attribute adjustment submodule is configured to adjust the attribute of the sliding window based on the sliding window attribute value indicated by the adjusted adjustment control in response to an adjustment operation issued by a user on the attribute adjustment control included in the image annotation interface.

[0063] Optionally, the first sliding window attribute adjustment submodule includes:

[0064] a sliding window size adjustment unit, configured to, in response to a user dragging an edge of a selected target sliding window, follow the dragging operation and adjust the size of the target sliding window based on a direction of the dragging operation until a position where the dragging operation stops falls within a preset drag limit range, or a position indicated by the dragging operation exceeds the preset drag limit range;

[0065] The sliding window position adjusting unit is configured to respond to a drag operation initiated by a user on an interior of a selected target sliding window, follow the drag operation, and adjust the position of the target sliding window based on a direction of the drag operation.

[0066] Optionally, the device further includes:

[0067] The cursor display module is configured to adjust the cursor to a retractable state in response to a cursor hovering over a window edge hot zone corresponding to a selected target window, wherein the window edge hot zone is an area of ​​the target window edge that does not overlap with the border of the region of interest, and the retractable state is configured to prompt the user that the edge corresponding to the cursor is draggable.

[0068] Optionally, the sliding window size adjustment unit includes:

[0069] an overlap ratio calculation subunit, configured to, in response to a user dragging operation on an edge of a selected target sliding window, follow the dragging operation, adjust the size of the target sliding window based on a direction of the dragging operation, and calculate a sliding window overlap ratio, wherein the sliding window overlap ratio is used to represent an overlapping area between the target sliding window and an adjacent sliding window;

[0070] a first size adjustment subunit, configured to complete the size adjustment of the target sliding window if the sliding window overlap ratio of the target sliding window is within a preset overlap ratio range when the dragging operation stops;

[0071] The second size adjustment subunit is configured to adjust the size of the target sliding window to a size corresponding to a maximum value of the preset overlap rate range when the sliding window overlap rate of the target sliding window exceeds the preset overlap rate range, thereby completing the size adjustment of the target sliding window. When the dragging operation causes the size of the target sliding window to increase, the maximum value of the preset overlap rate range is the maximum value; and when the dragging operation causes the size of the target sliding window to decrease, the maximum value of the preset overlap rate range is the minimum value.

[0072] Optionally, the device further includes:

[0073] The synchronous adjustment module is configured to adjust the sizes of other sliding windows in the same manner as that of the target sliding window when adjusting the size of the target sliding window based on the direction of the drag operation.

[0074] Optionally, the second sliding window attribute adjustment submodule includes:

[0075] a quantity adjustment unit, configured to adjust the number of sliding windows based on the number of sliding windows indicated by the adjusted sliding window quantity adjustment control in response to a quantity adjustment instruction issued by a user to the sliding window quantity adjustment control included in the image annotation interface;

[0076] An overlap rate adjustment unit is configured to, in response to an overlap rate adjustment instruction issued by a user to a sliding window overlap rate adjustment control included in the image annotation interface, adjust the size of the sliding window based on the sliding window overlap rate indicated by the adjusted sliding window overlap rate adjustment control to complete the size adjustment of the sliding window.

[0077] Optionally, the sliding window overlap rate adjustment control includes a range adjustment component;

[0078] The overlap rate adjustment unit includes:

[0079] The overlap rate adjustment subunit is used to respond to a drag operation issued by the user on the range adjustment component, follow the drag operation, and adjust the size of the sliding window so that the sliding window overlap rate of each sliding window is the same as the sliding window overlap rate corresponding to the drag operation on the range adjustment component.

[0080] Optionally, the sliding window quantity adjustment control includes a first sliding window quantity adjustment control and a second sliding window quantity adjustment control;

[0081] The quantity adjustment unit includes:

[0082] a deselecting subunit, configured to display all selected sliding windows as unselected in response to the number of horizontal sliding windows set by the user based on the first sliding window number adjustment control and the number of vertical sliding windows set based on the second sliding window number adjustment control;

[0083] a sliding window display subunit, configured to display the unselected sliding windows in the image annotation interface according to a default arrangement;

[0084] The quantity adjustment subunit is configured to adjust the quantity of sliding windows included in the image to be annotated in the image annotation interface according to the quantity of the horizontal sliding windows and the quantity of the vertical sliding windows.

[0085] Optionally, the device further includes:

[0086] a sliding window determining module, configured to determine, based on the number of horizontal sliding windows and the number of vertical sliding windows, a sliding window located at a central position of the region of interest from among the sliding windows included in the image to be annotated after the number of sliding windows is adjusted;

[0087] The sliding window selection module is used to display the determined sliding window as a selected state.

[0088] Optionally, the sliding window determination module includes:

[0089] a first sliding window determination submodule, configured to, in response to the number of the horizontal sliding windows and the number of the vertical sliding windows being odd numbers, determine a sliding window located at a center position of the region of interest from the sliding windows included in the image to be annotated after the number of sliding windows is adjusted;

[0090] a second sliding window determination submodule configured to, in response to the number of the horizontal sliding windows and the number of the vertical sliding windows being an even number, determine a sliding window closest to the center position and located in a first direction from the sliding windows included in the image to be annotated after the number of sliding windows is adjusted;

[0091] a third sliding window determination submodule, configured to, in response to the number of the horizontal sliding windows being an odd number and the number of the vertical sliding windows being an even number, determine, from the sliding windows included in the image to be labeled after the number of sliding windows is adjusted, a sliding window that is closest to the center position and located in a second direction;

[0092] The fourth sliding window determination submodule is configured to determine, in response to the number of the horizontal sliding windows being an even number and the number of the vertical sliding windows being an odd number, a sliding window closest to the center position and located in a third direction from the sliding windows included in the image to be labeled after the number of sliding windows is adjusted.

[0093] Optionally, the device further includes:

[0094] The region of interest adjustment module is configured to adjust the attributes of the region of interest in response to an attribute adjustment operation issued by a user on the region of interest.

[0095] Optionally, the region of interest adjustment module includes:

[0096] a first region of interest adjustment submodule, configured to respond to a drag operation initiated by a user on a vertex or an edge of the region of interest, follow the drag operation, and adjust a size of the region of interest based on a direction of the drag operation;

[0097] a second region of interest adjustment submodule, configured to respond to a drag operation initiated by a user on the interior of the region of interest and adjust the position of the region of interest following the drag operation;

[0098] The third region of interest adjustment submodule is configured to respond to a drag operation initiated by a user on a rotating hotspot displayed at a preset position of the region of interest and adjust the angle of the region of interest following the drag operation.

[0099] Optionally, the device further includes:

[0100] a highlighting module, configured to highlight overlapping areas between the sliding windows during the process of adjusting the size of the sliding windows;

[0101] The non-highlighting display module is used to display the overlapping area between the sliding windows in a non-highlighting state after the sliding window size adjustment is completed.

[0102] Optionally, the centers of the preset number of sliding windows are displayed with identification points, and the device further includes:

[0103] The center point display module is used to display the center point of each sliding window based on the current position and size of each sliding window when the position or size of the sliding window is adjusted.

[0104] Optionally, the sliding window attribute adjustment module includes:

[0105] The sliding window attribute adjustment submodule is configured to, in response to an attribute adjustment operation issued by a user on the sliding window, wherein the triggering position of the attribute adjustment operation is in an overlapping area of ​​multiple sliding windows, adjust the attribute of the sliding window with the highest priority among the multiple sliding windows.

[0106] In a third aspect, an embodiment of the present application provides an electronic device, including:

[0107] Memory for storing computer programs;

[0108] The processor is configured to implement any of the methods described in the first aspect above when executing a program stored in the memory.

[0109] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, it implements any of the methods described in the first aspect above.

[0110] Beneficial effects of the embodiments of the present application:

[0111] In the solution provided by an embodiment of the present application, an electronic device can display an image to be annotated in an image annotation interface for a machine vision task, wherein the region of interest of the image to be annotated includes a preset number of sliding windows; in response to a user-initiated attribute adjustment operation on the sliding windows, the attributes of the sliding windows are adjusted; and in response to a user-initiated sliding window confirmation operation, the area included in each sliding window in the current image annotation interface is used as the detection area of ​​the image to be annotated. In the above process, when performing image annotation, the region of interest of the image to be annotated displayed in the image annotation interface includes the preset number of sliding windows. If the sliding window attributes need to be adjusted, the user can issue an attribute adjustment operation on the sliding window through the image annotation interface. In this way, the user can adjust the sliding window attributes based on the existing preset number of sliding windows, without having to manually annotate the detection area where each target to be detected in the image to be annotated is located. Therefore, the efficiency of image annotation in machine vision tasks can be improved and the labor cost required for image annotation can be reduced. Of course, implementing any product or method of the present application does not necessarily require achieving all of the advantages described above at the same time. BRIEF DESCRIPTION OF THE DRAWINGS

[0112] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other embodiments can also be obtained based on these drawings.

[0113] Figure 1 A flowchart of an image annotation method provided in an embodiment of the present application;

[0114] Figure 2 Based on Figure 1 A first schematic diagram of the image annotation interface of the illustrated embodiment;

[0115] Figure 3 (a) is based on Figure 1 A second schematic diagram of the image annotation interface of the illustrated embodiment;

[0116] Figure 3(b) is based on Figure 1 A third schematic diagram of the image annotation interface of the illustrated embodiment;

[0117] Figure 4 Based on Figure 1 A flow chart of a method for adjusting the size of a target sliding window according to the illustrated embodiment;

[0118] Figure 5 Based on Figure 1 A fourth schematic diagram of the image annotation interface of the illustrated embodiment;

[0119] Figure 6 Based on Figure 1 A flow chart of a method for adjusting the number of sliding windows in the illustrated embodiment;

[0120] Figure 7 Based on Figure 1 A flow chart of a sliding window determination method according to the illustrated embodiment;

[0121] Figure 8 Based on Figure 1 A flow chart of the overlapping area display method of the illustrated embodiment;

[0122] Figure 9 Based on Figure 1 A fifth schematic diagram of the image annotation interface of the illustrated embodiment;

[0123] Figure 10 Based on Figure 1 A flow chart of the image annotation method of the illustrated embodiment;

[0124] Figure 11 for Figure 10 A specific flow chart of step S1004 in the illustrated embodiment;

[0125] Figure 12 for Figure 10 A specific flow chart of step S1005 in the illustrated embodiment;

[0126] Figure 13 for Figure 10 Another specific flow chart of step S1005 in the illustrated embodiment;

[0127] Figure 14 A schematic diagram of the structure of an image annotation device provided in an embodiment of the present application;

[0128] Figure 15 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0129] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field based on this application are within the scope of protection of this application.

[0130] In order to improve the efficiency of image annotation in machine vision tasks and reduce the labor cost required for image annotation, the embodiments of the present application provide an image annotation method, apparatus, electronic device, computer-readable storage medium, and computer program product. The following first introduces an image annotation method provided by the embodiments of the present application.

[0131] The image annotation method provided in the embodiments of the present application can be applied to any electronic device that needs to determine the number of stacked items, for example, a desktop computer, a laptop computer, a tablet computer, etc., without specific limitation. For the sake of clarity, it will be referred to as an electronic device in this article.

[0132] like Figure 1 As shown, an image annotation method includes:

[0133] S101, displaying an image to be annotated in an image annotation interface of a machine vision task; in response to a user's attribute adjustment operation on the sliding window, executing step S102;

[0134] The region of interest of the image to be annotated includes a preset number of sliding windows.

[0135] S102, adjusting the properties of the sliding window; in response to the sliding window confirmation operation issued by the user, executing step S103;

[0136] S103: Using the area included in each sliding window in the current image annotation interface as the detection area of ​​the image to be annotated.

[0137] It can be seen that in the solution provided by the embodiment of the present application, the electronic device can display the image to be annotated in the image annotation interface of the machine vision task, wherein the region of interest of the image to be annotated includes a preset number of sliding windows; in response to the attribute adjustment operation issued by the user for the sliding window, the attributes of the sliding window are adjusted; in response to the sliding window confirmation operation issued by the user, the area included in each sliding window in the current image annotation interface is used as the detection area of ​​the image to be annotated. When performing image annotation, the region of interest of the image to be annotated displayed in the image annotation interface includes a preset number of sliding windows. If the sliding window attributes need to be adjusted, the user can issue an attribute adjustment operation for the sliding window through the image annotation interface. In this way, the user can adjust the sliding window attributes based on the existing preset number of sliding windows, without having to manually annotate the detection area where each target to be detected in the image to be annotated is located. Therefore, the efficiency of image annotation in machine vision tasks can be improved and the labor cost required for image annotation can be reduced.

[0138] In step S101, for an image annotation scenario in a machine vision task, the electronic device may display the image to be annotated in the image annotation interface of the machine vision task. The image annotation interface may be an interface for image annotation in software used to perform machine vision tasks. In one embodiment, since the target to be detected is usually located in the region of interest (ROI) of the image to be annotated, in order to facilitate image annotation by the user, the electronic device may extract the region of interest (ROI) of the image to be annotated. Next, the image to be annotated may be displayed in the image annotation interface of the machine vision task in a default display mode. The image to be annotated displayed in the default display mode may include a preset number of sliding windows.

[0139] The ROI can be an area in a machine vision task, outlined in a box, circle, ellipse, irregular polygon, or the like, within an image to be annotated. The sliding window can be used to divide the ROI into multiple areas arranged in a grid when multiple different objects to be detected exist within the ROI. Specifically, the ROI can be divided into multiple equally sized areas arranged in a grid.

[0140] The preset number can be set according to actual needs, for example, 4, 6, 9, etc., and is not specifically limited here. For example, assuming that the image to be annotated is displayed in the default display mode and the preset number is 9, then the region of interest of the displayed image to be annotated may include 9 sliding windows arranged in a nine-square grid.

[0141] The user can perform various interactive operations through the image annotation interface of the machine vision task to adjust the properties of the region of interest and the sliding window. When the user issues an attribute adjustment operation for the sliding window in the image annotation interface of the machine vision task, the electronic device can adjust the properties of the sliding window based on the attribute adjustment operation, that is, execute step S102.

[0142] The properties of the sliding window may include size, position, and number. For example, a user may drag the interior of the sliding window to adjust the position of the sliding window. For another example, a user may drag the edge of the sliding window to adjust the size of the sliding window.

[0143] As the user adjusts the properties of the sliding window, the image annotation interface of the machine vision task displays the adjusted sliding window in real time as the sliding window properties are adjusted, allowing the user to intuitively check whether the adjusted sliding window meets the image annotation requirements. If the adjusted sliding window meets the image annotation requirements, the user can issue a sliding window confirmation operation, and the electronic device will then use the area included in each sliding window in the current image annotation interface as the detection area of ​​the image to be annotated, thus executing step S103.

[0144] Among them, the above-mentioned sliding window confirmation operation can be issued by the user through the sliding window confirmation button in the image annotation interface of the machine vision task. The sliding window confirmation button can be located at the bottom, top, etc. of the image annotation interface of the machine vision task, and is not specifically limited here.

[0145] As can be seen, in the embodiment of the present application, when performing image annotation, the region of interest of the image to be annotated displayed in the image annotation interface of the machine vision task includes a preset number of sliding windows. If the sliding window properties need to be adjusted, the user can issue a property adjustment operation for the sliding window through the image annotation interface of the machine vision task. In this way, the user can adjust the sliding window properties based on the existing preset number of sliding windows, without having to manually annotate the detection area where each target to be detected in the image to be annotated is located. Therefore, the efficiency of image annotation in the machine vision task can be improved and the labor cost required for image annotation can be reduced.

[0146] As an implementation of an embodiment of the present application, the step of adjusting the properties of the sliding window in response to a property adjustment operation issued by the user on the sliding window may include:

[0147] In response to a user dragging operation on the sliding window, determining a location targeted by the dragging operation; adjusting properties of the sliding window based on the location targeted by the dragging operation; and / or, in response to a user adjusting operation on a property adjustment control included in the image annotation interface, adjusting properties of the sliding window based on a sliding window property value indicated by the adjusted adjustment control.

[0148] In the first embodiment, a drag operation at the edge of the sliding window changes the window's size, while a drag operation at the interior of the sliding window changes the window's position. Therefore, in order to determine which properties of the sliding window are being changed by the drag operation, the electronic device can determine the location of the drag operation in response to a user's drag operation on the sliding window. Subsequently, the properties of the sliding window are adjusted based on the location of the drag operation.

[0149] In a second embodiment, the image annotation interface may include a property adjustment control, through which the user can adjust the properties of the sliding window. For example, the property adjustment control may be an input box, increase or decrease buttons, a drag bar, etc. In response to the user's adjustment operation on the property adjustment control included in the image annotation interface, the electronic device may adjust the properties of the sliding window based on the sliding window property value indicated by the adjusted adjustment control.

[0150] For example, assuming that the property adjustment control includes a first sliding window number input box and a second sliding window number input box, the first sliding window number input box is used to input the number of horizontal sliding windows, and the second sliding window number input box is used to input the number of vertical sliding windows. The user enters 3 and 4 in the first sliding window number input box and the second sliding window number input box, respectively. Then, the electronic device can adjust the number of sliding windows based on the adjusted number of sliding windows, and the adjusted number of horizontal sliding windows is 3 and the number of vertical sliding windows is 4.

[0151] In a third embodiment, the user may issue a drag operation on the sliding window and an adjustment operation on the property adjustment control, that is, adjust the properties of the sliding window through the first embodiment and the second embodiment at the same time.

[0152] As can be seen, in embodiments of the present application, the electronic device can, in response to a user's drag operation on a sliding window, determine the location targeted by the drag operation; adjust the properties of the sliding window based on the location targeted by the drag operation; and / or, in response to a user's adjustment operation on a property adjustment control included in an image annotation interface, adjust the properties of the sliding window based on the sliding window property value indicated by the adjusted adjustment control. In this way, the user can adjust the sliding window properties by dragging the sliding window or by adjusting the property adjustment control. The user can adjust the sliding window properties in a custom manner, providing the user with a high degree of operational freedom.

[0153] As an implementation of an embodiment of the present application, the steps of determining, in response to a user dragging operation on the sliding window, a location targeted by the dragging operation; and adjusting the properties of the sliding window based on the location targeted by the dragging operation may include:

[0154] In response to a user dragging an edge of a selected target sliding window, following the dragging operation and adjusting the size of the target sliding window based on the direction of the dragging operation until the position where the dragging operation stops is within a preset drag limit range, or the position indicated by the dragging operation exceeds the preset drag limit range;

[0155] and / or,

[0156] In response to a drag operation initiated by a user on the interior of a selected target sliding window, the position of the target sliding window is adjusted based on the direction of the drag operation following the drag operation.

[0157] In the first embodiment, if the drag operation targets the edge of a window, this indicates that the user intends to adjust the size of the window by dragging the window edge. Therefore, in response to the user's drag operation on the edge of a selected target window, the electronic device can follow the drag operation and adjust the size of the target window based on the direction of the drag operation.

[0158] That is, the electronic device can adjust the size of the target window by moving the window edge targeted by the drag operation in the direction of the drag operation. For example, assuming that the window edge targeted by the drag operation is the right edge of the target window, and the drag operation is to the right, the electronic device can follow the drag operation and move the right edge of the target window to the right, thereby increasing the size of the target window.

[0159] The electronic device may stop adjusting the size of the target sliding window in the following two situations:

[0160] The first case is when the drag operation stops at a location within a preset drag limit. This means the user actively stops the drag operation, and the location where the drag operation stops is within the preset drag limit. The preset drag limit is used to limit the drag range of the drag operation, meaning that the drag operation cannot cause the target window to become too large.

[0161] The second case is that the position indicated by the drag operation exceeds the preset drag limit range. In this case, the drag operation will be restricted and stop at the maximum drag position corresponding to the preset drag limit range.

[0162] In a second embodiment, if the drag operation targets a location within a window, this indicates that the user intends to adjust the window's position by dragging within the window. Therefore, in response to a user dragging within a selected target window, the electronic device can follow the drag operation and adjust the position of the target window based on the direction of the drag operation. In this case, the position attributes of each window are independent, and changing the position of one window does not affect the positions of other windows.

[0163] For example, assuming that the position targeted by the drag operation is inside the target sliding window and the drag operation is to the right, the electronic device may follow the drag operation and move the position of the target sliding window to the right.

[0164] In a third embodiment, the user can adjust the size of the target sliding window by dragging the edge of the target sliding window, and adjust the position of the target sliding window by dragging the inside of the target sliding window. That is, the size and position of the target sliding window can be adjusted simultaneously through the first and second embodiments.

[0165] As can be seen, in embodiments of the present application, in response to a user dragging an edge of a selected target window, the electronic device can follow the dragging operation and, based on the direction of the dragging operation, adjust the size of the target window until the position where the dragging operation stops falls within a preset drag limit range, or the position indicated by the dragging operation exceeds the preset drag limit range. Furthermore, in response to a user dragging the interior of a selected target window, the electronic device can follow the dragging operation and adjust the position of the target window based on the direction of the dragging operation. In this way, the user can adjust the size of the target window by dragging the edge of the target window, and adjust the position of the target window by dragging the interior of the target window, enabling the user to easily adjust the size and position of the target window.

[0166] As an implementation of an embodiment of the present application, before the step of responding to a user dragging an edge of a selected target sliding window and adjusting the size of the target sliding window based on the direction of the dragging operation, the method may further include:

[0167] In response to the cursor hovering over a hot area on an edge of a sliding window corresponding to a selected target sliding window, the cursor is adjusted to a telescopic state.

[0168] When a user hovers a cursor over a hot zone on the edge of a target window, the electronic device can adjust the cursor to a retractable state to indicate to the user that the edge corresponding to the cursor is draggable. The retractable state can be a pre-set cursor, such as a two-way arrow. The hovering operation can include holding the cursor at a certain position for a preset duration, such as 1 second, 2 seconds, etc., which is not specifically limited here.

[0169] The window edge hotspot may be the area of ​​the target window edge that does not overlap with the border of the region of interest. This allows for a clear distinction between whether the user intends to resize the target window by dragging the target window edge or to resize the region of interest by dragging the border of the region of interest, if the target window edge and the region of interest border overlap.

[0170] For example, the first schematic diagram of the image annotation interface can be as follows Figure 2 As shown, the region of interest of the image to be annotated includes nine sliding windows arranged in a nine-square grid. Assuming the user hovers the cursor over the window edge hotspot 201 of the lower right window, the electronic device can adjust the cursor to a retractable state 202 in the form of a double arrow. The currently selected window is the lower right window, so the edge of the lower right window is highlighted. A draggable indicator 203 is also displayed on all four edges of the lower right window, except for the edge that coincides with the ROI border.

[0171] For another example, a second schematic diagram of an image annotation interface can be shown in Figure 3(a). The region of interest 302 of an image to be annotated 301 includes six sliding windows, and a cursor 303 is currently positioned within the sliding window in the first row and second column. When the user clicks on a sliding window with cursor 303, the window is selected and highlighted (not shown). Furthermore, a draggable indicator 304 is displayed on each of the four edges of the sliding window, except for the edge that coincides with the region of interest border.

[0172] Assuming the user adjusts the size of the sliding window, the image annotation interface may appear as shown in Figure 3(b), which is a third schematic diagram of the image annotation interface. In Figure 3(b), assuming the user hovers the cursor over a hot zone 305 at the edge of the sliding window, the electronic device may adjust the cursor to a retracted state 306 in the form of a double arrow.

[0173] As can be seen, in the embodiment of the present application, in response to the cursor hovering over the window edge hot zone corresponding to the selected target window, the electronic device can adjust the cursor to a telescopic state. The window edge hot zone is the area of ​​the target window edge that does not overlap with the border of the region of interest. The telescopic state is used to prompt the user that the edge corresponding to the cursor is draggable. This can intuitively prompt the user to adjust the size of the window by dragging the edge corresponding to the cursor, thereby improving the user experience.

[0174] As an implementation method of the present application, Figure 4 As shown, the step of responding to a user dragging an edge of a selected target sliding window, following the dragging operation and adjusting the size of the target sliding window based on the direction of the dragging operation until the position where the dragging operation stops is within a preset drag limit range, or the position indicated by the dragging operation exceeds the preset drag limit range, may include:

[0175] S401: In response to a user dragging an edge of a selected target sliding window, following the dragging operation, adjusting the size of the target sliding window based on the direction of the dragging operation, and calculating a sliding window overlap ratio in real time; if the sliding window overlap ratio of the target sliding window is within a preset overlap ratio range when the dragging operation stops, executing step S402; if the sliding window overlap ratio of the target sliding window exceeds the preset overlap ratio range, executing step S403;

[0176] When a user initiates a drag operation on the edge of a selected target window, the electronic device can follow the drag operation, adjust the size of the target window based on the direction of the drag operation, and calculate the window overlap ratio. The window overlap ratio can be used to represent the overlapping area between the target window and adjacent windows. In one embodiment, the window overlap ratio can be the ratio between the overlap area of ​​the target window and the recognition area, where the overlap area is the overlapping area between the target window and the adjacent window, and the recognition area is the actual detection area.

[0177] S402, completing the size adjustment of the target sliding window;

[0178] When the target sliding window overlap ratio is within the preset overlap ratio range when the dragging operation stops, it indicates that the dragging operation does not exceed the preset drag limit range, and the size adjustment of the target sliding window can be completed.

[0179] The preset overlap ratio range can be set based on actual needs. If the preset overlap ratio range is limited, if the real-time calculated window overlap ratio reaches the upper or lower limit of the preset overlap ratio range during the process of adjusting the size of the target window, the window size cannot be further expanded or reduced. For example, the preset overlap ratio range can be 0 to 1, indicating that adjacent windows can have at least no overlap and at most 100% overlap in the recognition area.

[0180] S403: Adjust the size of the target sliding window to a size corresponding to the maximum value of the preset overlap rate range, thereby completing the size adjustment of the target sliding window.

[0181] If the target window's window overlap ratio exceeds a preset overlap ratio range, indicating that the drag operation has exceeded the preset drag limit, the electronic device cannot continue to resize the target window. In this case, the electronic device can resize the target window to the maximum value of the preset overlap ratio range, completing the resizing of the target window.

[0182] When the dragging operation increases the size of the target sliding window, the maximum value of the preset overlap ratio range is the maximum value; when the dragging operation decreases the size of the target sliding window, the maximum value of the preset overlap ratio range is the minimum value.

[0183] As can be seen, in an embodiment of the present application, in response to a user dragging an edge of a selected target window, the electronic device can adjust the size of the target window based on the direction of the drag operation and calculate a window overlap ratio following the drag operation. The window overlap ratio represents the overlapping area between the target window and adjacent windows. If the window overlap ratio of the target window is within a preset overlap ratio range when the drag operation stops, the target window size adjustment is completed. If the window overlap ratio of the target window exceeds the preset overlap ratio range, the target window size adjustment is completed by adjusting the size of the target window to a size corresponding to the maximum value of the preset overlap ratio range. If the drag operation increases the size of the target window, the maximum value of the preset overlap ratio range is the maximum value, and if the drag operation decreases the size of the target window, the minimum value of the preset overlap ratio range is the minimum value. In the above process, by adjusting the size of the target window following the drag operation while calculating the window overlap ratio, the size of the target window can be ensured to not exceed the preset drag limit range.

[0184] As an implementation of the embodiment of the present application, the above method may further include:

[0185] When the size of the target sliding window is adjusted based on the direction of the drag operation, the sizes of other sliding windows are adjusted in the same manner as that of the target sliding window.

[0186] To reduce the amount of user input required, when adjusting the size of a target window, the electronic device can synchronously adjust the sizes of other windows in the same manner as the target window. For example, if a user drags the left edge of a target window to the left, increasing its size by 10%, the electronic device can follow the user's dragging action, synchronously moving the left edges of other windows to the left and increasing their sizes by 10%.

[0187] As can be seen, in this embodiment of the present application, when the electronic device adjusts the size of the target window based on the direction of the drag operation, it can also adjust the sizes of other windows in the same manner as the target window. This allows the user to adjust the size of the target window by dragging it, while also adjusting the sizes of other windows. This can further reduce the amount of user effort and improve image annotation efficiency.

[0188] As an implementation of an embodiment of the present application, the step of adjusting the properties of the sliding window based on the sliding window property value indicated by the adjusted adjustment control in response to the user's adjustment operation on the property adjustment control included in the image annotation interface may include:

[0189] In response to a quantity adjustment instruction issued by a user to a sliding window quantity adjustment control included in the image annotation interface, adjusting the number of sliding windows based on the adjusted number of sliding windows indicated by the sliding window quantity adjustment control; and / or,

[0190] In response to an overlap rate adjustment instruction issued by a user for a sliding window overlap rate adjustment control included in the image annotation interface, the size of the sliding window is adjusted based on the sliding window overlap rate indicated by the adjusted sliding window overlap rate adjustment control to complete the size adjustment of the sliding window.

[0191] In a first embodiment, the image annotation interface may include a sliding window quantity adjustment control. For example, the sliding window quantity adjustment control may be an input box, an increase or decrease button, a drag bar, etc., without specific limitation herein. In this case, the user may issue a quantity adjustment instruction to the sliding window quantity adjustment control, and the electronic device may adjust the number of sliding windows based on the adjusted number of sliding windows indicated by the sliding window quantity adjustment control.

[0192] In a second embodiment, the image annotation interface may include a sliding window overlap ratio adjustment control. For example, the sliding window overlap ratio adjustment control may be an input box, an increase / decrease button, a drag bar, etc., without specific limitation herein. In this case, a user may issue an overlap ratio adjustment instruction to the sliding window overlap ratio adjustment control, and the electronic device may adjust the size of the sliding window based on the adjusted sliding window overlap ratio indicated by the sliding window overlap ratio adjustment control, thereby completing the sliding window size adjustment.

[0193] In a third embodiment, the image annotation interface may include a sliding window number adjustment control and a sliding window overlap ratio adjustment control. In this case, the user can issue a number adjustment instruction for the sliding window number adjustment control, or issue an overlap ratio adjustment instruction for the sliding window overlap ratio adjustment control. That is, through the first and second embodiments, the number of sliding windows and the sliding window overlap ratio can be adjusted simultaneously.

[0194] It can be seen that in the embodiment of the present application, in response to the number adjustment instruction issued by the user for the sliding window number adjustment control included in the image annotation interface, the electronic device can adjust the number of sliding windows based on the number of sliding windows indicated by the adjusted sliding window number adjustment control; and / or, in response to the overlap rate adjustment instruction issued by the user for the sliding window overlap rate adjustment control included in the image annotation interface, the electronic device can adjust the size of the sliding windows based on the sliding window overlap rate indicated by the adjusted sliding window overlap rate adjustment control to complete the size adjustment of the sliding windows. In the above manner, the user can adjust the number of sliding windows and the sliding window overlap rate through the sliding window number adjustment control and the sliding window overlap rate adjustment control, without having to manually annotate the detection area where each target to be detected in the annotated image is located. Therefore, the efficiency of image annotation can be improved and the labor cost required for image annotation can be reduced.

[0195] As an implementation manner of an embodiment of the present application, the sliding window overlap ratio adjustment control may include a range adjustment component. In this case, the step of adjusting the size of the sliding window based on the sliding window overlap ratio indicated by the adjusted sliding window overlap ratio adjustment control in response to an overlap ratio adjustment instruction issued by a user for the sliding window overlap ratio adjustment control included in the image annotation interface may include:

[0196] In response to a drag operation issued by a user on the range adjustment component, following the drag operation, the sizes of the sliding windows are adjusted so that the sliding window overlap ratios of the respective sliding windows are the same as the sliding window overlap ratio corresponding to the drag operation on the range adjustment component.

[0197] The sliding window overlap ratio adjustment control may include a range adjustment component, where different positions of the range adjustment component correspond to different sliding window overlap ratios. For example, the range adjustment component may include a drag bar and a slider, where different positions of the slider on the drag bar correspond to different sliding window overlap ratios, and the ends of the drag bar may correspond to the minimum and maximum values ​​of the sliding window overlap ratio adjustment range, respectively.

[0198] In this case, the user can issue a drag operation on the range adjustment component, and the electronic device can follow the drag operation and adjust the size of the sliding window so that the sliding window overlap ratio of each sliding window is the same as the sliding window overlap ratio corresponding to the drag operation in the range adjustment component.

[0199] For example, the fourth diagram of the image annotation interface can be as follows Figure 5 As shown, the user can drag the range adjustment component 501 to adjust the size of the sliding window. The sliding window overlap rate corresponding to the current slider position is 0.2.

[0200] As can be seen, in the embodiments of the present application, in response to a user's drag operation on a range adjustment component, the electronic device can follow the drag operation and adjust the size of the sliding windows so that the sliding window overlap ratio of each sliding window is the same as the sliding window overlap ratio corresponding to the drag operation on the range adjustment component. Because the sliding window overlap ratio can be adjusted within a certain range, a range adjustment component can be provided. In this way, the user can adjust the size of the sliding window by dragging the range adjustment component, thereby changing the sliding window overlap ratio. Furthermore, while the user is dragging the range adjustment component, the displayed sliding window size can change in real time based on the sliding window overlap ratio corresponding to the dragging of the range adjustment component. This makes it easier for the user to intuitively determine the appropriate sliding window overlap ratio during the dragging process.

[0201] As an implementation of an embodiment of the present application, the above-mentioned sliding window quantity adjustment control may include a first sliding window quantity adjustment control and a second sliding window quantity adjustment control. In this case, Figure 6 As shown, in response to a quantity adjustment instruction issued by a user to a sliding window quantity adjustment control included in the image annotation interface, the step of adjusting the number of sliding windows based on the number of sliding windows indicated by the adjusted sliding window quantity adjustment control may include:

[0202] S601, in response to the user setting the number of horizontal sliding windows based on the first sliding window number adjustment control and the number of vertical sliding windows based on the second sliding window number adjustment control, displaying all selected sliding windows as unselected;

[0203] The sliding window quantity adjustment control may include a first sliding window quantity adjustment control and a second sliding window quantity adjustment control. The first sliding window quantity adjustment control may be used to adjust the number of horizontal sliding windows, and the second sliding window quantity adjustment control may be used to adjust the number of vertical sliding windows. For example, the first sliding window quantity adjustment control and the second sliding window quantity adjustment control may be input boxes, increase / decrease buttons, drag bars, etc., without specific limitation herein.

[0204] Continue as Figure 5 As shown, the user can set the number of horizontal windows using the first sliding window number adjustment control 502 and the number of vertical windows using the second sliding window number adjustment control 503. Specifically, the number can be directly entered in the first sliding window number adjustment control 502 and the second sliding window number adjustment control 503, or the number can be adjusted using the increase and decrease buttons in the first sliding window number adjustment control 502 and the second sliding window number adjustment control 503. The increase and decrease buttons are equilateral triangles and right triangles. The current number of horizontal windows is 3, and the number of vertical windows is 2.

[0205] After the number of horizontal sliding windows and the number of vertical sliding windows are set, the electronic device can display all selected sliding windows as unselected. For example, the selected sliding windows can be highlighted, and the unselected sliding windows can be non-highlighted.

[0206] S602, displaying the unselected sliding windows in the image annotation interface according to a default arrangement;

[0207] Next, the electronic device may display the unselected sliding windows in the image annotation interface in a default arrangement. The default arrangement may be pre-set based on actual circumstances, for example, the default arrangement may be 2×3, 3×3, etc., and is not specifically limited here.

[0208] S603: Adjust the number of sliding windows included in the image to be annotated in the image annotation interface according to the number of horizontal sliding windows and the number of vertical sliding windows.

[0209] The electronic device may adjust the number of sliding windows included in the image to be annotated in the image annotation interface according to the number of horizontal sliding windows and the number of vertical sliding windows.

[0210] For example, assuming that the sliding window arrangement is recorded as the number of horizontal sliding windows × the number of vertical sliding windows, the default arrangement is 3×3, and the current arrangement is 4×2. At this time, the user sets the number of horizontal sliding windows and the number of vertical sliding windows to 3 and 4, then the electronic device can first display all selected sliding windows as unselected, and then adjust the current arrangement to 3×3, and then display the sliding windows according to the 3×4 arrangement.

[0211] As can be seen, in the embodiments of the present application, in response to the user setting the number of horizontal sliding windows using the first sliding window number adjustment control and the number of vertical sliding windows using the second sliding window number adjustment control, the electronic device can display all selected sliding windows as unselected; display the unselected sliding windows in the image annotation interface according to the default arrangement; and adjust the number of sliding windows included in the image to be annotated in the image annotation interface according to the number of horizontal sliding windows and the number of vertical sliding windows. In this way, the user can conveniently adjust the number of horizontal sliding windows and the number of vertical sliding windows using the first sliding window number adjustment control and the second sliding window number adjustment control.

[0212] As an implementation method of the present application, Figure 7 As shown, after the step of adjusting the number of sliding windows based on the number of sliding windows indicated by the adjusted sliding window quantity adjustment control in response to a quantity adjustment instruction issued by the user to the sliding window quantity adjustment control included in the image annotation interface, the method may further include:

[0213] S701, based on the number of horizontal sliding windows and the number of vertical sliding windows, determining a sliding window located at the center of the region of interest from among the sliding windows included in the image to be annotated after the number of sliding windows is adjusted;

[0214] After the number of sliding windows is adjusted, the arrangement of the sliding windows in the image annotation interface will change. At this time, the sliding window at the center of the region of interest can be determined from the sliding windows included in the image to be annotated after the number of sliding windows is adjusted.

[0215] S702: Display the determined sliding window as selected.

[0216] Next, the electronic device may display the determined sliding window as selected, i.e., the sliding window in the center is selected by default. The selected sliding window may be highlighted, specifically by highlighting the selected sliding window, displaying a preset marker near the selected sliding window, etc., which are not specifically limited herein.

[0217] As can be seen, in the embodiment of the present application, the electronic device can, based on the number of horizontal and vertical sliding windows, determine the sliding window located at the center of the region of interest from among the sliding windows included in the image to be annotated after the number of sliding windows has been adjusted, and display the determined sliding window as selected. In this way, after the number of sliding windows has been adjusted, the sliding window located at the center is selected by default, facilitating subsequent adjustments by the user.

[0218] As an implementation manner of an embodiment of the present application, the step of determining, based on the number of horizontal sliding windows and the number of vertical sliding windows, the sliding window located at the center of the region of interest from the sliding windows included in the image to be annotated after the number of sliding windows is adjusted, may include:

[0219] In response to the fact that the number of the horizontal sliding windows and the number of the vertical sliding windows are both odd numbers, determining a sliding window located at a center position of the region of interest from the sliding windows included in the image to be labeled after the number of sliding windows is adjusted;

[0220] In response to the number of the horizontal sliding windows and the number of the vertical sliding windows being both even numbers, determining a sliding window closest to the center position and located in a first direction from the sliding windows included in the image to be labeled after the number of sliding windows is adjusted;

[0221] In response to the number of the horizontal sliding windows being an odd number and the number of the vertical sliding windows being an even number, determining a sliding window closest to the center position and located in a second direction from the sliding windows included in the image to be labeled after the number of sliding windows is adjusted;

[0222] In response to the number of the horizontal sliding windows being an even number and the number of the vertical sliding windows being an odd number, a sliding window closest to the center position and located in the third direction is determined from the sliding windows included in the image to be labeled after the number of sliding windows is adjusted.

[0223] In a first embodiment, in response to the fact that both the number of horizontal sliding windows and the number of vertical sliding windows are odd numbers, the electronic device may determine the sliding window located at the center of the region of interest from among the sliding windows included in the image to be annotated after the number of sliding windows has been adjusted. For example, assuming the adjusted sliding window arrangement is 5×5, the sliding window located in the third row and third column may be determined.

[0224] In a second embodiment, in response to the number of horizontal and vertical sliding windows being both even numbers, the electronic device may determine the sliding window closest to the center position and located in a first direction from among the sliding windows included in the image to be annotated after the number of sliding windows has been adjusted. The first direction may be set as needed, for example, to the upper left, lower left, upper right, lower right, etc., and is not specifically limited herein. For example, assuming the adjusted sliding window arrangement is 6×6 and the first direction is the upper left, the sliding window located in the third row and third column may be determined.

[0225] In a third embodiment, in response to the number of horizontal sliding windows being an odd number and the number of vertical sliding windows being an even number, the electronic device may determine the sliding window closest to the center position and located in the second direction from among the sliding windows included in the image to be annotated after the number of sliding windows has been adjusted. The second direction can be set as needed, for example, upward, downward, etc., and is not specifically limited herein. For example, assuming the adjusted sliding window arrangement is 3×4 and the second direction is upward, the sliding window located in the second row and second column may be determined.

[0226] In a fourth embodiment, in response to the number of horizontal sliding windows being an even number and the number of vertical sliding windows being an odd number, the electronic device may determine the sliding window closest to the center position and located in a third direction from among the sliding windows included in the image to be annotated after the number of sliding windows has been adjusted. The third direction can be set as needed, for example, to the left, right, etc., and is not specifically limited herein. For example, assuming the adjusted sliding window arrangement is 4×3 and the third direction is left, the sliding window located in row 2 and column 2 may be determined.

[0227] It can be seen that in the embodiment of the present application, in response to the number of horizontal sliding windows and the number of vertical sliding windows being odd numbers, the sliding window at the center of the region of interest is determined from the sliding windows included in the image to be annotated after the number of sliding windows is adjusted; in response to the number of horizontal sliding windows and the number of vertical sliding windows being even numbers, the sliding window closest to the center and located in the first direction is determined from the sliding windows included in the image to be annotated after the number of sliding windows is adjusted; in response to the number of horizontal sliding windows being odd numbers and the number of vertical sliding windows being even numbers, the sliding window closest to the center and located in the second direction is determined from the sliding windows included in the image to be annotated after the number of sliding windows is adjusted; in response to the number of horizontal sliding windows being even numbers and the number of vertical sliding windows being odd numbers, the sliding window closest to the center and located in the third direction is determined from the sliding windows included in the image to be annotated after the number of sliding windows is adjusted. Through the above embodiments, the sliding window to be selected by default can be quickly and accurately determined in various situations where the number of horizontal sliding windows and the number of vertical sliding windows are adjusted.

[0228] As an implementation of an embodiment of the present application, after the step of displaying the image to be annotated in the image annotation interface of the machine vision task, the method may further include:

[0229] In response to a property adjustment operation issued by a user on the region of interest, the properties of the region of interest are adjusted.

[0230] When a user wants to adjust the properties of a region of interest, they can issue a property adjustment operation for the region of interest in the image annotation interface. In this way, the electronic device can adjust the properties of the region of interest based on the property adjustment operation. For example, the user can drag the edge of the region of interest to adjust the size of the region of interest. For another example, the user can drag the interior of the region of interest to adjust the position of the region of interest.

[0231] As can be seen, in the embodiment of the present application, in response to the user's attribute adjustment operation on the region of interest, the electronic device can adjust the attributes of the region of interest. In this way, the user can quickly and conveniently adjust the attributes of the region of interest based on the image annotation interface.

[0232] As an implementation of an embodiment of the present application, the step of adjusting the attributes of the region of interest in response to the attribute adjustment operation issued by the user on the region of interest may include at least one of the following:

[0233] In response to a user drag operation on a vertex or an edge of the region of interest, following the drag operation and adjusting a size of the region of interest based on a direction of the drag operation;

[0234] In response to a drag operation initiated by a user on an interior of the region of interest, adjusting a position of the region of interest following the drag operation;

[0235] In response to a user's dragging operation on a rotating hotspot displayed at a preset position of the region of interest, the angle of the region of interest is adjusted following the dragging operation.

[0236] In a first embodiment, a user may initiate a drag operation on a vertex or edge of a region of interest, and the electronic device may follow the drag operation and adjust the size of the region of interest based on the direction of the drag operation. Specifically, the electronic device may move the vertex or edge being dragged by the user in the direction of the drag operation, thereby adjusting the size of the region of interest.

[0237] In a second embodiment, the user may initiate a drag operation on the interior of the region of interest, and the electronic device may follow the drag operation and adjust the position of the region of interest.

[0238] In a third embodiment, a user can drag a rotating hotspot displayed at a preset position of the region of interest, and the electronic device can follow the drag operation to adjust the angle of the region of interest. The preset position can be set as needed, and can be near the vertex of the region of interest, below the region of interest, etc., and is not specifically limited here.

[0239] Continue as Figure 2 As shown, the user can drag the rotation hot zone 204 downward, and the electronic device can follow the dragging operation to control the area of ​​interest to rotate clockwise.

[0240] As can be seen, in the embodiments of the present application, in response to a user dragging a vertex or edge of a region of interest, the dragging operation is followed and the size of the region of interest is adjusted based on the direction of the dragging operation; in response to a user dragging an interior of the region of interest, the dragging operation is followed and the position of the region of interest is adjusted; in response to a user dragging a rotating hotspot displayed at a preset position of the region of interest, the dragging operation is followed and the angle of the region of interest is adjusted. Through the above three implementations, users can conveniently adjust the size, position, and angle of the region of interest.

[0241] As an implementation method of the present application, Figure 8 As shown, the above method may further include:

[0242] S801, highlighting overlapping areas between sliding windows during the process of adjusting the size of the sliding windows;

[0243] To facilitate real-time viewing of overlapping areas of the sliding windows when adjusting the window size, the electronic device may highlight the overlapping areas of the sliding windows during the window size adjustment process. Specifically, the highlighting method may include thickening the border of the overlapping area, highlighting the overlapping area, and the like, which are not specifically limited herein.

[0244] For example, continue as Figure 2 As shown, Figure 2 Highlights are indicated by shading in the middle. The overlapping areas of adjacent sliding windows in the vertical direction are marked by shading in the shape of " / ". The overlapping areas of adjacent sliding windows in the horizontal direction are marked by shading in the shape of "\". The shading of the intersection area is also cross-shaped, indicating that the highlight color of the intersection area is darker.

[0245] S802: After the sliding window size adjustment is completed, the overlapping area between the sliding windows is displayed in a non-highlighted state.

[0246] After the sliding window size adjustment is completed, the electronic device can display the overlapping area between the sliding windows in a non-highlighted state.

[0247] As can be seen, in the embodiments of the present application, during the process of adjusting the size of the sliding window, the electronic device can highlight the overlapping areas between the sliding windows; after the sliding window size adjustment is completed, the overlapping areas between the sliding windows are displayed in a non-highlighted state. In current related art, the method for adjusting the properties of the region of interest and the sliding window does not allow the user to intuitively perceive the difference between the recognition area and the overlapping area of ​​the sliding window, resulting in low adjustment efficiency and poor adjustment effect. However, in the solution provided in the embodiments of the present application, the user can intuitively view the overlapping areas between the current sliding windows while adjusting the sliding window size, making it easier for the user to determine the sliding window size to be adjusted.

[0248] As an implementation of an embodiment of the present application, the centers of the preset number of sliding windows may be displayed with identification points. In this case, the method may further include:

[0249] When adjusting the position or size of the sliding window, the center point of each sliding window is displayed based on the current position and size of each sliding window.

[0250] To help users determine the position of each sliding window, the electronic device may display an identification point at the center of each sliding window. The identification point may be a solid circle, a triangle, a five-pointed star, and so on, without limitation. In this case, when adjusting the position or size of a sliding window, the electronic device may display the center point of each sliding window based on the current position and size of each sliding window, ensuring that the center point remains at the center of the window when the position or size of the window is adjusted.

[0251] For example, the fifth diagram of the image annotation interface can be as follows Figure 9 As shown, the center of each sliding window displays a solid circle mark point 901. Figure 9 In the example, the sliding window at the center is selected, so the edges of the sliding window are highlighted, and a draggable indicator is displayed on each edge of the sliding window.

[0252] As an implementation of an embodiment of the present application, the step of adjusting the properties of the sliding window in response to a property adjustment operation issued by the user on the sliding window may include:

[0253] In response to a property adjustment operation issued by a user on the sliding window, where a triggering position of the property adjustment operation is in an overlapping area of ​​multiple sliding windows, properties of a corresponding sliding window with the highest priority among the multiple sliding windows are adjusted.

[0254] Each sliding window can have a priority relationship, which can be set based on the importance of the sliding window. If multiple sliding windows have overlapping areas and a user issues an attribute adjustment operation for the overlapping area, the attribute adjustment operation can be performed first on the sliding window with the highest priority in the overlapping area.

[0255] For example, assuming that windows 1 to 4 have an overlapping area, window 1 has the highest priority. If the user issues an attribute adjustment operation for the overlapping area, the attribute adjustment operation will be applied to window 1, thereby adjusting the attributes of window 1.

[0256] As can be seen, in the embodiments of the present application, in response to a user issuing an attribute adjustment operation on a sliding window, where the triggering location of the attribute adjustment operation is in the overlapping region of multiple sliding windows, the electronic device can adjust the attributes of the sliding window with the highest priority among the multiple sliding windows. In this way, when a user issues an attribute adjustment operation on the overlapping region of multiple sliding windows, the sliding window to be interacted with by the attribute adjustment operation can be determined based on the priority of the sliding windows.

[0257] As an implementation method of the embodiment of the present application, a flowchart of an image annotation method can be as follows: Figure 10 As shown, the following steps may be specifically included:

[0258] S1001, preliminarily determine the region of interest;

[0259] The electronic device can preliminarily determine the position and size of the region of interest of the image to be annotated by using a region of interest determination algorithm.

[0260] S1002, displaying a region of interest;

[0261] Next, the electronic device can display the region of interest in the image annotation interface. When the region of interest is generated, multiple sliding windows can be displayed in the region of interest according to a default arrangement. For example, the sliding windows can be displayed in a 3×3 format. At the same time, the sliding window in the center position can be selected by default. In addition, the user can hover and select the sliding window. When the hover operation is performed on the sliding window, the identification area of ​​the sliding window can be highlighted.

[0262] S1003, adjusting the region of interest;

[0263] The user can adjust the properties of the region of interest, specifically, the size, position, and angle of the region of interest.

[0264] S1004, adjusting by dragging;

[0265] Users can drag and drop the image annotation interface to adjust the properties of the sliding window.

[0266] S1005, adjust through property adjustment controls;

[0267] The user can also adjust the attribute parameters of the sliding window through the attribute adjustment controls included in the image annotation interface, thereby adjusting the attributes of the sliding window.

[0268] S1006: Image annotation is completed.

[0269] When the user issues a sliding window confirmation operation, the electronic device can use the area included in each sliding window in the current image annotation interface as the detection area of ​​the image to be annotated.

[0270] As an implementation method of the present application, Figure 11 As shown, the above step S1004 may specifically include the following steps:

[0271] S1101, the cursor is hovered over the hot area at the edge of the selected target window;

[0272] After starting the adjustment, the user can control the cursor to hover over the window edge hot zone of the selected target window.

[0273] S1102, adjusting the cursor to a telescopic state;

[0274] At this time, the cursor can be adjusted to a telescopic state to prompt the user to drag the edge of the target sliding window.

[0275] S1103, long press and drag the edge of the target sliding window;

[0276] The user can long-press the mouse and drag the edge of the target sliding window to adjust the size of the target sliding window.

[0277] S1104, determining in real time whether the drag limit range is reached; if yes, executing step S1105; if not, executing step S1106;

[0278] When the user drags the edge of the target sliding window, the electronic device can determine in real time whether the position indicated by the drag operation exceeds the drag limit range.

[0279] S1105: The edge of the target sliding window is at a restricted position and does not move;

[0280] If yes, it means that the edge of the target sliding window is at a restricted position, and the edge of the target sliding window cannot continue to move following the drag operation. Next, the electronic device may return to step S1103.

[0281] S1106, following the drag operation, the size of the target sliding window is adjusted, other sliding windows are adjusted synchronously, and the overlapping area is highlighted;

[0282] If not, the electronic device can follow the drag operation and adjust the size of the target sliding window. At the same time, the electronic device can also adjust the sizes of other sliding windows in the same way as the target sliding window and highlight the overlapping area.

[0283] S1107, release the mouse to stop dragging;

[0284] After the user releases the mouse, the edge of the target window will no longer move along with the cursor.

[0285] S1108, unhighlight the overlapping area.

[0286] After the user releases the mouse, the electronic device can unhighlight the overlapping area, that is, display the overlapping area in a non-highlighted state, thereby ending the adjustment.

[0287] As an implementation method of the present application, Figure 12 As shown, the above step S1005 may specifically include the following steps:

[0288] S1201, adjusting the number of horizontal sliding windows and the number of vertical sliding windows;

[0289] After starting the adjustment, the user can adjust the number of horizontal and vertical sliding windows through the sliding window quantity adjustment control included in the image annotation interface.

[0290] S1202, deselect all sliding windows, and the number of sliding windows in the interface changes in real time;

[0291] The electronic device can deselect all selected sliding windows, that is, display all selected sliding windows as unselected. Next, the positions of all sliding windows can be reset to the default grid points, that is, the unselected sliding windows can be displayed in the default arrangement. Furthermore, the electronic device can adjust the number of sliding windows in the image annotation interface based on the adjusted number of horizontal and vertical sliding windows.

[0292] S1203, determine whether the number of horizontal sliding windows is an odd number; if yes, execute step S1204; if not, execute step S1205;

[0293] The electronic device may determine whether the number of horizontal sliding windows is an odd number.

[0294] S1204, determine whether the number of vertical sliding windows is an odd number; if yes, execute step S1206; if not, execute step S1207;

[0295] When the number of horizontal sliding windows is an odd number, the electronic device may continue to determine whether the number of vertical sliding windows is an odd number.

[0296] S1205, determine whether the number of vertical sliding windows is an odd number; if yes, execute step S1208; if not, execute step S1209;

[0297] When the number of horizontal sliding windows is an even number, the electronic device may continue to determine whether the number of vertical sliding windows is an odd number.

[0298] S1206, automatically selecting the sliding window at the center position;

[0299] When the number of horizontal sliding windows and the number of vertical sliding windows are both odd numbers, the electronic device may automatically select the sliding window at the center position.

[0300] S1207, automatically selecting the sliding window above the central position;

[0301] When the number of horizontal sliding windows is odd and the number of vertical sliding windows is even, the electronic device may automatically select the sliding window above the center position.

[0302] S1208, automatically selecting the sliding window on the left side of the center position;

[0303] When the number of horizontal sliding windows is an even number and the number of vertical sliding windows is an odd number, the electronic device may automatically select the sliding window to the left of the center position.

[0304] S1209, automatically select the sliding window at the upper left of the center position.

[0305] When the number of horizontal sliding windows and the number of vertical sliding windows are both even, the electronic device can automatically select the sliding window at the upper left of the center position, thereby completing the adjustment.

[0306] As an implementation method of the present application, Figure 13 As shown, the above step S1005 may further include the following steps:

[0307] S1301, adjusting the sliding window overlap ratio by inputting a numerical value;

[0308] After starting to adjust the sliding window overlap ratio, the user can adjust the sliding window overlap ratio by entering a value. The default value of the sliding window overlap ratio can be 0.

[0309] S1302, the sliding window size in the image annotation interface is adjusted;

[0310] When adjusting the sliding window overlap rate, the size of each sliding window in the image annotation interface will also be adjusted.

[0311] S1303, adjusting the sliding window overlap ratio through a range adjustment component;

[0312] The electronic device can adjust the sliding window overlap rate by dragging the range adjustment component.

[0313] S1304, when pressing and holding the range adjustment component, the overlapping area is highlighted;

[0314] When the user holds down the range adjustment component with a mouse, the electronic device can highlight the overlapping area.

[0315] S1305, the sliding window size in the image annotation interface is adjusted;

[0316] When adjusting the sliding window overlap rate, the size of each sliding window in the image annotation interface will also be adjusted.

[0317] S1306: When the range adjustment component is released, the overlapping area is unhighlighted.

[0318] When the user releases the mouse, the electronic device can cancel the highlighting of the overlapping area, thereby ending the adjustment.

[0319] In the technical solution of this application, the operations involved in obtaining, storing, using, processing, transmitting, providing and disclosing user personal information are all carried out with the user's authorization.

[0320] Corresponding to the above-mentioned image annotation method, the embodiment of the present application further provides an image annotation device. The image annotation device provided by the embodiment of the present application is introduced below.

[0321] like Figure 14 As shown, an image annotation device includes:

[0322] An image display module 1401 is configured to display an image to be annotated in an image annotation interface of a machine vision task, wherein the region of interest of the image to be annotated includes a preset number of sliding windows;

[0323] A sliding window attribute adjustment module 1402, configured to adjust the attributes of the sliding window in response to an attribute adjustment operation issued by a user on the sliding window;

[0324] The detection area confirmation module 1403 is configured to, in response to a sliding window confirmation operation issued by the user, use the area included in each sliding window in the current image annotation interface as the detection area of ​​the image to be annotated.

[0325] It can be seen that in the solution provided by the embodiment of the present application, the electronic device can display the image to be annotated in the image annotation interface of the machine vision task, wherein the region of interest of the image to be annotated includes a preset number of sliding windows; in response to the attribute adjustment operation issued by the user for the sliding window, the attributes of the sliding window are adjusted; in response to the sliding window confirmation operation issued by the user, the area included in each sliding window in the current image annotation interface is used as the detection area of ​​the image to be annotated. In the above process, when performing image annotation, the region of interest of the image to be annotated displayed in the image annotation interface includes a preset number of sliding windows. If the sliding window attributes need to be adjusted, the user can issue an attribute adjustment operation for the sliding window through the image annotation interface. In this way, the user can adjust the sliding window attributes based on the existing preset number of sliding windows without having to manually annotate the detection area where each target to be detected in the image to be annotated is located. Therefore, the efficiency of image annotation in machine vision tasks can be improved and the labor cost required for image annotation can be reduced.

[0326] As an implementation of the embodiment of the present application, the sliding window attribute adjustment module 1402 may include:

[0327] a first sliding window attribute adjustment submodule, configured to, in response to a drag operation initiated by a user on the sliding window, determine a position targeted by the drag operation; and adjust attributes of the sliding window based on the position targeted by the drag operation;

[0328] The second sliding window attribute adjustment submodule is configured to adjust the attribute of the sliding window based on the sliding window attribute value indicated by the adjusted adjustment control in response to an adjustment operation issued by a user on the attribute adjustment control included in the image annotation interface.

[0329] As an implementation of an embodiment of the present application, the first sliding window attribute adjustment submodule may include:

[0330] a sliding window size adjustment unit, configured to, in response to a user dragging an edge of a selected target sliding window, follow the dragging operation and adjust the size of the target sliding window based on a direction of the dragging operation until a position where the dragging operation stops falls within a preset drag limit range, or a position indicated by the dragging operation exceeds the preset drag limit range;

[0331] The sliding window position adjusting unit is configured to respond to a drag operation initiated by a user on an interior of a selected target sliding window, follow the drag operation, and adjust the position of the target sliding window based on a direction of the drag operation.

[0332] As an implementation of the embodiment of the present application, the above-mentioned device may further include:

[0333] The cursor display module is configured to adjust the cursor to a retractable state in response to a cursor hovering over a window edge hot zone corresponding to a selected target window, wherein the window edge hot zone is an area of ​​the target window edge that does not overlap with the border of the region of interest, and the retractable state is configured to prompt the user that the edge corresponding to the cursor is draggable.

[0334] As an implementation of an embodiment of the present application, the sliding window size adjustment unit may include:

[0335] an overlap ratio calculation subunit, configured to, in response to a user dragging operation on an edge of a selected target sliding window, follow the dragging operation, adjust the size of the target sliding window based on a direction of the dragging operation, and calculate a sliding window overlap ratio, wherein the sliding window overlap ratio is used to represent an overlapping area between the target sliding window and an adjacent sliding window;

[0336] a first size adjustment subunit, configured to complete the size adjustment of the target sliding window if the sliding window overlap ratio of the target sliding window is within a preset overlap ratio range when the dragging operation stops;

[0337] The second size adjustment subunit is configured to adjust the size of the target sliding window to a size corresponding to a maximum value of the preset overlap rate range when the sliding window overlap rate of the target sliding window exceeds the preset overlap rate range, thereby completing the size adjustment of the target sliding window. When the dragging operation causes the size of the target sliding window to increase, the maximum value of the preset overlap rate range is the maximum value; and when the dragging operation causes the size of the target sliding window to decrease, the maximum value of the preset overlap rate range is the minimum value.

[0338] As an implementation of the embodiment of the present application, the above-mentioned device may further include:

[0339] The synchronous adjustment module is configured to adjust the sizes of other sliding windows in the same manner as that of the target sliding window when adjusting the size of the target sliding window based on the direction of the drag operation.

[0340] As an implementation of an embodiment of the present application, the second sliding window attribute adjustment submodule may include:

[0341] a quantity adjustment unit, configured to adjust the number of sliding windows based on the number of sliding windows indicated by the adjusted sliding window quantity adjustment control in response to a quantity adjustment instruction issued by a user to the sliding window quantity adjustment control included in the image annotation interface;

[0342] An overlap rate adjustment unit is configured to, in response to an overlap rate adjustment instruction issued by a user to a sliding window overlap rate adjustment control included in the image annotation interface, adjust the size of the sliding window based on the sliding window overlap rate indicated by the adjusted sliding window overlap rate adjustment control to complete the size adjustment of the sliding window.

[0343] As an implementation of an embodiment of the present application, the sliding window overlap rate adjustment control includes a range adjustment component. In this case, the overlap rate adjustment unit may include:

[0344] The overlap rate adjustment subunit is used to respond to a drag operation issued by the user on the range adjustment component, follow the drag operation, and adjust the size of the sliding window so that the sliding window overlap rate of each sliding window is the same as the sliding window overlap rate corresponding to the drag operation on the range adjustment component.

[0345] As an implementation of an embodiment of the present application, the above-mentioned sliding window quantity adjustment control may include a first sliding window quantity adjustment control and a second sliding window quantity adjustment control. In this case, the above-mentioned quantity adjustment unit may include:

[0346] a deselecting subunit, configured to display all selected sliding windows as unselected in response to the number of horizontal sliding windows set by the user based on the first sliding window number adjustment control and the number of vertical sliding windows set based on the second sliding window number adjustment control;

[0347] a sliding window display subunit, configured to display the unselected sliding windows in the image annotation interface according to a default arrangement;

[0348] The quantity adjustment subunit is configured to adjust the quantity of sliding windows included in the image to be annotated in the image annotation interface according to the quantity of the horizontal sliding windows and the quantity of the vertical sliding windows.

[0349] As an implementation of the embodiment of the present application, the above-mentioned device may further include:

[0350] a sliding window determining module, configured to determine, based on the number of horizontal sliding windows and the number of vertical sliding windows, a sliding window located at a central position of the region of interest from among the sliding windows included in the image to be annotated after the number of sliding windows is adjusted;

[0351] The sliding window selection module is used to display the determined sliding window as a selected state.

[0352] As an implementation of an embodiment of the present application, the sliding window determination module may include:

[0353] a first sliding window determination submodule, configured to, in response to the number of the horizontal sliding windows and the number of the vertical sliding windows being odd numbers, determine a sliding window located at a center position of the region of interest from the sliding windows included in the image to be annotated after the number of sliding windows is adjusted;

[0354] a second sliding window determination submodule configured to, in response to the number of the horizontal sliding windows and the number of the vertical sliding windows being an even number, determine a sliding window closest to the center position and located in a first direction from the sliding windows included in the image to be annotated after the number of sliding windows is adjusted;

[0355] a third sliding window determination submodule, configured to, in response to the number of the horizontal sliding windows being an odd number and the number of the vertical sliding windows being an even number, determine, from the sliding windows included in the image to be labeled after the number of sliding windows is adjusted, a sliding window that is closest to the center position and located in a second direction;

[0356] The fourth sliding window determination submodule is configured to determine, in response to the number of the horizontal sliding windows being an even number and the number of the vertical sliding windows being an odd number, a sliding window closest to the center position and located in a third direction from the sliding windows included in the image to be labeled after the number of sliding windows is adjusted.

[0357] As an implementation of the embodiment of the present application, the above-mentioned device may further include:

[0358] The region of interest adjustment module is configured to adjust the attributes of the region of interest in response to an attribute adjustment operation issued by a user on the region of interest.

[0359] As an implementation of the embodiment of the present application, the above-mentioned region of interest adjustment module may include:

[0360] a first region of interest adjustment submodule, configured to respond to a drag operation initiated by a user on a vertex or an edge of the region of interest, follow the drag operation, and adjust a size of the region of interest based on a direction of the drag operation;

[0361] a second region of interest adjustment submodule, configured to respond to a drag operation initiated by a user on the interior of the region of interest and adjust the position of the region of interest following the drag operation;

[0362] The third region of interest adjustment submodule is configured to respond to a drag operation initiated by a user on a rotating hotspot displayed at a preset position of the region of interest and adjust the angle of the region of interest following the drag operation.

[0363] As an implementation of the embodiment of the present application, the above-mentioned device may further include:

[0364] a highlighting module, configured to highlight overlapping areas between the sliding windows during the process of adjusting the size of the sliding windows;

[0365] The non-highlighting display module is used to display the overlapping area between the sliding windows in a non-highlighting state after the sliding window size adjustment is completed.

[0366] As an implementation of an embodiment of the present application, the centers of the preset number of sliding windows may be displayed with identification points. In this case, the apparatus may further include:

[0367] The center point display module is used to display the center point of each sliding window based on the current position and size of each sliding window when the position or size of the sliding window is adjusted.

[0368] As an implementation of the embodiment of the present application, the sliding window attribute adjustment module 1402 may include:

[0369] The sliding window attribute adjustment submodule is configured to, in response to an attribute adjustment operation issued by a user on the sliding window, wherein the triggering position of the attribute adjustment operation is in an overlapping area of ​​multiple sliding windows, adjust the attribute of the sliding window with the highest priority among the multiple sliding windows.

[0370] The present application also provides an electronic device, such as Figure 15 Shown, including:

[0371] Memory 1501, used for storing computer programs;

[0372] The processor 1502 is configured to implement the image annotation method described in any of the above embodiments when executing the program stored in the memory 1501 .

[0373] Furthermore, the electronic device may further include a communication bus and / or a communication interface, and the processor 1502, the communication interface, and the memory 1501 communicate with each other via the communication bus.

[0374] It can be seen that in the solution provided by the embodiment of the present application, the electronic device can display the image to be annotated in the image annotation interface of the machine vision task, wherein the region of interest of the image to be annotated includes a preset number of sliding windows; in response to the attribute adjustment operation issued by the user for the sliding window, the attributes of the sliding window are adjusted; in response to the sliding window confirmation operation issued by the user, the area included in each sliding window in the current image annotation interface is used as the detection area of ​​the image to be annotated. In the above process, when performing image annotation, the region of interest of the image to be annotated displayed in the image annotation interface includes a preset number of sliding windows. If the sliding window attributes need to be adjusted, the user can issue an attribute adjustment operation for the sliding window through the image annotation interface. In this way, the user can adjust the sliding window attributes based on the existing preset number of sliding windows without having to manually annotate the detection area where each target to be detected in the image to be annotated is located. Therefore, the efficiency of image annotation in machine vision tasks can be improved and the labor cost required for image annotation can be reduced.

[0375] The communication bus mentioned in the electronic devices mentioned above can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus. This communication bus can be divided into address buses, data buses, control buses, etc. For ease of illustration, only a single thick line is used in the figure, but this does not mean that there is only one bus or only one type of bus.

[0376] The communication interface is used for communication between the above electronic device and other devices.

[0377] The memory may include random access memory (RAM) or non-volatile memory (NVM), such as at least one disk storage. Alternatively, the memory may be at least one storage device located away from the processor.

[0378] The above-mentioned processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, and discrete hardware components.

[0379] In another embodiment provided by the present application, a computer-readable storage medium is further provided, wherein a computer program is stored in the computer-readable storage medium. When the computer program is executed by a processor, the steps of any of the above-mentioned image annotation methods are implemented.

[0380] In another embodiment provided by the present application, a computer program product including instructions is further provided, which, when executed on a computer, enables the computer to execute any one of the image annotation methods in the above embodiments.

[0381] In the above embodiments, all or part of the embodiments can be implemented using software, hardware, firmware, or any combination thereof. When implemented using software, all or part of the embodiments can be implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions described in the embodiments of the present application are generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or data center that integrates one or more available media. The available medium can be magnetic media (e.g., floppy disk, hard disk, tape), optical media (e.g., DVD), or solid-state drive (SSD).

[0382] It should be noted that, in this document, relational terms such as first and second, etc., are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply the existence of any such actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article, or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article, or device. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or device comprising the element.

[0383] Each embodiment in this specification is described in a related manner. Similar portions between embodiments can be referenced to each other. Each embodiment focuses on the differences between other embodiments. In particular, the device, electronic device, computer-readable storage medium, and computer program product embodiments are generally similar to the method embodiments, so their descriptions are relatively simple. For related portions, reference can be made to the descriptions of the method embodiments.

[0384] The above description is only a preferred embodiment of the present application and is not intended to limit the scope of protection of the present application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present application are included in the scope of protection of the present application.

Claims

1. An image annotation method, characterized in that: The method comprises: In the image annotation interface of the machine vision task, an image to be annotated is displayed, wherein a region of interest of the image to be annotated includes a preset number of sliding windows, and the sliding windows are used to divide the region of interest into multiple areas arranged in a grid when multiple different targets to be detected exist within the region of interest; In response to a property adjustment operation issued by a user on the sliding window, adjusting the properties of the sliding window, wherein when adjusting the size of a target sliding window, the sizes of other sliding windows are synchronously adjusted in the same manner as that of the target sliding window; In response to a sliding window confirmation operation issued by the user, the area included in each sliding window in the current image annotation interface is used as the detection area of ​​the image to be annotated.

2. The method according to claim 1, characterized in that The step of adjusting the properties of the sliding window in response to a property adjustment operation issued by a user on the sliding window includes: In response to a user dragging operation on the sliding window, determining a location targeted by the dragging operation; adjusting properties of the sliding window based on the location targeted by the dragging operation; and / or, In response to an adjustment operation issued by a user on a property adjustment control included in the image annotation interface, the property of the sliding window is adjusted based on the sliding window property value indicated by the adjusted adjustment control.

3. The method according to claim 2, characterized in that In response to a drag operation initiated by a user on the sliding window, determining a position targeted by the drag operation; The step of adjusting the properties of the sliding window based on the position targeted by the drag operation includes: In response to a user dragging an edge of a selected target sliding window, following the dragging operation and adjusting the size of the target sliding window based on the direction of the dragging operation until the position where the dragging operation stops is within a preset drag limit range, or the position indicated by the dragging operation exceeds the preset drag limit range; and / or, In response to a drag operation initiated by a user on the interior of a selected target sliding window, the position of the target sliding window is adjusted based on the direction of the drag operation following the drag operation.

4. The method according to claim 3, characterized in that Before the step of responding to a drag operation initiated by the user on an edge of the selected target sliding window and adjusting the size of the target sliding window based on the direction of the drag operation, the method further includes: In response to a cursor hovering over a window edge hot zone corresponding to a selected target window, the cursor is adjusted to a telescopic state, wherein the window edge hot zone is an area of ​​the edge of the target window that does not overlap with the border of the region of interest, and the telescopic state is used to prompt the user that the edge corresponding to the cursor can be dragged.

5. The method according to claim 3, characterized in that The step of responding to a drag operation initiated by a user on an edge of a selected target sliding window, following the drag operation, and adjusting the size of the target sliding window based on a direction of the drag operation until a position where the drag operation stops is within a preset drag limit range, or a position indicated by the drag operation exceeds the preset drag limit range, includes: In response to a user dragging an edge of a selected target sliding window, following the dragging operation, adjusting the size of the target sliding window based on a direction of the dragging operation, and calculating a sliding window overlap ratio, wherein the sliding window overlap ratio is used to represent an overlapping area between the target sliding window and an adjacent sliding window; When the sliding window overlap ratio of the target sliding window is within a preset overlap ratio range when the dragging operation stops, completing the resizing of the target sliding window; When the sliding window overlap rate of the target sliding window exceeds the preset overlap rate range, the size of the target sliding window is adjusted to a size corresponding to a maximum value of the preset overlap rate range, thereby completing the size adjustment of the target sliding window. When the dragging operation causes the size of the target sliding window to increase, the maximum value of the preset overlap rate range is a maximum value; when the dragging operation causes the size of the target sliding window to decrease, the maximum value of the preset overlap rate range is a minimum value.

6. The method according to claim 3, characterized in that The method further comprises: When the size of the target sliding window is adjusted based on the direction of the drag operation, the sizes of other sliding windows are adjusted in the same manner as that of the target sliding window.

7. The method according to claim 2, characterized in that The step of adjusting the properties of the sliding window based on the sliding window property value indicated by the adjusted adjustment control in response to an adjustment operation issued by the user on the property adjustment control included in the image annotation interface includes: In response to a quantity adjustment instruction issued by a user to a sliding window quantity adjustment control included in the image annotation interface, adjusting the number of sliding windows based on the adjusted number of sliding windows indicated by the sliding window quantity adjustment control; and / or, In response to an overlap rate adjustment instruction issued by a user for a sliding window overlap rate adjustment control included in the image annotation interface, the size of the sliding window is adjusted based on the sliding window overlap rate indicated by the adjusted sliding window overlap rate adjustment control to complete the size adjustment of the sliding window.

8. The method according to claim 7, characterized in that The sliding window overlap rate adjustment control includes a range adjustment component; The step of adjusting the size of the sliding window based on the sliding window overlap ratio indicated by the adjusted sliding window overlap ratio adjustment control in response to an overlap ratio adjustment instruction issued by a user to a sliding window overlap ratio adjustment control included in the image annotation interface comprises: In response to a drag operation issued by a user on the range adjustment component, following the drag operation, the sizes of the sliding windows are adjusted so that the sliding window overlap ratios of the respective sliding windows are the same as the sliding window overlap ratio corresponding to the drag operation on the range adjustment component.

9. The method according to claim 7, characterized in that The sliding window quantity adjustment control includes a first sliding window quantity adjustment control and a second sliding window quantity adjustment control; The step of adjusting the number of sliding windows based on the number of sliding windows indicated by the adjusted sliding window number adjustment control in response to a quantity adjustment instruction issued by a user to a sliding window quantity adjustment control included in the image annotation interface comprises: In response to the user setting the number of horizontal sliding windows based on the first sliding window number adjustment control and the number of vertical sliding windows based on the second sliding window number adjustment control, displaying all selected sliding windows as unselected; In the image annotation interface, the unselected sliding window is displayed according to a default arrangement; According to the number of horizontal sliding windows and the number of vertical sliding windows, the number of sliding windows included in the image to be annotated is adjusted in the image annotation interface.

10. The method according to claim 9, characterized in that After the step of adjusting the number of sliding windows based on the number of sliding windows indicated by the adjusted sliding window quantity adjustment control in response to a quantity adjustment instruction issued by the user to the sliding window quantity adjustment control included in the image annotation interface, the method further includes: Based on the number of horizontal sliding windows and the number of vertical sliding windows, determining a sliding window located at a central position of the region of interest from the sliding windows included in the image to be annotated after the number of sliding windows is adjusted; The determined sliding window is displayed as selected.

11. The method according to claim 10, characterized in that The step of determining, based on the number of horizontal sliding windows and the number of vertical sliding windows, a sliding window located at the center of the region of interest from the sliding windows included in the image to be annotated after the number of sliding windows is adjusted, comprises: In response to the number of the horizontal sliding windows and the number of the vertical sliding windows being both odd numbers, determining a sliding window located at a center position of the region of interest from the sliding windows included in the image to be labeled after the number of sliding windows is adjusted; In response to the number of the horizontal sliding windows and the number of the vertical sliding windows being both even numbers, determining a sliding window closest to the center position and located in a first direction from the sliding windows included in the image to be labeled after the number of sliding windows is adjusted; In response to the number of the horizontal sliding windows being an odd number and the number of the vertical sliding windows being an even number, determining a sliding window closest to the center position and located in a second direction from the sliding windows included in the image to be labeled after the number of sliding windows is adjusted; In response to the number of the horizontal sliding windows being an even number and the number of the vertical sliding windows being an odd number, a sliding window closest to the center position and located in the third direction is determined from the sliding windows included in the image to be labeled after the number of sliding windows is adjusted.

12. The method according to any one of claims 1 to 11, characterized in that After the step of displaying the image to be annotated in the image annotation interface of the machine vision task, the method further includes: In response to a property adjustment operation issued by a user on the region of interest, the properties of the region of interest are adjusted.

13. The method according to claim 12, characterized in that The step of adjusting the attributes of the region of interest in response to the attribute adjustment operation issued by the user on the region of interest includes at least one of the following: In response to a user drag operation on a vertex or an edge of the region of interest, following the drag operation and adjusting a size of the region of interest based on a direction of the drag operation; In response to a drag operation initiated by a user on the interior of the region of interest, adjusting a position of the region of interest following the drag operation; In response to a user's dragging operation on a rotating hotspot displayed at a preset position of the region of interest, the angle of the region of interest is adjusted following the dragging operation.

14. The method according to claim 5 or 7, characterized in that The method further comprises: During the process of adjusting the size of the sliding windows, overlapping areas between the sliding windows are highlighted; After the sliding window size adjustment is completed, the overlapping area between the sliding windows is displayed in a non-highlighted state.

15. The method according to any one of claims 3 to 11, characterized in that: The centers of the preset number of sliding windows are displayed with identification points, and the method further includes: When adjusting the position or size of the sliding window, the center point of each sliding window is displayed based on the current position and size of each sliding window.

16. The method according to claim 1, wherein The step of adjusting the properties of the sliding window in response to a property adjustment operation issued by a user on the sliding window includes: In response to a property adjustment operation issued by a user on the sliding window, where a triggering position of the property adjustment operation is in an overlapping area of ​​multiple sliding windows, properties of a corresponding sliding window with the highest priority among the multiple sliding windows are adjusted.

17. An image annotation device, characterized in that: The device comprises: An image display module is configured to display an image to be annotated in an image annotation interface for a machine vision task, wherein a region of interest of the image to be annotated includes a preset number of sliding windows, and the sliding windows are configured to divide the region of interest into a plurality of regions arranged in a grid when a plurality of different targets to be detected are present within the region of interest; a sliding window attribute adjustment module, configured to adjust the attributes of the sliding window in response to an attribute adjustment operation issued by a user on the sliding window, wherein when adjusting the size of a target sliding window, the sizes of other sliding windows are synchronously adjusted in the same manner as that of the target sliding window; The detection area confirmation module is configured to, in response to a sliding window confirmation operation issued by a user, use the area included in each sliding window in the current image annotation interface as the detection area of ​​the image to be annotated.

18. The device according to claim 17, characterized in that The sliding window attribute adjustment module includes: a first sliding window attribute adjustment submodule, configured to, in response to a drag operation initiated by a user on the sliding window, determine a position targeted by the drag operation; and adjust attributes of the sliding window based on the position targeted by the drag operation; a second sliding window attribute adjustment submodule, configured to adjust the attribute of the sliding window based on the adjusted sliding window attribute value indicated by the attribute adjustment control in response to an adjustment operation issued by a user on the attribute adjustment control included in the image annotation interface; and / or The first sliding window attribute adjustment submodule includes: a sliding window size adjustment unit, configured to, in response to a user dragging an edge of a selected target sliding window, follow the dragging operation and adjust the size of the target sliding window based on a direction of the dragging operation until a position where the dragging operation stops falls within a preset drag limit range, or a position indicated by the dragging operation exceeds the preset drag limit range; a sliding window position adjustment unit, configured to, in response to a drag operation initiated by a user on an interior of a selected target sliding window, follow the drag operation and adjust the position of the target sliding window based on a direction of the drag operation; and / or, The device further comprises: a cursor display module, configured to adjust the cursor to a retractable state in response to the cursor hovering over a window edge hot zone corresponding to a selected target window, wherein the window edge hot zone is an area of ​​the target window edge that does not overlap with the border of the region of interest, and the retractable state is used to prompt the user that the edge corresponding to the cursor can be dragged; and / or The sliding window size adjustment unit includes: an overlap ratio calculation subunit, configured to, in response to a user dragging operation on an edge of a selected target sliding window, follow the dragging operation, adjust the size of the target sliding window based on a direction of the dragging operation, and calculate a sliding window overlap ratio, wherein the sliding window overlap ratio is used to represent an overlapping area between the target sliding window and an adjacent sliding window; a first size adjustment subunit, configured to complete the size adjustment of the target sliding window if the sliding window overlap ratio of the target sliding window is within a preset overlap ratio range when the dragging operation stops; a second size adjustment subunit, configured to, if the window overlap ratio of the target window exceeds the preset overlap ratio range, adjust the size of the target window to a size corresponding to a maximum value of the preset overlap ratio range, thereby completing the size adjustment of the target window, wherein, if the dragging operation causes the size of the target window to increase, the maximum value of the preset overlap ratio range is a maximum value, and if the dragging operation causes the size of the target window to decrease, the maximum value of the preset overlap ratio range is a minimum value; and / or The device further comprises: a synchronous adjustment module, configured to adjust the sizes of other sliding windows in the same manner as the target sliding window when adjusting the size of the target sliding window based on the direction of the drag operation; and / or The second sliding window attribute adjustment submodule includes: a quantity adjustment unit, configured to adjust the number of sliding windows based on the number of sliding windows indicated by the adjusted sliding window quantity adjustment control in response to a quantity adjustment instruction issued by a user to the sliding window quantity adjustment control included in the image annotation interface; an overlap rate adjustment unit, configured to, in response to an overlap rate adjustment instruction issued by a user to a sliding window overlap rate adjustment control included in the image annotation interface, adjust the size of the sliding window based on the sliding window overlap rate indicated by the adjusted sliding window overlap rate adjustment control to complete the size adjustment of the sliding window; and / or, The sliding window overlap rate adjustment control includes a range adjustment component; The overlap rate adjustment unit includes: an overlap rate adjustment subunit, configured to respond to a drag operation initiated by a user on the range adjustment component, follow the drag operation, and adjust the size of the sliding window so that the sliding window overlap rate of each sliding window is the same as the sliding window overlap rate corresponding to the drag operation on the range adjustment component; and / or, The sliding window quantity adjustment control includes a first sliding window quantity adjustment control and a second sliding window quantity adjustment control; The quantity adjustment unit includes: a deselecting subunit, configured to display all selected sliding windows as unselected in response to the number of horizontal sliding windows set by the user based on the first sliding window number adjustment control and the number of vertical sliding windows set based on the second sliding window number adjustment control; a sliding window display subunit, configured to display the unselected sliding windows in the image annotation interface according to a default arrangement; a quantity adjustment subunit, configured to adjust the number of sliding windows included in the image to be annotated in the image annotation interface according to the number of horizontal sliding windows and the number of vertical sliding windows; and / or The device further comprises: a sliding window determining module, configured to determine, based on the number of horizontal sliding windows and the number of vertical sliding windows, a sliding window located at a central position of the region of interest from among the sliding windows included in the image to be annotated after the number of sliding windows is adjusted; a sliding window selection module, configured to display the determined sliding window as selected; and / or, The sliding window determination module includes: a first sliding window determination submodule, configured to, in response to the number of the horizontal sliding windows and the number of the vertical sliding windows being odd numbers, determine a sliding window located at a center position of the region of interest from the sliding windows included in the image to be annotated after the number of sliding windows is adjusted; a second sliding window determination submodule configured to, in response to the number of the horizontal sliding windows and the number of the vertical sliding windows being an even number, determine a sliding window closest to the center position and located in a first direction from the sliding windows included in the image to be annotated after the number of sliding windows is adjusted; a third sliding window determination submodule, configured to, in response to the number of the horizontal sliding windows being an odd number and the number of the vertical sliding windows being an even number, determine, from the sliding windows included in the image to be labeled after the number of sliding windows is adjusted, a sliding window that is closest to the center position and located in a second direction; a fourth sliding window determination submodule, configured to, in response to the number of the horizontal sliding windows being an even number and the number of the vertical sliding windows being an odd number, determine, from the sliding windows included in the image to be annotated after the number of sliding windows is adjusted, a sliding window that is closest to the center position and located in a third direction; and / or The device further comprises: an area of ​​interest adjustment module, configured to adjust the attributes of the area of ​​interest in response to an attribute adjustment operation issued by a user on the area of ​​interest; and / or, The region of interest adjustment module includes: a first region of interest adjustment submodule, configured to respond to a drag operation initiated by a user on a vertex or an edge of the region of interest, follow the drag operation, and adjust a size of the region of interest based on a direction of the drag operation; a second region of interest adjustment submodule, configured to respond to a drag operation initiated by a user on the interior of the region of interest and adjust the position of the region of interest following the drag operation; A third region of interest adjustment submodule is configured to, in response to a user dragging operation on a rotating hotspot displayed at a preset position of the region of interest, adjust the angle of the region of interest following the dragging operation; and / or, The device further comprises: a highlighting module, configured to highlight overlapping areas between the sliding windows during the process of adjusting the size of the sliding windows; a non-highlighting display module, configured to display the overlapping areas between the sliding windows in a non-highlighting state after the sliding window size adjustment is completed; and / or, The centers of the preset number of sliding windows are displayed with identification points, and the device further includes: a center point display module, configured to display the center point of each sliding window based on the current position and size of each sliding window when adjusting the position or size of the sliding window; and / or, The sliding window attribute adjustment module includes: The sliding window attribute adjustment submodule is configured to, in response to an attribute adjustment operation issued by a user on the sliding window, wherein the triggering position of the attribute adjustment operation is in an overlapping area of ​​multiple sliding windows, adjust the attribute of the sliding window with the highest priority among the multiple sliding windows.

19. An electronic device, characterized in that: include: Memory for storing computer programs; A processor, configured to implement the method according to any one of claims 1 to 16 when executing a program stored in a memory.

20. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method according to any one of claims 1 to 16 is implemented.

Images