Target detection method and system, medium and electronic equipment

Abstract

The invention provides a target detection method and system, a medium and electronic equipment. The target detection method comprises the following steps: performing point set transformation on a point set for several times to obtain a target point set; processing the target point set to obtain a feature map; obtaining a target detection result according to the feature map; wherein the input point set of the first time of point set transformation is an image to be detected, the input point sets of the other times of point set transformation are output point sets of the last time of point set transformation, and the output point set of the last time of point set transformation is the target point set; the point set transformation process comprises the following steps: acquiring normalized position features and normalized pixel features according to an input point set; clustering the normalized position features to obtain a position cluster; performing similarity calculation on the normalized pixel features and the position cluster, and obtaining a pixel cluster according to a calculation result; and obtaining an output point set according to the index of the central point in the pixel cluster.

Description

Technical Field

[0001] The present application belongs to the field of computer vision technology and relates to a target detection method, system, medium and electronic device. Background Art

[0002] Object detection is a computer vision technology that plays a key role in autonomous driving, video surveillance, image analysis, and robot navigation. Object detection aims to identify and locate objects of interest appearing in images or videos. This process involves not only detecting one or more objects in the image, but also determining the precise location of these objects. In addition, it is also necessary to be able to identify the category of objects and accurately depict their location and range in the image. However, existing technologies often face a large consumption of computing resources in high-resolution image processing and are not effective in detecting small or densely packed objects in complex scenes. Summary of the invention

[0003] The purpose of this application is to provide a target detection method, system, medium and electronic device for improving target detection accuracy.

[0004] In a first aspect, the present application provides a target detection method, which includes: performing several point set transformations on a point set to obtain a target point set; processing the target point set to obtain a feature map; obtaining a target detection result based on the feature map; wherein the input point set of the first point set transformation is an image to be detected, the input point set of the remaining point set transformations is an output point set of the previous point set transformation, and the output point set of the last point set transformation is the target point set; the point set transformation process includes: obtaining normalized position features and normalized pixel features based on the input point set; clustering the normalized position features to obtain position clusters; performing similarity calculation on the normalized pixel features and the position clusters, and obtaining pixel clusters based on the calculation results; and obtaining an output point set based on the index of the center point in the pixel cluster.

[0005] In an implementation of the first aspect, the process of obtaining normalized position features and normalized pixel features based on an input point set includes: obtaining a position point set and a pixel point set based on the input point set; performing feature extraction on the position point set and the pixel point set to obtain position features and pixel features; and normalizing the position features and the pixel features to obtain the normalized position features and the normalized pixel features.

[0006] In an implementation manner of the first aspect, the process of clustering the normalized location features to obtain location clusters includes: clustering the normalized location features using a kmeans clustering algorithm to obtain the location clusters.

[0007] In an implementation of the first aspect, the process of performing similarity calculation on the normalized pixel features and the position clusters and obtaining the pixel clusters based on the calculation results includes: performing cosine similarity calculation on the normalized pixel features and the center points of the position clusters, and clustering the pixel features into a plurality of pixel clusters based on the calculated cosine similarities.

[0008] In an implementation of the first aspect, the process of obtaining the target point set according to the index of the center point in the pixel cluster includes: selecting points with the same index in the pixel point set as the target point set according to the index of the center point in the pixel cluster.

[0009] In an implementation manner of the first aspect, the process of processing the target point set to obtain the feature map includes: inputting the target point set into a Transformer Encoder module to obtain the feature map.

[0010] In an implementation of the first aspect, the process of obtaining the target detection result based on the feature map includes: processing the feature map using an MLP model to obtain rectangular box coordinates and probability distribution; and obtaining the target detection result based on the rectangular box coordinates and the probability distribution.

[0011] In a second aspect, the present application provides a target detection system, which includes: a point set processing module, which is used to perform several point set transformations on a point set to obtain a target point set; a feature map acquisition module, which is used to process the target point set to obtain a feature map; a target detection result acquisition module, which is used to obtain a target detection result based on the feature map; wherein, the input point set of the first point set transformation is the image to be detected, the input point set of the remaining point set transformations is the output point set of the previous point set transformation, and the output point set of the last point set transformation is the target point set; the process of the point set transformation includes: obtaining normalized position features and normalized pixel features based on the input point set; clustering the normalized position features to obtain position clusters; performing similarity calculation on the normalized pixel features and the position clusters, and obtaining pixel clusters based on the calculation results; and obtaining the output point set based on the index of the center point in the pixel cluster.

[0012] In a third aspect, the present application provides an electronic device, comprising: a memory on which a computer program is stored; and a processor, communicatively connected to the memory, for executing the computer program to implement the above-mentioned target detection method.

[0013] In a fourth aspect, the present application provides a computer-readable storage medium having a computer program stored thereon, which implements the above-mentioned target detection method when executed by an electronic device.

[0014] As described above, the target detection method, system, medium and electronic device described in the present application have the following beneficial effects:

[0015] (1) Through point set transformation, the model can extract important position and pixel features from the original image and perform normalization, which helps the model better understand and distinguish different visual objects.

[0016] (2) Using clustering algorithms to cluster location features can identify important spatial regions, namely location clusters. This method helps reduce data dimensions and emphasize the most representative features.

[0017] (3) By calculating the similarity between pixel features and the center of the location cluster, the pixel features can be clustered into pixel clusters, which further enhances the model's ability to recognize objects in the image.

[0018] (4) According to the index of the center point of the pixel cluster, a target point set is selected. The target point set contains the most representative points in the image, providing a concise and effective data input for subsequent feature map generation and target detection. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 Shown is a schematic diagram of an application scenario of the target detection method described in an embodiment of the present application.

[0020] Figure 2 Shown is a schematic diagram of the target detection process described in an embodiment of the present application.

[0021] Figure 3 Shown is a schematic diagram of the point set transformation process described in an embodiment of the present application.

[0022] Figure 4 Shown is a schematic diagram of the process of obtaining normalized position features and normalized pixel features as described in an embodiment of the present application.

[0023] Figure 5 Shown is a schematic diagram of the process of obtaining target detection results described in an embodiment of the present application.

[0024] Figure 6 Shown is a schematic diagram of the structure of the target detection system described in an embodiment of the present application.

[0025] Figure 7 Shown is a schematic diagram of the structure of an electronic device described in an embodiment of the present application.

[0026] Component number description

[0027] 11. Cell Phone

[0028] 12 Tablet

[0029] 13 Laptop

[0030] 2 Target Detection System

[0031] 21 point collection processing module

[0032] 22 Feature map acquisition module

[0033] 23 Target detection result acquisition module

[0034] 3 Electronic devices

[0035] 31 Memory

[0036] 32 processors

[0037] Steps S11~S13

[0038] Steps S21~S24

[0039] Steps S31~S33

[0040] Steps S41~S42 DETAILED DESCRIPTION

[0041] The following describes the embodiments of the present application through specific examples, and those skilled in the art can easily understand other advantages and effects of the present application from the contents disclosed in this specification. The present application can also be implemented or applied through other different specific embodiments, and the details in this specification can also be modified or changed in various ways based on different viewpoints and applications without departing from the spirit of the present application. It should be noted that the following embodiments and features in the embodiments can be combined with each other without conflict.

[0042] It should be noted that the illustrations provided in the following embodiments are only schematic illustrations of the basic concept of the present application, and thus the drawings only show components related to the present application rather than being drawn according to the number, shape and size of components in actual implementation. In actual implementation, the type, quantity and proportion of each component may be changed at will, and the component layout may also be more complicated.

[0043] Object detection is a computer vision technology that plays a key role in autonomous driving, video surveillance, image analysis, and robot navigation. Object detection aims to identify and locate objects of interest appearing in images or videos. This process involves not only detecting one or more objects in the image, but also determining the precise location of these objects. In addition, it is also necessary to be able to identify the category of objects and accurately depict their location and range in the image. However, existing technologies often face a large consumption of computing resources in high-resolution image processing and are not effective in detecting small or densely packed objects in complex scenes.

[0044] At least to address the above problems, the following embodiments of the present application provide a target detection method, which can be applied to Figure 1 Electronic equipment shown.

[0045] The electronic devices described in the present application may include mobile phones 11, tablet computers 12, laptop computers 13, wearable devices, vehicle-mounted devices, augmented reality (AR) / virtual reality (VR) devices, ultra-mobile personal computers (UMPC), netbooks, personal digital assistants (PDA), etc., which have wireless charging functions. The embodiments of the present application do not impose any restrictions on the specific types of electronic devices.

[0046] For example, the electronic device may be a station (STAION, ST) in a WLAN with a wireless charging function, a cellular phone, a cordless phone, a Session Initiation Protocol (SIP) phone, a Wireless Local Loop (WLL) station, a Personal Digital Assistant (PDA) device, a handheld device with a wireless charging function, a computing device or other processing device, a computer, a laptop computer, a handheld communication device, a handheld computing device, and / or other devices for communicating on a wireless system and a next generation communication system, such as a mobile terminal in a 5G network, a mobile terminal in a future evolved Public Land Mobile Network (PLMN), or a mobile terminal in a future evolved Non-terrestrial Network (NTN).

[0047] For example, the electronic device can communicate with the network and other devices through wireless communication. The above wireless communication can use any communication standard or protocol, including but not limited to Global System of Mobilecommunication (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), email, Short Messaging Service (SMS), BT, GNSS, WLAN, NFC, FM, and / or IR technology, etc. The GNSS can include Global Positioning System (GPS), Global Navigation Satellite System (GLONASS), Beidou Satellite Navigation System (BDS), Quasi-Zenith Satellite System (QZSS) and / or Satellite Based Augmentation Systems (SBAS).

[0048] The technical solutions in the embodiments of the present application will be described in detail below in conjunction with the drawings in the embodiments of the present application.

[0049] Figure 2 The following is a schematic diagram of the target detection process in one embodiment of the present application. Figure 2 As shown, the target detection method includes:

[0050] S11, perform several point set transformations on the point set to obtain the target point set. The point set is input into the point set transformation module, and the target point set is obtained by performing multiple point set transformations on the point set using the input cluster. Among them, the input point set of the first point set transformation is the image to be detected, the input point set of the remaining point set transformations is the output point set of the previous point set transformation, and the output point set of the last point set transformation is the target point set.

[0051] Specifically, the size of the image to be detected is cropped to a height multiplied by a width of 224 * 224, that is, the image point set includes 224 * 224 points. The number of input clusters is ( (h / / 2), (w / / 2) ) = 112 * 112 = 12544. Among them, / / represents division and rounding. The number of point set transformations is, for example, three times, but the present application is not limited to this. At each point set transformation, the number of input clusters changes. The number of points in the point set is the same as the number of input clusters.

[0052] Exemplarily, the image to be detected can be used as a pixel point set, and point set transformations are performed on it three times to obtain a target point set. The image to be detected with (h, w) being (224, 224) is input into the first point set transformation module, and point set processing is performed in combination with the first input clusters of ((h / / 2), (w / / 2)) to obtain the first output point set. The first output point set is input into the second point set transformation module as the input point set of the second point set transformation, and point set processing is performed in combination with the second input clusters of ((h / / 4), (w / / 4)) to obtain the second output point set. The second output point set is input into the third point set transformation module as the input point set of the third point set transformation, and point set processing is performed in combination with the third input clusters of ((h / / 16), (w / / 16)) to obtain the third output point set, and the third output point set is used as the target point set. Each point set transformation module reduces the number of input clusters by half, which can converge features and reduce the amount of calculation.

[0053] S12, processing the target point set to obtain a feature map.

[0054] S13, obtaining a target detection result according to the feature map.

[0055] Figure 3 The diagram is a schematic diagram of the point set transformation process in one embodiment of the present application. Figure 3 As shown, the process of point set transformation includes:

[0056] S21, obtaining normalized position features and normalized pixel features according to the input point set.

[0057] S22, clustering the normalized location features to obtain location clusters.

[0058] S23, performing similarity calculation on the normalized pixel feature and the position cluster, and obtaining a pixel cluster according to the calculation result.

[0059] S24, obtaining an output point set according to the index of the center point in the pixel cluster.

[0060] According to the above description, the target detection method provided by the embodiment of the present application can extract important positions and pixel features from the original image according to the point set transformation, perform normalization processing, and use a clustering algorithm to cluster the position features, so as to identify important spatial regions, namely position clusters, which helps to reduce the data dimension and emphasize the most representative features. By calculating the similarity between the pixel features and the center of the position cluster, the pixel features can be clustered into pixel clusters, which further enhances the model's ability to recognize targets in the image. According to the index of the center point of the pixel cluster, a target point set is selected, and the target point set contains the most representative points in the image, thereby improving the accuracy of target detection.

[0061] Figure 4 The diagram shows a process of obtaining normalized position features and normalized pixel features in an embodiment of the present application. Figure 4 As shown, the process of obtaining normalized position features and normalized pixel features according to the input point set includes:

[0062] S31, obtain a position point set and a pixel point set according to the input point set. Split the input point set into a position point set and a pixel point set. The position point set is composed of h * w vectors, each vector has 2 elements (one is the relative position coordinate of the X axis, and the other is the relative position coordinate of the Y axis). When the height h and width w of the image are both 4, the position point set has 4*4=16 vectors, X-axis position = X-axis index / / width, y-axis position value = Y-axis index / / height. The pixel point set is composed of h * w vectors, each vector has 3 elements (RGB values).

[0063] Exemplarily, the input point set (h * w) is split to obtain a position point set (h * w, 2) and a pixel point set (h * w, 3).

[0064] S32, performing feature extraction on the position point set and the pixel point set to obtain position features and pixel features.

[0065] S33, normalizing the position feature and the pixel feature to obtain the normalized position feature and the normalized pixel feature.

[0066] Exemplarily, a transformer encoder block is used to extract features from a set of position points to obtain position features, and a sigmoid function is used to normalize the position features to obtain normalized position features. The shape of the normalized position features is (h * w, D), where D represents the dimension of the feature.

[0067] The process of extracting features from a set of position points using the Transformer Encoder module to obtain position features includes: encoding the input of each position in the set of position points, calculating the attention weights between different positions using the self-attention mechanism, capturing the association between different position points in the image point set through the self-attention mechanism, and performing nonlinear transformations on each position in the image point set by the neural network in the Transformer Encoder. In-depth feature extraction of the image point set is achieved through the processing of multiple encoding layers in the Transformer Encoder. The sigmoid function is an activation function. By using the sigmoid function to process position features one by one, the original position feature value can be mapped to a range between 0 and 1.

[0068] The transformer encoder block is used to extract the pixel points and obtain the pixel features. The pixel features are normalized using the L2 norm to obtain the normalized pixel features. The shape of the normalized pixel features is (h*w, D). The L2 norm is a measure of the feature vector, expressed as the square root of the sum of the squares of the elements of the feature vector. The L2 norm is used to normalize each pixel feature and normalize the length of the pixel feature to 1, ensuring the uniformity of the scale between different pixel features.

[0069] In one embodiment of the present application, the process of clustering the normalized location features to obtain location clusters includes: clustering the normalized location features to obtain the location clusters. Based on N input clusters, the normalized location features are clustered using a kmeans clustering algorithm to obtain N location clusters. Each input cluster includes a number of points.

[0070] Exemplarily, during the first point set transformation, the normalized position features with a shape of (h*w, D) and N input clusters are clustered using the kmeans clustering algorithm to obtain N position clusters with a shape of (N, 2).

[0071] In one embodiment of the present application, the process of performing similarity calculation on the normalized pixel features and the position clusters, and obtaining the pixel clusters based on the calculation results includes: performing cosine similarity calculation on the normalized pixel features and the center points of the position clusters, and clustering the pixel features into a plurality of pixel clusters based on the calculated cosine similarities.

[0072] Exemplarily, during the first point set transformation, cosine similarity calculation is performed based on the normalized pixel features of shape (h*w, D) and N position clusters of shape (N, 2) to obtain N pixel clusters of shape (N, 3), where each pixel cluster includes a number of points.

[0073] In one embodiment of the present application, the process of obtaining the target point set according to the index of the center point in the pixel cluster includes: selecting points with the same index in the pixel point set as the target point set according to the index of the center point in the pixel cluster.

[0074] Exemplarily, each pixel in the pixel set is associated with a unique position index (for example, the index of the pixel in the first point set transformation module is 0 to h * w), which remains unchanged during the processing. In the clustering process, each cluster consists of multiple pixel features, but the center point feature of each cluster is unique. Through the index of this center point, we can retrieve the corresponding pixel from the original pixel set, thereby constructing a new point set, which contains the same number of pixels as the number of center points, that is, N center points correspond to N pixels. By referencing the index of the center point of the pixel cluster, we can filter out the corresponding pixel from the pixel set to form a new set as the target point set. This process ensures that the structure of the output point set is consistent with the input cluster structure. Each cluster center point represents the feature of a pixel, realizing the aggregation and abstraction of features.

[0075] In one embodiment of the present application, the process of processing the target point set to obtain the feature map includes: inputting the target point set into a Transformer Encoder module to obtain the feature map.

[0076] Exemplarily, the target point set is processed using the Transformer Encoder block to obtain a feature map with a shape of ((h / / 16) * (w / / 16), D).

[0077] Figure 5 The following is a schematic diagram of the process of obtaining target detection results in one embodiment of the present application. Figure 5 As shown, the process of obtaining the target detection result according to the feature map includes:

[0078] S41, using an MLP (Multilayer Perceptron) model to process the feature map to obtain rectangular frame coordinates and probability distribution.

[0079] Exemplarily, each point in the feature map may correspond to an object in the image to be tested. Two different MLP models are used to process the feature map to obtain box and class. Among them, the first MLP is used to predict the parameters of the bounding box corresponding to these points, usually including the center position, width, height and possible rotation angle of the bounding box. The output of the MLP will undergo some necessary post-processing steps, such as decoding and non-maximum suppression (NMS), to generate the final bounding box prediction result. Box can be expressed as [x-axis upper left corner coordinate, y-axis upper left corner coordinate, x-axis lower right corner coordinate, y-axis lower right corner coordinate]. The second MLP is used to predict the category of the object in each bounding box, and the output is a vector, each element of which corresponds to a different category, and the value of the element represents the probability of belonging to that category.

[0080] S42, obtaining the target detection result according to the rectangular frame coordinates and the probability distribution. By applying a softmax function to the output vector, it can be converted into a probability distribution, thereby selecting the category with the highest probability as the prediction result.

[0081] For example, if the probability distribution of the target category is [0.5, 0.3, 0.1], the index with the largest probability value is selected as the target detection result.

[0082] In summary, the target detection method provided by the present application can regard the image as a collection of points, use the Transformer Encoder module to learn the feature representation between pixels, cluster similar pixel features through the kmeans clustering algorithm, and transition from the original pixel points to the center point after clustering, thereby reducing the dimension of the data and the number of points, and improving the processing efficiency of high-resolution images. And through the MLP model, the targets in the image are more accurately located and classified, and the recognition and detection of small targets and dense targets in complex scenes are realized. In this way, the model can improve the detection accuracy of small targets and dense targets in complex scenes, especially in high-resolution images, while reducing the consumption of computing resources. And according to different application scenarios and needs, by adjusting the number and parameters of the point set transformation, it can flexibly adapt to various target detection tasks. .

[0083] The protection scope of the target detection method described in the embodiment of the present application is not limited to the execution order of the steps listed in the present embodiment. All solutions implemented by adding, reducing or replacing steps in the prior art based on the principles of the present application are included in the protection scope of the present application.

[0084] An embodiment of the present application also provides a target detection system, which can implement the target detection method described in the present application. However, the implementation device of the target detection method described in the present application includes but is not limited to the structure of the target detection system listed in the present embodiment. All structural deformations and replacements of the prior art made according to the principles of the present application are included in the protection scope of the present application.

[0085] Figure 6 The diagram is a schematic diagram of the structure of a target detection system in one embodiment of the present application. Figure 6 As shown, the target detection system 2 includes: a point set processing module 21, a feature map acquisition module 22, and a target detection result acquisition module 23. Among them, the point set processing module 21 is used to perform several point set transformations on the point set to obtain a target point set. The feature map acquisition module 22 is used to process the target point set to obtain a feature map. The target detection result acquisition module 23 is used to obtain a target detection result according to the feature map. Among them, the input point set of the first point set transformation is the image to be detected, the input point set of the remaining point set transformations is the output point set of the last point set transformation, and the output point set of the last point set transformation is the target point set; the process of the point set transformation includes: obtaining normalized position features and normalized pixel features according to the input point set; clustering the normalized position features to obtain position clusters; performing similarity calculation on the normalized pixel features and the position clusters, and obtaining pixel clusters according to the calculation results; obtaining the output point set according to the index of the center point in the pixel cluster.

[0086] It should be noted that Figure 6 The modules in the target detection system 2 are shown in FIG. Figure 2 The steps in the target detection method correspond to each other and will not be described in detail here.

[0087] In the several embodiments provided in the present application, it should be understood that the disclosed system, device or method can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of modules / units is only a logical function division. There may be other division methods in actual implementation, such as multiple modules or units can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or modules or units, which can be electrical, mechanical or other forms.

[0088] The modules / units described as separate components may or may not be physically separated, and the components displayed as modules / units may or may not be physical modules, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules / units may be selected according to actual needs to achieve the purpose of the embodiments of the present application. For example, the functional modules / units in the various embodiments of the present application may be integrated into one processing module, or each module / unit may exist physically separately, or two or more modules / units may be integrated into one module / unit.

[0089] Those of ordinary skill in the art should further appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in the above description according to function. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0090] The embodiment of the present application also provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by the processor, the target detection method provided by the embodiment of the present application is implemented. A person of ordinary skill in the art can understand that all or part of the steps in the method for implementing the above embodiment can be completed by instructing the processor through a program, and the program can be stored in a computer-readable storage medium, and the storage medium is a non-transitory medium, such as a random access memory, a read-only memory, a flash memory, a hard disk, a solid-state hard disk, a magnetic tape, a floppy disk, an optical disc, and any combination thereof. The above storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or a data center that includes one or more available media integrated. The available medium can be a magnetic medium (for example, a floppy disk, a hard disk, a tape), an optical medium (for example, a digital video disc (DVD)), or a semiconductor medium (for example, a solid-state disk (SSD)), etc.

[0091] The embodiment of the present application may also provide an electronic device. Figure 7 The diagram shows a schematic diagram of the structure of an electronic device 3 in an embodiment of the present application. Figure 7 As shown, in this embodiment, the electronic device 3 includes a memory 31 and a processor 32 .

[0092] The memory 31 is used to store computer programs. In some possible implementations, the memory 31 may include: ROM, RAM, a disk, a USB disk, a memory card, or an optical disk, etc., various media that can store program codes.

[0093] In the embodiment of the present application, the memory 31 may include a computer system readable medium in the form of a volatile memory, such as a RAM and / or a cache memory. The electronic device 3 may further include other removable / non-removable, volatile / non-volatile computer system storage media. The memory 31 may include at least one program product, which has a set (e.g., at least one) of program modules, which are configured to perform the functions of each embodiment of the present application.

[0094] The processor 32 is connected to the memory 31 and is used to execute the computer program stored in the memory 31 so that the electronic device 3 executes the target detection method.

[0095] Exemplarily, the processor 32 may be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc. In other embodiments, the processor 22 may also be a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components.

[0096] The descriptions of the processes or structures corresponding to the above-mentioned figures have different emphases. For parts that are not described in detail in a certain process or structure, please refer to the relevant descriptions of other processes or structures.

[0097] The above embodiments are merely illustrative of the principles and effects of the present application and are not intended to limit the present application. Anyone familiar with the technology may modify or change the above embodiments without violating the spirit and scope of the present application. Therefore, all equivalent modifications or changes made by a person of ordinary skill in the art without departing from the spirit and technical ideas disclosed in the present application shall still be covered by the claims of the present application.

Claims

1. A target detection method, characterized in that: The target detection method comprises: Perform several point set transformations on the point set to obtain the target point set; Processing the target point set to obtain a feature map; Acquire a target detection result according to the feature map; The input point set of the first point set transformation is the image to be detected, the input point set of the remaining point set transformations is the output point set of the last point set transformation, and the output point set of the last point set transformation is the target point set; The process of point set transformation includes: Obtain normalized position features and normalized pixel features based on the input point set; Clustering the normalized location features to obtain location clusters; Performing similarity calculation on the normalized pixel features and the position cluster, and obtaining a pixel cluster according to the calculation result; According to the index of the center point in the pixel cluster, an output point set is obtained.

2. The target detection method according to claim 1, characterized in that: The process of obtaining normalized position features and normalized pixel features based on the input point set includes: Acquire a position point set and a pixel point set according to the input point set; Performing feature extraction on the position point set and the pixel point set to obtain position features and pixel features; The position feature and the pixel feature are normalized to obtain the normalized position feature and the normalized pixel feature.

3. The target detection method according to claim 1, characterized in that: The process of clustering the normalized location features to obtain location clusters includes: clustering the normalized location features using a kmeans clustering algorithm to obtain the location clusters.

4. The target detection method according to claim 1, characterized in that: The process of performing similarity calculation on the normalized pixel features and the position clusters and obtaining the pixel clusters according to the calculation results includes: performing cosine similarity calculation on the normalized pixel features and the center points of the position clusters, and clustering the pixel features into a plurality of the pixel clusters according to the calculated cosine similarities.

5. The target detection method according to claim 1, characterized in that: The process of obtaining the target point set according to the index of the center point in the pixel cluster includes: selecting points with the same index as the target point set according to the index of the center point in the pixel cluster.

6. The target detection method according to claim 1, characterized in that: The process of processing the target point set to obtain a feature map includes: inputting the target point set into a Transformer Encoder module to obtain the feature map.

7. The target detection method according to claim 1, characterized in that: The process of obtaining the target detection result according to the feature map includes: The feature map is processed using the MLP model to obtain rectangular frame coordinates and probability distribution; The target detection result is obtained according to the rectangular frame coordinates and the probability distribution.

8. A target detection system, characterized in that: The target detection system comprises: A point set processing module is used to perform several point set transformations on the point set to obtain a target point set; A feature map acquisition module, used for processing the target point set to obtain a feature map; A target detection result acquisition module, used to acquire the target detection result according to the feature map; The input point set of the first point set transformation is the image to be detected, the input point set of the remaining point set transformations is the output point set of the last point set transformation, and the output point set of the last point set transformation is the target point set; The process of point set transformation includes: Obtain normalized position features and normalized pixel features based on the input point set; Clustering the normalized location features to obtain location clusters; Performing similarity calculation on the normalized pixel features and the position cluster, and obtaining a pixel cluster according to the calculation result; According to the index of the center point in the pixel cluster, an output point set is obtained.

9. An electronic device, characterized in that: The electronic device comprises: a memory having a computer program stored thereon; A processor is communicatively connected to the memory, and is used to execute the computer program to implement the target detection method according to any one of claims 1 to 7.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by an electronic device, the target detection method according to any one of claims 1 to 7 is implemented.

Images