Laser batch processing method, equipment, system and medium

Abstract

The embodiment of the invention discloses a laser batch processing method, device and system and a medium. The method comprises the following steps: acquiring a first image obtained by shooting a processing area in which a plurality of to-be-processed materials are placed; acquiring a rough position of a reference object material in the plurality of to-be-processed materials based on the first image, acquiring a second image of the reference object material, and acquiring a processing element filled on the reference object material in the second image of the reference object material; acquiring a second image of each to-be-processed material based on the rough position of each to-be-processed material except the reference material in the first image; based on the second image of the reference material, the second image of each to-be-processed material and the relative position information of the processing elements on the reference material, each to-be-processed material is filled with the processing elements in the first image, so that batch processing is conducted on the multiple to-be-processed materials. According to the technical scheme, automatic laser batch machining is achieved, and the reliability of laser batch machining is high.

Description

Technical Field

[0001] The present application relates to the field of laser processing technology, and in particular to a laser batch processing method, laser processing equipment, system, and computer-readable medium. Background Art

[0002] Laser processing equipment is a device that uses laser beams for processing. It can use laser beams to cut, punch, and engrave various materials such as metals, plastics, wood, glass, textiles, etc. In the related art, when using laser processing equipment to realize laser batch processing of materials to be processed, it is usually necessary to manually place and align the materials to be processed. This process is time-consuming and labor-intensive, reducing the efficiency of laser batch processing. In addition, manual placement and alignment are prone to errors, reducing the accuracy of laser batch processing.

[0003] Therefore, how to improve the reliability of laser batch processing is an urgent problem to be solved. Summary of the invention

[0004] To solve the above technical problems, the embodiments of the present application provide a laser batch processing method, a laser batch processing device, a system, a laser processing equipment, a computer-readable storage medium, and a computer program product. The embodiments of the present application realize automated laser batch processing, improve the efficiency and accuracy of laser batch processing, and the reliability of laser batch processing is high.

[0005] One aspect of an embodiment of the present application provides a laser batch processing method, the method comprising: acquiring a first image obtained by photographing a processing area where a plurality of materials to be processed are placed; acquiring a rough position of a reference material among the plurality of materials to be processed based on the first image, and acquiring a second image of the reference material, and acquiring processing elements filled on the reference material in the second image of the reference material; acquiring a second image of each material to be processed based on the rough position of each material to be processed except the reference material in the first image; filling each material to be processed in the first image with the processing elements based on the second image of the reference material, the second image of each material to be processed, and the relative position information of the processing elements on the reference material, so as to perform batch processing on the plurality of materials to be processed.

[0006] Another aspect of an embodiment of the present application provides a laser batch processing device, the device comprising: a first acquisition module, configured to acquire a first image obtained by photographing a processing area where a plurality of materials to be processed are placed; a second acquisition module, configured to acquire a rough position of a reference material among the plurality of materials to be processed based on the first image, and acquire a second image of the reference material, and acquire processing elements filled on the reference material in the second image of the reference material; a third acquisition module, configured to acquire a second image of each material to be processed based on the rough position of each material to be processed except the reference material in the first image; a filling module, configured to fill each material to be processed in the first image with the processing elements based on the second image of the reference material, the second image of each material to be processed, and the relative position information of the processing elements on the reference material, so as to perform batch processing on the plurality of materials to be processed.

[0007] Another aspect of an embodiment of the present application provides a laser processing device, including a processing head, a long-range camera, a close-range camera, a communication component and a controller, wherein the long-range camera is used to capture a first image; the close-range camera is used to capture a second image; the communication component is used to output the first image and the second image, and receive processing instructions obtained according to the steps of the laser batch processing method as described above; and the controller controls the long-range camera, the close-range camera and the processing head based on the processing instructions to perform laser processing.

[0008] According to another aspect of an embodiment of the present application, a laser processing system is provided, including a laser processing device and a terminal device, wherein the laser processing device includes a base plate and a processing head, the base plate includes a processing area for placing materials, and the processing head is used to move on the processing area; the terminal device is communicatively connected to the laser processing device, and the terminal device is used to execute the laser batch processing method as described above.

[0009] Another aspect of an embodiment of the present application provides an electronic device, comprising: one or more processors and a memory, the memory being used to store one or more computer programs, and when the one or more computer programs are executed by the one or more processors, the electronic device implements the laser batch processing method as described above.

[0010] In another aspect of an embodiment of the present application, a computer-readable storage medium is provided, on which computer-readable instructions are stored. When the computer-readable instructions are executed by a processor of a computer, the computer executes the above-mentioned laser batch processing method.

[0011] Another aspect of an embodiment of the present application provides a computer program product, including a computer program, which implements the above laser batch processing method when executed by a processor.

[0012] In the technical solution provided in the embodiment of the present application, by acquiring the first images of multiple materials to be processed, the second image of the reference material determined from the multiple materials to be processed, and the second image of each of the remaining materials to be processed, and using the multiple images to fill in the processing elements on each material to be processed, automated laser batch processing is achieved; compared with the related technical solutions, there is no need to manually place and align the materials to be processed, which saves manpower and material resources, improves the efficiency of laser batch processing, and also avoids the phenomenon that manual placement and alignment of materials to be processed are prone to errors, ensuring the consistency of laser batch processing, thereby improving the accuracy of laser batch processing. Therefore, the reliability of laser batch processing in the technical solution provided in the embodiment of the present application is high. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Figure 1 is a schematic diagram of an exemplary laser processing system of the present application;

[0014] Figure 2 is a flow chart of a laser batch processing method shown in an exemplary embodiment of the present application;

[0015] Figure 3 is a flow chart of a laser batch processing method shown in another exemplary embodiment of the present application;

[0016] Figure 4 is a schematic diagram of a first image shown in an exemplary embodiment of the present application;

[0017] Figure 5 is a schematic diagram of a second image shown in an exemplary embodiment of the present application;

[0018] Figure 6 is a schematic diagram of a foreground area image shown in an exemplary embodiment of the present application;

[0019] Figure 7a to Figure 7b is a schematic diagram of laser batch processing shown in an exemplary embodiment of the present application;

[0020] Figure 8 is a block diagram of a laser batch processing device shown in an exemplary embodiment of the present application;

[0021] Fig. 9 is a schematic structural diagram of a laser processing device shown in an exemplary embodiment of the present application;

[0022] Fig.10 It is a structural diagram of a computer system suitable for implementing an electronic device of an embodiment of the present application. DETAILED DESCRIPTION

[0023] Here, exemplary embodiments will be described in detail, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are only examples of devices and methods consistent with some aspects of the present application as detailed in the attached claims.

[0024] The block diagrams shown in the accompanying drawings are merely functional entities and do not necessarily correspond to physically independent entities. That is, these functional entities may be implemented in software form, or in one or more hardware modules or integrated circuits, or in different networks and / or processor devices and / or microcontroller devices.

[0025] The flowcharts shown in the accompanying drawings are only exemplary and do not necessarily include all the contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps can be decomposed, and some operations / steps can be combined or partially combined, so the actual execution order may change according to actual conditions.

[0026] The term "multiple" as used in this application refers to two or more than two. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the related objects are in an "or" relationship.

[0027] The terms "first", "second", "third" and "fourth" in the specification, claims and drawings of this application are used to distinguish different objects, rather than to describe a specific order. The terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally includes steps or units that are not listed, or optionally includes other steps or units inherent to these processes, methods, products or devices.

[0028] In the embodiments of the present application, the term "module" or "unit" refers to a computer program or a part of a computer program with a predetermined function, and works together with other related parts to achieve a predetermined goal, and can be implemented in whole or in part by using software, hardware (such as processing circuits or memories) or a combination thereof. Similarly, a processor (or multiple processors or memories) can be used to implement one or more modules or units. In addition, each module or unit can be part of an overall module or unit that includes the function of the module or unit.

[0029] See also Figure 1 , Figure 1 This is a schematic diagram of an exemplary laser processing system of the present application. With the development of laser processing equipment, laser processing equipment has gradually become intelligent and convenient. Users can conveniently use laser processing equipment to achieve laser batch processing on the materials to be processed by controlling the host computer software installed on the terminal device. Figure 1 As shown, the laser processing system 100 includes a terminal device 101 and a laser processing device 102. The terminal device 101 is communicatively connected to the laser processing system 102. The terminal device 101 is installed with host computer software of the laser processing device 102. The host computer software provides a device control interface. The user can use the laser processing device 102 to realize laser batch processing on the material to be processed by performing relevant trigger operations (such as editing processing patterns, setting processing parameters, etc.) on the device control interface.

[0030] In the process of using laser processing equipment to realize laser batch processing of materials to be processed, it is usually necessary to manually place and align the materials to be processed. This process is time-consuming and labor-intensive, reducing the efficiency of laser batch processing, and manual placement and alignment are also prone to errors, reducing the accuracy of laser batch processing. Therefore, in order to improve the efficiency and accuracy of laser batch processing and ensure the reliability of laser batch processing, this application provides a laser batch processing solution.

[0031] In one embodiment of the present application, the laser batch processing method can be executed by the terminal device 101 (specifically, it can be the upper computer software in the terminal device 101), specifically: the terminal device 101 obtains a first image obtained by photographing a processing area where a plurality of materials to be processed are placed; then, based on the first image, a rough position of a reference material among the plurality of materials to be processed is obtained, and a second image of the reference material is obtained, and a processing element filled on the reference material in the second image of the reference material is obtained; at the same time, based on the rough position of each material to be processed except the reference material in the first image, a second image of each material to be processed is obtained; then, based on the second image of the reference material, the second image of each material to be processed, and the relative position information of the processing element on the reference material, the processing element is filled in each material to be processed in the first image to perform batch processing on the plurality of materials to be processed.

[0032] In one embodiment of the present application, the laser batch processing method can also be executed by the laser processing equipment 102, or the laser processing equipment 102 and the terminal device 101 can be executed interactively. In actual applications, the execution subject of the laser batch processing method can be flexibly adjusted according to the specific application scenario.

[0033] It should be clear that the terminal device 101 includes but is not limited to smart phones, computers (tablet computers, laptops, desktop computers, etc.). The laser processing equipment 102 includes but is not limited to laser engraving machines, laser cutting machines, laser printers, etc.; Optionally, the laser processing equipment 102 has a long-range camera and a close-range camera, wherein the long-range camera has a larger shooting range and can be used to shoot a processing area where multiple materials to be processed are placed to obtain a first image, and the close-range camera has a smaller shooting range and can be used to shoot a certain material to be processed to obtain a second image. Optionally, the laser processing equipment 102 has a zoomable camera, which can shoot a processing area where multiple materials to be processed are placed at a first focal length to obtain a first image, and can shoot a certain material to be processed at a second focal length to obtain a second image, and the second focal length is greater than the first focal length. Among them, the first image can be a panoramic image, and the second image is a close-range image of a certain material to be processed.

[0034] It should be noted that the number of terminal devices 101 and laser processing devices 102 is only schematic, and any number of terminal devices 101 and laser processing devices 102 may be provided according to actual needs.

[0035] It is understandable that in the specific implementation of this application, user-related data is involved. When the embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of relevant data need to comply with relevant laws, regulations and standards of relevant countries and regions.

[0036] The following is a detailed description of various implementation details of the technical solution of the embodiment of the present application:

[0037] See also Figure 2 , Figure 2 1 is a flow chart of a laser batch processing method according to an embodiment of the present application. The present application takes the laser batch processing method executed by the terminal device 101 (specifically, it can be the host computer software in the terminal device 101) as an example for explanation. The principle of the laser batch processing method executed by the laser processing device 102 is similar and will not be described in detail here. Figure 2 As shown, the laser batch processing method at least includes S201 to S204, which are described in detail as follows:

[0038] S201, acquiring a first image obtained by photographing a processing area where a plurality of materials to be processed are placed.

[0039] In the embodiments of the present application, the material to be processed refers to any type of material to be processed, including but not limited to metal, plastic, wood, glass, textile, etc., and the material to be processed can be of any shape, including but not limited to regular polygons (such as triangles, squares, rectangles, etc.) and irregular polygons (such as five-pointed stars, etc.). Among them, the number of materials to be processed is multiple (i.e., two or more), and the materials and / or shapes of different materials to be processed can be the same or different. In practical applications, it shall be based on the specific laser batch processing requirements.

[0040] In the embodiment of the present application, the first image refers to an image obtained by photographing multiple materials to be processed placed in the processing area, which includes multiple materials to be processed.

[0041] In one embodiment of the present application, the process of obtaining the first image obtained by photographing the processing area where multiple materials to be processed are placed in S201 may include: controlling the long-range camera of the laser processing equipment to photograph the processing area where multiple materials to be processed are placed to obtain the first image.

[0042] That is, in the optional embodiment, the laser processing equipment has a long-range camera. Since the long-range camera has a large shooting range, the terminal device can control the long-range camera to shoot a plurality of materials to be processed placed in the processing area to obtain a first image. In this way, by implementing the optional embodiment, the long-range camera in the laser processing equipment can be used to easily obtain the first image, thereby providing strong support for laser batch processing.

[0043] Among them, in an optional embodiment, the process of controlling the long-range camera of the laser processing equipment to photograph the processing area where multiple materials to be processed are placed to obtain a first image may include: generating a global shooting instruction, and sending the global shooting instruction to the laser processing equipment, so that the laser processing equipment controls the long-range camera based on the global shooting instruction to photograph the multiple materials to be processed placed in the processing area to obtain the first image; and receiving the first image sent by the laser processing equipment.

[0044] That is, in the optional embodiment, the terminal device sends the generated global shooting instruction to the laser processing device, and accordingly, the laser processing device receives the global shooting instruction, and uses the global shooting instruction to control the long-range camera to shoot and obtain the first image, and then sends the first image to the laser processing device, and accordingly, the laser processing device receives the first image. In this way, by implementing the optional embodiment, the terminal device sends the global shooting instruction according to the demand and interacts with the laser processing device, so that the first image can be easily obtained.

[0045] In one embodiment of the present application, the process of obtaining a first image obtained by photographing a processing area where a plurality of materials to be processed are placed in S201 may include: generating acquisition information for the first image, and displaying the acquisition information in an editable interface; displaying the first image in the editable interface, where the first image is obtained by a user photographing and uploading the plurality of materials to be processed placed in the processing area using a photographing device.

[0046] That is, in the optional embodiment, the terminal device displays the generated acquisition information, so that after the user views the acquisition information, the user can use a shooting device (such as a camera of the terminal device or a camera of other devices) to shoot the processing area where multiple materials to be processed are placed to obtain a first image, and send the first image to the terminal device. Accordingly, the terminal device receives the first image. In this way, by implementing the optional embodiment, the first image can be easily obtained by shooting with an external shooting device, thereby providing strong support for laser batch processing.

[0047] S202, obtaining a rough position of a reference material among a plurality of materials to be processed based on the first image, obtaining a second image of the reference material, and obtaining processing elements filled on the reference material in the second image of the reference material.

[0048] In the embodiment of the present application, the terminal device obtains a first image, and then can use the rough position of a reference material among multiple materials to be processed in the first image to obtain a second image of the reference material, and then can fill the reference material with processing elements on the second image of the reference material, and obtain the filled processing elements and the relative position information of the filled processing elements on the reference material.

[0049] In the embodiment of the present application, the reference material refers to a material to be processed selected from a plurality of materials to be processed and used for the first filling of processing elements so as to provide a reference for filling processing elements in the remaining materials to be processed, wherein the remaining materials to be processed refer to all materials to be processed among the plurality of materials to be processed except the reference material.

[0050] The second image of the reference material in the embodiment of the present application refers to an image obtained by photographing the reference material placed in the processing area, which includes the reference material. The rough position of the reference material refers to the approximate position of the reference material in the processing area.

[0051] In the embodiment of the present application, the processing element refers to any pattern that needs to be processed, including but not limited to text, letters, line patterns, pictures, or a combination of these.

[0052] In one embodiment of the present application, the process of obtaining the rough position of a reference material among multiple materials to be processed based on the first image in S202, and obtaining a second image of the reference material, may include: determining the rough position of the reference material selected from the multiple materials to be processed in the processing area based on the first image, and moving the close-up camera of the laser processing equipment based on the rough position of the reference material, and controlling the close-up camera to shoot the reference material to obtain a second image of the reference material.

[0053] That is, in the optional embodiment, the terminal device uses the first image to determine the rough position of the reference material, and the laser processing equipment has a close-up camera. Since the shooting range of the close-up camera is small, the terminal device can control the close-up camera to move to the reference material placed in the processing area and shoot according to the rough position of the reference material to obtain the second image of the reference material. In this way, by implementing the optional embodiment, the second image of the reference material can be easily obtained by shooting with the close-up camera in the laser processing equipment, thereby providing strong support for laser batch processing; and the distortion of the close-up camera is smaller than that of the long-range camera, making the second image of the reference material more accurate.

[0054] In one embodiment of the present application, the process of obtaining the rough position of a reference material among multiple materials to be processed based on the first image in S202, and obtaining a second image of the reference material, may include: controlling the camera of the laser processing equipment to shoot the processing area where the multiple materials to be processed are placed with a first focal length to obtain a first image.

[0055] That is, in the optional embodiment, the camera zoom of the laser processing device is controlled so that the camera is at the first focal length. In this way, by implementing the optional embodiment and utilizing the camera zoom process, the second image of the reference material can be obtained simply and accurately.

[0056] Among them, in an optional embodiment, the process of determining the rough position of a reference material selected from multiple materials to be processed in the processing area based on the first image may include: displaying the first image in an editable interface; in response to a selection operation on multiple materials to be processed in the first image, determining the selected material to be processed as the reference material, and obtaining the rough position of the reference material.

[0057] That is, in an optional embodiment, the terminal device interacts with the user to determine the reference material from the multiple materials to be processed, obtain the position of the reference material in the first image, and then determine the rough position of the reference material in the processing area based on the position of the reference material in the first image. Optionally, the selection operation can be a box selection operation or a point selection operation.

[0058] Among them, in an optional embodiment, the process of moving the close-up camera of the laser processing equipment based on the rough position of the reference material, and controlling the close-up camera to shoot the reference material to obtain a second image of the reference material may include: generating a first local shooting instruction, the first local shooting instruction including the rough position of the reference material, and sending the first local shooting instruction to the laser processing equipment, so that the laser processing equipment moves the close-up camera to the vicinity of the reference material placed in the processing area based on the rough position of the reference material in the first local shooting instruction, and controls the close-up camera to shoot the reference material to obtain a second image of the reference material; and receiving the second image of the reference material sent by the laser processing equipment.

[0059] That is, in the optional embodiment, the terminal device sends the generated first partial shooting instruction to the laser processing device. Accordingly, the laser processing device receives the first partial shooting instruction, and uses the rough position of the reference material in the first partial shooting instruction to move the close-range camera to the position of the reference material placed in the processing area and shoot, thereby obtaining a second image of the reference material, and sending the second image of the reference material to the terminal device. Accordingly, the terminal device receives the second image of the reference material. In this way, by implementing the optional embodiment, the terminal device issues the first partial shooting instruction according to demand and interacts with the laser processing device, so as to easily obtain the second image of the reference material.

[0060] In other embodiments, an external photographing device may be used to photograph and obtain a second image of the reference material. The specific process is similar to that of photographing and obtaining the first image using an external photographing device, and will not be described in detail here.

[0061] S203, acquiring a second image of each material to be processed based on the rough position of each material to be processed except the reference material in the first image.

[0062] In the embodiment of the present application, the terminal device determines the reference material, and then can use the rough positions of the remaining materials to be processed to obtain the second image of each material to be processed.

[0063] The second image of the material to be processed in the embodiment of the present application refers to the image obtained by photographing the remaining materials to be processed placed in the processing area, which includes the remaining materials to be processed. The rough position of the remaining materials to be processed refers to the approximate position of the remaining materials to be processed in the processing area; it should be clear that if there are two materials to be processed, the reference material is one of them, and the number of the remaining materials to be processed is one; if there are three or more materials to be processed, the reference material is one of them, and the number of the remaining materials to be processed is two or more. Accordingly, the rough position of the remaining materials to be processed refers to the rough position of each material to be processed in the remaining materials to be processed. For ease of understanding, the embodiment of the present application takes the example of three or more materials to be processed, and the rough position of each material to be processed in the remaining materials to be processed is referred to as the rough position of each material to be processed.

[0064] In one embodiment of the present application, the process of obtaining a second image of each material to be processed based on the rough position of each material to be processed except the reference material in the first image in S203 may include: determining the rough position of each material to be processed in the processing area based on the first image, and moving the close-up camera of the laser processing equipment based on each rough position, and controlling the close-up camera to shoot each material to be processed to obtain a second image of each material to be processed.

[0065] That is, in the optional embodiment, the terminal device uses the first image to determine the rough position of each material to be processed, and the laser processing equipment has a close-up camera. Since the shooting range of the close-up camera is small, the terminal device can move the close-up camera to each material to be processed placed in the processing area according to the rough position of each material to be processed and shoot, thereby obtaining the second image of each material to be processed. In this way, by implementing the optional embodiment, the close-up camera in the laser processing equipment can be used to easily obtain the second image of each material to be processed, thereby providing strong support for laser batch processing; and the distortion of the close-up camera is smaller than that of the long-range camera, making the second image of the material to be processed more accurate.

[0066] In one embodiment of the present application, the process of obtaining the second image of each material to be processed based on the rough position of each material to be processed except the reference material in the first image in S203 may include: determining the rough position of each material to be processed in the processing area based on the first image, and moving the camera of the laser processing equipment based on each rough position, and controlling the camera to shoot each material to be processed with a second focal length, and obtaining the second image of each material to be processed to control the camera of the laser processing equipment.

[0067] That is, in the optional embodiment, the camera can be moved to the corresponding material to be processed, and the camera can be controlled to be at a second focal length to capture the second image of the material to be processed. In this way, by implementing the optional embodiment and using the camera zoom processing, the second image of the material to be processed can be obtained simply and accurately.

[0068] Among them, in an optional embodiment, the process of determining the rough position of each material to be processed in the processing area based on the first image may include: performing target detection on the first image to obtain multiple first candidate frames located in the first image; based on the position of each first candidate frame in the first image, obtaining the rough position of each material to be processed in the processing area.

[0069] That is, in the optional embodiment, the terminal device first performs target detection on the first image to obtain a plurality of first candidate frames located in the first image, and then uses the position of each first candidate frame in the first image to obtain the rough position of each material to be processed in the processing area. In this way, by implementing the optional embodiment, the target detection is directly performed on the first image, and each material to be processed can be located intuitively and accurately from the first image, so that the rough position of each material to be processed can be obtained simply and accurately.

[0070] It is understandable that in the optional embodiment, the first candidate frame may select the material to be processed (the material to be processed is complete or incomplete), or may not select the material to be processed. Usually, the number of first candidate frames is greater than or equal to the number of materials to be processed placed in the processing area. In the case where the first candidate frame selects the incomplete material to be processed, the position of the first candidate frame in the first image can be obtained; in the case where the first candidate frame does not select the material to be processed, it can be ignored. Specifically, multiple target first candidate frames that select the material to be processed (which may be complete or incomplete) can be selected from multiple first candidate frames, and then based on the position of each target first candidate frame in the first image, the rough position of each material to be processed in the processing area can be obtained.

[0071] Optionally, the process of performing target detection on the first image in the optional embodiment to obtain multiple first candidate frames located in the first image may include: performing feature extraction on the first image to obtain a first semantic feature corresponding to the first image; performing target detection on the first image based on the first semantic feature to generate multiple first candidate frames located in the first image. In this way, by implementing the optional embodiment, the first semantic feature of the first image, which is a high-level abstract feature, can accurately detect targets in the first image, thereby improving the accuracy of target detection on the first image.

[0072] Exemplarily, in the optional embodiment, the process of extracting features from the first image to obtain the first semantic features corresponding to the first image may include: preprocessing the first image, the preprocessing including at least one of image resizing, contrast enhancement, noise removal, color space conversion, and input format conversion; extracting features from the preprocessed first image to obtain the first semantic features corresponding to the preprocessed first image. In this way, by implementing the optional embodiment, the first semantic features are extracted after preprocessing the first image, which improves the accuracy of extracting the first semantic features, thereby improving the accuracy of target detection for the first image.

[0073] It can be understood that in the optional embodiment, image resizing is used to obtain a first image of a specified image size, which can be specifically increased or decreased in size; contrast enhancement is used to enhance the differences between different regions in the first image to improve the visual quality and information transmission capability of the image, which can be specifically achieved by histogram equalization, contrast stretching, histogram matching and other methods; noise removal is used to eliminate or reduce interference signals or pixels introduced by various factors from the first image, which can be specifically achieved by spatial domain filtering, frequency domain filtering, nonlinear filtering and other methods; color space conversion is used to adjust and optimize the color information of the first image, and common color spaces include RGB (Red, Green, Blue), HSV (Hue, Saturation, Value), Lab (Luminance, color channels a and b), etc.; input format conversion is used to obtain a first image of a specified format, and common formats include lossless compression format, lossy compression format, original image format, etc.

[0074] It should be clear that since the first image captured by the long-range camera is very likely to be distorted, in the optional embodiment, the first image may be firstly subjected to distortion correction, so that the corrected first image can be as close as possible to the state in the real scene, and then the first image after distortion correction is preprocessed. In this way, by implementing the optional embodiment, the first image is subjected to distortion correction and then preprocessed, which reduces the preprocessing time and thus improves the efficiency of target detection for the first image.

[0075] Optionally, in the optional embodiment, the process of performing target detection on the first image to obtain multiple first candidate boxes located in the first image may include: inputting the first image into a target detection model, performing target detection on the first image through the target detection model, and obtaining multiple first candidate boxes located in the first image; specifically, the target detection model may be used to perform feature extraction on the first image to obtain a first semantic feature corresponding to the first image, and then target detection is performed on the first image based on the first semantic feature to generate multiple first candidate boxes located in the first image. In this way, by implementing the optional embodiment, the first semantic feature corresponding to the first image can be easily and accurately obtained using the target detection model to generate the first candidate box, thereby improving the efficiency and accuracy of target detection for the first image. In practical applications, the target detection model can be trained according to the requirements of specific application scenarios.

[0076] Among them, in an optional embodiment, the process of moving the close-up camera of the laser processing equipment based on the rough position of each material to be processed, and controlling the close-up camera to shoot each material to be processed to obtain a second image of each material to be processed may include: generating a second local shooting instruction, the second local shooting instruction including the rough position of each material to be processed, and sending the second local shooting instruction to the laser processing equipment, so that the laser processing equipment moves the close-up camera to the vicinity of each material to be processed in the processing area based on the rough position of each material to be processed in the second local shooting instruction, and controls the close-up camera to shoot each material to be processed to obtain a second image of each material to be processed; and receiving the second image of each material to be processed sent by the laser processing equipment.

[0077] That is, in the optional embodiment, the terminal device sends the generated second partial shooting instruction to the laser processing device. Accordingly, the laser processing device receives the second partial shooting instruction, and uses the rough position of each material to be processed in the second partial shooting instruction to move the close-range camera to each material to be processed in the processing area and shoot, thereby obtaining the second image of each material to be processed, and sends the second image of each material to be processed to the terminal device. Accordingly, the terminal device receives the second image of each material to be processed. In this way, by implementing the optional embodiment, the terminal device issues the second partial shooting instruction according to demand and interacts with the laser processing device, so as to easily obtain the second image of each material to be processed.

[0078] In other embodiments, an external photographing device may be used to photograph and obtain a second image of each material to be processed. The specific process is similar to that of photographing and obtaining the first image using an external photographing device, and will not be described in detail here.

[0079] Among them, in an optional embodiment, the process of controlling the laser processing equipment to move the close-up camera based on each rough position, and controlling the close-up camera to shoot each material to be processed to obtain a second image of each material to be processed may include: based on the shooting angle information of the long-range camera and the material information corresponding to each material to be processed, correcting the rough position corresponding to each material to be processed to obtain the corrected position of each material to be processed in the processing area; moving the close-up camera based on each corrected position, and controlling the close-up camera to shoot each material to be processed to obtain a second image of each material to be processed.

[0080] As introduced in the aforementioned embodiment, the accuracy of the position of each material to be processed in the processing area obtained based on the first image is low; therefore, in an optional embodiment, the terminal device can first correct the position of each material to be processed in the processing area with low accuracy to obtain the position of each material to be processed in the processing area with high accuracy, and then use the position of each material to be processed in the processing area with high accuracy to control the close-range camera to shoot each material to be processed placed in the processing area to obtain a second image of each material to be processed.

[0081] It is understandable that in the optional embodiment, the terminal device uses the shooting angle information of the long-range camera (such as the tilt angle relative to the processing area, etc.) and the material information corresponding to each material to be processed (such as material thickness, reflectivity, etc.) to correct the rough position corresponding to each material to be processed, thereby obtaining the corrected position of each material to be processed in the processing area (i.e., a more accurate position relative to the rough position), and then moves the close-range camera to each corrected position to shoot, thereby obtaining the second image of each material to be processed. In this way, by implementing the optional embodiment, the rough position corresponding to each material to be processed is corrected before shooting, so as to ensure that each second image can include the material to be processed as much as possible, thereby improving the accuracy of close-range shooting.

[0082] Optionally, the material information in the optional embodiment includes material thickness; accordingly, in the optional embodiment, based on the shooting angle information of the long-range camera and the material information corresponding to each material to be processed, the rough position corresponding to each material to be processed is corrected to obtain the corrected position of each material to be processed in the processing area, which may include: generating correction information based on the shooting angle information of the long-range camera and the material thickness corresponding to each material to be processed; correcting the rough position of each material to be processed based on the correction information to obtain the corrected position of each material to be processed in the processing area. The correction information is used to indicate the direction of correction, step length, etc. In this way, by implementing the optional embodiment, the correction information can be generated simply and accurately, so that the correction information can be used to more accurately correct the rough position of each material to be processed, thereby improving the accuracy of the correction.

[0083] Optionally, in the optional embodiment, based on the shooting angle information of the long-range camera and the material information corresponding to each material to be processed, the rough position corresponding to each material to be processed is corrected to obtain the corrected position of each material to be processed in the processing area, which may include: inputting the shooting angle information of the long-range camera and the material information corresponding to each material to be processed into the correction model, and correcting the rough position corresponding to each material to be processed based on the shooting angle information of the long-range camera and the material information corresponding to each material to be processed by the correction model to obtain the corrected position of each material to be processed in the processing area; specifically, the correction model can generate correction information based on the shooting angle information of the long-range camera and the material thickness corresponding to each material to be processed, and then correcting the rough position of each material to be processed based on the correction information to obtain the corrected position of each material to be processed in the processing area. In this way, by implementing the optional embodiment, the correction information can be obtained simply and accurately using the correction model, thereby realizing correction, and improving the efficiency and accuracy of correction.

[0084] S204, based on the second image of the reference material, the second image of each material to be processed, and the relative position information of the processing elements on the reference material, fill the processing elements for each material to be processed in the first image to perform batch processing on multiple materials to be processed.

[0085] In the embodiment of the present application, the terminal device obtains the second image and processing elements of the reference material, and then can use the second image and processing elements of the reference material to obtain the relative position information of the processing elements on the reference material. Then, the second image of the reference material, the second image of each material to be processed, and the relative position information of the processing elements on the reference material can be used to fill the processing elements for each material to be processed in the first image, thereby realizing batch processing of multiple materials to be processed.

[0086] In one embodiment of the present application, the process of filling each material to be processed in the first image with processing elements based on the second image of the reference material, the second image of each material to be processed, and the relative position information of the processing elements on the reference material in S204 may include: determining the relative position information of the reference material and each material to be processed based on the second image of the reference material and the second image of each material to be processed; filling each material to be processed in the first image with processing elements based on the relative position information of the processing elements on the reference material, the reference material and the relative position information of each material to be processed.

[0087] Among them, in an optional embodiment, the relative position information of the reference material and each material to be processed refers to the relative position relationship between the reference material and each material to be processed, which includes but is not limited to the distance between the reference material and each material to be processed, the rotation angle of each material to be processed relative to the reference material, and whether there is a symmetrical relationship, etc.; wherein the number of relative position information of the reference material and each material to be processed is the same as the number of other materials to be processed.

[0088] Among them, in an optional embodiment, the relative position information of the processing element on the reference material refers to the relative position relationship between the processing element and the reference material, which includes but is not limited to the position, rotation angle, etc. of the processing element on the reference material, and the size of the processing element relative to the reference material; wherein the number of relative position information of the processing element on the reference material is the same as the number of processing elements.

[0089] In this way, by implementing the optional embodiment, after determining the relative position information between the reference material and each material to be processed, and then using the relative position information between the processing element on the reference material and the relative position information between the reference material and each material to be processed, each material to be processed in the first image can be easily and accurately filled with the processing element.

[0090] In one embodiment of the present application, the process of determining the relative position information of the reference material and each material to be processed based on the second image of the reference material and the second image of each material to be processed may include: obtaining a foreground image of the reference material based on the second image of the reference material, and obtaining a foreground image of each material to be processed based on the second image of each material to be processed; and determining the relative position information of the reference material and each material to be processed based on the foreground image of the reference material and the foreground image of each material to be processed.

[0091] That is, in the optional embodiment, the terminal device obtains the second image of the reference material, and then the foreground image of the reference material can be obtained by using the second image of the reference material, and the second image of each material to be processed can be obtained, and then the foreground image of each material to be processed can be obtained by using the second image of each material to be processed, and then the foreground image of the reference material and the foreground image of each material to be processed can be used to determine the relative position information of the reference material and each material to be processed. In this way, by implementing the optional embodiment, the corresponding foreground image is obtained based on the corresponding second image processing, and then the relative position information between the reference material and each material to be processed can be easily and accurately obtained by using the foreground image, thereby providing strong support for laser batch processing.

[0092] Among them, in an optional embodiment, the process of obtaining the foreground image of each material to be processed based on the second image of each material to be processed may include: performing target detection on the second image of each material to be processed to obtain a third candidate frame located in each second image; performing image foreground segmentation on each third candidate frame to obtain the foreground image corresponding to each material to be processed.

[0093] That is, in the optional embodiment, the terminal device first performs target detection on the second image of each material to be processed, thereby obtaining a third candidate frame located in each second image, and then performs image foreground segmentation on each third candidate frame, thereby obtaining a foreground image corresponding to each material to be processed. In this way, by implementing the optional embodiment, target detection is directly performed on the second image of each material to be processed, and each material to be processed can be intuitively and accurately located from the second image of each material to be processed, so that the foreground image corresponding to each material to be processed can be easily and accurately obtained.

[0094] It is understandable that in the optional embodiment, the third candidate frame may frame the material to be processed (the frame selected is a complete or incomplete material to be processed), or it may not frame the material to be processed. Usually, the number of third candidate frames is greater than or equal to the number of materials to be processed placed in the processing area. In the case where the third candidate frame selects an incomplete material to be processed, image foreground segmentation can be performed at this time; in the case where the third candidate frame does not frame the material to be processed, it can be ignored. Specifically, multiple target third candidate frames that frame the material to be processed (which can be a complete or incomplete material to be processed) can be selected from multiple third candidate frames, and then image foreground segmentation is performed on each target third candidate frame to obtain a foreground image corresponding to each material to be processed. At the same time, for the second image of the same material to be processed, one or more third candidate frames can be included; for example, when the size of the material to be processed is small, it is easy to shoot the material to be processed around it when shooting the material to be processed.

[0095] Optionally, in the optional embodiment, the process of performing target detection on the second image of each material to be processed to obtain a third candidate frame located in the second image of each material to be processed may include: performing feature extraction on the second image of each material to be processed to obtain a second semantic feature corresponding to the second image of each material to be processed; performing target detection on the second image of each material to be processed based on each second semantic feature to generate a third candidate frame located in the second image of each material to be processed. In this way, by implementing the optional embodiment, the second semantic feature of the second image of each material to be processed can be used as a high-level abstract feature to accurately perform target detection on the second image of each material to be processed, thereby improving the accuracy of target detection on the second image of each material to be processed.

[0096] Exemplarily, in the optional embodiment, the process of extracting features from the second image of each material to be processed to obtain the second semantic features corresponding to the second image of each material to be processed may include: preprocessing the second image of each material to be processed, the preprocessing including at least one of image resizing, contrast enhancement, noise removal, color space conversion, and input format conversion; extracting features from the preprocessed second image of each material to be processed to obtain the second semantic features corresponding to the preprocessed second image of each material to be processed. In this way, by implementing the optional embodiment, the second image of each material to be processed is preprocessed and then the second semantic features are extracted, which improves the accuracy of extracting each second semantic feature, thereby improving the accuracy of target detection for each second image of the material to be processed.

[0097] It can be understood that in the optional embodiment, image resizing is used to obtain a second image of a specified image size, which can be specifically increased or decreased in size; contrast enhancement is used to enhance the differences between different regions in the second image to improve the visual quality and information transmission capability of the image, which can be specifically achieved by histogram equalization, contrast stretching, histogram matching and other methods; noise removal is used to eliminate or reduce interference signals or pixels introduced by various factors from the second image, which can be specifically achieved by spatial domain filtering, frequency domain filtering, nonlinear filtering and other methods; color space conversion is used to adjust and optimize the color information of the second image, and common color spaces include RGB, HSV, Lab and the like; input format conversion is used to obtain a second image of a specified format, and common formats include lossless compression format, lossy compression format, original image format and the like.

[0098] Optionally, in the optional embodiment, the process of performing target detection on the second image of each material to be processed to obtain the third candidate frame located in each second image may include: inputting the second image of each material to be processed into the target detection model, performing target detection on the second image of each material to be processed through the target detection model, and obtaining the third candidate frame located in the second image of each material to be processed; specifically, the target detection model may be used to perform feature extraction on the second image of each material to be processed to obtain the second semantic features corresponding to the second image of each material to be processed, and then performing target detection on the second image of each material to be processed based on each second semantic feature to generate the third candidate frame located in the second image of each material to be processed. In this way, by implementing the optional embodiment, the target detection model can be used to easily and accurately obtain the second semantic features corresponding to the second image of each material to be processed to generate the third candidate frame, thereby improving the efficiency and accuracy of target detection for the second image of each material to be processed.

[0099] It should be noted that the target detection model for performing target detection on the second image of each material to be processed and the target detection model for performing target detection on the first image can be the same model or different models. In practical applications, they can be flexibly adjusted according to specific application scenarios.

[0100] Optionally, the process of performing image foreground segmentation on each third candidate frame in an optional embodiment to obtain a foreground image corresponding to each material to be processed may include: intercepting an image corresponding to the third candidate frame contained in the second image of each material to be processed to obtain a candidate frame image corresponding to the second image of each material to be processed; performing foreground segmentation on each candidate frame image based on the pixels contained in each candidate frame image to obtain a foreground image corresponding to each candidate frame image; and obtaining a foreground image corresponding to each material to be processed based on the foreground image corresponding to each candidate frame image.

[0101] It can be understood that there is a mapping relationship between the candidate frame diagram and the material to be processed; therefore, the foreground image corresponding to each candidate frame diagram in the optional embodiment is the foreground image of the material to be processed corresponding to each candidate frame diagram. In this way, by implementing the optional embodiment, foreground segmentation is performed on multiple candidate frame diagrams, and the foreground image corresponding to each material to be processed can be obtained simply and accurately, thereby improving the efficiency and accuracy of image foreground segmentation.

[0102] Optionally, in the optional embodiment, the process of performing image foreground segmentation on each third candidate frame to obtain the foreground image corresponding to each material to be processed may include: inputting each second image marked with the third candidate frame into the target segmentation model, performing image foreground segmentation on each third candidate frame through the target segmentation model, and obtaining the foreground image corresponding to each material to be processed; specifically, the image corresponding to the third candidate frame contained in the second image of each material to be processed can be intercepted by the target segmentation model to obtain the candidate frame image corresponding to the second image of each material to be processed, and then performing foreground segmentation on each candidate frame image based on the pixels contained in each candidate frame image to obtain the foreground image corresponding to each candidate frame image, and then obtaining the foreground image corresponding to each material to be processed based on the foreground image corresponding to each candidate frame image. In this way, by implementing the optional embodiment, the foreground image corresponding to each material to be processed can be obtained simply and accurately using the target segmentation model, thereby improving the efficiency and accuracy of image foreground segmentation. In practical applications, the target segmentation model can be trained according to the needs of specific application scenarios.

[0103] Among them, the process of obtaining a foreground image of a reference material based on a second image of the reference material in an optional embodiment may include: performing target detection on the second image of the reference material to obtain a second candidate frame in the second image of the reference material; performing image foreground segmentation on the second candidate frame to obtain a foreground image corresponding to the reference material.

[0104] That is, in the optional embodiment, the terminal device first performs target detection on the second image of the reference material, thereby obtaining a second candidate frame located in the second image of the reference material, and then performs image foreground segmentation on the second candidate frame, thereby obtaining a foreground image corresponding to the reference material. In this way, by implementing the optional embodiment, target detection is directly performed on the second image of the reference material, and the reference material can be intuitively and accurately located from the second image of the reference material, so that the foreground image corresponding to the reference material can be easily and accurately obtained.

[0105] It should be noted that the process of obtaining the foreground image of the reference material based on the second image of the reference material in the optional embodiment is similar to the process of obtaining the foreground image of each material to be processed based on the second image of each material to be processed in the aforementioned embodiment, and will not be repeated here.

[0106] Among them, in an optional embodiment, the process of determining the relative position information of the reference material and each material to be processed based on the foreground image of the reference material and the foreground image of each material to be processed may include: performing material integrity detection on the foreground image of each material to be processed; for a first foreground image whose material integrity is less than a preset integrity threshold, generating a spliced ​​second image of the material to be processed corresponding to the first foreground image, and determining the relative position information of the material to be processed and the reference material corresponding to the spliced ​​second image based on the spliced ​​second image and the foreground image of the reference material; for a second foreground image whose material integrity is greater than or equal to the preset integrity threshold, determining the relative position information of the material to be processed and the reference material corresponding to the second foreground image based on the second foreground image and the foreground image of the reference material.

[0107] It should be clear that since the second image of the material to be processed is obtained based on the rough position of the material to be processed, the second image of the material to be processed may not contain the complete material to be processed. Accordingly, the foreground image of the material to be processed may not contain the complete material to be processed, thereby affecting the determination of the relative position information between the reference material and the material to be processed; therefore, in an optional embodiment, the terminal device can perform an integrity detection on the foreground image of the material to be processed. If the integrity is low, the stitched second image with higher integrity obtained by image stitching can be used, and then the stitched second image and the foreground image of the reference material can be used to determine the relative position information of the material to be processed and the reference material corresponding to the stitched second image. If the integrity is high, the foreground image of the material to be processed and the foreground image of the reference material can be used to determine the corresponding relative position information of the material to be processed and the reference material.

[0108] Among them, in an optional embodiment, after the terminal device detects that there is a first foreground image among multiple foreground images whose material integrity is less than a preset integrity threshold, it is necessary to generate a spliced ​​second image of the material to be processed corresponding to the first foreground image, wherein the integrity of the material to be processed in the spliced ​​second image is greater than or equal to the preset integrity threshold, and then use the spliced ​​second image and the foreground image of the reference material to obtain the relative position information of the material to be processed and the reference material corresponding to the spliced ​​second image.

[0109] Among them, in an optional embodiment, after the terminal device detects that there is a second foreground image with an integrity greater than or equal to a preset integrity threshold among multiple foreground images, the second foreground image and the foreground image of the reference material can be directly used to obtain the relative position information of the material to be processed and the reference material corresponding to the spliced ​​second image.

[0110] In this way, by implementing the optional embodiment, the relative position information of the material to be processed and the reference material corresponding to the spliced ​​second image is determined after the material integrity detection, thereby improving the efficiency and accuracy of the relative position information determination. In practical applications, the preset integrity threshold can be flexibly set according to the specific application scenario, such as 100%, 95%, etc.

[0111] Optionally, in an optional embodiment, the process of performing material integrity detection on the foreground image of each material to be processed may include: obtaining the position of the material mask in the foreground image of each material to be processed; if it is detected that the position of the material mask is in the edge area of ​​the corresponding foreground image, the corresponding foreground image is determined as the first foreground image; if it is detected that the position of the material mask is in the non-edge area of ​​the corresponding foreground image, the corresponding foreground image is determined as the second foreground image. In this way, by implementing the optional embodiment, the material integrity detection is performed based on whether the material mask is in the edge area of ​​the foreground image, thereby improving the efficiency and accuracy of the material integrity detection. In practical applications, the edge area can be flexibly set according to the specific application scenario.

[0112] Optionally, the process of generating a spliced ​​second image of the material to be processed corresponding to the first foreground image in the optional embodiment may include: obtaining missing information for the material to be processed in the first foreground image; moving the close-up camera of the laser processing equipment based on the missing information, and controlling the close-up camera to shoot the material to be processed that should be included in the first foreground image to obtain a first reference image; splicing based on the first reference image to obtain a spliced ​​second image. Exemplarily, the first reference image may be one or more; when there is one first reference image, the second image corresponding to the first foreground image and the first reference image may be spliced ​​to obtain a spliced ​​second image; when there are multiple first reference images, multiple first reference images may be spliced ​​to obtain a spliced ​​second image. In this way, by implementing the optional embodiment, the missing information is used for targeted reshooting, which improves the efficiency and accuracy of reshooting, thereby improving the efficiency and accuracy of splicing.

[0113] Optionally, the process of generating a spliced ​​second image of the material to be processed corresponding to the first foreground image in the optional embodiment may include: moving the close-range camera to shoot the material to be processed that should be included in the first foreground image to obtain multiple second reference images; based on the missing information of the material to be processed in the first foreground image, selecting a target second reference image from multiple second reference images; splicing based on the target second reference image to obtain a spliced ​​second image. Exemplarily, the target second reference image may be one or more; when there is one target second reference image, the second image corresponding to the first foreground image and the target second reference image may be spliced ​​to obtain a spliced ​​second image; when there are multiple target second reference images, multiple target second reference images may be spliced ​​to obtain a spliced ​​second image. In this way, by implementing the optional embodiment, random reshooting is first performed, and then selection is made using the missing information, thereby improving the flexibility of splicing.

[0114] It should be noted that the process of obtaining the foreground image based on the spliced ​​second images of the materials to be processed in the optional embodiment is similar to the process of obtaining the foreground image of each material to be processed based on the second image of each material to be processed in the aforementioned embodiment, and will not be repeated here.

[0115] In one embodiment of the present application, the relative position information of the processing element on the reference material includes: the position and rotation angle of the processing element on the reference material, and the relative position information of the reference material and each material to be processed includes: the distance between the reference material and each material to be processed, and the rotation angle of each material to be processed relative to the reference material. Accordingly, based on the relative position information of the processing element on the reference material, the relative position information of the reference material and each material to be processed, the process of filling each material to be processed with the processing element in the first image may include: determining the position and rotation angle of the processing element on each material to be processed based on the position and rotation angle of the processing element on the reference material, the distance between the reference material and each material to be processed, and the rotation angle of each material to be processed relative to the reference material; filling each material to be processed with the processing element in the second image based on the position and rotation angle of the processing element on each material to be processed; and filling each processing element into the first image based on the position of the processing element in each second image.

[0116] That is, in the optional embodiment, the terminal device first uses the position and rotation angle of the processing element on the reference material, the distance between the reference material and each material to be processed, and the rotation angle of each material to be processed relative to the reference material to obtain the position and rotation angle of the processing element on each material to be processed, and then uses the position and rotation angle of the processing element on each material to be processed to fill the processing element in the second image for each material to be processed, and then uses the position of the processing element in each second image to fill each processing element in the first image. In this way, by implementing the optional embodiment, each material to be processed can be simply and accurately filled with the processing element in the first image, thereby improving the efficiency and accuracy of laser batch processing.

[0117] In one embodiment of the present application, the process of filling processing elements for each material to be processed in the first image may include: obtaining a filled list, the filled list including identification information of the filled material; if in the process of filling in sequence, it is detected based on the filled list that the current material to be processed has not been filled, then filling the processing elements for the current material to be processed in the first image, and adding the identification information of the current material to be processed to the filled list until each material to be processed is filled with processing elements.

[0118] That is, in the optional embodiment, the terminal device can detect whether the material to be processed has been filled with processing elements. If it is detected that the processing elements are not filled, the processing elements can be filled. If it is detected that the processing elements are filled, the filling of the processing elements is not repeated. In this way, by implementing the optional embodiment, filling is performed after checking whether it has been filled, thereby avoiding the phenomenon of repeated filling, thereby improving the efficiency of laser batch processing.

[0119] In an optional embodiment, the terminal device detects whether the material to be processed is filled with processing elements through the filled list. When the identification information corresponding to the material to be processed is not found in the filled list, it is determined that the material to be processed has not been filled. At this time, the material to be processed can be filled with processing elements, and after filling the processing elements, the identification information corresponding to the processing material is added to the filled list to update the filled list; when the identification information corresponding to the material to be processed is found in the filled list, it is determined that the material to be processed has been filled, and at this time, there is no need to fill the filled material to be processed with processing elements. The identification information includes but is not limited to at least one of position information, name, arrangement number, etc.

[0120] In one embodiment of the present application, after the process of filling processing elements for each material to be processed in the first image based on the second image of the reference material, the second image of each material to be processed, and the relative position information of the processing elements on the reference material in S204, it may also include: based on the positions of the processing elements on the multiple materials to be processed and the positions of the multiple materials to be processed, controlling the laser processing equipment to perform batch processing on the multiple materials to be processed so as to form processing elements on the multiple materials to be processed.

[0121] That is, in the optional embodiment, multiple materials to be processed are filled with processing elements, and then the terminal device can control the laser processing device to perform laser processing on the multiple materials to be processed filled with processing elements to obtain processed materials (also called processed products). In this way, by implementing the optional embodiment, laser processing is performed after multiple materials to be processed are filled with processing elements, thereby improving the efficiency and accuracy of laser batch processing.

[0122] Optionally, the process of controlling the laser processing equipment to perform batch processing on multiple materials to be processed in an optional embodiment may include: if it is detected that one material to be processed is fully filled, controlling the laser processing of the filled material to be processed until processing elements are formed on multiple materials to be processed; if it is detected that multiple materials to be processed are fully filled, controlling the laser processing of the multiple materials to be processed separately.

[0123] That is, in the optional embodiment, batch processing includes two modes. Mode 1 is to control laser processing once each time a material to be processed is filled, and mode 2 is to control laser processing uniformly after all materials to be processed are filled. In this way, by implementing the optional embodiment, there are two modes of batch processing, which can be selected according to actual needs, thereby improving the flexibility of laser batch processing.

[0124] Exemplarily, controlling a laser processing process may include: generating a single processing instruction based on the most recently filled processing element in the first image, and sending the single processing instruction to the laser processing equipment, so that the laser processing equipment performs laser processing on the material to be processed corresponding to the most recently filled processing element based on the single processing instruction.

[0125] Exemplarily, controlling the process of unified laser processing may include: generating a unified processing instruction based on all filled processing elements in the first image, and sending the unified processing instruction to the laser processing equipment, so that the laser processing equipment performs laser processing on multiple materials to be processed based on the unified processing instruction.

[0126] Optionally, in an optional embodiment, controlling the process of separately laser processing a plurality of materials to be processed may include: obtaining a processed list, the processed list including identification information of the processed materials; if in the process of sequentially performing laser processing, it is detected based on the processed list that the current material to be processed has not been laser processed, then laser processing is performed on the current material to be processed to obtain a processed material, and the identification information of the obtained processed material is added to the processed list, until processing elements are formed on the plurality of materials to be processed.

[0127] That is, in the optional embodiment, the terminal device can detect whether the filled material to be processed has been laser processed. If it is detected that it has not been laser processed, laser processing can be performed. If it is detected that it has been laser processed, laser processing is not repeated. In this way, by implementing the optional embodiment, laser processing is performed after detecting whether it has been laser processed, thereby avoiding the phenomenon of repeated laser processing, thereby improving the efficiency of laser batch processing.

[0128] In an optional embodiment, the terminal device detects whether the filled material to be processed has been laser processed through the processed list. When the identification information corresponding to the filled material to be processed is not found in the processed list, it is determined that the filled material to be processed has not been laser processed. At this time, the material to be processed can be laser processed and becomes a processed material after laser processing. The identification information corresponding to the processed material is added to the processed list to update the processed list; when the identification information corresponding to the filled material to be processed is found in the processed list, it is determined that the filled material to be processed has been laser processed. At this time, there is no need to laser process the filled material to be processed. The identification information includes but is not limited to at least one of position information, name, arrangement number, etc.

[0129] As described in the above embodiment, a close-up camera may be used for shooting; wherein:

[0130] Optionally, in the optional embodiment, the process of moving the close-up camera of the laser processing equipment based on each rough position, and controlling the close-up camera to shoot each material to be processed to obtain the second image of each material to be processed may include: based on the rough position of the traversed material to be processed, moving the close-up camera to the vicinity of the traversed material to be processed, and shooting the traversed material to be processed to obtain the second image of the traversed material to be processed. Correspondingly, the process of filling each material to be processed with processing elements in the first image based on the second image of the reference material, the second image of each material to be processed, and the relative position information of the processing elements on the reference material in S204 may include: filling the traversed material to be processed with processing elements in the first image based on the relative position information of the processing elements on the reference material, the second image of the reference material, and the second image of each material to be processed, and traversing the next material to be processed to fill the processing elements until each material to be processed is filled with processing elements.

[0131] That is, in the optional embodiment, the terminal device fills the processing elements on the remaining materials to be processed by traversing. Specifically, each time the second image of the traversed material to be processed is obtained, the traversed material to be processed is filled with processing elements until the remaining materials to be processed are filled with processing elements. In this way, by implementing the optional embodiment, the accuracy of laser batch processing is improved by shooting and filling in a traversing manner.

[0132] Optionally, in the optional embodiment, the process of moving the close-up camera of the laser processing equipment based on each rough position, and controlling the close-up camera to shoot each material to be processed, and obtaining the second image of each material to be processed may include: moving the close-up camera of the laser processing equipment to the vicinity of each material to be processed based on each rough position, and controlling the close-up camera to shoot each material to be processed, and obtaining the second image of all materials to be processed except the reference material in the first image. Accordingly, the process of filling the processing element in the first image for each material to be processed based on the second image of the reference material, the second image of each material to be processed, and the relative position information of the processing element on the reference material in S204 may include: filling the processing element in the first image for all materials to be processed based on the relative position information of the processing element on the reference material, the second image of the reference material, and the second image of each material to be processed.

[0133] That is, in the optional embodiment, the terminal device first uniformly obtains the second image of each of the remaining materials to be processed, and then uniformly fills the processing elements for each material to be processed. In this way, by implementing the optional embodiment, the efficiency of laser batch processing is improved by adopting unified shooting and unified filling.

[0134] The embodiments of the present application implement automated laser batch processing. Compared with related technical solutions, there is no need for manual placement and alignment of materials to be processed, which saves manpower and material resources, improves the efficiency of laser batch processing, and avoids the phenomenon that manual placement and alignment of materials to be processed are prone to errors, thereby ensuring the consistency of laser batch processing and thus improving the accuracy of laser batch processing. Therefore, the reliability of laser batch processing in the technical solution provided in the embodiments of the present application is high.

[0135] The specific scenarios of the embodiments of the present application are described in detail below:

[0136] See also Figure 3 , Figure 3 FIG. 1 is a flow chart of a laser batch processing method according to an embodiment of the present application. The laser batch processing method can be executed by the terminal device 101 (specifically, it can be the host computer software in the terminal device 101). Figure 3 As shown, the laser batch processing method at least includes S301 to S311, which are described in detail as follows:

[0137] S301, controlling a long-range camera of a laser processing device to photograph a processing area where a plurality of materials to be processed are placed, to obtain a first image.

[0138] Optionally, a global shooting instruction is generated and sent to the laser processing equipment, so that the laser processing equipment controls the long-range camera to shoot multiple materials to be processed placed in the processing area based on the global shooting instruction to obtain a first image, and then receives the first image sent by the laser processing equipment.

[0139] S302, inputting the first image into the target detection model, performing target detection on the first image through the target detection model, obtaining multiple first candidate boxes located in the first image, and obtaining the rough position of each material to be processed in the processing area based on the position of each first candidate box in the first image.

[0140] See also Figure 4 , is a schematic diagram of the first image. Figure 4 As shown, the material to be processed is a toothpick, and the center position of each toothpick is the rough position of the toothpick.

[0141] Optionally, the target detection model performs feature extraction on the first image to obtain a first semantic feature corresponding to the first image, and then performs target detection on the first image based on the first semantic feature to generate a plurality of first candidate boxes located in the first image.

[0142] It should be noted that each material to be processed in S302 refers to each material to be processed among a plurality of materials to be processed.

[0143] S303, based on the approximate position of the reference material selected from the multiple materials to be processed in the processing area, move the close-up camera of the laser processing equipment, and control the close-up camera to shoot the reference material to obtain a second image of the reference material, and obtain the processing elements filled on the reference material in the second image of the reference material.

[0144] Optionally, the first image is displayed in an editable interface, and in response to a selection operation on a plurality of materials to be processed in the first image, the selected materials to be processed are determined as reference materials, and a rough position of the reference materials is acquired.

[0145] Optionally, a first local shooting instruction is generated, wherein the first local shooting instruction includes a rough position of a reference material, and the first local shooting instruction is sent to a laser processing device, so that the laser processing device moves a close-range camera to the vicinity of the reference material in a processing area based on the rough position of the reference material in the first local shooting instruction, and controls the close-range camera to shoot the reference material to obtain a second image of the reference material, and then receives the second image of the reference material sent by the laser processing device.

[0146] S304, based on the shooting angle information of the long-range camera and the material information corresponding to each material to be processed among the remaining materials to be processed, the rough position of each material to be processed is corrected to obtain the corrected position of each material to be processed in the processing area, and based on each corrected position, the close-range camera of the laser processing equipment is moved to the vicinity of each material to be processed, and the close-range camera is controlled to shoot each material to be processed to obtain a second image corresponding to each material to be processed.

[0147] See also Figure 5 , is a schematic diagram of the second image. Figure 5 As shown, only Figure 4 Based on this, a portion of the second image is illustrated.

[0148] Optionally, correction information is generated using the shooting angle information of the long-range camera and the material thickness corresponding to each material to be processed, and then the correction information is used to correct the rough position of each material to be processed to obtain the corrected position of each material to be processed in the processing area.

[0149] Optionally, a second local shooting instruction is generated, wherein the second local shooting instruction includes the correction position of each material to be processed, and the second local shooting instruction is sent to the laser processing equipment, so that the laser processing equipment moves the close-range camera to the vicinity of each material to be processed placed in the processing area based on the correction position of each material to be processed in the second local shooting instruction, and controls the close-range camera to shoot each material to be processed to obtain a second image of each material to be processed, and then receives the second image of each material to be processed sent by the laser processing equipment.

[0150] It should be noted that S303 and S304 can be executed in parallel or one can be executed first or the other can be executed later. At the same time, each material to be processed in S304 refers to each material to be processed among multiple materials to be processed (usually multiple) except the reference material.

[0151] S305, inputting the second image of the reference material into the target detection model, performing target detection on the second image of the reference material through the target detection model to obtain a second candidate box located in the second image of the reference material, and inputting the second image including the second candidate box into the target segmentation model, performing image foreground segmentation on the second candidate box in the second image of the reference material through the target segmentation model to obtain a foreground image corresponding to the reference material.

[0152] S306, inputting the second image corresponding to each material to be processed into the target detection model, performing target detection on each second image through the target detection model to obtain a third candidate box located in each second image, and inputting the second image containing the third candidate box into the target segmentation model, performing image foreground segmentation on the third candidate box in each second image through the target segmentation model to obtain a foreground image corresponding to each material to be processed.

[0153] See also Figure 6 , is a schematic diagram of the foreground image corresponding to each material to be processed. Figure 6 As shown, the white color is the foreground, and only part of the foreground image is shown.

[0154] Optionally, the target detection model performs feature extraction on the second image corresponding to each material to be processed to obtain a second semantic feature corresponding to each second image, and then performs target detection on each second image based on each second semantic feature to generate a third candidate box located in each second image.

[0155] Optionally, the target segmentation model captures the image corresponding to the third candidate box contained in each second image to obtain a candidate box image corresponding to each second image, and then performs foreground segmentation on each candidate box image based on the pixels contained in each candidate box image to obtain a foreground image corresponding to each candidate box image, and then obtains a foreground image corresponding to each material to be processed based on the foreground image corresponding to each candidate box image.

[0156] It should be noted that S305 and S306 can be executed in parallel or one can be executed first and the other can be executed later.

[0157] S307, perform integrity detection on the foreground image corresponding to each material to be processed. If a first foreground image with integrity less than a preset integrity threshold is detected among the foreground images corresponding to multiple materials to be processed, execute S308; if a second foreground image with integrity greater than or equal to the preset integrity threshold is detected among the foreground images corresponding to multiple materials to be processed, execute S309.

[0158] S308, generating a spliced ​​second image of the material to be processed corresponding to the first foreground image, wherein the integrity of the material to be processed in the spliced ​​second image is greater than or equal to a preset integrity threshold, and based on the spliced ​​second image and the foreground image of the reference material, determining the relative position information of the material to be processed and the reference material corresponding to the spliced ​​second image.

[0159] Please refer to Figure 6 , the foreground images in the second row are all incomplete. Taking the first foreground image in the second row as an example, it is missing half of its content. We can obtain the foreground image corresponding to the re-shot second image (such as the first reference image or the second target reference second image in the aforementioned embodiment) and splice it to the right with the first foreground image in the second row to obtain a spliced ​​second image containing a complete toothpick, and then determine the relative position information of the material to be processed and the reference material corresponding to the spliced ​​second image.

[0160] It can be understood that a foreground image of the reference material can be obtained based on the second image of the reference material; optionally, a foreground image of the material to be processed can be obtained based on the spliced ​​second image; optionally, the spliced ​​second image is processed to obtain the foreground image of the material to be processed, which can be achieved through the target detection model and target segmentation model in the aforementioned embodiments.

[0161] S309: Based on the second foreground image and the foreground image of the reference material, determine relative position information of the material to be processed and the reference material corresponding to the second foreground image.

[0162] Please refer to Figure 6 , the second foreground image of the first row is complete, and the relative position information of the material to be processed and the reference material corresponding to the foreground image can be determined.

[0163] S310: Fill each material to be processed with the processing element in the first image based on the relative position information of the processing element on the reference material and the relative position information of the reference material and each material to be processed.

[0164] Optionally, the relative position information of the processing element on the reference material includes: the position and rotation angle of the processing element on the reference material; the relative position information of the reference material and each material to be processed includes: the distance between the reference material and each material to be processed, and the rotation angle of each material to be processed relative to the reference material. Accordingly, based on the position and rotation angle of the processing element on the reference material, the distance between the reference material and each material to be processed, and the rotation angle of each material to be processed relative to the reference material, the position and rotation angle of the processing element on each material to be processed are determined; based on the position and rotation angle of the processing element on each material to be processed, the processing element is filled in each material to be processed in the second image; based on the position of the processing element in each second image, each processing element is filled in the first image.

[0165] For easier understanding, see Figure 7a and Figure 7b , where the processing area includes multiple objects, the goal of this laser batch processing is to engrave a triangular pattern (i.e., processing element) on an oval-shaped piece of wood (i.e., multiple materials to be processed). Figure 7a As shown in FIG. 1 , the user first fills a triangular pattern on a certain oval-shaped wood as a reference material, and then fills triangular patterns on the other three oval-shaped woods (i.e., the remaining materials to be processed) based on the reference material, and obtains the following Figure 7b Processing diagram shown.

[0166] S311, obtaining a processed list, the processed list includes identification information of processed materials. If, during the process of sequential laser processing, it is detected based on the processed list that the current material to be processed has not been laser processed, laser processing is performed on the current material to be processed to obtain processed materials, and the identification information of the obtained processed materials is added to the processed list, until processing elements are formed on multiple materials to be processed to complete laser batch processing.

[0167] Following the above, we can get Figure 7b For the example of the processing diagram shown, a judgment can be made first on whether the four oval-shaped wood pieces filled with triangular patterns have been engraved. If the triangular patterns have not been engraved on the four oval-shaped wood pieces, it is necessary to control the laser processing equipment to engrave the triangular patterns on the four oval-shaped wood pieces using the processing diagram, thereby completing the laser batch processing.

[0168] It should be noted that in the laser batch processing method in the above embodiment, if the execution subject is the laser processing equipment, some instructions issued by the terminal device in the above embodiment and the content of the image upload will not be executed in the laser processing equipment. Please refer to the above embodiment for details.

[0169] In the embodiments of the present application, corresponding processing in the laser batch processing process is realized by using corresponding models in artificial intelligence technology (AI), so that the batch processing control function of the laser processing equipment has a higher degree of intelligence and automation, which is suitable for many laser batch processing scenarios.

[0170] Figure 8 : is a block diagram of a laser batch processing device shown in an exemplary embodiment of the present application. The device includes:

[0171] A first acquisition module 801 is configured to acquire a first image obtained by photographing a processing area where a plurality of materials to be processed are placed;

[0172] A second acquisition module 802 is configured to acquire a rough position of a reference material among a plurality of materials to be processed based on the first image, acquire a second image of the reference material, and acquire a processing element filled on the reference material in the second image of the reference material;

[0173] A third acquisition module 803 is configured to acquire a second image of each material to be processed based on a rough position of each material to be processed except the reference material in the first image;

[0174] The filling module 804 is configured to fill each material to be processed with processing elements in the first image based on the second image of the reference material, the second image of each material to be processed, and the relative position information of the processing elements on the reference material, so as to batch process multiple materials to be processed.

[0175] In one embodiment of the present application, based on the aforementioned scheme, the filling module 804 is specifically configured as follows: based on the second image of the reference material and the second image of each material to be processed, determine the relative position information of the reference material and each material to be processed; based on the relative position information of the processing element on the reference material, the relative position information of the reference material and each material to be processed, fill the processing element for each material to be processed in the first image.

[0176] In one embodiment of the present application, based on the aforementioned scheme, the first acquisition module 801 is specifically configured as follows: controlling the long-range camera of the laser processing equipment to photograph the processing area where a plurality of materials to be processed are placed to obtain a first image; or controlling the camera of the laser processing equipment to photograph the processing area where the plurality of materials to be processed are placed at a first focal length to obtain a first image.

[0177] In one embodiment of the present application, based on the aforementioned scheme, the third acquisition module 803 is specifically configured as follows: determining the rough position of each material to be processed in the processing area based on the first image, and moving the close-up camera of the laser processing equipment based on each rough position, and controlling the close-up camera to shoot each material to be processed to obtain a second image of each material to be processed; or, determining the rough position of each material to be processed in the processing area based on the first image, and moving the camera of the laser processing equipment based on each rough position, and controlling the camera to shoot each material to be processed at a second focal length to obtain a second image of each material to be processed.

[0178] In one embodiment of the present application, based on the aforementioned scheme, the third acquisition module 803 is further specifically configured as: based on the rough position of the traversed material to be processed, moving the close-range camera to the vicinity of the traversed material to be processed, and photographing the traversed material to be processed to obtain a second image of the traversed material to be processed; accordingly, the filling module 804 is further specifically configured as: based on the relative position information of the processing elements on the reference material, the second image of the reference material and the second image of each material to be processed, filling the traversed material to be processed with processing elements in the first image, and traversing the next material to be processed to fill the processing elements until each material to be processed is filled with processing elements.

[0179] In one embodiment of the present application, based on the aforementioned scheme, the third acquisition module 803 is further specifically configured as follows: based on each rough position, the close-up camera of the laser processing equipment is moved to the vicinity of each material to be processed, and the close-up camera is controlled to shoot each material to be processed, so as to obtain a second image of all materials to be processed except the reference material in the first image; accordingly, the filling module 804 is further specifically configured as follows: based on the relative position information of the processing elements on the reference material, the second image of the reference material and the second image of each material to be processed, all materials to be processed in the first image are filled with processing elements.

[0180] In one embodiment of the present application, based on the aforementioned scheme, the third acquisition module 803 is further specifically configured to: perform target detection on the first image to obtain multiple first candidate boxes located in the first image; based on the position of each first candidate box in the first image, obtain the rough position of each material to be processed in the processing area.

[0181] In one embodiment of the present application, based on the aforementioned scheme, the third acquisition module 803 is further specifically configured as follows: based on the shooting angle information of the long-range camera and the material information corresponding to each material to be processed, the rough position corresponding to each material to be processed is corrected to obtain the corrected position of each material to be processed in the processing area; based on each corrected position, the close-up camera is moved, and the close-up camera is controlled to shoot each material to be processed to obtain a second image of each material to be processed.

[0182] In one embodiment of the present application, based on the aforementioned scheme, the material information includes material thickness; accordingly, the third acquisition module 803 is further specifically configured to: generate correction information based on the shooting angle information of the long-range camera and the material thickness corresponding to each material to be processed; correct the rough position of each material to be processed based on the correction information to obtain the corrected position of each material to be processed in the processing area.

[0183] In one embodiment of the present application, based on the above solution, the filling module 804 is further specifically configured as follows:

[0184] Perform target detection on the second image of the reference material to obtain a second candidate frame in the second image of the reference material; perform image foreground segmentation on the second candidate frame to obtain a foreground image corresponding to the reference material; perform target detection on the second image of each material to be processed to obtain a third candidate frame located in each second image; perform image foreground segmentation on each third candidate frame to obtain a foreground image corresponding to each material to be processed; determine the relative position information of the reference material and each material to be processed based on the foreground image of the reference material and the foreground image of each material to be processed.

[0185] In one embodiment of the present application, based on the aforementioned scheme, the filling module 804 is further specifically configured to: perform material integrity detection on each foreground image of the material to be processed; for a first foreground image whose material integrity is less than a preset integrity threshold, generate a spliced ​​second image of the material to be processed corresponding to the first foreground image, and based on the spliced ​​second image and the foreground image of the reference material, determine the relative position information of the material to be processed and the reference material corresponding to the spliced ​​second image; for a second foreground image whose material integrity is greater than or equal to the preset integrity threshold, determine the relative position information of the material to be processed and the reference material corresponding to the second foreground image based on the second foreground image and the foreground image of the reference material.

[0186] In one embodiment of the present application, based on the aforementioned scheme, the filling module 804 is further specifically configured to: obtain missing information for the material to be processed in the first foreground image; move the close-up camera of the laser processing equipment based on the missing information, and control the close-up camera to shoot the material to be processed that should be included in the first foreground image to obtain a first reference image; splice the first reference image and the second image corresponding to the first foreground image, or splice multiple first reference images to obtain a spliced ​​second image; or, move the close-up camera to shoot the material to be processed that should be included in the first foreground image to obtain multiple second reference images; based on the missing information for the material to be processed in the first foreground image, select a target second reference image from the multiple second reference images; splice the target second reference image and the second image corresponding to the first foreground image, or splice multiple target second reference images to obtain a spliced ​​second image.

[0187] In one embodiment of the present application, based on the aforementioned scheme, the filling module 804 is further specifically configured to: obtain the position of the material mask in the foreground image of each material to be processed; if it is detected that the position of the material mask is in the edge area of ​​the corresponding foreground image, the corresponding foreground image is determined as the first foreground image; if it is detected that the position of the material mask is in the non-edge area of ​​the corresponding foreground image, the corresponding foreground image is determined as the second foreground image.

[0188] In one embodiment of the present application, based on the aforementioned scheme, the relative position information of the processing element on the reference material includes: the position and rotation angle of the processing element on the reference material; the relative position information of the reference material and each material to be processed includes: the distance between the reference material and each material to be processed, and the rotation angle of each material to be processed relative to the reference material; the filling module 804 is further specifically configured to: determine the position and rotation angle of the processing element on each material to be processed based on the position and rotation angle of the processing element on the reference material, the distance between the reference material and each material to be processed, and the rotation angle of each material to be processed relative to the reference material; fill the processing element in each material to be processed in the second image of each material to be processed based on the position and rotation angle of the processing element on each material to be processed; and fill each processing element into the first image based on the position of the processing element in the second image of each material to be processed.

[0189] In one embodiment of the present application, based on the aforementioned scheme, the filling module 804 is further specifically configured to: obtain a filled list, the filled list including identification information of the filled material; if in the process of filling in sequence, it is detected based on the filled list that the current material to be processed has not been filled, then fill the processing elements for the current material to be processed in the first image, and add the identification information of the current material to be processed to the filled list until each material to be processed is filled with the processing elements.

[0190] In one embodiment of the present application, based on the aforementioned scheme, the device also includes a control module configured to: based on the positions of the processing elements on the multiple materials to be processed and the positions of the multiple materials to be processed, control the laser processing equipment to perform batch processing on the multiple materials to be processed so as to form processing elements on the multiple materials to be processed.

[0191] It should be noted that the laser batch processing device provided in the above embodiment and the laser batch processing method provided in the above embodiment belong to the same concept, wherein the specific manner in which each module and unit performs operations has been described in detail in the method embodiment and will not be repeated here.

[0192] See also Figure 1 The embodiment of the present application also provides a laser processing system 100, including a laser processing device 102 and a terminal device 101, the terminal device 101 is connected to the laser processing device 102 in communication, the terminal device 101 can implement the laser batch processing method provided in the above embodiments to generate a processing instruction (such as a batch processing instruction) and send it to the laser processing device 102, the laser processing device 102 can receive the processing instruction and execute it to achieve batch processing of multiple materials to be processed. Among them, the terminal device 101 is the same as the terminal device of the previous embodiment, and will not be repeated here.

[0193] See also Fig. 9 The laser processing equipment 102 of the present application may include a processing head 1021, and the laser output by the processing head 1021 may move on the processing area to achieve processing of the material to be processed.

[0194] The laser processing device 102 may include a base plate 1024, which includes a processing area (also referred to as a processing zone) for placing materials to be processed. The laser processing device 102 may include a controller 1023, which is responsible for coordinating and managing the work of the hardware and software in the laser processing device. Specifically, the controller 1023 communicates with the laser processing software in the terminal device 101 to receive and execute processing instructions. The laser processing device 102 may include a communication component 1022, which can be connected to the terminal device 101 through the communication component 1022, and receive processing instructions issued by the terminal device 101, and output corresponding processing data, sensor data, image data, etc. to the terminal device 101.

[0195] In some embodiments, the laser processing equipment 102 may further include a long-range camera 1025 for capturing a panoramic image of multiple materials to be processed in the processing area (i.e., the first image in the aforementioned embodiment). The laser processing equipment 102 may upload the panoramic image captured by the long-range camera 1025 to the terminal device 101 via the communication component 1022.

[0196] In some embodiments, the laser processing equipment 102 may further include a close-up camera 1026 for capturing a close-up image of the processing area (i.e., the second image in the aforementioned embodiment). The laser processing equipment 102 may upload the close-up image captured by the long-range and close-up camera 1026 to the terminal device 101 via the communication component 1022.

[0197] The field of view of the long-range camera 1025 is greater than that of the short-range camera 1026. The long-range camera 1025 can capture the entire processing area, and the short-range camera 1026 can capture a local area of ​​the processing area. The short-range camera 1026 can be set on the laser source 1021 to move with the laser head 1021. The long-range camera 1025 can be set on the housing or on the top.

[0198] In some embodiments, the controller 1023 can receive laser batch processing instructions, and correspondingly control the long-range camera 1025 and the close-range camera 1026 to move and capture images, and output the captured images to the terminal device 101. The controller 1023 can also control the processing head 1021 to process the material to be processed based on the laser batch processing instructions.

[0199] The laser processing equipment 102 may also include other related functional components, which will not be described in detail here.

[0200] In some embodiments, the laser processing equipment 102 may further include a variable-focus camera, which may photograph a processing area where a plurality of materials to be processed are placed at a first focal length to obtain a first image, and may photograph a certain material to be processed at a second focal length to obtain a second image, wherein the second focal length is greater than the first focal length. The first image may be a panoramic image, and the second image may be a close-up image of a certain material to be processed.

[0201] The embodiment of the present application also provides an electronic device, including: one or more processors; a memory for storing one or more computer programs, when the one or more computer programs are executed by the one or more processors, the electronic device implements the laser batch processing method provided in each of the above embodiments. The electronic device can be a mobile phone, a computer, a tablet, or a laser processing device, etc., which are not listed here one by one.

[0202] Fig.10 It is a schematic diagram of the structure of a computer system suitable for implementing an electronic device of an embodiment of the present application. It should be noted that: Fig.10 The computer system 900 of the electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0203] like Fig.10As shown, the computer system 900 includes a central processing unit (CPU) 901, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 902 or the program loaded from the storage part 908 to the random access memory (RAM) 903, such as executing the method in the above embodiment. In the RAM 903, various programs and data required for system operation are also stored. The CPU 901, ROM 902 and RAM 903 are connected to each other through a bus 904. An input / output (I / O) interface 905 is also connected to the bus 904.

[0204] The following components are connected to the I / O interface 905: an input section 906 including a keyboard, a mouse, etc.; an output section 907 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker; a storage section 908 including a hard disk, etc.; and a communication section 909 including a network interface card such as a local area network (LAN) card, a modem, etc. The communication section 909 performs communication processing via a network such as the Internet. A drive 910 is also connected to the I / O interface 905 as needed. A removable medium 911, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 910 as needed so that a computer program read therefrom is installed into the storage section 908 as needed.

[0205] In particular, according to an embodiment of the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present application includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a computer program for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication section 909, and / or installed from a removable medium 911. When the computer program is executed by a central processing unit (CPU) 901, various functions defined in the system of the present application are executed.

[0206] It should be noted that the computer-readable medium shown in the embodiment of the present application can be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. The computer program contained in the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

[0207] The flowchart and block diagram in the accompanying drawings illustrate the possible architecture, functions and operations of the system, method and computer program product according to various embodiments of the present application. Wherein, each box in the flowchart or block diagram can represent a module, a program segment, or a part of the code, and the above-mentioned module, program segment, or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flowchart, and the combination of boxes in the block diagram or flowchart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0208] The units involved in the embodiments described in this application may be implemented by software or hardware, and the units described may also be set in a processor. The names of these units do not, in some cases, constitute limitations on the units themselves.

[0209] Another aspect of the present application further provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the laser batch processing method as described above is implemented. The computer-readable storage medium may be included in the electronic device described in the above embodiment, or may exist independently without being assembled into the electronic device.

[0210] Another aspect of the present application also provides a computer program product or a computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the laser batch processing method provided in each of the above embodiments.

[0211] The above content is only a preferred exemplary embodiment of the present application and is not intended to limit the implementation scheme of the present application. A person skilled in the art can easily make corresponding changes or modifications based on the main concept and spirit of the present application. Therefore, the scope of protection of the present application shall be based on the scope of protection required by the claims.

Claims

1. A laser batch processing method, characterized in that: include: Acquire a first image obtained by photographing a processing area where a plurality of materials to be processed are placed; Acquire a rough position of a reference material among the plurality of materials to be processed based on the first image, acquire a second image of the reference material, and acquire a processing element filled on the reference material in the second image of the reference material; Based on the rough position of each material to be processed except the reference material in the first image, acquiring a second image of each material to be processed; Based on the second image of the reference material, the second image of each material to be processed, and the relative position information of the processing elements on the reference material, the processing elements are filled in each material to be processed in the first image to perform batch processing on the multiple materials to be processed.

2. The method according to claim 1, characterized in that The filling the processing elements for each material to be processed in the first image based on the second image of the reference material, the second image of each material to be processed, and the relative position information of the processing elements on the reference material comprises: Determining relative position information of the reference material and each of the materials to be processed based on the second image of the reference material and the second image of each of the materials to be processed; Based on the relative position information of the processing element on the reference material and the relative position information of the reference material and each material to be processed, the processing element is filled in each material to be processed in the first image.

3. The method according to claim 1, characterized in that: The step of acquiring a first image obtained by photographing a processing area where a plurality of materials to be processed are placed includes: Controlling a long-range camera of the laser processing equipment to photograph a processing area where the plurality of materials to be processed are placed to obtain a first image; or controlling a camera of the laser processing equipment to photograph the processing area where the plurality of materials to be processed are placed at a first focal length to obtain a first image; and / or, The step of acquiring a second image of each material to be processed based on a rough position of each material to be processed except the reference material in the first image comprises: Based on the first image, the rough position of each material to be processed in the processing area is determined, and based on each rough position, the close-up camera of the laser processing equipment is moved, and the close-up camera is controlled to shoot each material to be processed to obtain a second image of each material to be processed; or, based on the first image, the rough position of each material to be processed in the processing area is determined, and based on each rough position, the camera of the laser processing equipment is moved, and the camera is controlled to shoot each material to be processed at a second focal length to obtain a second image of each material to be processed.

4. The method according to claim 3, characterized in that The method of moving the close-up camera of the laser processing device based on each rough position and controlling the close-up camera to photograph each material to be processed to obtain a second image of each material to be processed includes: Based on the rough position of the traversed material to be processed, move the close-range camera to the vicinity of the traversed material to be processed, and photograph the traversed material to be processed to obtain a second image of the traversed material to be processed; The filling the processing elements for each material to be processed in the first image based on the second image of the reference material, the second image of each material to be processed, and the relative position information of the processing elements on the reference material comprises: Based on the relative position information of the processing element on the reference material, the second image of the reference material and the second image of each material to be processed, the traversed material to be processed in the first image is filled with the processing element, and the next material to be processed is traversed to fill the processing element until each material to be processed is filled with the processing element.

5. The method according to claim 3, characterized in that: The method of moving the close-up camera of the laser processing device based on each rough position and controlling the close-up camera to photograph each material to be processed to obtain a second image of each material to be processed includes: Based on each rough position, the close-range camera of the laser processing equipment is moved to the vicinity of each material to be processed, and the close-range camera is controlled to shoot each material to be processed, so as to obtain a second image of all materials to be processed except the reference material in the first image; The filling the processing elements for each material to be processed in the first image based on the second image of the reference material, the second image of each material to be processed, and the relative position information of the processing elements on the reference material comprises: Based on the relative position information of the processing elements on the reference material, the second image of the reference material and the second image of each material to be processed, the processing elements are filled in all the materials to be processed in the first image.

6. The method according to claim 3, characterized in that The determining a rough position of each material to be processed in the processing area based on the first image comprises: Performing object detection on the first image to obtain a plurality of first candidate boxes located in the first image; Based on the position of each first candidate frame in the first image, a rough position of each material to be processed in the processing area is obtained.

7. The method according to claim 3, characterized in that The method of moving the close-up camera of the laser processing device based on each rough position and controlling the close-up camera to photograph each material to be processed to obtain a second image of each material to be processed includes: Generate correction information based on the shooting angle information of the long-range camera and the material thickness corresponding to each material to be processed; Correcting the rough position of each material to be processed based on the correction information to obtain the corrected position of each material to be processed in the processing area; The close-up camera is moved based on each deviation correction position, and the close-up camera is controlled to shoot each of the materials to be processed to obtain a second image of each of the materials to be processed.

8. The method according to claim 2, characterized in that: The determining, based on the second image of the reference material and the second image of each material to be processed, relative position information of the reference material and each material to be processed comprises: Performing target detection on the second image of the reference material to obtain a second candidate frame in the second image of the reference material; Performing image foreground segmentation on the second candidate frame to obtain a foreground image corresponding to the reference material; Performing target detection on the second image of each of the materials to be processed to obtain a third candidate frame located in each of the second images; Performing image foreground segmentation on each third candidate frame to obtain a foreground image corresponding to each material to be processed; Based on the foreground image of the reference material and the foreground image of each material to be processed, relative position information of the reference material and each material to be processed is determined.

9. The method according to claim 8, characterized in that The determining the relative position information of the reference material and each of the materials to be processed based on the foreground image of the reference material and the foreground image of each of the materials to be processed comprises: Performing material integrity detection on the foreground image of each material to be processed; For the first foreground image whose material integrity is less than a preset integrity threshold, generating a spliced ​​second image of the material to be processed corresponding to the first foreground image, and determining relative position information of the material to be processed and the reference material corresponding to the spliced ​​second image based on the spliced ​​second image and the foreground image of the reference material; For the second foreground image whose material integrity is greater than or equal to the preset integrity threshold, relative position information of the material to be processed and the reference material corresponding to the second foreground image is determined based on the second foreground image and the foreground image of the reference material.

10. The method according to claim 9, characterized in that The step of generating a second image of the material to be processed corresponding to the first foreground image comprises: Obtaining missing information about the material to be processed in the first foreground image, moving a close-up camera of a laser processing device based on the missing information, and controlling the close-up camera to shoot the material to be processed that should be included in the first foreground image to obtain a first reference image, and splicing the first reference image and the second image corresponding to the first foreground image, or splicing a plurality of the first reference images to obtain the spliced ​​second image; or Move the close-range camera to shoot the material to be processed that should be included in the first foreground image to obtain multiple second reference images, and based on the missing information about the material to be processed in the first foreground image, select a target second reference image from the multiple second reference images, and splice the target second reference image and the second image corresponding to the first foreground image, or splice multiple target second reference images to obtain the spliced ​​second image.

11. The method according to any one of claims 1 to 10, characterized in that The step of filling the processing element for each material to be processed in the first image comprises: Obtaining a filled list, wherein the filled list includes identification information of filled materials; If, in the process of sequentially filling, it is detected based on the filled list that the current material to be processed has not been filled, then the processing element is filled in the current material to be processed in the first image, and the identification information of the current material to be processed is added to the filled list until each material to be processed is filled with the processing element; and / or, After filling the processing elements for each material to be processed in the first image based on the second image of the reference material, the second image of each material to be processed, and the relative position information of the processing elements on the reference material, the method further includes: Based on the positions of the processing elements on the multiple materials to be processed and the positions of the multiple materials to be processed, the laser processing equipment is controlled to perform batch processing on the multiple materials to be processed, so as to form the processing elements on the multiple materials to be processed.

12. A laser processing device, characterized in that: include: Processing head; A perspective camera, used for collecting a first image; A close-up camera, used for acquiring a second image; A communication component, the communication component is used to output the first image and the second image, and receive a processing instruction obtained according to the steps of the laser batch processing method according to any one of claims 1 to 11; A controller controls the long-range camera, the short-range camera and the processing head based on the processing instruction to perform laser processing.

13. A laser processing system, characterized in that: include: A laser processing device, the laser processing device comprising a base plate and a processing head, the base plate comprising a processing area for placing a material, and the processing head being used to move on the processing area; as well as A terminal device that communicates with the laser processing device, wherein the terminal device is used to execute the laser batch processing method according to any one of claims 1 to 11.

14. A computer readable medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the laser batch processing method according to any one of claims 1 to 11 is implemented.

Images