Image-based cutting position monitoring method, device, equipment and medium
The image-based cutting position monitoring method and device address the issue of untimely detection of cutting deviations by precisely determining cutting center coordinates and generating alarms, thereby reducing material loss and slicing costs.
Patent Information
- Application Number
- CN202311750521.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-12-19
- Publication Date
- 2024-12-06
- Estimated Expiration
- 2043-12-19
AI Technical Summary
Existing cutting processes in dicing machines fail to timely detect cutting deviations, leading to material loss due to untimely fault handling.
An image-based cutting position monitoring method and device that moves an image acquisition device to match the preset knife mark center, acquires and identifies knife mark images using grayscale thresholds, determines cutting center coordinates, and generates an alarm if marking coordinates do not match, allowing for quick response to cutting defects.
Effectively avoids material loss by quickly detecting cutting deviations and reducing slicing costs through precise monitoring of cutting positions.
Smart Images

Figure CN117968523B_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of industrial production, and in particular to an image-based cutting position monitoring method, device, electronic device and storage medium. Background Art
[0002] When the dicing machine is cutting the product, it will leave cutting marks at the designated cutting position of the product. In order to better discover whether there is any abnormality in the cutting effect during the cutting process and improve the controllability of the cut product, it is necessary to check the processed cutting marks regularly. The shape and position of the cutting marks can be used to intuitively determine whether there is any abnormality in the current cutting product. The image inspection method can be used for automatic inspection, which enhances the intelligence of the equipment and reduces the operation time of manual inspection. Summary of the invention
[0003] In order to overcome the problems existing in the related art, the present disclosure provides a cutting position monitoring method, device, electronic device and storage medium based on an image, so as to solve the problem of material loss caused by untimely fault handling during the cutting process in the related art.
[0004] According to a first aspect of an embodiment of the present disclosure, a cutting position monitoring method based on an image is provided, the method comprising:
[0005] In response to receiving a knife mark monitoring instruction, the image acquisition device is moved to a target monitoring position according to a preset knife mark center so that a camera center of the image acquisition device matches the preset knife mark center;
[0006] Acquire a knife mark monitoring image of a material to be cut on a dicing machine based on preset optical parameters;
[0007] Identify the knife mark monitoring image according to the knife mark grayscale threshold, and determine the knife mark image information in the knife mark monitoring image;
[0008] Determine the cutting center coordinates of the center position of the knife mark according to the knife mark image information;
[0009] Based on the cutting center coordinates, controlling the image acquisition device to move a preset distance in a preset direction, and acquiring target image information at the current position;
[0010] Determine the marking coordinate information of the preset marking point in the target image information;
[0011] If the marking coordinate information does not match the preset marking coordinates, an alarm prompt information is generated, and the alarm prompt information is used to indicate that the center position of the knife mark does not match the preset knife mark position.
[0012] Optionally, the knife mark monitoring image is identified according to the knife mark grayscale threshold to determine the knife mark image information in the knife mark monitoring image.
[0013] Acquire image grayscale information of the knife mark monitoring image;
[0014] The image grayscale information is screened according to the knife mark grayscale threshold to determine knife mark pixels in the knife mark monitoring image;
[0015] The knife mark image information is determined according to the position of the knife mark pixel point in the knife mark monitoring image.
[0016] Optionally, determining the cutting center coordinates of the center position of the knife mark according to the knife mark image information includes:
[0017] Obtaining gray value information of each pixel in the knife mark image information;
[0018] Determine, according to the gray value information, a first pixel point and a second pixel point with the largest gray value in a preset first direction, and a third pixel point and a fourth pixel point with the largest gray value in a preset second direction, wherein the preset first direction is perpendicular to the preset second direction;
[0019] Generate an inscribed rectangle according to the first pixel point, the second pixel point, the third pixel point and the fourth pixel point;
[0020] The cutting center coordinates are determined according to the inscribed rectangle.
[0021] Optionally, determining the cutting center coordinates according to the inscribed rectangle includes:
[0022] Obtaining multiple vertex coordinates of each vertex in the inscribed rectangle;
[0023] Determine the center coordinates of the center position of the inscribed rectangle according to the multiple vertex coordinates;
[0024] The center coordinate is used as the cutting center coordinate.
[0025] Optionally, the method further comprises:
[0026] Obtaining information on the number of cutting blades for the sheet to be cut;
[0027] When the information on the number of cutting knives reaches a preset number of cutting knives, the knife mark monitoring instruction is generated.
[0028] Optionally, controlling the image acquisition device to move a preset distance in a preset direction based on the cutting center coordinates includes:
[0029] Acquire the image center position of the image acquisition device;
[0030] When it is determined that the center position of the image matches the cutting center coordinates, acquiring the preset direction and the preset moving distance;
[0031] Based on the preset direction and the preset movement distance, the image acquisition device is controlled to move.
[0032] Optionally, the method further comprises:
[0033] If the marking coordinate information matches the preset marking coordinates, a cutting instruction is generated, where the cutting instruction is used to instruct the dicing machine to perform cutting based on a preset cutting route.
[0034] According to a second aspect of an embodiment of the present disclosure, there is provided an image-based cutting position monitoring device, the device comprising:
[0035] A processing module, configured to, in response to receiving a knife mark monitoring instruction, move the image acquisition device to a target monitoring position according to a preset knife mark center so that a camera center of the image acquisition device matches the preset knife mark center;
[0036] An acquisition module, used for acquiring a knife mark monitoring image of a sheet to be cut on a dicing machine based on preset optical parameters;
[0037] A first determination module, configured to identify the knife mark monitoring image according to a knife mark grayscale threshold, and determine knife mark image information in the knife mark monitoring image;
[0038] A second determination module is used to determine the cutting center coordinates of the center position of the knife mark according to the knife mark image information;
[0039] A control module, for controlling the image acquisition device to move a preset distance in a preset direction based on the cutting center coordinates, and to acquire target image information at a current position;
[0040] A third determining module is used to determine the marking coordinate information of the preset marking point in the target image information;
[0041] The execution module is used to generate an alarm prompt message if the marking coordinate information does not match the preset marking coordinate information, wherein the alarm prompt message is used to indicate that the center position of the tool mark does not match the preset tool mark position.
[0042] According to a third aspect of an embodiment of the present disclosure, there is provided an electronic device, including:
[0043] a memory having a computer program stored thereon;
[0044] A processor, configured to execute the computer program in the memory to implement the steps of any one of the image-based cutting position monitoring methods in the first aspect of the present disclosure.
[0045] According to a fourth aspect of an embodiment of the present disclosure, a non-temporary computer-readable storage medium is provided, on which a computer program is stored, and when the program is executed by a processor, the steps of the image-based cutting position monitoring method described in any one of the first aspects of the present disclosure are implemented.
[0046] The technical solution provided by the embodiments of the present disclosure may have the following beneficial effects:
[0047] In the above manner, in response to receiving a knife mark monitoring instruction, according to a preset knife mark center, the image acquisition device is moved to the target monitoring position so that the camera center of the image acquisition device matches the preset knife mark center, the knife mark monitoring image of the material to be cut on the dicing machine is obtained based on preset optical parameters, the knife mark monitoring image is identified according to the knife mark grayscale threshold, the knife mark image information in the knife mark monitoring image is determined, the cutting center coordinates of the knife mark center position are determined according to the knife mark image information, and the image acquisition device is controlled to move a preset distance in a preset direction based on the cutting center coordinates, and the target image information at the current position is acquired, and the mark coordinate information of the preset mark point in the target image information is determined. If the mark coordinate information does not match the preset mark coordinate, an alarm prompt information is generated, and the alarm prompt information is used to indicate that the knife mark center position does not match the preset knife mark position. Therefore, according to the relative position between the cut mark and the mark point, it is judged whether there is a cutting deviation defect at the current position, and when a cutting defect occurs, a quick response is made, effectively avoiding material loss caused by cutting deviation and reducing the cost of slicing.
[0048] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS
[0049] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.
[0050] Figure 1 The figure is a flow chart of a cutting position monitoring method based on an image according to an exemplary embodiment.
[0051] Figure 2 It is a block diagram of a cutting position monitoring device based on an image according to an exemplary embodiment.
[0052] Figure 3 It is a block diagram of an electronic device according to an exemplary embodiment. DETAILED DESCRIPTION
[0053] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.
[0054] It should be noted that all actions of acquiring signals, information or data in the present disclosure are carried out in compliance with the relevant data protection laws and policies of the country where the device is located and with the authorization given by the owner of the corresponding device.
[0055] In the related technology, the existing knife mark inspection to check whether there is a deviation in cutting is to run the camera through the y-axis to the center of the cutting knife mark, then take a photo, extract the coordinates of the center position of the cutting knife mark, and then compare the y-coordinate position of the center of the knife mark with the center position of the camera through image processing. If the deviation from the center is greater than the set value, it is considered that the cutting position is deviated, and then the machine alarm prompts, so that the cutting problem can be stopped in time to avoid machine failure and damage to more materials. However, in the actual machine cutting process, if the grating ruler is dusty and not paid attention to, it is possible that the cutting path and the camera knife mark center are aligned, and the single product on it is also cut off, and the problem is not discovered until the final cutting is completed and taken out.
[0056] Figure 1 is a flow chart of a cutting position monitoring method based on an image according to an exemplary embodiment. Figure 1 As shown, the method includes the following steps.
[0057] Step S11, in response to receiving a knife mark monitoring instruction, the image acquisition device is moved to a target monitoring position according to a preset knife mark center, so that the camera center of the image acquisition device matches the preset knife mark center.
[0058] For example, in some embodiments, the image acquisition device in this embodiment uses a black and white camera, and performs matching search through an image search template. The image data detected by the image acquisition device is transmitted to an industrial computer through a gigabit network port. The industrial computer includes a CPU, memory, hard disk, USB interface, network port, and PCI slot for operation and control board.
[0059] Step S12, obtaining a knife mark monitoring image of the material to be cut on the dicing machine based on preset optical parameters.
[0060] Step S13, identifying the knife mark monitoring image according to the knife mark grayscale threshold, determining the knife mark image information in the knife mark monitoring image, and determining the cutting center coordinates of the knife mark center position according to the knife mark image information.
[0061] Step S14, based on the cutting center coordinates, controlling the image acquisition device to move a preset distance in a preset direction, and acquiring target image information at the current position.
[0062] Step S15, determining the marking coordinate information of the preset marking point in the target image information.
[0063] Step S16: if the marking coordinate information does not match the preset marking coordinate information, an alarm prompt information is generated, wherein the alarm prompt information is used to indicate that the center position of the tool mark does not match the preset tool mark position.
[0064] Optionally, the knife mark monitoring image is identified according to the knife mark grayscale threshold to determine the knife mark image information in the knife mark monitoring image.
[0065] Acquire image grayscale information of the knife mark monitoring image;
[0066] The image grayscale information is screened according to the knife mark grayscale threshold to determine the knife mark pixel points in the knife mark monitoring image;
[0067] The knife mark image information is determined according to the position of the knife mark pixel point in the knife mark monitoring image.
[0068] Optionally, determining the cutting center coordinates of the center position of the knife mark according to the knife mark image information includes:
[0069] Obtaining gray value information of each pixel in the knife mark image information;
[0070] Determine, according to the gray value information, a first pixel point and a second pixel point with the largest gray value in a preset first direction, and a third pixel point and a fourth pixel point with the largest gray value in a preset second direction, wherein the preset first direction is perpendicular to the preset second direction;
[0071] Generate an inscribed rectangle according to the first pixel point, the second pixel point, the third pixel point and the fourth pixel point;
[0072] The cutting center coordinates are determined according to the inscribed rectangle.
[0073] Optionally, determining the cutting center coordinates according to the inscribed rectangle includes:
[0074] Obtaining multiple vertex coordinates of each vertex in the inscribed rectangle;
[0075] Determine the center coordinates of the center position of the inscribed rectangle according to the multiple vertex coordinates;
[0076] The center coordinate is used as the cutting center coordinate.
[0077] Optionally, the method further comprises:
[0078] Obtaining information on the number of cutting blades for the sheet to be cut;
[0079] When the information on the number of cutting knives reaches a preset number of cutting knives, the knife mark monitoring instruction is generated.
[0080] Optionally, controlling the image acquisition device to move a preset distance in a preset direction based on the cutting center coordinates includes:
[0081] Acquire the image center position of the image acquisition device;
[0082] When it is determined that the center position of the image matches the cutting center coordinates, acquiring the preset direction and the preset moving distance;
[0083] Based on the preset direction and the preset movement distance, the image acquisition device is controlled to move.
[0084] Optionally, the method further comprises:
[0085] If the marking coordinate information matches the preset marking coordinates, a cutting instruction is generated, where the cutting instruction is used to instruct the dicing machine to perform cutting based on a preset cutting route.
[0086] For example, in some embodiments, during the product cutting process, the knife mark inspection is performed after a set number of cuts; before the knife mark inspection function is enabled, the knife mark grayscale is first analyzed and the lighting is adjusted (the camera has preset optical parameters for taking a knife mark reference image, including the knife mark grayscale); generally, knife marks after cutting will appear darker due to the lack of product surface and poor reflection. Adjust the grayscale threshold, extract the cutting marks, and then use the square to fit the inscribed rectangle (the cutting marks are not regular straight lines under the microscope, so the two most prominent points of the sheet are connected into a straight line, and the horizontal and vertical directions together form a rectangle). Calculate the center of the rectangle to get the center of the cutting mark; compare the cutting center coordinates with the camera cutting position center. The difference is within the set range, which only proves that the deviation between the center of the cutting mark and the actual cutting center is within the qualified range; in order to solve whether the cutting position is also normal, take the center of the cutting mark as the starting point coordinate, and find a marking template with a fixed value relative to the cutting mark position at the relative position of the cutting mark of the plate (any feature in the sheet can be used as a reference point, as long as it forms a fixed distance from the cutting mark position). After we get the cutting center position, we use the center position as the starting point and move relatively to the marking position. If the deviation of the center of the photographed marker relative to the current cutting mark inspection center position is very small, it means that the current cutting position is also normal. In this way, the loophole of checking whether the product is cut normally in the current market solution can be more thoroughly solved.
[0087] In the above manner, in response to receiving a knife mark monitoring instruction, according to a preset knife mark center, the image acquisition device is moved to the target monitoring position so that the camera center of the image acquisition device matches the preset knife mark center, the knife mark monitoring image of the material to be cut on the dicing machine is obtained based on preset optical parameters, the knife mark monitoring image is identified according to the knife mark grayscale threshold, the knife mark image information in the knife mark monitoring image is determined, the cutting center coordinates of the knife mark center position are determined according to the knife mark image information, and the image acquisition device is controlled to move a preset distance in a preset direction based on the cutting center coordinates, and the target image information at the current position is acquired, and the mark coordinate information of the preset mark point in the target image information is determined. If the mark coordinate information does not match the preset mark coordinate, an alarm prompt information is generated, and the alarm prompt information is used to indicate that the knife mark center position does not match the preset knife mark position. Therefore, according to the relative position between the cut mark and the mark point, it is judged whether there is a cutting deviation defect at the current position, and when a cutting defect occurs, a quick response is made, effectively avoiding material loss caused by cutting deviation and reducing the cost of slicing.
[0088] Figure 2 is a block diagram of a cutting position monitoring device based on an image according to an exemplary embodiment. Figure 2The device 100 includes: a processing module 110, an acquisition module 120, a first determination module 130, a control module 140, a second determination module 150 and an execution module 160.
[0089] The processing module 110 is used for, in response to receiving the knife mark monitoring instruction, moving the image acquisition device to a target monitoring position according to a preset knife mark center so that the camera center of the image acquisition device matches the preset knife mark center;
[0090] An acquisition module 120, configured to acquire a knife mark monitoring image of a sheet to be cut on a dicing machine based on preset optical parameters;
[0091] The first determination module 130 is used to identify the knife mark monitoring image according to the knife mark grayscale threshold, determine the knife mark image information in the knife mark monitoring image; and determine the cutting center coordinates of the knife mark center position according to the knife mark image information;
[0092] A control module 140, configured to control the image acquisition device to move a preset distance in a preset direction based on the cutting center coordinates, and to acquire target image information at a current position;
[0093] A second determination module 150 is used to determine the marking coordinate information of the preset marking point in the target image information;
[0094] The execution module 160 is used to generate an alarm prompt message if the marking coordinate information does not match the preset marking coordinate information, and the alarm prompt message is used to indicate that the center position of the tool mark does not match the preset tool mark position.
[0095] Optionally, the acquisition module 120 is used to:
[0096] Acquire image grayscale information of the knife mark monitoring image;
[0097] The image grayscale information is screened according to the knife mark grayscale threshold to determine knife mark pixels in the knife mark monitoring image;
[0098] The knife mark image information is determined according to the position of the knife mark pixel point in the knife mark monitoring image.
[0099] Optionally, the first determining module 130 includes:
[0100] An acquisition submodule, used for acquiring gray value information of each pixel in the knife mark image information;
[0101] A first determination submodule is used to determine, according to the gray value information, a first pixel point and a second pixel point with the largest gray value in a preset first direction, and a third pixel point and a fourth pixel point with the largest gray value in a preset second direction, wherein the preset first direction is perpendicular to the preset second direction;
[0102] A generating submodule, used for generating an inscribed rectangle according to the first pixel point, the second pixel point, the third pixel point and the fourth pixel point;
[0103] The second determination submodule is used to determine the cutting center coordinates according to the inscribed rectangle.
[0104] Optionally, the second determining submodule is used to:
[0105] Obtaining multiple vertex coordinates of each vertex in the inscribed rectangle;
[0106] Determine the center coordinates of the center position of the inscribed rectangle according to the multiple vertex coordinates;
[0107] The center coordinate is used as the cutting center coordinate.
[0108] Optionally, the apparatus 100 includes a first generating module, the generating module being configured to:
[0109] Obtaining information on the number of cutting blades for the sheet to be cut;
[0110] When the information on the number of cutting knives reaches a preset number of cutting knives, the knife mark monitoring instruction is generated.
[0111] Optionally, the control module 140 is configured to:
[0112] Acquire the image center position of the image acquisition device;
[0113] When it is determined that the center position of the image matches the cutting center coordinates, acquiring the preset direction and the preset moving distance;
[0114] Based on the preset direction and the preset movement distance, the image acquisition device is controlled to move.
[0115] Optionally, the apparatus 100 includes a second generating module, and the second generating module is used to:
[0116] If the marking coordinate information matches the preset marking coordinates, a cutting instruction is generated, where the cutting instruction is used to instruct the dicing machine to perform cutting based on a preset cutting route.
[0117] In the above manner, in response to receiving a knife mark monitoring instruction, according to a preset knife mark center, the image acquisition device is moved to the target monitoring position so that the camera center of the image acquisition device matches the preset knife mark center, the knife mark monitoring image of the material to be cut on the dicing machine is obtained based on preset optical parameters, the knife mark monitoring image is identified according to the knife mark grayscale threshold, the knife mark image information in the knife mark monitoring image is determined, the cutting center coordinates of the knife mark center position are determined according to the knife mark image information, and the image acquisition device is controlled to move a preset distance in a preset direction based on the cutting center coordinates, and the target image information at the current position is acquired, and the mark coordinate information of the preset mark point in the target image information is determined. If the mark coordinate information does not match the preset mark coordinate, an alarm prompt information is generated, and the alarm prompt information is used to indicate that the knife mark center position does not match the preset knife mark position. Therefore, according to the relative position between the cut mark and the mark point, it is judged whether there is a cutting deviation defect at the current position, and when a cutting defect occurs, a quick response is made, effectively avoiding material loss caused by cutting deviation and reducing the cost of slicing.
[0118] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.
[0119] Figure 3 3 is a block diagram of an electronic device 300 according to an exemplary embodiment. For example, the electronic device 300 may be a computer, a digital broadcast terminal, a message transceiver device, a console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.
[0120] Reference Figure 3 , the electronic device 300 may include one or more of the following components: a processing component 302 , a memory 304 , a power component 306 , an input / output interface 312 , a sensor component 314 , and a communication component 316 .
[0121] The processing component 302 generally controls the overall operation of the electronic device 300, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 302 may include one or more processors 320 to execute instructions to complete all or part of the steps of the above-mentioned image-based cutting position monitoring method. In addition, the processing component 302 may include one or more modules to facilitate the interaction between the processing component 302 and other components. For example, the processing component 302 may include a multimedia module to facilitate the interaction between other modules and the processing component 302.
[0122] The memory 304 is configured to store various types of data to support operations on the electronic device 300. Examples of such data include instructions for any application or method operating on the electronic device 300, contact data, phone book data, messages, pictures, videos, etc. The memory 304 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.
[0123] The audio component 310 is configured to output and / or input audio signals. For example, the audio component 310 includes a microphone (MIC), and when the electronic device 300 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 304 or sent via the communication component 316. In some embodiments, the audio component 310 also includes a speaker for outputting audio signals.
[0124] The input / output interface 312 provides an interface between the processing component 302 and the peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.
[0125] The sensor assembly 314 includes one or more sensors for providing various aspects of status assessment for the electronic device 300. For example, the sensor assembly 314 can detect the open / closed state of the electronic device 300, the relative positioning of components, such as the display and keypad of the electronic device 300, and the sensor assembly 314 can also detect the position change of the electronic device 300 or a component of the electronic device 300, the presence or absence of user contact with the electronic device 300, the orientation or acceleration / deceleration of the electronic device 300, and the temperature change of the electronic device 300. The sensor assembly 314 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 314 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 314 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
[0126] The communication component 316 is configured to facilitate wired or wireless communication between the electronic device 300 and other devices. The electronic device 300 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 316 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 316 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.
[0127] In an exemplary embodiment, the electronic device 300 can be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to perform the above-mentioned image-based cutting position monitoring method.
[0128] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 304 including instructions, and the instructions can be executed by a processor 320 of an electronic device 300 to perform the above-mentioned image-based cutting position monitoring method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
[0129] In another exemplary embodiment, a computer program product is also provided. The computer program product includes a computer program executable by a programmable device, and has a code portion for executing the above-mentioned image-based cutting position monitoring method when executed by the programmable device.
[0130] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the present disclosure. The present disclosure is intended to cover any variations, uses or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The description and examples are to be considered as exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.
[0131] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
Claims
1. A cutting position monitoring method based on image, It is characterized in that The method comprises: In response to receiving a knife mark monitoring instruction, the image acquisition device is moved to a target monitoring position according to a preset knife mark center so that a camera center of the image acquisition device matches the preset knife mark center; Acquire a knife mark monitoring image of a material to be cut on a dicing machine based on preset optical parameters; The knife mark monitoring image is identified according to the knife mark grayscale threshold, knife mark image information in the knife mark monitoring image is determined, and the cutting center coordinates of the center position of the knife mark are determined according to the knife mark image information; the determining of the cutting center coordinates of the center position of the knife mark according to the knife mark image information includes: Obtaining gray value information of each pixel in the knife mark image information; Determine, according to the gray value information, a first pixel point and a second pixel point with the largest gray value in a preset first direction, and a third pixel point and a fourth pixel point with the largest gray value in a preset second direction, wherein the preset first direction is perpendicular to the preset second direction; Generate an inscribed rectangle according to the first pixel point, the second pixel point, the third pixel point and the fourth pixel point; Determine the cutting center coordinates according to the inscribed rectangle; Determining the cutting center coordinates according to the inscribed rectangle includes: Obtaining multiple vertex coordinates of each vertex in the inscribed rectangle; Determine the center coordinates of the center position of the inscribed rectangle according to the multiple vertex coordinates; Using the center coordinate as the cutting center coordinate; Based on the cutting center coordinates, controlling the image acquisition device to move a preset distance in a preset direction, and acquiring target image information at the current position; Determine the marking coordinate information of the preset marking point in the target image information; If the marking coordinate information does not match the preset marking coordinates, an alarm prompt information is generated, and the alarm prompt information is used to indicate that the center position of the knife mark does not match the preset knife mark position.
2. The image-based cutting position monitoring method according to claim 1, It is characterized in that The knife mark monitoring image is identified according to the knife mark grayscale threshold to determine the knife mark image information in the knife mark monitoring image. Acquire image grayscale information of the knife mark monitoring image; The image grayscale information is screened according to the knife mark grayscale threshold to determine knife mark pixels in the knife mark monitoring image; The knife mark image information is determined according to the position of the knife mark pixel point in the knife mark monitoring image.
3. The image-based cutting position monitoring method according to claim 1, It is characterized in that The method further comprises: Obtaining information on the number of cutting blades for the sheet to be cut; When the information on the number of cutting knives reaches a preset number of cutting knives, the knife mark monitoring instruction is generated.
4. The image-based cutting position monitoring method according to claim 1, It is characterized in that The step of controlling the image acquisition device to move a preset distance in a preset direction based on the cutting center coordinates includes: Acquire the image center position of the image acquisition device; When it is determined that the center position of the image matches the cutting center coordinates, acquiring the preset direction and the preset moving distance; Based on the preset direction and the preset movement distance, the image acquisition device is controlled to move.
5. The image-based cutting position monitoring method according to claim 1, It is characterized in that The method further comprises: If the marking coordinate information matches the preset marking coordinates, a cutting instruction is generated, where the cutting instruction is used to instruct the dicing machine to perform cutting based on a preset cutting route.
6. An image-based cutting position monitoring device, It is characterized in that The device comprises: A processing module, configured to, in response to receiving a knife mark monitoring instruction, move the image acquisition device to a target monitoring position according to a preset knife mark center so that a camera center of the image acquisition device matches the preset knife mark center; An acquisition module, used for acquiring a knife mark monitoring image of a sheet to be cut on a dicing machine based on preset optical parameters; The first determination module is used to identify the knife mark monitoring image according to the knife mark grayscale threshold, determine the knife mark image information in the knife mark monitoring image; and determine the cutting center coordinates of the center position of the knife mark according to the knife mark image information; the determination of the cutting center coordinates of the center position of the knife mark according to the knife mark image information includes: Obtaining gray value information of each pixel in the knife mark image information; Determine, according to the gray value information, a first pixel point and a second pixel point with the largest gray value in a preset first direction, and a third pixel point and a fourth pixel point with the largest gray value in a preset second direction, wherein the preset first direction is perpendicular to the preset second direction; Generate an inscribed rectangle according to the first pixel point, the second pixel point, the third pixel point and the fourth pixel point; Determine the cutting center coordinates according to the inscribed rectangle; Determining the cutting center coordinates according to the inscribed rectangle includes: Obtaining multiple vertex coordinates of each vertex in the inscribed rectangle; Determine the center coordinates of the center position of the inscribed rectangle according to the multiple vertex coordinates; Using the center coordinate as the cutting center coordinate; A control module, used for controlling the image acquisition device to move a preset distance in a preset direction based on the cutting center coordinates, and to acquire target image information at a current position; A second determining module is used to determine the marking coordinate information of the preset marking point in the target image information; The execution module is used to generate an alarm prompt message if the marking coordinate information does not match the preset marking coordinate information, wherein the alarm prompt message is used to indicate that the center position of the tool mark does not match the preset tool mark position.
7. An electronic device, It is characterized in that include: a memory having a computer program stored thereon; A processor, configured to execute the computer program in the memory to implement the steps of the image-based cutting position monitoring method according to any one of claims 1 to 5.
8. A non-transitory computer-readable storage medium having a computer program stored thereon, It is characterized in that When the program is executed by a processor, the steps of the image-based cutting position monitoring method described in any one of claims 1 to 5 are implemented.
