Real-time dynamic monitoring method, device, equipment and medium for positioning points based on vision

Abstract

The present disclosure relates to a method, device, equipment and medium for real-time dynamic monitoring of positioning points based on vision, the method comprising: obtaining first sheet image data at a first preset position, the first sheet image data including image information of a sheet to be cut, identifying the first sheet image data to determine multiple groups of reference point templates on the sheet to be cut and the distribution position information of the multiple groups of reference point templates on the sheet to be cut, determining multiple cutting processes of the sheet to be cut according to the distribution position information, acquiring a first cut image corresponding to the first cutting process through an image acquisition device, verifying the first cut image according to a second group of reference point templates of the sheet to be cut, and if the cut position in the first cut image matches the preset cut position, determining the entry point position and exit point position of the second cutting process based on the second group of reference point templates. Thus, the accuracy of multi-material cutting on the dicing machine is improved during the cutting process.

Description

Technical Field

[0001] The present disclosure relates to the field of industrial manufacturing, and in particular, to a method, device, equipment and medium for real-time dynamic monitoring of positioning points based on vision. Background Art

[0002] With the advancement of technology and the update of production technology, the manufacturing cost of high-precision equipment has further decreased. As a result, the components that needed to be processed before can choose more advanced equipment and change the processing method to achieve better component processing effects in terms of cost and processing accuracy. The dicing machine is a precision equipment for square cutting of thin sheet materials. It can perform high-precision square cutting of thinner round or square materials of different sizes. Large blocks of materials contain multiple small block single products. In order to achieve precise processing of products after intelligent positioning, identification points for identifying the material cutting path will be printed on the edges of the materials or in the middle of the materials. There is a regular positional relationship between the identification points and the cutting path, which are generally divided into two points: the entry position marking point and the exit position marking point. In addition, in order to improve cutting efficiency, a relatively large working platform will be selected, so that multiple products can be placed on the workbench for processing at one time, to avoid placing too few pieces of material on the small working platform, which will increase the frequency of material changes and reduce processing efficiency. Summary of the invention

[0003] The purpose of the present invention is to provide a vision-based real-time dynamic monitoring method, device, equipment and medium for positioning points, so as to solve the technical problem in the related art that the cutting positioning of the material sheet on the dicing machine is inaccurate, resulting in the wrong cutting line.

[0004] In order to achieve the above-mentioned object, according to a first aspect of the present disclosure, the present disclosure provides a method for real-time dynamic monitoring of positioning points based on vision, which is applied to a terminal, wherein the terminal includes an image acquisition device, and the method includes:

[0005] In response to the image acquisition device moving to a first preset position of the dicing machine, first sheet image data at the first preset position is acquired, wherein the first sheet image data includes image information of the sheet to be cut;

[0006] Identify the first sheet image data to determine multiple groups of reference point templates on the sheet to be cut and distribution position information of the multiple groups of reference point templates on the sheet to be cut;

[0007] Determine, according to the distribution position information, a multi-segment cutting process of the sheet to be cut, wherein each segment of the cutting process corresponds to each group of reference point templates;

[0008] In response to the dicing machine completing a first cutting process based on the multiple cutting processes, the image acquisition device acquires a first cut mark image corresponding to the first cutting process, wherein the first cutting process is any one of the multiple cutting processes;

[0009] The first cutting mark image is verified according to the second group of reference point templates of the sheet to be cut, the next cutting process of the first cutting process in the multi-segment cutting process is the second cutting process, and the reference point template corresponding to the second cutting process is the second group of reference point templates;

[0010] If the cut mark position in the first cut mark image matches the preset cut mark position, the cutting point position and the cutting point position of the second cutting process are determined based on the second set of reference point templates.

[0011] Optionally, determining a multi-stage cutting process of the to-be-cut material according to the distribution position information includes:

[0012] Obtaining information on the number of templates of the multiple groups of reference point templates;

[0013] Dividing the preset cutting process according to the template quantity information to generate multiple initial cutting processes;

[0014] Based on a plurality of preset cutting mark positions in the to-be-cut material sheet in the initial cutting process, establishing a mapping relationship between the plurality of preset cutting mark positions and the plurality of groups of reference templates;

[0015] The multi-segment cutting process is generated according to the mapping relationship.

[0016] Optionally, the initial cutting process includes a plurality of initial cutting sub-processes, and the mapping relationship between the plurality of preset cutting mark positions and the plurality of groups of reference templates is established based on the plurality of preset cutting mark positions in the to-be-cut material sheet in the initial cutting process, including:

[0017] Obtaining an initial cutting point position and an initial cutting point position of a first initial cutting sub-process in the to-be-cut material sheet, wherein the first initial cutting sub-process is any one of the multiple initial cutting sub-processes;

[0018] Determining an initial cutting midpoint of the first initial cutting sub-process according to the initial cutting point position and the initial cutting point position;

[0019] Determining a plurality of spacings between the initial cutting midpoint and the plurality of groups of reference templates;

[0020] Determine, from the multiple distances, a reference template having the smallest distance from the initial cutting midpoint as a first reference template;

[0021] A mapping relationship between the first initial cutting sub-process and the first reference template is established.

[0022] Optionally, determining a plurality of distances between the initial cutting midpoint and the plurality of groups of reference templates comprises:

[0023] Generating multiple groups of reference straight lines according to the multiple groups of reference templates;

[0024] Determining a plurality of vertical distances from the initial cutting terminal to the plurality of reference straight lines;

[0025] The plurality of vertical distances are referred to as the plurality of intervals.

[0026] Optionally, the acquiring of the first cut mark image corresponding to the first cutting process by the image acquisition device includes:

[0027] Acquire first preset cutting position information of the first cutting process;

[0028] Controlling the image acquisition device to move to a corresponding position of the first cutting mark corresponding to the first cutting process based on the first preset cutting position information;

[0029] In response to the image acquisition device moving to the corresponding position, the dicing machine is imaged to generate the first cut image.

[0030] Optionally, the method further comprises:

[0031] Acquire first gray value information of each pixel in the first cut mark image;

[0032] Determine a target pixel point whose grayscale value is greater than a set grayscale threshold from the first grayscale value information;

[0033] Determining a first cut mark image position of the first cutting process according to a position of the target pixel point in the first cut mark image;

[0034] The first cut mark image position is compared with a first preset cut mark position of the first cutting process. If the first cut mark image position matches the first preset cut mark position, it is determined that the cut mark position matches the preset cut mark position.

[0035] Optionally, the method further comprises:

[0036] If the first cutting mark image position does not match the first preset cutting mark position, stopping the multi-stage cutting process and generating an alarm message based on the first cutting process;

[0037] The alarm information is sent to the terminal.

[0038] According to a second aspect of an embodiment of the present disclosure, a device for real-time dynamic monitoring of positioning points based on vision is provided, the device comprising:

[0039] An acquisition module, configured to acquire first sheet image data at a first preset position in response to the image acquisition device moving to a first preset position of a dicing machine, wherein the first sheet image data includes image information of a sheet to be cut;

[0040] A first determination module is used to identify the first sheet image data to determine a plurality of groups of reference point templates on the sheet to be cut and distribution position information of the plurality of groups of reference point templates on the sheet to be cut;

[0041] A second determination module is used to determine a multi-segment cutting process of the to-be-cut material according to the distribution position information, wherein each segment of the cutting process corresponds to each group of reference point templates;

[0042] A collection module, configured to collect a first cut mark image corresponding to the first cutting process through the image collection device in response to the dicing machine completing a first cutting process based on the multiple cutting processes, wherein the first cutting process is any one of the multiple cutting processes;

[0043] a verification module, configured to verify the first cut mark image according to a second set of reference point templates of the sheet to be cut, the next cutting process of the first cutting process in the multi-segment cutting process is the second cutting process, and the reference point template corresponding to the second cutting process is the second set of reference point templates;

[0044] An execution module is used to determine the entry point position and the exit point position of the second cutting process based on the second set of reference point templates if the cut mark position in the first cut mark image matches the preset cut mark position.

[0045] According to a third aspect of an embodiment of the present disclosure, there is provided an electronic device, including:

[0046] a memory having a computer program stored thereon;

[0047] A processor is used to execute the computer program in the memory to implement the steps of the vision-based real-time dynamic monitoring method of positioning points in any one of the first aspects of the present disclosure.

[0048] According to a fourth aspect of an embodiment of the present disclosure, a non-temporary computer-readable storage medium is provided, on which a computer program is stored, and when the program is executed by a processor, the steps of the vision-based real-time dynamic monitoring method of positioning points described in any one of the first aspects of the present disclosure are implemented.

[0049] Through the above technical solution, in response to the image acquisition device moving to the first preset position of the dicing machine, first sheet image data at the first preset position is obtained, the first sheet image data includes image information of the sheet to be cut, the first sheet image data is identified to determine multiple groups of reference point templates on the sheet to be cut and the distribution position information of the multiple groups of reference point templates on the sheet to be cut, and according to the distribution position information, multiple cutting processes of the sheet to be cut are determined, wherein each cutting process corresponds to each group of reference point templates, and in response to the dicing machine completing the first Cutting process, the image acquisition device is used to collect the first cut mark image corresponding to the first cutting process, the first cutting process is any one of the multiple cutting processes, and the first cut mark image is verified according to the second group of reference point templates of the material to be cut, the next cutting process of the first cutting process in the multiple cutting processes is the second cutting process, and the reference point template corresponding to the second cutting process is the second group of reference point templates, if the cut mark position in the first cut mark image matches the preset cut mark position, then based on the second group of reference point templates, the entry point position and exit point position of the second cutting process are determined. In this way, the cut marks are calibrated and verified based on multiple groups of reference templates during the cutting process, and the cutting process is made more accurate based on the diversification of reference templates, thereby improving the accuracy of multi-material cutting on the dicing machine.

[0050] Other features and advantages of the present disclosure will be described in detail in the following detailed description. BRIEF DESCRIPTION OF THE DRAWINGS

[0051] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0052] Figure 1 The present invention is a flowchart of a method for real-time dynamic monitoring of positioning points based on vision according to an exemplary embodiment.

[0053] Figure 2 is a schematic diagram of a material sheet to be cut according to an exemplary embodiment.

[0054] Figure 3 The present invention is a block diagram of a device for real-time dynamic monitoring of positioning points based on vision according to an exemplary embodiment.

[0055] Figure 4 It is a block diagram of an electronic device according to an exemplary embodiment. DETAILED DESCRIPTION

[0056] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0057] It should be noted that all actions of acquiring signals, information or data in the present disclosure are carried out in compliance with the relevant data protection laws and policies of the country where the device is located and with the authorization given by the owner of the corresponding device.

[0058] Figure 1 is a flow chart of a method for real-time dynamic monitoring of positioning points based on vision according to an exemplary embodiment. Figure 1 As shown, the method is applied to a terminal, the terminal is equipped with an image acquisition device, and the method includes the following steps.

[0059] Step S11, in response to the image acquisition device moving to a first preset position of the dicing machine, first sheet image data at the first preset position is acquired, wherein the first sheet image data includes image information of the sheet to be cut.

[0060] For example, in this embodiment, the image acquisition device uses a black and white camera, and performs matching search through image search templates. The image data detected by the image acquisition device is transmitted to the industrial computer through the gigabit network port. The industrial computer includes a CPU, memory, hard disk, USB interface, network port and PCI slot for operation and control board.

[0061] Step S12, identifying the first sheet image data to determine a plurality of groups of reference point templates on the sheet to be cut and distribution position information of the plurality of groups of reference point templates on the sheet to be cut.

[0062] Step S13, determining a multi-segment cutting process of the to-be-cut material according to the distribution position information, wherein each segment of the cutting process corresponds to each group of reference point templates.

[0063] Step S14, in response to the dicing machine completing a first cutting process based on the multiple cutting processes, the image acquisition device acquires a first cut mark image corresponding to the first cutting process, where the first cutting process is any one of the multiple cutting processes.

[0064] Step S15, verifying the first cut mark image according to the second set of reference point templates of the material to be cut, the next cutting process of the first cutting process in the multi-segment cutting process is the second cutting process, and the reference point template corresponding to the second cutting process is the second set of reference point templates.

[0065] Step S16: If the cut mark position in the first cut mark image matches the preset cut mark position, then based on the second set of reference point templates, determine the cutting point position and the cutting point position of the second cutting process.

[0066] Optionally, determining a multi-stage cutting process of the to-be-cut material according to the distribution position information includes:

[0067] Obtaining information on the number of templates of the multiple groups of reference point templates;

[0068] Dividing the preset cutting process according to the template quantity information to generate multiple initial cutting processes;

[0069] Based on a plurality of preset cutting mark positions in the to-be-cut material sheet in the initial cutting process, establishing a mapping relationship between the plurality of preset cutting mark positions and the plurality of groups of reference templates;

[0070] The multi-segment cutting process is generated according to the mapping relationship.

[0071] Optionally, the initial cutting process includes a plurality of initial cutting sub-processes, and the mapping relationship between the plurality of preset cutting mark positions and the plurality of groups of reference templates is established based on the plurality of preset cutting mark positions in the to-be-cut material sheet in the initial cutting process, including:

[0072] Obtaining an initial cutting point position and an initial cutting point position of a first initial cutting sub-process in the to-be-cut material sheet, wherein the first initial cutting sub-process is any one of the multiple initial cutting sub-processes;

[0073] Determining an initial cutting midpoint of the first initial cutting sub-process according to the initial cutting point position and the initial cutting point position;

[0074] Determining a plurality of spacings between the initial cutting midpoint and the plurality of groups of reference templates;

[0075] Determine, from the multiple distances, a reference template having the smallest distance from the initial cutting midpoint as a first reference template;

[0076] A mapping relationship between the first initial cutting sub-process and the first reference template is established.

[0077] Optionally, determining a plurality of distances between the initial cutting midpoint and the plurality of groups of reference templates comprises:

[0078] Generating multiple groups of reference straight lines according to the multiple groups of reference templates;

[0079] Determining a plurality of vertical distances from the initial cutting terminal to the plurality of reference straight lines;

[0080] The plurality of vertical distances are referred to as the plurality of intervals.

[0081] Optionally, the acquiring of the first cut mark image corresponding to the first cutting process by the image acquisition device includes:

[0082] Acquire first preset cutting position information of the first cutting process;

[0083] Controlling the image acquisition device to move to a corresponding position of the first cutting mark corresponding to the first cutting process based on the first preset cutting position information;

[0084] In response to the image acquisition device moving to the corresponding position, the dicing machine is imaged to generate the first cut image.

[0085] Optionally, the method further comprises:

[0086] Acquire first gray value information of each pixel in the first cut mark image;

[0087] Determine a target pixel point whose grayscale value is greater than a set grayscale threshold from the first grayscale value information;

[0088] Determining a first cut mark image position of the first cutting process according to a position of the target pixel point in the first cut mark image;

[0089] The first cut mark image position is compared with a first preset cut mark position of the first cutting process. If the first cut mark image position matches the first preset cut mark position, it is determined that the cut mark position matches the preset cut mark position.

[0090] Optionally, the method further comprises:

[0091] If the first cutting mark image position does not match the first preset cutting mark position, stopping the multi-stage cutting process and generating an alarm message based on the first cutting process;

[0092] The alarm information is sent to the terminal.

[0093] For example, Figure 2 is a schematic diagram of a material to be cut according to an exemplary embodiment. Figure 2As shown in the figure, the traditional reference point templates are relatively few and the entire cutting process is fixed. For example, there is only a single reference point template, and the entire cutting action is carried out according to the technical specifications when to cut horizontally and when to cut vertically. The cutting process cannot change the cutting parameters and reference point templates. However, this solution can find multiple sets of templates in the sheet, such as Figure 2 As shown, the sheet to be cut includes 4 sets of reference point templates. With the reference point template, a fixed cutting process can be avoided. Different reference point templates can be switched during the cutting process to verify the already cut cutting path. For example, when cutting, use 1 set of templates to locate the starting point and the end point for cutting. When the cutting is completed, 2 sets of templates can be switched to check the completed path. Switching to 2 sets of templates to locate the starting point and the end point of the cutting also plays a role in calibration and verification during the cutting process. The templates of the reference points are diversified, and the entire cutting process can be switched and changed, which is flexible.

[0094] Through the above technical solution, in response to the image acquisition device moving to the first preset position of the dicing machine, first sheet image data at the first preset position is obtained, the first sheet image data includes image information of the sheet to be cut, the first sheet image data is identified to determine multiple groups of reference point templates on the sheet to be cut and the distribution position information of the multiple groups of reference point templates on the sheet to be cut, and according to the distribution position information, multiple cutting processes of the sheet to be cut are determined, wherein each cutting process corresponds to each group of reference point templates, and in response to the dicing machine completing the first Cutting process, the image acquisition device is used to collect the first cut mark image corresponding to the first cutting process, the first cutting process is any one of the multiple cutting processes, and the first cut mark image is verified according to the second group of reference point templates of the material to be cut, the next cutting process of the first cutting process in the multiple cutting processes is the second cutting process, and the reference point template corresponding to the second cutting process is the second group of reference point templates, if the cut mark position in the first cut mark image matches the preset cut mark position, then based on the second group of reference point templates, the entry point position and exit point position of the second cutting process are determined. In this way, the cut marks are calibrated and verified based on multiple groups of reference templates during the cutting process, and the cutting process is made more accurate based on the diversification of reference templates, thereby improving the accuracy of multi-material cutting on the dicing machine.

[0095] Figure 3 is a block diagram of a real-time dynamic monitoring device for positioning points based on vision according to an exemplary embodiment. Figure 3 As shown, the device 100 includes: an acquisition module 110 , a first determination module 120 , a second acquisition module 130 , a collection module 140 , a verification module 150 and an execution module 160 .

[0096] An acquisition module 110 is configured to acquire first sheet image data at a first preset position in response to the image acquisition device moving to a first preset position of a dicing machine, wherein the first sheet image data includes image information of a sheet to be cut;

[0097] A first determination module 120 is used to identify the first sheet image data to determine a plurality of groups of reference point templates on the sheet to be cut and distribution position information of the plurality of groups of reference point templates on the sheet to be cut;

[0098] A second determination module 130 is used to determine a multi-segment cutting process of the to-be-cut material according to the distribution position information, wherein each segment of the cutting process corresponds to each group of reference point templates;

[0099] The acquisition module 140 is used for acquiring a first cut mark image corresponding to the first cutting process through the image acquisition device in response to the dicing machine completing a first cutting process based on the multiple cutting processes, wherein the first cutting process is any one of the multiple cutting processes;

[0100] A verification module 150 is used to verify the first cut mark image according to the second group of reference point templates of the sheet to be cut, the next cutting process of the first cutting process in the multi-segment cutting process is the second cutting process, and the reference point template corresponding to the second cutting process is the second group of reference point templates;

[0101] The execution module 160 is used to determine the cutting point position and the cutting point position of the second cutting process based on the second set of reference point templates if the cutting mark position in the first cutting mark image matches the preset cutting mark position.

[0102] Optionally, the second determining module 130 includes:

[0103] An acquisition submodule, used to acquire information on the number of templates of the multiple groups of reference point templates;

[0104] A first generating submodule, used for dividing the preset cutting process according to the template quantity information to generate multiple initial cutting processes;

[0105] An establishment submodule is used to establish a mapping relationship between a plurality of preset cutting mark positions and the plurality of groups of reference templates based on a plurality of preset cutting mark positions in the to-be-cut material sheet in the initial cutting process;

[0106] The second generating submodule is used to generate the multi-segment cutting process according to the mapping relationship.

[0107] Optionally, create submodules, including:

[0108] An acquisition unit, configured to acquire an initial cutter entry point position and an initial cutter exit point position of a first initial cutting sub-process in the sheet to be cut, wherein the first initial cutting sub-process is any one of the multiple initial cutting sub-processes;

[0109] A first determining unit, configured to determine an initial cutting midpoint of the first initial cutting sub-process according to the initial cutting point position and the initial cutting point position;

[0110] A second determining unit, configured to determine a plurality of distances between the initial cutting midpoint and the plurality of groups of reference templates;

[0111] A third determining unit, configured to determine, from the multiple intervals, a reference template having the smallest interval with the initial cutting midpoint as a first reference template;

[0112] An establishing unit is used to establish a mapping relationship between the first initial cutting sub-process and the first reference template.

[0113] Optionally, the second determining unit is configured to:

[0114] Generating multiple groups of reference straight lines according to the multiple groups of reference templates;

[0115] Determining a plurality of vertical distances from the initial cutting terminal to the plurality of reference straight lines;

[0116] The plurality of vertical distances are referred to as the plurality of intervals.

[0117] Optionally, the acquisition module 140 is used to:

[0118] Acquire first preset cutting position information of the first cutting process;

[0119] Controlling the image acquisition device to move to a corresponding position of the first cutting mark corresponding to the first cutting process based on the first preset cutting position information;

[0120] In response to the image acquisition device moving to the corresponding position, the dicing machine is imaged to generate the first cut image.

[0121] Optionally, the apparatus 100 further includes a first determination module, the first determination module being configured to:

[0122] Acquire first gray value information of each pixel in the first cut mark image;

[0123] Determine a target pixel point whose grayscale value is greater than a set grayscale threshold from the first grayscale value information;

[0124] Determining a first cut mark image position of the first cutting process according to a position of the target pixel point in the first cut mark image;

[0125] The first cut mark image position is compared with a first preset cut mark position of the first cutting process. If the first cut mark image position matches the first preset cut mark position, it is determined that the cut mark position matches the preset cut mark position.

[0126] Optionally, the apparatus 100 further includes a second determination module, wherein the second determination module is configured to:

[0127] If the first cutting mark image position does not match the first preset cutting mark position, stopping the multi-stage cutting process and generating an alarm message based on the first cutting process;

[0128] The alarm information is sent to the terminal.

[0129] Through the above technical solution, in response to the image acquisition device moving to the first preset position of the dicing machine, first sheet image data at the first preset position is obtained, the first sheet image data includes image information of the sheet to be cut, the first sheet image data is identified to determine multiple groups of reference point templates on the sheet to be cut and the distribution position information of the multiple groups of reference point templates on the sheet to be cut, and according to the distribution position information, multiple cutting processes of the sheet to be cut are determined, wherein each cutting process corresponds to each group of reference point templates, and in response to the dicing machine completing the first Cutting process, the image acquisition device is used to collect the first cut mark image corresponding to the first cutting process, the first cutting process is any one of the multiple cutting processes, and the first cut mark image is verified according to the second group of reference point templates of the material to be cut, the next cutting process of the first cutting process in the multiple cutting processes is the second cutting process, and the reference point template corresponding to the second cutting process is the second group of reference point templates, if the cut mark position in the first cut mark image matches the preset cut mark position, then based on the second group of reference point templates, the entry point position and exit point position of the second cutting process are determined. In this way, the cut marks are calibrated and verified based on multiple groups of reference templates during the cutting process, and the cutting process is made more accurate based on the diversification of reference templates, thereby improving the accuracy of multi-material cutting on the dicing machine.

[0130] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0131] Through the above technical scheme, in response to the image acquisition device moving to the preset first position of the dicing machine, the first sheet image data at the preset first position is obtained, and the identification point recognition is performed on the first sheet image data. When it is determined that there is no entry point identification in the first sheet image data and there is a knife exit point identification in the first sheet image data, the camera center of the image acquisition device is used as the starting point, the image acquisition device is controlled to search for the entry point identification based on the first preset path range, and the first coordinate information of the entry point identification is determined according to the image acquisition device. In response to the image acquisition device moving to the preset second position of the dicing machine, the second sheet image data at the preset second position is obtained, and the identification point recognition is performed on the second sheet image data. When it is determined that there is no knife exit point identification in the first sheet image data, the camera center of the image acquisition device is used as the starting point, the image acquisition device is controlled to search for the knife exit point identification based on the second preset path range, and the second coordinate information of the knife exit point identification is determined according to the image acquisition device. According to the first coordinate information and the second coordinate information, a cutting positioning path for the sheet to be cut on the dicing machine is generated. This can adapt to the precise positioning required during multi-material cutting on the dicing machine, avoid production accidents caused by inaccurate positioning during the cutting process, and improve the accuracy of multi-material cutting on the dicing machine.

[0132] Figure 4 4 is a block diagram of an electronic device 400 according to an exemplary embodiment. For example, the electronic device 400 may be a computer, a digital broadcast terminal, a message transceiver device, a console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0133] Reference Figure 4 , the electronic device 400 may include one or more of the following components: a processing component 402 , a memory 404 , a power component 406 , an input / output interface 412 , a sensor component 414 , and a communication component 416 .

[0134] The processing component 402 generally controls the overall operation of the electronic device 400, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 402 may include one or more processors 420 to execute instructions to complete all or part of the steps of the above-mentioned vision-based positioning point real-time dynamic monitoring method. In addition, the processing component 402 may include one or more modules to facilitate the interaction between the processing component 402 and other components. For example, the processing component 402 may include a multimedia module to facilitate the interaction between other modules and the processing component 402.

[0135] The memory 404 is configured to store various types of data to support operations on the electronic device 400. Examples of such data include instructions for any application or method operating on the electronic device 400, contact data, phone book data, messages, pictures, videos, etc. The memory 404 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0136] The power supply component 406 provides power to the various components of the electronic device 400. The power supply component 406 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device 400.

[0137] In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of a touch or slide action. In some embodiments, a front camera and / or a rear camera are included. When the electronic device 400 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0138] The sensor assembly 414 includes one or more sensors for providing various aspects of status assessment for the electronic device 400. For example, the sensor assembly 414 can detect the open / closed state of the electronic device 400, the relative positioning of the components, such as the display and keypad of the electronic device 400, and the sensor assembly 414 can also detect the position change of the electronic device 400 or a component of the electronic device 400, the presence or absence of contact between the user and the electronic device 400, the orientation or acceleration / deceleration of the electronic device 400, and the temperature change of the electronic device 400. The sensor assembly 414 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 414 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 414 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0139] The communication component 416 is configured to facilitate wired or wireless communication between the electronic device 400 and other devices. The electronic device 400 can access a wireless network based on a communication standard, such as WiFi, 2G or 4G, or a combination thereof. In an exemplary embodiment, the communication component 416 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 416 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0140] In an exemplary embodiment, the electronic device 400 can be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to execute the above-mentioned vision-based real-time dynamic monitoring method for positioning points.

[0141] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 404 including instructions, and the instructions can be executed by a processor 420 of an electronic device 400 to complete the above-mentioned vision-based real-time dynamic monitoring method for positioning points. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0142] In another exemplary embodiment, a computer program product is also provided. The computer program product includes a computer program that can be executed by a programmable device. The computer program has a code portion for executing the above-mentioned vision-based real-time dynamic monitoring method of positioning points when executed by the programmable device.

[0143] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the present disclosure. The present disclosure is intended to cover any variations, uses or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The description and examples are to be considered as exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0144] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A real-time dynamic monitoring method for positioning points based on vision, characterized in that: Applied to a terminal, the terminal includes an image acquisition device, and the method includes: In response to the image acquisition device moving to a first preset position of the dicing machine, first sheet image data at the first preset position is acquired, wherein the first sheet image data includes image information of the sheet to be cut; Identify the first sheet image data to determine multiple groups of reference point templates on the sheet to be cut and distribution position information of the multiple groups of reference point templates on the sheet to be cut; Determine a multi-segment cutting process of the sheet to be cut according to the distribution position information, wherein each segment of the cutting process corresponds to each group of reference point templates; In response to the dicing machine completing a first cutting process based on the multiple cutting processes, the image acquisition device acquires a first cut mark image corresponding to the first cutting process, wherein the first cutting process is any one of the multiple cutting processes; The first cutting mark image is verified according to the second group of reference point templates of the sheet to be cut, the next cutting process of the first cutting process in the multi-segment cutting process is the second cutting process, and the reference point template corresponding to the second cutting process is the second group of reference point templates; If the cut mark position in the first cut mark image matches the preset cut mark position, the cutting point position and the cutting point position of the second cutting process are determined based on the second set of reference point templates.

2. The method for real-time dynamic monitoring of positioning points based on vision according to claim 1, characterized in that: Determining the multi-stage cutting process of the to-be-cut material according to the distribution position information includes: Obtaining information on the number of templates of the multiple groups of reference point templates; Dividing the preset cutting process according to the template quantity information to generate multiple initial cutting processes; Based on a plurality of preset cutting mark positions in the to-be-cut material sheet in the initial cutting process, establishing a mapping relationship between the plurality of preset cutting mark positions and the plurality of groups of reference point templates; The multi-segment cutting process is generated according to the mapping relationship.

3. The method for real-time dynamic monitoring of positioning points based on vision according to claim 2 is characterized in that: The initial cutting process includes a plurality of initial cutting sub-processes, and the mapping relationship between the plurality of preset cutting mark positions and the plurality of groups of reference point templates is established based on the plurality of preset cutting mark positions in the to-be-cut material sheet according to the initial cutting process, including: Obtaining an initial cutting point position and an initial cutting point position of a first initial cutting sub-process in the to-be-cut material sheet, wherein the first initial cutting sub-process is any one of the multiple initial cutting sub-processes; Determining an initial cutting midpoint of the first initial cutting sub-process according to the initial cutting point position and the initial cutting point position; Determining a plurality of spacings between the initial cutting midpoint and the plurality of sets of reference point templates; Determine, from the multiple intervals, a set of reference point templates with the smallest intervals from the initial cutting midpoint as the first reference point template; A mapping relationship between the first initial cutting sub-process and the first reference point template is established.

4. The method for real-time dynamic monitoring of positioning points based on vision according to claim 3 is characterized in that: Determining a plurality of distances between the initial cutting midpoint and the plurality of groups of reference point templates comprises: Generating multiple groups of reference straight lines according to the multiple groups of reference point templates; Determining a plurality of perpendicular distances from the initial cutting midpoint to the plurality of sets of reference straight lines; The plurality of vertical distances are referred to as the plurality of intervals.

5. The method for real-time dynamic monitoring of positioning points based on vision according to claim 1, characterized in that: The collecting of the first cut mark image corresponding to the first cutting process by the image collecting device includes: Acquire first preset cutting position information of the first cutting process; Controlling the image acquisition device to move to a corresponding position of the first cutting mark corresponding to the first cutting process based on the first preset cutting position information; In response to the image acquisition device moving to the corresponding position, the dicing machine is imaged to generate the first cut image.

6. The method for real-time dynamic monitoring of positioning points based on vision according to any one of claims 1 to 5, characterized in that: The method further comprises: Acquire first gray value information of each pixel in the first cut mark image; Determine a target pixel point whose grayscale value is greater than a set grayscale threshold from the first grayscale value information; Determining a first cut mark image position of the first cutting process according to a position of the target pixel point in the first cut mark image; The first cut mark image position is compared with a first preset cut mark position of the first cutting process. If the first cut mark image position matches the first preset cut mark position, it is determined that the cut mark position matches the preset cut mark position.

7. The method for real-time dynamic monitoring of positioning points based on vision according to claim 6 is characterized in that: The method further comprises: If the first cutting mark image position does not match the first preset cutting mark position, stopping the multi-stage cutting process and generating an alarm message based on the first cutting process; The alarm information is sent to the terminal.

8. A real-time dynamic monitoring device for positioning points based on vision, characterized in that: The device comprises: An acquisition module, configured to acquire first sheet image data at a first preset position in response to the image acquisition device moving to a first preset position of the dicing machine, wherein the first sheet image data includes image information of the sheet to be cut; A first determination module is used to identify the first sheet image data to determine a plurality of groups of reference point templates on the sheet to be cut and distribution position information of the plurality of groups of reference point templates on the sheet to be cut; A second determination module is used to determine a multi-segment cutting process of the to-be-cut material according to the distribution position information, wherein each segment of the cutting process corresponds to each group of reference point templates; A collection module, configured to collect a first cut mark image corresponding to the first cutting process through the image collection device in response to the dicing machine completing a first cutting process based on the multiple cutting processes, wherein the first cutting process is any one of the multiple cutting processes; a verification module, configured to verify the first cut mark image according to a second set of reference point templates of the sheet to be cut, the next cutting process of the first cutting process in the multi-segment cutting process is the second cutting process, and the reference point template corresponding to the second cutting process is the second set of reference point templates; An execution module is used to determine the entry point position and the exit point position of the second cutting process based on the second set of reference point templates if the cut mark position in the first cut mark image matches the preset cut mark position.

9. An electronic device, characterized in that: include: a memory having a computer program stored thereon; A processor is used to execute the computer program in the memory to implement the steps of the vision-based real-time dynamic monitoring method of positioning points as described in any one of claims 1-7.

10. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the steps of the vision-based real-time dynamic monitoring method for positioning points described in any one of claims 1-7 are implemented.

Images