ZYNQ embedded image-assisted numerical control system

By integrating FPGA and ARM chips into one piece, using internal bus communication and visual assistance functions, the high communication cost and poor performance caused by the separation design of FPGA and ARM chips in the existing CNC CNC system are solved, and the operational performance is achieved. , a six-axis motor-linked CNC system with strong real-time communication and low cost.

CN118938802APending Publication Date: 2024-11-12SHENZHEN ZHONGLIANTUO CNC TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411224887.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-03
Publication Date
2024-11-12

AI Technical Summary

Technical Problem

The separation design of FPGA and ARM chips in existing CNC CNC systems leads to high communication costs and poor performance, making it difficult to achieve low-cost and high-performance motion control.

Method used

Using ZYNQ chip, FPGA and ARM chip are integrated into one piece, through internal bus communication, combined with FPGA's hardware accelerator and ARM's process processing capabilities, visual assistance functions are added to improve system performance.

Benefits of technology

It realizes a six-axis motor-linked CNC system with stable operating performance, strong communication real-time and low cost, reducing development costs and development efficiency and improving the competitiveness of the system.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118938802A_ABST
    Figure CN118938802A_ABST
Patent Text Reader

Abstract

The invention belongs to the technical field of embedded motion control and automation, and particularly relates to a ZYNQ embedded image-assisted numerical control system. The whole ZYNQ embedded image auxiliary numerical control system comprises an FPGA control system and an ARM numerical control system. The ARM numerical control system comprises a CPU0 motion control unit and a CPU1 image processing unit. The CPU0 motion control unit is mainly responsible for internal and external interface data processing and motion control processing functions; the CPU 1 image processing unit is mainly responsible for assisting processing of a high-definition image tool path processing algorithm transmitted by the image acquisition unit in the FPGA control system. The FPGA control system comprises a motion implementation unit and an image acquisition unit; the motion implementation unit is mainly responsible for working of a six-axis servo motor, 32-path IO input and output control and display output; the image acquisition unit is mainly responsible for controlling the CMOS image sensor and carrying the images to the CPU 1 image processing unit in the ARM numerical control system through DMA.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention belongs to the technical field of embedded motion control and automation, and specifically relates to a ZYNQ embedded image-assisted numerical control system. Background Art

[0002] Numerical control technology is the guarantee of advanced manufacturing technology. In the field of numerical control systems, in order to realize complex motion control calculations such as speed planning, acceleration planning and trajectory planning, the CNC numerical control system software needs to adapt to the bus servo, which requires a lot of work and even requires the redesign of the software architecture. The ZYNQ embedded image-assisted numerical control system of the present invention can control the numerical control system of the composite processing equipment with six-axis motor linkage. The controller ZYNQ chip FPGA and ARM chip of the numerical control system are integrated on one piece. The FPGA end uses the xc7z010clg400-1 chip, and the embedded end uses the ARM CONTEX A9 dual-core chip. The system has the advantages of stable operating performance, strong real-time communication, and low cost.

[0003] Currently, the products on the market basically use FPGA as the CNC controller and ARM as the CNC user operation end. This separate design uses network cable, SDIO or serial port to communicate between the two boards, which is not in line with the development direction of low cost and high performance. The internal bus communication is used between FPGA and ARM in the ZYNQ chip, which makes full use of the advantages of the hardware accelerator on the FPGA side and the advantages of the ARM side in powerful process processing. The dual-core of the ARM side runs petalinux and sdk bare metal respectively, making data interaction more convenient and stable.

[0004] FPGA can achieve four times the speed of embedded image processing in terms of image algorithm, and can give full play to the advantages of FPGA-side CMOS high-speed acquisition and HLS image algorithm acceleration after acquisition, to assist ZYNQ CNC system processing; this CNC system with ZYNQ CNC system as the main and visual assistance as the auxiliary makes ZYNQ embedded image-assisted CNC system products more competitive. Summary of the invention

[0005] In order to help optimize the existing CNC system functions more comprehensively, the present invention proposes a ZYNQ embedded image-assisted CNC system, which adds some visual auxiliary functions on the FPGA side while controlling the six axes. At the same time, ARM and FPGA are in one chip, that is, the FPGA pulse control circuit and the ARM control circuit are integrated into one circuit, which improves the development efficiency and reduces the development cost.

[0006] The present invention proposes a ZYNQ embedded image-assisted numerical control system, which comprises an FPGA control system and an ARM numerical control system.

[0007] In a ZYNQ embedded image-assisted numerical control system of the present invention, the FPGA control system includes a motion implementation unit and an image acquisition unit;

[0008] The motion implementation unit in the FPGA control system includes controlling the X-axis servo motor, Y-axis servo motor, Z-axis servo motor, A-axis servo motor, B-axis servo motor, C-axis servo motor, 16-way IO input, 16-way IO output, RGBA display output and HDMI interface display output. Among them, 32-way IO output is used to control the coolant switch, gas valve switch, 3-way limit switch or tension switch.

[0009] The image acquisition unit in the FPGA control system includes the use of CMOS chips for data image acquisition. The FPGA control system and the CMOS chip data interface use parallel or four-lane serial high-speed pixel interface (HiSPi) differential signals (SLVS) for communication. The image sensor chip MT9F002I12STCV-DP imported from the United States is selected here. This MT9F002I12STCV-DP supports 1.4 million pixels-Pix technology, automatic black level calibration, external mechanical shutter bracket, supports scaling from maximum resolution, full HD support at 60 frames per second, and an active pixel array of 4608H×3288V (4640H×3320V, including boundary pixels) to achieve optimal video performance. The full HD image array area can be increased by 20% to achieve electronic image stabilization; this ON Semiconductor chip also supports programmable control: gain, horizontal and vertical blanking, frame size / rate, exposure, left and right and up and down image inversion, window size and translation, which is very suitable for digital video or digital still camera scenes.

[0010] In the image acquisition unit of the FPGA control system, the FPGA collects the image of the 4608H×3288V pixel of the CMOS image sensor of ON Semiconductor MT9F002I12STCV-DP model through the Verilog method, and then converts the image format through the Bayer to RGB conversion and transmits it to AXI_DMA through the axi-stream internal bus. AXI_DMA uses the internal bus axi-stream to move it to HLS for image pre-algorithm processing. After HLS processing, AXI_DMA sends it to the CPU1 image processing unit through the axi_hp bus.

[0011] In the image acquisition unit of the FPGA control system, the image is pre-processed after being acquired from ON Semiconductor. This is mainly done by adding a dedicated algorithm to the HLS IP core and implementing hardware acceleration through the hls::cv library.

[0012] In a ZYNQ embedded image-assisted numerical control system of the present invention, the ARM numerical control system includes a CPU0 motion control unit and a CPU1 image processing unit;

[0013] CPU0 motion control unit, which is transplanted with petalinux system, is mainly responsible for the processing of internal and external interface data and motion control processing;

[0014] The processing of internal and external interface data in the CPU0 motion control unit includes controlling 16 IO inputs and 16 IO outputs through the AXI_ACP interface; including controlling the communication control of the six-axis servo motor through the AXI_GPIO; including the output of the HMDI interface or the RGBA interface for interface display; including processing the input of peripheral USB storage devices, such as U disk; including the external output of the network port; including the USB WIFI hotspot connection output; including the external output of the PS debugging serial port; including 4x5 USB button control input; including the MPG handwheel encoder input; including the vibration sensor data input; including the temperature monitoring sensor data input.

[0015] The communication between the CPU0 motion control unit and the CPU1 image processing unit uses the chip's internal DDR cache refresh method and uses inter-core soft interrupts for notification. The data that the CPU0 motion control unit needs to transmit to the CPU1 image processing unit include the control command parameters for controlling the CMOS chip frame rate, pixels, zoom, and focus.

[0016] Motion control processing in CPU0 motion control unit, including NC program syntax checking, NC program interpreter, interpolation control algorithm, trajectory planning, motor acceleration planning, machining 3D tool path display, machining progress processing, tool management, and user file addition, deletion and modification management.

[0017] The CPU1 image processing unit runs the SDK bare metal system and is mainly responsible for assisting the processing of the high-definition image path processing algorithm transmitted from the image acquisition unit in the FPGA control system, and outputs the image data to the CPU0 control unit through the inter-core soft interrupt method inside the chip and the DDR cache refresh method.

[0018] The USB keyboard input uses a 4x5 matrix key form to input the USB peripheral of the CPU0 motion control unit PS in the ARM numerical control system, using a circular scanning method. There are 20 keys, which can meet the user's demand for a motion control system with simple and convenient keys.

[0017] The interface between the handwheel and the CNC system uses USB to input to the CPU0 motion control unit PS peripheral in the ARM CNC system. There are three switches for selecting the magnification: x10, x100, and x1000, which can determine the direction in which the handwheel is rotating.

[0018] There is no special requirement for HDMI output. It can be connected to the user's monitor with an HDMI interface through an external HDMI monitor, and the HDMI interface hardware circuit pin constraints can be added to the FPGA control system.

[0019] The ARM numerical control system includes CPU0 motion control unit and CPU1 image processing unit; CPU0 motion control unit is mainly responsible for the processing of internal and external interface data and motion control processing functions; CPU1 image processing unit is mainly responsible for assisting the processing of high-definition image tool path processing algorithms transmitted from the image acquisition unit in the FPGA control system. The FPGA control system includes motion implementation unit and image acquisition unit; the motion implementation unit is mainly responsible for the work of the six-axis servo motor, 32-way IO input and output control and display output; the image acquisition unit is mainly responsible for the CMOS image sensor gain, horizontal and vertical blanking, frame size / rate, exposure, left and right and up and down image inversion, window size and translation control, and transfers these images to the CPU1 image processing unit in the ARM numerical control system through DMA.

[0020] The advantages of the present invention are

[0021] The dual-core processor architecture is adopted, and the FPGA chip of xc7z010clg400-1 and the ARM dual-core chip are integrated on one chip, which reduces the design size of the chip circuit and reduces the hardware cost. The ARM numerical control system and the FPGA control system are combined into one, giving full play to the advantages of the system process of the ARM human-computer interaction part and the parallel real-time high-speed advantages of the FPGA pulse control part, avoiding the problem of inaccurate numerical control system data caused by external plug-in or interference transmission of the two boards, and has broad market prospects in the field of low-cost economical numerical control machine tools that require fast processing speed. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Figure 1 The schematic diagram of the ZYNQ embedded image-assisted numerical control system is shown.

[0022] Figure 2 The ZYNQ embedded image-assisted CNC system architecture is shown.

[0023] Figure 3 The flow chart of ZYNQ embedded image-assisted numerical control system is shown;

[0024] Figure 4 It shows the 4x5 buttons of the exclusive external USB interface actually supported by the ZYNQ embedded image-assisted CNC system. DETAILED DESCRIPTION

[0025] Figure 1As shown in the figure, the principle block diagram of the ZYNQ embedded image-assisted CNC system, the ARM CNC system includes CPU0 motion control unit and CPU1 image processing unit; CPU0 motion control unit is mainly responsible for the processing of internal and external interface data and motion control processing functions; CPU1 image processing unit is mainly responsible for assisting the processing of the high-definition image tool path processing algorithm transmitted from the image acquisition unit in the FPGA control system. The FPGA control system includes a motion implementation unit and an image acquisition unit; the motion implementation unit is mainly responsible for the work of the six-axis servo motor, 32-way IO input and output control and display output; the image acquisition unit is mainly responsible for the image acquisition of the CMOS image sensor and the HLS IP core algorithm processing, and these images are transferred to the CPU1 image processing unit in the ARM CNC system through DMA.

[0026] Figure 2 As shown in the figure, the architecture of ZYNQ embedded image-assisted numerical control system, the hardware driver layer includes the bottom LINUX driver and FPGA logic driver; the bottom LINUX driver is responsible for the internal bus driver, network port / WIFI interface driver, USB driver, HLS IP driver, interrupt UIO driver, DMA IP driver, storage medium driver and debug serial port driver; the FPGA logic driver is responsible for the HDMI display driver, RGBA display driver, 16-way IO input read driver, 16-way IO output write driver, six-axis servo motor driver and CMOS chip driver. The CPU0 motion control unit of the system layer runs the petalinux operating system, the CPU1 image processing unit runs the bare metal system, and the CPU0 motion control unit and the CPU1 image processing unit use inter-core soft interrupts and refresh DDR to transmit images and control CMOS chips. The application program of the user layer is responsible for the three major categories of interface response, motion control and sensor data system processing. The interface response is responsible for processing the hardware interface data transmission and protocol processing, tool setting / tool ​​change / tool ​​setting management, processing time / processing progress display, handwheel / key / touch protocol input action response, mechanical coordinate / workpiece coordinate management and user file addition, deletion and modification.

[0027] Figure 3As shown in the figure, the flow design diagram of the ZYNQ embedded image-assisted CNC system is first used to find the zero point in the machine tool through the limit device and set the XY zero point of the machine tool mechanical coordinates. Z is set to the safe height raised. Place the workpiece arbitrarily and fix it with a fixture, read the G code for processing in the USB disk, and the user operates to find the zero point of the workpiece coordinates. At this time, the CMOS image acquisition system starts to work, and the acquired image is passed to the HLS::CV image pixel processing for workpiece feature judgment, and assists the CNC system to identify the image processing coordinate origin. At the same time, the HLS::CV image pixel processing assists in identifying the 3D tool path and acceleration planning generated by the processing coordinates, and then combines the mechanical coordinates and the workpiece coordinate system to start motion control for servo processing of the workpiece. During the processing process, the HLS::CV image pixel processing assists in identifying the 3D tool path generated by the processing coordinates, and assists in visual fusion of a more accurate 3D tool path trajectory; the CPU1 image processing unit transmits the 3D tool path trajectory of the workpiece to the CPU0 motion control unit for HDMI or RGBA output display.

[0028] Figure 4 As shown in the figure, the ZYNQ embedded image-assisted CNC system actually supports a dedicated external USB interface 4x5 button controller design, which overlaps multiple functions on the same button, and after input, it is transmitted to the embedded image-assisted CNC system for processing control.

[0029] Professionals in the field of numerical control technology can understand that various aspects of the method for calibrating the machining datum of a numerical control system are implemented as systems, methods or products. Various aspects of the present disclosure can be specifically implemented in the following forms: a complete hardware implementation, a complete software implementation, which can be collectively referred to as a "unit" or "system" here.

[0030] The above description is only an exclusive implementation mode of the present invention and is not intended to limit the present invention. Any modifications, substitutions, improvements, etc. made within the spirit and principles of the present invention should be regarded as the protection scope of the present invention by technicians in the development field without departing from the technical principles of the present invention.

Claims

1. A ZYNQ embedded image-assisted numerical control system, characterized in that: The ZYNQ embedded image-assisted CNC system as a whole includes an FPGA control system and an ARM CNC system. The ARM CNC system includes a CPU0 motion control unit and a CPU1 image processing unit. The CPU0 motion control unit is mainly responsible for the processing of internal and external interface data and motion control processing functions. The CPU1 image processing unit is mainly responsible for assisting the processing of the high-definition image tool path processing algorithm transmitted from the image acquisition unit in the FPGA control system. The FPGA control system includes a motion implementation unit and an image acquisition unit. The motion implementation unit is mainly responsible for the work of the six-axis servo motor, 32-way IO input and output control and display output. The image acquisition unit is mainly responsible for the CMOS image sensor gain, horizontal and vertical blanking, frame size / rate, exposure, left and right and up and down image inversion, window size and translation control, and transfers these images to the CPU1 image processing unit in the ARM CNC system through DMA.

2. The ZYNQ embedded image-assisted numerical control system according to claim 1, characterized in that: The motion implementation unit in the FPGA control system includes controlling the X-axis servo motor, Y-axis servo motor, Z-axis servo motor, A-axis servo motor, B-axis servo motor, C-axis servo motor, 16-way IO input, 16-way IO output, RGBA display output and HDMI interface display output. Among them, 32-way IO output is used to control the coolant switch, gas valve switch, 3-way limit switch or tension switch.

3. The ZYNQ embedded image-assisted numerical control system according to claim 1, characterized in that: The image acquisition unit in the FPGA control system includes the use of CMOS chips for data image acquisition. The FPGA control system and the CMOS chip data interface use parallel or four lane serial high-speed pixel interface (HiSPi) differential signals (SLVS) for communication. After the image is acquired from ON Semiconductor, the image is pre-processed, mainly through the hls::cv library in the HLS IP core to achieve hardware acceleration.

4. The ZYNQ embedded image-assisted numerical control system according to claim 1, characterized in that: Processing of internal and external interface data in CPU0 motion control unit, including control of 16 IO inputs and 16 IO outputs through AXI_ACP interface; including communication control of six-axis servo motors through AXI_GPIO; including output of interface display through HMDI interface or RGBA interface; including processing of external USB storage device input, such as U disk; including external output of network port; including USB WIFI hotspot connection output; including external output of PS debug serial port; including 4x5 USB key control input; Includes MPG handwheel encoder input; includes vibration sensor data input; includes temperature monitoring sensor data input.

5. The ZYNQ embedded image-assisted numerical control system according to claim 1, characterized in that: Motion control processing in CPU0 motion control unit, including NC program syntax checking, NC program interpreter, interpolation control algorithm, trajectory planning, motor acceleration planning, machining 3D tool path display, machining progress processing, tool management, and user file addition, deletion and modification management.

6. The ZYNQ embedded image-assisted numerical control system according to claim 1, characterized in that: The dual-core processor architecture is adopted, and the FPGA chip of xc7z010clg400-1 and the ARM dual-core chip are integrated on one chip, which reduces the design size of the chip circuit and reduces the hardware cost. The ARM numerical control system and the FPGA control system are combined into one.

7. The ZYNQ embedded image-assisted numerical control system according to claim 1, characterized in that: The communication between the CPU0 motion control unit and the CPU1 image processing unit uses the chip's internal DDR cache refresh method and uses inter-core soft interrupts for notification. The data that the CPU0 motion control unit needs to transmit to the CPU1 image processing unit include the control command parameters for controlling the CMOS chip frame rate, pixels, zoom, and focus.

8. The ZYNQ embedded image-assisted numerical control system according to claim 1, characterized in that: FPGA can achieve four times the speed of embedded image processing in terms of image algorithm, and can give full play to the advantages of FPGA-side CMOS high-speed acquisition and HLS image algorithm acceleration after acquisition, to assist ZYNQ CNC system processing; this CNC system with ZYNQ CNC system as the main and visual assistance as the auxiliary makes ZYNQ embedded image-assisted CNC system products more competitive.

9. The ZYNQ embedded image-assisted numerical control system architecture according to claim 1, characterized in that: The hardware driver layer includes the bottom LINUX driver and FPGA logic driver; the bottom LINUX driver is responsible for the internal bus driver, network port / WIFI interface driver, USB driver, HLS IP driver, interrupt UIO driver, DMA IP driver, storage medium driver and debug serial port driver; the FPGA logic driver is responsible for the HDMI display driver, RGBA display driver, 16-way IO input read driver, 16-way IO output write driver, six-axis servo motor driver and CMOS chip driver. The system layer CPU0 motion control unit runs the petalinux operating system, the CPU1 image processing unit runs the bare metal system, the CPU0 motion control unit and the CPU1 image processing unit use inter-core soft interrupts and refresh DDR to transmit images and control CMOS chips. The user layer application is responsible for the three major categories of interface response, motion control and sensor data system processing. The interface response is responsible for processing hardware interface data transmission and protocol processing, tool setting / tool ​​change / tool ​​setting management, processing time / processing progress display, handwheel / button / touch protocol input action response, mechanical coordinate / workpiece coordinate management and user file addition, deletion, modification and query.

10. The ZYNQ embedded image-assisted numerical control system process according to claim 1 is characterized in that: First, find the zero point in the machine tool through the limit device and set the XY zero point of the machine tool mechanical coordinates, and set Z to the safe height raised. Place the workpiece arbitrarily and fix it with a fixture, read the G code for processing in the USB disk, and the user operates to find the zero point of the workpiece coordinates. At this time, the CMOS image acquisition system starts to work, and the acquired image is passed to the HLS::CV image pixel processing for workpiece feature judgment, and assists the CNC system to identify the image processing coordinate origin. At the same time, the HLS::CV image pixel processing assists in identifying the 3D tool path and acceleration planning generated by the processing coordinates, and then combines the mechanical coordinates and the workpiece coordinate system to start motion control for servo processing of the workpiece. During the processing process, the HLS::CV image pixel processing assists in identifying the 3D tool path generated by the processing coordinates, and assists in visual fusion of a more accurate 3D tool path trajectory; the CPU1 image processing unit transmits the 3D tool path trajectory of the workpiece to the CPU0 motion control unit for HDMI or RGBA output display.