Augmented reality processing assistance system and its use method

Abstract

The present invention discloses an augmented reality processing auxiliary system, including a workpiece processing database, a calculation module and an augmented reality device. The workpiece processing database is used to store multiple workpiece processing original data. The calculation module is electrically connected to the workpiece processing database to calculate the auxiliary processing data of the workpiece. The augmented reality device is electrically connected to the workpiece processing database and the calculation module. The augmented reality device has a sensor to sense the identification pattern on the workpiece, wherein the identification pattern obtains an identification code through analysis and calculation and transmits it to the workpiece processing database. After receiving the identification code, the workpiece processing database transmits the corresponding workpiece processing original data to the calculation module to calculate the auxiliary processing data, and the calculation module transmits the auxiliary processing data to the augmented reality device for display.

Description

Technical Field

[0001] The present invention relates to the field of machining assistance systems, and in particular to a machining assistance system that utilizes augmented reality technology to assist an operator in operating a machining machine, and a method for using the system. Background Art

[0002] In order to cope with the manufacture of workpieces of various shapes or materials, such as wood, metal, semiconductors, ceramics, composite materials or other workpieces that can be processed, there are many types of existing processing machines and tools used on the machines, and the operation of the processing machines has become relatively complicated. In order to meet the requirements of the size and shape of various workpieces, the operator of the processing machine often needs to compare the workpiece being processed with the design drawing at any time, and needs to manually measure the size of the processed part on the workpiece before and after each processing process to confirm that the processing process is correct.

[0003] For example, in the prior art, when drilling a plate-like workpiece, the operator first needs to manually measure the size of the motherboard. If the size does not match, the motherboard needs to be cut to the correct size and then the size of the plate-like workpiece needs to be measured again. The operator then needs to compare the design drawing or CAD drawing to confirm that the size of the plate-like workpiece is correct, and then place the plate-like workpiece on the drilling machine to prepare for the drilling operation. In order to match the drilling position of the plate-like workpiece, the operator needs to manually install a dedicated tool on the drilling machine according to the CAM software or the pre-planned tool installation method, and then perform mechanical positioning of the machine for these installed tools. Only after the positioning is completed can the drilling operation be officially carried out.

[0004] Therefore, during the entire processing process, the operator often needs to compare the design drawings, workpieces and machine configurations back and forth. For the machine operator, the more complicated this processing process is, the easier it is to make mistakes. Moreover, if the cutting size error, the omission of the processing procedure or the tool installation error occurs in the above process, not only the entire process needs to be corrected from the beginning, but the previously processed incorrect workpiece must also be scrapped, causing waste, and the entire processing production progress is also prone to delays. In addition, the production line of the processing plant often needs to deal with changes in the type of workpieces produced. When the same machine is changed to process different types of workpieces, all of the above processes may also need to be significantly modified, which can easily lead to low production efficiency. Summary of the invention

[0005] In view of the shortcomings of the prior art and the problems encountered, the purpose of the present invention is to provide a method of using augmented reality real-time imaging technology as an auxiliary production line processing method. The imaging source is the original data of the workpiece processing. The augmented reality real-time imaging technology is combined with CAD / CAM software, that is, the original data of the workpiece processing is obtained after scanning the processed workpiece, and the model drawn by the CAD software and the result of the path planned by the CAM software are calculated in real time, and then projected and imaged. In this way, it can replace traditional design drawings and increase the processing efficiency and convenience on the production line.

[0006] Taking the quality inspection of wood panel furniture production lines as an example, the existing technology requires the operator to measure the relative coordinates and dimensions of the process implemented on the workpiece by himself to verify whether the workpiece processing results or accuracy meet the standards, and to compare them with the design drawings or CAD drawings, which is not only time-consuming and laborious. In addition, taking the "CNC multi-row drilling" machine for mass production of wood panel furniture as an example, each different workpiece needs to be planned through the CAM software. The processing path and machine configuration, when the operator installs the tool on the machine according to the prompts provided by the program, can begin processing. If the number of processes to be implemented is large, the operator must print out the drawings for the machine configuration, or confirm back and forth whether the tool configuration on the machine is consistent with the configuration planned by the CAM software, which is also time-consuming and laborious.

[0007] In addition, before using or augmenting the reality equipment to scan the workpiece, each workpiece must be assigned a unique identification barcode. The identification barcode can be a one-dimensional code, a two-dimensional code, a QR Code, an RFID or other equivalent object identification code, which is used to record the geometric information and processing information of the workpiece. Then, using the Mark-Based technology in augmented reality technology, the unique identification barcode of the workpiece is used as the identification object. After the lens scans the identification barcode, the workpiece information recorded by the identification barcode is obtained to generate a virtual model or description of CAD or CAM. Then, based on the deformation of the identification barcode in the actual space, the proportion of the virtual model is calculated, and a virtual workpiece or machine configuration of the same size is projected, and the relevant position, size, and prompt information are marked for the operator's reference.

[0008] If augmented reality real-time imaging technology can be combined with CAD / CAM software, when the workpiece is processed, the workpiece-specific identification barcode can be scanned and the model drawn by CAD software can be imaged based on the original data of the workpiece processing. This can be applied to quality inspection. The operator can compare the difference between the actual processing result and the virtual image at a glance, and the inspection process becomes more intuitive and faster. Furthermore, before processing, the workpiece-specific identification barcode can be scanned and the processing path can be calculated immediately by CAM software. The result planned by CAM software can be projected, and the operator can install and verify the machine according to the imaging result, making the pre-processing work more efficient.

[0009] Therefore, in order to achieve the above-mentioned purpose, the present invention provides an augmented reality processing assistance system for assisting a processing machine to process a workpiece. The augmented reality processing assistance system includes: a workpiece processing database for storing a plurality of workpiece processing original data; a calculation module electrically connected to the workpiece processing database, the calculation module for calculating the auxiliary processing data of the workpiece; and an augmented reality device electrically connected to the workpiece processing database and the calculation module, the augmented reality device having a sensor for sensing an identification pattern on the workpiece; wherein the identification pattern is obtained through analysis and calculation to obtain an identification code and transmitted to the workpiece processing database, the workpiece processing database receives the identification code and transmits the workpiece processing original data of the corresponding workpiece to the calculation module for calculating the auxiliary processing data of the workpiece, the calculation module transmits the auxiliary processing data to the augmented reality device, and the augmented reality device displays the auxiliary processing data on the display of the augmented reality device.

[0010] In a preferred embodiment, the original data of workpiece processing is a text file.

[0011] In a preferred embodiment, the auxiliary processing data includes a virtual graphic file of the workpiece, and the calculation module also includes a drawing module. The drawing module draws the virtual graphic file through the original processing data of the workpiece.

[0012] In a preferred embodiment, the auxiliary processing data includes the operation flow of the processing machine, and the calculation module also includes a computer-aided manufacturing calculation module, which calculates the operation flow through the workpiece processing raw data.

[0013] In a preferred embodiment, the calculation module is disposed in the augmented reality device.

[0014] In a preferred embodiment, the analysis algorithm is executed by the processor of the augmented reality device to obtain the identification code, and the augmented reality device transmits the identification code to the workpiece processing database.

[0015] In a preferred embodiment, the recognition pattern is transmitted from the augmented reality device to the calculation module, the analysis calculation is executed by the calculation module to obtain the recognition code, and the recognition code is transmitted by the calculation module to the workpiece processing database.

[0016] To achieve the above-mentioned purpose, the present invention provides a method for using an augmented reality processing assistance system, which is used to assist a processing machine in processing a workpiece. The augmented reality processing assistance system includes a workpiece processing database, a calculation module and an augmented reality device, wherein the workpiece processing database is used to store multiple workpiece processing original data, the augmented reality device has a sensor, and the method for using includes the following steps: sensing an identification pattern on the workpiece through the sensor; analyzing the identification pattern to obtain an identification code; transmitting the identification code to the workpiece processing database; according to the identification code, the workpiece processing database transmits the workpiece processing original data of the corresponding workpiece to the calculation module; according to the workpiece processing original data, the calculation module calculates the auxiliary processing data of the workpiece and transmits the auxiliary processing data to the augmented reality device; and displaying the auxiliary processing data on the display of the augmented reality device.

[0017] In a preferred embodiment, the method for using the augmented reality processing auxiliary system further includes the following steps: analyzing the recognition pattern through the processor of the augmented reality device to obtain the recognition code; and

[0018] The identification code is transmitted to the workpiece processing database through the augmented reality device.

[0019] In a preferred embodiment, the method for using the augmented reality processing assistance system also includes the following steps: sensing the identification pattern on the workpiece through a sensor to obtain a recognition pattern image and transmitting the recognition pattern image to a calculation module; analyzing the recognition pattern image through the calculation module to obtain an identification code; and transmitting the identification code to the workpiece processing database through the calculation module.

[0020] According to the above, the embodiment of the present invention senses the identification pattern on the workpiece through the sensor of the augmented reality device, and receives the workpiece processing original data from the workpiece processing database after analyzing the identification pattern to obtain the identification code, and then calculates the auxiliary processing data of the workpiece based on the workpiece processing original data and displays it on the display of the augmented reality device. In this way, the appropriate operation process can be displayed in real time corresponding to different types of workpieces, and the operation errors of the processing machine operator can be greatly reduced. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Figure 1 is a system architecture diagram showing an augmented reality processing assistance system according to an embodiment of the present invention;

[0022] Figure 2 is based on Figure 1 An embodiment of the invention is a schematic diagram showing a workpiece and a recognition pattern on the workpiece;

[0023] Figure 3 is based on Figure 1 and Figure 2 An embodiment of the invention is a schematic diagram showing a display state of an augmented reality processing assistance system for an operator to watch;

[0024] Figure 4 is a system architecture diagram showing an augmented reality processing assistance system according to another embodiment of the present invention;

[0025] Figure 5 is a system architecture diagram showing an augmented reality processing assistance system according to yet another embodiment of the present invention;

[0026] Figure 6 According to another embodiment of the present invention, a method for using an augmented reality processing assistance system is shown;

[0027] Fig. 7A is based on Figure 6 An embodiment of the present invention shows a method for using an augmented reality processing assistance system; and

[0028] Figure 7B is based on Figure 6 The embodiment of the present invention shows a method for using an augmented reality processing assistance system.

[0029] Explanation of symbols:

[0030] 10, 20, 30 Augmented Reality Processing Assistance System

[0031] 11 Workpiece processing database

[0032] 111 Workpiece processing raw data

[0033] 112, 113 Auxiliary processing data

[0034] 12, 22, 32 calculation modules

[0035] 121 Drawing Module

[0036] 122 Computer-aided manufacturing calculation module

[0037] 13 Augmented Reality Devices

[0038] 131 Sensor

[0039] 132 Processors

[0040] 133 Display

[0041] 15 Workpiece

[0042] 15' Virtual Workpiece

[0043] 151 Pattern recognition

[0044] 152 Features

[0045] 152' The shape of the feature after processing

[0046] 321 Calculation module processor

[0047] A, B, C data transmission path

[0048] Steps S101~S106, S202~S203, S301~S303 DETAILED DESCRIPTION

[0049] The above-mentioned other technical contents, features and effects of the present invention will be clearly presented in the following detailed description of a preferred embodiment with reference to the accompanying drawings. The directional terms mentioned in the following embodiments, such as up, down, left, right, front or back, etc., are only referenced to the directions of the attached drawings. Therefore, the directional terms used are used to illustrate and not to limit the present invention.

[0050] Figure 1 FIG. 1 is a schematic diagram showing the architecture of an augmented reality processing assistance system according to an embodiment of the present invention. Figure 1 The augmented reality processing auxiliary system 10 includes a workpiece processing database 11, a calculation module 12, and an augmented reality device 13. The workpiece processing database 11 is used to store a plurality of workpiece processing raw data 111. The workpiece processing database 11 is located in a storage device (not shown), such as a hard disk in a computer or other readable recording media. The workpiece processing raw data 111 can be the size, shape, thickness, processing method, etc. of various processed workpiece products or features on the workpiece. The features can be protrusions or depressions on various workpieces, etc., which are not limited here.

[0051] Figure 2 is based on Figure 1 Embodiment, showing a schematic diagram of a workpiece and a recognition pattern on the workpiece, and at the same time Figure 1 The calculation module 12 is electrically connected to the workpiece processing database 11. The calculation module 12 is used to calculate the auxiliary processing data of the workpiece 15. The augmented reality device 13 is electrically connected to the workpiece processing database 11 and the calculation module 12. The augmented reality device 13 has a sensor 131 for sensing the identification pattern 151 on the workpiece 15. In this embodiment, the workpiece 15 is in a flat plate shape but is not limited thereto. The sensor 131 can be a laser barcode scanner, a charge coupled device (CCD) scanner, a 2D camera, a 3D camera or other suitable sensing device. The identification pattern 151 is formed on the workpiece 15 by, for example, sticker attachment, laser processing or other appropriate methods. The identification pattern 151 can record the identification code (not shown) of the workpiece 15. Workpieces 15 of different processing processes or different types have different identification codes. The identification pattern 151 can be a one-dimensional barcode, a two-dimensional barcode, an RFID or other suitable types. The present invention is not limited thereto.

[0052] Please continue to refer to Figure 1 and Figure 2 When the sensor 131 senses the identification pattern 151 on the workpiece 15, the identification pattern 151 can obtain an identification code through analysis and calculation, and transmit the identification code to the workpiece processing database 11. Specifically, the augmented reality device 13 of this embodiment also has a processor 132, and the processor 132 can perform the analysis and calculation on the identification pattern 151 to obtain the identification code, and the augmented reality device 13 then transmits the identification code to the workpiece processing database 11 through the data transmission path A. In this embodiment, the processor 132 can be a single-core or multi-core central processing unit (CPU) in the prior art that can be installed in the augmented reality device 13 and can perform analysis and calculation, other programmable general-purpose or special-purpose microprocessors, or other similar components, or a combination of the above components. The analysis calculation can be based on the recognition pattern 151 sensed by the sensor 131, which is first converted into an electrical signal and then goes through processes such as calculating the deformation ratio, decoding, and image processing to obtain an identification code, wherein the identification code is, for example, a string of text, symbols, numbers, or a combination thereof that is specific to the workpiece 15. The data transmission path A can be an existing wired or wireless data transmission method, such as a physical cable, Wi-Fi, Bluetooth, Zigbee, or other suitable data transmission methods. In addition, since the analysis calculation of pattern recognition belongs to the existing technology in the field of augmented reality technology, the present invention does not elaborate on its calculation principle and details.

[0053] Please continue to refer to Figure 1 and Figure 2 When the workpiece processing database 11 receives the identification code, it transmits the workpiece processing original data 111 corresponding to the workpiece 15. For example, each piece of workpiece processing original data 111 stored in the workpiece processing database 11 corresponds to a specific identification code. When the workpiece processing database 11 receives the identification code that is exclusive to the workpiece 15 from the data transmission path A, it transmits the workpiece processing original data 111 corresponding to the workpiece 15 to the calculation module 12 through another data transmission path B, wherein the data transmission path B is similar to the data transmission path A, and can adopt the existing wired or wireless data transmission method, which will not be described in detail in the present invention.

[0054] After receiving the workpiece processing raw data 111 corresponding to the workpiece 15, the calculation module 12 calculates the auxiliary processing data 112 of the workpiece 15, and transmits the auxiliary processing data 112 to the augmented reality device 13 through the data transmission path C. The augmented reality device 13 displays the auxiliary processing data 112 on the display 133. In detail, the calculation module 12 is, for example, a PC, a tablet computer or other suitable electronic device with a single-core or multi-core CPU and a GPU (Graphics Processing Unit). The calculation module 12 includes a drawing module 121 and a computer-aided calculation module 122. The workpiece processing raw data 111 is a text file. The data transmission path C is similar to the data transmission paths A and B, and can be an existing wired or wireless data transmission method. Since the workpiece processing raw data 111 only records the text information such as the size, shape, thickness or processing method of the finished product or feature after the workpiece 15 is processed, it can greatly improve the data transmission rate between the workpiece processing database 11 and the calculation module 12 compared with the image file or picture file. The drawing module 121 can also generate the auxiliary processing data 112 of the workpiece 15 in real time according to the various data in the workpiece processing raw data 111, thereby accelerating the processing efficiency of the calculation module 12. In this embodiment, the drawing module 121 can be implemented by computer-aided design (CAD, Computer Aided Design) software or other suitable drawing software installed. The auxiliary processing data 112 can be a virtual model of the workpiece 15 after processing. The augmented reality device 13 is, for example, a head-mounted display device, a mobile phone, a tablet computer, a notebook computer or other electronic display devices with augmented reality functions. In this way, the operator only needs to wear or hold the augmented reality device 13 to view the virtual model of the workpiece 15 after processing on the display 133 of the augmented reality device 13, and can confirm whether the operation of the processing machine is correct in real time, thereby greatly reducing the operating errors of the processing machine operator.

[0055] In this embodiment, the computer-aided calculation module 122 of the calculation module 12 can be implemented by computer-aided manufacturing (CAM) software or other suitable processing and manufacturing planning software. The computer-aided calculation module 122 can calculate the auxiliary processing data 113 in real time according to the content of the workpiece processing original data 111 and display it on the display 133 of the augmented reality device 13, wherein the auxiliary processing data 113 can be the operation flow of the processing machine corresponding to the workpiece 15, and the operation flow includes, for example, the type, installation position and number of the tool on the processing machine, or the operation sequence of the processing machine when processing the workpiece 15. In this way, the operator of the processing machine can not only compare the operation mode of the tool installation of the processing machine in real time to greatly reduce the situation of operation errors, but also when the type of the workpiece 15 is changed, the augmented reality processing auxiliary system 10 can also modify the auxiliary processing data 112 and 113 in real time by scanning the identification barcode 151 of different workpieces 15, so that it can correspond to different types of workpieces 15 and display the appropriate operation flow or the virtual model of the finished workpiece.

[0056] Figure 3 is based on Figure 1 and Figure 2 The embodiment of FIG. 1 is a schematic diagram showing the display status of the augmented reality processing auxiliary system for the operator to watch. Please also refer to Figure 1 , Figure 2 and Figure 3 It should be noted that the present invention does not limit the file format of the auxiliary processing data 112 or 113, nor does it limit the display 133 to only display one of the auxiliary processing data 112 or 113. When the hardware capabilities of the calculation module 12 and the augmented reality device 13 are sufficient, the display 133 can also display and modify the auxiliary processing data 112 and 113 at the same time. Specifically, the augmented reality device 13 can use the existing augmented reality display technology to simultaneously display the actual workpiece 15, the auxiliary processing data 112 and 113 in the display 133, wherein the auxiliary processing data 112 includes the virtual model 15' of the workpiece 15 and the shape 152' of the feature 152 on the workpiece 15 after processing, and the auxiliary processing data 113 includes the operation process, for example, the installation position of the tool in the processing machine and the operation steps and other information that the operator needs to know are displayed in a pure text form. In addition, the auxiliary processing data 112 may include not only the virtual model 15' and the shape 152' of the feature object after processing, but also graphic text or symbols such as dimension markings and process types. The information included in the auxiliary processing data 113 may be in the form of pure text or schematic diagrams or a combination of text and graphics, such as a schematic diagram of the tool type and installation position of a processing machine, etc. This allows the operator of the processing machine to more easily understand the machine operation process and increase work efficiency.

[0057] In this embodiment, the auxiliary processing data 112 includes a virtual model of the workpiece 15 after processing, and the auxiliary processing data 113 includes a processing machine operation process corresponding to the workpiece 15. However, in other embodiments, the auxiliary processing data may also include a simulation process video of processing the workpiece 15 drawn by the computer-aided computing module 122 itself through the drawing capability, or by the drawing module 121 according to the processing original data 111. In addition, when the computer-aided computing module 122 finds an error while calculating the auxiliary processing data, such as when the tool specifications of the processing machine cannot meet the processing requirements of the workpiece 15 or other errors occur, the computer-aided computing module 122 may also add a prompt of the failure of the processing path planning and / or the cause of the error to the auxiliary processing data, and display it on the display 133 of the augmented reality device 13.

[0058] Figure 4 is a system architecture diagram of an augmented reality processing assistance system according to another embodiment of the present invention. Figure 4 , Augmented Reality Processing Assistance System 20 and Figure 1 The augmented reality processing assistance system 20 is similar to the augmented reality processing assistance system 10 of the present invention, and the same components are represented by the same component numbers and are not repeated here. Figure 1 The difference between the augmented reality processing auxiliary system 10 and the augmented reality processing auxiliary system 10 is that the calculation module 22 is set in the augmented reality device 13. In other words, when the hardware computing power of the augmented reality device 13 is sufficient, the calculation module 22 can be directly installed in the augmented reality device 13 and use the hardware resources of the augmented reality device 13 for calculation, so that the setting of the hardware equipment related to the calculation module 22 can be reduced, and the volume of the overall augmented reality processing auxiliary system 20 can be reduced. In addition, since the calculation module 22 is directly installed in the augmented reality device 13, after the identification code is transmitted from the augmented reality device 13 to the workpiece processing database 11 through the data transmission path A, the workpiece processing raw data 111 is also transmitted back to the augmented reality device 13 through the data transmission path A for the calculation module 22 to perform calculations, so that the path and process of data transmission can be simplified.

[0059] Figure 5 is a system architecture diagram of an augmented reality processing assistance system according to another embodiment of the present invention. Figure 2 and Figure 5 , Augmented Reality Processing Assistance System 30 and Figure 1 Augmented reality processing assistance system 10 and Figure 4The augmented reality processing assistance system 30 is similar to the augmented reality processing assistance system 20 of the present invention, and the same components are represented by the same component numbers and are not repeated here. The difference between the augmented reality processing assistance system 30 and the augmented reality processing assistance systems 10 and 20 is that when the sensor 131 of the augmented reality device 13 senses the recognition pattern 151, a recognition pattern image (not shown) is obtained, and the augmented reality device 13 transmits the recognition pattern image to the calculation module 32, and the calculation module 32 performs analysis calculation on the recognition pattern image to obtain a recognition code, and then the calculation module 32 transmits the recognition code to the workpiece processing database 11. In detail, the augmented reality device 13 can transmit the sensed recognition pattern 151 in the form of an image file, that is, a recognition pattern image, to the calculation module 32 through the data transmission path C, and then the processor 321 of the calculation module 32 performs analysis calculations on the recognition pattern image to obtain a recognition code, wherein the processor 321 can be a single-core or multi-core central processing unit (CPU) capable of performing analysis calculations in the prior art, other programmable general-purpose or special-purpose microprocessors (Microprocessors) or other similar components or a combination of the above components, which will not be repeated here. Next, the calculation module 32 transmits the identification code to the workpiece processing database 11 through the data transmission path B. The workpiece processing database 11 then transmits the corresponding workpiece processing original data 111 to the calculation module 32 through the data transmission path B according to the identification code to calculate the auxiliary processing data 112 and 113. Finally, the calculation module 32 transmits the auxiliary processing data 112 and 113 completed by the calculation to the augmented reality device 13 through the data transmission path C, and the display 133 displays the auxiliary processing data 112 and 113. In this way, since the augmented reality device 13 only needs to transmit the identification pattern image to the calculation module 32, part of the hardware burden can be reduced, and relatively high hardware capabilities are not required, thereby achieving the lightweight of the augmented reality device 13. In addition, since the augmented reality device 13 of this embodiment does not need to directly connect with the workpiece processing database 11 for data transmission, that is, the workpiece processing database 11 only needs to verify the security of the data transmission path B between the calculation module 32 and does not need the data transmission path A, so the information security of the workpiece processing database 11 can be improved. In addition, in this embodiment, the calculation module 32 performs analysis calculations on the identified pattern image through the processor 321, and respectively performs calculations of the auxiliary processing data 112 and 113 through the aforementioned drawing module 121 and the computer-aided manufacturing calculation module 122. However, the processor 321 can also execute or support the calculation work of the drawing module 121 and the computer-aided manufacturing calculation module 122, and the present invention will not be repeated here.

[0060] Figure 1In the augmented reality machining assistance system 10 disclosed in the embodiment, the workpiece machining database 11, the calculation module 12 and the augmented reality device 13 are independent electronic devices or are disposed in different devices; Figure 4 In the augmented reality processing auxiliary system 20 disclosed in the embodiment, the calculation module 22 is disposed in the augmented reality device 13; Figure 5 In the disclosed augmented reality processing assistance system 30, the augmented reality device 13 transmits the recognition pattern image to the processor 321 of the calculation module 32 to perform analysis calculations on the recognition pattern image. However, in other embodiments, the workpiece processing database can also be set in the augmented reality device. For example, the augmented reality device can be an electronic device such as a notebook computer or a tablet computer that can be equipped with a large-capacity storage device. The workpiece processing database can be set in the storage device of these electronic devices. In this way, the augmented reality processing assistance system only needs to set up the connection between the augmented reality device and the calculation module, which can improve the operating efficiency of the entire augmented reality processing assistance system. In addition, if the hardware capacity of the augmented reality device is sufficient, the workpiece processing database and the calculation module can also be set in the augmented reality device at the same time, which can greatly reduce the space or volume occupied by the augmented reality processing assistance system. In this embodiment, the operation of the augmented reality processing assistance system is roughly the same as the aforementioned embodiment, and will not be repeated here.

[0061] Figure 6 According to yet another embodiment of the present invention, a method for using an augmented reality processing assistance system is shown. Figure 6 The embodiments can be applied to the above-mentioned augmented reality processing assistance systems 10, 20, 30, please refer to Figure 6 And with Figure 1 , Figure 2 , Figure 4 and Figure 5 The augmented reality processing assistance system 10, 20, 30 is used to assist a processing machine in processing a workpiece 15. The augmented reality processing assistance system 10, 20, 30 includes a workpiece processing database 11, a calculation module 12 (or 22, 32) and an augmented reality device 13. The workpiece processing database 11 is used to store a plurality of workpiece processing raw data 111. The augmented reality device 13 has a sensor 131. The method for using the augmented reality processing assistance system also includes the following steps.

[0062] Step S101 : Sense the identification pattern on the workpiece through the sensor In this step, the sensor 131 of the augmented reality device 13 is used to sense the identification pattern 151 on the workpiece 15 , wherein the identification pattern 151 can record the identification code of the workpiece 15 .

[0063] Step S102: Analyze the recognition pattern to obtain the recognition code. In this step, the recognition pattern 151 is analyzed and calculated to obtain the recognition code. The analysis and calculation is based on the recognition pattern 151 sensed by the sensor 131, which is first converted into an electrical signal and then calculated through deformation ratio, decoding and other processes to obtain the recognition code.

[0064] Step S103: Transmitting the identification code to the workpiece processing database. In this step, in the augmented reality processing assistance system 10, 20, the identification code is transmitted from the augmented reality device 13 to the workpiece processing database 11 via the data transmission path A. In addition, in the augmented reality processing assistance system 30, the identification code is obtained by the processor 321 of the calculation module 32 performing the analysis calculation, and thus the calculation module 32 transmits the identification code to the workpiece processing database 11 via the data transmission path B.

[0065] Step S104: According to the identification code, the workpiece processing database transmits the workpiece processing raw data of the corresponding workpiece to the calculation module. In this step, the workpiece processing database 11 of the augmented reality processing auxiliary system 10, 30 transmits the workpiece processing raw data 111 to the calculation module 12, 32 through the data transmission path B, and in the augmented reality processing auxiliary system 20, the workpiece processing database 11 transmits the workpiece processing raw data 111 to the calculation module 22 in the augmented reality device 13 through the data transmission path A.

[0066] Step S105: Based on the workpiece processing original data, the calculation module calculates the auxiliary processing data of the workpiece, and transmits the auxiliary processing data to the augmented reality device. In this step, the calculation modules 12, 22, 32 calculate the auxiliary processing data 112, 113 of the workpiece 15 based on the workpiece processing original data 111. The calculation modules 12, 32 transmit the auxiliary processing data 112, 113 to the augmented reality device 13 through the data transmission path C. Since the calculation module 12 is set in the augmented reality device 13, the auxiliary processing data 112, 113 can be transmitted only through the circuit inside the augmented reality device 13. The auxiliary processing data 112 can be a virtual model of the workpiece 15 after processing, and the auxiliary processing data 113 can be an operation flow of the processing machine corresponding to the workpiece 15.

[0067] Step S106: Display the auxiliary processing data on the display of the augmented reality device. In this step, the augmented reality device 13 displays the received auxiliary processing data 112 and 113 on the display 133, wherein the augmented reality device 13 can selectively display only the auxiliary processing data 112 or 113 on the display 133, or can display the auxiliary processing data 112 and 113 on the display 133 at the same time.

[0068] Fig. 7A is based on Figure 6The embodiment of the present invention shows a method for using an augmented reality processing assistance system. Fig. 7A The embodiments can be applied to the above-mentioned augmented reality processing auxiliary systems 10 and 20, please refer to Fig. 7A And with Figure 1 , Figure 2 and Figure 4 , wherein the same steps are represented by the same reference numerals and will not be described in detail herein. Figure 6 The method is similar, but the difference is that the following steps are also included: Step S202: Analyze the recognition pattern through the processor of the augmented reality device to obtain the recognition code. In this step, the analysis calculation is performed by the processor 132 of the augmented reality device 13 to obtain the recognition code.

[0069] Step S203: Transmitting the identification code to the workpiece processing database via the augmented reality device In this step, the identification code is transmitted from the augmented reality device 13 to the workpiece processing database 11 via the data transmission path A.

[0070] Figure 7B is based on Figure 6 The embodiment of the present invention shows a method for using an augmented reality processing assistance system. Fig. 7A The embodiment can be applied to the above-mentioned augmented reality processing auxiliary system 30, please refer to Figure 7B And with Figure 2 and Figure 5 , wherein the same steps are represented by the same reference numerals and will not be repeated here. Figure 7B Examples and Figure 6 , Fig. 7A The method is similar, but the difference is that the following steps are also included. Step S301: Sense the recognition pattern on the workpiece through the sensor to obtain a recognition pattern image, and transmit the recognition pattern image to the calculation module. In this step, after the augmented reality device 13 senses the recognition pattern 151 through the sensor 133, a recognition pattern image is formed and transmitted to the calculation module 32 through the data transmission path C.

[0071] Step S302: Analyze the recognition pattern image through the calculation module to obtain the recognition code. In this step, the calculation module 32 performs analysis calculation on the recognition pattern image transmitted by the augmented reality device 13 through the processor 321 to obtain the recognition code.

[0072] Step S303: Transmitting the identification code to the workpiece processing database via the calculation module In this step, after the calculation module 32 performs the analysis calculation to obtain the identification code of the workpiece 15 , the calculation module 32 transmits the identification code to the workpiece processing database 11 via the data transmission path B.

[0073] In summary, the embodiments of the present invention sense the identification pattern on the workpiece through the sensor of the augmented reality device, and obtain the original workpiece processing data from the workpiece processing database after analyzing the identification pattern to obtain the identification code. The calculation module then calculates the auxiliary processing data of the workpiece based on the original workpiece processing data and displays it on the display of the augmented reality device. In this way, the augmented reality processing auxiliary system of the present invention can display the appropriate operation process corresponding to different types of workpieces in real time, and can also greatly reduce the operational errors of the processing machine operators.

[0074] However, what is described above is only a preferred embodiment of the present invention, and should not be used to limit the scope of the present invention. That is, all simple equivalent changes and modifications made according to the scope of the patent application of the present invention and the content of the invention description are still within the scope of the patent of the present invention.

Claims

1. An augmented reality processing assistance system, for assisting a processing machine to process a workpiece, characterized in that: The augmented reality machining assistance system includes: A workpiece processing database for storing a plurality of workpiece processing original data, wherein the workpiece processing original data is a text file; a calculation module electrically connected to the workpiece processing database, the calculation module is used to calculate an auxiliary processing data of the workpiece, the auxiliary processing data includes a virtual graphic file of the workpiece and an operation flow of the processing machine, the calculation module also includes a drawing module and a computer-aided manufacturing calculation module, the drawing module draws the virtual graphic file through the workpiece processing original data, and the computer-aided manufacturing calculation module calculates the operation flow through the workpiece processing original data; and an augmented reality device, electrically connected to the workpiece processing database and the calculation module, the augmented reality device having a sensor for sensing an identification pattern on the workpiece, and the calculation module is disposed in the augmented reality device; The recognition pattern is subjected to an analysis calculation to obtain an identification code and is transmitted to the workpiece processing database. The analysis calculation is executed by a processor of the augmented reality device to obtain the identification code, and the augmented reality device transmits the identification code to the workpiece processing database. The recognition pattern is transmitted from the augmented reality device to the calculation module. The analysis calculation is executed by the calculation module to obtain the identification code, and the calculation module transmits the identification code to the workpiece processing database. After receiving the identification code, the workpiece processing database transmits the workpiece processing original data corresponding to the workpiece to the calculation module to calculate an auxiliary processing data of the workpiece. The calculation module transmits the auxiliary processing data to the augmented reality device, and the augmented reality device displays the auxiliary processing data on the display of the augmented reality device.

2. A method for using the augmented reality processing assistance system according to claim 1, which is used to assist a processing machine in processing a workpiece, characterized in that: The augmented reality processing auxiliary system includes a workpiece processing database, a calculation module and an augmented reality device, wherein the workpiece processing database is used to store a plurality of workpiece processing original data, and the augmented reality device has a sensor. The use method includes the following steps: sensing an identification pattern on the workpiece through the sensor; Analyzing the identification pattern through a processor of the augmented reality device to obtain an identification code; transmitting the identification code to the workpiece processing database through the augmented reality device; and sensing the recognition pattern on the workpiece through the sensor to obtain a recognition pattern image and transmitting the recognition pattern image to the calculation module; Analyzing the recognition pattern image through the calculation module to obtain the recognition code; Transmitting the identification code to the workpiece processing database through the calculation module; According to the identification code, the workpiece processing database transmits the workpiece processing raw data corresponding to the workpiece to the calculation module; The calculation module calculates auxiliary processing data of the workpiece according to the workpiece processing original data, and transmits the auxiliary processing data to the augmented reality device; and The auxiliary processing data is displayed on a display of the augmented reality device.

Images