Information processing device, processing system, information processing method, and program
The described system automates the alignment of CAD drawings with imaging images by maintaining fixed camera and lighting positions, enabling efficient and accurate superimposition for improved machining quality assessment.
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- FANUC LTD
- Filing Date
- 2024-11-12
- Publication Date
- 2026-05-21
AI Technical Summary
Existing information processing systems struggle with accurately aligning and superimposing CAD drawings onto imaging images of processed workpieces, necessitating manual realignment of cameras and lighting devices during machining, which is inefficient and time-consuming.
An information processing apparatus and method that includes a camera and lighting device positioned relative to a processing device to maintain fixed alignment, allowing for automatic superimposition of a workpiece's contour line with a planned processing line without requiring realignment, using a superimposed image generation unit to display the alignment on a display screen.
Facilitates efficient and automated alignment of CAD drawings with imaging images, enhancing processing accuracy and reducing manual intervention, thereby improving machining quality assessment.
Smart Images

Figure JP2024040076_21052026_PF_FP_ABST
Abstract
Description
Information Processing Apparatus, Processing System, Information Processing Method, and Program
[0001] The present disclosure relates to an information processing apparatus, a processing system, an information processing method, and a program.
[0002] Japanese Patent Application Laid-Open No. 2019-169007 discloses an apparatus (information processing apparatus) that superimposes a CAD drawing on an imaging image obtained by imaging a processed workpiece processed by a processing apparatus with a camera and displays the image on a display screen.
[0003] There is a long-felt need for a better information processing apparatus, processing system, information processing method, and program.
[0004] A first aspect of the present disclosure includes an information acquisition unit that acquires processing information based on a processing program, an image acquisition unit that acquires an image of the upper surface of a workpiece processed by a processing apparatus based on the processing information using a camera, a superimposed image generation unit that generates a superimposed image in which a contour line of a processed portion grasped from the image acquired by the image acquisition unit and a planned processing line calculated from the processing information are superimposed, and a display control unit that displays the superimposed image generated by the superimposed image generation unit on a display screen.
[0005] A second aspect of the present disclosure is a processing system including the information processing apparatus according to the first aspect and the processing apparatus.
[0006] A third aspect of the present disclosure is an information processing method including an information acquisition step of acquiring processing information based on a processing program, an image acquisition step of acquiring an image of the upper surface of a workpiece processed by a processing apparatus based on the processing information using a camera, a superimposed image generation step of generating a superimposed image in which a contour line of a processed portion grasped from the image acquired by the image acquisition step and a planned processing line calculated from the processing information are superimposed, and a display control step of displaying the superimposed image generated by the superimposed image generation step on a display screen.
[0007] A fourth aspect of the present disclosure is a program that causes a computer to execute the information processing method according to the third aspect.
[0008] Figure 1 is a schematic diagram of the processing system. Figure 2 is a flowchart illustrating an example of an information processing method. Figure 3 is an explanatory diagram showing the processing of a workpiece. Figure 4 is an explanatory diagram of the information processing method. Figure 5 is an explanatory diagram of the information processing method. Figure 6 is an explanatory diagram of the information processing method. Figure 7 is an explanatory diagram of an overlaid image.
[0009] The aforementioned Japanese Patent Publication No. 2019-169007 only discloses a method for displaying a superimposed image by aligning the origin of the CAD drawing with the reference point of the workpiece corresponding to the origin of the CAD drawing. This disclosure may provide a better information processing device, a processing system, an information processing method, and a program.
[0010] Figure 1 is a schematic diagram of the processing system 12. As shown in Figure 1, the processing system 12 comprises a processing device 14, a camera 16, a lighting device 18, and an information processing device 10.
[0011] The processing device 14 is, for example, a wire electrical discharge machine, but is not limited thereto. The processing device 14 performs electrical discharge machining on the workpiece 22 by applying a voltage to the wire electrode 20 and causing an electrical discharge. The processing device 14 performs the electrical discharge while the wire electrode 20 is moved relative to the workpiece 22 along a path specified in a predetermined processing program (processing command information). The processing device 14 includes a table 24 on which the workpiece 22 is placed. The relative movement between the wire electrode 20 and the workpiece 22 is performed by moving the table 24 that supports the workpiece 22. The table 24 is movable two-dimensionally with respect to the wire electrode 20.
[0012] The processing apparatus 14 includes an upper wire guide 26, a lower wire guide 28, an upper guide block 30, and a lower guide block 32. The upper wire guide 26 supports the wire electrode 20 on the upper side of the table 24. The lower wire guide 28 supports the wire electrode 20 on the lower side of the table 24. The upper wire guide 26 is installed on the upper guide block 30. The lower wire guide 28 is installed on the lower guide block 32. The wire electrode 20 is supplied from a wire bobbin (not shown).
[0013] The processing apparatus 14 further includes a processing power supply 34 that supplies voltage between the electrodes. The camera 16 takes an image of the workpiece 22 after processing. The camera 16 is attached to the upper guide block 30. The camera 16 may be detachable from the upper guide block 30. In this case, for example, the workpiece 22 can be processed with the camera 16 removed from the upper guide block 30, so the camera 16 does not interfere with the processing of the workpiece 22. The camera 16 may also be permanently attached to the upper guide block 30. In this case, the trouble of attaching and detaching the camera 16 can be avoided. The mounting position of the camera 16 does not necessarily have to be the upper guide block 30; it may be mounted in another position.
[0014] The lighting device 18 illuminates the workpiece 22 after processing when the workpiece 22 is imaged by the camera 16. The lighting device 18 can illuminate the workpiece 22 after processing with continuous light or instantaneous light (strobe). For example, an LED lighting device may be used as the lighting device 18, but is not limited to this.
[0015] The illumination device 18 is attached to the lower guide block 32. That is, the illumination device 18 is located on the opposite side of the camera 16 from the processed workpiece 22. The illumination device 18 illuminates the processed workpiece 22 from below upward. This allows the processed portion 23 (see Figure 4) of the processed workpiece 22 to be clearly displayed in the image captured by the camera 16. The illumination device 18 does not necessarily have to be attached to the lower guide block 32; it may be attached to another location.
[0016] The lighting device 18 may be detachable from the lower guide block 32. In this case, for example, the workpiece 22 can be machined with the lighting device 18 removed from the lower guide block 32, so the lighting device 18 does not interfere with the machining of the workpiece 22. Alternatively, the lighting device 18 may be permanently attached to the lower guide block 32. In this case, the effort of attaching and detaching the lighting device 18 can be eliminated.
[0017] In this embodiment, the camera 16 is attached to the upper guide block 30 and the lighting device 18 is attached to the lower guide block 32. That is, the relative positions of the camera 16 and the lighting device 18 do not change even when the table 24 is moved. Therefore, even if the coordinate position of the processing device 14 changes when the table 24 is moved, there is no need to realign the camera 16 and the lighting device 18.
[0018] The processing apparatus 14 further includes a processing tank 38 for storing processing fluid. The upper wire guide 26, lower wire guide 28, lower guide block 32, workpiece 22, and table 24 are placed in the processing fluid when processing the workpiece 22. In this embodiment, the camera 16 is positioned outside the processing fluid so as not to come into contact with it. If the lighting device 18 comes into contact with the processing fluid by fixing it to the lower guide block 32, the lighting device 18 is treated to be waterproof (waterproof).
[0019] The information processing device 10 comprises a calculation unit 40, a storage unit 42, an operation unit 44, and a display screen 46. The calculation unit 40 is composed of a processor such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit). In other words, the calculation unit 40 is composed of processing circuitry.
[0020] The calculation unit 40 includes a processing control unit 48, an information acquisition unit 50, a calculation unit 52, an image acquisition unit 54, a superimposed image generation unit 56, a display control unit 58, and a determination unit 60. The processing control unit 48, the information acquisition unit 50, the calculation unit 52, the image acquisition unit 54, the superimposed image generation unit 56, the display control unit 58, and the determination unit 60 can be realized by the calculation unit 40 executing a program stored in the storage unit 42.
[0021] Furthermore, at least a portion of the processing control unit 48, information acquisition unit 50, calculation unit 52, image acquisition unit 54, superimposed image generation unit 56, display control unit 58, and determination unit 60 may be implemented using integrated circuits such as ASICs (Application Specific Integrated Circuits) and FPGAs (Field-Programmable Gate Arrays). Alternatively, at least a portion of the processing control unit 48, information acquisition unit 50, calculation unit 52, image acquisition unit 54, superimposed image generation unit 56, display control unit 58, and determination unit 60 may be configured using electronic circuits including discrete devices.
[0022] The machining control unit 48 processes the workpiece 22 by controlling the machining device 14. The information acquisition unit 50 acquires machining information based on predetermined machining command information. The machining command information is a machining program, which is stored in the storage unit 42. The machining program is an NC program (CNC program).
[0023] The calculation unit 52 calculates the planned machining line L2 (see Figure 5) based on the machining setting information and machining program set when machining the workpiece 22. The machining setting information is information that the user can set when machining the workpiece 22. The machining setting information is information for changing the machining content specified in the machining program.
[0024] The machining setting information includes rotation command information, scaling ratio change command information, and axis reversal command information. In other words, the calculation unit 52 calculates the planned machining line L2 by changing the machining content specified in the machining program based on the machining setting information (rotation command information, scaling ratio change command information, axis reversal command information).
[0025] Rotation command information specifies the amount of rotation (rotation angle) for the machining content specified in the machining program. Rotation command information may include information (rotation angle information) for rotating the machining content specified in the machining program around a reference point. The coordinate position of the reference point may be set as appropriate or may be set in advance. Rotation command information may include information (axis rotation angle information) for rotating the coordinate axes used in the machining program around the origin.
[0026] Scaling ratio change command information specifies a change in scaling for the machining content specified in the machining program. This command information includes information (scaling ratio information) for enlarging or reducing the machining content specified in the machining program. It may also include information (finishing allowance information) for reflecting the finishing allowance in the machining content specified in the machining program. The finishing allowance may be set as appropriate or may be pre-set.
[0027] Axis reversal command information specifies the reversal of axes for the machining content specified in the machining program. Axis reversal command information may include information (mirror image information) for reversing the machining content specified in the machining program with respect to the coordinate axes. In this case, the coordinate axis used as the reference for reversal can be set as appropriate. Axis reversal command information may also include information (axis switching information) for switching the coordinate axes used in the machining program (for example, switching between the X and Y axes).
[0028] The image acquisition unit 54 acquires an image of the upper surface of the workpiece 22 processed by the processing device 14 based on the processing information, which is captured by the camera 16.
[0029] The superimposed image generation unit 56 generates a superimposed image 72 by superimposing the contour line L1 of the processing area 23, which is grasped from the image acquired by the image acquisition unit 54, and the planned processing line L2, which is calculated from the processing information (see Figure 7). The display control unit 58 displays the superimposed image 72 generated by the superimposed image generation unit 56 on the display screen 46. The determination unit 60 determines the quality of the processing of the workpiece 22 based on the planned processing line L2 and the contour line L1 of the processing area 23, which is grasped based on the superimposed image 72.
[0030] The storage unit 42 is composed of a volatile memory (not shown) and a non-volatile memory (not shown). Examples of volatile memory include RAM (Random Access Memory). The volatile memory is used as the working memory of the processor and temporarily stores data necessary for processing or calculation. Examples of non-volatile memory include ROM (Read Only Memory) and flash memory. The non-volatile memory is used as storage memory and stores programs, tables, maps, etc. At least a part of the storage unit 42 may be provided in the processor, integrated circuit, etc. as described above.
[0031] The operation unit 44 is used when the user operates the information processing device 10. The display screen 46 is equipped with display elements (not shown). Examples of display elements include liquid crystal display elements and organic electroluminescent display elements. The operation unit 44 and the display screen 46 may be configured by a touch panel (not shown) equipped with such display elements.
[0032] Next, an example of an information processing method according to this embodiment will be described. Figure 2 is a flowchart illustrating an example of an information processing method. Figure 3 is an explanatory diagram showing the processing of the workpiece 22. Figures 4 to 6 are explanatory diagrams of the information processing method.
[0033] In step S1, the workpiece 22 is machined. Specifically, the calculation unit 52 calculates machining information, which is information indicating the planned machining line L2, based on the machining program, which is predetermined machining command information, and the machining setting information. If the user does not specifically set the machining setting information, the machining content specified in the machining program becomes the planned machining line L2. After that, the machining control unit 48 machines the workpiece 22 by controlling the machining device 14 based on the calculated machining information.
[0034] As shown in Figure 3, in this embodiment, a start hole 100 is pre-formed at the machining start point P2 of the workpiece 22. When machining the workpiece 22, the wire electrode 20 is passed through the start hole 100 of the workpiece 22 and supported by the upper wire guide 26 and the lower wire guide 28. Subsequently, the machining control unit 48 moves the table 24 based on the machining information, thereby performing electrical discharge machining on the workpiece 22 with the wire electrode 20. The machining control unit 48 does not necessarily have to move the table 24; it may also move the column (not shown) of the machining apparatus 14 or the entire machining tank 38.
[0035] As a result, for example, the wire electrode 20 moves relative to the workpiece 22 along the arrow in Figure 3. In this case, a square-shaped hole 102 (see Figure 4) can be formed in the workpiece 22. When the processing of the workpiece 22 is complete, for example, the workpiece 22 is removed from the processing fluid by discharging the processing fluid from the processing tank 38. After this, the process proceeds to step S2.
[0036] In step S2, an information acquisition step is performed. In the information acquisition step, the information acquisition unit 50 acquires the processing information calculated by the calculation unit 52. Note that the information acquisition step may be performed before processing the workpiece 22 or during processing the workpiece 22. After this, the process proceeds to step S3.
[0037] In step S3, the image acquisition step is performed. After the processing of the workpiece 22 is completed, in the image acquisition step, an image is acquired by the camera 16 of the upper surface of the workpiece 22 that has been processed by the processing device 14 based on the processing information.
[0038] Specifically, as shown in Figure 4, the user (operator) moves the table 24 by operating the control unit 44 to move the camera 16 to the position where observation is desired. In this embodiment, the user operates the control unit 44 so that the processed portion 23 of the processed workpiece 22 can be imaged by the camera 16. In Figure 4, point P1 indicates the center coordinates of the camera 16, and reference numeral 70 indicates the imaging range of the camera 16.
[0039] Subsequently, with the lighting device 18 illuminating the processed area 23 of the workpiece 22 after processing, the camera 16 takes an image of the processed area 23. The camera 16 outputs the image obtained from the image to the information processing device 10. As a result, the image acquisition unit 54 can acquire the image taken by the camera 16. After this, the process proceeds to step S4.
[0040] In step S4, the superimposed image generation step is performed. In the superimposed image generation step, the superimposed image generation unit 56 generates a superimposed image 72 (see Figure 7) by superimposing the contour line L1 of the processing area 23, which is grasped from the image acquired by the image acquisition unit 54, and the planned processing line L2, which is calculated from the processing information.
[0041] Specifically, as shown in Figure 5, the superimposed image generation unit 56 aligns the starting point P2 of the planned processing line L2 with the center coordinates P1 of the camera 16. In the example in Figure 5, for ease of understanding, the planned processing line L2 is drawn with the starting point P2 aligned with the center coordinates P1 of the camera 16. Subsequently, the determination unit 60 determines whether the center coordinates P1 of the camera 16 coincide with the starting coordinates P3 of the processing program. The information processing device 10 has previously acquired information regarding the center coordinates P1 of the camera 16. In the example in Figure 5, the center coordinates P1 of the camera 16 are offset from the starting coordinates P3 of the processing program. In this case, the planned processing line L2 is offset from the contour line L1 of the processing area 23 shown by the image acquired by the image acquisition unit 54.
[0042] If the center coordinates P1 of the camera 16 do not coincide with the processing start coordinates P3 of the processing program, the superimposed image generation unit 56 adjusts the processing start point P2 of the planned processing line L2 to coincide with the processing start coordinates P3 of the processing program, as shown in Figure 6. As a result, the planned processing line L2 coincides with the contour line L1 of the processing area 23 shown by the image acquired by the image acquisition unit 54. Note that the table 24 of the processing apparatus 14 does not move during this process.
[0043] When the center coordinates P1 of the camera 16 match the machining start coordinates P3 of the machining program, with the machining start point P2 of the machining planned line L2 made to coincide with the center coordinates P1 of the camera 16, the machining planned line L2 overlaps with the contour line L1 of the machining part 23 shown by the image acquired by the image acquisition unit 54. Therefore, there is no need to perform a process of making the machining start point P2 of the machining planned line L2 coincide with the machining start coordinates P3 of the machining program. After this, the process proceeds to step S5.
[0044] In step S5, a display control step is performed. Specifically, as shown in FIG. 7, the display control unit 58 causes the superimposed image 72 to be displayed on the display screen 46. In the present embodiment, a pair of auxiliary lines L3 and L4 indicating the machining tolerance of the machining planned line L2 determined in advance are shown in the superimposed image 72. The interval (machining tolerance) between the machining planned line L2 and the auxiliary line L3 can be set as appropriate. Also, the interval (machining tolerance) between the machining planned line L2 and the auxiliary line L4 can be set as appropriate. After this, the process proceeds to step S6.
[0045] In step S6, a determination step is performed. That is, the determination unit 60 determines the quality of the machining of the workpiece 22 based on the machining planned line L2 and the contour line L1 of the machining part 23 grasped based on the superimposed image 72. When the contour line L1 of the machining part 23 is located inside the pair of auxiliary lines L3 and L4, the determination unit 60 determines that the machining of the workpiece 22 has been performed within the range of the machining tolerance (makes an OK determination). Also, when the contour line L1 of the machining part 23 is located outside the pair of auxiliary lines L3 and L4, the determination unit 60 determines that the machining of the workpiece 22 has been performed beyond the range of the machining tolerance (makes an NG determination). The determination method does not necessarily have to make an NG determination when the contour line L1 is located outside the pair of auxiliary lines L3 and L4, and it may be determined by another criterion different from the machining tolerance (for example, twice the machining tolerance) or the count number of the locations where the contour line L1 is located outside the pair of auxiliary lines L3 and L4.
[0046] The information processing device 10 may notify the determination result by the determination unit 60. In this case, the information processing device 10 may notify, for example, by displaying the determination result on the display screen 46. Also, the information processing device 10 may notify the determination result by sound.
[0047] In this embodiment, in step S6, the quality of the processing of the workpiece 22 is determined over the entire length of the contour line L1 of the processing part 23 grasped based on the superimposed image 72. That is, the table 24 is moved so that the imaging range 70 of the camera 16 moves along the processing part 23 of the workpiece 22.
[0048] In this embodiment, based on the operation input by the user, the position and size of the superimposed image 72 displayed on the display screen 46 can be changed. Specifically, for example, the user can change the position of the superimposed image 72 by sliding the display screen 46 with a finger. In this case, when the user slides the display screen 46 with a finger, the processing control unit 48 moves the table 24 based on this slide operation. Thereby, the position of the camera 16 with respect to the processing part 23 of the workpiece 22 can be easily changed. In this embodiment, when the imaging range 70 of the camera 16 with respect to the processing part 23 of the workpiece 22 changes, the information processing apparatus 10 performs an image acquisition step, a superimposed image generation step, a display control step, and a determination step. Therefore, the quality of the processing can be easily determined over the entire length of the processing part 23 of the workpiece 22.
[0049] Also, according to the input operation of the user on the display screen 46, the enlargement and reduction of the superimposed image 72 displayed on the display screen 46 can be easily performed. In this case, the user can easily grasp the processing accuracy visually. After the determination step determines the quality of the processing of the workpiece 22 over the entire length of the processing part 23 of the workpiece 22 after processing, the processing in FIG. 2 is completed.
[0050] In the information processing method described above, the determination step has been described by taking the example of being performed by the determination unit 60 of the information processing apparatus 10, but the user may also make the determination. In this case, the user can easily determine whether or not the contour line L1 of the processing part 23 is inside the pair of auxiliary lines L3 and L4 in the superimposed image 72 displayed on the display screen 46 by visual inspection.
[0051] According to this embodiment, a superimposed image 72 is generated by superimposing the contour line L1 of the processing area 23, which is grasped from the image acquired by the image acquisition unit 54, and the planned processing line L2, which is calculated from the processing information, and this image is displayed on the display screen 46. In other words, since the planned processing line L2 calculated based on the processing program is used instead of a CAD drawing, it is not necessary to match the center coordinates P1 of the camera 16 to the reference point of the workpiece 22 (object to be processed) which corresponds to the origin of the CAD drawing when capturing an image. In this case, a superimposed image 72 can be generated by superimposing the planned processing line L2 onto an image captured with the camera 16 positioned at the desired location on the processing area 23 of the workpiece 22 after processing. Therefore, a better information processing device 10, processing system 12, information processing method, and program can be provided.
[0052] The information processing device 10 further includes a calculation unit 52 that calculates a planned machining line L2 based on machining setting information and a machining program set when machining the workpiece 22. The machining setting information includes rotation command information that specifies the amount of rotation for the machining content specified in the machining program. The machining setting information also includes scaling ratio change command information that commands a change in scaling for the machining content specified in the machining program. Furthermore, the machining setting information includes axis reversal command information that specifies axis reversal for the machining content specified in the machining program.
[0053] With this configuration, the planned machining line L2 can be easily calculated using the machining program and machining setting information.
[0054] The display control unit 58 can change the position and size of the superimposed image 72 displayed on the display screen 46 based on user input.
[0055] With this configuration, it is possible to easily display the portion of the processed workpiece 22 that you want to show on the display screen 46.
[0056] The superimposed image generation unit 56 aligns the starting point P2 of the planned processing line L2 with the center coordinates P1 of the camera 16 when the image was captured.
[0057] With this configuration, for example, if the center coordinates P1 of the camera 16 coincide with the machining start coordinates P3 of the machining program, the superimposed image 72 can be easily generated.
[0058] The superimposed image generation unit 56 generates a superimposed image 72 by aligning the processing start point P2 of the planned processing line L2 with the processing start coordinate P3 of the processing program when the center coordinate P1 of the camera 16 does not coincide with the processing start coordinate P3 of the processing program.
[0059] With this configuration, a superimposed image 72 can be generated with the camera 16 positioned to observe the portion of the processed workpiece 22 that needs to be observed.
[0060] The superimposed image 72 shows auxiliary lines L3 and L4 indicating the machining tolerances of the planned machining line L2.
[0061] With this configuration, it is easy to determine whether or not the machined portion 23 of the workpiece 22 after processing is within the machining tolerance range.
[0062] The system includes a determination unit 60 that determines the quality of the machining of the workpiece 22 based on the planned machining line L2 and the contour line L1 of the machining area 23 shown by the superimposed image 72.
[0063] With this configuration, the quality of the machining of the workpiece 22 can be determined automatically.
[0064] In this embodiment, the display screen 46 does not have to be a component of the information processing device 10.
[0065] The following additional information is disclosed regarding the above embodiments.
[0066] (Note 1) The information processing device (10) of the present disclosure includes: an information acquisition unit (50) that acquires processing information based on a processing program; an image acquisition unit (54) that acquires an image of the upper surface of a workpiece (22) processed by a processing device (14) based on the processing information, captured by a camera (16); a superimposed image generation unit (56) that generates a superimposed image (72) by superimposing the contour line (L1) of the processing area (23) grasped from the image acquired by the image acquisition unit and the planned processing line (L2) calculated from the processing information; and a display control unit (58) that displays the superimposed image generated by the superimposed image generation unit on a display screen (46).
[0067] (Note 2) The information processing device described in Note 1 further comprises a calculation unit (52) that calculates the planned machining line based on machining setting information set when machining the workpiece and the machining program, wherein the machining setting information may include at least one of rotation command information that specifies the amount of rotation for the machining content specified in the machining program, scaling ratio change command information that specifies a change in scaling, and axis reversal command information that specifies axis reversal.
[0068] (Note 3) In the information processing device described in Note 1 or 2, the display control unit may change the position and size of the superimposed image to be displayed on the display screen based on user input.
[0069] (Note 4) An information processing device as described in any one of Notes 1 to 3, wherein the superimposed image generation unit may align the starting point (P2) of the planned processing line with the center coordinates (P1) of the camera when the image was captured.
[0070] (Note 5) In the information processing apparatus described in Note 4, the superimposed image generation unit may generate the superimposed image by making the processing start point of the planned processing line coincide with the processing start coordinate of the processing program when the center coordinate of the camera does not coincide with the processing start coordinate (P3) of the processing program.
[0071] (Note 6) An information processing device according to any one of Notes 1 to 5, wherein the superimposed image may include auxiliary lines (L3, L4) indicating the machining tolerance of the planned machining line.
[0072] (Note 7) An information processing device according to any one of Notes 1 to 6 may include a determination unit (60) that determines whether the workpiece has been processed based on the planned processing line and the contour line of the processing area grasped based on the superimposed image.
[0073] (Note 8) The processing system (12) of this disclosure comprises an information processing device described in any one of Notes 1 to 7 and the processing device.
[0074] (Note 9) The processing system described in Note 8 further comprises an illumination device (18) that illuminates the processed portion of the workpiece after processing when the camera takes an image, and the illumination device may be positioned on the opposite side of the workpiece after processing from the camera.
[0075] (Note 10) The information processing method of the present disclosure comprises: an information acquisition step of acquiring processing information based on a processing program; an image acquisition step of acquiring an image of the upper surface of a workpiece processed by a processing device based on the processing information, captured by a camera; a superimposed image generation step of generating a superimposed image by superimposing the contour line of the processing area grasped from the image acquired in the image acquisition step and the planned processing line calculated from the processing information; and a display control step of displaying the superimposed image generated by the superimposed image generation step on a display screen.
[0076] (Note 11) The program of this disclosure causes a computer to execute the information processing method described in Note 10.
[0077] The computer program (computer software) according to this embodiment is also called a computer program product. A computer program product is not limited to computer programs recorded on a recording medium, but also includes computer programs that are transmitted, distributed, or downloaded via the Internet or the like.
[0078] While this disclosure has been described in detail, it is not limited to the individual embodiments described above. These embodiments can be added, replaced, modified, partially deleted, etc., in any way that does not depart from the gist of this disclosure or from the spirit of this disclosure derived from the claims and their equivalents. These embodiments can also be implemented in combination. For example, the order of operations and processes in the embodiments described above are given as examples only and are not limited thereto. The same applies when numerical values or mathematical formulas are used in the description of the embodiments described above.
[0079] 10...Information processing device 12...Processing system 14...Processing device 16...Camera 18...Lighting device 22...Workpiece 23...Processing area 46...Display screen 50...Information acquisition unit 52...Calculation unit 54...Image acquisition unit 56...Superimposed image generation unit 58...Display control unit 60...Determination unit 72...Superimposed image L1...Contour line L2...Processing planned line L3, L4...Auxiliary lines P1...Center coordinates P2...Processing start point P3...Processing start coordinates
Claims
1. An information processing device comprising: an information acquisition unit that acquires processing information based on a processing program; an image acquisition unit that acquires an image of the upper surface of a workpiece processed by a processing device based on the processing information, captured by a camera; a superimposed image generation unit that generates a superimposed image by superimposing the contour line of the processing area grasped from the image acquired by the image acquisition unit and the planned processing line calculated from the processing information; and a display control unit that displays the superimposed image generated by the superimposed image generation unit on a display screen.
2. An information processing device according to claim 1, further comprising a calculation unit that calculates the planned machining line based on machining setting information set when machining the workpiece and the machining program, wherein the machining setting information includes at least one of rotation command information that specifies the amount of rotation for the machining content specified in the machining program, scaling ratio change command information that specifies a change in scaling, and axis reversal command information that specifies axis reversal.
3. An information processing apparatus according to claim 1 or 2, wherein the display control unit can change the position and size of the superimposed image to be displayed on the display screen based on user input.
4. An information processing apparatus according to any one of claims 1 to 3, wherein the superimposed image generation unit aligns the starting point of the processing line with the center coordinates of the camera at the time the image was captured.
5. An information processing apparatus according to claim 4, wherein the superimposed image generation unit generates the superimposed image by making the processing start point of the planned processing line coincide with the processing start coordinate of the processing program when the center coordinate of the camera does not coincide with the processing start coordinate of the processing program.
6. An information processing device according to any one of claims 1 to 5, wherein the superimposed image shows auxiliary lines indicating the machining tolerance of the planned machining line.
7. An information processing apparatus according to any one of claims 1 to 6, comprising a determination unit that determines whether the processing of the workpiece is good or bad based on the planned processing line and the contour line of the processing area grasped based on the superimposed image.
8. A processing system comprising: an information processing device according to any one of claims 1 to 7; and the processing device.
9. A machining system according to claim 8, further comprising an illumination device for illuminating the machined portion of the workpiece after machining when imaging is performed by the camera, wherein the illumination device is positioned on the opposite side of the workpiece after machining from the camera.
10. An information processing method comprising: an information acquisition step of acquiring processing information based on a processing program; an image acquisition step of acquiring an image of the upper surface of a workpiece processed by a processing device based on the processing information, captured by a camera; a superimposed image generation step of generating a superimposed image by superimposing the contour line of the processing area grasped from the image acquired in the image acquisition step and the planned processing line calculated from the processing information; and a display control step of displaying the superimposed image generated by the superimposed image generation step on a display screen.
11. A program that causes a computer to execute the information processing method described in claim 10.