Working machinery
The integration of a transparent display in the viewing window of machine tools allows simultaneous monitoring of machining progress and control panel information, improving operator efficiency by eliminating the need for repetitive movements.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2023-02-28
- Publication Date
- 2026-04-15
AI Technical Summary
Operators of machine tools need to repeatedly move between a viewing window and a control panel to check machining progress and program information, reducing work efficiency.
A transparent display is integrated into the viewing window, displaying machining information such as NC program details, tool positions, and workpiece coordinates, allowing operators to view machining progress and control panel information simultaneously.
Enhances work efficiency by enabling operators to monitor machining operations and control panel information without needing to move between the window and the panel.
Smart Images

Figure 0007846645000001 
Figure 0007846645000002 
Figure 0007846645000003
Abstract
Description
Technical Field
[0001] This invention relates to display technology in machine tools.
Background Art
[0002] A viewing window is provided on the front door of a machine tool that automatically performs machining by executing an NC (Numerical Control) program. Patent Document 1 describes an example in which a slide-type working door body is equipped on the front surface of a protective cover installed to cover the machine tool, and a viewing window is provided on the working door body. An operator can look into the machining chamber through the window to observe the machining state.
[0003] In addition, a machine tool is provided with an operation panel that receives instruction operations from an operator and displays various types of information related to machining. Patent Document 2 describes an example in which programs and workpiece coordinates stored in an NC control device are displayed on the operation panel.
[0004] An operator can look into the machining chamber through the window and grasp the machining situation in combination with the display on the operation panel.
Prior Art Documents
Patent Documents
[0005]
Patent Document 1
Patent Document 2
Summary of the Invention
Problems to be Solved by the Invention
[0006] However, when an operator is looking into the machining chamber through the window, the display content on the operation panel cannot be seen. Conversely, when the operator is looking at the display content on the operation panel, the machining chamber cannot be looked into.
[0007] For example, when an operator checks the operation of a program on a machine tool, they must perform two actions: checking the program running on the control panel and checking the movement of the machining part inside the machining chamber. In other words, the operator has to repeatedly move between the viewing window and the control panel. However, such repetitive movements are cumbersome and reduce work efficiency. [Means for solving the problem]
[0008] Therefore, the present invention provides the apparatus and the like described in the claims. [Effects of the Invention]
[0009] According to the present invention, it is possible for workers to easily check various information related to processing while looking into the processing room from a window. [Brief explanation of the drawing]
[0010] [Figure 1] This is an external view of a machine tool. [Figure 2] This is a block diagram of a machine tool. [Figure 3] This figure shows an example of an NC program configuration. [Figure 4] This is a diagram showing the state transitions of a machine tool. [Figure 5] This figure shows an example of a displayed image. [Figure 6] This diagram shows what the worker would see. [Figure 7] This figure shows an example of a 3D model in a virtual space. [Modes for carrying out the invention]
[0011] Figure 1 is an external view of the machine tool 100. The machine tool 100 automatically performs machining operations on a workpiece in the machining chamber according to the NC program 310. A door 202 is provided on the front of the machine tool 100, separating the machining chamber from the outside. The door 202 is provided with a window 200 for the operator to view the machining chamber of the machine tool 100.
[0012] Furthermore, a control panel 110 is installed next to the door 202. The control panel 110 is equipped with a monitor 112, a single block button 114, a cycle start button 116, a pause button 118, and a reset button 120. The monitor 112 displays information such as the NC program 310 and the remaining travel amount 304. The single block button 114 is a button used by the operator to instruct the machine to switch to single block mode. The cycle start button 116 is a button used by the operator to instruct the start of the machining operation. The pause button 118 is a button used by the operator to instruct the machine to pause the machining operation. The reset button 120 is a button used by the operator to instruct the machine to reset the machining operation. The operation of each button and the machining operation will be described later in relation to Figure 4.
[0013] The window 200 is made of a transparent plate material such as tempered glass and has impact resistance. In this embodiment, a transparent display 240 capable of displaying images, characters, numbers, etc., is provided on the surface of the window 200. The transparent display 240 is fixed in contact with the outer or inner surface of the transparent plate material.
[0014] In this embodiment, some of the information displayed on the monitor 112 is also displayed on the transparent display 240. Furthermore, images and information that make it easier to understand the state of the machining chamber are displayed on the transparent display 240 using 3D modeling technology. Specifically, as will be described later in relation to Figures 5 and 6, the transparent display 240 can display specific information (such as scales, various coordinates, workpieces, tools, blocks of the NC program 310, and the execution status of those blocks). In other words, the machine tool 100 is capable of displaying specific information and is equipped with a window 200 for viewing the interior.
[0015] The operator operates the machine tool 100 while checking the information displayed on the monitor 112 in the machining chamber of the machine tool 100. Therefore, conventionally, the operator had to move between the window 200 and the monitor 112 of the operation panel 110. In the embodiment, since the operator can view various information on the transparent display 240 of the window 200, there is no need to move toward the monitor 112. Therefore, it becomes easier for the operator to work, and the work efficiency is improved.
[0016] In addition, a camera 600 for photographing the operator is provided in front of the door 202. The camera 600 will be described in Modification 1.
[0017] FIG. 2 is a block diagram of the machine tool 100. In addition to the operation panel 110, the transparent display 240, and the camera 600 described above, the machine tool 100 includes a machining unit 102 and an NC control device 104.
[0018] The machining unit 102 performs machining operations on the workpiece. The machining unit 102 includes a mounting portion to which a tool is attached, a driving portion such as a servo motor that rotates a shaft, and the like. When the machine tool 100 is a machining center, the spindle corresponds to the mounting portion, and the servo motor that rotates the spindle corresponds to the driving portion. When the machine tool 100 is a turning center, the tool post corresponds to the mounting portion 822, and in addition to the servo motor that rotates the rotating shaft to which the workpiece is attached, it has a driving portion that moves the turret. Here, an example of a turning center is shown. As will be described later in relation to FIG. 6, the machining unit 102 in this example includes a rotating shaft, a chuck, a tool post, a tool, and the like. Thus, the machining unit 102 includes various devices and components.
[0019] The NC control device 104 executes the NC program 310 and gives an instruction for a machining operation to the machining unit 102 according to the NC program 310. The machining unit 102 performs a machining operation according to the instruction of the NC control device 104.
[0020] The control panel 110 includes hardware such as a single block button 114, a cycle start button 116, a pause button 118, a reset button 120, and a monitor 112, as well as components such as a reception unit 130, an information acquisition unit 150, a 3D model storage unit 152, a display processing unit 156, and an eye position detection unit 158.
[0021] Each component of the control panel 110 is realized by hardware including arithmetic units such as a CPU (Central Processing Unit) and various coprocessors, storage devices such as memory and storage, and wired or wireless communication lines connecting them, as well as software stored in the storage devices that supplies processing instructions to the arithmetic units. The computer program may consist of device drivers, an operating system, various application programs located at a higher layer, and libraries that provide common functions to these programs. The illustrated reception unit 130, information acquisition unit 150, 3D model storage unit 152, display processing unit 156, and eye position detection unit 158 represent functional blocks, not hardware units. The control panel 110 is an example of an information processing device. Information processing devices other than the control panel 110 may also be equipped with these components and perform the processing operations of the control panel 110, which will be described later.
[0022] The reception unit 130 accepts user operations such as pressing the single block button 114, the cycle start button 116, the pause button 118, and the reset button 120.
[0023] The information acquisition unit 150 acquires various information from the NC control device 104.
[0024] The 3D model storage unit 152 stores data (hereinafter referred to as "3D model data") that defines the shape and position (machine coordinates) of the 3D models of the devices and parts (rotating axes, chucks, tool posts, tools, etc.) included in the machining unit 102 and the workpiece. Machine coordinates are also called "global coordinates." The orientation and origin of each axis for determining the machine coordinates are defined as eigenvalues of the machine tool 100. The 3D model data also includes scales for measuring intervals and the shape of the 3D model of the workpiece coordinate system (see Figure 7).
[0025] The display processing unit 156 generates an image to be displayed on the transparent display 240 (hereinafter referred to as the "display image") and processes the display of the generated display image on the transparent display 240. The display processing unit 156 has a modeling unit 154. The modeling unit 154 expands a virtual space using the memory area and generates a 3D model in the virtual space. The display processing unit 156 can generate a part of the display image (scale, coordinates, workpiece and tool information) based on the 3D model. The display processing unit 156 also has a rendering function to represent the 3D model in 3D. As will be described later in relation to Figures 5 and 6, the display processing unit 156 of the machine tool 100 displays specific information (such as scale, various coordinates, workpiece, tool, blocks of the NC program 310 and the execution status of the blocks) in a position where the operator can view the information while looking inside the machine tool when the operator looks inside through the window 200.
[0026] The eye position detection unit 158 detects the position of the worker's eyes (machine coordinates) based on the image of the worker captured by the camera 600. Details of the eye position detection unit 158 will be explained in Modification Example 1.
[0027] Figure 3 shows an example of the configuration of the NC program 310. In this example, NC program 310 performs rough machining on the workpiece, followed by finish machining. In rough machining, the tool is first brought close to the workpiece in an approach motion before moving on to the rough cutting motion. Similarly, in finish machining, the tool is brought close to the workpiece in an approach motion before moving on to the finish cutting motion.
[0028] Therefore, the NC program 310 is written to process the roughing approach, roughing cuts, finishing approach, and finishing cuts in that order. Furthermore, multiple blocks are described for each of the operations of the roughing approach, roughing cuts, finishing approach, and finishing cuts.
[0029] Normally, the operations of each block are performed sequentially, but when the machine tool 100 is set to single-block mode, the operations are performed one block at a time. To verify whether the NC program 310 is programmed correctly, the operator operates the machining unit 102 one block at a time in single-block mode and confirms that it is moving as intended each time.
[0030] It is possible to run the entire NC program 310 in single-block mode and verify the operation of all blocks. However, it is also possible to run only a part of the NC program 310 in single-block mode and verify the operation of only the blocks contained therein. In the example shown in Figure 3, the operation of each block is checked for the roughing approach and the finishing approach. This method may be used if the possibility of programming errors is considered low for the roughing and finishing cuts, or if verification is possible even with continuous operation. This method of running and verifying each block in single-block mode is common to both the prior art and the embodiment.
[0031] Figure 4 is a diagram showing the state transitions of the machine tool 100. This transition diagram illustrates the operation of one block of tool movement. The vertical axis shows the remaining movement, indicating how far the tool will move. The horizontal axis shows the elapsed time. In this example, the block contains a command to move the tool 100 mm, intended to bring the cutting edge of the tool close to the end face of the workpiece.
[0032] When the operator presses the cycle start button 116, the tool begins to move and enters the RUN state. The RUN state means that the machining unit 102 is in operation. Ts indicates the time since entering the RUN state. Initially, the remaining travel distance is 100 mm, but as time passes from Ts, the remaining travel distance decreases.
[0033] When the operator presses the pause button 118, the tool stops and enters a HOLD state. In the HOLD state, the operation of the machining unit 102 is temporarily stopped. Th indicates the time the HOLD state has been in effect. In the HOLD state, the remaining travel distance does not change. In the HOLD state, the operator performs a check. In this example, the tool has stopped with a remaining travel distance of 50 mm.
[0034] Here, we will explain the checking procedure for conventional technology. The operator looks at the monitor 112 on the control panel 110 to find out the contents of the block and the remaining travel distance (50 mm). Then, the operator opens the door and enters the machining room and uses calipers to measure the distance between the workpiece and the cutting edge of the tool. If the distance between the workpiece and the cutting edge of the tool is 50 mm, it is understood that the tool will move another 50 mm and stop when the cutting edge touches the side. In other words, it is confirmed that it is operating as intended. If the distance between the workpiece and the cutting edge of the tool is not 50 mm, it is understood that it is not operating as intended and there is a programming error. Then, the operator leaves the machining room.
[0035] Next, the checking procedure for the embodiment will be described. The operator can see the display image on the transparent display 240 (see Figures 5 and 6) to know the contents of the block and the remaining movement (50 mm). Therefore, there is no need to approach the control panel. In addition, the distance between the workpiece and the cutting edge of the tool can be estimated by looking at the scale 332 on the display image of the transparent display 240. Therefore, there is no need to open the door, enter the processing room, and take measurements using calipers. If the distance estimated by visual inspection matches the remaining movement, it can be determined that the system is functioning correctly.
[0036] When the operator presses the cycle start button 116 while the machine is in the HOLD state, the tool movement resumes and the machine returns to the RUN state. Tr indicates the time since the machine returned to the RUN state. While in the RUN state, the remaining travel distance decreases further. When the remaining travel distance reaches 0, the tool stops and the machine returns to the STOP state. Tp indicates the time since the machine returned to the STOP state. If the reset button 120 is pressed, the machine stops and returns to the reset state.
[0037] Figure 5 shows an example of the displayed image 340. Figure 6 shows the image as seen by the worker. The display image 340 is shown on the transparent display 240, allowing the worker to view the processing room through the display image 340 on the transparent display 240. While viewing the processing room, the worker can simultaneously access various information displayed on the display image 340.
[0038] The display image 340 includes the execution status 302 of the machine tool 100 (RUN, HOLD, and STOP). The execution status 302 of the machine tool 100 is controlled by the NC control device 104. The information acquisition unit 150 acquires the execution status 302 of the machine tool 100 from the NC control device 104. The display processing unit 156 displays the acquired execution status 302 in a predetermined location on the display image 340, and the execution status 302 is displayed on the display 240 as part of the display image 340. For example, "RUN" is displayed if the state is RUN, "HOLD" is displayed if the state is HOLD, and "STOP" is displayed if the state is STOP. When the display of the execution status 302 switches from "RUN" to "STOP", the operator can immediately determine that the block's operation has finished while looking inside the machining room. Thus, the displayed execution status 302 of the block is either, for example, that a single block is running or that a single block has finished running.
[0039] The display image 340 includes the remaining movement amount 304. The information acquisition unit 150 acquires the remaining movement amount for each movable axis from the NC control device 104. The display processing unit 156 displays the acquired movement amount for each axis at a predetermined location on the display image 340, and the movement amount for each axis is displayed on the display 240 as part of the display image 340. In the RUN state, the remaining movement amount in the moving axis changes, and the display processing unit 156 displays the changing remaining movement amount.
[0040] For example, if movement is possible in three axes (X, Y, and Z), the remaining movement amount will be shown for the X, Y, and Z axes. Similarly, if movement is possible in six axes (X, Y, Z, A, B, and C), the remaining movement amount will be shown for the X, Y, Z, A, B, and C axes. An example of displaying the remaining movement amount when movement is possible in six axes is shown below. X: 50,000 Y: 0.000 Z: -2.000 A: 0.000 B: 0.000 C: 0.000
[0041] Display image 340 includes information related to NC program 310. A partial example of NC program 310 is shown below. G54 G0X104.Z2. X96. G1Z-49.9F.3 G0U1.Z2. X92. G1Z-49.9 G0U1.Z2. G0X104.
[0042] In this example, execution block 306 and the next block 308 are displayed. At the start of the RUN state, indicated as Ts in Figure 4, the content of the block to be executed is displayed as execution block 306, and the content of the next block to be executed is displayed as the next block 308. Subsequently, the display of execution block 306 and the next block 308 remains unchanged in the HOLD state and the resumed RUN state. The display of execution block 306 and the next block 308 also remains unchanged in the STOP state. When the cycle start button is pressed, the content of the block that was displayed in the next block 308 moves up to execution block 306, and the content of the block after that is displayed in the next block 308.
[0043] Therefore, when the execution state 302 acquired by the information acquisition unit 150 from the NC control device 104 switches from the STOP state to the RUN state, the display processing unit 156 displays the contents of the block that was previously displayed in the next block 308 in the execution block 306. The information acquisition unit 150 acquires the contents of the next block and displays them in the next block 308. Alternatively, at the timing of the switch from the STOP state to the RUN state, the information acquisition unit 150 may acquire the contents of the currently executing block and the contents of the next block to be executed, and the display processing unit 156 may display them in the execution block 306 and the next block 308. The method of displaying blocks is not limited to this example.
[0044] The displayed image 340 includes a display of the work coordinate system 330. The display of the work coordinate system 330 is drawn by projecting a three-dimensional model showing the three axes of the work coordinate system 330 onto the transparent display 240. After alignment is performed in the initial processing of the NC program 310, the information acquisition unit 150 acquires the machine coordinates (offset) of the origin of the work coordinate system 330. The modeling unit 154 positions this three-dimensional model in virtual space so that the intersection of the three axes in the three-dimensional model of the work coordinate system 330 coincides with its machine coordinates (see Figure 7). In this example, the origin of the work coordinate system 330 is aligned with the center of the end face of the workpiece 404 fixed to the chuck 402 of the rotation axis 410, but the origin of the work coordinate system 330 may be set to a location where there is no workpiece 404. The projection method of the three-dimensional model will be described later in relation to Figure 7.
[0045] The displayed image 340 includes a display of a scale 332 with a predetermined point on the tool 406 (for example, the cutting edge) as the reference point. In this example, a scale 332 in the vertical direction and a scale 332 in the direction of the rotation axis are displayed. The display of the scale 322 is drawn by projecting a three-dimensional model showing the scales 332 in two directions onto the transparent display 240. The information acquisition unit 150 constantly acquires the mechanical coordinates of the cutting edge of the tool 406, which is fixed to the tool post 408. The modeling unit 154 moves the three-dimensional model of the scale 332 in virtual space in accordance with the movement of the tool 406 so that the intersection of two lines in the three-dimensional model of the scale 332 coincides with its mechanical coordinates (see Figure 7). The method of projecting the three-dimensional model will be described later in relation to Figure 7.
[0046] The displayed image 340 includes the movement endpoint coordinates 334. The movement endpoint coordinates 334 are represented by a mark such as a black circle or a cross. Before the block's operation begins, the information acquisition unit 150 acquires the machine coordinates of the movement endpoint of the reference point (e.g., the cutting edge) of the tool 406 caused by the block's operation from the NC control device 104. The display processing unit 156 displays the mark of the movement endpoint coordinates 334 on the transparent display 240 by mapping the machine coordinates of the movement endpoint in the virtual space onto the virtual display surface 540. The mapping method will be described later in relation to Figure 7. The display processing unit 156 may also display the machine coordinate values of the movement endpoint (e.g., "Xe:××,Ye:××,Ze:××") on the transparent display 240.
[0047] The display image 340 may include coordinates for checking the remaining movement amount, work coordinates, and tool coordinates, in addition to the movement endpoint coordinates 334. The coordinates for checking the remaining movement amount are, for example, the movement start point coordinates that indicate the reference point (e.g., the cutting edge) of the tool 406 at the time the block operation begins. The movement start point coordinates are represented, for example, by a mark such as a black circle or a cross. The information acquisition unit 150 acquires the machine coordinates of the movement start point of the reference point (e.g., the cutting edge) of the tool 406 due to the block operation from the NC control device 104 before the block operation begins. The display processing unit 156 displays the movement start point coordinate mark on the transparent display 240 by mapping the machine coordinates of the movement start point in virtual space onto the virtual display surface 540. The display processing unit 156 may also display the machine coordinate values of the movement start point (for example, "Xs:××,Ys:××,Zs:××") on the transparent display 240. The worker can determine the remaining distance to move by comparing the coordinates of the starting point of the block's movement with the current reference point of the tool 406 during the block's operation.
[0048] The work coordinates included in the displayed image 340 are, for example, the machine coordinates of the reference point of the workpiece 404 (for example, the center of the end face of the workpiece 404). The work coordinates are represented by marks such as black circles or crosses. The information acquisition unit 150 acquires the machine coordinates of the reference point of the workpiece 404 from the NC control device 104. The display processing unit 156 displays the marks of the work coordinates on the transparent display 240 by mapping the work coordinates in the virtual space onto the virtual display surface 540. The display processing unit 156 may also display the machine coordinate values of the work coordinates (for example, "Xw:××,Yw:××,Zw:××") on the transparent display 240.
[0049] The tool coordinates included in the displayed image 340 are, for example, the machine coordinates of the reference point (e.g., the cutting edge) of the tool 406. The tool coordinates are represented by marks such as black circles or crosses. The information acquisition unit 150 acquires the machine coordinates of the reference point of the tool 406 from the NC control device 104. The display processing unit 156 displays the work coordinate marks on the transparent display 240 by mapping the tool coordinates in the virtual space onto the virtual display surface 540. The display processing unit 156 may also display the machine coordinate values of the tool coordinates (e.g., "Xt:××, Yt:××, Zt:××") on the transparent display 240.
[0050] In this way, the display processing unit 156 displays specific information (such as scale 332, various coordinates, workpiece 404, tool 406, blocks of the NC program 310, and the execution status of the blocks 302) in a position visible to the operator when the operator is looking at the workpiece 404 inside through the window 200. In other words, at least one of the scale 332, coordinates, workpiece 404, tool 406, blocks of the NC program 310, and the execution status of the blocks 302 is displayed in the window 200.
[0051] Figure 7 shows an example of a 3D model in a virtual space. The modeling unit 154 places 3D models of the equipment, parts, and workpieces included in the machining unit 102 into a virtual space deployed in the memory area, and moves these 3D models in accordance with the movement of the machining unit 102. In other words, the modeling unit 154 matches the shape and position of the 3D models of the equipment and parts included in the machining unit 102 with the shape and position of the actual equipment and parts. Furthermore, if the shape of the workpiece 404 changes due to cutting, the 3D model of the workpiece 404 is also deformed. This technology is also used, for example, as a function to prevent interference. From the perspective of interference prevention, the machine coordinates obtained by predicting future movements (hereinafter referred to as "future machine coordinates") are used to determine the shape and position of the 3D model slightly in the future. However, in the modeling in this embodiment, it is sufficient to determine the shape and position of the current 3D model using the current machine coordinates. However, the modeling unit 154 may place the 3D model in the future machine coordinates, and the display processing unit 156 may project the 3D model placed in the future machine coordinates onto the transparent display 240.
[0052] Specifically, the modeling unit 154 sets up a rotation axis 3D model 510, a chuck 3D model 502, a workpiece 3D model 504, a tool post 3D model 508, and a tool 3D model 506 in virtual space, as shown in the figure. The modeling unit 154 also sets up a scale 3D model 532 in virtual space, using the cutting edge of the tool 3D model 506 as the reference point. The intersection of the two lines of the scale 3D model 532 coincides with the position of the cutting edge of the tool 3D model 506. Furthermore, the modeling unit 154 sets up a work coordinate system 3D model 530 in virtual space, using the center of the end face of the workpiece 3D model 504 as the reference point. The intersection of the three axes of the work coordinate system 3D model 530 coincides with the center of the end face of the workpiece 3D model 504.
[0053] Then, when the NC control device 104 moves the tool post 408 and the tool 406 in the machining chamber, the information acquisition unit 150 acquires information on the movement of the tool post 408 and the tool 406, and the modeling unit 154 moves the 3D model of the tool post 508 and the 3D model of the tool 506 in the virtual space based on that information. The modeling unit 154 also moves the scale 3D model 532 in accordance with the movement of the 3D model of the tool 506.
[0054] A virtual display surface 540 is set at a position in the virtual space that corresponds to the position of the transparent display 240 in the real space. The size and shape of the virtual display surface 540 are matched to the size and shape of the transparent display 240. Furthermore, a virtual viewpoint 550 is set at a position in the virtual space that corresponds to the position of the worker's eyes in the real space. In this embodiment, the virtual viewpoint 550 does not move. A method for moving the virtual viewpoint 550 will be described in Modification 1.
[0055] The display processing unit 156 draws a scale mapping 552 on the virtual display surface 540 where it overlaps with the scale 3D model 532, as viewed from the virtual viewpoint 550. When focusing on a point in the scale 3D model 532 (for example, the intersection of two scales), the display processing unit 156 defines the point on the virtual display surface 540 where the line connecting the virtual viewpoint 550 and that point intersects as one point of the mapping. The scale mapping 552 is determined by a set of points similarly identified for each point included in the scale 3D model 532. The display processing unit 156 projects the scale mapping 552 on the virtual display surface 540 onto the transparent display 240.
[0056] In this way, the worker can see the actual tool 406 and workpiece 404 through the scale 332 displayed on the transparent display 240 and estimate the distance between the tool 406 and workpiece 404 by referring to the scale 332.
[0057] Furthermore, the display processing unit 156 projects the 3D model of the work coordinate system 530 onto the transparent display 240 in a similar manner. That is, the display processing unit 156 draws a mapping of the work coordinate system 330 (omitted in Figure 7) on the virtual display surface 540 where it overlaps with the 3D model of the work coordinate system 530, as viewed from the virtual viewpoint 550. When focusing on a single point in the 3D model of the work coordinate system 530 (for example, the intersection of the three axes), the display processing unit 156 defines the point on the virtual display surface 540 where the line connecting the virtual viewpoint 550 and that single point intersects is one point in the mapping of the work coordinate system 330. The mapping of the work coordinate system 330 is determined by a set of points similarly identified for each point included in the 3D model of the work coordinate system 530. The display processing unit 156 displays the mapping of the work coordinate system 330 on the virtual display surface 540 on the transparent display 240.
[0058] Similarly, it is possible to project a 3D model other than the scale 332 and the work coordinate system 330 onto the transparent display 240 using the same method. The display processing unit 156 may also map the work 3D model 504 onto the virtual display surface 540 to display the work 404 on the transparent display 240. The display processing unit 156 may also map the tool 3D model 506 onto the virtual display surface 540 to display the tool 406 on the transparent display 240. For example, during cutting, the work 404 and tool 406 are hidden by the coolant and cannot be seen. However, by displaying projections of the work 3D model 504 and the tool 3D model 506 on the transparent display 240, it becomes easier to understand what is happening to the work 404 and tool 406 during cutting. Thus, the information of the work 404 displayed may be a 3D image of the part of the work 404 that is not visible through the window 200.
[0059] When the display processing unit 156 projects a 3D model such as a workpiece 3D model 504 or a tool 3D model 506 onto the transparent display 240, it may display an image represented by outlines that show the plane boundaries and contours of the 3D model (hereinafter referred to as a "2D image"), or it may display an image represented by surfaces that have been shaded and colored (hereinafter referred to as a "3D image"). When displaying a 2D image, the display processing unit 156 generates a mapping of outlines that show the plane boundaries and contours of the 3D model onto the virtual display surface 540, and displays that mapping on the transparent display 240. When displaying a 3D image, the display processing unit 156 generates a mapping of surfaces that have been shaded and colored onto the virtual display surface 540 through rendering, and displays that mapping on the transparent display 240.
[0060] The display processing unit 156 may display workpiece offset information. The display processing unit 156 may display the workpiece offset information as a mark indicating the coordinates of the workpiece offset, or as the coordinate values of the offset (for example, "Xwo:xx, Ywo:xx, Zwo:xx"). The display processing unit 156 may also display tool offset information. The display processing unit 156 may display the tool offset information as a mark indicating the coordinates of the tool offset, or as the coordinate values of the tool offset (for example, "Xto:xx, Yto:xx, Zto:xx").
[0061] Thus, the information displayed for workpiece 404 is at least one of the following: a two-dimensional image of workpiece 404, a three-dimensional image of workpiece 404, or offset information of workpiece 404. Similarly, the information displayed for tool 406 is at least one of the following: a two-dimensional image of tool 406, a three-dimensional image of tool 406, or offset information of tool 406.
[0062] The movement endpoint coordinates 334 shown in Figures 5 and 6 are drawn by mapping the machine coordinates of the movement endpoint in the virtual space onto the virtual display surface 540. The display processing unit 156 draws a mark for the movement endpoint coordinates 334 on the virtual display surface 540 where it overlaps with the movement endpoint as viewed from the virtual viewpoint 550. In other words, the display processing unit 156 sets the display position of the movement endpoint as the point where the line connecting the virtual viewpoint 550, that one point, and the movement endpoint intersects on the virtual display surface 540. The display processing unit 156 displays the mark for the movement endpoint coordinates 334 at the display position of the movement endpoint on the transparent display 240. As described above, the display processing unit 156 may also display the machine coordinate values of the movement endpoint coordinates 334 (for example, "Xe:××,Ye:××,Ze:××") on the transparent display 240.
[0063] Although not shown in the diagram, the display processing unit 156 may display a mark of the movement start point coordinates on the transparent display 240 by mapping the machine coordinates of the movement start point in the virtual space onto the virtual display surface 540. As described above, the display processing unit 156 may also display the machine coordinate values of the movement start point (for example, "Xs:xx, Ys:xx, Zs:xx") on the transparent display 240.
[0064] Furthermore, the display processing unit 156 may display marks of the tool 406's machine coordinates on the transparent display 240 by mapping the machine coordinates of the tool 406 in the virtual space onto the virtual display surface 540. As described above, the display processing unit 156 may also display the machine coordinate values of the tool 406 (for example, "Xt:xx, Yt:xx, Zt:xx") on the transparent display 240. The machine coordinates of the tool 406 indicate the position of a predetermined part, such as the cutting edge.
[0065] Although the scale 332 described above is displayed at a position relative to the tool 406, the display processing unit 156 may also display the scale 332 at a position relative to the workpiece 404. For example, the intersection of the two scale lines can be aligned with the center of the end face of the workpiece 404. Even with a scale 332 relative to the workpiece 404, the operator can grasp the distance between the workpiece 404 and the tool 406. Furthermore, if the display processing unit 156 displays the workpiece 404 together with the scale 332 relative to the workpiece 404, the operator can confirm the position, length, and size of the workpiece 404. In this way, the display processing unit 156 displays the workpiece 404 and the scale 332 at a position visible to the operator's line of sight, and based on the scale 332, the operator can confirm at least one of the position, length, or size of the workpiece 404.
[0066] According to the embodiment described above, the worker does not need to move back and forth between the window 200 and the monitor 112. In addition, since the scale 332 is displayed on the window 200, the worker can visually assess the distance between the workpiece 404 and the tool 406 from the outside without having to open the door and enter the processing room.
[0067] In this embodiment, the virtual viewpoint 550 does not move. Therefore, the operator views the processing room from a predetermined position. A mode in which the virtual viewpoint 550 moves to match the operator's eye position will be explained in Modification 1.
[0068] [Example 1] In Modification 1, the position and size of the display are changed according to the operator's position. In other words, no matter what angle the operator is viewing the machining room from, the scale 332, work coordinate system 330, workpiece 404, and tool 406 displayed on the transparent display 240 are displayed in a way that aligns with the actual positions of the equipment and tools in the machining room. For example, if the operator moves to the right in front of the window 200, the scale 332 moves to the right, and the intersection of the scale 332 continues to coincide with the reference point of the tool. Conversely, if the operator moves to the left in front of the window 200, the scale 332 moves to the left, and the intersection of the scale 332 continues to coincide with the reference point of the tool. Also, as the operator approaches the window 200, the scale 332 becomes slightly smaller, and as the operator moves away from the window 200, the scale 332 becomes slightly larger. As a result, the distance between the workpiece 404 and the tool 406 can always be correctly indicated.
[0069] As shown in Figure 1, the machine tool 100 is equipped with a camera 600 for imaging the worker. Preferably, the camera 600 is a wide-angle camera such as a 360-degree camera. A wide-angle camera can capture the worker's position even if they move over a wide area. The camera 600 images the worker, and the eye position detection unit 158 detects the position of the worker's eyes based on the captured image.
[0070] The eye position detection unit 158 first acquires an image from the camera 600. The eye position detection unit 158 unfolds the acquired image into a distortion-free image. The eye position detection unit 158 detects the worker's face from the unfolded image. The eye position detection unit 158 detects both of the worker's eyes from the detected face and identifies the positions of both eyes in the unfolded image. The eye position detection unit 158 calculates the distance between the eyes in the image. Based on the calculated distance between the eyes, the eye position detection unit 158 calculates the distance from the camera 600 to both eyes. The eye position detection unit 158 is assumed to have the actual distance between the worker's eyes stored in advance. The eye position detection unit 158 can compare the distance between the eyes in the image with the actual distance between the eyes to determine the distance from the camera 600 to both eyes. The eye position detection unit 158 can determine the direction from the camera 600 based on the position of both eyes in the unfolded image, and further determine the positional relationship between the camera 600 and both eyes, i.e., the coordinates of both eyes in the camera coordinate system, based on the distance to both eyes. The eye position detection unit 158 can determine the machine coordinates of both eyes of the worker by converting the camera coordinates of both eyes into machine coordinates.
[0071] The display processing unit 156 acquires the machine coordinates of both of the operator's eyes and determines a single virtual viewpoint 550. If it is set to use either the coordinates of the right eye or the coordinates of the left eye, the display processing unit 156 uses the machine coordinates of one eye as the machine coordinates of the virtual viewpoint 550 according to that setting. If it is not set to use either the coordinates of the right eye or the coordinates of the left eye, the display processing unit 156 uses the machine coordinates of the midpoint between the right and left eyes as the machine coordinates of the virtual viewpoint 550.
[0072] By repeating the process described above, the virtual viewpoint 550 can be made to follow the operator's eye position in the virtual space. Therefore, when the operator is constantly looking, the scale 332, work coordinate system 330, workpiece 404, tool 406, etc., displayed on the transparent display 240 will be aligned with the actual positions of the equipment and tools in the machining room. If the operator's eye position moves to the right, the display processing unit 156 may move the display position of information such as blocks of the NC program 310 and the execution status 302 of the blocks to the right, and conversely, if the operator's eye position moves to the left, the display processing unit 156 may move the display position of information such as blocks of the NC program 310 and the execution status 302 of the blocks to the left. In this way, the display processing unit 156 determines the display position of specific information (such as the scale 332, various coordinates, workpiece 404, tool 406, blocks of the NC program 310 and the execution status 302 of the blocks) based on the operator's eye position.
[0073] [Differentiation 2] A head-mounted display, which is a display device mounted on the worker's head, may also be used.
[0074] When using the transparent display described above, there is only one virtual viewpoint 550. Therefore, when viewed by one eye, the displayed image 340 and the actual product or part appear to be correctly aligned, but when viewed by the other eye, it may appear blurry or the image position may be shifted. A head-mounted display can display images with different viewpoints set for the left and right eyes. A head-mounted display has a display unit for the right eye and a display unit for the left eye. In the modified example 2, two virtual viewpoints 550 are provided to match the positions of the left and right eyes. The display processing unit 156 displays the display image 340 created by the right eye's virtual viewpoint 550 on the right eye's display unit, and displays the display image 340 created by the left eye's virtual viewpoint 550 on the left eye's display unit. In this way, there is no shift in the image position for either the left or right eye, so accurate observation can be performed using both eyes.
[0075] For example, similar to the embodiment, using the virtual viewpoint 550 of the right eye and the virtual viewpoint 550 of the left eye as predetermined machine coordinates, the display processing unit 156 displays the display image 340 for the right eye, which has been mapped onto the virtual display surface 540 using the virtual viewpoint 550 of the right eye, on the display unit for the right eye. The display processing unit 156 also displays the display image 340 for the left eye, which has been mapped onto the virtual display surface 540 using the virtual viewpoint 550 of the left eye, on the display unit for the left eye.
[0076] Alternatively, similar to Modification 1, the eye position detection unit 158 may detect the position (machine coordinates) of the worker's right eye and similarly detect the position (machine coordinates) of the left eye. In this case, the display processing unit 156 uses the detected right eye position as the virtual viewpoint 550 for the right eye to generate a display image 340 for the right eye and displays it on the right eye display unit. The display processing unit 156 also uses the detected left eye position as the virtual viewpoint 550 for the left eye to generate a display image 340 for the left eye and displays it on the left eye display unit.
[0077] It should be noted that the present invention is not limited to the embodiments and modifications described above, and the components can be modified and implemented without departing from the spirit of the invention. Various inventions may be formed by appropriately combining the multiple components disclosed in the embodiments and modifications described above. In addition, some components may be deleted from all the components shown in the embodiments and modifications described above. [Explanation of symbols]
[0078] 100 Machine tool, 102 Machining unit, 104 NC control device, 110 Control panel, 112 Monitor, 114 Single block button, 116 Cycle start button, 118 Pause button, 120 Reset button, 130 Reception unit, 150 Information acquisition unit, 152 3D model storage unit, 154 Modeling unit, 156 Display processing unit, 158 Eye position detection unit, 200 Window, 202 Door, 240 Transparent display, 302 Execution status, 304 Remaining movement amount, 306 Execution block, 308 Next block, 310 NC program, 330 Work coordinate system, 332 Scale, 334 Movement end point coordinates, 336 Movement start point coordinates, 340 Display image, 402 Chuck, 404 Workpiece, 406 Tool, 408 Tool post, 410 Rotation axis, 502 Chuck 3D model, 504 Workpiece 3D model, 506 Tool 3D model, 508 Tool post 3D model, 510 Rotation axis 3D model, 532 Scale 3D model, 530 Workpiece coordinate system rotation 3D model, 540 Virtual display plane, 550 Virtual viewpoint, 552 Scale mapping, 600 Camera
Claims
[Claim 1] At the very least, it should be able to display scales and have a window for viewing the interior. The device includes a display processing unit that causes the scale to be displayed in a position where the operator can see the scale while looking at the interior through the window, A machine tool in which the scale is displayed by the display processing unit at a position where the workpiece inside and the scale are visible to the operator's line of sight, and the operator can confirm at least one of the position, length, or size of the workpiece based on the scale.
Citation Information
Patent Citations
Working door device with observation hole in protective cover for machine tool
JP1993060294A
Machine tool operating panel
JP2017167865A
Machining Units, How to Operate Machining Units, and Use of Machining Units
JP2017535829A
Machine tool
JP2018094689A
Machine-tool or production machine with head-up display
US20050002151A1