Display control device, machining simulation device, display control method, and program product

Abstract

A display control device (10) has a shape data acquisition section (11) that acquires shape data of an imaginary workpiece after machining by machining simulation, an illumination condition acquisition section (12) that acquires an illumination condition when light is irradiated on the workpiece by an imaginary light source, a material information acquisition section (13) that acquires material information of the workpiece, a camera position information acquisition section (14) that acquires position information of an imaginary camera that determines a display range of an image, an observation state acquisition section (16) that acquires observation state information of an observer, and an image generation section (17) that generates an image to be provided to a display section (20). The image generation section (17) calculates second reflected light from each position of a machined surface of the workpiece toward an eye of the observer among first reflected light of light irradiated from the imaginary light source on the workpiece based on the shape data, the illumination condition, the material information, the camera position information, and the observation state information, and adds the second reflected light in an image of the imaginary workpiece observed from the imaginary camera.

Description

TECHNICAL FIELD

[0001] The present application relates to a display control device, a machining simulation device, a display control method, and a program. BACKGROUND

[0002] An NC (Numerical Control) machine tool performs machining based on a machining program created by a CAM (Computer Aided Manufacturing) device or the like. In a machined product after machining by the NC machine tool, a machining defect that indicates a finished product different from the intention of the designer of the machining program sometimes occurs. The machining defect occurs, for example, in a case where there is a problem in the machining program, in a case where the NC machine tool does not follow the instructions of the machining program due to inappropriate adjustment of machining conditions or the NC machine tool, or the like. In a case where there is a problem in the machining program when cutting machining is performed by the NC machine tool, the machining defect occurs due to cutting residue or excess cutting.

[0003] In order to prevent the occurrence of the machining defect as described above, a machining simulation device that performs machining simulation based on a machining program created in advance before machining by the NC machine tool is becoming widespread. For example, refer to Patent Literature 1. In Patent Literature 1, a technology is described in which a shape of a machined surface of a virtual machined product after machining simulation based on a machining program is displayed on a display.

[0004] In addition, a technology of simulating a finished product of a building material by a computer is becoming widespread. For example, refer to Patent Literature 2. In Patent Literature 2, a technology is described in which an image of a building material corresponding to a change in an observation environment and a change in an orientation of the building material is displayed on a display.

[0005] Patent Literature 1: Japanese Patent Application Laid-Open (JP A) No. 2017-156170

[0006] Patent Literature 2: Japanese Patent Application Laid-Open (JP A) No. 2017-33319 SUMMARY

[0007] However, the texture of the machined surface of the machined product after machining by the NC machine tool is different from that of the building material, and is different depending on the material of the machined product, the machining path of a tool, and the like. In addition, the evaluation criteria of the machined surface are different depending on the purpose of the machined product. Therefore, in any of the above-described conventional technologies, the texture of the machined surface of the machined product is predicted based on the machining program created in advance, and it is difficult to correct the machining program corresponding to the evaluation criteria for each purpose of the machined product based on the prediction.

[0008] In addition, an observer recognizes the shape and texture of the workpiece based on the texture (e.g., gloss and position of a shadow) of the surface that changes in accordance with the observation state. However, in any of the above-described prior art, the texture in the image of the virtual workpiece displayed on the display portion does not change in accordance with the observation state as in the actual environment. Therefore, it is difficult to confirm the presence or absence of a processing defect in the workpiece based on the result of the processing simulation.

[0009] An object of the present application is to add reflected light of light irradiated from each position of a processing surface of a virtual workpiece processed by processing simulation to an image.

[0010] A display control device according to one embodiment of the present application is a display control device that causes an image of a workpiece on a simulation to be displayed on a display portion, the display control device including a shape data acquisition portion that acquires shape data that represents a shape of the workpiece; an illumination condition acquisition portion that acquires an illumination condition when a light source irradiates light to the workpiece; a material information acquisition portion that acquires material information that represents a material of the workpiece; a position information acquisition portion that acquires position information that represents a virtual viewpoint position that determines a display range of the image in the display portion; and a display image generation portion that generates the image of the workpiece viewed from the virtual viewpoint position, which is provided to the display portion, the display image generation portion calculating, based on the shape data, the illumination condition, the material information, and the position information, reflected light of light irradiated from each position of a processing surface of the workpiece by the light source, which is first reflected light, toward the virtual viewpoint position, which is second reflected light, and adding the second reflected light to the image of the workpiece viewed from the virtual viewpoint position, and performing any processing of adding first reflected light of the first reflected light to the image as the second reflected light or adding the first reflected light and second reflected light of the first reflected light to the image as the second reflected light in accordance with the generated image.

[0011] The display control method according to another aspect of the present application is executed by a display control device that displays an image of a virtual workpiece processed by processing simulation on a display unit, and includes the steps of: acquiring shape data representing a shape of the workpiece; acquiring an illumination condition when a virtual light source illuminates the workpiece with light; acquiring material information representing a material of the workpiece; acquiring camera position information representing a position of a virtual camera that determines a display range of the image on the display unit; acquiring observation state information including at least one of a distance from a display surface of the display unit to an eye of an observer and a direction of a line of sight of the observer with respect to the display surface; generating the image of the workpiece viewed from the camera, and providing the image to the display unit; and in the step of providing the image to the display unit, based on the shape data, the illumination condition, the material information, the camera position information, and the observation state information, calculating a second reflection light from each position of a processing surface of the workpiece toward the eye of the observer among first reflection light from the each position of the processing surface of the workpiece illuminated with light by the light source, and adding the second reflection light to the image generated.

[0012] Effects of the Invention

[0013] According to the present application, it is possible to add reflection light of light illuminated from each position of a processing surface of a virtual workpiece processed by processing simulation to an image. BRIEF DESCRIPTION OF DRAWINGS

[0014] Figure 1 is a block diagram schematically showing a configuration of a processing system according to Embodiment 1.

[0015] Figure 2 is a side view showing a configuration of a ball end mill of an NC machine tool shown in Figure 1

[0016] Figure 3 is an oblique view showing a workpiece processed by the ball end mill shown in Figure 2

[0017] Figure 4 is a schematic view showing a use state of a processing simulation device according to Embodiment 1.

[0018] Figure 5 ​​is a block diagram schematically showing the structure of the machining simulation device according to Embodiment 1.

[0019] Figure 6 is a diagram showing an imaginary space of an image provided to a display section, which is generated by the display control device according to Embodiment 1.

[0020] Figure 7 (A) of is a diagram showing the first-order reflected light among the incident light irradiated to each position of the machined surface of the workpiece and the reflected light of the incident light. Figure 7 (B) of is a diagram showing the first-order reflected light and the second-order reflected light among the incident light irradiated to each position of the machined surface of the workpiece and the reflected light of the incident light.

[0021] Figure 8 (A) of is a diagram showing one example of a microscopic display image generated by the display image generation section of the display control device according to Embodiment 1. Figure 8 (B) of is a diagram showing one example of a macroscopic display image generated by the display image generation section of the display control device according to Embodiment 1.

[0022] Figure 9 (A) of is a diagram showing one example of an image displayed on the display shown in Figure 8 (A) of is a diagram showing one example of an image displayed on the display shown in Figure 9 (B) of is a diagram showing one example of an image displayed on the display shown in Figure 8 (A) of is a diagram showing one example of an image displayed on the display shown in

[0023] Figure 10 is a diagram schematically showing the hardware structure of the machining simulation device according to Embodiment 1.

[0024] Figure 11 is a flowchart showing the operation of the display control device according to Embodiment 1. DETAILED DESCRIPTION

[0025] Hereinafter, the display control device, the machining simulation device, the display control method, and the program according to Embodiment 1 will be described with reference to the drawings. Embodiment 1 below is merely an example, and can be appropriately changed.

[0026] <Embodiment 1>

[0027] Figure 1 is a block diagram schematically showing the structure of the machining system 1 according to Embodiment 1. As shown in Figure 1 , the machining system 1 has a machining simulation device 100, a CAM device 200, and an NC working machine 300 (hereinafter, also referred to as "NC machining machine").

[0028] The processing simulation device 100 is a device that simulates processing of the NC working machine 300 with respect to a workpiece. Further, the structure of the processing simulation device 100 will be described later.

[0029] The CAM device 200 creates a processing program in which an action instruction to the NC working machine 300 is described.

[0030] The NC working machine 300 processes a workpiece based on the processing program created by the CAM device 200. In Figure 1 In the example shown, the NC working machine 300 has a ball end mill 301 as a cutting tool, and a driving section 302 that drives the ball end mill 301. The ball end mill 301 can form a surface of a workpiece into a freeform shape. The driving section 302 has, for example, a motor and a transmission mechanism (for example, a gear) that transmits a driving force of the motor to the ball end mill 301. Further, the NC working machine 300 is not limited to the ball end mill, and can have other tools such as a drill.

[0031] Figure 2 is a side view that shows a structure of the ball end mill 301 of the NC working machine 300 shown in Figure 1 As shown in Figure 2 , a shape of a front end portion 301a of the ball end mill 301 is, for example, spherical. In addition, a portion 301b of the ball end mill 301 other than the front end portion 301a is, for example, cylindrical.

[0032] Figure 3 is a perspective view that shows a workpiece 400 processed by the ball end mill 301 shown in Figure 2 As shown in Figure 3 , the workpiece 400 has a processing surface 410 processed by the ball end mill 301. In the example shown, the processing surface 410 has a plurality of cutting surfaces 411, 412, 413. The ball end mill 301 forms the cutting surfaces 411, 412, 413 in a circular arc shape on the workpiece 400. Here, between adjacent ones of the plurality of cutting surfaces 411, 412, 413, a triangular-shaped tip portion 414, 415 is formed.

[0033] Next, a processing defect that occurs in a workpiece after cutting processing will be described. In a workpiece processed by the ball end mill 301 shown in Figure 1 and Figure 2 , a processing defect can occur in a shape of the workpiece and a processing surface due to a problem in a cutting path or the like. In a case where a processing defect occurs, a product cannot be shipped, and thus it is desirable that a processing defect does not occur in a workpiece.

[0034] Generally, there are two kinds of defects, "damage" and "unevenness of processing", in processing defects. Here, "damage" is, for example, a groove with a small depth formed in a processed surface of a processed product. The depth of the groove is, for example, about 10 μm. In other words, "damage" is a processing defect that occurs in that a part of a processed surface, which is originally a continuous surface, forms a step after processing. The presence or absence of "damage" is identified by irregularity of the shape of the processed surface, and thus, it is possible to make a judgment by touching the processed surface by a person.

[0035] "Unevenness of processing" is, for example, a discontinuous concavo-convex with a small height formed in a processed surface of a processed product. The height of the concavo-convex is, for example, about 1 μm. "Unevenness of processing" is a processing defect in which a fluctuation in texture occurs in a wide range in a processed surface. That is, "unevenness of processing" is a processing defect in which the shape of a processed product is not homogenized, and the color or pattern of a part of a site in a processed surface looks different from that of other sites. The presence or absence of "unevenness of processing" can be judged by light diffraction, color unevenness or shape unevenness based on a rainbow color appearing in a processed surface.

[0036] Generally, the presence or absence of "damage" and "unevenness of processing" is evaluated by a user of an NC processing machine in a visual manner. For example, the user performs trial processing of a processed product, and confirms the presence or absence of a processing defect by reflected light when indoor illumination light or sunlight or the like is irradiated to a processed surface of the processed product after the trial processing. When the user determines that there is a processing defect, the processed product cannot be shipped. Therefore, the user performs a job of correcting a processing parameter in a processing program. However, a processing preparation process including the trial processing and the correction job of the processing parameter is a process that requires a large amount of time. Therefore, it is desirable to reduce the processing preparation process and make a processing job efficient.

[0037] Next, the recognition of texture of a surface of an object performed by a person is described. In an actual environment, reflected light of light irradiated to an object changes in accordance with a material of the object, a shape of a surface of the object, or characteristics of a light source located in the periphery of the object, and the like. For example, a person understands a material of an object in accordance with a fine concavo-convex, gloss, and a change in a shadow of a surface of the object represented by a change in reflected light. Thereby, the person can recognize a surface property of the object, that is, texture of the object.

[0038] Thereby, "texture" in the present specification is a material characteristic understood by a person through reflected light reflected by a surface of an object, that is, a processed surface of a processed product. The reflected light has characteristics such as wavelength characteristics (hereinafter, also referred to as "color tone"), directivity, and diffusivity.

[0039] Furthermore, when a person observes the surface of an object, they perform an active action by moving their eyes, head, or body. Based on the actions performed during observation as described above, the gloss and shadows on the object's surface change, making it easier for the person to understand the object's material. Therefore, in accordance with the person's actions during observation, the display unit of the processing simulation device 100 (i.e., described later)... Figure 4 The display 20) shows a change in the image of the hypothetical workpiece (hereinafter also referred to as "object"), which can simulate the display of the machined surface of the workpiece after it has been actually machined by the NC machining machine.

[0040] Reflected light from an object's surface includes components of specular reflection and diffuse reflection. Specular reflection occurs when the angle of incidence and the angle of reflection are the same. Diffuse reflection occurs when incident light is reflected in various directions from the reflecting surface. Therefore, specular reflection has strong directionality, while diffuse reflection reflects light in all directions. Additionally, reflected light from an object's surface also includes components of internal reflection and mutual reflection. Internal reflection occurs when light traveling inside the object is scattered internally and reflected towards the outside. Mutual reflection occurs when light reflected from one object strikes another object and is further reflected.

[0041] Therefore, by adding a change in the hue of the reflected light to the image of the imaginary workpiece displayed on the display unit of the processing simulation device 100, the realism of the workpiece can be further enhanced. This change in the hue of the reflected light can be achieved, for example, by occurring in an image that reflects a landscape including objects or people present around the display unit, and the display unit reflecting the hue of the light illuminating it.

[0042] Next, the structure of the processing simulation device 100 will be described. Figure 4 It means Figure 1 A schematic diagram of the processing simulation device 100 in use. (As shown) Figure 4 As shown, the machining simulation apparatus 100 includes a display control device 10 and a display 20 as a display unit. The display control device 10 is an apparatus capable of executing the display control method and the program according to Embodiment 1.

[0043] The display control device 10 displays an image of the hypothetical workpiece 502, processed through machining simulation, on the display 20. The user, or observer 50, of the machining simulation device 100 can confirm the results of the machining simulation by observing the display 20. Figure 4 In the example shown, the image displayed on monitor 20 is described later. Figure 8 The macroscopic image shown in (B) is displayed as image A2.

[0044] The display 20 is, for example, a liquid crystal display, an organic EL (Electro Luminescense) display, a micro LED (Light Emitting Diode) display, or the like. Further, the display 20 can also be an air display, an HMD (Head Mounting Display), a VR (Virtual Reality) device, an AR (Augmented Reality) device, or the like.

[0045] In Figure 4 In the example shown, the display control device 10 and the display 20 are provided to the terminal device 30. The terminal device 30 is, for example, a tablet-type PC (Personal Computer), a notebook-type PC, or the like. Further, the display control device 10 can also be provided to another terminal device other than the terminal device having the display 20.

[0046] Figure 5 is a block diagram schematically showing the structure of the machining simulation device 100 according to Embodiment 1. As Figure 5 shown, the display control device 10 has a shape data acquisition section 11, an illumination condition acquisition section 12, a material information acquisition section 13, a camera position information acquisition section 14, a display range information acquisition section 15, an observation state acquisition section 16, and a display image generation section 17.

[0047] The shape data acquisition section 11 acquires shape data showing the shape of a workpiece. The shape data acquisition section 11 acquires the shape data via an input device (for example, a keyboard and a mouse, or the like) 110 operated by the observer 50 (refer to Figure 4 ). The shape data acquisition section 11 acquires, for example, 3-dimensional volume data as the shape data. The acquired shape data is stored in a storage section (not shown) of the display control device 10. Further, the shape data acquisition section 11 is not limited to a structure that acquires 3-dimensional volume data, and can acquire data obtained by performing a relief map that expresses a sense of relief by changing the surface of the workpiece in the normal direction. In addition, the shape data acquisition section 11 can acquire data obtained by measuring the shape of the workpiece after actual cutting machining by a 3-dimensional shape measuring device. The shape data acquisition section 11 outputs the acquired shape data to the display image generation section 17.

[0048] The illumination condition acquisition section 12 acquires an illumination condition of a virtual light source (that is, the virtual light source described later Figure 6The illustrated hypothetical light source 42) is the illumination condition when the workpiece is irradiated with light. In the case where the material of the workpiece is metal, the illumination condition includes, for example, any one or more of the angle at which light emitted from the hypothetical light source is incident on the work surface, the position of the hypothetical light source, the intensity of the light, the light distribution of the light, the number of hypothetical light sources, the color of the light, and the wavelength characteristics of the light.

[0049] In Figure 5 In the illustrated example, the illumination condition acquisition section 12 acquires the illumination condition via the input device 110. The illumination condition acquisition section 12 outputs the acquired illumination condition to the display image generation section 17. In addition, the illumination condition acquisition section 12 can acquire the illumination condition without via the input device 110, and can store a predetermined illumination condition. In addition, the illumination condition acquisition section 12 can store a plurality of predetermined illumination conditions. For example, in the case where the material of the workpiece is metal, the reflection characteristics of the light irradiated on the work surface differ in correspondence with the illumination condition. The illumination condition acquisition section 12 stores a plurality of illumination conditions, and thereby can acquire an illumination condition corresponding to the material or shape of the workpiece.

[0050] The material information acquisition section 13 acquires material information indicating the material of the workpiece. In Embodiment 1, the material information acquisition section 13 acquires material information indicating the raw material of the workpiece as the material information. The raw material of the workpiece includes, for example, any one or more of metal (for example, aluminum, iron, titanium, and the like), resin (for example, plastic), wood, and rubber. The material information acquisition section 13 stores, for example, a plurality of predetermined raw material information. The material information acquisition section 13 acquires, as the material information, raw material information selected by the observer 50 from the stored plurality of raw material information via the input device 110. In addition, in the case where the raw material information of the workpiece is not stored in the material information acquisition section 13, the material information acquisition section 13 can acquire, as the material information, new raw material information input via the input device 110. In addition, the material information acquisition section 13 is not limited to raw material information, and can acquire, as the material information, a texture image including information related to the object color of the workpiece or information related to the specular reflection intensity, or can acquire BRDF (Bidirectional Reflectance Distribution Function) data as the material information.

[0051] The camera position information acquisition section 14 acquires camera position information indicating a hypothetical camera (i.e., the hypothetical camera described later Figure 4 ) virtually displaced from the eyes of the observer 50 observing the display 20 (refer to Figure 6The position of the assumed camera 41) shown. The camera position information acquisition section 14 acquires the camera position information, for example, via an input device 110 such as a keyboard and a mouse. Further, in the case where the display 20 is a display capable of touch operation (hereinafter, also referred to as "touch panel display"), the camera position information acquisition section 14 can acquire the camera position information via a touch operation of the observer 50 in the touch panel display.

[0052] The display range information acquisition section 15 acquires the camera position information acquired by the camera position information acquisition section 14 as display range information indicating a display range of an image of an assumed work displayed on the display 20.

[0053] The observation state acquisition section 16 acquires observation state information indicating an observation state of the observer 50 (refer to Figure 4 ) observing the display 20. The observation state information includes a distance from a display surface 20a (refer to Figure 4 ) of the display 20 to a position of the eye of the observer 50, and a direction of a line of sight of the observer 50 with respect to the display surface 20a. The observation state acquisition section 16 is, for example, a photographing device (for example, a color camera, an infrared camera, or the like) that tracks the observer 50 by photographing the observer 50.

[0054] The observation state acquisition section 16, for example, detects an area of the head 50a (refer to Figure 4 ) of the observer 50 included in an image acquired by photographing the observer 50, thereby acquiring the distance from the display surface 20a of the display 20 to the position of the eye of the observer 50. In the case where the area of the head 50a detected by the observation state acquisition section 16 is greater than a threshold value decided in advance, it is possible to detect that the observer 50 is in a position closer than a reference position decided in advance. In addition, in the case where the area of the head 50a detected is less than or equal to the threshold value, it is possible to detect that the observer 50 is in a position farther than the reference position. Further, the observation state acquisition section 16 can also detect a width or a length of the head 50a of the observer 50. In addition, the observation state acquisition section 16 can also take the position of the eye of the observer at the time when the photographing device initially photographs the observer 50 as the reference position, and acquire the observation state information according to whether or not the eye of the observer moves in any of the leftward and rightward directions and the upward and downward directions with respect to the reference position.

[0055] In addition, the observation state acquisition section 16 can also acquire an amount of movement of a pixel in the image of the detected head 50a, and acquire the position of the observer 50 with respect to the display surface 20a on the basis of the amount of movement of the pixel. In addition, it is also possible to acquire an amount of movement of a pixel corresponding to the amount of change in the area of the detected head 50a as the area of the head 50a decreases over time, and acquire the position of the observer 50 with respect to the display surface 20a on the basis of the amount of movement of the pixel.

[0056] As Figure 4 shown in Embodiment 1, the observation state acquisition section 16 is provided to the display 20. Further, the observation state acquisition section 16 can be provided near the display 20. In addition, the observation state acquisition section 16 can be provided to the display control device 10 or near the display control device 10. In this case, the observation state acquisition section 16 can be an acceleration sensor, a gyro sensor, a ToF (Time of Flight) sensor, or the like. In addition, the observation state acquisition section 16 can be disposed at a position away from the machining simulation device 100 if it can acquire the relative positional relationship between the display 20 and the observer 50.

[0057] In addition, in a case where the position of the hypothetical light source among the lighting conditions acquired by the lighting condition acquisition section 12 is away from a predetermined reference position, the shape (i.e., the texture) of the object after machining by machining simulation does not change. At this time, the observation state acquisition section 16 can not acquire the position of the observer 50 with respect to the display surface 20a.

[0058] The display image generation section 17 generates an image of the hypothetical machined object to be provided to the display 20. The display image generation section 17 generates an image based on the shape data, the lighting conditions, the material information, the camera position information, and the observation state information. Specifically, the display image generation section 17 generates an image in which the shape data of the machined object is subjected to a rendering process based on the lighting conditions, the material information, the camera position information, and the observation state information. The image of the hypothetical machined object is generated in a hypothetical 3-dimensional space (i.e., a hypothetical space V described later Figure 6

[0059] Figure 6 is a schematic view showing a hypothetical space V in which a hypothetical machined object (hereinafter, simply referred to as a "machined object") 500 is generated. In Figure 6 an XYZ orthogonal coordinate system is shown. The X axis and the Y axis are coordinate axes parallel to a horizontal plane. The Z axis is a coordinate axis orthogonal to both the X axis and the Y axis. As Figure 6 shown in Embodiment 1, the observation state acquisition section 16 is provided to the display 20. Further, the observation state acquisition section 16 can be provided near the display 20. In addition, the observation state acquisition section 16 can be provided to the display control device 10 or near the display control device 10. In this case, the observation state acquisition section 16 can be an acceleration sensor, a gyro sensor, a ToF (Time of Flight) sensor, or the like. In addition, the observation state acquisition section 16 can be disposed at a position away from the machining simulation device 100 if it can acquire the relative positional relationship between the display 20 and the observer 50.

[0060] The position of the hypothetical camera 41 is a viewpoint position at the time when the image of the hypothetical machined object 500 after machining by machining simulation is displayed on the display 20. The display range of the machined object 500 in the display 20 is determined based on the position of the hypothetical camera 41. That is, the display range of the image of the machined object 500 in the display 20 corresponds to the position of the hypothetical camera 41. In Embodiment 1, the observer 50 (refer to Figure 4 ​The position of the imaginary camera 41 is input to the camera position information acquisition unit 14, thereby determining the display range of the workpiece 500 on the display 20. That is, the position of the imaginary camera 41 represents the position of the viewpoint of the observer 50 observing the display 20. As described above, by the input operation of the observer 50, the position of the imaginary camera 41 in the imaginary space V is changed, thereby allowing the display range of the workpiece 500 on the display 20 to be freely set to the range observed by the observer 50.

[0061] The hypothetical light source 42 illuminates the incident light L1 as light irradiating the workpiece 500. Figure 6 In the example shown, the positions of the imaginary camera 41 and the workpiece 500 are fixed, and the position of the imaginary light source 42 is relative to that of the observer 50 (see reference). Figure 4 The observation state changes accordingly. For example, the imaginary camera 41 is fixed to the workpiece 500 on the display 20 (see reference). Figure 4 The position that can be displayed in the image is such that the position of the imaginary light source 42 changes in any direction in the X-axis, Y-axis and Z-axis directions, corresponding to the observation state of the observer 50.

[0062] Display image generation unit 17 (reference) Figure 5 Based on shape data, lighting conditions, material information, camera position information, and observation state information, the intensity of the second reflected light (L3) from each position of the incident light L1 (first reflected light L2) irradiated by the imaginary light source 42 onto the workpiece 500 towards the observer's eye is calculated. This second reflected light L3 is then added to the image of the workpiece 500 viewed from the imaginary camera 41. For example, when the position of the imaginary light source 42 changes according to the observation state, the display image generation unit 17 adjusts the intensity of the second reflected light L3 from each position of the workpiece 500's surface towards the observer's eye. This results in a change in the texture of the workpiece 500 displayed on the display 20.

[0063] like Figure 5 As shown, the display control device 10 also includes a scale information acquisition unit 18 and a scale information determination unit 19. Furthermore, the display control device 10 can be implemented even without the scale information acquisition unit 18 and the scale information determination unit 19.

[0064] The scale information acquisition unit 18 acquires scale information indicating a scale of an image in the display 20. In a case where the display 20 is a touch panel display, the scale information acquisition unit 18 acquires the scale information, for example, via a gesture action generated by a touch operation or a GUI (Graphical User Interface) using a slider bar. Further, in a case where the display 20 does not have a touch sensor built in, the scale information acquisition unit 18 can acquire the scale information, for example, via an input device such as a keyboard and a mouse.

[0065] In Embodiment 1, the scale acquired by the scale information acquisition unit 18 has a first scale and a second scale larger than the first scale. The first scale is a scale at the time of enlarged display of a part of an image of a virtual workpiece processed by processing simulation. The second scale is a scale at the time of equal-magnification display or reduced display of the image of the virtual workpiece processed by the processing simulation.

[0066] The scale information judgment unit 19 judges a kind of an image displayed in the display 20 on the basis of the scale information acquired by the scale information acquisition unit 18. In Embodiment 1, the scale information judgment unit 19 judges that the display 20 displays a microscopic display image (i.e., a microscopic display image Al shown in (A) of FIG. 6 described later) when the first scale is acquired by the scale information acquisition unit 18. The scale information judgment unit 19 judges that the display 20 displays a macroscopic display image (i.e., a macroscopic display image A2 shown in (B) of FIG. 6 described later) when the second scale is acquired by the scale information acquisition unit 18. Further, the scale information judgment unit 19 can judge that the display 20 displays the microscopic display image when scale information having a magnification larger than or equal to a reference value decided in advance is acquired by the scale information acquisition unit 18. In addition, the scale information judgment unit 19 can judge that the display 20 displays the macroscopic display image when scale information having a magnification equal to or smaller than the reference value is acquired by the scale information acquisition unit 18. Figure 8 Figure 8 The scale information judgment unit 19 judges a kind of an image displayed in the display 20 on the basis of the scale information acquired by the scale information acquisition unit 18. In Embodiment 1, the scale information judgment unit 19 judges that the display 20 displays a microscopic display image (i.e., a microscopic display image Al shown in (A) of FIG. 6 described later) when the first scale is acquired by the scale information acquisition unit 18. The scale information judgment unit 19 judges that the display 20 displays a macroscopic display image (i.e., a macroscopic display image A2 shown in (B) of FIG. 6 described later) when the second scale is acquired by the scale information acquisition unit 18. Further, the scale information judgment unit 19 can judge that the display 20 displays the microscopic display image when scale information having a magnification larger than or equal to a reference value decided in advance is acquired by the scale information acquisition unit 18. In addition, the scale information judgment unit 19 can judge that the display 20 displays the macroscopic display image when scale information having a magnification equal to or smaller than the reference value is acquired by the scale information acquisition unit 18.

[0067] The display image generation unit 17 has a microscopic display image generation unit 17a and a macroscopic display image generation unit 17b.

[0068] The microscopic display image generation unit 17a generates a microscopic display image when the scale information judgment unit 19 judges that an image displayed in the display 20 is the microscopic display image. The microscopic display image is first reflected light (i.e., the first reflected light L2 shown in (A) of FIG. 6 described later) among the first reflected light L2 of the incident light L1 irradiated from the virtual light source 42 shown in (A) of FIG. 6 described later, which is added to the image of the virtual workpiece processed by the processing simulation. Figure 6 Figure 7 ​​the image of the first reflected light (i.e., the first reflected light L21 to L25 described later) among the first reflected light L2 of the incident light L1 irradiated from the virtual light source 42 shown in (A) of FIG. 6. As described above, the micro-display image generation section 17a is a rendering section that renders (also referred to as "draws") the image to which the first reflected light is added.

[0069] The macro-display image generation section 17b generates a macro-display image when it is judged by the scale information judging section 19 that the image displayed in the display 20 is a macro-display image. The macro-display image is an image to which the first reflected light (i.e., the first reflected light L23, L25 described later) and the second reflected light (i.e., the second reflected light L31, L32, L33 described later) of the incident light L1 irradiated from the virtual light source 42 shown in (B) of FIG. 6 are added. Figure 6 Figure 7 The macro-display image generation section 17b generates a macro-display image when it is judged by the scale information judging section 19 that the image displayed in the display 20 is a macro-display image. The macro-display image is an image to which the first reflected light (i.e., the first reflected light L23, L25 described later) and the second reflected light (i.e., the second reflected light L31, L32, L33 described later) of the incident light L1 irradiated from the virtual light source 42 shown in (B) of FIG. 6 are added. Figure 7

[0070] The first reflected light L21 to L25 and the second reflected light L31 to L33 of the light irradiated to the workpiece are described using (A) of FIG. 5 and (B) of FIG. 6. Figure 7 Figure 7 The first reflected light L21 to L25 and the second reflected light L31 to L33 of the light irradiated to the workpiece are described using (A) of FIG. 5 and (B) of FIG. 6. Figure 7 (A) of FIG. 5 is a schematic view showing the incident light L11 to L15 irradiated to each position of the working surface 500a of the workpiece 500 and the first reflected light L21 to L25 among the reflected light of the incident light L11 to L15. As described above, the first reflected light L21 to L25 is reflected light that reaches the eye of the observer 50 (refer to (B) of FIG. 5) by one reflection of the incident light L11 to L15 irradiated to each position of the working surface 500a of the workpiece 500. Figure 7 (A) of FIG. 5 is a schematic view showing the incident light L11 to L15 irradiated to each position of the working surface 500a of the workpiece 500 and the first reflected light L21 to L25 among the reflected light of the incident light L11 to L15. As described above, the first reflected light L21 to L25 is reflected light that reaches the eye of the observer 50 (refer to (B) of FIG. 5) by one reflection of the incident light L11 to L15 irradiated to each position of the working surface 500a of the workpiece 500. Figure 4 (A) of FIG. 5 is a schematic view showing the incident light L11 to L15 irradiated to each position of the working surface 500a of the workpiece 500 and the first reflected light L21 to L25 among the reflected light of the incident light L11 to L15. As described above, the first reflected light L21 to L25 is reflected light that reaches the eye of the observer 50 (refer to (B) of FIG. 5) by one reflection of the incident light L11 to L15 irradiated to each position of the working surface 500a of the workpiece 500.

[0071] ​​​The luminance values of the first-reflected light L21 to L25 are calculated, for example, by a bump mapping. In addition, the calculation of the optical reflection is performed by a reflection model corresponding to the material of the workpiece, among reflection models such as a Phong model, a Torrance-Sparrow model, and a Blinn model. The rendering process of the image to which the first-reflected light L21 to L25 is added is performed each time the information acquired by the camera position information acquisition section 14, the observation state acquisition section 16, and the scale information acquisition section 18 is updated. Thus, the image corresponding to the updated information can be displayed in real time on the display 20.

[0072] Figure 7 (B) is a schematic view showing the first-reflected light L23, L25 and the second-reflected light L31, L32, L33 among the incident light L11 to L15 irradiated to each position of the machined surface 500a of the workpiece 500 and the reflected light of the incident light L11 to L15. In Figure 7 In the example shown in (B), the incident light L13, L15 among the incident light L11 to L15 irradiated to each position of the machined surface 500a reaches the eyes of the observer 50 as the first-reflected light L23, L25 which is first-reflected on the machined surface 500a. The incident light L11, L12, L14 among the incident light L11 to L15 reaches the eyes of the observer 50 as the second-reflected light L31, L32, L33 which is second-reflected on the machined surface 500a. The second-reflected light L31, L32, L33 is reflected light which reaches the eyes of the observer 50 by multiple reflection of the incident light L11, L12, L14 irradiated to each position of the machined surface 500a of the workpiece 500 by the machined surface 500a. The second-reflected light L31, L32, L33 includes a subsurface scattering component, a refraction component, a mutual reflection light component, and a diffraction light component.

[0073] The luminance values of the second-reflected light L31, L32, L33 are calculated, for example, by an approximation using a model created by physical basic rendering which is modeled based on a measurement of the transmission of a light ray, photon mapping, and diffraction of light. In addition, the luminance values of the second-reflected light L31, L32, L33 can be calculated by a microfacet theory which performs a rendering process using a BRDF or a NDF (Normal Distribution Function). The rendering process of the image to which the first-reflected light L23, L25 and the second-reflected light L31, L32, L33 are added is performed each time the information acquired by the camera position information acquisition section 14, the observation state acquisition section 16, and the scale information acquisition section 18 is updated. Thus, the image corresponding to the updated information can be displayed in real time on the display 20.

[0074] The reflection characteristics of the image to which the first-order reflected light L23, L25 and the second-order reflected light L31, L32, L33 are added are more complicated than the reflection characteristics of the image to which only the first-order reflected light L21 to L25 is added. That is, the image of the object after processing by processing simulation to which the first-order reflected light L23, L25 and the second-order reflected light L31, L32, L33 are added, whereby the texture of the object can be made close to the actual environment.

[0075] Next, a specific example of the image generated by the display image generation section 17 will be described using Figure 8 (A) of FIG. 10 and Figure 8 (B) of FIG. 11, and Figure 9 (A) of FIG. 12 and Figure 9 (B) of FIG. 13. Figure 8 (A) of FIG. 10 is a view showing one example of the microscopic display image Al generated by the microscopic display image generation section 17a of the display image generation section 17. Figure 8 (B) of FIG. 11 is a view showing one example of the macroscopic display image A2 generated by the macroscopic display image generation section 17b of the display image generation section 17. The microscopic display image Al and the macroscopic display image A2 are patterns obtained by simulating the cutting process using the ball-end mill 301 (refer to FIG. 9). Figure 2

[0076] The microscopic display image Al is an image generated when the scale is the first scale, which is obtained by the scale information acquisition section 18 shown in FIG. 1. That is, the microscopic display image Al is an image displayed in the display 20 when the processed object 501 after processing by processing simulation is displayed in an enlarged manner. In the microscopic display image Al, the first-order reflected light L21 to L25 calculated by the microscopic display image generation section 17a (refer to (A) of FIG. 10) is added. Figure 5 Figure 7

[0077] The macroscopic display image A2 is an image generated when the scale is the second scale, which is obtained by the scale information acquisition section 18 shown in FIG. 1. That is, the macroscopic display image A2 is an image displayed in the display 20 when the processed object 502 after processing by processing simulation is displayed in an equal-to-reduced manner. In the macroscopic display image A2, the first-order reflected light L23, L25 and the second-order reflected light L31, L32, L33 calculated by the macroscopic display image generation section 17b (refer to (B) of FIG. 11) are added. Figure 7

[0078] ​​​​The reflective properties of the macroscopic display image A2 are more complex than those of the microscopic display image A1, thus enabling the texture of the processed object 502 in the macroscopic display image A2 to closely approximate the actual environment. Furthermore, since the microscopic display image A1 is supplemented with primary reflections L21 to L25, and the macroscopic display image A2 is supplemented with primary reflections L23, L25 and secondary reflections L31, L32, L33, the rendering processing time for generating the microscopic display image A1 can be shortened compared to the rendering processing time for generating the macroscopic display image A2. Therefore, the microscopic display image A1 can be smoothly displayed on the display 20 by following the direction of the observer 50's line of sight.

[0079] The observer 50 observes the display 20 and confirms the presence or absence of processing defects in the hypothetical workpieces 501 and 502 based on the microscopic display image A1 and the macroscopic display image A2 displayed on the display 20, thereby evaluating whether the processing procedure needs to be corrected.

[0080] For example, observer 50 observes the microscopic display image A1, thereby confirming the presence or absence of defects on the magnified machined surface of the workpiece 501. Typically, NC machine tools 300 (refer to...) Figure 1 When evaluating the presence or absence of machining defects in a workpiece processed by the NC machine tool 300, the user confirms the presence or absence of damage to the workpiece. Specifically, the user confirms the presence or absence of damage by visual inspection or by using a magnifying glass to magnify the machined surface. Figure 8 As shown in (A), in the display control device 10, when the workpiece 501 processed through processing simulation is magnified and displayed, a microscopic display image A1 with additional primary reflection light L21 to L25 and without additional secondary reflection light is displayed on the display 20. Therefore, in the microscopic display image A1, it is difficult for iridescent color inconsistencies or color fluctuations to occur, thus the observer 50 can easily identify the fine unevenness (i.e., cutting shape) of the processed surface of the workpiece 501. This allows for confirmation of the presence or absence of damage on the processed surface of the workpiece 501.

[0081] Furthermore, by observing the macroscopic display image A2, the observer 50 can visually confirm whether the shape of the processed object 502 is homogeneous over a large area. Thus, the observer 50 can confirm the presence or absence of processing inhomogeneities in the processed object 502.

[0082] Figure 9 (A) means that in Figure 4 A diagram showing an example of image A3 displayed on display 20 when the left side of display 20 is tilted downwards. Figure 9Image A3 shown in (A) is generated by observer 50. Figure 8 The image shown in (A) is the left side of the display 20 tilted downwards. Figure 9 (B) indicates that in Figure 8 A diagram of an example of an image A4 displayed on display 20 when the right side of display 20 is tilted downwards. (A) Figure 9 Image A4 shown in (B) was created by observer 50. Figure 9 The image shown in (A) is the right side of the display 20 when it is tilted downwards.

[0083] like Figure 6 (A) and Figure 10 As shown in (B), the gloss of image A3 is stronger than that of image A4, and image A3 is brighter than image A4. As described above, the reflective properties of the image displayed on the display 20 differ according to the change in the observer 50's viewing state towards the display 20. That is, the image generation unit 17 adjusts the reflection characteristics of the second reflected light L3 (refer to) directed towards the observer 50's eye according to the change in the viewing state. Figure 10 The intensity of the workpiece 501 is changed. As a result, the realism of the workpiece 501 displayed on the display 20 is improved, so the observer 50 can easily confirm the texture of the workpiece 501's surface.

[0084] Figure 5 This is a diagram that roughly represents the hardware structure of the processing simulation device 100. (For example...) Figure 11 As shown, the processing simulation device 100 has a memory 10a, a processor 10b and a display 20.

[0085] Display control device 10 (refer to) Figure 1 The display control device 10 can be implemented by a computer, which includes: a memory 10a, a storage device for storing programs as software; and a processor 10b, an information processing unit that executes the programs stored in the memory 10a. The memory 10a is, for example, RAM (Random Access Memory) or ROM (Read Only Memory). The processor 10b executes the programs to implement the functions of each structure of the display control device 10. Furthermore, a portion of the structure of the display control device 10 can be implemented using the memory 10a and the processor 10b. Alternatively, the display control device 10 can also be implemented using circuitry.

[0086] Next, the operation of the display control device 10 will be explained. ​ This is a flowchart showing the operation of the display control device 10.

[0087] First, in step S1, the shape data acquisition section 11 acquires shape data indicating the shape of the hypothetical workpiece 500 that is processed by processing simulation.

[0088] In step S2, the material information acquisition section 13 acquires material information indicating the material of the workpiece 500.

[0089] In step S3, the camera position information acquisition section 14 acquires the position of the hypothetical camera 41 that determines the display range of the image of the workpiece 500 in the hypothetical space V. The initial position of the hypothetical camera 41 is stored in advance in the camera position information acquisition section 14. The position of the hypothetical camera 41 is changed at the time of display range update in step S10 described later. Thus, the observer 50 can freely set the position of the hypothetical camera 41, that is, the display range of the workpiece 500 displayed in the display 20, and thus the observer 50 can observe the workpiece 500 in the desired display range and easily confirm the texture of the workpiece 500.

[0090] In step S4, the lighting condition acquisition section 12 acquires the lighting condition at the time when the incident light LI is irradiated on the workpiece 500 by the hypothetical light source 42. The lighting condition is changed in step S11 described later, in a case where the observation state information of the observer 50 who observes the display 20 is acquired.

[0091] In step S5, the scale information judgment section 19 determines whether the scale acquired by the scale information acquisition section 18 is the first scale, and in a case where it is determined that the scale is the first scale (that is, in a case where it is determined Yes in step S5), the process proceeds to step S6. The scale information judgment section 19 causes the process to proceed to step S7 in a case where it is determined that the scale acquired by the scale information acquisition section 18 is not the first scale (that is, in a case where it is determined No in step S5). That is, in a case where the scale information judgment section 19 determines that the scale acquired by the scale information acquisition section 18 is the second scale, the process proceeds to step S7. Further, in a case where it is determined No in step S5, a case where the scale information acquisition section 18 does not acquire the scale information via the input device 110 is also included. That is, in step S5, the scale information judgment section 19 also causes the process to proceed to step S7 in a case where the scale information is not input.

[0092] In step S6, the display image for microscopes generation section 17a calculates the first reflected light L21 to L25 based on the shape data, the lighting condition, the material information, the camera position information, and the first scale, and generates the display image for microscopes Al to which the first reflected light L21 to L25 is added.

[0093] In step S7, the macro display image generating section 17b creates a macro display image A2 to which the first reflected light L23, L25 and the second reflected light L31, L32, L33 are added, based on the shape data, the lighting condition, the material information, the camera position information, and the second scale.

[0094] In step S8, the display image generating section 17 supplies the image created in step S6 and step S7 to the display 20. The update frequency of the image in the display 20 is, for example, less than or equal to 100 ms. Thereby, the observer 50 who observes the display 20 hardly recognizes the delay of the display of the image. Further, the update frequency of the image in the display 20 can correspond to the update frequency of the observation state acquiring section 16, and can be, for example, 30 fps.

[0095] In step S9, the display control device 10 determines whether or not to end the display of the image in the display 20, and in the case of determining to end the display (i.e., in the case of determining Yes in step S9), the process proceeds to step S13. In the case of determining not to end the display of the image in the display 20 (i.e., in the case of determining No in step S9), the process returns to step S8.

[0096] In step S10, the display control device 10 determines whether or not to update the display range of the image in the display 20. That is, the display control device 10 determines whether or not the display range information is acquired by the display range information acquiring section 15. Here, the update of the display range of the image is the change of the display range of the image displayed in the display 20. Whether or not to update the display range is determined by whether or not the camera position information acquired by the camera position information acquiring section 14 is updated.

[0097] In the case of displaying the image of the object in 2 dimensions in the touch panel display as the display 20, the observer 50 performs the operation of moving the finger in the left-right direction and the up-down direction on the touch panel display, thereby acquiring the camera position information and updating the display range. In the case of displaying the image of the object in 3 dimensions in the touch panel display, the observer 50 performs the operation of moving the finger in the left-right direction and the up-down direction on the touch panel display, thereby updating the display range in 3 dimensions. Further, in the case of the display 20 being the HMD, the display range can be updated by the recognition of the movement of the hand of the observer 50 or the operation by the joystick.

[0098] In step S10, the display control device 10 returns the process to step S3 in a case where it is determined that the display range is updated (i.e., in a case where Yes is determined in step S10). In addition, the display control device 10 ends the process in a case where it is determined that the display range is not updated (i.e., in a case where No is determined in step S10).

[0099] In step Sll, the display control device 10 determines whether or not the observation state information is acquired by the observation state acquisition section 16, and returns the process to step S4 in a case where it is determined that the observation state information is acquired (i.e., in a case where Yes is determined in step Sll). That is, in a case where the observation state information is acquired by the observation state acquisition section 16, the illumination condition is updated. Then, in a case where the process proceeds to step S6, the micro-display image generation section 17a generates the micro-display image Al based on the updated illumination condition on the basis of the shape data, the material information, the camera position information, and the first scale. That is, in a case where the observation state information is acquired, the micro-display image generation section 17a generates the micro-display image Al based on the shape data, the illumination condition, the material information, the camera position information, the observation state information, and the first scale.

[0100] In addition, in a case where the observation state information is acquired, in a case where the process proceeds to step S7, the macro-display image generation section 17b generates the macro-display image A2 based on the updated illumination condition on the basis of the shape data, the material information, the camera position information, and the second scale. That is, in a case where the observation state information is acquired, the macro-display image generation section 17b generates the macro-display image A2 based on the shape data, the illumination condition, the material information, the camera position information, the observation state information, and the second scale.

[0101] The display control device 10 ends the process in a case where it is determined that the observation state information is not acquired by the observation state acquisition section 16 (i.e., in a case where No is determined in step Sll).

[0102] In step S12, the scale information determination section 19 determines whether or not the scale information is updated by the scale information acquisition section 18, and returns the process to step S6 in a case where it is determined that the scale information is updated (i.e., in a case where Yes is determined in step S12). The scale information determination section 19 ends the process in a case where it is determined that the scale information is not updated (i.e., in a case where No is determined in step S12).

[0103] In step S13, the display 20 ends the display of the image of the workpiece 500.

[0104] As described above, according to the display control device 10 according to the embodiment 1, the display image generation section 17 calculates the reflection light, i.e., the second reflection light L3, from each position of the machined surface of the workpiece 500 toward the eye of the observer 50, among the first reflection light L2, i.e., the reflection light of the incident light L1 irradiated from the virtual light source 42 toward each position of the machined surface of the workpiece 500, on the basis of the shape data, the lighting condition, the material information, the camera position information, and the observation state information, and adds the second reflection light L3 to the image of the workpiece 500 observed from the virtual camera 41. Thereby, the gloss and the shade of the image of the workpiece 500 displayed on the display 20 change, the texture of the workpiece 500 approaches the actual environment, and thus the reality of the workpiece 500 can be increased. Thereby, the observer 50 can confirm the presence or absence of the processing failure in the workpiece 500 processed by the processing simulation.

[0105] In a case where there is a problem in the machining program created by the CAM device 200, a workpiece having a desired shape cannot be sometimes manufactured by the instruction code, i.e., the G code, described in the machining program. In addition, the tool of the NC machine tool moves by the working portion (e.g., the rotation axis of the driving portion 302 shown in FIG. 1) of the NC machine tool, but the moving speed, the moving range, the acceleration, and the deceleration of the tool are determined in advance. Therefore, the actual movement of the tool of the NC machine tool does not sometimes follow the movement instruction described in the machining program, and a workpiece having a desired shape cannot be manufactured. ​

[0106] The difference between the workpiece actually machined by the NC machine tool and the workpiece having a desired shape is sometimes difficult to be visually recognized by the user of the NC machine tool. For example, in the machined surface of the workpiece actually machined, a scratch or a defect having a depth and a width of several micrometers and a length of several tens of micrometers occurs as a processing failure.

[0107] Therefore, before the machining by the NC machine tool, trial machining is sometimes performed on a trial workpiece formed of a soft and low-priced material, and thereby a process of confirming whether there is a problem in the machining program is performed. The user of the NC machine tool visually inspects the workpiece after the trial machining, and thereby judges the presence or absence of the processing failure in the workpiece. In a case where it is judged that there is a processing failure, the machining program is corrected.

[0108] ​However, in the trial machining process as described above, time and cost are spent. The time spent in the trial machining process is, for example, several hours. In addition, sometimes the trial machining process is repeatedly performed until a machining program in which no machining defect occurs is created. According to the display control device 10 related to Embodiment 1, as described above, the sense of reality of the workpiece 500 displayed in the display 20 is improved, and the observer 50 easily confirms the presence or absence of a machining defect in the workpiece 500 machined by the machining simulation. Therefore, the trial machining process using the NC machining device is not needed, and productivity can be improved.

[0109] In addition, according to Embodiment 1, the image of the second reflected light L3 calculated by the display control device 10 is additionally displayed in the display 20. Thereby, the displayed image is confirmed in the digital space as a result of the machining simulation, and the observer 50 can share the result with the operator who is far away.

[0110] In addition, according to Embodiment 1, the display image generation section 17 changes the intensity of the second reflected light L3 in accordance with the change in the observation state. Thereby, the sense of reality of the workpiece 501 displayed in the display 20 is improved, and the observer 50 easily confirms the surface properties of the machined surface of the workpiece 501. Thereby, the presence or absence of a machining defect in the workpiece 500 machined by the machining simulation is easily confirmed.

[0111] In addition, according to Embodiment 1, the display control device 10 has the scale information acquisition section 18 that acquires scale information indicating a scale of an image in the display 20, and the display image generation section 17 calculates the second reflected light L3 on the basis of the scale information on the basis of the shape data, the lighting condition, the material information, the camera position information, and the observation state information, and adds the second reflected light L3 to the image of the workpiece 500 observed from the virtual camera 41. Thereby, the image displayed in the display 20 can be changed in accordance with the scale of the image.

[0112] In addition, according to Embodiment 1, when the scale acquired by the scale information acquisition section 18 is a first scale in which the image displayed in the display 20 is enlarged, the microscopic display image Al in which the first reflected light L21 to L25 is added to the image is generated. In addition, when the scale acquired by the scale information acquisition section 18 is a second scale in which the image displayed in the display 20 is displayed at the same size / zoomed out, the macroscopic display image A2 in which the first reflected light L23, L25 and the second reflected light L31, L32, L33 are added to the image is generated. Thereby, the rendering processing time for generating the microscopic display image Al can be shortened compared to the rendering processing time for generating the macroscopic display image A2. The microscopic display image Al can be smoothly displayed in the display 20 in accordance with the direction of the line of sight of the observer 50.

[0113] In addition, according to Embodiment 1, the macro display image A2 is added with the first-order reflected light L23, L25 and L31, L32, L33. Thereby, the reflection characteristics of the macro display image A2 are more complicated than those of the micro display image Al, and thus the macro display image A2 can be made close to the actual environment. Therefore, the observer can easily confirm the presence or absence of processing defects in the processed product processed by the processing simulation.

[0114] In addition, according to Embodiment 1, the camera position information acquisition section 14 acquires the camera position information via the input device 110 operated by the observer 50. Thereby, the display range of the image in the display 20 is changed each time the camera position information is updated, and thus the processed product 500 processed by the processing simulation can be confirmed from the direction of observation by the observer 50. Thereby, the presence or absence of processing defects in the processed product 500 can be more easily confirmed.

[0115] Explanation of Reference Numerals

[0116] 1 processing system, 10 display control device, 10a memory, 10b processor, 11 shape data acquisition section, 12 illumination condition acquisition section, 13 material information acquisition section, 14 camera position information acquisition section, 15 display range information acquisition section, 16 observation state acquisition section, 17 display image generation section, 17a micro display image generation section, 17b macro display image generation section, 18 scale information acquisition section, 19 scale information judgment section, 20 display, 20a display surface, 30 terminal device, 41 virtual camera, 42 virtual light source, 50 observer, 100 processing simulation device, 110 input device, 200 CAM device, 300 NC working machine, 301 ball end mill, L1, L11, L12, L13, L14, L15 incident light, L2 first reflected light, L3 second reflected light, L21, L22, L23, L24, L25 first-order reflected light, L31, L32, L33 second-order reflected light, V virtual space.

Claims

1. A display control device that displays an image of a simulated workpiece on a display unit. The display control device has: A shape data acquisition unit acquires shape data representing the shape of the workpiece. The lighting conditions acquisition unit acquires the lighting conditions when the workpiece is irradiated by an imaginary light source; The material information acquisition unit acquires material information representing the material of the workpiece; A camera position information acquisition unit acquires position information that represents an imaginary viewpoint position that determines the display range of the image in the display unit; An observation state acquisition unit acquires observation state information representing the observation state, which includes at least one of the distance from the display surface of the display unit to the position of the observer's eye and the observer's observation direction relative to the display surface; and The display image generation unit generates an image of the processed object as viewed from the hypothetical viewpoint and provides it to the display unit. The display image generation unit calculates, based on the shape data, the lighting conditions, the material information, and the position information, the reflected light (i.e., the first reflected light) from each position toward the hypothetical viewpoint position, which is the reflected light from each position toward the processing surface of the workpiece irradiated by the light source at each position. The second reflected light is then added to the image of the workpiece viewed from the hypothetical viewpoint position. Correspondingly, the unit performs arbitrary processing on the generated image, either adding the first reflected light (i.e., the first reflected light) as the second reflected light to the image, or adding both the first and second reflected lights as the second reflected light to the image.

2. The display control device according to claim 1, wherein, The device includes an observation state acquisition unit that acquires observation state information representing the observation state, which includes at least one of the distance from the display surface of the display unit to the observer's viewpoint position and the observer's observation direction relative to the display surface. The image generation unit further calculates the second reflected light based on the observation state information.

3. A display control device that displays an image of a simulated workpiece on a display unit. The display control device has: A shape data acquisition unit acquires shape data representing the shape of the workpiece. The lighting conditions acquisition unit acquires the lighting conditions when the workpiece is irradiated by an imaginary light source; The material information acquisition unit acquires material information representing the material of the workpiece; A camera position information acquisition unit acquires position information that represents an imaginary viewpoint position that determines the display range of the image in the display unit; An observation state acquisition unit acquires observation state information representing the observation state, which includes at least one of the distance from the display surface of the display unit to the position of the observer's eye and the observer's observation direction relative to the display surface; and The display image generation unit generates an image of the processed object as viewed from the hypothetical viewpoint and provides it to the display unit. The display image generation unit calculates, based on the lighting conditions and the position information, the second reflected light (i.e., the reflected light from each position toward the hypothetical viewpoint position) of the first reflected light (i.e., the light irradiated by the light source at each position on the processing surface of the workpiece by the light source), and adds the second reflected light to the image of the workpiece observed from the hypothetical viewpoint position. Correspondingly, it performs arbitrary processing on the generated image, either adding the first reflected light (i.e., the first reflected light) as the second reflected light to the image, or adding both the first and second reflected lights as the second reflected light to the image.

4. The display control device according to claim 3, wherein, The device includes an observation state acquisition unit that acquires observation state information representing the observation state, which includes at least one of the distance from the display surface of the display unit to the observer's viewpoint position and the observer's observation direction relative to the display surface. The image generation unit further calculates the second reflected light based on the observation state information.

5. A display control device that displays an image of a hypothetical workpiece processed through processing simulation on a display unit. The display control device has: A shape data acquisition unit acquires shape data representing the shape of the workpiece. The lighting conditions acquisition unit acquires the lighting conditions when the workpiece is irradiated by an imaginary light source; The material information acquisition unit acquires material information representing the material of the workpiece; A camera position information acquisition unit acquires camera position information, which represents the position of an imaginary camera that determines the display range of the image in the display unit; An observation state acquisition unit acquires observation state information representing the observation state, which includes at least one of the distance from the display surface of the display unit to the position of the observer's eye and the direction of the observer's line of sight relative to the display surface; as well as The display image generation unit generates an image of the processed object as observed from the camera and provides it to the display unit. The display image generation unit calculates, based on the shape data, the lighting conditions, the material information, the camera position information, and the observation state information, the reflected light (i.e., the first reflected light) from each position of the workpiece illuminated by the light source toward the observer's eye (i.e., the second reflected light), and adds the second reflected light to the image of the workpiece observed from the camera. Correspondingly, the unit performs arbitrary processing on the generated image, either adding the first reflected light (i.e., the first reflected light) as the second reflected light to the image, or adding both the first and second reflected lights as the second reflected light to the image.

6. The display control device according to claim 5, wherein, The display image generation unit changes the intensity of the second reflected light in accordance with the change in the observation state.

7. The display control device according to claim 5 or 6, wherein, It also includes a scale information acquisition unit, which acquires scale information representing the scale of the image in the display unit. The display image generation unit calculates the second reflected light based on the shape data, the lighting conditions, the material information, the camera position information, the observation state information, and the scale information, and adds the second reflected light to the image of the processed object observed from the camera.

8. The display control device according to claim 7, wherein, The display image generation unit When the scale is the first scale, the first reflected light from the first reflected light is added to the image as the second reflected light. When the scale is a second scale that is greater than the first scale, the first and second reflected rays of the first reflected light are added to the image as the second reflected light.

9. The display control device according to any one of claims 5 to 8, wherein, The camera position information acquisition unit acquires the camera position information via an input device operated by the observer.

10. A processing simulation device, comprising: The display control device as described in any one of claims 1 to 9; and The display unit.

11. A display control method, executed by a display control device that displays an image of a hypothetical workpiece processed through processing simulation on a display unit. The display control method comprises the following steps: Obtain shape data representing the shape of the workpiece; Obtain the illumination conditions when the workpiece is irradiated by an imaginary light source; Obtain material information representing the material of the processed workpiece; Obtain camera position information, which represents the position of an imaginary camera that determines the display range of the image in the display unit; Obtain observation state information, which includes at least one of the distance from the display surface of the display unit to the position of the observer's eye and the direction of the observer's line of sight relative to the display surface; An image of the workpiece as observed from the camera is generated and provided to the display unit. In the step of providing the image to the display unit, based on the shape data, the lighting conditions, the material information, the camera position information, and the observation state information, the reflected light (i.e., the first reflected light) emanating from each position of the workpiece surface illuminated by the light source towards the observer's eye (i.e., the second reflected light) is calculated. The second reflected light is then added to the image of the workpiece observed from the camera. Correspondingly with the generated image, either the first reflected light (i.e., the first reflected light) is added to the image as the second reflected light, or both the first and second reflected lights are added to the image as the second reflected light.

12. A program product in which a computer displays an image of a hypothetical workpiece processed through processing simulation on a display unit. This program product enables the computer to perform the following steps: Obtain shape data representing the shape of the workpiece; Obtain the illumination conditions when the workpiece is irradiated by an imaginary light source; Obtain material information representing the material of the processed workpiece; Obtain camera position information, which represents the position of an imaginary camera that determines the display range of the image in the display unit; Obtain observation state information representing the observation state, the observation state including at least one of the distance from the display surface of the display unit to the position of the observer's eye and the direction of the observer's line of sight relative to the display surface; An image of the workpiece as observed from the camera is generated and provided to the display unit. In the step of providing the image to the display unit, based on the shape data, the lighting conditions, the material information, the camera position information, and the observation state information, the reflected light (i.e., the first reflected light) emanating from each position of the workpiece surface illuminated by the light source towards the observer's eye (i.e., the second reflected light) is calculated. The second reflected light is then added to the image of the workpiece observed from the camera. Correspondingly with the generated image, either the first reflected light (i.e., the first reflected light) is added to the image as the second reflected light, or both the first and second reflected lights are added to the image as the second reflected light.

Images