Display device and computer program

Abstract

Display device (1), comprising: a normal vector extraction unit (12) configured to extract a normal vector of each machined surface constituent based on shape information relating to a machined surface formed by machined surface constituents; a brightness calculation unit (13) configured to calculate the brightness of each machined surface component based on the normal vector; and a display unit (15) configured to graphically represent the machined surface based on the brightness of each machined surface component, wherein The brightness calculation unit (13) calculates adjusted angles by multiplying angles formed by the normal vector with axes of a three-dimensional space by a predetermined adjustment multiplication factor and calculates the brightness of each processed surface component on the basis of the adjusted angles.

Description

Technical field

[0001] The present disclosure relates to a display device and a computer program. State of the art

[0002] A display device that presents a machined surface of a workpiece in three-dimensional computer graphics is known (see, for example, patent document 1). An operator checks the results displayed on such a device and determines the quality of the machined surface based on its irregularities. The quality of the machined surface is determined by the difference in brightness between the polygons that make up the surface. Therefore, the greater the difference in brightness, the easier it is to detect the irregularities and thus determine the quality of the machined surface.

[0003] As in Fig. As shown in Figure 5, according to a typical method based on three-dimensional computer graphics, the brightness of a polygon is determined from the relationship between a direction vector from the polygon towards a light source and a normal vector of the polygon. To increase the brightness difference between the polygons, it is necessary in this case to adjust the position of the light source accordingly with respect to the orientation of the surface being processed. List of cited documents Patent document

[0004] Patent document 1: Japanese unexamined patent application, publication no. 2017-138726.

[0005] DI XIE, Wuyuan [et al.]: 3D surface detail enhancement from a single normal map. In: 2017 IEEE international conference on computer vision, 22-29 October 2017, Venice, Italy. IEEE, 2017. pp. 2344-2352 demonstrates an improvement in 3D surface detail using a single normal map. In 3D reconstruction, the surface details obtained are mainly limited to the visual sensor due to the sampling and quantization involved in the digitization process. The question of how to obtain a fine-grained 3D surface cost-effectively remains a challenge in terms of experience, equipment, and ease of procurement. This work presents a novel framework for improving surfaces reconstructed from normal maps, where assumptions about hardware (e.g., photometric stereo setup) and reflection model (e.g., Lambertian reflection) are not strictly necessary.We propose using a new measure, the angular profile, to derive the hidden microstructure from existing surfaces. Furthermore, the derived results are enhanced through discrete geometry processing (DGP), enabling the achievement of a stable surface structure under selectable enhancement settings. Extensive simulation results demonstrate that the proposed method offers significant improvements over the uniform sharpening method, both in terms of subjective visual evaluation and objective quality metrics. Disclosure of the invention Problems to be solved by the invention

[0006] When inspecting a defect, stripe pattern, or similar feature on a machined surface, it is sometimes necessary to adjust the position of a light source to increase the brightness difference between the polygons representing the defect, stripe pattern, or similar feature. However, adjusting the light source position requires setting numerous parameters and is therefore time-consuming and labor-intensive, placing a significant burden on the operator. Means of solving the tasks

[0007] The invention is defined by the subject matter of the independent claims.

[0008] A display device according to the present disclosure comprises: a normal vector extraction unit configured to extract a normal vector of each machined surface constituent based on shape information relating to a machined surface consisting of machined surface constituents; a brightness calculation unit configured to calculate the brightness of each machined surface constituent based on the normal vector; and a display unit configured to graphically display the machined surface based on the brightness of each machined surface constituent.The brightness calculation unit calculates the adjusted angles by multiplying the angles formed by the normal vector with the axes of a three-dimensional space by a predetermined adjustment multiplication factor, and calculates the brightness of each processed surface component based on the adjusted angles.

[0009] A computer program according to the present disclosure serves to cause a computer to perform operations that include: extracting a normal vector of each machined surface constituent based on shape information relating to a machined surface consisting of machined surface constituents; calculating the brightness of each machined surface constituent based on the normal vector; and graphically representing the machined surface based on the brightness of each machined surface constituent. The brightness calculation includes calculating fitted angles by multiplying the angles that the normal vector forms with the axes of a three-dimensional space by a predetermined fitting multiplication factor and calculating the brightness of each machined surface constituent based on the fitted angles.

[0010] The display device and the computer program of the present disclosure are able to reduce the operator's workload. Brief description of the drawings Fig. Figure 1 is a diagram showing an outline of a display device according to an embodiment of the present disclosure; Fig. 2A is a diagram illustrating a calculation example using a brightness calculation unit, and showing the angle formed by a normal vector of a polygon 1 with axes; Fig. 2B is a diagram illustrating a calculation example using the brightness calculation unit, and showing adjusted angles given by multiplying the angles formed by the normal vector of polygon 1 with the axes by an adjustment multiplication factor ‘level’; Fig. 2C is a diagram illustrating a calculation example using the brightness calculation unit and showing the components of a new vector based on the adjusted angles in Fig. 2B based; Fig. 2D is a diagram that illustrates a calculation example using the brightness calculation unit and shows the new vector that is applied to the set angles in Fig. 2B based; Fig. 2E is a diagram illustrating a calculation example using the brightness calculation unit, and the new vector in Fig. 2D shows the normalized version; Fig. 3A is a diagram illustrating a calculation example using the brightness calculation unit, and showing the angles formed by a normal vector of a polygon 2 with the axes; Fig. 3B is a diagram illustrating a calculation example using the brightness calculation unit, and showing adjusted angles given by multiplying the angles formed by the normal vector of polygon 2 with the axes by an adjustment multiplication factor ‘level’; Fig. 3C is a diagram illustrating a calculation example by the brightness calculation unit and showing the components of a new vector based on the adjusted angles in Fig. 3B based; Fig. 3D is a diagram that illustrates a calculation example using the brightness calculation unit and shows the new vector that is based on the adjusted angles in Fig. 3B based; Fig. 3E is a diagram illustrating a calculation example using the brightness calculation unit, and the new vector in Fig. 3D shows what is normalized; Fig. Figure 4 is a diagram showing an embodiment of a method for calculating brightness according to an embodiment of the present disclosure; Fig. Figure 5 is a diagram illustrating an example of a brightness calculation method from the known state of the art; Fig. Figure 6 is an image displayed by a display device according to an embodiment of the present disclosure; and Fig. 7 is an image displayed by a state-of-the-art display device. Preferred method of carrying out the invention

[0011] An embodiment of the present invention will be described in more detail with reference to the drawings.

[0012] Fig. Figure 1 is a diagram showing the outline of a display device 1 according to an embodiment of the present embodiment. The present embodiment provides a display device 1 and a computer program that eliminate the need to adjust the position of a light source and reduce the workload for an operator.

[0013] The display device 1 consists, for example, of a computer comprising a memory such as a read-only memory (ROM) and a random access memory (RAM), a central processing unit (CPU), and a communication control unit, which are interconnected via a bus. As in Fig. As shown in Figure 1, the display device 1 comprises a storage unit 11, a normal vector extraction unit 12, a brightness calculation unit 13, a multiplication factor adjustment unit 14, and a display unit 15. The functions and operations of these units are implemented through the interaction of the CPU and the memory built into the computer, as well as a control program stored in memory.

[0014] Storage unit 11 stores shape information about a modified surface, which consists of modified surface components. The shape information comprises a multitude of element information pieces relating to polygons or pixels. Each of these components has a vertex of a polygon, a normal vector of a plane containing a polygon, or a normal vector of a plane containing a pixel.

[0015] Based on the shape information about the processed surface, which consists of the surface constituents, the normal vector extraction unit 12 extracts a normal vector for each processed surface constituent. In a case where the shape information does not include a normal vector, the normal vector extraction unit 12 calculates a normal vector from the vertex of the polygon or the pixel contained in the shape information and extracts the normal vector.

[0016] Brightness Calculation Unit 13 calculates the brightness of each processed surface component based on fitted angles, which are determined by multiplying the angles formed by the normal vector with the axes of a three-dimensional space by a predetermined fitting multiplication factor. Specifically, Brightness Calculation Unit 13 calculates a vector in the three-dimensional space based on the fitted angles and calculates the brightness of each processed surface component based on the sum of the three-dimensional spatial components of the vector. For example, Brightness Calculation Unit 13 calculates the brightness of each processed surface component according to the following procedure.

[0017] First, the brightness calculation unit 13 uses an inverse trigonometric function to calculate the angles that a normal vector of a polygon or a normal vector of a pixel forms with the x-axis, y-axis, and z-axis. Next, the brightness calculation unit 13 multiplies each of the calculated angles by a predetermined fitting multiplication factor to calculate fitted angles. Subsequently, the brightness calculation unit 13 calculates a new vector based on the fitted angles, using a trigonometric function. Next, the brightness calculation unit 13 normalizes the new vector and adds the components of the normalized new vector together. Since the sum of the additions is in the range of - (3 1 / 2 ) to 3 1 / 2If the brightness calculation unit 13 is set to 0.0 to 1.0, the conversion formula is expressed as follows: Brightness = ((Sum of additions) + 3 1 / 2 ) / (2 × 3 1 / 2 ).

[0018] The multiplication factor adjustment unit 14 arbitrarily sets the adjustment multiplication factor for the calculation by the brightness calculation unit 13, based on arbitrary information received from the computer. Therefore, the adjustment multiplication factor is changed as needed. A larger adjustment multiplication factor increases the brightness difference, thus enabling the display of an image with greater brightness emphasis.

[0019] The display unit 15 graphically represents the processed surface based on the brightness of the processed surface components.

[0020] Fig. 2A to 2E and Fig. Diagrams 3A to 3E show examples of calculations performed by the brightness calculation unit 13. Here, the calculation is described using the normal vectors of two adjacent polygons 1 and 2 as an example. For simplicity, the Z-axis has been omitted from these diagrams.

[0021] Fig. 2A is a diagram illustrating angles formed by a normal vector of polygon 1 with the axes. Fig. 3A is a diagram illustrating angles formed by a normal vector of polygon 2 with the axes. As in Fig. As shown in Figure 2A, the brightness calculation unit 13 calculates the angles (α1, β1, γ1) formed by the normal vector (x1, y1, z1) of polygon 1 with the x-axis, the y-axis and the z-axis using an inverse trigonometric function, as follows: α1 = arccos (x 1 / 1 ), β1 = arccos (y 1 / 1 ), and γ1 = arccos (z 1 / 1 ). Similarly, the brightness calculation unit 13 calculates, as in Fig. Figure 3A shows, using the inverse trigonometric function, the angles (α2, β2, γ2) formed by the normal vector (x2, y2, z2) of polygon 2 with the x-axis, y-axis and z-axis, as follows: α2 = arccos (x 2 / 1 ), β2 = arccos (y 2 / 1 ), and γ2 = arccos (z 2 / 1 ).

[0022] Fig. 2B is a diagram illustrating the adjusted angles that result from multiplying the angles formed by the normal vector of polygon 1 with the axes by a multiplication factor “level”. Fig. 3B is a diagram illustrating the fitted angles resulting from multiplying the angles formed by the normal vector of polygon 2 with the axes by the

[0023] The multiplication factor "level" results. As in Fig. As shown in 2B, the brightness calculation unit 13 multiplies each of the values ​​shown in Fig. The angles (α1, β1, γ1) calculated in the manner shown in 2A are multiplied by the given adjustment multiplication factor "level" to calculate the adjusted angles (α1', β1', γ1') as follows: α1' = level × α1, β1' = level × β1, and γ1' = level × γ1. Similarly, the brightness calculation unit 13 multiplies as shown in Fig. 3B shows each of the ones in Fig. The angles (α2, β2, γ2) calculated in the manner shown in Figure 3A are used with the given adjustment multiplication factor "level" to calculate the adjusted angles (α2', β2', γ2') as follows: α2' = level × α2, β2' = level × β2, and γ2' = level × γ2. The adjustment multiplication factor "level" is set to, for example, 2 or 5.

[0024] Fig. 2C is a diagram illustrating the components of a new vector based on the adjusted angles in Fig. 2B based. Fig. 3C is a diagram showing the components of a new vector based on the adjusted angles in Fig. 3B based. As in Fig. As shown in Figure 2C, the brightness calculation unit 13 uses a trigonometric function to calculate the components of the new vector (x1', y1', z1') based on the adjusted angles (α1', β1', γ1') as follows: x1' = cos(α1') × 1, y1' = cos(β1') × 1, and z1' = cos(γ1') × 1. Similarly, the

[0025] Brightness calculation unit 13, as in Fig. Figure 3C shows the components of the new vector (x2', y2', z2') based on the adjusted angles (α2', β2', γ2') using the trigonometric function, as follows: x2' = cos (α2') × 1, y2' = cos (β2') × 1, and z2' = cos (γ2') × 1.

[0026] Fig. 2D is a diagram illustrating the new vector that is based on the adjusted angles in Fig. 2B based. Fig. 3D is a diagram illustrating the new vector that is based on the adjusted angles in Fig. 3B based. As in Fig. In 2D representation, the brightness calculation unit 13 determines the new vector based on the components that are located in Fig. The brightness calculation unit is also given as 13, as shown in 2C. Fig. 3D representation, the new vector based on the components that are in Fig. 3C were calculated in the manner shown.

[0027] Fig. 2E is a diagram that shows the new vector in Fig. 2D illustration, which is normalized. Fig. 3E is a diagram that shows the new vector in Fig. 3D, which is normalized, shows. As in Fig. As shown in 2E, the brightness calculation unit 13 normalizes the new vector (x1', y1', z1') and adds the components of the normalized new vector (x1", y1", z1") together. Similarly, the brightness calculation unit 13 normalizes, as shown in Fig. 3E represents the new vector (x2', y2', z2') and adds the components of the normalized new vector (x2", y2", z2") together.

[0028] The brightness calculation unit 13 converts the sum of x1" + y1" + z1" into a brightness range. In a case where the brightness range is set to 0.0 to 1.0, the conversion formula is expressed as follows: Brightness = ((x1" + y1" + z1") + 3 1 / 2 ) / (2 × 3 1 / 2Similarly, the brightness calculation unit 13 converts the sum of x2" + y2" + z2" into a brightness range. In a case where the brightness range is set to 0.0 to 1.0, the conversion formula is expressed as follows: Brightness = ((x2" + y2" + z2") + 3 1 / 2 ) / (2 × 3 1 / 2 ). Fig. Figure 6 is an image displayed by the display device 1 according to the present embodiment. Fig. Figure 7 is an image displayed by a display device from the known prior art. The image from Fig. 6 is displayed with the adjustment multiplication factor "level" described above, which is set to 5. From these figures, it is evident that the image in Fig. 6, which is displayed by the display device 1 according to the present embodiments, enables an operator to check for a defect and a stripe pattern on the machined surface more clearly than the image in Fig. 7, which is displayed by the display device of the known prior art.

[0029] The present embodiment has the following effects.

[0030] The display device 1 according to the present embodiment comprises the normal vector extraction unit 12, which extracts a normal vector of each machined surface component based on shape information relating to a machined surface formed by the machined surface components, the brightness calculation unit 13, which calculates the brightness of each machined surface component based on the normal vector, and the display unit 15, which graphically displays the machined surface based on the brightness of each machined surface component.The brightness calculation unit 13 is configured to calculate the fitted angles by multiplying the angles formed by the normal vector with the axes of a three-dimensional space by a predetermined fitting multiplication factor, and to calculate the brightness of each machined surface component based on the fitted angles.

[0031] Thus, in contrast to the one described in the present embodiment, the display device 1 can be Fig. The 5 conventional methods for calculating brightness shown here calculate the brightness solely on the basis of the normal vector, independent of the light source, as in Fig. Figure 4 illustrates this. Therefore, in the present embodiment, unlike the conventional method for calculating brightness, the need for a corresponding adjustment of the light source's position is eliminated, and the operator's workload can be reduced.

[0032] In particular, the present embodiment enables the operator to inspect a defect, stripe pattern or similar feature of a machined surface more clearly than in the known prior art in the following cases: when a normal vector has only a slight inclination, when a polygon is tiny and a difference in brightness is insufficient, when the light from a light source strikes a step perpendicular to the step, when a light source is present on the angle bisector of an angle formed by adjacent polygons and a difference in brightness is insufficient.

[0033] According to the embodiment of the display device 1, the shape information consists of a plurality of element information relating to polygons or pixels, and each of the plurality of element information has a normal vector of a plane in which the polygon is located, or a normal vector of a plane in which the pixel is located.

[0034] Because of this property, the effect described above can be reliably achieved even when the shape information consists of a multitude of element information relating to polygons or pixels. That is to say, the present disclosure is applicable to any shape information from which a plane can be determined.

[0035] The display device 1 according to the present embodiment further comprises the multiplication factor adjustment unit 14, which sets the adjustment multiplication factor.

[0036] Because of this property, the adjustment multiplication factor can be changed arbitrarily using the multiplication factor adjustment unit 14, making it possible to obtain a display image in which a brightness difference is highlighted.

[0037] According to the display device 1 of the present embodiment, the brightness calculation unit 13 calculates a vector in a three-dimensional space on the basis of the adapted angles and calculates the brightness of each machined surface component on the basis of the sum of the three-dimensional spatial components of the vector.

[0038] This property makes it possible to reliably achieve the effects described above.

[0039] The present embodiment further relates to a computer program according to which the display device 1 described above operates. The computer program causes the computer forming the display device 1 to perform steps that include: a normal vector extraction step to extract a normal vector of each machined surface component based on shape information relating to a machined surface consisting of machined surface components; a brightness calculation step to calculate the brightness of each machined surface component based on the normal vector; and a display step to graphically display the machined surface based on the brightness of each machined surface component.Furthermore, in the brightness calculation step, adjusted angles are calculated by multiplying the angles formed by the normal vector with axes of a three-dimensional space by a predetermined adjustment multiplication factor, and the brightness of each processed surface component is calculated based on the adjusted angles.

[0040] Because of this feature, the computer program of the present embodiment can have the same effects as those described above.

[0041] It should be noted that the present disclosure is not limited to the embodiments described above and that modifications and improvements within any area in which the subject matter of the present disclosure can be achieved fall within the scope of the present disclosure.

[0042] The display device of the present disclosure can be used as a display device for an ordinary external computer. The display device of the present disclosure can, for example, be used as a display unit of a machining simulator. When the display device of the present disclosure is applied to the display unit of the machining simulator, it is possible to accurately evaluate a roughness, a defect, or the like on a machined surface after the machining simulation. Explanation of reference symbols 1 Display device 11 storage unit 12 Normal vector extraction unit 13 Brightness calculation unit 14 Multiplication factor adjustment unit 15 Display unit

Claims

[1] Display device (1), comprising: a normal vector extraction unit (12) configured to extract a normal vector of each machined surface constituent based on shape information relating to a machined surface formed by machined surface constituents; a brightness calculation unit (13) configured to calculate the brightness of each machined surface component based on the normal vector; and a display unit (15) configured to graphically represent the machined surface based on the brightness of each machined surface component, wherein The brightness calculation unit (13) calculates adjusted angles by multiplying angles formed by the normal vector with axes of a three-dimensional space by a predetermined adjustment multiplication factor and calculates the brightness of each processed surface component on the basis of the adjusted angles. [2] Display device (1) according to claim 1, wherein the shape information is composed of a multitude of pieces of element information relating to polygons or pixels, and Each of the multitude of pieces of element information has a normal vector of a plane in which the polygon is located, or a normal vector of a plane in which the pixel is located. [3] Display device (1) according to claim 1 or 2, further comprising a multiplication factor adjustment unit (14) configured to adjust the adjustment multiplication factor. [4] Display device (1) according to one of claims 1 to 3, wherein the brightness calculation unit (13) calculates a vector in three-dimensional space on the basis of the set angles and calculates the brightness of each processed surface component on the basis of the sum of the three-dimensional spatial components of the vector. [5] Computer program that causes a computer to perform operations that include: Extracting a normal vector of each machined surface constituent based on shape information about a machined surface formed by machined surface constituents; Calculating the brightness of each processed surface component based on the normal vector; and graphical representation of the edited surface based on the brightness of each edited surface component, wherein The calculation of brightness includes calculating fitted angles by multiplying angles formed by the normal vector with axes of a three-dimensional space, with a predetermined fitting multiplication factor, and calculating the brightness of each machined surface component based on the fitted angles.

Images