Display control device and control program
The display control device enhances mold defect detection by highlighting defects based on size, position, and color, enabling operators to efficiently locate and address mold issues, thereby improving casting quality.
Patent Information
- Application Number
- JP2021027727
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2020-03-30
- Filing Date
- 2021-02-24
- Publication Date
- 2024-11-13
- Estimated Expiration
- 2041-02-24
AI Technical Summary
Existing techniques fail to provide an easy way for operators to identify and locate defects in molds, particularly when the defects are small or numerous, making it difficult to grasp the nature and location of mold issues.
A display control device that highlights defects in a mold image based on their features, such as size, position, and color, using markers or enlarged views to emphasize the defects, allowing operators to easily recognize their nature and location.
Enables operators to quickly and accurately identify and locate defects in molds, improving the efficiency of defect detection and reducing the risk of defective castings by ensuring only defect-free molds are used for casting.
Smart Images

Figure 0007581954000001 
Figure 0007581954000002 
Figure 0007581954000003
Abstract
Description
[Technical field]
[0001] The present invention relates to a display control device and a control program. [Background technology]
[0002] In casting, a technique for inspecting mold defects has been proposed. For example, Patent Document 1 describes evaluating whether the actual situation is acceptable by detecting the expected gap width between adjacent sand mold parts, the expansion of the mold, and the dimensions of the mold. In addition, a technique for inspecting defects in manufactured castings has also been proposed. Patent Document 2 describes calculating the position of an abnormal ingot from information on the molten metal before it solidifies in the mold and transmitting it to the subsequent consecutive process. Patent Document 3 describes displaying the name of the product during the previous process of casting, the name of the product during mold removal, and images related to its shape on a display means installed in a post-processing process in which gate cutting and the like are performed. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Special Publication No. 2018-520009 [Patent Document 2] JP 2013-43185 A [Patent Document 3] Japanese Patent Application Publication No. 05-169244 Summary of the Invention [Problem to be solved by the invention]
[0004] In the techniques described in Patent Documents 1 to 3, there were cases where the worker could not easily grasp which part of the mold had a defect. For example, when the detected out-of-date part of the mold was small, the image displaying the detected out-of-date part was also small, so there were cases where the worker could not at a glance grasp which part was out-of-date.
[0005] One aspect of the present invention aims to provide a technique that enables workers and others to easily identify defects in a mold. [Means for solving the problem]
[0006] In order to solve the above problems, a display control device according to aspect 1 of the present invention is characterized in that it includes a controller, and the controller executes an identification process for identifying features of each defect contained in a mold by referring to an image of the mold, and a display process for highlighting the defects contained in the mold in a manner corresponding to the features of the defects identified in the identification process and displaying the image on a display.
[0007] According to the above configuration, when the display control device displays an image of the mold on the display, the image displays an image in which defects in the mold are emphasized according to a method based on the feature amount of the defect. Therefore, the worker can easily understand what kind of defect is present in the mold from the image displayed on the display.
[0008] A display control device according to aspect 2 of the present invention is such that, in aspect 1, the feature of each defect identified in the identification process includes at least the size of the defect, and the controller, in the display process, may emphasize the defect by superimposing a defect graphic indicating the defect on the image and by superimposing a marker indicating a defect whose size is equal to or smaller than a threshold value on the image.
[0009] According to the above configuration, even if the size of the defect is small, the worker can easily grasp what type of defect is present in the casting by using the marker that indicates the defect on the displayed image.
[0010] A display control device according to aspect 3 of the present invention is such that, in aspect 1, the features of each defect identified in the identification process include at least the size of the defect and the position of the defect, and the controller, in the display process, may superimpose a defect graphic indicating the defect onto the image, and may also emphasize a defect group consisting of defects that are adjacent to each other and have sizes equal to or smaller than a threshold value by superimposing a marker indicating the defect group onto the image.
[0011] According to the above configuration, even if the mold contains small defects, the worker can easily grasp the location where the small defects are concentrated by using the marker that indicates the group of defects.
[0012] A display control device according to aspect 4 of the present invention is, in aspect 2 or 3, wherein the controller, in the display processing, may change the color, shape, position, size, or blinking pattern of the marker depending on the characteristic parameters of the defect indicated by the marker or each defect included in a group of defects.
[0013] According to the above configuration, an operator can easily grasp defects in the mold by the color, shape, position, size, or blinking pattern of the displayed marker.
[0014] A display control device according to aspect 5 of the present invention is such that, in aspect 1, the feature of each defect identified in the identification process includes at least the size of the defect, and the controller, in the display process, may superimpose a defect graphic corresponding to the size of the defect onto the image for a defect whose size is greater than a threshold, and may emphasize the defect by superimposing an enlarged image of an area including a defect whose size is equal to or smaller than the threshold onto the image.
[0015] According to the above configuration, even if the size of the defect is small, the worker can easily understand what type of defect is contained in the mold by viewing the enlarged image of the area including the defect.
[0016] A display control device according to aspect 6 of the present invention is such that, in aspect 1, the features of each defect identified in the identification process include at least the size and position of the defect, and the controller, in the display process, may superimpose a defect figure corresponding to the size of the defect onto the image for a defect whose size is greater than a threshold, and emphasize the defect group by superimposing an enlarged image of an area including a defect group consisting of adjacent defects whose sizes are equal to or smaller than a threshold onto the image.
[0017] According to the above configuration, even if the mold contains small defects, the worker can easily grasp the location where the small defects are concentrated by viewing the enlarged image of the area including the defect group.
[0018] A display control device according to aspect 7 of the present invention is, in aspect 5 or 6, wherein the controller changes the color, shape, position, size, or blinking pattern of the enlarged image according to a characteristic amount of a defect included in the enlarged image or of each defect included in a group of defects.
[0019] According to the above configuration, an operator can easily grasp defects in the mold based on the color, shape, position, size, or blinking pattern of the displayed enlarged image.
[0020] A display control device according to aspect 8 of the present invention is any of aspects 1 to 7, wherein the controller includes at least one processor that executes each of the processes according to a predetermined program, and at least one memory that stores the program.
[0021] According to the above configuration, when the display control device displays an image of the mold on the display, the image displays an image in which defects in the mold are emphasized according to a method based on the feature amount of the defect. Therefore, the worker can easily understand what kind of defect is present in the mold from the image displayed on the display.
[0022] A control program according to a ninth aspect of the present invention is a control program for controlling the display control device according to any one of the first to eighth aspects, and is characterized in that the control program causes the controller to execute each of the processes.
[0023] The present invention also includes a control program according to the ninth aspect and a computer-readable recording medium having the same recorded thereon. Effect of the Invention
[0024] According to one aspect of the present invention, it is easy for workers to identify defects in a mold. [Brief description of the drawings]
[0025] [Figure 1] 1 is a configuration diagram that shows a casting system according to a first embodiment of the present invention. [Diagram 2] FIG. 1 is a block diagram illustrating a schematic configuration of a display control device 10 according to a first embodiment of the present invention. [Diagram 3] FIG. 4 is a diagram illustrating an example of the contents of a reference image table according to the first embodiment of the present invention. [Figure 4] FIG. 2 is a diagram illustrating a reference image according to the first embodiment of the present invention. [Diagram 5] FIG. 4 is a diagram illustrating an example of the contents of a test result table according to the first embodiment of the present invention. [Figure 6] 4 is a diagram illustrating an example of the contents of a mold management table according to the first embodiment of the present invention. FIG. [Figure 7] FIG. 2 is a process diagram showing a manufacturing process of a casting using the casting system according to the first embodiment of the present invention. [Figure 8] 5 is a flowchart illustrating a flow of display processing of an inspection result by the display control device and the line controller according to the first embodiment of the present invention. [Figure 9] FIG. 11 is a diagram illustrating an example of a screen displayed on a display. [Figure 10] FIG. 11 is a diagram illustrating an example of a screen displayed on a display. [Figure 11] FIG. 11 is a diagram illustrating an example of a screen displayed on a display. [Figure 12] FIG. 11 is a diagram illustrating an example of a screen displayed on a display. [Figure 13] FIG. 11 is a diagram illustrating an example of a screen displayed on a display. [Figure 14] 4 is a flowchart illustrating a flow of processing performed by a line controller according to the first embodiment of the present invention. [Figure 15] FIG. 11 is a diagram illustrating an example of a screen displayed on a display. [Figure 16] FIG. 13 is a diagram showing a displayed rectangular shape and the actual size of a defect. [Figure 17] FIG. 11 is a diagram illustrating an example of a screen displayed on a display. [Figure 18] FIG. 11 is a diagram showing a schematic configuration of a display control system according to a fourth embodiment of the present invention. [Figure 19] FIG. 11 is a diagram showing a schematic configuration of a casting system according to a fifth embodiment of the present invention. [Figure 20] FIG. 11 is a diagram showing a schematic configuration of a casting system according to a sixth embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0026] [Embodiment 1] 1 is a schematic diagram of a casting system 1 including a display control device according to one embodiment of the present invention. The casting system 1 is a system that produces castings by pouring molten metal into multiple molds 2 transported along a transport path. The casting system 1 includes a display control device 10, an inspection device 20, an input / output device 30, a molding machine 40, a line controller 50, a pouring machine 60, a transport device 70, and a mold matching device 110.
[0027] The display control device 10 is a device that displays the results of inspection of defects in the mold 2 during casting on a display 31. The display control device 10 is, for example, a laptop or desktop personal computer. The display control device 10 may also be a smartphone or tablet terminal carried by an operator.
[0028] The inspection device 20 is a device that inspects the molds 2 on the conveying path. The inspection device 20 is equipped with a sensor 21 that captures an image of each of the multiple molds 2 conveyed along the conveying path. The sensor 21 is, for example, a camera. The sensor 21 captures an image of the product surface (cavity surface) of the flaskless mold before the upper and lower molds conveyed along the conveying path are framed together.
[0029] The display control device 10 compares the captured image (hereinafter referred to as the "captured image") with the reference image to inspect the mold for defects and accumulates the inspection results in an inspection result table. The upper and lower molds are transported alternately to the core setting area.
[0030] FIG. 2 is a block diagram showing a schematic configuration of the display control device 10. The display control device 10 includes a controller 106. The controller 106 includes a processor 101, a main memory 102, an auxiliary memory 103, an input interface 104, and an output interface 105. The processor 101 is a processor that controls the display control device 10, and is, for example, a microprocessor, a digital signal processor, a microcontroller, or a combination of these. The main memory 102 and the auxiliary memory 103 (an example of a memory) are, for example, semiconductor random access memories (RAMs). The main memory 102 and the auxiliary memory 103 may be integrated (physically the same memory) by distinguishing the same memory by area and / or address. The auxiliary memory 103 stores a program for causing the processor 101 to execute the operation of the display control device 10. The processor 101 loads the control program stored in the auxiliary memory 103 onto the main memory 102, and executes each command included in the loaded control program.
[0031] The main memory 102 mainly stores applications / software for determining whether a mold is out of date. The auxiliary memory 103 stores reference image data to be referenced when inspecting the mold 2, input captured images, display object data, and various other data. In this embodiment, the auxiliary memory 103 stores a reference image table and an inspection result table. The reference image table is a table in which reference images used when inspecting the mold 2 are stored for each model. The inspection result table is a table in which the results of the defect inspection of the mold 2 are stored in association with identification information that identifies the mold 2.
[0032] The input interface 104 acquires a captured image from the inspection device 20. The acquired captured image is stored in the auxiliary memory 103 in association with identification information for identifying the mold 2. The output interface 105 outputs data representing the image to the display 31. Note that, although one input interface 104 and one output interface 105 are illustrated in FIG. 2, the display control device 10 may include a plurality of input interfaces and / or a plurality of output interfaces. In this example, the processor 101 reads out and executes a control program stored in the auxiliary memory 103, thereby realizing the identification unit 11 and display control unit 12 shown in FIG. 2.
[0033] FIG. 3 is a diagram illustrating the contents of the reference image table. In the example of FIG. 3, the reference image table stores the items of "pattern code" and "reference image folder No." in association with each other. Among these items, the "pattern code" item stores identification information (ID) for identifying a model. The pattern code corresponds to a model used for a certain molding, that is, a casting mold to be molded using that model. For example, "10" is the ID of a lower mold to be molded with a certain model, and "11" is the ID of an upper mold to be matched with that lower mold. In other words, the pattern code distinguishes between an upper mold and a lower mold made with a certain model. Therefore, when molding is performed using the same model, the IDs of the upper mold and the lower mold are alternately consecutive, such as the mold IDs "10" and "11" that flow through the molding line (see FIG. 5).
[0034] The item "Reference Image Folder No." stores information indicating the storage location of the data of the reference image corresponding to the model. The items included in the reference image table are not limited to those described above, and other items may be included in the reference image table. The reference image is image data of the mold 2 photographed from above when the mold 2 is molded without defects. The defects of the mold 2 to be molded are confirmed by comparing this reference image with the captured image. When the pattern code of molding based on a certain model is "10" (lower mold), the display control device 10 judges the defect by comparing it with the reference image with "Reference Image Folder No." "S10". Since the mold 2 with the pattern code "11" (upper mold) is conveyed next, the display control device 10 judges the defect by comparing the captured image with the reference image stored in the reference image folder with "Reference Image Folder No." "S11". The reference image table in FIG. 3 has a data structure for judging defects by such image comparison.
[0035] 4 is a diagram illustrating an example of the reference image G0. The reference image G0 is prepared in advance and stored in the auxiliary memory 103. The reference image G0 is, for example, an image of a defect-free mold 2 captured by the inspection device 20.
[0036] FIG. 5 is a diagram illustrating the contents of an inspection result table. In the example of FIG. 5, the inspection result table stores the items "mold ID," "pattern code," "inspection date and time," and "inspection result" in association with each other. Of these items, the "mold ID" item stores identification information that identifies the mold 2. The ID stored in the "pattern code" item is the same as the ID stored in the "pattern code" of the reference image table described above. The "inspection date and time" item stores information indicating the date and time when the defect inspection was performed. The "inspection result" item stores information indicating the result of the defect inspection.
[0037] The "inspection result" item includes the items "judgment" and "inspection result image folder No." The "judgment" item stores information indicating the judgment result of the defect inspection. The defect inspection judgment is performed by comparing the captured image with a reference image stored in the auxiliary memory 103, and is executed by the program of the display control device 10. As described above, the data table of FIG. 5 is stored in the auxiliary memory 103 of the display control device 10. The information indicating the judgment result is, for example, "OK," "NG," or "Fail." "OK" indicates that the mold 2 is normal. "NG" indicates that the mold 2 is abnormal (has a defect). "Fail" indicates that the inspection itself has failed. The "inspection result image folder No." item stores information indicating the storage location of an image showing the result of the defect inspection of the mold 2 (hereinafter referred to as "inspection result image"). In this way, the auxiliary memory 103 of the display control device 10 stores the inspection result of the mold 2 in association with the identification information for identifying the mold 2. The items included in the inspection result table are not limited to those described above, and other items may be included in the inspection result table. For example, the inspection result may include data representing defects in the mold. The data representing the defects in the mold is, for example, data indicating at least one of the position, shape, and size of the defects.
[0038] Returning to the description of FIG. 2, the display control device 10 includes an identifying unit 11 and a display control unit 12. The identifying unit 11 executes an identifying process for identifying the size of each defect contained in the mold 2, which is identified by referring to a captured image of the mold 2. The captured images are sequentially input to an input interface 104 and stored in an auxiliary memory 103 by the processor 101. The identifying unit 11 identifies the size of the defect and generates a superimposed image according to the size by comparing the captured image with a reference image stored in the auxiliary memory 103. The generated superimposed image is displayed on the display 31. Such a program is stored in the auxiliary memory 103, and the processor 101 performs a series of image processing according to the program in the auxiliary memory 103. The size of the defect is, for example, the area of the defective part when viewed from a predetermined direction (for example, the top surface of the mold 2), the length of the defective part in the longitudinal direction or the transverse direction, or the sum of the longitudinal length and the transverse length.
[0039] The display control unit 12 executes a display process in which the captured image is displayed on the display 31 with defects in the mold highlighted in a manner according to the size of the defect identified in the identification process. The identification unit 11 compares the captured image with a reference image, identifies the defective portion according to the comparison result, identifies the resulting size of the defective portion in relation to a threshold value, determines an object to be superimposed on the image according to the result, generates a composite image in which the object is superimposed on the captured image, and temporarily stores the generated composite image in memory (in a state waiting to be read). This composite image waiting to be read is displayed on the display 31 by a trigger of the line controller 50 at the time to be displayed (specifically, when the mold for which the image is to be displayed arrives at the core work area).
[0040] Displaying in a manner according to the size of the defect means, for example, displaying the appearance of an image representing a defect (hereinafter referred to as a "defect image") differently according to the size of each defect. The defect image is an image representing a defect that is displayed by being superimposed on the captured image. The defect image is, for example, a figure corresponding to the size of the defect contained in the mold 2 (hereinafter referred to as a "defect figure"), or a marker indicating the defect. The defect figure is, for example, a rectangular figure, an ellipse, or a circular figure. The marker is an image for making the defect contained in the mold 2 stand out in the captured image, and is, for example, a frame image surrounding the defect, a balloon image indicating the defective part, or an arrow image indicating the defective part. The defect figure and the marker are examples of a defect image representing a defect. The appearance of the defect image includes, for example, the number of images included in the defect image, the shape, color, position, size, or blinking pattern of the image.
[0041] The display control unit 12 may perform control such that defects whose size satisfies a predetermined condition are displayed on the captured image by a first method, while other defects are displayed on the captured image by a second method. More specifically, for example, the display control unit 12 performs control such that defects whose size is larger than a threshold are displayed on the captured image by a first method, while defects whose size is equal to or smaller than the threshold are displayed on the captured image by a second method. The first method is, for example, a method of displaying a defect figure representing the position and size of each defect, and the second method is, for example, a method of displaying a marker pointing to the defect in addition to displaying a defect figure representing the position and size of each defect.
[0042] According to the above configuration, when display control device 10 displays an image of a mold on display 31, the image displays defects in the mold in an enhanced manner according to the size of the defects. Therefore, the worker can easily understand what type of defects are present in the mold from the screen displayed on display 31.
[0043] In this embodiment, the inspection device 20 and the display control device 10 are described as separate devices, but the inspection device 20 and the display control device 10 may be configured as an integrated device. That is, the inspection device 20 may have a function related to the display control device 10. The above-mentioned display control device 10 may be realized by a plurality of separate devices working together. For example, a first device including the identification unit 11 and a second device including the display control unit 12 may be configured as separate devices.
[0044] Returning to the description of FIG. 1, the molding machine 40 is a device for manufacturing the mold 2. The molding machine 40 alternately molds the upper and lower dies, and the transport device 70 transports the upper and lower dies alternately. The molding machine 40 receives information on the mold 2 (hereinafter referred to as "mold information") from the line controller 50, and manufactures the mold 2 indicated by the pattern code included in the received mold information. The pattern code is information that uniquely indicates a molding pattern. The molding machine 40 puts sand into a molding flask (not shown) set together with a model (not shown), and pressurizes and hardens the sand in the flask. The molding machine 40 molds the mold 2 by removing the model from the hardened sand. The molding machine 40 transmits mold feed information to the line controller 50 every time it molds the mold 2. Every time it receives mold feed information from the molding machine 40, the line controller 50 generates mold information, which will be described later, and registers the generated mold information in a mold management table.
[0045] The input / output device 30 is a device for an operator to perform various operations. The input / output device 30 includes an operation unit (not shown) operated by an operator, and a display 31 that displays the inspection results of the mold 2. In addition to the display 31, the input / output device 30 is also provided with an input means (e.g., an OK / NG button, an OK / NG button displayed on a display / touch panel, etc.) that allows an operator at the core setting area to visually check the image inspection results displayed on the display 31 and determine whether the defect is serious enough to stop pouring, or whether pouring is OK based on the operator's visual and experience, even if the defect is judged to be a defect based on the image judgment, and to indicate whether pouring is OK or not, or an input device that inputs OK / NG by voice. In the example of FIG. 1, the input / output device 30 is installed at the core setting area A1.
[0046] The display 31 is, for example, a liquid crystal display, and displays a screen in accordance with data supplied from the display control device 10. The display 31 may be, for example, a display device installed at a core setting site of the mold 2, or may be, for example, a liquid crystal display included in a smartphone or tablet terminal carried by a worker. The display 31 may also be a wearable computer such as smart glasses. Note that, although the example in FIG. 1 illustrates a case in which the display control device 10 and the display 31 are separate devices, the display control device 10 may also be configured to include the display 31.
[0047] The line controller 50 is a controller that performs overall control of the casting system 1. In this embodiment, the line controller 50 particularly controls the molding machine 40, the pouring machine 60, and the transport device 70. The positions of the molds 2 flowing through the line are collectively managed by the line controller 50.
[0048] The pouring machine 60 is a device that pours molten metal into the mold 2. The pouring machine 60 pours (pourings) molten metal into the mold 2 located in the pouring area in accordance with a control signal transmitted from the line controller 50. The pouring machine 60 determines whether or not pouring is possible in accordance with the control signal received from the line controller 50, and does not pour molten metal into the mold 2 if pouring is not possible.
[0049] The transport device 70 is a device that transports the molds 2 from the molding machine 40 to the pouring machine 60. The transport device 70 has, for example, a roller conveyor (not shown) or rails (not shown), and transports a plurality of molds 2 in sequence along a transport path on the roller conveyor or rail. The transport device 70 transports the molds 2 in accordance with a control signal transmitted from the line controller 50.
[0050] A core setting station A1 is provided between the inspection device 20 and the pouring machine 60. Workers are stationed at the core setting station A1 and perform the task of setting cores in the mold 2.
[0051] The casting molds (upper and lower dies) that have passed through the core setting area A1 are aligned before pouring by a die alignment device 110 that aligns the upper and lower dies. For example, the upper and lower dies may be aligned by lifting the upper die, inverting it, and aligning it with the lower die.
[0052] The aligned upper and lower forms are transported to the pouring area by the transport device 70. When the aligned upper and lower forms enter the pouring area, the line controller 50 judges whether pouring can be performed or not based on a mold management table described below before pouring. If either the upper or lower form is visually judged to be NG, the pouring machine 60 is controlled based on a signal from the line controller 50 so that pouring is not performed.
[0053] In this embodiment, the molding machine 40 molds the upper and lower dies alternately, but the molding method is not limited to this. The molding machine 40 may mold the upper and lower dies at once, and the molds 2 may be transported two at a time (i.e., the upper and lower dies are transported as a set). In this case, two molding machines 40 and two inspection devices 20 are provided. The transport device 70 transports the molds 2 two at a time.
[0054] In this case, the upper and lower dies are photographed at the same time, and the two images are compared with the reference image and the inspection results of the upper and lower frames are displayed on the display 31. The worker in charge of the core looks at the two images and judges whether or not it is possible to pour molten metal.
[0055] The line controller 50 is provided with a mold management table that manages mold information. The mold management table is stored, for example, in an auxiliary memory of the line controller 50. The mold information is information about the mold 2, and includes, for example, identification information for identifying the mold 2 and position information indicating the position of the mold 2 on the transport path. That is, the mold management table stores the identification information of the mold 2 in association with the position information of the mold 2. FIG. 6 is a diagram illustrating the contents of the mold management table. The mold management table stores mold information in which each item, such as "mold ID", "pattern code", "position", and "mold inspection result", is associated with each other. Among these items, the "mold ID" item stores identification information for identifying the mold 2. The "pattern code" item stores identification information for identifying a model (molding pattern) used to manufacture the mold 2 identified by the corresponding mold ID.
[0056] The "position" item stores information indicating the position of the mold 2 identified by the corresponding mold ID on the transport path (hereinafter referred to as "position information"). In this embodiment, positions P1 to P19 are set as the positions of the mold 2 on the transport path. This position information P is incremented sequentially from P1 to P19 as one mold 2 is molded by the molding machine 40 and one mold 2 is transported. Position P1 is located at the most upstream position in the transport direction of the transport device 70, and position information is assigned as positions P2, P3, ... downstream. Position P1 is the position where molding is performed by the molding machine 40. Positions P2 to P4 are positions between the molding machine 40 and the inspection device 20. Position P5 is the position where photography is performed by the inspection device 20. Positions P6 to P17 are positions between the inspection device 20 and the pouring machine 60. Position P9 is a position in front of the display 31. Position P18 is a position where pouring is performed by the pouring machine 60. Position P19 is a position where the flask containing the poured mold 2 is removed.
[0057] The transport device 70 moves the multiple molds 2 sequentially on the transport path, and outputs a signal indicating that the movement is complete each time a mold 2 is moved (hereinafter referred to as a "flask transfer completion signal"). The line controller 50 updates the position information associated with the identification information of the mold 2 each time the multiple molds 2 are moved on the transport path. In this embodiment, each time the line controller 50 receives a flask transfer completion signal from the transport device 70, it advances the "position information" included in the mold information stored in the mold management table by one and adds the new mold information to the mold management table. The added mold information has position information indicating position P1 stored in the "position" field. When the flask at position P19 is transferred to the flask, it is removed from the casting system 1.
[0058] That is, the line controller 50 generates new mold information when a mold 2 is molded. Also, when molding of a mold 2 is completed and the mold 2 is discharged, the transport device 70 moves one mold 2, and all the molds 2 on the other lines also move by one mold, and the position information (P1, P2, ...PN) of each mold 2 is sequentially incremented. The incremented position information is stored in the mold information table of the line controller 50. The line controller 50 knows where each mold 2 is located on the line based on the position information stored in the mold management table.
[0059] The "Mold inspection results" item includes the items "Judgment" and "Pouring possible or not." The "Judgment" item stores information indicating the judgment result of the defect inspection. The information stored in the "Judgment" item is the same as the information stored in the "Judgment" item of the inspection results table of the display control device 10.
[0060] The "Pouring Possible or Unpossible" item stores information indicating whether or not pouring is to be performed (hereinafter referred to as "Pouring Possible or Unpossible Information"). In this embodiment, the worker who sets the core visually checks the inspection results displayed on the display 31 to determine whether pouring is possible for the mold 2. The worker determines whether pouring is possible by visually checking the inspection results displayed on the display 31 to see whether defects will occur in the casting to be cast by pouring molten metal into the mold 2. The worker inputs the judgment result using the input / output device 30. The input / output device 30 transmits the pouring possible or unpossible information to the line controller 50 in response to the operation of the worker. The line controller 50 stores the pouring possible or unpossible information received from the input / output device 30 in the "Pouring Possible or Unpossible" item of the mold management table. The line controller 50 transmits a control signal to the pouring machine 60 according to the information stored in the "Pouring Possible or Unpossible" item of the mold management table. The items included in the mold management table are not limited to those described above, and other items may be included in the mold management table.
[0061] (operation) 7 is a process diagram showing the steps of manufacturing a casting in the casting system 1. In the molding process S01, the line controller 50 transmits a control signal to the molding machine 40 to instruct molding, and mold information of a position P. The molding machine 40 manufactures a mold 2 of a type indicated by a pattern code included in the mold information received from the line controller 50.
[0062] In the transport step S02, the line controller 50 transmits a control signal (hereinafter referred to as a "transport instruction signal") to the transport device 70 to instruct the transport device 70 to transport the mold 2 by one pitch. The transport device 70 controls the transport of the mold 2 on the transport path by one pitch each time the transport device 70 receives a transport instruction signal from the line controller 50. When the transport of the mold 2 is completed, the transport device 70 transmits a frame transfer completion signal to the line controller 50. The line controller 50 updates the position information included in the mold information of the mold 2 on the transport path each time the line controller 50 receives a frame transfer completion signal from the transport device 70. The transport device 70 moves the mold 2 on the transport path by one pitch, and this movement is repeated, so that the mold 2 located at the molding machine 40 moves to the inspection device 20.
[0063] In the inspection step S03, the sensor 21 of the inspection device 20 captures (images) the mold 2 formed in a molding flask located in the inspection area (position P5). The image captured by the sensor 21 is referenced in a specification process that identifies the size of defects in the mold 2. In this embodiment, the sensor 21 captures an image of the mold 2 from above the mold 2 that has moved to position P5. The imaging range of the sensor 21 is set in advance so that at least the surface (the entire upper surface) of the mold 2 at position P5 is imaged. The display control device 10 inspects the mold 2 using a pattern code included in the mold information of the mold 2 at position P5 and the generated imaging data.
[0064] The mold 2 is inspected, for example, as follows: The display control device 10 generates a difference image that represents the difference between the image captured by the sensor 21 and a reference image that has been registered in advance, performs particle analysis on the generated difference image, and detects blobs in the difference image, thereby identifying defective portions.
[0065] The display control device 10 stores the inspection results in its own auxiliary memory 103. The inspection results include, for example, image data representing the identified defective portion. This storage process is repeated, and the inspection results of multiple molds 2 are accumulated in the auxiliary memory 103.
[0066] In the transport step S04, the line controller 50 performs the same process as in the transport step S02, and transports the mold 2 on the transport path one pitch at a time. The transport device 70 moves the mold 2 on the transport path one pitch at a time, and this movement is repeated, so that the mold 2 located at the position of the inspection device 20 moves to the core setting site A1.
[0067] In the core setting process S05, the display control device 10 causes the display 31 to display the inspection results of the mold 2 formed in the molding flask located at position P9. The display 31 continues to display the inspection results while the mold 2 is stopped at the core setting site A1. A worker at the core setting site A1 determines whether or not to set a core in the mold 2 based on the inspection results of the mold 2 displayed on the display 31. For example, the worker sets a core in a mold 2 whose inspection results are normal, and does not set a core in a mold 2 whose inspection results are abnormal. In addition to this core setting operation, the worker performs an operation to determine whether or not to pour molten metal, i.e., OK if the worker visually determines that the mold is normal, and NG if the worker visually determines that the mold is abnormal.
[0068] In the transport step S06, the line controller 50 performs the same process as in the transport step S02, and transports the mold 2 on the transport path one pitch at a time. The transport device 70 moves the mold 2 on the transport path one pitch at a time, and this movement is repeated, so that the mold 2 at the core setting site A1 moves to the position of the pouring machine 60.
[0069] In the pouring process S07, the line controller 50 transmits a control signal instructing pouring and the mold information to the pouring machine 60. The pouring machine 60 pours molten metal based on the pattern code included in the mold information in accordance with the control signal received from the line controller 50. At this time, if the inspection result of the mold 2 is normal, the line controller 50 transmits a control signal to the pouring machine 60 instructing it to pour molten metal into the mold 2, and if the inspection result is abnormal, the line controller 50 transmits a control signal to the pouring machine 60 instructing it not to pour molten metal into the mold 2.
[0070] In the transport step S08, the line controller 50 performs the same process as in the transport step S02, and transports the mold 2 on the transport path one pitch at a time. The transport device 70 moves the mold 2 on the transport path one pitch at a time, and this movement is repeated, so that the mold into which molten metal has been poured at the position of the pouring machine 60 is carried out from the casting system 1.
[0071] As described above, in the casting system 1, the molding machine 40 manufactures the molds 2, and the inspection device 20 inspects the molds 2. Then, a core is set in the molds 2 that are inspected normally, and then the pouring machine 60 pours molten metal into the molds 2 with the cores set in them. In addition, in the casting system 1, a plurality of molds 2 are transported in sequence to positions P1 to P19 by the transport device 70. That is, the molding process S01 for one mold 2, the inspection process S03 for another mold 2, the core setting process S05 for yet another mold 2, and the molten metal pouring process S07 for yet another mold 2 are carried out in parallel.
[0072] Next, the display processing of defects in the mold 2 performed by the display control device 10 and the line controller 50 will be described with reference to the drawings. Fig. 8 is a flowchart illustrating the flow of the display processing of defects performed by the display control device 10 and the line controller 50. Note that some steps may be performed in parallel or in a different order.
[0073] In step S101, the identification unit 11 compares the captured image of the mold 2 taken by the inspection device 20 with a reference image to identify the size of each defect contained in the mold 2. The identification unit 11 generates an inspection result image in which a marker corresponding to the size of the identified defect is superimposed on the captured image, and stores the image in an inspection result table.
[0074] In this embodiment, the line controller 50 grasps the identification information of the mold 2 in front of the worker at the core setting site A1 in relation to its position. In order to display an image of the inspection result of the mold 2 in front of the worker at the core setting site A1 on the display 31 at the core setting site A1, the line controller 50 transmits the identification information of the mold 2 to the display control device 10 so as to read out the inspection result image of the mold 2 in front of the worker at the core setting site A1.
[0075] In step S102, the line controller 50 identifies the mold 2 to be displayed. For example, the line controller 50 identifies the mold 2 located at a specific position. The specific position is, for example, a position corresponding to the core setting site A1. Note that the method of identifying the mold 2 to be displayed is not limited to this. The line controller 50 transmits identification information of the identified mold 2 to the display control device 10.
[0076] The display control device 10 receives the identification information from the line controller 50. The identifying unit 11 of the display control device 10 identifies the mold 2 corresponding to the received identification information as the mold 2 to be displayed.
[0077] In step S103, the identifying unit 11 reads out an inspection result image (a synthesized image for display) of the identified mold 2 from the auxiliary memory 103. In this embodiment, the display control device 10 reads out the inspection result image (a synthesized image in which the captured image is compared with a reference image and an object display is superimposed on the obsolete portion of the captured image based on the difference) stored in the auxiliary memory 103 based on the identification information from the line controller 50, and sends the image data for display to the input / output device 30. The input / output device 30 displays the inspection result image on the display 31.
[0078] In step S104, the display control unit 12 displays the inspection result image on the display 31, thereby highlighting each defect contained in the mold 2 in a manner according to the size of the defect identified by the identification unit 11. Note that the display 31 may display inspection result images of a plurality of molds 2. An example of a manner according to the size of the defect is a display method in which the number, color, shape, position, size, or blinking pattern of the defect images is varied according to the size of the defect. In this embodiment, the display control unit 12 displays a defect figure corresponding to the size of the defect contained in the mold 2 at a position corresponding to the defect in the captured image of the mold 2. The defect figure indicates at what position and how large the defect was detected.
[0079] In this embodiment, the display control unit 12 changes the display method of the defect image (defect graphic, marker, etc.) depending on whether the size of the defect portion is equal to or smaller than a threshold value. More specifically, the display control unit 12 superimposes a defect graphic representing the defect on the captured image, and also superimposes a marker indicating a defect whose size is equal to or smaller than a threshold value on the captured image, thereby emphasizing the defect.
[0080] 9 to 12 are diagrams illustrating screens G12 to G15 displayed on the display 31. In the example of Fig. 9, the display control unit 12 displays rectangular figures f21 and f22 corresponding to the size of a defect contained in the mold 2 at the position of each defect. Furthermore, for a defect whose size is equal to or smaller than a threshold, the display control unit 12 displays a marker f23 which is a circular figure surrounding the defect.
[0081] 10, the display control unit 12 displays rectangular figures f31, F32 corresponding to the size of a defect contained in the mold 2 at the position of each defect. Furthermore, for a defect whose size is equal to or smaller than a threshold, the display control unit 12 displays a marker f32 which is a rectangular figure surrounding the defect.
[0082] 11, the display control unit 12 displays a rectangular figure f41 corresponding to the size of a defect contained in the mold 2. Furthermore, for defects whose size is equal to or smaller than a threshold, the display control unit 12 displays a marker f42, which is a balloon image pointing to the defect. The marker f42 displays a numerical value indicating the size of the detected defective portion.
[0083] 12, the display control unit 12 displays a rectangular figure f51 corresponding to the size of a defect contained in the mold 2. Furthermore, for defects whose size is equal to or smaller than a threshold, the display control unit 12 displays a marker f52 which is an arrow image pointing to the defect. The marker f52 includes a numerical value indicating the size of the detected defective portion.
[0084] Furthermore, in this embodiment, the display control unit 12 performs display processing to emphasize a defect group by superimposing a defect graphic indicating the defect on the captured image and also by superimposing a marker indicating a defect group consisting of adjacent defects whose size is equal to or smaller than a threshold on the captured image.
[0085] Fig. 13 is a diagram illustrating a screen G16 displayed on the display 31. In the example of Fig. 13, the display control unit 12 displays rectangular figures f61 and f62 corresponding to the size of the defect contained in the mold 2 at the position of each defect. Furthermore, the display control unit 12 emphasizes the defect group by superimposing a marker f63 indicating a defect group consisting of defects close to each other and having a size equal to or smaller than a threshold value on the captured image. A worker who installs a core or the like can easily recognize that multiple small defects have been formed in the mold 2 from the marker f63 included in the screen displayed on the display 31.
[0086] Incidentally, even if the inspection device 20 judges whether a part is OK or NG for out-of-mold items by image judgment, depending on the shape of the mold 2, it may judge parts that do not need to be NG for out-of-mold items, such as parts called runners that are separated from the cast product, as NG judgments. If these parts are judged as NG and pouring is not allowed, the yield of the entire line will decrease.
[0087] Conversely, even if a defect on a mold is relatively small and the image on the inspection device 20 indicates that the mold is out of date, there may be defects that are unacceptable as product defects when the actual cast product is produced. If molten metal is poured into such a mold to produce a casting, the defect rate will increase and the yield of the entire line will decrease.
[0088] Therefore, whether or not it is OK to pour molten metal into the mold must not only be determined mechanically from the images, but the worker must also make a final visual judgment while referring to the judgment information from the images.
[0089] The only workers on the casting line are basically those at the core setting station A1 or around the pouring machine 60, and in the current casting line, only the workers at the core setting station A1 can visually check for out-of-mold parts.
[0090] On the other hand, the inspection device 20 for image determination of outdated molds takes images and makes an OK / NG determination at a position slightly before the core setting site A1, so in order to display and show an image of the determination result of the mold 2 in front of them to the worker at the core setting site A1, the image that was previously inspected and stored is read out from the inspection result table of the display control device 10 by a position control signal from the line controller 50 when the mold 2 arrives at the core setting site A1, and is displayed on the display 31.
[0091] While looking at the image displayed on display 31, a worker at core setting site A1 visually inspects the image of the mold in front of him, particularly the parts marked as outdated (NG), and judges whether to reject it as judged by the image, or whether there is no problem with pouring molten metal as is. The worker inputs his / her own judgment result (OK / NG) using the operation section of input / output device 30.
[0092] The visual inspection results can be input by the worker using a simple two-button operation, a PC keypad, voice input, or any other known input method. The workers at the core setting site A1 have various tasks before matching the molds in addition to core setting, so they do not have time to leisurely input the visual inspection results of the out-of-date molds. For this reason, it is preferable to be able to input the visual inspection results easily.
[0093] The visual inspection result (OK / NG) input by the worker is transmitted to the line controller 50 and stored as the visual inspection result in the mold management table.
[0094] 14(a) shows a flowchart of the process of updating the mold management table in the line controller 50. Note that some steps may be executed in parallel or in a different order.
[0095] In step S201, the line controller 50 receives from the input / output device 30 information indicating the result of the determination made by the worker.
[0096] In step S202, the line controller 50 registers the received determination result in the mold management table.
[0097] In this way, the visual judgment results of the workers at the core setting area are updated in the line controller 50, and information on whether or not molten metal can be poured for each individual mold is registered in the mold management table, as shown in Figure 6.
[0098] Next, the pouring control by the line controller 50 based on the mold management table in which the pouring feasibility information has been updated and registered as described above will be described with reference to FIG. 14(b).
[0099] 14(b) shows a flowchart of the control of pouring of molten metal to the pouring machine 60 by the line controller 50. Note that some steps may be executed in parallel or in a different order.
[0100] In step S203, the line controller 50 identifies the mold 2 that has arrived at the pouring machine 60 by its mold ID.
[0101] In step S204, a pouring possibility signal indicating whether or not pouring is possible for the mold 2 that has arrived at the pouring machine 60 is read based on the mold ID.
[0102] In step S205, if the pouring permission signal is "pouring not possible", the line controller 50 outputs a pouring not possible signal to the pouring machine 60 (step S206). When the pouring machine 60 receives this "pouring not possible" signal, it proceeds with the process without pouring molten metal into the mold.
[0103] On the other hand, if the pouring permission signal is "pouring permission" in step S205, the line controller 50 outputs a pouring permission signal to the pouring machine 60 (step S207). Note that in some cases, it is not necessary for the line controller 50 to output the "pouring permission" signal to the pouring machine 60. This is because the pouring machine 60 normally operates on the basis of pouring molten metal into all arriving molds in sequence, and so the pouring machine 60 is controlled to pour molten metal into all molds unless it receives a "pouring permission not allowed" signal from the line controller 50.
[0104] In this way, the pouring machine 60 controls pouring of molten metal into the mold 2 that has arrived at the position of the pouring machine 60 based on the pouring possibility signal received from the line controller 50. If the received pouring possibility signal indicates "yes", or if no signal is received, the pouring machine 60 pours molten metal into the mold 2. On the other hand, if the received pouring possibility signal indicates "no", the pouring machine 60 does not pour molten metal into the mold 2.
[0105] In this embodiment, the inspection results of the mold 2 being transported along the transport path are displayed on the display 31. At this time, if the size of a defective portion in the mold 2 is equal to or smaller than a threshold value, a marker that highlights the defective portion is displayed in addition to a rectangular shape representing the defective portion. By displaying the marker, even if the size of the defect in the mold 2 is small, the worker who sets the core or the like can easily grasp the defective portion.
[0106] In the first embodiment, the display control device 10 is configured as a device separate from the line controller 50. Alternatively, the line controller 50 may have the functions of the display control device 10. In other words, the line controller 50 and the display control device 10 may be configured as an integrated device.
[0107] [Embodiment 2] Another embodiment of the present invention will be described. This embodiment differs from the above-mentioned embodiment 2 in that the contents of the display process for defects in the mold 2 (the process of step S103 in FIG. 8) performed by the display control device 10 are different. For ease of explanation, the same reference numerals are given to members having the same functions as the members explained in the above embodiment, and the explanations thereof will not be repeated.
[0108] In this embodiment, the display control unit 12 changes the display method of a rectangular figure representing a defect depending on whether the size of the defect is equal to or smaller than a threshold. More specifically, for a defect whose size is larger than a threshold, the display control unit 12 displays a rectangular figure corresponding to the size of the defect at the position of the defect in the captured image. On the other hand, for a defect whose size is equal to or smaller than a threshold, the display control unit 12 displays a rectangular figure whose size is larger than the size of the defect at the position of the defect in the captured image.
[0109] Fig. 15 is a diagram illustrating an example of screen G18 displayed on display 31. In the example of Fig. 15, for a defect whose size is larger than a threshold, display control unit 12 displays a rectangular figure f81 corresponding to the size of the defect at the position of the defect. On the other hand, for a defect whose size is equal to or smaller than the threshold, display control unit 12 displays a rectangular figure f82 whose size is larger than the size of the defect at the position of the defect.
[0110] Fig. 16 is a diagram showing the displayed rectangular figure and the size of the actual defect. In Fig. 16, a defect k83 is included in the captured image of the mold 2. In this embodiment, the display control unit 12 displays a rectangular figure f82 that is larger than the size of the defect k83 at the position of the defect k83.
[0111] In this embodiment, when the size of a defect in the mold 2 is equal to or smaller than a threshold value, a rectangular shape representing the defect is displayed in a size larger than the size of the defect in the captured image. This makes it easier for an operator setting the core to grasp the defect even if the size of the defect in the mold 2 is small.
[0112] As described above, in this embodiment, the display control unit 12 displays a rectangular figure having a size larger than the size of the defect and a rectangular figure having a size corresponding to the size of the defect. At this time, the display control unit 12 may display the rectangular figure having a size larger than the size of the defect and the rectangular figure having a size corresponding to the size of the defect in different ways. For example, the display control unit 12 may display the rectangular figure having a size larger than the size of the defect and the rectangular figure having a size corresponding to the size of the defect in different colors. In this case, the operator or the like can easily know whether the displayed rectangular figure is larger than the actual size of the defect based on the color of the rectangular figure displayed on the display 31.
[0113] [Embodiment 3] Another embodiment of the present invention will be described. This embodiment differs from the above-mentioned embodiment 2 in that the contents of the display process for defects in the mold 2 performed by the display control device 10 (the process of step S103 in FIG. 8) are different. For ease of explanation, the same reference numerals are attached to members having the same functions as the members explained in the above embodiment, and the explanation thereof will not be repeated.
[0114] In this embodiment, for a defect whose size is larger than the threshold, the display control unit 12 superimposes a rectangular shape corresponding to the size of the defect on the captured image and displays the rectangular shape at the position of the defect. On the other hand, the display control unit 12 performs display processing to emphasize the defect by superimposing an enlarged image obtained by enlarging an area including a defect whose size is equal to or smaller than the threshold on the captured image.
[0115] Fig. 17 is a diagram illustrating a screen G17 displayed on the display 31. In the example of Fig. 17, the display control unit 12 displays a rectangular figure f71 corresponding to the size of a defect at the position of each defect for defects whose size is larger than a threshold value. On the other hand, for defects whose size is equal to or smaller than the threshold value, the display control unit 12 performs a display process to emphasize the defect by superimposing an enlarged image g73 obtained by enlarging an area including the defect on the captured image. The enlarged image g73 may include a rectangular figure f72 surrounding the defect.
[0116] Also, in this embodiment, the display control unit 12 performs display processing to emphasize a defect group by superimposing an enlarged image of an area including a defect group consisting of adjacent defects whose size is equal to or smaller than a threshold on the captured image.
[0117] In this embodiment, when the size of a defect in the mold 2 is small, an enlarged image of the area including the defect is displayed superimposed on the captured image. This makes it easier for an operator setting the core to grasp the defect even when the size of the defect in the mold 2 is small.
[0118] [Embodiment 4] Another embodiment of the present invention will be described. This embodiment differs from the above-mentioned embodiment 2 in that a screen showing defects in the mold 2 is displayed on smart glasses instead of the display 31. For convenience of explanation, the same reference numerals are used for members having the same functions as those described in the above embodiment, and the explanations thereof will not be repeated.
[0119] 18 is a diagram showing a schematic configuration of a display system 3 according to embodiment 5. The display system 3 includes a display control device 10, a wireless router 80, and smart glasses 90. The wireless router 80 is a communication device that relays wireless communication between the display control device 10 and the smart glasses 90. In this embodiment, the display control device 10 includes a communication interface (not shown) that performs wireless communication with the smart glasses 90. The smart glasses 90 are an augmented reality wearable computer of a head-mounted display type.
[0120] In this embodiment, the display control device 10 transmits display screen data to the smart glasses 90 via the wireless router 80. The smart glasses 90 display a screen showing defects in the mold 2 (for example, screen G20 in FIG. 18 ). At this time, the smart glasses 90 display each defect in the mold 2 with emphasis in a manner according to the size of the defect. A worker at the core setting site A1 or the like can wear the smart glasses 90 and understand what kind of defects are present in the mold 2 by checking the screen displayed on the smart glasses 90.
[0121] [Embodiment 5] FIG. 19 is a diagram showing a schematic configuration of a casting system 1C according to this embodiment. In the example of FIG. 19, a plurality of casting lines L1, L2, L3, ... are arranged in a single factory. Each of the casting lines L1, L2, L3, ... includes the casting system 1 shown in FIG. 2. In particular, each of the casting lines L1, L2, L3, ... includes a display control device 10, an input / output device 30, a line controller 50, and a gateway GW. The display control device 10, the input / output device 30, and the line controller 50 are the same as those in the above-mentioned embodiment 2.
[0122] The data stored in the display control device 10, the line controller 50, and the input / output device 30 are integrated, organized, and managed in the management server 5 of the factory via the gateway GW and the network 4.
[0123] The integrated and organized data of the management server 5 is displayed as traceability data, including current and past data, on a monitoring monitor 6 such as a PC or mobile terminal for factory management. The monitoring monitor 6 displays the operating status of each line, the status of obsolete models (defect rate, etc.), analysis of the cause of defects, advice on countermeasures, etc. For example, in addition to the overall defect rate on each line in the factory, the presence or absence of obsolete models, and on which line and when obsolete models occurred are displayed graphically.
[0124] In addition to the information that the mold 2 is out of date, other information regarding the mold 2, such as sand property data regarding the mold 2, control data during molding, specific result data of the mold strength, external information such as air temperature, and images of actual inspection results, are also displayed.
[0125] The traceability data can display past defect rates and the percentage of defects caused by outdated models, as well as provide advice on countermeasures.
[0126] [Embodiment 6] FIG. 20 is a diagram showing a schematic configuration of a casting system 1D according to this embodiment. The casting system 1D includes a plurality of casting systems 1C, each of which has a plurality of casting lines installed in a single factory 8. In each casting system 1C, management is performed for each casting line. The management server 5 of each casting system 1C is connected to an integrated monitoring server 7 via a network 4. The integrated monitoring server 7 receives data from the plurality of management servers 5, and organizes and manages the data.
[0127] In this embodiment, multiple factories including multiple lines can be monitored. In this case, management for each factory is similar to that of the fifth embodiment described above.
[0128] In managing multiple factories, various data organized and stored in the integrated monitoring server 7 of each factory is collected in the management server 5 of each factory 8 via the network 4. The various collected data is organized and stored in the same manner as in the fifth embodiment, and each factory 8 is able to monitor the defect rate and the status of outdated models on a screen or the like.
[0129] [Modifications] In the above-mentioned second embodiment, when the size of the defect included in the mold 2 is equal to or smaller than a threshold value, the display control unit 12 performs a display process of superimposing a marker (defect image) indicating the defect on the captured image. The display method according to the size of the defect is not limited to that shown in the above-mentioned embodiment. The display control unit 12 may change the color, shape, position, size, or blinking pattern of the defect image representing the defect according to the size of the defect represented by the defect image or each defect included in the defect group. For example, the display control unit 12 may perform control to change the color of the defect image to be displayed according to the size of the defect. Also, for example, the display control unit 12 may change the color of the defect image depending on whether the shape of the defect included in the mold 2 satisfies a predetermined condition. Also, for example, when the size of the defect included in the mold 2 satisfies a predetermined condition, the display control unit 12 may perform control to display the defect image corresponding to the defect at a prominent position on the screen (for example, the center of the screen) instead of at the position of the defect. Furthermore, for example, when the size of a defect contained in the mold 2 satisfies a predetermined condition, the display control unit 12 may perform control such as increasing the size of the defect image, making the defect image blink, or making the shape of the defect image different from the shapes of other defect images.
[0130] However, when the inspection device 20 is a device that detects small-sized obsolete molds, a mold 2 that does not actually need to be judged as obsolete may be detected as obsolete. In such a case, the worker himself / herself ultimately judges whether the mold 2 is obsolete by visual inspection. According to this embodiment, for example, a defect image with a color according to the size of the defect is displayed on the display 31, so that the worker can easily know whether the defect (obsolete) requires visual inspection by the color of the defect image.
[0131] In the above-mentioned fourth embodiment, the display control unit 12 performed a display process of superimposing an enlarged image obtained by enlarging an area including a defect whose size is equal to or smaller than a threshold value on the captured image. The display method of the enlarged image according to the size of the defect is not limited to that shown in the above-mentioned embodiment. The display control unit 12 may change the color, shape, position, size, or blinking pattern of the enlarged image indicating the defect according to the size of the defect included in the enlarged image or each defect included in the defect group. For example, the display control unit 12 may perform control to change the color of the enlarged image to be displayed according to the size of the defect. Also, for example, the display control unit 12 may change the color of the enlarged image depending on whether or not the shape of the defect included in the mold 2 satisfies a predetermined condition. Also, for example, when the size of the defect included in the mold 2 satisfies a predetermined condition, the display control unit 12 may perform control to display the enlarged image corresponding to the defect at a prominent position on the screen (for example, the center of the screen) instead of at a position corresponding to the defect. Furthermore, for example, when the size of a defect contained in the mold 2 satisfies a predetermined condition, the display control unit 12 may perform control such as making the size of the enlarged image larger than other enlarged images, making the enlarged image blink, or making the shape of the enlarged image different from the shapes of the other enlarged images.
[0132] In the above-mentioned second embodiment, the display control device 10 performed a display process to emphasize the defect by superimposing a defect image representing the defect on a captured image of the mold 2. The display process performed by the display control device 10 is not limited to that shown in the above-mentioned embodiment. For example, the display control device 10 may display a defect image by superimposing it on a reference image to which the captured image is compared in the inspection process. Furthermore, the display control device 10 may perform a display process to display only a defect image representing the defect (for example, only an enlarged image of an area including the defect portion) without performing the superimposition process.
[0133] In the above-mentioned embodiment 2, the case where the display 31 is installed at the core setting site A1 has been described. The display 31 may be installed at a site other than the core setting site A1. The display 31 is installed, for example, at a downstream process to which the mold 2 to be inspected is moved. The display 31 may be installed, for example, at a site where pouring is performed by the pouring machine 60. The display 31 may also be installed at a site other than the casting line, for example, in the management office, control room, or inspection site of the casting system 1.
[0134] In the above embodiment, the display control device 10 displays on the display 31 the inspection results of the mold 2 being transported along the transport path. The display device 10 may display on the display 31 the inspection results of the mold 2 being transported in real time, or may display past inspection results on the display 31. When displaying past inspection results, the display control device 10, for example, reads out the inspection results from an inspection result table and displays the read out inspection results on the display 31 installed in the management office, control room, or inspection site. At this time, the display control device 10 may, for example, display on the display 31 information indicating the inspection date and time and identification information for identifying the mold 2 together with the inspection results.
[0135] In each of the above-described embodiments, a configuration has been described in which each defect is highlighted and displayed in a manner that corresponds to the size of the defect contained in the mold 2. The display control device according to the present invention may be applied to systems other than the systems shown in the above-described embodiments. For example, the display control device according to the present invention may inspect a casting produced using a mold for defects, and highlight and display each defect in a manner that corresponds to the size of the defect contained in the inspected casting.
[0136] The functions implemented by the display control device 10 in each of the above-mentioned embodiments may be shared and implemented by a plurality of devices. For example, at least some of the functions of the display control device 10 according to the above-mentioned second embodiment may be implemented in a server on a cloud. In this case, the display control device 10 according to the above-mentioned second embodiment is realized by the display control device 10 and the server communicating via a network.
[0137] In this case, the server, in addition to performing calculations and storing image data as an out-of-date detection device, analyzes the relationship with sand properties and molding data to prevent out-of-date occurrence, and provides advice on countermeasures, etc.
[0138] The server stores, for example, data related to the inspection of the mold 2 and analytical data obtained from each device on the line. The data related to the inspection of the mold 2 includes, for example, an image taken by the inspection device 20 and a reference image used for the inspection, a composite image in which the inspection result image is marked with obsolete parts, and parameters related to the inspection process. The analytical data includes, for example, sand properties before molding (CB, moisture, sand temperature, compressive strength, air permeability, etc.), control data during molding (aeration waveform, squeeze pressure waveform, amount of release agent applied, etc.), mold strength measurement data after molding, and factory environmental data (temperature, humidity, etc.). The analytical data on the line is stored linked to the inspection data.
[0139] Functions provided by the server include, for example, checking the trends in past waste generation (visualization by year / month / day or by product, etc.), predicting defect rates based on accumulated past data, and providing advice on countermeasures.
[0140] In the above embodiment, the display control device 10 specifies the size of the defect as the feature of the defect. The feature of the defect may be a feature other than the size of the defect. The feature of the defect is information that indicates the feature of the defect, such as the appearance or state of the defect, and is, for example, information that indicates the size or position of the defect. Displaying in a manner according to the feature means, for example, displaying the appearance of an image that indicates a defect (hereinafter, referred to as a "defect image") differently according to the feature of each defect. For example, when the feature of the defect is the position of the defect, the display control device 10 may change the color, shape, position, size, or blinking pattern of the marker or the enlarged image depending on whether the position of the defect is included in a cavity that constitutes the shape of the casting or included in a runner that guides molten metal to the cavity.
[0141] [Software implementation example] The display control device 10, the inspection device 20, the input / output device 30, and the control blocks of the line controller 50 (particularly the identification unit 11 and the display control unit 12) may be realized by a logic circuit (hardware) formed in an integrated circuit (IC chip) or the like, or may be realized by software.
[0142] In the latter case, the display control device 10, the inspection device 20, the input / output device 30, and / or the line controller 50 are provided with a computer that executes instructions of a program, which is software that realizes each function. This computer is provided with, for example, one or more processors, and also with a computer-readable recording medium that stores the above program. Then, in the above computer, the processor reads the above program from the above recording medium and executes it, thereby achieving the object of the present invention. For example, a CPU (Central Processing Unit) can be used as the above processor. For the above recording medium, in addition to a "non-transient tangible medium" such as a ROM (Read Only Memory), a tape, a disk, a card, a semiconductor memory, a programmable logic circuit, etc. can be used. In addition, a RAM for expanding the above program may be further provided. In addition, the above program may be supplied to the above computer via any transmission medium (such as a communication network or a broadcast wave) that can transmit the program. Note that one aspect of the present invention may also be realized in the form of a data signal embedded in a carrier wave, in which the above program is embodied by electronic transmission.
[0143] [Additional Notes] The present invention is not limited to the above-described embodiment, and various modifications are possible within the scope of the claims. Embodiments obtained by appropriately combining the individual technical means included in the above-described embodiment are also included in the technical scope of the present invention. [Explanation of symbols]
[0144] 1 Casting System 2. Mold 3. Display System 10 Display control device 11 Specific section 12 Display control section 20 Inspection Equipment 21 Sensors 30 Input / Output Devices 31 Display 40 Molding machine 50 Line Controller 60 Pouring machine 70 Transport Equipment 80 Wireless Router 90 Smart Glasses 101 Processor 102 Main Memory 103 Auxiliary Memory 104 Input Interface 105 Output Interface A1 Core setting area f21, f31, f41, f51, f61, f71, f72, f81, f82 Rectangular shapes f23, f32, f42, f52, f63 Markers G12, G16, G17, G18, G20 screens g73 Enlarged image k83 Defect P1, P18, P19, P2, P3, P5, P6, P9 position
Claims
1. A controller is provided. The controller: A process of identifying a feature amount of each defect contained in the mold by referring to an image of the mold; a display process for highlighting the defect contained in the mold in a manner corresponding to the feature amount of the defect identified in the identification process and displaying the image on a display; The feature amount of each defect identified by the identification process includes at least the size of the defect, In the display process, the controller is configured to display, among defects contained in the mold, superimposing a defect figure representing a defect whose size is greater than a threshold value on the image at a size corresponding to the size of the defect in the image; a defect image representing a defect whose size is equal to or smaller than the threshold is enlarged to a size larger than the size of the defect in the image, and superimposed on the image; A display control device comprising:
2. In the display process, the controller emphasizes a defect whose size is equal to or smaller than the threshold by superimposing a marker indicating the defect on the image. The display control device according to claim 1 .
3. the feature amount of each defect identified by the identification process includes at least the size and position of the defect; the controller, in the display processing, emphasizes a defect group by superimposing, on the image, a marker indicating the defect group that is made up of adjacent defects whose size is equal to or smaller than the threshold value. The display control device according to claim 1 .
4. the controller changes a color, a shape, a position, a size, or a blinking pattern of the marker in accordance with a feature amount of the defect indicated by the marker or each defect included in a group of defects in the display process; 4. The display control device according to claim 2 or 3.
5. In the display process, the controller emphasizes the defect by superimposing an enlarged defect image of a part of the image including a defect whose size is equal to or smaller than the threshold value on the image. The display control device according to claim 1 .
6. the feature amount of each defect identified by the identification process includes at least the size and position of the defect; the controller, in the display processing, superimposes, on the image, a defect image obtained by enlarging a region that is a part of the image and includes a defect group made up of adjacent defects whose sizes are equal to or smaller than the threshold value, thereby emphasizing the defect group. The display control device according to claim 1 .
7. the controller changes a color, a shape, a position, a size, or a blinking pattern of the defect image in accordance with a feature amount of a defect included in the defect image or each defect included in a group of defects; 7. The display control device according to claim 5 or 6.
8. The controller: At least one processor that executes each of the processes according to a predetermined program; At least one memory storing the program.
8. The display control device according to claim 1, wherein the display control device is a display control device for displaying a display image.
9. 9. A control program for controlling a display control device according to claim 1, the control program causing the controller to execute each of the processes.
Citation Information
Patent Citations
Assisting system for casting work
JP1993169244A
Defect inspection method and its apparatus
JP2005351910A
Solder inspection system
JP2007271638A
Visual inspection system for transparent film
JP2009053122A
Method of manufacturing metal ingot and metal ingot manufacturing device
JP2013043185A
