Product Inspection Equipment
Patent Information
- Application Number
- JP2021169388
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-10-15
- Publication Date
- 2025-02-17
- Estimated Expiration
- 2041-10-15
AI Technical Summary
【0024】 本発明によれば、所要の検査感度を担保しながらも、品種ごとの検査パラメータとなる判定基準の設定作業の負担を軽減することができる物品検査装置および物品検査方法を提供することができる。
Smart Images

Figure 0007630406000001 
Figure 0007630406000002 
Figure 0007630406000003
Abstract
Description
[Technical field]
[0001] The present invention relates to an article inspection apparatus and an article inspection method, and more particularly to an article inspection apparatus and an article inspection method for inspecting an article based on an inspection image of an article to be inspected. [Background technology]
[0002] Devices and methods have been known for some time that involve providing an X-ray inspection area in a production line for various types of inspected items (meat, seafood, processed foods, pharmaceuticals, etc.), irradiating the inspected items with X-rays as they are being transported, and inspecting the inspected items based on the X-ray inspection images, for example, item inspection devices and methods that can inspect for the presence of foreign objects, missing items, or defective packaging.
[0003] In such an object inspection apparatus and method, X-rays passing through the object being transported are successively detected by an X-ray line sensor or the like, multi-tone X-ray image data corresponding to the distribution of X-ray transmission at each specified time is created, and the X-ray image data is subjected to filtering, differentiation, and other image processing to determine whether or not there are foreign objects or missing parts in the object being inspected.
[0004] Furthermore, because the amount of X-ray penetration varies depending on the contents of the inspected item, its thickness in the direction of X-ray penetration, and the presence or absence of foreign objects or missing parts, in order to obtain accurate inspection results, when a new variety is registered in the item inspection device, parameters are set that specify the X-ray wavelength, irradiation intensity, image processing conditions, etc. that correspond to that variety. In addition, the suitability of the judgment threshold (hereinafter also referred to as the limit) for detecting foreign objects or missing parts based on the inspection image is often checked using an item sample or a test piece for the foreign object to be detected.
[0005] One example of this type of item inspection device and method is one in which, for example, when the item to be inspected is a packed lunch box containing multiple types of ingredients, multiple inspection areas can be specified in the X-ray inspection image of the item, and limits can be set for each specified area corresponding to the type of ingredient or the size of the foreign object to be detected, making it possible to detect foreign objects with the required sensitivity (see, for example, Patent Document 1). [Prior art documents] [Patent documents]
[0006] [Patent Document 1] Patent No. 3888623 Summary of the Invention [Problem to be solved by the invention]
[0007] However, in conventional article inspection devices and methods, in order to perform highly sensitive article inspection, it is necessary to set judgment criteria such as judgment threshold levels as inspection parameters for each type of article being inspected. Therefore, in cases where many similar types of articles are inspected or in industries where replacement with new types is frequent, the burden of setting the judgment criteria can be felt to be significant.
[0008] Furthermore, when multiple inspection target regions are specified within an inspection image region as in the above-mentioned conventional example, highly sensitive foreign body detection and missing part inspection become possible. However, when a large number of regions are specified or when an inexperienced operator performs the setup work, it becomes necessary to set judgment criteria such as a judgment threshold level for each specified region, which increases the burden of the setup work.
[0009] The present invention is devised to solve such conventional problems, and aims to provide an item inspection device and an item inspection method that can reduce the burden of setting judgment criteria that serve as inspection parameters for each type of item while ensuring the required inspection sensitivity. [Means for solving the problem]
[0010] (1) In order to achieve the above-mentioned object, the item inspection device of the present invention is an item inspection device that inspects an item to be inspected including a plurality of contents using an inspection image, and is characterized in that it comprises an information memory unit that stores information of a predetermined detection value related to the inspection image, an item imaging unit that images the item to be inspected, a composition determination unit that performs a predetermined recognition process based on image data of the item to be inspected imaged by the item imaging unit to determine the material composition of the contents of the item to be inspected, and a proposal output unit that, when the material composition of the contents is determined by the composition determination unit, estimates the detection sensitivity for the predetermined detection value based on the material composition of the contents and proposes and outputs a judgment criterion for the item inspection.
[0011] With this configuration, in the present invention, a predetermined recognition process is performed in the composition determination unit based on image data of the inspected article captured by the article imaging unit, and the material composition of the contents of the inspected article is determined. Then, in the proposal output unit, the detection sensitivity of a predetermined detection value corresponding to the pixel value, etc. of the inspection image according to the material composition of the contents is estimated, and a judgment criterion for the article inspection based on the stored information in the information storage unit is proposed and output at an appropriate reference value level according to the estimated detection sensitivity. As a result, it is possible to sufficiently reduce the workload of setting judgment criteria such as judgment threshold levels, which are inspection parameters for each type.
[0012] (2) In a preferred embodiment of the present invention, the method further includes a sensitivity affecting material memory unit that stores information on the sensitivity effect of each of a plurality of materials on the specified detection value, and the proposal output unit can be configured to estimate the detection sensitivity for the specified detection value based on the information on the material configuration acquired by the specified recognition process in the configuration determination unit and the stored information in the sensitivity affecting material memory unit corresponding to the material configuration.
[0013] With this configuration, when the composition determining unit acquires information on the material composition of the contents of the inspected item, the sensitivity influence level of the material composition on a predetermined detection value can be grasped based on the stored information in the sensitivity influence material storage unit. Therefore, it becomes possible to propose and output appropriate judgment criteria for the inspection of the item according to the material composition that significantly affects the predetermined detection value.
[0014] (3) In a preferred embodiment of the present invention, the composition determination unit may have an image input means for inputting an image of the inspected item as an image capable of character recognition and / or image recognition, and a recognition processing means for performing character recognition and / or image recognition on the image input by the image input means to obtain first material information corresponding to the material composition of at least a specific content of the inspected item.
[0015] In this way, first material information corresponding to at least the material composition of a specific content is obtained by character recognition or image recognition based on the input image by the image input means. Therefore, when first material information that significantly affects a predetermined detection value is obtained, it is possible to propose and output a judgment standard for the required item inspection according to its sensitivity influence level.
[0016] (4) In a preferred embodiment of the present invention, the recognition processing means of the composition determination unit is characterized in that, based on the results of character recognition and / or image recognition of the input image by the image input means, in addition to the first material information, it obtains second material information corresponding to the difference from the first material information for the material composition of other contents similar to the material composition of the specific content.
[0017] In this case, based on the results of character recognition and / or image recognition from the input image, in addition to the first material information, second material information corresponding to the difference from the first material information is obtained for the material composition of other contents similar to the material composition of the specific content. Therefore, known sensitivity information can be used for inspected articles having other similar contents instead of the specific content, and the article inspection device can quickly, easily, and accurately set the judgment threshold level as an inspection parameter for each type.
[0018] (5) In a preferred embodiment of the present invention, the inspected item is configured such that the multiple contents are arranged in multiple corresponding placement areas, and the configuration determination unit executes the predetermined recognition process based on image data of the contents for each of the multiple placement areas imaged by the item imaging unit to determine the material composition of the contents in each of the multiple placement areas, and the proposal output unit is configured to propose and output judgment criteria for each of the multiple placement areas based on the judgment result by the configuration determination unit.
[0019] In this case, information on specified detection values relating to multiple contents is stored in correspondence with multiple placement areas, making it possible to accurately propose and output judgment criteria for each placement area depending on the material composition of the contents in each placement area.
[0020] (6) In a preferred embodiment of the present invention, the apparatus further includes a variety registration information storage unit that stores variety and setting information of the object to be inspected together with information on the material composition, and the composition determination unit determines, for each of the plurality of placement areas in the object to be inspected, based on the information stored in the variety registration information storage unit and the information acquired by the specified recognition process, whether or not a partial change that significantly affects the specified detection value has occurred in the material composition of the contents corresponding to each placement area.
[0021] In this case, for each of the multiple placement areas, the material composition of the contents to be inspected is compared with the material composition of the contents that have already been registered based on the material composition of the contents that have already been registered and the information obtained by a predetermined recognition process, and it is determined whether or not a partial change that significantly affects a predetermined detection value has occurred. Therefore, it is possible to accurately propose and output necessary adjustments to the judgment criteria while using the setting information of the contents that have already been registered.
[0022] (7) The item inspection method of the present invention is an item inspection method for inspecting an item to be inspected including a plurality of contents using an inspection image, and is characterized in that it includes an information storage step for storing information on a predetermined detection value related to the inspection image, an item imaging step for imaging the item to be inspected, a composition determination step for performing a predetermined recognition process based on image data of the item to be inspected imaged in the item imaging step to determine the material composition of the contents of the item to be inspected, and a proposal output step for estimating detection sensitivity for the predetermined detection value based on the material composition of the contents determined in the composition determination step, and proposing and outputting a judgment criterion for the item inspection.
[0023] With this configuration, in the article inspection method of the present invention, a predetermined recognition process is performed in the composition determination step based on the appearance image data of the inspected article captured in the article imaging step, and the material composition of the contents of the inspected article is determined. Then, in the proposal output step, the detection sensitivity of a predetermined detection value corresponding to the pixel values, etc. of the inspection image is estimated while taking into account the effect on detection sensitivity corresponding to the material composition of the contents, and a judgment criterion for the article inspection based on the information stored in the information storage step is proposed and output at an appropriate reference value level corresponding to the estimated detection sensitivity. As a result, it is possible to sufficiently reduce the workload of setting judgment criteria such as judgment threshold levels, which are inspection parameters for each type. Effect of the Invention
[0024] According to the present invention, it is possible to provide an item inspection device and an item inspection method that can reduce the burden of setting judgment criteria that serve as inspection parameters for each type of item while ensuring the required inspection sensitivity. [Brief description of the drawings]
[0025] [Figure 1] 1 is a schematic diagram conceptually showing a schematic configuration of a main part of an article inspection device according to an embodiment of the present invention; [Diagram 2] 1 is a partial perspective view showing a schematic configuration of an X-ray inspection area and its surroundings in an article inspection device according to an embodiment of the present invention. [Diagram 3]1 is a schematic system configuration diagram showing, in block diagram form, the system configuration of a control system in an article inspection device according to an embodiment of the present invention. [Figure 4] 3 is an explanatory diagram of an example of an operation screen for selecting an operation mode and performing various setting operations in an article inspection device according to an embodiment of the present invention. FIG. [Diagram 5] 5 is a flowchart showing a mode switching process procedure for switching between a foreign object detection mode and a threshold setting mode in response to a selective mode selection input in an article inspection device according to an embodiment of the present invention. [Figure 6] 10 is a flowchart showing the procedure of limit setting work and sensitivity testing according to the presence or absence of similar products in an article inspection device according to an embodiment of the present invention. [Figure 7] 5 is a flowchart showing the procedure of manual limit setting work at the time of product type registration or the like in the product inspection device according to one embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0026] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
[0027] 1 to 4 show the configuration of an article inspection device according to one embodiment of the present invention.
[0028] First, the configuration will be described.
[0029] The object inspection apparatus 10 of this embodiment shown in Figures 1 to 3 is an X-ray inspection apparatus that transports the inspected work W (inspected object) by a transport section 11, and inspects the work W during transport by an inspection section 12 that uses a predetermined inspection image, such as an X-ray inspection image, and is configured to detect, for example, the presence or absence of foreign matter mixed in the work W, or the presence or absence of missing parts.
[0030] The work W is a product manufactured and shipped as meat, fish and shellfish, processed food, medicine, etc., and here, food, for example, a packed lunch box will be described as a typical example. This work W has a pack P having a plurality of concave arrangement areas A to D as its multiple contents, and a plurality of ingredients stored and arranged in the plurality of arrangement areas A to D, for example, a staple food Wa, a main dish Wb, a side dish Wc, and a side dish Wd, which are arranged in the respective determined arrangement areas A to D. Of course, the pack P here has a cover part made of a transparent top lid or a wrap, not shown. In addition, the food here may be packed noodles or wrapped rice balls, etc., and the plurality of ingredients may be the main ingredient and ingredients of the noodles, the main ingredient and ingredients of the rice ball, etc., and may not necessarily be limited to the names such as the staple food Wa and the main dish Wb, but may be an assortment pack in which a plurality of types of cakes are combined, etc.
[0031] In this manner, the multiple types of ingredients to be arranged in each of the arrangement areas A to D of the pack P are selectively combined from ingredient candidates that are predetermined as ingredients that can be produced.
[0032] As an example, in the case of boxed lunches, multiple types of boxed lunches are manufactured with different ingredients and presentation depending on the delivery destination, and even if the delivery destination is the same and the same type of boxed lunch is being delivered, the ingredients may change depending on the season, and the amount of some ingredients presented may change due to campaigns, etc.
[0033] The staple food Wa, main dish Wb, side dish Wc, and side dish Wd are each brought in as different kinds of ingredients that have been processed or cooked in the processing and cooking process, and are arranged in predetermined amounts in each arrangement area A to D of the pack P in the plating process, closed with a top lid or plastic wrap, and carried to the inspection process as the work W. An item inspection device 10 (X-ray inspection device) inspects the work W in this inspection process, and those that are determined to be non-defective are carried to the next process.
[0034] The conveying section 11 is, for example, a belt conveyor type, and supports an endless conveyor belt 11a in a predetermined shape as illustrated in FIG. 3 by downstream rollers 11b, 11c and upstream rollers 11d, 11e that contact its inner surface, so that an article placed on the conveyor belt 11a can be conveyed in the direction D1 in the figure.
[0035] The inspection section 12 includes an X-ray source 21 that outputs X-rays in a direction perpendicular to the D1 direction from an X-ray tube or the like located above the conveyor belt 11a of the conveying section 11, an X-ray detector 22 such as an X-ray line sensor located inside the conveyor belt 11a of the conveying section 11, an X-ray image input section 23 that generates line image data corresponding to the amount of X-rays that pass through the workpiece W and are detected by the X-ray detector 22 at each specified time, and an object detection sensor 24 that detects the entry of the workpiece W into a specified inspection area Z1.
[0036] The X-ray source 21 has an X-ray tube (not shown) therein, and although details are not shown, electrons emitted from a filament on the cathode side in an envelope of the X-ray tube and focused by a focusing electrode are collided with a target on the anode side facing the filament, thereby generating X-rays from the target. The X-ray source 21 may be, for example, a rotating type target, and in either case, it can irradiate the workpiece W on the conveyor 11 with X-rays in the form of a fan beam perpendicular to the direction D1, and form an X-ray irradiation area in a range covering the cross section through which the workpiece W passes within the inspection area Z1.
[0037] The X-ray detector 22 is composed of an X-ray line sensor camera in which detection elements, each consisting of a scintillator that emits fluorescence when exposed to X-rays and a photodiode or charge-coupled device that is a light-receiving element, are arranged in an array at a predetermined pitch in the passage width direction of the conveying section 11 to detect X-rays at a predetermined resolution. The X-ray detector 22 may be a semiconductor sensor using an X-ray conversion film, or an area sensor in which multiple detection elements are arranged two-dimensionally, and is selected according to the characteristics of the workpiece W and the performance required for inspection.
[0038] The X-ray image input unit 23 can, for example, A / D convert the transmission amount detection signal from each detection element of the X-ray detector 22 and generate data of the accumulated X-ray transmission amount (hereinafter also simply referred to as the transmission amount) for each predetermined unit transport time as line scan image data with a density level representing a gradation from 0 to 1023. In addition, the X-ray image input unit 23 is capable of outputting X-ray transmission image data for each workpiece W by repeating line scan image generation by the X-ray detector 22 a predetermined number of times during the inspection period corresponding to each workpiece W.
[0039] The article detection sensor 24 is composed of a photoelectric sensor having an optical axis in the passage width direction at a predetermined height position above the conveyor belt 11a of the transfer section 11, for example as indicated by a dashed line in FIG.
[0040] The inspection unit 12 also has an X-ray detector drive circuit 25 that causes the X-ray detector 22 to output detection data corresponding to the amount of transmission per specified time, a transport drive motor 26 that is connected to a drive roller 11b that engages with the conveyor belt 11a at the downstream end of the transport unit 11 in the transport direction and drives the transport unit 11 via the drive roller 11b, a motor drive circuit 27 that is capable of controlling the drive of the transport drive motor 26, and an X-ray generator drive circuit 28 that is capable of controlling the X-ray irradiation conditions of the X-ray source 21 by the tube current, tube voltage, etc. of the X-ray tube.
[0041] In this inspection unit 12, a control circuit 30 manages setting information such as control parameters for the operating mode and various conditions, as well as type registration information for the work W, and controls the item inspection conditions according to the type of the work W.
[0042] As shown in FIG. 3, the control circuit 30 comprises a CPU 31, a program storage unit 32 that stores programs that perform item inspection functions including foreign object detection using X-ray inspection, an operation input unit 33 and a display unit 34 that are composed of a touch panel, a tablet type or other portable information terminal, etc., and that perform operation input such as settings and selection instructions and display a screen corresponding to the input, and a data storage unit 35 that stores inspection result information, various setting conditions related to item inspection, and other management information.
[0043] In addition, a camera 41, which is a visual sensor, is connected to the control circuit 30 via a camera image input unit 42, which is a camera controller. This camera 41 may be installed as a camera for monitoring the production line during normal times and may also be used for type confirmation, making efficient use of the equipment and allowing the type confirmation work to be recorded as a monitoring record, or it may be installed as a camera for type confirmation in a position near the plating process, eliminating the need to bring a sample of the work W into the inspection process and allowing a camera angle or angle of view suitable for capturing an external image of the work W.
[0044] The CPU 31 is composed of an industrial controller, PC, etc. that executes programs in the program storage unit 32 in response to operation input from the operation input unit 33, and is capable of communication in a predetermined bus format (e.g., field network communication) with each of the X-ray image input unit 23, X-ray detector driving circuit 25, motor driving circuit 27 and X-ray generator driving circuit 28 of the inspection unit 12.
[0045] This CPU 31 can execute an operation of sequentially storing the line image data from the X-ray image input unit 23 or the X-ray transmission image data for each inspection period of each workpiece W in the data accumulation unit 35. In addition, the CPU 31 can execute an operation of sequentially writing the image data from the camera 41 in the data accumulation unit 35 via the camera image input unit 42.
[0046] The program storage unit 32 has, as multiple control programs executed by the CPU 31, an item inspection program 51 which is an execution program for item inspection, for example, item inspection capable of detecting foreign objects or missing items; a threshold setting program 52 for setting a judgment threshold used for judging foreign object detection or missing item detection based on the X-ray inspection image related to the item inspection; a composition judgment program 53 for classifying and identifying the material composition (for example, the type and amount of main ingredients) of the ingredients Wa to Wd which are the contents of the work W by image recognition or character recognition using images from the camera 41; a sensitivity adjustment program 54 (proposal output unit) which estimates the detection sensitivity level for a predetermined detection value such as the X-ray transmission amount related to the X-ray transmission image data based on the material composition of each content judged by the composition judgment program 53, and can propose and output judgment criteria for item inspection based on the X-ray transmission image; and programs for registering and setting various parameters not shown.
[0047] As will be described in more detail later, the sensitivity adjustment program 54 estimates the detection sensitivity under specified X-ray irradiation conditions, taking into account the difference in the amount of X-ray penetration (predetermined detection value) due to the material composition, from the perspective of whether the material composition of each of the contents Wa, Wb, Wc or Wd of the work W to be inspected is suitable for reusing the judgment threshold (limit) for foreign objects or missing parts for a reference work of similar composition, and if the reuse of the judgment threshold is not suitable, also has the function of proposing and outputting sensitivity adjustments according to the differences in material composition between the new work W to be inspected and the work W of similar composition.
[0048] The data storage unit 35 has an X-ray image memory 61 that can sequentially store X-ray transmission image data for each inspection period of each work W, a camera image memory 62 that can sequentially write image data from the camera 41 for each inspection period of each work W via the camera image input unit 42, a variety registration and setting memory 63 that stores and retains variety registration information used in the item inspection program 51 in the program storage unit 32 and various other parameters that are set by the aforementioned registration and setting program, and a management sensitivity memory 64 (sensitivity affected material storage means) that stores the judgment thresholds for foreign objects and missing parts corresponding to the material composition of each variety of work W that are set by the threshold setting program 52 or that are proposed to be adjusted by the sensitivity adjustment program 54 and approved by the operator, together with information on the degree of influence (sensitivity influence) of the corresponding main material composition.
[0049] Here, the X-ray image memory 61 is an information storage unit that stores information on specified detection values such as the amount of X-ray penetration related to item inspection as X-ray inspection image data for each work W (concentration image data according to the amount of X-ray penetration), and the camera image memory 62 stores the image from the camera 41 as visual sensor information for each work W that can be processed for image recognition and character recognition as described below.
[0050] The product type registration / setting memory 63 stores and holds judgment thresholds as inspection parameters for each product type of work W, as well as various control parameters that are normally set, in association with the product name, main material composition, packaging form, etc., and here, a work W of an already set product type or each of its contents Wa, Wb, Wc or Wd can be used as a reference work or reference material composition of a similar material composition, as described below.
[0051] In this embodiment, the work W is configured by arranging multiple ingredients, such as a staple food Wa, a main dish Wb, a side dish Wc, and a side dish Wd, in multiple concave arrangement areas A to D of the pack P, and the control sensitivity memory 64 of the data storage unit 35 stores information related to the sensitivity effects according to the material composition of the multiple ingredients, i.e., information related to the material characteristics (e.g., amount of substance, density, thickness, etc.) corresponding to the X-ray transmittance of the ingredients, which appears as a significant difference in the judgment of pass / fail as a change in pixel shade on the X-ray transmission image data, in association with the multiple arrangement areas A to D.
[0052] The camera 41 is an article imaging unit that images the workpiece W, and is configured, for example, with a Bayer type video camera or a multi-plate prism spectral color area scan camera that can function as a color camera or a monochrome camera. At least one of the cameras 41 is installed as a network camera or a USB video class camera (UVC camera) on the production line or near the plating work position in the plating process of the production line.
[0053] The camera image input unit 42 is capable of performing pre-processing such as noise removal, image enhancement, distortion correction, etc. Furthermore, it is preferable that the image can be associated with the conveying direction in the X-ray inspection image, and that image cropping and rotation processing can be performed, so that the layout of the placement areas A to D in the pack P can be accurately associated and reliably specified between the image data from the camera 41 and the X-ray transmission image. This eliminates the need for installation and adjustment conditions of the camera 41, and in particular the need to image the workpiece W from directly above, thereby easing restrictions and efforts regarding the camera angle as long as the resolution is ensured.
[0054] More specifically, the X-ray inspection images sequentially input from the X-ray detector 22 to the X-ray image memory 61 of the data storage unit 35 via the X-ray image input unit 23 have pixel values corresponding to predetermined detection values such as the amount of X-ray transmission calculated, and are then converted into brightness values of, for example, 256 levels in preprocessing. After undergoing feature extraction filter processing for edge detection, etc., the images are stored and saved in an image data format that can be displayed on the operation input screen 70 as an X-ray inspection image of the workpiece W.
[0055] In addition, the item inspection program 51 can perform image judgment to detect foreign objects. For example, in synchronization with the workpiece W passing through the inspection area Z1, it reads out a judgment threshold for foreign object detection for each placement area A, B, C or D stored in the product registration / setting memory 63 of the data accumulation unit 35, and determines the presence or absence of foreign objects with low X-ray transmittance (large X-ray absorption coefficient) based on whether or not the pixel value for each placement area exceeds the judgment threshold.
[0056] The composition determination program 53 is configured to perform the function of a composition determination unit that determines the main material composition of the contents Wa to Wd of the work W with respect to a reference work of a similar composition. For the composition determination, the composition determination program 53 includes a work image input unit 53a (image input means) that inputs an image of the work W from the camera 41 via the camera image input unit 42 as an image capable of character recognition or / and an image capable of image recognition, a recognition processing unit 53b that executes a predetermined image recognition process and character recognition process based on the image data of the work W captured by the camera 41, and a material composition determination unit 53c having the function of a determination means that determines the material composition (any one or a combination of the names, material types, amounts, etc. of ingredients) of the multiple contents Wa to Wd in the work W based on the recognition information of the recognition processing unit 53b.
[0057] The image recognition processing by the recognition processing unit 53b extracts, for example, feature quantities (area, length, diameter, specific shape, number) related to the shape of an image or figure in a digital image from the camera 41, which is visual sensor information, the color and brightness of the image forming the figure, changes in the color and brightness, the direction of the change, etc. Also, for example, statistical discriminant analysis, binarization by threshold discrimination, edge extraction, labeling processing, contour tracing, etc. are selectively performed to enable extraction calculation of geometric feature quantities and pattern recognition, thereby recognizing images of ingredients and ingredients having the extracted feature quantities. Typically, character recognition is possible by reading characters on a food label attached to the work W, for example, and image recognition is possible by photographing a product sample with a camera, for example.
[0058] Here, reading characters on food labels will be described.
[0059] When imaging a food label, the label attached to the product or a sample of the label to be attached is imaged, the area of the ingredient label is extracted by image recognition, and character recognition is performed. Then, when the characteristic ingredient is identified by character recognition, candidates of ingredients that have been previously associated with it are displayed.
[0060] In addition, data may be linked to a label printing system (not shown) that manages the printing information of food labels, a barcode for identifying a product may be photographed with a camera, and the barcode information may be output to the label printing system, and information on the characteristic ingredients of the lunch box to which the barcode is attached may be obtained from the response information obtained. This allows information on changes in presentation and ingredients due to various campaigns to be obtained from other systems.
[0061] The information regarding various campaigns can also be specified by campaign labels on which decorative characters of a predetermined shape and color are printed.
[0062] The recognition processing unit 53b may alternatively perform color shading processing to convert a specified color into a 256-level gray image with the highest gradation of lightness, or color binarization processing to extract only a specified color range based on a threshold from a multi-level range of 256 gradations for each of RGB, and further may perform preprocessing such as Bayer conversion on the output image data of the camera 41 when a Bayer camera is used.
[0063] Here, the recognition processing unit 53b of the configuration determination program 53 has a function (recognition processing means) of performing character recognition and / or image recognition on the input image by the image input function of the work image input unit 53a, and acquiring first ingredient information corresponding to at least a specific content in the work W, for example, any one of the staple food Wa, main dish Wb, side dish Wc, and side dish Wd in the packed lunch W. Furthermore, the specific content in the work W referred to here may of course be any one of the main ingredients and ingredients of a rice ball packaged in an openable transparent cover or pack-like container and with an ingredient label attached, or any one of the main ingredients and ingredients of noodles packaged in an openable transparent container and with an ingredient label attached, or may be ingredients or medicines that are stored inside or removed from a transparent box depending on the type.
[0064] In addition, the material composition determination unit 53c of the composition determination program 53, in cooperation with the recognition processing unit 53b, detects other contents similar to a specific content in a reference work of similar composition, for example, a main dish Wb' in a packed lunch work W as shown in Figure 4, based on the results of character recognition and / or image recognition of the input image of the work image input unit 53a, and obtains second material information corresponding to the difference from the first material information corresponding to the aforementioned specific content Wb, as information regarding added ingredients, toppings, changed sauces and other ingredients, or significant increases or decreases (Wb'-Wb) in known ingredients, etc.
[0065] Furthermore, the composition determination program 53 has a composition determination function that identifies multiple placement areas A to D in the work W imaged by the camera 41, and for each identified placement area A, B, C or D, performs a predetermined recognition process such as image recognition or character recognition based on the image data of the contents Wa to Wd, such as ingredients, for each area, and determines the material composition of the contents Wa, Wb, Wc or Wd for each area.
[0066] In addition, the configuration determination program 53 also has the function of comparing the material composition of each content Wa, Wb, Wc or Wd for each placement area A, B, C or D with registered information of known material compositions, and determining whether or not a similar material composition exists for each placement area.
[0067] The sensitivity adjustment program 54 is configured to estimate the sensitivity effect on a specified detection value such as the amount of X-ray transmission due to the determined material composition and an appropriate control sensitivity based on information on the sensitivity-affecting materials stored in the control sensitivity memory 64, provided that the composition determination program 53 has determined the material composition of the contents to be placed in each of the multiple placement areas A to D, for example, the main dish Wb in placement area B, and to propose and output adjustments to the judgment criteria such as the judgment threshold value for item inspection so that an appropriate control sensitivity is obtained according to the estimated result.
[0068] The sensitivity adjustment program 54 is also configured to perform the functions of a sensitivity influence determination unit 54a and a sensitivity adjustment suggestion unit 54b shown in Fig. 1. The sensitivity influence determination unit 54a has a function of determining whether a change has occurred in the material composition related to the sensitivity-influencing material from the control sensitivity memory 64 when it is determined based on the material composition information of the work W from the composition determination program 53 that there is a reference work of a similar composition in a new work W to be inspected, and the sensitivity adjustment suggestion unit 54b has a function of estimating the degree of change in the detection sensitivity of a predetermined detection value such as the amount of X-ray transmission corresponding to the change in the material composition related to the sensitivity-influencing material based on the determination result of the sensitivity influence determination unit 54a and the stored information of the control sensitivity memory 64, and proposing and outputting adjustment of the judgment criteria such as the judgment threshold value of the item inspection so that an appropriate control sensitivity is obtained according to the estimation result.
[0069] Furthermore, when the composition determination program 53 determines that a significant partial change (the above-mentioned second material information, for example, main dish Wb', difference in Wb) that changes the material composition of the object to be inspected has occurred in any of the multiple placement areas A to D, the sensitivity adjustment program 54 is configured to propose and output an adjustment to the judgment criteria for item inspection for a specified detection value such as the amount of X-ray transmission for any of the contents corresponding to the placement area A, B, C or D where the partial change has occurred, for example, main dish Wb', i.e., the judgment threshold (limit) for detecting foreign objects or missing parts.
[0070] As shown in Figure 4, in the item inspection device 10 of this embodiment, an operation input screen 70 for inputting settings, selection instructions, etc. from an operation input unit 33 consisting of a touch panel or a tablet terminal, etc., is displayed on a display unit 34 consisting of a liquid crystal display, etc.
[0071] In this operation input screen 70, for example, when the workpiece W on the transport unit 11 is irradiated with X-rays from the X-ray source 21 of the inspection unit 12 and X-ray transmission image data for each inspection period corresponding to each workpiece W is stored in the X-ray image memory 61, the X-ray transmission image of the workpiece W being inspected is displayed on the inspection screen 71 as shown in Fig. 4. Also, the result of determining whether there is a foreign object or a missing part is displayed on the inspection screen 71 with the characters "OK" or "NG", for example. Note that the X-ray transmission image here may be subjected to a feature extraction filter process or the like to emphasize the foreign object image.
[0072] The operation input screen 70 displays and outputs a selection operation button 72 for a foreign object detection mode, a selection operation button 73 for a threshold setting mode, a moveable cursor 74 for specifying an operation area, a plurality of movement operation buttons 75 for movement in multiple directions, for example up, down, left and right, a confirmation button 76 for confirming an operation upon selection, a numeric display 77 for displaying input values and setting values, a numeric keypad input section 78, and an enter key 79, all of which are displayed and output in a state allowing operation input and selection operation.
[0073] Next, the operation of the article inspection apparatus 10 of the present embodiment will be described, along with a description of one embodiment of an article inspection method of the present invention that can be carried out using the article inspection apparatus 10.
[0074] [Mode Selection] First, the operation input procedure for selecting a mode by pressing the foreign object detection mode selection operation button 72 or the threshold setting mode selection operation button 73 will be described with reference to the flowchart of FIG.
[0075] First, until an operator who determines the operating conditions, etc., of the object inspection device 10 presses either the foreign object detection mode selection operation button 72 or the threshold setting mode selection operation button 73, the CPU 31 checks at predetermined time intervals whether a mode selection operation input has been made (if NO in step S1).
[0076] Next, when a mode selection operation is input (YES in step S1), it is determined whether the selection operation has been performed by pressing the foreign object detection mode selection operation button 72 or the threshold setting mode selection operation button 73 (step S2), and if the foreign object detection mode selection operation button 72 has been selected at this time, then the foreign object detection program in the program storage unit 32 is started and operation in the foreign object detection mode is performed (step S3). On the other hand, if the threshold setting mode selection operation button 73 has been selected at this time, then the parameter setting program in the program storage unit 32 that allows the threshold setting input and increase / decrease operation is started and operation in the threshold setting mode is performed (step S4).
[0077] [Foreign object detection mode] The procedures for controlling operation in the foreign object detection mode and for controlling operation during the sensitivity test (test measurement) described below are substantially similar to those of conventional object inspection devices, such as those described in Patent Document 1. For example, when the foreign object detection mode button 73 is pressed, a mode execution program (not shown) in the program storage unit 32 starts an object inspection program capable of performing foreign object detection, and the foreign object detection process is executed.
[0078] At this time, the CPU 31 outputs drive commands to each drive circuit 25, 27, 28, and X-rays are irradiated from the X-ray source 21 into the inspection area Z1 in a fan beam shape perpendicular to the conveying direction D1 of the work W placed on the conveyor belt 11a.Then, the conveying section 11 is operated by the rotational drive of the conveying drive motor 26, and the conveying of the work W, which is a lunch box containing ingredients Wa to Wd, begins.
[0079] Then, when the workpiece W passes between the emitter and receiver of the object detection sensor 24, at a predetermined timing, the X-rays that have passed through the workpiece W are detected by the X-ray detector 22 and converted into an electrical signal corresponding to a predetermined detection value, and an X-ray line sensor image is generated and sequentially imported into the X-ray image memory 61 via the X-ray image input unit 23 (information storage step).
[0080] During this time, the image judgment process for detecting foreign objects is executed in synchronization with the ingredients Wa to Wd, which are the contents of the work W, passing through the inspection area Z1, so that image judgment for detecting foreign objects is performed by the aforementioned item inspection program 51 using the corresponding foreign object detection threshold for each placement area A, B, C or D stored in the X-ray image memory 61.
[0081] [Threshold setting mode] When operating in the threshold setting mode, first, prior to setting the threshold, the operator presses the threshold setting mode selection operation button 73 on the operation input screen 70, whereupon the threshold setting program 52 in the program storage unit 32 is executed, and the threshold setting process as shown in FIG. 6 is performed.
[0082] This threshold setting process is intended to set inspection parameters for determining pass / fail in item inspection, and in order to prevent inappropriate thresholds from being set due to incorrect operation, part of the process may be allowed to be executed only by an administrator who has been granted access through password authentication, etc.
[0083] First, a check is made to see whether a new type of work W for which the current threshold value (limit in the figure) is to be set, i.e., a product with a material composition similar to that of a product that will be manufactured and inspected on the production line or a product that has just started production and is not yet reaching the inspection process, has already been registered (step S11).
[0084] At this time, if there is a monitoring image from the camera 41, the composition determination program 53 is executed to identify the material composition of the pack P of the work W and the ingredients Wa to Wd stored therein by image recognition and character recognition processing. Furthermore, the sensitivity adjustment program 54 is executed to search for a material composition (including the pack) similar to the work W for which the threshold value is to be set in the control sensitivity memory 64, and if a similar material composition is found, it is determined that a similar product exists (if YES in step S11).
[0085] Here, when a similar material configuration is found and a camera image corresponding to that material configuration is stored in the product type registration / setting memory 63, the image currently captured by the camera 41 and the searched stored image may be displayed side by side for comparison, so that even if the material configuration appears to be similar, the operator can identify inappropriate data that cannot be used as a reference for setting the current threshold value.
[0086] Even if there is no monitoring image from the camera 41, it is determined that there is a similar product if, for example, base product registration information is used when registering the product type of the workpiece W for which the threshold value is to be set, or if a sample image of the workpiece W captured in advance can be used. The process when a sample image at the time of product type registration can be used will be described later with reference to FIG.
[0087] In the threshold setting process (limit adjustment) shown in FIG. 6, if a product with a material composition similar to the work W being set this time has not yet been registered as a product type, a similar material composition is not found in the management sensitivity memory 64, and it is determined that there is no similar product (if NO in step S11).
[0088] In this case, to specify multiple placement areas A to D in the pack P of the work W, the operator touches the operation input screen 70 or selectively operates multiple movement operation buttons 75 arranged crosswise or radially on the operation input screen 70 to move the cursor 74, selects multiple points or lines that can identify the contour shape of each of the placement areas A to D, or selects the area surrounded by the selected contour line, and then presses the confirm button 76 to specify each of the placement areas A to D (step S12). In the case of the work W illustrated in Figure 4, for example, in the case of placement area B, the area can be specified by specifying the two diagonal vertices of the rectangle (the black circle positions in the figure).
[0089] Next, a process is executed to identify ingredients having a large sensitivity effect in a specified area of the work W, for example, ingredients in the placement area B, for example, the main dish Wb (step S13). Here, a large degree of influence means that the sensitivity effect is such that adjustment of the judgment threshold is required when the addition of the ingredient or a significant increase or decrease in the amount of the ingredient is maintained, because there is a concern that the detection accuracy will decrease if the judgment threshold for foreign objects or missing items is maintained.
[0090] In this case, the configuration determination program 53 is executed to classify and identify the material configuration in each placement area A, B, C, or D of the workpiece W by image recognition or character recognition using the image from the camera 41 for each placement area. Furthermore, the sensitivity adjustment program 54 is executed to extract similar material configurations in the control sensitivity memory 64 for each placement area A, B, C, or D, and to read out the main material configurations that have a large degree of influence (sensitivity influence) on the judgment threshold for foreign objects and missing parts, and the degree of influence thereof.
[0091] At this time, for each placement area A, B, C or D, the composition of ingredients that has a large sensitivity effect among the ingredients of a specific content within that area, for example, the main dish Wb in the lunch pack W, is obtained as the first ingredient information.
[0092] Then, the sensitivity effect of the material corresponding to the acquired first material information is estimated based on the sensitivity effect information in the control sensitivity memory 64, the required judgment threshold is proposed and output as a limit corresponding to the optimum inspection sensitivity (step S14), and an operation input to determine the limit is requested from the person in charge who will be the operator (step S15). In addition, together with the display of the optimum limit, the direction and adjustment range of the limit are temporarily displayed, and the display information is stored and held in the control sensitivity memory 64 so as to be readable until the processing stage of fine adjustment of the limit, which will be described later.
[0093] Next, it is determined whether the necessary limits have been set and adjusted for each placement area A, B, C or D as described above (step S16), and if there is any remaining area that has not been set or adjusted (YES in step S16), the processing subsequent to remaining area setting (steps S12 to S15) is executed for that remaining area in sequence (step S20).
[0094] Here, whether or not the necessary limit setting and adjustment has been completed can be determined by, for example, requesting the selection of the next setting area or by having the user select the end of limit setting and adjustment at the stage where limit setting and adjustment has been completed for one placement area A, B, C, or D. Alternatively, it is also possible to estimate the presence or absence of a remaining area from the size of the image area of the work W that is not used for area setting.
[0095] Once the limits have been set and adjusted for all placement areas A to D, the operator is requested to perform a trial item inspection by the inspection unit 12 using product samples and test pieces of the work W, or using samples containing foreign matter or missing parts, and the inspection sensitivity according to the judgment threshold value is test measured to check whether the required inspection sensitivity (hereinafter referred to as the control sensitivity) that enables accurate item inspection has been obtained (step S17).
[0096] Here, obtaining the control sensitivity, which is the required inspection sensitivity, means that when a test piece of the minimum size required for foreign object detection is placed in each placement area A, B, C, or D to be test measured, the test piece is detected and the inspection result is NG. Also, the test measurement is repeatedly performed for all placement areas A to D until it is checked whether a test piece of the minimum size is detected when placed in a single area and the inspection result is NG.
[0097] Next, whether or not the control sensitivity has been obtained is determined based on whether or not there is an area during the test measurement where the inspection result is not judged as NG and the required control sensitivity has not been obtained (step S18).
[0098] Then, if there is an area where the required control sensitivity is not obtained, the previously stored limit value and its adjustment direction and adjustment range for that insufficient sensitivity placement area A, B, C or D are displayed again on the operation input screen 70, and a display is displayed requesting operation input for fine adjustment of the limit.
[0099] Specifically, for each placement area A, B, C or D with insufficient sensitivity, for example, a limit value displayed on a numeric display 77 on the operation input screen 70 is manually input using the numeric keypad input section 78, or a highlighted up / down movement operation key 75 is selected, and then the limit is fine-tuned by pressing the enter key 79 (step S19).
[0100] After such fine adjustment of the limits, a test measurement is performed again (step S17), and then it is determined again whether or not the control sensitivity has been obtained (step S18).
[0101] At this time, if the required control sensitivity is obtained, the process of setting each placement area and adjusting the limits for the workpiece W with no similar products is completed.
[0102] On the other hand, if it is determined in the first judgment step S11 that a similar product exists (YES in step S11), the work W for which the current threshold value (limit in the figure) is to be set will have the material composition of the pack P of the work W and the ingredients Wa to Wb stored therein already identified by image recognition or character recognition processing by executing the composition judgment program 53 based on images from the camera 41, etc., and a material composition (including the pack P) similar to the work W for which the threshold value is to be set will be searched for in the management sensitivity memory 64, and the similar material composition will be found by executing the sensitivity adjustment program 54.
[0103] In this case, for each placement area A, B, C or D, for other contents similar to a specific content in a similar product that has a large sensitivity effect, for example, a main dish Wb' similar to the main dish Wb in a lunch pack W of a similar product, in addition to the above-mentioned first ingredient information contained in the similar ingredient composition, second ingredient information corresponding to the difference from the first ingredient information is obtained as added ingredients (Wb'-Wb) or as an increase or decrease in known ingredients (Wb'-Wb), and then it is checked whether a significant difference in the ingredient composition compared to the similar product has been detected as the second ingredient information for any of the existing placement areas A to D (step S21).
[0104] Then, the sensitivity effect of the material corresponding to the acquired second material information is estimated based on the sensitivity effect information in the control sensitivity memory 64, the requested adjusted judgment threshold is proposed and output as an optimum limit (step S22), and an operation input to determine the limit is requested from the person in charge who will be the operator (step S23). In addition, together with the display of the optimum limit, the direction and adjustment range of the limit are temporarily displayed, and the display information is stored and held in the control sensitivity memory 64 so as to be readable until the processing stage of fine adjustment of the limit.
[0105] Next, it is determined whether the necessary limit adjustments have been made for each placement area A, B, C or D as described above (step S24), and if there is any remaining area that has not been adjusted (YES in step S24), the process moves to the next area (step S25), and the process of determining whether there is a difference in the material composition between the areas and subsequent processes (steps S21 to S23) are performed for that remaining area.
[0106] Here, whether or not the necessary limit adjustments have been completed can be automatically determined based on whether or not there are differences in the material composition for each area, but once limit adjustments for one placement area have been completed, it is also possible to request selection of the next setting area or to allow selection of the end of limit adjustments.
[0107] Next, once the setting and adjustment of the limits for all placement areas A to D has been completed, a test measurement of the inspection sensitivity described above is performed using a product sample and a test piece of the work W, or using a contaminated or missing sample, to check whether or not the control sensitivity has been obtained (steps S17 to S18). If there are areas during the test measurement where the inspection result is not NG and the required control sensitivity has not been obtained (NO in step S18), the fine adjustment of the limits (step S19) is as described above.
[0108] [When registering a variety] 7, in the case where an area is set at the time of registering a product type, first, an operator selects the type of product to be the work W (step S31). For example, for products sold at convenience stores in a package with a transparent top side, such as boxed lunches, rice balls, salads, etc., whose material composition can be grasped by capturing an image with a camera 41, the product types are displayed in the form of a hierarchical classification or a list, etc., and the target product type is selected by selecting one of the products to be registered from among them.
[0109] Next, a sample of the workpiece W of that product type is photographed by the camera 41 (step S32).
[0110] Next, an image of a product, for example a bento box, is read from the camera 41, and in order to specify multiple placement areas A to D in the pack P of the work W, multiple movement operation buttons 75 on the operation input screen 70 are selectively operated to move the cursor 74, and multiple points or lines that can identify the contour shape of each of the placement areas A to D are selected, or the area surrounded by the selected contour lines is selected, and then the confirmation button 76 is pressed, thereby specifying and identifying each of the placement areas A to D (step S33).
[0111] Next, by executing the configuration determination program 53 based on the image captured by the camera 41 and the information on the identified placement areas A to D, the pack P of the work W and the classification of the ingredients contained therein, for example, rice, noodles, hamburger steak, fried chicken, etc., and the material composition of each ingredient are identified for each placement area A, B, C or D through image recognition and character recognition processing (step S34).
[0112] Next, it is checked whether the ingredient classification has been identified (step S35), and if the ingredient classification cannot be performed (NO in step S35), an operation input is performed to register a new ingredient classification name (step S36), and the name is registered in the database in the variety / registration setting memory 63 of the data storage unit 35 (step S37).
[0113] When this registration makes it possible to identify the ingredient classification (YES in step S35), then the composition determination program 53 is executed to extract candidate ingredients that make up the ingredient composition of that ingredient classification from the variety registration / setting memory 63 of the data accumulation unit 35 (step S38), and the relevant ingredients are listed in a form that allows selection of the ingredients (step S39).
[0114] Next, a check is made by inputting a selection operation to see whether or not the corresponding ingredient is present in the list (step S40), and if the corresponding ingredient is not present (NO in step S40), a new ingredient and the name of its classification are set and input (step S41).
[0115] Next, based on the image captured by camera 41 and the information on the identified placement area, for each placement area, a similar material composition (including pack P) is searched for in control sensitivity memory 64 by executing sensitivity adjustment program 54 for the material composition obtained by executing composition determination program 53, and if a similar material composition is found, the sensitivity effect of the material corresponding to the second material information obtained as the difference from that material composition is estimated based on the sensitivity effect information in control sensitivity memory 64, and the required judgment threshold is set as a provisional limit (step S42), and the new ingredient is registered in association with a specified detection value such as the amount of X-ray transmission and a judgment threshold related to foreign object detection and missing item detection (step S43).
[0116] In addition, when a new ingredient is registered (corresponding to steps S41 to S43), the series of processes may be terminated at step S43 so that only the ingredient registration is performed in advance before the product that will actually contain the ingredient is manufactured. In other words, it is preferable to perform only the registration of the new ingredient in advance as preparation for manufacturing the product that will actually contain the ingredient. This makes it possible to smoothly execute the threshold setting process for the product that contains the new ingredient by making step S40 YES at the start of actual manufacturing.
[0117] As a result, when the relevant ingredient is found in the list (YES in step S40), the recognition information obtained by image processing, character recognition, etc. of the target area obtained by executing the composition determination program 53 is updated taking into consideration the registered ingredient name and the classification name of the ingredient, etc. Therefore, it becomes possible to calculate the degree of sensitivity influence for each placement area based on the type and amount (or mass) of the ingredient (step S44), and it becomes possible to propose and output the optimum limit value for that area (step S45).
[0118] Next, it is checked whether there is any remaining area (step S46), and if there is any remaining area in which the registration of a new classification ingredient and the proposed output of its limit value have not been completed (YES in step S46), the process moves to the next area (step S47), and the processing subsequent to the step of identifying the ingredient classification for each placement area based on the image captured by camera 41 and the identified placement area information (steps S34 to S45) is repeated until there is no remaining area (NO in step S46).
[0119] In this embodiment, when performing an article inspection of a work W containing multiple contents such as ingredients Wa-Wd and a pack P based on an inspection image, information on predetermined detection values such as the amount of X-ray transmission related to the X-ray inspection image is stored in the X-ray image memory 61 (information storage step), the work W is imaged by the camera 41 (article imaging step), and predetermined recognition processing such as image recognition and character recognition is performed based on the image data of the imaged work W to identify sensitivity-influencing materials that significantly affect the amount of X-ray transmission of the work W, and to determine the material composition of such contents (composition determination step).Then, based on the material composition of the determined contents and the stored information in the control sensitivity memory 64, the detection sensitivity for predetermined detection values such as the amount of X-ray transmission corresponding to the material composition is estimated, and a judgment threshold (limit), which is the judgment criterion for article inspection, is proposed and output so that an appropriate control sensitivity is obtained (proposal output step).
[0120] Therefore, during article inspection, a predetermined recognition process is executed based on the image data of the captured work W, and the detection sensitivity is estimated taking into consideration the degree of increase or decrease in a predetermined detection value such as the amount of X-ray transmission corresponding to the material composition of the contents, based on the material composition of the contents that has a large effect on the sensitivity of the work W and the stored information on the sensitivity-influencing materials stored in the control sensitivity memory 64, and the judgment criteria for the article inspection are proposed and output as suitable reference values corresponding to the estimated sensitivity. As a result, it is possible to sufficiently reduce the workload of setting judgment criteria such as judgment threshold levels that serve as inspection parameters for each type, and even inexperienced managers can perform appropriate setting work with a light burden.
[0121] Furthermore, in this embodiment, when a wide variety of similar articles are to be inspected, it is possible to propose a reference value that is appropriately adjusted to the judgment criteria for similar articles, thereby making it possible to further reduce the workload of setting the judgment threshold levels and the like, which are inspection parameters for each article type.
[0122] In addition, in this embodiment, when the composition determination program 53 acquires information on the material composition of the contents of the workpiece W, it becomes possible to grasp the sensitivity influence level of the material composition on a predetermined detection value such as the amount of X-ray transmission related to the inspection image based on the stored information in the control sensitivity memory 64, which is a sensitivity influence material storage unit. Therefore, it becomes possible to propose and output appropriate judgment criteria for item inspection according to the material composition that significantly affects the predetermined detection value.
[0123] Furthermore, in this embodiment, the configuration determination program 53 obtains first material information corresponding to the material composition of multiple contents in the work W from the results of a specified recognition process, and determines the contents that significantly affect a specified detection value of the work W based on the obtained information. Therefore, when a change occurs in the contents that significantly affects the specified detection value, it is possible to timely propose and output adjustments to the judgment criteria for the necessary item inspection.
[0124] Furthermore, in this embodiment, the configuration determination program 53 has an image input means 53a that inputs an image of the workpiece W as an image capable of character recognition and / or image recognition, and a recognition processing means 53b that recognizes and processes the input image to obtain first material information corresponding to the material composition of at least a specific content in the workpiece W. Therefore, when the first material information that significantly affects a predetermined detection value is obtained, it is possible to accurately grasp the level of sensitivity influence on the detection sensitivity of the X-ray transmission amount, etc. related to the inspection image, and then propose and output the necessary determination criteria.
[0125] In addition, in this embodiment, based on the recognition processing results by the recognition processing means 53b, second material information corresponding to the difference from the first material information is obtained for the material composition of other contents Wb' that are similar to the material composition of a specific content Wb, for example. Therefore, it becomes possible to quickly, easily, and accurately set the judgment threshold level and other inspection parameters for each type for a work W that has other contents Wb' that are similar to the specific content Wb.
[0126] In addition, in this embodiment, the work W is configured such that multiple contents Wa to Wd are arranged in multiple corresponding placement areas A to D, and information on specified detection values such as the amount of X-ray transmission related to the multiple contents Wa to Wd is stored in correspondence with each of the multiple placement areas A to D, making it possible to accurately propose and output judgment criteria for each placement area depending on the material composition of the contents Wa, Wb, Wc or Wd in each placement area A, B, C or D.
[0127] In addition, for each of the multiple placement areas A to D, the material composition of the contents that have already been registered and the acquired information on the material composition of the contents to be inspected by a predetermined recognition process are compared to determine whether or not a partial change that significantly affects a predetermined detection value has occurred. Therefore, it is possible to accurately propose and output the necessary adjustment of the judgment criteria while using the setting information of the contents that have already been registered.
[0128] In this way, in this embodiment, it is possible to provide an item inspection device and an item inspection method that can reduce the burden of setting judgment criteria that serve as inspection parameters for each type of work W while ensuring the required inspection sensitivity of item inspection using the X-ray inspection method.
[0129] In the above-mentioned article inspection method, the pack P and the ingredients Wa-Wd stored therein have been described, but in order to identify the pack P on the transmission image, for example, the X-ray generator drive circuit 28 may set the X-ray irradiation conditions of the X-ray source 21 to low output, or the image processing conditions may be set to area extraction processing for recognizing the arrangement areas A-D of the pack P, thereby transporting only empty packs P that do not contain the objects Wa-Wd as ingredients. This makes it possible to generate X-ray images corresponding to the arrangement areas A-D of the pack P, so that the arrangement areas A-D can be specified with high accuracy.
[0130] The placement area in the present invention is not limited to a concave storage area formed in a resin pack, but may be a recess or a surrounded area on a testing tray. Furthermore, the top lid or cover is not limited to a transparent one, but may be nearly translucent, or may have holes or openings, and it is preferable to have the lid open when capturing an image with the camera 41, for example.
[0131] Furthermore, in the above embodiment, the predetermined inspection image used in the article inspection has been described as an X-ray inspection image corresponding to the distribution of the amount of X-rays transmitted through the workpiece W, but the present invention is also applicable to article inspections that use inspection images obtained by other observation methods. Therefore, the predetermined detection value referred to in the present invention is not limited to the amount of X-ray transmission, but may be, for example, a temperature obtained from a thermograph that observes the heat dissipation state or cooling state of the workpiece W, and the present invention may also be applied to cases where the sensitivity of such a predetermined detection value is affected depending on the material composition.
[0132] As described above, the present invention can provide an item inspection apparatus and an item inspection method that can reduce the burden of setting judgment criteria that serve as inspection parameters for each type of item while ensuring the required inspection sensitivity, and is useful for item inspection apparatuses and methods in general that inspect items based on inspection images of the item to be inspected. [Explanation of symbols]
[0133] 10. Article inspection equipment (X-ray inspection equipment) 11 Conveyor section 11a Conveyor Belt 11b Upstream roller (drive roller) 11c Upstream roller 11d, 11e Downstream roller 12 Inspection Department 21 X-ray source 22 X-ray detector 23 X-ray image input unit 24 Object detection sensor 25 X-ray detector driver circuit 26 Transport drive motor 27 Motor drive circuit 28 X-ray generator driver circuit 30 Control circuit 31 CPU 32 Program storage section 33 Operation input section 34 Display section 35 Data Storage Section 41 Camera (item imaging section) 42 Camera image input unit 51 Article Inspection Program 52 Threshold Setting Program 53 Configuration determination program (configuration determination part) 53a Work image input unit (image input means) 53b Recognition processing unit (recognition processing means) 53c Material composition determination unit (determination means) 54 Sensitivity adjustment program (suggested output section) 54a Sensitivity effect judgment part 54b Sensitivity adjustment proposal section 61 X-ray image memory (information storage unit) 62 Camera Image Memory 63 Product registration and setting memory 64 Management sensitivity memory (sensitivity affecting material storage means) A, B, C, D placement areas (multiple placement areas) W Work (item to be inspected) Wa Staple food (ingredients, contents) Wb Main dish (ingredients, contents) Wc Side dish (ingredients, contents) Wd Side dishes (ingredients, contents) Z1 Inspection area
Claims
1. An article inspection device that uses X-ray inspection images generated by irradiating an inspected article (W) in which a plurality of contents (Wa, Wb, Wc, Wd) are arranged in a corresponding plurality of arrangement areas (A, B, C, D) with X-rays, and inspects the article according to different judgment criteria for each of the plurality of arrangement areas, an information storage unit (61) for storing information on a predetermined detection value related to the X-ray inspection image; an article imaging unit (41) that outputs appearance image data obtained by imaging the appearance of the inspected article; a composition determination unit (53) that identifies each of the plurality of placement areas from the appearance image data of the inspected article captured and output by the article imaging unit, and determines a material composition of the contents of the inspected article from features extracted by executing a predetermined recognition process based on the appearance image data of the contents for each of the identified placement areas; a proposal output unit (54) that, when the material composition of the contents is determined by the composition determination unit, estimates a detection sensitivity for the predetermined detection value related to the X-ray inspection image based on the material composition of the contents, and proposes and outputs the judgment criteria for the item inspection using the X-ray inspection image for each of the specified areas of the multiple placement areas; a product registration information storage unit (63) for storing product type and setting information of the product to be inspected together with information on the material composition, An item inspection device characterized in that the configuration determination unit determines, for each of the multiple placement areas in the inspected item, based on the information stored in the product registration information storage unit and the information acquired by the specified recognition processing, whether or not a partial change has occurred in the material composition of the contents corresponding to each placement area that significantly affects the specified detection value related to the X-ray inspection image.
2. The method further includes a sensitivity influence material storage unit (64) for storing information on sensitivity influence of each of a plurality of materials on the predetermined detection value, The object inspection device described in claim 1, characterized in that the proposal output unit (54) executes a program that searches the sensitivity affecting material memory unit for information on the material composition determined by the composition determination unit and material compositions similar to the material composition, and estimates the detection sensitivity for the specified detection value based on the stored information of the material composition found by the search.
3. The configuration determination unit is an image input means (53a) for inputting the appearance image data of the inspected article from the imaging unit as a character-recognizable image; The object inspection device described in claim 1 or 2, characterized in that it has a recognition processing means (53b) that performs character recognition on an input image by the image input means and obtains first material information corresponding to at least the material composition of a specific content of the inspected object.
4. The object inspection device described in claim 3, characterized in that the recognition processing means of the composition determination unit, based on the results of character recognition of the input image by the image input means, acquires, in addition to the first material information, second material information corresponding to the difference from the first material information for the material composition of other contents (Wb') that are similar to the material composition of the specific content (Wb).
Citation Information
Patent Citations
X-ray foreign matter detection method and x-ray foreign matter detection system
JP2004028768A
X-ray inspection device
JP2007232586A
Automatic recipe creation apparatus and program
JP2010061382A
Device and method for supporting cooking
JP2010191745A
Cooking apparatus, cooking method, cooking control program, and method of providing cooking information
JP2015158351A