Object counting system, device and method, and object counting management system

The object counting system addresses the challenge of accurately counting connected parts on reels by using X-ray absorbing portions to generate non-holographic images and determine closed regions, achieving efficient and cost-effective counting.

JP7582637B2Active Publication Date: 2024-11-13MICRO CONTROL SYST LTD
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2018218116
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2018-11-21
Publication Date
2024-11-13
Estimated Expiration
2038-11-21

AI Technical Summary

Technical Problem

Conventional object counting methods, particularly for parts reels, face challenges in accurately counting connected parts images due to their close contact, leading to increased costs with high-resolution X-ray and CCD devices, which are expensive and burdensome.

Method used

An object counting system using an X-ray absorbing portion to generate non-holographic images, determining closed image regions, calculating region sizes, and associating count numbers with size intervals, enabling accurate counting without excessive processing load.

Benefits of technology

Accurately counts connected parts without high-resolution imaging, reducing costs and processing burdens, and efficiently managing parts without rewinding reels.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007582637000001
    Figure 0007582637000001
  • Figure 0007582637000002
    Figure 0007582637000002
  • Figure 0007582637000003
    Figure 0007582637000003
Patent Text Reader

Abstract

To provide an object counting program capable of more accurately performing an object counting process without imposing an excessive burden.SOLUTION: The object counting program for performing an object counting process using an image showing a plurality of objects, includes: object area determination means for determining a closed image area corresponding to an object in an image; area size determination means for calculating an amount related to a size of each determined closed image area; count number determination means for determining a count number in the closed image area based on the amount related to the size calculated for each closed image area; and object number determination means for determining the number of objects based on the determined number of counts for each determined closed image area, to function a computer.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a technique for performing counting processing on a plurality of objects. [Background technology]

[0002] Traditionally, the task of managing parts in manufacturing companies has been an important task in the manufacture of products, but at the same time, it has also been a major burden on management. In particular, in recent years, with the commoditization of IT and electronics technology, an increasing number of small and medium-sized enterprises are developing and marketing a large number of original products, but the types of parts used by these companies are also increasing, making appropriate parts management a major issue.

[0003] For example, component reels that store electronic components such as chip resistors and chip capacitors, which are indispensable for the manufacture of electronic devices, arranged on tape and wound up, are required separately for each type and specification of electronic components, and there are often a huge number of them. The task of managing the number of unused components remaining on each such component reel is a huge burden.

[0004] To address such problems, for example, Patent Document 1 discloses a component counting device having an image forming unit 122 that forms an image from an electrical signal based on the intensity distribution of X-rays obtained from a detection unit 112, and a counting unit 123 that analyzes the formed image and counts the number of images of electronic components present in the image.

[0005] Here, the component image selection unit 126 of the counting unit 123 is a processing unit that, when an electronic component image exists in an overlapping portion of a plurality of formed images, selects whether or not the component image is a component image to be counted. Also, the selection criteria are set such that if the area of ​​the electronic component image appearing in the image of the overlapping portion is half or more of the total area of ​​the electronic component images and is the image formed first, it is counted, and if it is less than half, it is not counted.

[0006] Patent Document 1 lists one of the advantages of this type of component counting device, in that it counts the number of components based on an image obtained from the intensity distribution of transmitted X-rays, making it possible to count the components almost as they are, without the need to unwind and rewind the component tape from the reel, as is the case with conventional chip reel counters. [Prior art documents] [Patent documents]

[0007] [Patent Document 1] JP 2007-73710 A Summary of the Invention [Problem to be solved by the invention]

[0008] However, in conventional technologies such as that described in Patent Document 1, which counts parts from images obtained by irradiating them with X-rays, the captured part images are not isolated but are connected together, making it difficult to perform accurate counting.

[0009] In particular, when counting objects that are parts reels, the wound tapes are in close contact with each other, so there are many cases where the parts on the tapes are also photographed as being connected.

[0010] In this case, in order to suppress counting errors, it may be possible to obtain extremely high image resolution by using an X-ray analysis device equipped with an irradiation device capable of emitting higher-intensity X-rays and a higher-performance CCD (Charge Coupled Device) device; however, such a device itself would be very expensive, which goes against the goal of reducing the cost of parts management operations.

[0011] Therefore, an object of the present invention is to provide an object counting device, method, and program that can perform object counting processing more accurately without imposing an excessive processing burden. [Means for solving the problem]

[0012] According to the present invention, an object counting method is provided that uses an image showing a plurality of objects and counts the number of the objects. system And, The object has an X-ray absorbing portion that absorbs X-rays without substantially interfering with the X-rays. 、 For the object in question X Line An irradiation unit for irradiating light; Detects X-rays irradiated onto the target object Detector and, From the detection result by the detector, Non-holographic image at the detector An image generating means for generating an image , an object region determining means for determining a closed image region in the non-holographic image at the detector that directly corresponds to the x-ray absorbing portion; A region size determination means for calculating a quantity related to the size of each of the determined closed image regions; a count number determining means for determining a count number in each closed image region based on the amount related to the size calculated for that closed image region; an object number determining means for determining the number of objects based on the determined count number for each of the determined closed image regions; have Object counting system is provided.

[0013] As one embodiment of the object counting program according to the present invention, it is preferable that the count number determination means sets a plurality of intervals for the quantity related to the size, each of which has a count number pre-assigned to it, and sets the count number for each closed image area to the count number associated with the interval to which the quantity related to the size calculated for the closed image area belongs.

[0014] In particular, it is also preferable that the count number determination means determines the section associated with the count number using a trained estimation model based on graph data showing the relationship between the amount related to the size and the number of closed image areas corresponding to this amount related to the size, and information identifying the object or the type of object.

[0015] Furthermore, as an example of application of the object counting program according to the present invention, the plurality of objects are a plurality of parts having metal portions stored in a parts reel, Non-hologram at the detector position It is also preferable that the image is an image generated by detecting X-rays irradiated onto the surface of the parts reel.

[0016] According to the present invention, there is also provided a method for producing a medicament for a medicament comprising the steps of: Using an image that contains multiple objects, the number of objects is counted. The object counting device and the object counting device can exchange information with each other. The An object counting and management system including an object management device used for managing objects, the object has an X-ray absorbing portion that absorbs X-rays without substantially interfering with them, and the image is a non-holographic image at the position of a detector that is generated by detecting X-rays irradiated to the object with the detector; The object counting device is an object region determining means for determining a closed image region in the non-holographic image at the detector that directly corresponds to the x-ray absorbing portion; A region size determination means for calculating a quantity related to the size of each of the determined closed image regions; a count number determining means for determining a count number in each closed image region based on the amount related to the size calculated for that closed image region; an object number determining means for determining the number of objects based on the determined count number for each of the determined closed image regions; having The object management device includes: a number information acquiring means for acquiring object number information, which is information relating to the number of the objects, from the object counting device; An identification information acquisition means for acquiring object identification information which is information for identifying a plurality of objects; a management location information acquiring means for acquiring management location information which is information relating to the locations at which a plurality of objects are managed; a management information generating means for generating object management information linking the object identification information, the management position information, and the object number information; a management information providing means for providing the generated object management information to an external object information management unit; An object counting and management system is provided having the following:

[0017] As an embodiment of the object counting management system according to the present invention, ,mosquitoThe count number determination means sets a plurality of sections for the amount related to the size, each section being associated with a count number in advance, and sets the count number of each closed image region as a count number associated with the section to which the amount related to the size calculated for the closed image region belongs; It is also preferable that the above-mentioned object management device further has an interval setting information providing means for acquiring or determining interval setting information for a plurality of objects to be counted, the interval setting information being used by the count number determination means when setting the interval, and providing the information to the object counting device.

[0018] The subject matter according to the invention Counting management system In another embodiment of the present invention, each of the plurality of managed objects is provided with an identification information providing unit capable of holding and externally presenting its own object identification information, The identification information acquisition means acquires removal target identification information which is information for identifying the managed object, at least a part of which is to be removed from the position; The above Object Management Device a means for determining whether the acquired identification information of the object to be taken out coincides with the identification information of the object to be taken out acquired from the identification information providing unit of the object to be taken out, and outputting a result of the determination; Step Furthermore Have It is also preferable.

[0019] Furthermore, the subject matter according to the invention Counting management system In yet another embodiment of the present invention, the object counting device displays a code representing information related to the determined number of the objects, or writes the information related to the number to a wireless tag for short-range wireless communication; The object management device has a code reading unit that reads the displayed code or a tag information reading unit that reads information written in the wireless tag, It is also preferable that the number information acquisition means acquires the object number information via a code reading unit or a tag information reading unit.

[0020] Furthermore, the subject matter according to the invention Counting management system In the above, the object management device is preferably a mobile terminal that can be carried by a person who performs the object management work, or a robot that can transport the object to the position.

[0021] According to the present invention, there is further provided an object counting device that uses an image showing a plurality of objects and counts the objects, comprising: The object has an X-ray absorbing portion that absorbs X-rays without substantially interfering with the X-rays. 、 The X-rays irradiated to the object Detect By detector From the detection results, the image in question is A non-holographic image at the detector position An image generating means for generating an image , an object region determining means for determining a closed image region in the non-holographic image at the detector that directly corresponds to the x-ray absorbing portion; A region size determination means for calculating a quantity related to the size of each of the determined closed image regions; a count number determining means for determining a count number in each closed image region based on the amount related to the size calculated for that closed image region; an object number determining means for determining the number of objects based on the determined count number for each of the determined closed image regions; An object counting device having the above-mentioned configuration is provided. Here, as one embodiment of the object counting device according to the present invention, it is also preferable that the count number determination means sets a plurality of intervals for the amount related to the size, each of which is previously associated with a count number, and sets the count number of each closed image region as a count number associated with the interval to which the amount related to the size calculated for the closed image region belongs. In this case, it is also preferable that the count number determination means determines the interval associated with the count number using a trained estimation model based on data of a graph showing the relationship between the amount related to the size and the number of closed image regions corresponding to the amount related to the size, and information identifying the object or the type of object.

[0022] According to the present invention, there is further provided an object counting method in a computer installed in an object counting device, which uses an image showing a plurality of objects and counts the objects, comprising the steps of: The object has an X-ray absorbing portion that absorbs X-rays without substantially interfering with the X-rays, and the image is formed by irradiating the X-rays on the object. By detector Generated by detecting , at the detector position Non-holographic Mu drawing It is an image, The Non-hologram at the detector position determining a closed image region in the image that directly corresponds to the x-ray absorbing portion; calculating a quantity related to the size of each of the determined closed image regions; determining a count for each closed image region based on the size quantity calculated for that closed image region; determining a number of objects based on the determined count for each determined closed image region; An object counting method is provided having the following: Effect of the Invention

[0023] According to the object counting device, method, and program of the present invention, it is possible to more accurately count the objects without imposing an excessive processing load. [Brief description of the drawings]

[0024] [Figure 1] 1 is a schematic diagram showing an embodiment of an object counting management system including an object counting device and an object management device according to the present invention. [Diagram 2] 1 is a functional block diagram showing a functional configuration of an object counting device and an object management device according to an embodiment of the present invention; [Diagram 3] 11 is a display image showing an embodiment of an object counting process using the object counting program according to the present invention. [Figure 4] 11 is a display image showing an embodiment of an object counting process using the object counting program according to the present invention. [Diagram 5] 11 is a display image showing an embodiment of an object counting process using the object counting program according to the present invention. [Figure 6] FIG. 2 is a sequence diagram showing an embodiment of an object management method (warehousing) according to the present invention. [Figure 7] FIG. 11 is a sequence diagram showing another embodiment of the object management method (warehousing) according to the present invention. [Figure 8] FIG. 2 is a sequence diagram showing an embodiment of an object management method (shipping) according to the present invention. [Figure 9] 11 is a schematic diagram showing another embodiment of an object counting management system including an object counting device and an object management device according to the present invention. FIG. [Figure 10] FIG. 11 is a functional block diagram showing a functional configuration of an object management device according to another embodiment of the present invention. [Figure 11] FIG. 11 is a sequence diagram showing still another embodiment of the object management method (warehousing) according to the present invention. [Figure 12] FIG. 11 is a sequence diagram showing another embodiment of the object management method (shipping) according to the present invention. [Figure 13] 1A and 1B are front and rear views of an embodiment of a case for storing component reels according to the present invention; [Figure 14]1A to 1C are a plan view, a bottom view, and a right side view of one embodiment of a case for storing component reels according to the present invention. [Figure 15] 1A and 1B are a front perspective view and a rear perspective view showing the names of each part in one embodiment of a case for storing parts reels according to the present invention; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0025] Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings.

[0026] [One embodiment of the object count management system] FIG. 1 is a schematic diagram showing an embodiment of an object counting management system including an object counting device and an object management device according to the present invention.

[0027] As shown in FIG. 1, the object counting management system of this embodiment is a system that stores component reels 4, on which electronic components such as chip resistors and chip capacitors are arranged and wound on tape, in component shelves 5 after determining the number of electronic components stored therein, and that can manage the incoming and outgoing information of the electronic components in a management server 6.

[0028] Specifically, this object counting management system: (a) an X-ray inspection device 2 that irradiates X-rays onto a plurality of objects (electronic components stored in component reels 4 in this embodiment) and generates images (image data) of the objects (electronic components); (b) an inspection device control PC1 as an object counting device that uses an image showing a plurality of objects (electronic components) and counts the objects (electronic components); (c) a parts shelf 5 for storing and managing a plurality of objects (electronic parts organized in the form of parts reels 4 in this embodiment) in a case 52; (d) a handheld terminal 3 as an object management device capable of "exchanging information" with the inspection device control PC 1 and used to manage a plurality of objects (electronic components); (e) a management server 6 as an object information management unit connected to the handheld terminal 3 for communication; It is equipped with:

[0029] Among these, the X-ray inspection device 2 irradiates the parts reel 4 with X-rays from an irradiation unit, measures the intensity of the transmitted X-rays using a detector such as a CCD (Charge Coupled Device), and generates a parts image (data) showing the part images of the electronic parts in the parts reel 4. Here, the irradiation unit and the detector may be arranged in various known forms. For example, a plurality of detectors may be arranged in a row within the irradiation range of the X-rays from the irradiation unit, and the parts reel 4 (or the case 52 housing the parts reel 4) may be moved between the irradiation unit and the detector row in a direction perpendicular to the detector row to perform X-ray photography.

[0030] Incidentally, in this embodiment, the X-ray inspection device 2 uses a characteristic object counting device (program) described later to count the objects (electronic components), so it does not require a very high X-ray analysis resolution. For example, it is also possible to apply a known X-ray inspection device for discovering foreign objects such as metal pieces mixed in or attached to food, clothing, etc., as the X-ray inspection device 2. In any case, metal parts such as electrodes of electronic components have a higher X-ray absorption rate than surrounding non-metallic parts, so they appear as component images in an image taken by transmitted X-rays.

[0031] In addition, the inspection device control PC1 has the following features: (A) A "closed image area" corresponding to the object (electronic component) in an image showing the object (electronic component) is determined; (B) Calculating the "quantity related to the size" of each determined "closed image region"; (C) determining the "count number" in the "closed image region" based on the "size-related amount" calculated for each "closed image region"; (D) The number of objects (electronic components) is determined based on the "count number" determined for each determined "closed image area."

[0032] Here, the "closed image area" determined by the above configuration (A) is a part image portion in the generated image that is separated from each other. For example, the generated image can be a binary image in which the area corresponding to the electronic component (electrodes, etc.) where X-rays are absorbed and the intensity is low is shown as white (pixel value = 255), and the other areas are shown as black (pixel value = 0). In this case, the "closed image area" becomes a white image area that is an island floating in a sea of ​​black.

[0033] In this embodiment, a gray image (data) showing an electronic component (electrodes, etc.) is generated in the X-ray inspection device 2, and this gray image (data) is transmitted to the inspection device control PC1 by wired communication via a signal interface 101 (FIG. 2) conforming to the USB (Universal Serial Bus) standard, for example. Next, the inspection device control PC1 binarizes the received gray image (data) to generate a binary image, and performs counting processing.

[0034] However, of course, as a modified embodiment, the inspection device control PC1 may acquire X-ray inspection data from the X-ray inspection device 2 and generate a gray image and a binary image, or the X-ray inspection device 2 may generate a binary image and transmit the binary image to the inspection device control PC1.

[0035] Furthermore, the "amount related to size" calculated in the above configuration (B) can be, for example, the area (number of pixels) of the "closed image area." Here, an amount other than the area, for example, "height (in the radial direction of the reel)," may be adopted as the "amount related to size" as long as it is an amount that allows the "count number" to be determined later.

[0036] Furthermore, the "count number" of the "closed image area" determined by the above configuration (C) is the number of electronic components that are presumed to form the "closed image area." Here, when the counting target is a component reel as in this embodiment, the wound tapes are in close contact with each other, and so there are many cases where the electronic components on the tape are connected and appear in the image. Also, when counting electronic components that are densely scattered on a component tray with some of them close together, many connected component images are generated.

[0037] Even for such "closed image areas," rather than simply counting one "closed image area" as one electronic component, a more accurate count of electronic components can be determined by performing a counting process that takes into account the "count number," which is the number of components that corresponds to that "closed image area."

[0038] For example, if there are 100 "closed image areas" with a "count number" of 1 (pieces), and 50 "closed image areas" with a "count number" of 2 (pieces), then in this embodiment, the total number of electronic components can be 200 (=1 x 100 + 2 x 50) (in contrast, if the "closed image areas" were simply counted, the total number of electronic components would be 150).

[0039] In this way, in the present invention, the number of objects can be found more accurately even when the image portions of the objects to be counted are connected and not isolated from one another, so there is no need to ensure extremely high image resolution in, for example, the X-ray inspection device 2. In other words, it can be understood that the object counting device (inspection device control PC1) of the present invention makes it possible to more accurately count the objects without imposing an excessive processing load.

[0040] Furthermore, according to the present invention, for example, counting of electronic components stored in the components reel 4 can be performed simply and efficiently without the need to pull out and rewind the tape from the components reel 4.

[0041] In this embodiment, the image of the object to be counted is generated by X-ray irradiation, but it is not limited to this. For example, if the object is one that can be captured by irradiation with electromagnetic waves (other than X-rays) such as infrared rays or ultrasonic waves, and an image portion corresponding to the size of the object is captured, the image generated by such irradiation can be used as the object to be counted.

[0042] Also in FIG. 1, the handheld terminal 3 is a portable terminal that can be carried by a person who performs electronic component management work in this embodiment, and is also an object management device that is connected to the inspection device control PC 1 and the management server 6 for communication. Its features include: (E) Obtain "object number information" which is information related to the number of objects (electronic components) from the inspection device control PC1, (F) Acquire "object identification information," which is information for identifying the object (electronic component), (G) Acquire "management location information," which is information related to the location where the target object (electronic component) is managed, (H) Generate "object management information" by linking the acquired "object identification information", "management location information", and "object number information", (I) The generated "object management information" is provided to a management server 6, which is an external object information management unit.

[0043] Here, the "object number information" acquired in the above configuration (E) is, for example, (a) The inspection device control PC1 generates barcode information indicating the number of electronic components determined in the above configuration (D) ("object number information"), and displays the one-dimensional (or two-dimensional) barcode 11 reflecting the barcode information on the display 106 (FIG. 2); (b) Next, the handheld terminal 3 uses its own barcode reader 302 (Figure 2) to read the barcode 11, thereby obtaining "information on the number of target objects (the number of electronic components stored in the component reel 4)."

[0044] In a modified embodiment, the inspection device control PC1 and the handheld terminal 3 may each be equipped with an NFC (Near Field Communication) reader / writer, a wireless LAN communication interface such as Wi-Fi (registered trademark), or a short-range wireless communication interface such as Bluetooth (registered trademark), and the number of electronic components ("object number information") may be transmitted from the inspection device control PC1 to the handheld terminal 3 via communication.

[0045] Furthermore, the “object identification information” acquired in the above configuration (F) may be, for example, information on the type and model of the electronic component (e.g., “chip resistor”) and specifications (e.g., “size (mm), rated power (W), resistance value (Ω)”), or may be a component identifier (component ID) previously assigned to the electronic component to be managed.

[0046] In this embodiment, for example, a one-dimensional (or two-dimensional) barcode 41 indicating “object identification information” is affixed to the parts reel 4, and the handheld terminal 3 obtains the “object identification information” of the parts reel 4 by reading this barcode 41 using its own barcode reader 302 (Figure 2).

[0047] In a modified embodiment, a wireless tag such as an NFC tag having “object identification information” recorded thereon may be affixed to the parts reel 4, and this “object identification information” may be read by an NFC reader / writer mounted on the handheld terminal 3.

[0048] Furthermore, in this embodiment, the "management position information" acquired in the above configuration (G) can be the position within the parts shelf 5 that stores the case 52 in which the parts reel 4 is stored, i.e., the shelf number. Here, in this embodiment, the position within the parts shelf 5 where the case 52 should be stored is determined in advance for each case 52, so that the "management position information" is ultimately information that specifies the position within the parts shelf 5 as well as information that specifies the case 52.

[0049] Regarding such "management location information," for example, a one-dimensional (or two-dimensional) barcode 51 indicating "object identification information (shelf number)" is affixed to the side of the case 52 that stores the parts reel 4, and the handheld terminal 3 can obtain the "object identification information (shelf number)" which is the storage location of the parts reel 4 by reading this barcode 51 using its own barcode reader 302 (Figure 2).

[0050] As an alternative embodiment, a wireless tag such as an NFC tag having “object identification information (shelf number)” recorded thereon may be affixed to the side of case 52 that stores parts reel 4, and this “object identification information (shelf number)” may be read by an NFC reader / writer mounted on handheld terminal 3.

[0051] Furthermore, in this embodiment, the "object management information" generated in the above configuration (H) can be, for example, as a specific example, "200 pieces (number of electronic components)", "R0021 (component ID)", and "H-31 (shelf number)" The information includes:

[0052] Such "object management information" is transmitted to a management server 6 serving as an object information management unit, and is managed by the management server 6. Incidentally, communication between the handheld terminal 3 and the management server 6 can be via a wireless LAN such as Wi-Fi (registered trademark), or the Internet via a carrier communication network (access network) such as a mobile phone communication network.

[0053] Here, as a modification of the object information management unit that manages the above-mentioned "object management information," it is also possible to employ an NFC tag as the object information management unit together with the management server 6 (or without using the management server 6). This NFC tag may be attached to the side surface of the case 52, for example.

[0054] Each time a component reel 4 is stored in the case 52 attached to such an NFC tag and managed at a specified shelf number position on the component shelf 5, the handheld terminal 3 equipped with an NFC reader / writer records "object management information" including, for example, the "number of electronic components," "component ID," and "shelf number." If the "number of electronic components" changes, for example, due to removal, the latest "number of electronic components" can be recorded in the NFC tag as appropriate. Furthermore, it is also preferable for the management server 6 to hold such recorded content in a synchronous manner.

[0055] In any case, according to the handheld terminal 3 of this embodiment, it is possible to more easily generate "object management information" that links "object identification information," "management location information," and "object number information" that reliably corresponds to the current state and management status of the object, thereby making it possible to improve the efficiency of object management operations.

[0056] For example, if the part number, which is the "object identification information" of the part reel 4 to be searched for, is known, it is possible to identify the case 5 in which the part is stored (the storage position (shelf number) on the part shelf 5). In addition, the number of electronic parts in stock can be confirmed at the same time.

[0057] [Functional configuration of the device] FIG. 2 is a functional block diagram showing a functional configuration of an object counting device and an object management device according to an embodiment of the present invention.

[0058] As shown in Figure 2, the inspection device control PC1 as an object counting device according to the present invention has a signal interface (IF) 101, a communication interface 102, an image storage unit 103, a counting result storage unit 104, a display (DP) 106, a keyboard 107 (KB), and a processor memory.

[0059] Here, this processor memory stores one embodiment of the object counting program according to the present invention, and also has a computer function, and performs object counting processing by executing this object counting program. Therefore, the inspection device control PC1 may be a dedicated object counting device or unit, but can also be a personal computer (PC) equipped with the object counting program according to the present invention as in this embodiment, and can also be a tablet or node type computer, or a communication terminal such as a smartphone.

[0060] Furthermore, this processor memory has a binary image generation unit 111, an object region determination unit 112, a region size determination unit 113, a count number determination unit 114 having a histogram generation unit 114a and a size interval setting unit 114b, an object number determination unit 115 having a barcode generation unit 115a, and an input / output control unit 116.

[0061] These functional components can be regarded as functions of an object counting program stored in a processor memory. Also, the process flow shown by connecting the functional components of the inspection device control PC1 in Fig. 2 with arrows can be understood as one embodiment of the object counting method according to the present invention in the inspection device control PC1.

[0062] Similarly, in the functional block diagram of the inspection device control PC1 in Fig. 2, the binary image generating unit 111 acquires a gray image showing electronic components housed in a component reel 4 from the X-ray inspection device 2 via the signal interface 101, and generates a binary image in which the range corresponding to the electronic components (metal parts thereof) is white (pixel value = 255) and the other parts are black (pixel value = 0). Here, as the binary conversion process, for example, the pixel value of each pixel in the gray image may be converted to 0 (black) or 255 (white) with a predetermined threshold as the border.

[0063] It is also preferable that the acquired gray image, the generated binary image, and further the histogram generated by the histogram generating unit 114a described later are associated with the corresponding part ID and temporarily stored in the image storage unit 103, and then read out as necessary. The stored image data may be used, for example, for machine learning to set various parameters.

[0064] The object region determination unit 112 determines closed image regions corresponding to (metal parts of) electronic components in the generated binary image, that is, white island image regions separated (isolated) from the surroundings. Specifically, a known blob analysis process may be performed on the binary image to determine closed image regions present in the binary image. Here, blob analysis is a basic image analysis method for determining the number and position of island image regions (blobs) and deriving shape characteristics such as their length and direction.

[0065] The region size determination unit 113 calculates the area (amount related to size) of each determined closed image region. This area (the number of pixels in the region) can also be calculated by carrying out the above-mentioned blob analysis process.

[0066] The count number determination unit 114 determines the count number for each closed image region based on the area (amount related to size) calculated for that closed image region. Here, the count number is the number of counting objects (electronic components) that make up that closed image region. For example, if one closed image region corresponds to the component images of two electronic components connected to each other, the count number for this closed image region is "2."

[0067] Here, it is also preferable that the count number determination unit 114 sets multiple intervals for area (a quantity related to size), each of which has a count number previously associated therewith, and sets the count number for each closed image area to the count number associated with the interval to which the area (a quantity related to size) calculated for that closed image area belongs.

[0068] Specifically, first, the histogram generating unit 114a of the count number determining unit 114 generates a histogram for the part reel 4 to be counted, with the horizontal axis representing area intervals and the vertical axis representing the number of closed image areas (white island image areas) having an area falling within the area interval. An example of the generated histogram (histogram 13) is shown in each of Figures 3 to 5, which will be used later to explain the embodiment. As shown in these figures, this histogram usually has the shape of a single "mountain" as a whole, or a shape in which multiple "mountains" are connected together.

[0069] Next, the size interval setting unit 114b of the count number determination unit 114 determines an interval in the horizontal axis (area axis) direction of each of the one or more "peaks" in the generated histogram (the base interval of the "peak"), and associates a "count number" with the determined horizontal axis interval of each "peak" based on the area value range of the horizontal axis interval.

[0070] For example, if the horizontal axis section of a first "mountain" is 10 to 30, and one counting object (electronic component) corresponds to an "area" of 20, then the horizontal axis section of the first "mountain" contains one "area," so a "count number" of 1 is associated with it. Furthermore, if the horizontal axis section of a second "mountain" connected to the first "mountain" is 30 to 60, then the horizontal axis section of the second "mountain" contains two "areas," so a "count number" of 2 is associated with it.

[0071] Finally, the count number determination unit 114 sets the count number of each closed image region as a "count number" associated with the horizontal axis section to which the area calculated for that closed image region belongs. For example, in the above case, the closed image region with an area of ​​50 belongs to the second "peak" whose horizontal axis section is 30 to 60, so the count number is determined to be 2.

[0072] Here, the horizontal axis interval for each "peak" may be set by the operator through specification / input operations via keyboard 107 or the like for the histogram displayed on display 106. However, it is also possible, for example, to perform a known normal distribution fitting process for each "peak" of this histogram and determine the horizontal axis interval for each "peak" by dividing the horizontal axis (area axis) by the intersection of the normal distribution curves of adjacent "peaks."

[0073] As a further modification, it is also preferable that the count number determination unit 114 determines the horizontal axis section associated with the count number using a trained estimation model based on data of a graph (e.g., the above-mentioned histogram) showing the relationship between the area value and the number of closed image regions corresponding to that area value, and information identifying the object or the type of object (e.g., part ID).

[0074] Specifically, first, a boundary value estimation model is constructed using, for example, a part ID, features of the image data of the histogram, and correct data for the boundary values ​​of the horizontal axis section (the boundary value between the counter numbers 1 and 2, the boundary value between the counter numbers 2 and 3, ...).Next, the part ID for which the count number is to be determined and the features of the histogram image can be input to this boundary value estimation model, and an estimate of the boundary value of the horizontal axis section can be output.

[0075] In this embodiment, the gray image acquired by the X-ray inspection device 2 is generated by detecting transmitted X-rays irradiated in a direction generally perpendicular to the surface of the component reel 4. Electronic components such as chip resistors having metal electrodes on both ends are usually stored in the component reel 4 in a direction aligned with the X-ray irradiation direction, i.e., with one electrode end surface facing the irradiated X-ray. Therefore, one white image area appears for one electronic component.

[0076] However, if electronic components are stored lying flat on the surface of component reel 4, i.e., with both metal electrode portions at both ends exposed to X-rays, two white image areas will appear for each electronic component. In this case, the count is determined taking into consideration that one white image area corresponds to 0.5 electronic component and that connected white image areas are generally made up of the metal electrode portions of two adjacent electronic components.

[0077] Furthermore, it is also preferable that the count number determination unit 114 obtains "section setting information", which is information for setting the horizontal axis section as described above, from the section setting information providing unit 316 of the handheld terminal 3, which will be described later, via the communication interface 102.

[0078] Examples of this "interval setting information" include the component IDs of electronic components stored in the component reel 4 as the counting object, and a count number previously set for the component ID (for example, "1" for the first "peak" of the histogram, "2" for the second "peak", etc.). It is also possible to use pixel value thresholds, etc., that are suitable for generating a binary image for an electronic component with that component ID as the "interval setting information". Furthermore, an embodiment may be adopted in which the specific area value ranges of the horizontal axis intervals of each "peak" are determined or preset by the handheld terminal 3 and specified as the "interval setting information".

[0079] Similarly, in the functional block diagram of the inspection device control PC1 in Fig. 2, the object number determination unit 115 determines the number of count objects (electronic components) based on the count number determined for each determined closed image region. A specific example of this number determination process will be described later using the histograms in Figs. 3 to 5. In addition, the determined number information may be temporarily stored in the counting result storage unit 104 in association with the corresponding component ID, and may be read out as appropriate.

[0080] Furthermore, the barcode generating unit 115a of the object number determining unit 115 converts the determined number of count objects (electronic components) into one-dimensional (or two-dimensional) barcode information, and causes the barcode 11 to be displayed on the display 106 via the input / output control unit 116. This allows the handheld terminal 3 equipped with the barcode reader 302 to obtain the determined number of count objects (electronic components) without manual input.

[0081] Note that the inspection device control PC1 (its communication interface 102) and the handheld terminal 3 (its communication interface 301) may be communicatively connected, and the number of counting objects (electronic components) determined by the object number determination unit 115 may be notified to the handheld terminal 3 via this communication. In this case, the barcode generation process by the barcode generation unit 115a is not required.

[0082] As also shown in FIG. 2, the handheld terminal 3 as an object management device according to the present invention has a communication interface (IF) 301, a barcode reader 302, a touch panel display (TP / DP) 303, a setting condition storage unit 304, a management information accumulation unit 305, and a processor / memory.

[0083] Here, the processor memory stores an embodiment of the object management program according to the present invention, has a computer function, and executes the object management program to perform object management processing. Therefore, the handheld terminal 3 may be a dedicated object management device or apparatus, but may also be a mobile terminal such as a tablet computer or smartphone equipped with the object management program according to the present invention.

[0084] Furthermore, the processor memory has a number information acquisition unit 311, an identification information acquisition unit 312, a management position information acquisition unit 313, a management information generation unit 314, a management information provision unit 315, a section setting information provision unit 316, an object confirmation unit 317, and an input / output control unit 318. These functional components can be considered as functions of an object management program stored in the processor memory. The process flow shown by connecting the functional components of the handheld terminal 3 in FIG. 2 with arrows can also be understood as one embodiment of an object management method in the handheld terminal 3 according to the present invention.

[0085] Similarly, in the functional block diagram of the handheld terminal 3 in FIG. 2, a number information acquisition unit 311 acquires the number of electronic components, which is object number information of the objects (electronic components) to be counted, from the inspection device control PC.

[0086] Here, as described above, when the inspection device control PC1 displays on the display 106 a barcode 11 representing the quantity information of the objects to be counted (electronic components), the operator can perform a simple operation of reading the displayed barcode using the barcode reader 302 of the handheld terminal 3, and the quantity information acquisition unit 311 can acquire the quantity information.

[0087] As a modified embodiment, when the inspection device control PC1 writes the number information of the objects to be counted (electronic components) to an NFC tag (not shown), the number information acquisition unit 311 may acquire the number information by the worker performing a simple operation of reading the NFC tag using an NFC reader / writer (not shown) of the handheld terminal 3. Incidentally, many smartphones today are equipped with an NFC reader / writer and can be used as such a handheld terminal 3.

[0088] As a further modification, the number information acquiring unit 311 may acquire the number information from the communication interface 102 of the inspection device control PC 1 by wireless communication via the communication interface 301 .

[0089] The identification information acquisition unit 312 acquires a part ID, which is object identification information of an object (electronic part). For example, when a barcode 41 representing the part ID is attached to the surface of the part reel 4, the worker performs a simple operation of reading the attached barcode 41 with the barcode reader 302 of the handy terminal 3, and the quantity identification information acquisition unit 312 can acquire the part ID information.

[0090] As a modified embodiment, an NFC tag recording the component ID may be affixed to the surface of the component reel 4, and this component ID information may be read by an NFC reader / writer (not shown) mounted on the handheld terminal 3.

[0091] The management position information acquisition unit 313 acquires the shelf number of the parts shelf 5, which is the management position information of the target object (electronic part). For this shelf number information, for example, a one-dimensional (or two-dimensional) barcode 51 indicating the shelf number is affixed to the side of the case 52 that stores the parts reel 4, and the handheld terminal 3 can acquire the shelf number, which is the storage position of the parts reel 4 on the parts shelf 5, by reading this barcode 51 using the barcode reader 302 provided in the handheld terminal 3 itself.

[0092] Again, as a modification, an NFC tag with the shelf number recorded thereon may be affixed to the side of case 52, and this shelf number information may be read by an NFC reader / writer (not shown) mounted on handheld terminal 3.

[0093] Similarly, in the functional block diagram of the handheld terminal 3 in FIG. 2, the management information generation unit 314 generates object management information that links the number of electronic components (e.g., "200") acquired as described above, the component ID (e.g., "R0021"), and the shelf number (e.g., "H-31").

[0094] Next, the management information providing unit 315 transmits the generated object management information to the management server 6, which is an object information management unit provided externally, via, for example, the communication interface 301. Incidentally, the generated object management information may be temporarily stored in the management information storage unit 305 and read out as appropriate.

[0095] The interval setting information providing unit 316 acquires or determines the "interval setting information" for the electronic components stored in the component reel 4 to be counted, which is used by the count number determination unit 114 of the inspection equipment control PC1 when setting the horizontal axis interval, and transmits the information to the inspection equipment control PC1, for example, via the communication interface 301.

[0096] As described above, the "section setting information" may be, for example, the component IDs of the electronic components stored in the component reel 4 as the counting objects, or a count number previously set for the component ID (for example, "1" for the first "peak" of the histogram, "2" for the second "peak", etc.). It is also possible to use a pixel value threshold value, etc., that is suitable for generating a binary image for an electronic component with that component ID as the "section setting information".

[0097] Furthermore, the specific area value range of the horizontal axis section of each "mountain" may be determined or preset by the handheld terminal 3 (section setting information providing unit 316) and notified to the inspection device control PC1 (count number determining unit 114) as "section setting information." Note that such "section setting information" may be stored in the setting condition storage unit 304 in a form linked to the part ID and read out as appropriate.

[0098] The object confirmation unit 317 is (a) A part ID read from a barcode 91 (FIG. 8) printed on a "withdrawal list" including identification information of the object to be removed (part ID of the electronic part to be removed from the parts shelf 5), (a) A part ID read from a barcode 41 attached to a part reel 4 stored and managed on a part shelf 5 and It is judged whether or not they match, and the result of the judgment is output. Incidentally, these barcodes function as identification information providing units that hold the part ID (object identification information) and can be presented externally, and instead, for example, NFC tags can also be used.

[0099] Here is a typical example: (a) Reading out the "part ID" (above (a)) of the electronic part to be removed, the "shelf number" and the "number of electronic parts" to be removed from the barcode 91 printed on the "withdrawal list" issued by the management server 6, (b) pull out the case 52 located at the position of this “shelf number” from the parts shelf 5, and read out the “parts ID” (above (a)) read out from the barcode 41 (or NFC tag) attached to the stored parts reel 4; (c) When the object confirmation unit 317 outputs a determination result indicating that "the two read part IDs match", take out (dispatch) the electronic parts corresponding to the "number of electronic parts" to be taken out from this part reel 4. This is what is possible.

[0100] Here, the determination result by the object confirmation unit 317 may be presented to the worker, for example, by being displayed on the touch panel display 303 via the input / output control unit 318, or by outputting a voice or a predetermined sound (from a speaker not shown). Also, the worker may be set to input instructions for carrying out the process at the time of leaving the warehouse, including the determination process as described above, for example, by tapping the touch panel display 303.

[0101] [Example of object counting process] 3 to 5 are display images showing an embodiment of an object counting process using the object counting program according to the present invention.

[0102] 3 to 5 are all screen images displayed on the display 106 of the inspection device control PC 1. Each screen image has a generated binary image 12, a generated histogram 13, count parameters 14 as setting conditions, and a barcode 11 indicating the number of electronic components as the counting process result.

[0103] First, Figure 3 shows a case where the electronic components to be counted are relatively small. According to the count parameter 14 in the figure, the horizontal axis section where the "count number" = 1 is from "1" to "31", the horizontal axis section where the "count number" = 2 is from "32" to "67", and the horizontal axis section where the "count number" = 3 is from "68" to "140".

[0104] As a result of performing a counting process on the histogram 13 based on such count number settings, the number of electronic components is calculated to be 5049, and furthermore, a barcode 11 representing this number 5049 is displayed in the lower right corner of the screen. Here, the actual number of electronic components is also 5049, and thus, in this embodiment, a counting result without error is obtained.

[0105] Next, Fig. 4 shows a case where the electronic components to be counted are of medium size. According to the count parameter 14 in the figure, the horizontal axis section where the "count number" = 1 is from "1" to "35", the horizontal axis section where the "count number" = 2 is from "36" to "67", and the horizontal axis section where the "count number" = 3 is from "68" to "200".

[0106] As a result of performing a counting process on the histogram 13 based on such count number settings, the number of electronic components is calculated to be 4897, and furthermore, a barcode 11 representing this number 4897 is displayed in the lower right corner of the screen. Here, the actual number of electronic components is also 4897, and thus, in this embodiment, a counting result without error is obtained.

[0107] Finally, Fig. 5 shows a case where the electronic components to be counted are relatively large. According to the count parameters 14 in this figure, the horizontal axis section where "count number" = 1 is from "1" to "88", and the horizontal axis section where "count number" = 2 is from "89" to "200". Also, there is no horizontal axis section where "count number" = 3 (in fact, the third "peak" does not appear in the histogram 13).

[0108] As a result of performing a counting process on the histogram 13 based on such a count number setting, the number of electronic components is calculated to be 4000, and furthermore, a barcode 11 representing this number 4000 is displayed in the lower right corner of the screen. Here, the actual number of electronic components is also 4000, and thus, in this embodiment, a counting result without error is obtained.

[0109] As yet another example, a counting process as described above was performed on a 128 dpi binary image depicting 0603 size reel components, and an accuracy of approximately 99.9% was obtained for the number of components.

[0110] Incidentally, in the embodiment described above, case 52 housing parts reels 4 is moved on the constant speed driven belt conveyor of X-ray inspection device 2, and X-ray measurement, i.e., image generation, begins when the front end of case 52 passes the measurement start line immediately preceding the row of X-ray detectors. As shown in Fig. 13 (front view of case 52) and Fig. 15 (perspective view of case 52), which will be used later in the description of the design, the inner storage section of case 52 is provided with a protrusion for fixing parts reel 4 at a predetermined position within the case, and parts reel 4 is installed so that this protrusion passes through its own central hole.

[0111] Therefore, since the distance from the front end of the case 52 to the center position of the parts reel 4 (and further to the front end of the parts reel 4 if the radius of the parts reel 4 is known) is known in advance, the position range of the parts reel image portion can be determined in advance in the generated image. As a result, in the embodiment described above, it is not necessary to detect the position range of the parts reel 4 in the subsequent counting process using this image, and high-speed processing is achieved.

[0112] Furthermore, it is also preferable to perform image processing on the X-ray detector row of the above-mentioned X-ray inspection device 2 in accordance with the actual conditions of the X-ray detector row to generate a more accurate parts reel image. Specifically, the X-ray detector row is, for example, a vertical arrangement of eight 256-bit linear CCDs to form a 2048-bit X-ray line sensor in total. Currently, pixel loss occurs at the joints of the linear CCDs in the generated image.

[0113] In response to this, it is also preferable to define pixel-deficient band regions, for example 2 bits wide or more, extending in a direction perpendicular to the X-ray detector row (linear CCD row) at positions every 256 bits in the direction of the X-ray detector row in the generated image, and perform line correction such that pixel values ​​in these pixel-deficient band regions are matched with adjacent (or nearest) pixel values ​​outside the region. This allows a more accurate parts reel image to be generated, and as a result, more accurate counting results can be obtained.

[0114] [Management method of the object] 6 is a sequence diagram showing an embodiment of the object management method (warehousing) according to the present invention. In this embodiment, information is exchanged between the handheld terminal 3 and the inspection device control PC1 by an operator holding the handheld terminal 3 and bringing it close to the inspection device control PC1 to read a barcode.

[0115] (S101) The warehousing process is selected as the processing mode of the handheld terminal 3 (by the worker). (S102) (The worker brings the handheld terminal 3 close to the parts reel 4 to be stored,) the handheld terminal 3 reads out the "parts number" which is the parts ID from the barcode 41 affixed to the parts reel 4 to be stored, and saves it.

[0116] (S103, S104) The parts reel 4 is inserted into the X-ray inspection device 2 (by an operator), and the X-ray inspection device 2 performs X-ray measurement on the parts reel 4 in response to an instruction for X-ray measurement. (S105, S106) The inspection apparatus control PC1 receives a counting process instruction together with setting information such as horizontal axis interval (from an operator), receives X-ray measurement results from the X-ray inspection apparatus 2, and performs a binary image generation process and a counting process.

[0117] (S107) The inspection device control PC1 displays the number of electronic components as a result of the counting process on the display 106 (FIG. 2) as a barcode 11. (S108) (The worker brings the handheld terminal 3 close to the display 106,) the handheld terminal 3 reads out the "number of electronic parts" from the barcode 11 displayed on the display 106, and stores it. (S109) (The worker places the parts reel 4 in the case 52 of the parts shelf 5 and brings the handheld terminal 3 close to this case 52,) and the handheld terminal 3 reads out the "shelf number" from the barcode 51 affixed to the case 52 and stores it.

[0118] (S110) The handheld terminal 3 generates, as part of a registration operation in the warehousing process, inventory part reel management information that links the acquired and stored "part number," "number of electronic parts," and "shelf number." (S111) The handheld terminal 3 transmits a registration request including the generated stock parts reel management information to the management server 6. (S112, S113) The management server 6 registers the received stocked parts reel management information, and returns a registration completion confirmation to the handheld terminal 3.

[0119] Here, in the incoming parts reel management information registered in the management server 6, the storage location (shelf number) and the number of stored electronic parts (number of electronic parts) are clearly associated with the type (part number) of the electronic parts related to the inventory. As a result, according to the object management method (warehousing) of this embodiment in which the incoming parts reel management information is registered, it becomes possible to reliably carry out inventory management of, for example, a huge number of types of electronic parts without confusion.

[0120] Furthermore, since a significant portion of this inventory part reel management information is generated automatically by the handheld terminal 3, the work time required for reliable inventory management is greatly reduced.

[0121] 7 is a sequence diagram showing another embodiment of the object management method (warehousing) according to the present invention. In this embodiment, information is exchanged between the handheld terminal 3 and the inspection device control PC1 by wireless communication, not by barcode reading.

[0122] (S201) The warehousing process is selected as the processing mode of the handheld terminal 3 (by the worker). (S202) (The worker brings the handheld terminal 3 close to the parts reel 4 to be stored,) and the handheld terminal 3 reads and saves the "parts number" which is the parts ID from the barcode 41 affixed to the parts reel 4 to be stored.

[0123] (S203, S204) The parts reel 4 is inserted into the X-ray inspection device 2 (by an operator), and the X-ray inspection device 2 performs X-ray measurement on the parts reel 4 upon receiving an instruction for X-ray measurement. (S205, S206) The inspection device control PC1 receives a counting process request along with setting information such as the horizontal axis section (from the handheld terminal 3 via wireless communication), receives the X-ray measurement results from the X-ray inspection device 2, and performs binary image generation processing and counting processing.

[0124] (S207) The inspection device control PC1 transmits the “number of electronic components” as a result of the counting process to the handheld terminal 3 in response to the counting process request, and the handheld terminal 3 stores the received “number of electronic components”.

[0125] (S208) (The worker places the parts reel 4 in the case 52 of the parts shelf 5 and brings the handheld terminal 3 close to this case 52,) and the handheld terminal 3 reads out the "shelf number" from the barcode 51 affixed to the case 52 and stores it.

[0126] (S209) The handheld terminal 3 generates, as part of a registration operation in the warehousing process, inventory part reel management information that links the acquired and stored "part number," "number of electronic parts," and "shelf number." (S210) The handheld terminal 3 transmits a registration request including the generated stock parts reel management information to the management server 6. (S211, S212) The management server 6 registers the received stocked parts reel management information, and returns a registration completion confirmation to the handheld terminal 3.

[0127] Here, in the incoming parts reel management information registered in the management server 6, the storage location (shelf number) and the number of stored electronic parts (number of electronic parts) are clearly associated with the type (part number) of the electronic parts related to the inventory. As a result, according to the object management method (warehousing) of this embodiment in which the incoming parts reel management information is registered, it becomes possible to reliably carry out inventory management of, for example, a huge number of types of electronic parts without confusion.

[0128] In addition, since the inventory part reel management information is also generated almost automatically by the handheld terminal 3, the work time required for reliable inventory management is greatly reduced.

[0129] 8 is a sequence diagram showing an embodiment of an object management method (warehouse removal) according to the present invention. In this embodiment, the task of removing the component reel 4 from the component shelf 5 is performed by a worker.

[0130] Furthermore, the withdrawal list 9 shown in the sequence diagram of Figure 8 is a list of outgoing parts output from the management server 6 upon receiving an outgoing instruction (including information on the type and quantity of electronic parts to be shipped), and is a paper medium on which is printed a barcode 91 indicating the "part number" of the electronic part to be shipped, the "shelf number" where it is stored, and the "number of electronic parts", which is the number of parts to be shipped.

[0131] (S301) The shipping process is selected as the processing mode of the handheld terminal 3 (by the worker). (S302) (The worker brings the handheld terminal 3 close to the payment list 9,) the handheld terminal 3 determines, from the barcode 91 printed on the payment list 9, (a) The "part number" which is the part ID of the electronic part to be shipped, (b) The “shelf number” of parts shelf 5, which is the storage location of the electronic parts to be shipped, Read and save.

[0132] (S303, S304) A parts reel 4 is removed from the corresponding "shelf number" position on the parts shelf 5 (by an operator who visually recognizes the "shelf number" displayed on the touch panel display 303 of the handheld terminal 3), and the handheld terminal 3 reads and stores the "parts number" of the parts reel 4 from the barcode 41 affixed to the removed parts reel 4.

[0133] (S305) The handheld terminal 3 checks the outgoing parts by determining whether the "part number" read from the withdrawal list 9 matches the "part number" read from the removed parts reel 4. If they match, the process proceeds to step S306.

[0134] On the other hand, if they do not match, a message to that effect is displayed on the touch panel display 303. Also, a warning sound may be output from a speaker provided in the handy terminal 3. Furthermore, it is preferable that measures to be taken (such as checking the shelf number) be displayed on the touch panel display 303 to the worker.

[0135] (S306, S307) (The worker brings the handheld terminal 3 close to the dispensing list 9,) and the handheld terminal 3 reads and saves the "number of electronic components," which is the number of components to be dispensed, from the barcode 91 printed on the dispensing list 9. Next, (the worker visually checks the "number of electronic components" displayed on the touch panel display 303 of the handheld terminal 3) electronic components are taken out from the taken-out parts reel 4 in the amount equal to the "number of electronic components."

[0136] (S308) The handheld terminal 3 generates outgoing part reel management information, which is information linking the acquired and stored "part number," "shelf number," and "number of electronic parts," as part of the registration work in the outgoing process. (S309) The handheld terminal 3 transmits a registration request including the generated out-of-stock parts reel management information to the management server 6. (S310, S311) The management server 6 registers the received outgoing parts reel management information, and returns a registration completion confirmation to the handheld terminal 3.

[0137] Here, in the outgoing parts reel management information registered in the management server 6, the storage location (shelf number) and the number of outgoing electronic parts (number of electronic parts) are clearly associated with the type (part number) of the outgoing electronic parts. As a result, according to the object management method (outgoing) of this embodiment in which the outgoing parts reel management information is registered, it becomes possible to reliably carry out outgoing management of, for example, a huge number of types of electronic parts without confusion.

[0138] In addition, since the outgoing parts reel management information is also generated almost automatically by the handheld terminal 3, the work time required for reliable outgoing management is greatly reduced.

[0139] [Another embodiment of the object counting management system] FIG. 9 is a schematic diagram showing another embodiment of an object counting management system including an object counting device and an object management device according to the present invention.

[0140] According to Figure 9, the object counting management system of this embodiment, like the object counting management system shown in Figure 1, is a system that stores parts reels 4 on parts shelves 5 after determining the number of electronic parts stored therein, and can manage the incoming and outgoing information of the electronic parts in a management server 6.

[0141] Specifically, this object counting management system employs a management robot 7 instead of the handheld terminal 3 as the object management device in the object counting management system shown in Fig. 1. The remaining system components, including the inspection device control PC 1, are the same as those in the object counting management system shown in Fig. 1. It is also preferable that this system further includes a robot control terminal 8 for controlling this management robot 7.

[0142] The management robot 7 is a robot that can hold the parts reel 4 and the case 52 using a suitable handling unit or suction mechanism, and can, for example, transport the parts reel 4 and store it in the case 52, and then transport the case 52 and insert it into a predetermined position on the parts shelf 5.

[0143] In other words, the management robot 7 can automatically perform the storage and shipping operations of the parts reels 4, which were previously performed by operators in the object counting management system shown in Figure 1, under instructions from the robot control terminal 8 and / or based on a specified program.

[0144] In addition, the management robot 7 has the same features as the handheld terminal 3 in FIG. 1, as follows: (E') Obtain "information on the number of objects" of the objects (electronic components) from the inspection device control PC1, (F') Obtain "object identification information" of the object (electronic component); (G') Acquire the "management location information" of the object (electronic component), (H') Generate "object management information" by linking the acquired "object identification information", "management location information", and "object number information", (I′) The generated “object management information” is provided to the management server 6 .

[0145] Furthermore, in this embodiment, the management robot 7 is communicatively connected not only to the management server 6 but also to the inspection device control PC 1, and is capable of acquiring the above-mentioned (E') "information on the number of objects" through this communication. Here, this communication can also be wireless LAN such as NFC or Wi-Fi (registered trademark), or short-distance wireless communication such as Bluetooth (registered trademark).

[0146] In addition, since the management robot 7 is equipped with a barcode reader 702 (Figure 10) for reading the barcode 41 on the parts reel 4 and the barcode 51 on the case 52, the above (E') ``number of objects information'' may be obtained by reading the barcode 11 displayed by the inspection device control PC1.

[0147] The management robot 7 as described above, like the handheld terminal 3, makes it possible to more easily generate "object management information" that links "object identification information", "management location information", and "object number information" that reliably correspond to the current state and management status of the object, and improves the efficiency of object management work. Also, in the object counting management system of Fig. 1, the work of storing and unloading parts reels 4 that was previously performed by workers can now be performed automatically without manual intervention.

[0148] Furthermore, the object counting management system of this embodiment can be realized at lower cost in a more compact installation space by using, for example, a commercially available general-purpose robot as the management robot 7 and adopting a relatively inexpensive commercially available X-ray inspection device for detecting foreign objects such as metal pieces as the X-ray inspection device 2.

[0149] [Functional configuration of the device] FIG. 10 is a functional block diagram showing the functional configuration of an object management device according to another embodiment of the present invention.

[0150] As shown in the functional block diagram of Fig. 10, the management robot 7 as an object management device has a robot body and an arm 71, and also includes a drive unit 72 that drives the arm 71 relative to the robot body. Incidentally, in this embodiment, the management robot 7 is a 6-axis articulated general-purpose robot, but Fig. 10 shows only one arm 71 and one drive unit 72.

[0151] Furthermore, the management robot 7 has, as an object management device, a communication interface (IF) 701, a barcode reader 702, a touch panel display (TP / DP) 703, a setting condition storage unit 704, a driving information storage unit 705, a management information accumulation unit 706, and a processor / memory.

[0152] Here, the processor memory stores one embodiment of an object management program according to the present invention, and has computer functionality to execute the object management program to perform object management processing.

[0153] Furthermore, this processor memory has a quantity information acquisition unit 711, an identification information acquisition unit 712, a management position information acquisition unit 713, a management information generation unit 714, a management information provision unit 715, a section setting information provision unit 716, an object confirmation unit 717, an input / output control unit 718, and an arm drive control unit 719.

[0154] These functional components can be regarded as functions of an object management program stored in a processor memory. Also, the process flow shown by connecting the functional components of the management robot 7 with arrows in Fig. 10 can be understood as one embodiment of the object management method of the present invention in the management robot 7.

[0155] Here, all or part of the above-mentioned functional components in the management robot 7 may be provided in an information processing device provided outside the robot body and the arm 71, for example, in a robot control terminal 8.

[0156] In addition, among the functional components in the management robot 7, those that have the same names as those in the functional components of the handheld terminal 3 in Fig. 2 have roughly the same functions as the functional components of the same names, and so a description thereof will be omitted here. Below, a description will be given of the functional components that play characteristic roles in the management robot 7.

[0157] In the functional block diagram of Figure 10, arm 71 is a robot arm that is equipped at its end with a handling unit and / or suction mechanism that is compatible with parts reel 4 and case 52, and that can hold and transport parts reel 4 and case 52.

[0158] The drive unit 72 is provided between the arm 71 and the robot body, and includes, for example, an electric motor system, a pneumatic drive system, and / or a hydraulic drive system, and upon receiving a drive control signal from the arm drive control unit 719, drives the arm 71 as instructed by the drive control signal. Incidentally, the drive unit 72 also includes a mechanism for rotating the entire robot body and arm 71 in a horizontal plane, and it is also preferable to orient the arm 71 in a direction within the horizontal plane as instructed by the drive control signal.

[0159] Here, the arm drive control unit 719 may output a drive control signal generated based on the “drive information” stored in the drive information storage unit 705 to the drive unit 72, for example, in accordance with a drive command from a drive control program mounted on the management robot 7.

[0160] This "driving information" may include, for example, as warehousing operation driving information, information on a driving procedure for a series of operations to move arm 71 to the position of the shelf number of parts shelf 5 where parts reel 4 is stored, store parts reel 4 in pulled-out case 52, and finally push in case 52. It may also include setting information for various parameters of arm 71, driving unit 72, etc.

[0161] Furthermore, the arm drive control unit 719 may receive a warehousing operation request or a warehousing operation request via the communication interface 701 from the robot control terminal 8 that accepts instruction input by the worker, and output a drive control signal generated in accordance with the request content to the drive unit 72. Also, the arm drive control unit 719 may receive a warehousing operation request or a warehousing operation request, as well as payment list information, from the management server 6 via the communication interface 701, and output a drive control signal generated in accordance with the content of these requests to the drive unit 72.

[0162] By such drive control by the arm drive control unit 719, the arm 71 can, for example, hold and transport a parts reel 4 and store it in a case 52 corresponding to the "shelf number" included in the drive control signal, and further hold and transport the case 52 and insert it into the position of that "shelf number" on the parts shelf 5.

[0163] [Management method of the object] 11 is a sequence diagram showing yet another embodiment of the object management method (warehousing) according to the present invention. In this embodiment, a management robot 7 is used as the object management device, and information is exchanged between the management robot 7 and the inspection device control PC 1 by wireless communication, not by barcode reading.

[0164] (S501) The storage process is selected as the process mode for the management robot 7 (by the worker). (S502) The management robot 7 reads out the "part number" which is the part ID from the barcode 41 affixed to the part reel 4 to be stored, and stores it.

[0165] (S503, S504) The management robot 7 holds and transports the parts reel 4, inserts it into the X-ray inspection device 2, and transmits an X-ray measurement request, setting information such as the horizontal axis section, and a counting process request to the inspection device control PC1. (S505) The X-ray inspection equipment 2 performs X-ray measurement on the inserted parts reel 4 in accordance with an X-ray measurement instruction from the inspection equipment control PC 1 which has received a request from the management robot 7. (S506) The inspection apparatus control PC1 receives the X-ray measurement result from the X-ray inspection apparatus 2, and performs a binary image generation process and a counting process.

[0166] (S507) The inspection device control PC1 transmits the "number of electronic components" as the result of the counting process to the management robot 7 as a response to the counting process request, and the management robot 7 stores the received "number of electronic components". (S508) The management robot 7 collects the counted parts reels 4 from the X-ray inspection device 2.

[0167] Incidentally, it is also preferable that the management robot 7 and X-ray inspection device 2 are designed so that, during X-ray measurement, the parts reel 4 held by the arm 71 can move between the X-ray irradiation unit and the X-ray detector row in the X-ray inspection device 2. In this case, the management robot 7 can transport the parts reel 4 while holding it, making it possible to execute the above steps S503 to S508 without manual intervention.

[0168] (S509, S510) The management robot 7 inquires of the management server 6 about the "shelf number" which is the storage location of the parts shelf 5 to which the parts are to be stored, receives the "shelf number" from the management server 6, and stores it. (S511) The management robot 7 transports the parts reel 4 according to a preset driving procedure for the received and stored "shelf number," and stores it in the case 52 and in the parts shelf 5.

[0169] (S512) For confirmation, the management robot 7 reads the "shelf number" from the barcode 51 affixed to the storage case 52, and confirms that this "shelf number" matches the "shelf number" received and stored. If they do not match, a message indicating that they do not match is displayed on the touch panel display 703 (FIG. 10). A warning sound may also be output from a speaker provided in the management robot 7. Furthermore, it is preferable that measures to be taken (such as checking the shelf number) be displayed on the touch panel display 703 to the worker.

[0170] (S513) The management robot 7 generates, as a registration operation in the warehousing process, incoming part reel management information that is information linking the acquired and stored "part number," "number of electronic parts," and "shelf number." (S514) The management robot 7 transmits a registration request including the generated stored parts reel management information to the management server 6. (S515, S516) The management server 6 registers the received stocked parts reel management information, and returns a registration completion confirmation to the management robot 7.

[0171] Here, in the incoming parts reel management information registered in the management server 6, the storage location (shelf number) and the number of stored electronic parts (number of electronic parts) are clearly associated with the type (part number) of the electronic parts related to the inventory. As a result, according to the object management method (warehousing) of this embodiment in which the incoming parts reel management information is registered, it becomes possible to reliably carry out inventory management of, for example, a huge number of types of electronic parts without confusion.

[0172] In addition, this inventory parts reel management information is also generated almost automatically by the management robot 7, and further, the transportation of parts reels 4 and the reading of various bar codes are also performed almost automatically by the management robot 7, so the work time required for reliable inventory management is significantly reduced.

[0173] 12 is a sequence diagram showing another embodiment of the object management method (shipping) according to the present invention. In this embodiment, the task of taking out the parts reel 4 from the parts shelf 5 is performed by the management robot 7.

[0174] In addition, upon receiving a shipping instruction including information on the type and quantity of electronic components to be shipped, the management server 6 generates withdrawal list information including the "part number" of the electronic component to be shipped, the "shelf number" where it is stored, and the "number of electronic components" which is the number of components to be shipped.

[0175] (S601) The out-of-stock process is selected as the process mode for the management robot 7 (by the worker). (S602, S603) The management robot 7 transmits a payout list information request to the management server 6, receives the payout list information from the management server 6, and stores it.

[0176] (S604) The management robot 7 pulls out the case 52 corresponding to the "shelf number" position included in the received and stored dispensing list information, and removes the stored parts reel 4. (S605) For confirmation, the management robot 7 reads out the "part number" from the bar code 41 affixed to the taken-out part reel 4.

[0177] (S606) The management robot 7 checks whether the read "part number" matches the "part number" included in the received and stored dispensing list information. If they do not match, a message indicating this is displayed on the touch panel display 703 (FIG. 10). A warning sound may also be output from a speaker provided on the management robot 7. It is also preferable that the touch panel display 703 displays to the worker measures to be taken (for example, checking the shelf number, etc.).

[0178] (S607) The management robot 7 displays on the touch panel display 703 the "number of electronic components" included in the received and stored removal list information, and indicates to the worker the number of electronic components to be removed from the component reel 4. At this point, a notification voice such as "The number of removed components is ** pieces" may be output from a speaker provided on the management robot 7.

[0179] (S608) As part of the registration process for the outgoing processing, the management robot 7 generates outgoing part reel management information, which is information linking the "part number," "shelf number," and "number of electronic parts" contained in the received and stored withdrawal list information. (S609) The management robot 7 transmits a registration request including the generated out-of-stock parts reel management information to the management server 6. (S610, S611) The management server 6 registers the received outgoing parts reel management information, and returns a registration completion confirmation to the management robot 7.

[0180] Here, in the outgoing parts reel management information registered in the management server 6, the storage location (shelf number) and the number of outgoing electronic parts (number of electronic parts) are clearly associated with the type (part number) of the outgoing electronic parts. As a result, according to the object management method (outgoing) of this embodiment in which the outgoing parts reel management information is registered, it becomes possible to reliably carry out outgoing management of, for example, a huge number of types of electronic parts without confusion.

[0181] In addition, this outgoing parts reel management information is also generated almost automatically by the management robot 7, and further, the transportation of parts reels 4 and the reading of various bar codes are also performed almost automatically by the management robot 7, so the work time required for reliable outgoing management is significantly reduced.

[0182] [Design of case for storing parts reels] Fig. 13 is a front view and a rear view of an embodiment of a case for storing parts reels according to the present invention. Fig. 14 is a plan view, a bottom view, and a right side view of an embodiment of a case for storing parts reels according to the present invention. Fig. 15 is a reference perspective view from the front side showing the names of each part, and a reference perspective view from the rear side of an embodiment of a case for storing parts reels according to the present invention. Note that the left side view is omitted because it is symmetrical with the right side view shown in Fig. 14.

[0183] [Description of the article to which the design pertains] As shown in Figures 13 to 15, this article is a case for storing part reels, etc., and is made of a synthetic resin with high X-ray transmittance. It has a protrusion in the case storage section, a chucking section shaped to facilitate chucking by a handling unit attached to the end of a robot arm, and a side protrusion shaped to facilitate holding by the handling unit.

[0184] [Design Description] The part indicated by the solid line is the part for which a design registration is sought as a partial design. The part for which a design registration is sought corresponds to the outer surface (flat surface, right side, left side, and bottom surface) of the case excluding the surface (front) and back surface of the storage section, and is specified including a "reference perspective view seen from the front side showing the names of each part" and a "reference perspective view seen from the back side showing the names of each part."

[0185] As described above in detail, according to the object counting program, device, and method of the present invention, the number of objects can be found more accurately even when the image portions of the objects to be counted are connected and not isolated from each other, so that, for example, in an X-ray inspection device, it is not necessary to ensure an extremely high image resolution. As a result, it is possible to perform object counting processing more accurately without imposing an excessive processing load.

[0186] In addition, according to the object management program, device, and method of the present invention, it is possible to more easily generate "object management information" that links "object identification information," "management location information," and "object number information" that reliably corresponds to the current state and management status of the object, thereby making it possible to improve the efficiency of object management operations.

[0187] Furthermore, the present invention, which achieves the exceptional effects described above, can also significantly reduce the costs required for implementation, and therefore, although this is only one example of application, it will also contribute greatly to improving the efficiency of parts management operations in small and medium-sized enterprises that develop and market a large number of original products.

[0188] Regarding the various embodiments of the present invention described above, various changes, modifications, and omissions within the scope of the technical idea and perspective of the present invention can be easily made by those skilled in the art. The above description is merely an example and is not intended to be restrictive in any way. The present invention is limited only by the scope of the claims and their equivalents. [Explanation of symbols]

[0189] 1 Inspection device control PC (object counting device) 101 Signal Interface (IF) 102, 301, 701 Communication interface (IF) 103 Image storage unit 104 Counting result storage unit 106 Display (DP) 107 Keyboard(KB) 11, 41, 51, 91 Barcode 12 Binary Images 13 Histogram 14 Counting parameters 111 Binary Image Generation Unit 112 Object region determination unit 113 Area size determination unit 114 Count number determination unit 114a Histogram generation unit 114b Size range setting section 115 Object Quantity Determination Unit 115a Barcode generator 116, 318 Input / Output Control Unit 2 X-ray inspection equipment 3. Handheld terminal (object management device) 302, 702 Barcode reader 303, 703 Touch Panel Display (TP / DP) 304, 704 Setting condition storage section 305, 706 Management information storage department 311, 711 Number information acquisition unit 312, 712 Identification information acquisition unit 313, 713 Management location information acquisition unit 314, 714 Management information generation section 315, 715 Management Information Provision Department 316, 716 Section setting information provision section 317, 717 Object Verification Department 4 Parts Reel 5 Parts shelf 52 cases 6 Management Server 7. Administrative Robots 705 Driving Information Storage Unit 71 Arm 719 Arm drive control unit 72 Drive unit 8 Robot control terminal 9. Payment List

Claims

1. An object counting system that uses an image showing a plurality of objects and counts the objects, the object has an X-ray absorbing portion that absorbs X-rays without substantially interfering with the X-rays; an irradiation unit that irradiates the object with X-rays; A detector for detecting X-rays irradiated onto the object; an image generating means for generating, as the image, a non-hologram image at the position of the detector based on a detection result by the detector; an object region determining means for determining a closed image region in a non-holographic image at the detector that directly corresponds to the x-ray absorbing portion; A region size determination means for calculating a quantity related to the size of each of the determined closed image regions; a count number determining means for determining a count number in each closed image region based on the amount related to the size calculated for that closed image region; an object number determining means for determining the number of objects based on the determined count number for each of the determined closed image regions; An object counting system comprising:

2. The object counting system described in claim 1, characterized in that the count number determination means sets a plurality of intervals for the quantity related to the size, each of which has a count number pre-assigned to it, and sets the count number of each closed image area to the count number associated with the interval to which the quantity related to the size calculated for the closed image area belongs.

3. The object counting system according to claim 2, characterized in that the count number determination means determines the section associated with the count number using a trained estimation model based on graph data showing the relationship between the amount related to the size and the number of closed image areas corresponding to the amount related to the size, and information identifying the object or the type of object.

4. The object counting system of any one of claims 1 to 3, characterized in that the multiple objects are multiple parts having metal portions contained on a parts reel, and the non-holographic image at the detector position is an image generated by detecting X-rays irradiated onto the surface of the parts reel.

5. An object counting management system including an object counting device that uses an image showing a plurality of objects and counts the objects, and an object management device that is capable of exchanging information with the object counting device and is used to manage the objects, the object has an X-ray absorbing portion that absorbs X-rays without substantially interfering with the X-rays, and the image is a non-holographic image at the position of a detector that is generated by detecting X-rays irradiated to the object with the detector; The object counting device includes: an object region determining means for determining a closed image region in a non-holographic image at the detector that directly corresponds to the x-ray absorbing portion; A region size determination means for calculating a quantity related to the size of each of the determined closed image regions; a count number determining means for determining a count number in each closed image region based on the amount related to the size calculated for that closed image region; an object number determining means for determining the number of objects based on the determined count number for each of the determined closed image regions; having The object management device includes: a number information acquiring means for acquiring object number information, which is information relating to the number of the plurality of objects, from the object counting device; an identification information acquisition means for acquiring object identification information which is information for identifying the plurality of objects; a management location information acquiring means for acquiring management location information which is information relating to the locations where the plurality of objects are managed; a management information generating means for generating object management information linking the object identification information, the management position information, and the object number information; a management information providing means for providing the generated object management information to an external object information management unit; An object counting management system comprising:

6. The count number determining means sets a plurality of intervals for the amount related to the size, each interval being associated with a count number in advance, and determines the count number of each closed image region as the count number associated with the interval to which the amount related to the size calculated for the closed image region belongs, The object management device includes: A means for acquiring or determining interval setting information for the plurality of objects to be counted, the interval setting information being used when the count number determining means sets the interval, and providing the information to the object counting device.

6. The object counting and management system according to claim 5, further comprising:

7. A plurality of managed objects are provided with an identification information providing unit capable of holding and externally presenting their own object identification information, the identification information acquisition means acquires removal target identification information which is information for identifying the managed object, at least a part of which is to be removed from the position; The object management device includes: a means for determining whether the acquired identification information of the object to be removed coincides with the identification information of the object to be managed, which is the object to be at least partially removed, acquired from the identification information providing unit, and outputting the result of the determination; 7. The object counting and management system according to claim 5 or 6, further comprising:

8. the object counting device displays a code representing information related to the determined number of the objects, or writes the information related to the number into a wireless tag for short-range wireless communication; the object management device further includes a code reading unit that reads the displayed code, or a tag information reading unit that reads information written in the wireless tag, The number information acquisition means acquires the object number information via the code reading unit or the tag information reading unit. The object counting management system according to any one of claims 5 to 7.

9. An object counting device that uses an image showing a plurality of objects and counts the objects, the object has an X-ray absorbing portion that absorbs X-rays without substantially interfering with the X-rays; an image generating means for generating, as the image, a non-hologram image at the position of a detector based on a detection result by the detector that detects X-rays irradiated onto the object; an object region determining means for determining a closed image region in a non-holographic image at the detector that directly corresponds to the x-ray absorbing portion; A region size determination means for calculating a quantity related to the size of each of the determined closed image regions; a count number determining means for determining a count number in each closed image region based on the amount related to the size calculated for that closed image region; an object number determining means for determining the number of objects based on the determined count number for each of the determined closed image regions; An object counting device comprising:

10. The object counting device described in claim 9, characterized in that the count number determination means sets a plurality of intervals for the quantity related to the size, each of which has a count number pre-assigned to it, and sets the count number of each closed image area to the count number associated with the interval to which the quantity related to the size calculated for the closed image area belongs.

11. The object counting device of claim 10, characterized in that the count number determination means determines the section associated with the count number using a trained estimation model based on graph data showing the relationship between the amount related to the size and the number of closed image areas corresponding to the amount related to the size, and information identifying the object or the type of object.

12. 1. An object counting method in a computer installed in an object counting device that uses an image showing a plurality of objects and counts the objects, comprising: the object has an X-ray absorbing portion that absorbs X-rays without substantially interfering with the X-rays, and the image is a non-holographic image at the position of a detector that is generated by detecting X-rays irradiated to the object with the detector; determining a closed image area in a non-holographic image at the detector that directly corresponds to the x-ray absorbing portion; calculating a quantity related to the size of each of the determined closed image regions; determining a count for each closed image region based on the size quantity calculated for that closed image region; determining a number of objects based on the determined count for each determined closed image region; 1. An object counting method comprising the steps of:

Citation Information

Patent Citations

  • Method for processing recognizing pictures of plural objects

    JP1990230475A

  • Number deciding method for uniform granular material

    JP1993165958A

  • Number of persons detecting device and number of users detecting device for elevator

    JP1999259625A

  • Number management method for component

    JP2006100428A

  • Device and method for counting part

    JP2007073710A