Image output device and image output system

Abstract

An image processing device includes: an acquisition unit that acquires an original image and attached information including a result of image processing performed on the original image as information attached to the original image; a generation unit that generates a thumbnail image of the original image selected on the basis of the additional information among the original images acquired by the acquisition unit in advance, and generates a thumbnail image of the original image that has not been generated in advance as required; and an output unit that outputs the thumbnail image generated by the generation unit in response to a request.

Description

Technical Field

[0001] This specification discloses an image output device and an image output system. Background Art

[0002] Conventionally, it has been proposed that in a recording and reproducing device that generates thumbnails of AV data recorded in an HD or DVD and stores them in a buffer area of ​​the HD, thumbnails with a high probability of being displayed are generated preferentially (for example, see Patent Document 1). In this recording and reproducing device, AV data is recorded in units of titles or chapters in an HD or DVD, and when a title video selection screen is displayed, it is determined that the thumbnails are likely to be displayed, and thumbnails to be displayed when the screen is switched to a chapter video selection screen are generated in advance. In addition, when a chapter video selection screen is displayed, thumbnails to be displayed when the screen is switched to a title video selection screen are generated in advance. Prior art literature Patent Literature

[0003] Patent Document 1: Japanese Patent Application Publication No. 2005-252790. Summary of the invention Problems to be solved by the invention

[0004] Although the technology described in Patent Document 1 can be applied to the case where thumbnails of images that are switched in a predetermined manner are prepared in advance for AV data recorded in units of titles or chapters, it cannot be applied to the case where thumbnails of images that are variously required from multiple images are prepared in advance.

[0005] The main object of the present disclosure is to increase the speed of outputting thumbnail images in response to requests by generating thumbnail images in advance, and to further reduce the load when generating thumbnail images in advance. Means for solving problems

[0006] In order to achieve the above-mentioned main object, the present disclosure adopts the following means.

[0007] The main purpose of the image output device disclosed in the present invention is to include: an acquisition unit that acquires an original image and additional information that is information attached to the original image and includes a result of image processing performed on the original image; a generation unit that generates in advance a thumbnail image of the original image selected based on the additional information from the original image acquired by the acquisition unit, and generates a thumbnail image of the original image that has not been generated in advance according to a request; and an output unit that outputs the thumbnail image generated by the generation unit according to a request.

[0008] In the image output device disclosed in the present invention, an original image and accompanying information including the result of image processing performed on the original image are obtained, and thumbnail images of the original images selected based on the accompanying information are prepared in advance. When a user uses the result of image processing to select an image to be confirmed later, thumbnail images of original images with a high probability of being requested to be output can be prepared in advance based on the accompanying information including the result of image processing. As a result, by preparing thumbnail images in advance, the output of the requested thumbnail images can be accelerated. In addition, compared with the case where thumbnail images are prepared for all the original images obtained, the load of preparing in advance can be further reduced.

[0009] The main purpose of the image output system disclosed in the present invention is to include: a photographing unit, which is arranged in an inspection device and photographs an original image of an inspection object; an image processing unit, which performs image processing on the original image of the inspection object photographed by the photographing unit to inspect the inspection object; an acquisition unit, which acquires the original image of the inspection object photographed by the photographing unit and accompanying information including the inspection result of the inspection object by the image processing unit as information accompanying the original image; a generation unit, which generates in advance a thumbnail image of the original image of the inspection object acquired by the acquisition unit, which is selected based on the accompanying information, and generates a thumbnail image of the original image that has not been generated in advance according to a request; and an output unit, which outputs the thumbnail image generated by the generation unit according to a request.

[0010] The image output system of the present disclosure can achieve the same effects as those of the image output device of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] Figure 1 This is a schematic configuration diagram of a production system including the image output system of this embodiment. Figure 2 This is an explanatory diagram showing an example of modules constituting the production system. Figure 3 This is a flowchart showing an example of image reception processing executed by the management device. Figure 4 This is a flowchart showing an example of image display processing executed by the management device. Figure 5 This is an explanatory diagram showing an example of display information displayed on the display device. DETAILED DESCRIPTION

[0012] Next, a mode for carrying out the present disclosure will be described with reference to the drawings.

[0013] Figure 1 1 is a schematic diagram of the structure of a production system 10 including the image output system according to the present embodiment. Figure 21 is an explanatory diagram showing an example of a module 20 constituting a production system. As shown in the figure, the production system 10 produces substrates on which components are mounted, and includes a plurality of modules 20 and a management device 30 for managing the plurality of modules 20.

[0014] The plurality of modules 20 include a printer, a printing inspection machine, a component mounting machine, a mounting inspection machine, and the like. Here, the printer prints solder on a substrate to form a circuit pattern. The printing inspection machine captures an image of the substrate to inspect whether the solder is normally printed on the substrate. The component mounting machine takes out components from a feeder 21 and mounts them on a substrate. The mounting inspection machine captures an image of the substrate to inspect whether the components are normally mounted on the substrate. Each module 20 includes: a photographing unit 20a, which captures an image of an inspection object (e.g., a substrate, solder, a component, etc.); and an image processing unit 20b, which processes the image of the inspection object captured by the photographing unit 20a to perform necessary inspection and confirmation.

[0015] like Figure 2 As shown, the component mounting machine as one of the modules 20 includes: a feeder 21 as a component supply device, which supplies components; a substrate conveying device 22, which conveys the substrate; a head 23, which uses a suction nozzle 24 (pickup component) that can move up and down to pick up the components supplied from the feeder 21 to the component supply position and install them on the substrate; and a head moving device 25, which moves the head 23 horizontally. In this embodiment, the head 23 holds a plurality of suction nozzles 24, and in one cycle from picking up to installing the components, a plurality of suction nozzles 24 can be used to pick up a plurality of components at a time and install them on the substrate. In addition, as a shooting unit 20a, the component mounting machine includes a mark camera 26, a side camera 27, and a part camera 28.

[0016] The marking camera 26 is configured to be movable together with the head 23 via the head moving device 25, and to photograph the upper surface of the component supplied by the supply device 21, or the upper surface of the substrate transported by the substrate transport device 22, or the upper surface of the substrate on which the component is mounted by the head 23. The image (original image) photographed by the marking camera 26 is output to the image processing unit 20b.

[0017] The side camera 27 is provided in the head 23, and when the suction nozzle 24 is caused to adsorb a component, it images the vicinity of the front end of the suction nozzle 24 from the side. The image (original image) captured by the side camera 27 is output to the image processing unit 20b.

[0018] The parts camera 28 is provided between the feeder 21 and the substrate transport device 22, and images the components from below when the suction nozzle 24 with the components sucked thereon passes above. The image (original image) captured by the parts camera 28 is output to the image processing unit 20b.

[0019] The image processing unit 20b obtains the images captured by the marking camera 26, the side camera 27, and the parts camera 28, respectively, and performs image processing. Specifically, as an image processing for the image captured by the marking camera 26, the image processing unit 20b obtains the image of the substrate captured by the marking camera 26 when the substrate is moved in by the substrate conveying device 22, and processes the acquired image to confirm the position of the substrate. In addition, when the image processing unit 20b uses the suction nozzle 24 to suck the component supplied from the feeder 21 to the component supply position, the image processing unit 20b processes the image of the component supply position captured by the marking camera 26 to confirm the presence or absence of the component at the component supply position and the position of the component. Moreover, after the component is installed on the substrate, the image processing unit 20b obtains the image of the substrate captured by the marking camera 26, and processes the acquired image to confirm the installation offset (position offset, angle offset) of the component relative to the substrate.

[0020] In addition, as image processing for the image captured by the side camera 27, the image processing unit 20b obtains an image near the front end of the suction nozzle 24 captured by the side camera 27 when the suction nozzle 24 adsorbs the component, and processes the obtained image to confirm whether the suction nozzle 24 adsorbs the component and the adsorption posture.

[0021] Moreover, as an image processing of the image taken by the part camera 28, the image processing unit 20b obtains the image taken by the part camera 28 when the suction nozzle 24 with the component adsorbed passes above the part camera 28, and processes the obtained image to confirm the adsorption offset (position offset, angle offset) of the component relative to the suction nozzle 24.

[0022] The image processing result in the image processing unit 20b is sent to the management device 30 together with the original image as information (status information) attached to the original image. For example, when the image of the component (target component) sucked by the suction nozzle 24 is captured by the part camera 28, the image processing result includes the positional offset (X coordinate value, Y coordinate value) and the angular offset (θ angle value) of the target component relative to the suction nozzle 24 determined by the image processing, and information indicating whether the positional offset and the angular offset are within the allowable range (whether there is an error, error code), etc. In addition, when the image of the component (target component) mounted on the substrate is captured by the mark camera 26, the image processing result includes the positional offset (X coordinate value, Y coordinate value) and the angular offset (θ angle value) of the target component relative to the substrate determined by the image processing, and information indicating whether the positional offset and the angular offset are within the allowable range (whether there is an error, error code), etc. In addition to the above-mentioned image processing results, the status information also includes parameters (image processing conditions) required for image processing and other information. The image processing conditions include, for example, shape data including the shape of the component, the allowable positional offset of the component, the allowable range of the angle offset, i.e., tolerance data, shooting conditions (camera, light source, etc. used for shooting), calibration data (distortion correction value of the camera, etc.), etc. Other information includes, for example, the shooting date and time of the original image, information for determining the type of the target component (component type information), information for determining the type of the substrate on which the target component is mounted (substrate type information), information for determining the feeder 21 used for supplying the target component (feeder information), information for determining the head 23 used for picking up and mounting the target component (head information), information for determining the suction nozzle 24 used for picking up the target component (suction nozzle information), etc.

[0023] The management device 30 manages the production line. In addition, the management device 30 obtains and stores the original image captured by the imaging unit 20a from each module 20 of the production line, and outputs (displays) it according to the request from the user. The management device 30 includes a processing unit 31, a communication unit 32, and a storage unit 33. In addition, the management device 30 is connected to an input device 41 such as a mouse and a keyboard, and a display device 42 for displaying various information.

[0024] The processing unit 31 is configured as a microprocessor centered around a CPU, and in addition to the CPU, includes a ROM storing a processing program, a RAM temporarily storing data, etc. The communication unit 32 is communicatively connected to the plurality of modules 20 constituting the production line, and exchanges various information with the plurality of modules 20 .

[0025] The storage unit 33 is configured as a storage device such as a hard disk drive or a solid state drive. The storage unit 33 stores an original image 34, status information 35, a thumbnail image 36, and the like. The original image 34 is photographed by the photographing unit 20a (marking camera 26, side camera 27, part camera 28, etc.) and obtained from the corresponding module 20 through communication. In the present embodiment, all images photographed during production in the production line are stored in the storage unit 33. The status information 35 includes image processing results, image processing conditions, and other information, and is attached to the original image 34 and obtained from the corresponding module 20 through communication together with the original image. The thumbnail image 36 stores a thumbnail image generated from the original image in the image receiving process and image display process described later.

[0026] Next, the operation of the image output system and the image output device of the present embodiment included in the production line thus constructed will be described. Here, the image output system of the present embodiment is equivalent to the photographing unit 20a and the image processing unit 20b and the management device 30 of each module 20, and the image output device of the present embodiment is equivalent to the management device 30.

[0027] Figure 3 1 is a flowchart showing an example of an image receiving process performed by the processing unit 31 of the management device 30. This process is repeatedly performed at predetermined intervals. When the image receiving process is performed, the processing unit 31 first determines whether the original image is received from the module 20 (S100). When the processing unit 31 determines that the original image is not received, the image receiving process is terminated directly.

[0028] When the processing unit 31 determines that the original image is received, the received original image is stored in the storage unit 33 (S110). Next, the processing unit 31 obtains the image processing result attached to the original image (S120), and judges whether the obtained image processing result is an error, that is, whether the obtained image processing result is an abnormal result based on the information contained in the obtained image processing result (S130). When the processing unit 31 determines that the image processing result is an error, it generates a thumbnail image of the original image received in S100, that is, the abnormal image determined to be an error in the image processing result (S140), and stores the thumbnail image generated in advance in the storage unit 33 in correspondence with the received original image (S150), and ends the image receiving process.

[0029] On the other hand, when the processing unit 31 determines that the image processing result of the original image received in S100 is normal rather than an error, the processing unit 31 retrieves an original image that is highly correlated with the original image received in S100 from among the original images 34 whose image processing results are errors among the other original images 34 stored in the storage unit 33 (S160). In the present embodiment, the processing is performed by retrieving original images that are common to at least one of the image processing conditions from among the original images 34 whose image processing results are errors. For example, in the case of retrieving other original images that are highly correlated with the original image obtained by photographing the object element, original images obtained by photographing other elements picked up by the head 23 (a plurality of nozzles 24) in the same cycle as the object element, original images obtained by photographing other elements of the same shape as the object element, and original images obtained by photographing the object element using other cameras, etc. can be listed. When the processing unit 31 determines that there are other original images 34 with high relevance among the original images 34 for which the image processing result is an error (Yes in S170), it generates a thumbnail image of the original image received in S100 in advance (S140), stores the thumbnail image generated in advance in the storage unit 33 (S150), and ends the image receiving process. On the other hand, when the processing unit 31 determines that there are no other original images 34 with high relevance (No in S170), it does not generate a thumbnail image in advance, and ends the image receiving process.

[0030] Next, an image display process performed in response to a request from a user after a plurality of original images 34 (including state information 35 ) are stored in the storage unit 33 will be described. Figure 4 This is a flowchart showing an example of the image display process executed by the processing unit 31 of the management device 30 .

[0031] When executing the image display process, the processing unit 31 of the management device 30 first determines whether a display request is issued by the user through the operation of the input device 41 (S200). When the processing unit 31 determines that a display request is not issued, the image display process is terminated directly.

[0032] When the processing unit 31 determines that a display request has been made, it obtains the search condition specified by the user (S210). The original image 34 that meets the specified search condition is retrieved from the original image 34 stored in the storage unit 33 (S220). As the search condition, the condition of shooting at a specified date and time, the condition of a specified component type, the condition of a specified substrate type, the condition of a specified nozzle, the condition of a specified camera, the condition of an image processing error occurring in a specified error code, etc. can be listed.

[0033] Next, the processing unit 31 determines whether a thumbnail image 36 has been generated for the original image 34 that meets the search condition (S230). When the processing unit 31 determines that the thumbnail image 36 has been generated, it obtains the generated thumbnail image 36 from the storage unit 33 (S240). When the processing unit 31 determines that the thumbnail image 36 has not been generated, it generates a thumbnail image 36 of the original image 34 that meets the search condition (S250). In addition, when the processing unit 31 generates the thumbnail image 36, it stores the generated thumbnail image 36 in the storage unit 33 in correspondence with the original image 34. And, the processing unit 31 waits for the preparation of the thumbnail image 36 to be completed (S260). When the processing unit 31 determines that the preparation of the thumbnail image 36 has been completed, it displays the thumbnail image 36 together with the corresponding status information 35 on the display device 42 at a glance (S270), and ends the image display processing. The list display of the thumbnail images 36 may be performed at once when acquisition of all the thumbnail images 36 displayed on the same screen is completed, or may be displayed sequentially from the acquired thumbnail images.

[0034] Figure 5 An example of display information displayed on the display device 42 is shown. As shown in the figure, the display information includes a thumbnail image of the original image, image processing results (for example, position offset, angle offset, error information, etc.), and other information (for example, component type information, component shape, head information, nozzle information, camera information, etc.). These display information, for example, display a specified number (for example, 3) at a glance in one screen, enter the next screen by operating the back button, and return to the previous screen by operating the forward button. The display information also includes a filter button for filtering the data to be displayed by specifying filter conditions. The filter button includes the designation of the shooting date and time, the designation of the error code of the image processing, the designation of the component, the designation of the component shape, the designation of the head 23 used, the designation of the nozzle 24 used, the designation of the camera used, etc. When the filter button is operated by the user, the processing unit 31 retrieves the data with the filter condition corresponding to the filter button, so that the thumbnail image 36 and the status information 35 of the data that meets the filter condition are displayed on the display device 42.

[0035] Here, when an error occurs in the production line during production, the user may want to check the image captured by the imaging unit 20a and having an error in the image processing result or an image highly related thereto in order to identify the cause of the error. In this case, the user specifies the search condition to the management device 30 and requests display, so that the thumbnail images of the original image with an error in the image processing result or the original image highly related thereto can be displayed at a glance on the display device 42 together with the information including the image processing result. In the present embodiment, among the original images received from each module 20, if the image processing result is an error, the processing unit 31 of the management device 30 generates a thumbnail image of the received original image, and even if the image processing result is normal, if at least one of the image processing conditions matches the received original image and the other original image 34 with an error in the image processing result is stored in the storage unit 33, the processing unit 31 of the management device 30 also generates a thumbnail image of the received original image. Therefore, the thumbnail images of the original image with an error in the image processing result or the original image highly related thereto can be quickly displayed according to the request from the user, which can help identify the error. Furthermore, compared with the case where thumbnail images of all original images received from each module 20 are generated in advance, the load when the thumbnail images are generated in advance can be reduced.

[0036] Here, the correspondence between the main elements of the embodiment and the main elements of the present disclosure described in the claims is described. That is, the processing unit 31 of the present embodiment that performs S100 to S120 of the image receiving process is equivalent to the acquisition unit of the present disclosure, the processing unit 31 that performs S140 of the image receiving process and S250 of the image display process is equivalent to the generation unit, and the processing unit 31 and the display device 42 that perform S270 of the image display process are equivalent to the output unit. In addition, the shooting unit 20a (marking camera 26, side camera 27, part camera 28) is equivalent to the shooting unit, and the image processing unit 20b is equivalent to the image processing unit.

[0037] In addition, the present disclosure is not limited to the above-mentioned embodiment at all, and can be implemented in various forms as long as it belongs to the technical scope of the present disclosure.

[0038] For example, in the above-described embodiment, the processing unit 31 generates in advance a thumbnail image of the received original image 34 not only when the image processing result of the received original image 34 is an error, but also when the image processing result of the received original image 34 is normal but at least one of the state information 35 (image processing conditions) is consistent with the received original image 34 and the image processing result is an error and other original images 34 are stored in the storage unit 33. However, the following method may be adopted, that is, the processing unit 31 generates in advance a thumbnail image only for the image whose image processing result is an error among the received original images 34, and generates thumbnail images for other original images 34 according to the request from the user.

[0039] In the above embodiment, the processing unit 31 displays thumbnail images of the original image 34 on the display device 42 in response to a user's request. However, the processing unit 31 may output or print information including thumbnail images to other devices in response to a user's request.

[0040] In addition, in the above-mentioned embodiment, the processing unit 31 obtains the original image captured by the imaging unit 20a (mark camera 26, side camera 27, part camera 28) of the component mounting machine as the module 20 together with the state information, and generates in advance a thumbnail image of the original image selected based on the state information from the acquired original image. However, it is not limited to the component mounting machine, and in other modules 20 equipped with the imaging unit 20a such as a printing machine, a printing inspection machine, and a mounting inspection machine, when the original image captured by the imaging unit 20a is obtained, a thumbnail image can also be generated in advance under the same conditions.

[0041] As described above, in the image output device of the present disclosure, an original image and accompanying information including the result of image processing performed on the original image are obtained, and thumbnail images of the original image selected based on the accompanying information are prepared in advance. When a user uses the result of image processing to select an image to be confirmed later, thumbnail images of original images with a high probability of being requested to be output can be prepared in advance based on the accompanying information including the result of image processing. As a result, by preparing thumbnail images in advance, the output of the requested thumbnail images can be accelerated. In addition, compared with the case where thumbnail images are prepared for all the original images obtained, the load of preparing thumbnail images in advance can be further reduced.

[0042] In such an image output device of the present disclosure, the generating unit may generate the thumbnail image in advance for at least one of the original images acquired by the acquiring unit, which is an abnormal image, that is, an abnormal image, as a result of the image processing. In this way, when a user wants to confirm an original image that has obtained an abnormal result as a result of the image processing, the thumbnail image thereof can be quickly output. In this case, the supplementary information may include image processing conditions when the image processing is performed, and the generating unit may generate the thumbnail image in advance for at least one of the original images acquired by the acquiring unit, which has obtained a normal result as a result of the image processing and at least one of the image processing conditions is common to the abnormal image. In this way, when a user wants to confirm an associated normal original image in addition to the original image that has obtained an abnormal result as a result of the image processing, these thumbnail images can be quickly output.

[0043] The present disclosure is not limited to the form of an image output device, and may take the form of an image output system including a photographing section and an image processing section in addition to the image output device. Industrial Applicability

[0044] The present disclosure can be utilized in the manufacturing industry of image output devices and image output systems, and the like. Description of Reference Numerals

[0045] 10 production system, 20 module, 20a shooting unit, 20b image processing unit, 21 feeder, 22 substrate transport device, 23 head, 24 nozzle, 25 head moving device, 26 marking camera, 27 side camera, 28 part camera, 30 management device, 31 processing unit, 32 communication unit, 33 storage unit, 34 original image, 35 status information, 36 thumbnail image, 41 input device, 42 display device.

Claims

1. An image output device, comprising: an acquisition unit that acquires an original image and, as information accompanying the original image, accompanying information including a result of image processing performed on the original image; a generating unit that generates in advance thumbnail images of original images selected based on the supplementary information among the original images acquired by the acquiring unit, and generates thumbnail images of original images that cannot be generated in advance upon request; and The output unit outputs the thumbnail image generated by the generating unit in response to a request.

2. The image output device according to claim 1, wherein: The generating unit generates the thumbnail image in advance for an abnormal image, which is an original image that has obtained an abnormal result as a result of the image processing, among the original images acquired by the acquiring unit.

3. The image output device according to claim 2, wherein: The supplementary information includes image processing conditions when performing the image processing. The generating unit generates the thumbnail image in advance for an original image that has obtained a normal result as the image processing result and has at least one of the image processing conditions in common with the abnormal image, among the original images acquired by the acquiring unit.

4. An image output system comprising: A photographing unit, provided in the inspection device, photographing an original image of the inspection object; an image processing unit that performs image processing on an original image of the inspection object captured by the imaging unit to inspect the inspection object; an acquisition unit that acquires an original image of the inspection object photographed by the imaging unit and additional information including an inspection result of the inspection object by the image processing unit as information attached to the original image; a generating unit that generates in advance a thumbnail image of the original image of the inspection object obtained by the obtaining unit and selected based on the supplementary information, and generates, upon request, a thumbnail image of the original image that could not be generated in advance; as well as The output unit outputs the thumbnail image generated by the generating unit in response to a request.

Images