Image output device and image output system

Abstract

An image processing apparatus includes an acquisition section configured to acquire original images and accompanying information representing a result of image processing performed on the original images as information about the original images, a generation section configured to generate in advance a thumbnail image of an original image selected from the original images acquired by the acquisition section on the basis of the accompanying information, and to generate, in response to a request, thumbnail images of original images that have not been generated in advance, and an output section configured to output the thumbnail image generated by the generation section in response to a request.

Description

Technical area

[0001] The present description relates to an image output device and an image output system. State of the art

[0002] Conventionally, regarding a recording and reproducing apparatus that creates thumbnails of AV data recorded on an HD or DVD and stores the created thumbnails in a buffer area of ​​the HD, a recording and reproducing apparatus that preferentially creates thumbnails with good displayability has been proposed (see, for example, Patent Literature 1). In this recording and reproducing apparatus, AV data is recorded on the HDD or DVD in units of titles or chapters, and when a title video selection screen is displayed, it is determined that there is a high probability of displaying thumbnails to be displayed during the screen transition to a chapter video selection screen, and the thumbnails are created in advance.When the chapter video selection screen is displayed, the thumbnails to be displayed while the screen switches to the title video selection screen are generated in advance. Bibliography Patent Literature

[0003] Patent Literature 1: JP-A-2005-252790 Overview of the inventionTechnical task

[0004] The technique described in Patent Literature 1 can be applied to a case where thumbnails of images for which screen content switching is performed in a predetermined mode, such as AV data recorded in title or chapter units, are prepared in advance, but cannot be applied to a case where thumbnails of images from a plurality of images required in varying manner are prepared in advance.

[0005] A primary objective of the present disclosure is to increase the output speed of thumbnail images in response to a request by generating the thumbnail images in advance and to further reduce the computational load of generating the thumbnail images in advance. Solution to the Problem

[0006] The present disclosure uses the following means to achieve the main object described above.

[0007] An image output device according to the present disclosure comprises: an acquisition section configured to acquire original images and accompanying information, including a result of image processing performed on the original images, as information associated with the original images; a generation section configured to generate in advance a thumbnail image of an original image selected from among the original images acquired by the acquisition section based on the accompanying information, and to generate, in response to a request, thumbnail images of original images that have not been generated in advance; and an output section configured to output the thumbnail image generated by the generation section in response to a request.

[0008] In the image output device according to the present disclosure, the original images and the accompanying information including the result of image processing performed on the original images are acquired, and the thumbnail of the original image selected from the acquired original images based on the accompanying information is generated in advance. When the result of image processing is used to select an image to be confirmed later, a user can create in advance a thumbnail of an original image that is highly likely to be requested for output based on the accompanying information including the result of image processing. Therefore, it is possible to speed up the output of the thumbnail in response to the request by generating the thumbnail in advance.In addition, compared to a case where thumbnails are generated for all acquired original images, it is possible to further reduce the computational load if the thumbnails are generated in advance.

[0009] An image output system of the present disclosure comprises: an imaging section provided in an inspection device and configured to capture original images of an inspection object; an image processing section configured to perform image processing on the original images of the inspection object acquired by the imaging section and inspect the inspection object; an acquisition section configured to acquire the original images of the inspection object acquired by the imaging section and accompanying information, including an inspection result of the inspection object by the image processing section, as information corresponding to the original images; a generating section configured to generate in advance a thumbnail of an original image selected from the original images of the inspection object acquired by the acquiring section based on the accompanying information, and to generate non-pregenerated thumbnails of original images in response to a request; and an output section configured to output the thumbnail images generated by the generating section in response to a request.

[0010] The image output system of the present disclosure can achieve the same effect as the image output apparatus of the present disclosure. Short description of the drawings Fig. 1 is a schematic configuration diagram of a manufacturing system including an image output system of the present embodiment. Fig. 2 is a view illustrating an example of a module constituting the manufacturing system. Fig. 3 is a flowchart illustrating an example of image reception processing executed by a management device. Fig. 4 is a flowchart illustrating an example of image display processing executed by the management device. Fig. 5 is a view illustrating an example of display information displayed on a display device. Description of embodiments

[0011] Next, an embodiment of the present disclosure will be described with reference to the drawings.

[0012] Fig. 1 is a schematic layout diagram of a manufacturing system 10 including an image output system of the present embodiment. Fig. Figure 2 is a view illustrating an example of a module 20 included in the manufacturing system. As shown, the manufacturing system 10 produces a printed circuit board on which components are mounted and includes a plurality of modules 20 and a management device 30 that manages a plurality of modules 20.

[0013] Several modules 20 include a printing machine, a printing inspection machine, a component mounter, a placement inspection machine, and the like. Here, the printing machine forms a circuit pattern by printing solder on a circuit board. The printing inspection machine captures an image of the board and checks whether the solder is properly printed on the board. The component mounter removes a component from the feeder 21 and mounts the component on the circuit board. The placement inspection machine captures an image of the board and checks whether the component is properly mounted on the board. Each module 20 has an imaging section 20a that captures an image of an inspection object (e.g., a board, solder, or a component), and an image processing section 20b that processes the image of the inspection object captured by the imaging section 20a to perform the required inspection or confirmation.

[0014] As in Fig. As shown in Fig. 2, the component mounter includes, as one of the modules 20, a feeder 21 as a component supply device that provides a component, a board conveying device 22 that conveys a board, a head 23 that picks up the component delivered by the feeder 21 to a component supply position with a suction nozzle 24 (pick-up member) that is vertically movable and mounts the component on the board, and a head moving device 25 that moves the head 23 horizontally. In the present embodiment, the head 23 supports a plurality of suction nozzles 24 and can pick up a plurality of components simultaneously with a plurality of suction nozzles 24 and mount the components on the board in one cycle from picking up to mounting the components. In addition, the component mounter includes a marking camera 26, a side camera 27, and a part camera 28 as the imaging section 20a.

[0015] The marking camera 26 is configured to be movable together with the head 23 by the head moving device 25, and captures an image of the top surface of the component fed from the feeder 21, a top image of the top surface of the printed circuit board conveyed by the board conveying device 22, and a top image of the top surface of the printed circuit board on which the component is mounted by the head 23. The image captured by the marking camera 26 (original image) is output to the image processing section 20b.

[0016] The side camera 27 is installed on the head 23 and captures an image of the vicinity of the front portion of the suction nozzle 24 from the side when the component is picked up by the suction nozzle 24. The image captured by the side camera 27 (original image) is output to the image processing section 20b.

[0017] The part camera 28 is installed between the feeder 21 and the board conveying device 22 and captures an image of the component from below as the suction nozzle 24 that has picked up the component moves over it. The image captured by the part camera 28 (original image) is output to the image processing section 20b.

[0018] The image processing section 20b acquires images captured by the marking camera 26, the side camera 27, and the part camera 28, and performs image processing for each of the acquired images. Specifically, as part of image processing for the image captured by the marking camera 26, the image processing section 20b acquires an image of the printed circuit board captured by the marking camera 26 when the printed circuit board is conveyed by the board conveying device 22 and processes the acquired image to confirm the position of the printed circuit board. When the component delivered from the feeder 21 to the component supply position is picked up by the suction nozzle 24, the image processing section 20b also processes the image of the component supply position captured by the marking camera 26 to confirm the presence or absence of the component and the position of the component at the component supply position.After the component is mounted on the circuit board, the image processing section 20b further acquires an image of the circuit board taken by the marking camera 26 and processes the acquired image to confirm a mounting deviation amount (a positional deviation amount and an angular deviation amount) of the component with respect to the circuit board.

[0019] In addition, the image processing section 20b acquires, as part of image processing for the image captured by the side camera 27, an image of the vicinity of the front portion of the suction nozzle 24 captured by the side camera 27 when the component is picked up by the suction nozzle 24, and processes the acquired image to confirm whether the component is picked up by the suction nozzle 24 and the pickup posture.

[0020] Further, in image processing for the image captured by the part camera 28, the image processing section 20b acquires an image captured by the part camera 28 when the suction nozzle 24 that has picked up the component moves above the part camera 28, and processes the captured image to confirm a suction deviation amount (a positional deviation amount and an angular deviation amount) of the component with respect to the suction nozzle 24.

[0021] The image processing result in the image processing section 20b is transmitted to the management device 30 along with the original image as information (status information) accompanying the original image. For example, when an image of the component (target component) picked up by the suction nozzle 24 is captured by the parts camera 28, the image processing result includes a positional deviation amount (X coordinate value, Y coordinate value) and an angular deviation amount (θ angle value) of the target component with respect to the suction nozzle 24 affected by the image processing, information (presence or absence of an error and an error code) indicating whether the positional deviation amount and the angular deviation amount are within an allowable range, and the like.When an image of the component mounted on the circuit board (target component) is captured by the marking camera 26, the image processing result includes a positional deviation amount (X coordinate value, Y coordinate value) and an angular deviation amount (θ angle value) of the target component with respect to the circuit board affected by the image processing, information (presence or absence of a defect and an error code) indicating whether the positional deviation amount and the angular deviation amount are within an allowable range, and the like. The status information includes parameters (image processing conditions) required for image processing and other information in addition to the image processing result described above.The image processing conditions include, for example, shape data including an external shape of the component and tolerance data representing an allowable range of a positional deviation amount and an angular deviation amount of the component, detection conditions (such as a camera and a light source used for detection), calibration data (such as a distortion correction value of the camera), and the like.Other information includes, for example, the shooting date and time of the original image, information (component type information) indicating the type of the target component, information (board type information) indicating the type of the circuit board on which the target component is mounted, information (feeder information) specifying the feeder 21 used to feed the target component, information (head information) specifying the head 23 used to pick up and mount the target component, and information (nozzle information) specifying the suction nozzle 24 used to pick up the target component.

[0022] The management device 30 controls a production line. The management device 30 acquires and stores the original images acquired by the imaging section 20a of each module 20 of the production line and outputs (displays) the original images in response to a request from the user. The management device 30 includes a processing section 31, a communication section 32, and a storage section 33. In addition, an input device 41, such as a mouse and a keyboard, and a display device 42 for displaying various information are connected to the management device 30.

[0023] The processing section 31 is configured as a CPU-centered microprocessor and includes, in addition to the CPU, a ROM that stores a processing program, a RAM that temporarily stores data, and the like. The communication section 32 is communicatively connected to a plurality of modules 20 constituting the production line and exchanges various information with the plurality of modules 20.

[0024] The storage section 33 is configured as a storage device such as a hard disk drive or a solid-state drive. The storage section 33 stores the original image 34, status information 35, a thumbnail image 36, and the like. The original image 34 is captured by the imaging section 20a (such as the marker camera 26, the side camera 27, and the partial camera 28) and obtained through communication from the corresponding module 20. In the present embodiment, all images captured during production on the production line are stored in the storage section 33. The status information 35 includes an image processing result, image processing conditions, and other information, and is acquired through communication from the corresponding module 20 together with the original image 34 as information accompanying the original image 34.A thumbnail image 36 is generated from an original image in image reception processing or image display processing as described below and stored.

[0025] Next, the operations of the image output system and the image output device of the present embodiment included in the production line constructed as described above will be described. Here, the image output system of the present embodiment corresponds to the imaging section 20a and the image processing section 20b provided in each module 20, and the management device 30, and the image output device of the present embodiment corresponds to the management device 30.

[0026] Fig. 3 is a flowchart illustrating an example of image reception processing executed by the processing section 31 of the management device 30. This processing is repeatedly executed every predetermined period. When executing the image reception processing, the processing section 31 first determines whether an original image is received from the module 20 (S100). If it is determined that the original image has not been received, the processing section 31 terminates the image reception processing without further operations.

[0027] If it is determined that the original image has been received, the processing section 31 stores the received original image in the storage section 33 (S110). Subsequently, the processing section 31 acquires an image processing result accompanying the original image (S120), and determines, based on information included in the acquired image processing result, whether the acquired image processing result indicates an error, that is, whether the acquired image processing result is an abnormal result (S130). If it is determined that the image processing result indicates an error, the processing section 31 generates in advance a thumbnail image of the original image received in S100, that is, a thumbnail image of the abnormal result.improper image which has been determined to have an image processing result indicating an error (S140), stores the thumbnail image generated in advance in the storage section 33 in association with the received original image (S150), and terminates the image reception processing.

[0028] On the other hand, if it is determined that the image processing result of the original image received in S100 does not indicate an error but is normal, the processing section 31 searches for original images particularly relevant to the original image received in S100 among other original images 34 stored in the storage section 33, focusing on original images 34 whose image processing result indicates an error (S160). In the present embodiment, this processing is performed by searching for original images 34 among original images 34 with an image processing result indicating an error, which share at least one of the image processing conditions.For example, when searching for other original images that are highly relevant to the original image obtained by capturing an image of the target component, other original images include an original image obtained by capturing an image of other components captured by the head 23 (plurality of suction nozzles 24) in the same cycle as the target component, an original image obtained by capturing an image of other components having the same shape as the target component, an original image obtained by capturing an image of the target component with a different camera, and the like.If it is determined that there are other original images 34 that are highly relevant to the original image among the original images 34 that have an image processing result indicating an error (YES in S170), the processing section 31 generates a thumbnail image of the original image received in S100 in advance (S140), stores the pre-generated thumbnail image in the storage section 33 (S150), and terminates the image reception processing. On the other hand, if it is determined that there are no other original images 34 that are highly relevant to the original image (NO in S170), the processing section 31 terminates the image reception processing without pre-generating thumbnail images.

[0029] Next, the image display processing executed in response to a user's request after a large number of original images 34 (including the status information 35) have been stored in the storage section 33 will be described. Fig. 4 is a flowchart illustrating an example of image display processing executed by the processing section 31 of the management device 30.

[0030] When executing image display processing, the processing section 31 of the management device 30 first determines whether a request for display has been made by the user through the operation of the input device 41 (S200). If it is determined that the display request has not been made, the processing section 31 terminates the image display processing.

[0031] If it is determined that the display request has been made, the processing section 31 acquires the search conditions specified by the user (S210). From the original images 34 stored in the storage section 33, the original images 34 that meet the specified search conditions are searched (S220). Possible search conditions include, for example, an image captured at a specific date and time, an image of a specific component type, an image of a specific circuit board type, an image of a specific nozzle, an image of a specific camera, and an image in which an image processing error with a specific error code occurred.

[0032] Next, the processing section 31 determines whether thumbnail images 36 have been generated for original images 34 that meet the search conditions (S230). If it is determined that thumbnail images 36 have been generated, the processing section 31 retrieves the generated thumbnail images 36 from the storage section 33 (S240). If it is determined that no thumbnail images 36 have been generated, the processing section 31 generates thumbnail images 36 of original images 34 that meet the search conditions (S250). After generating the thumbnail images 36, the processing section 31 stores the generated thumbnail images 36 in the storage section 33 in association with the original images 34. Then, the processing section 31 waits until the creation of the thumbnail images 36 is completed (S260).When it is determined that the creation of the thumbnail images 36 is complete, the processing section 31 displays a list of the thumbnail images 36 along with corresponding status information 35 on the display device 42 (S270) and terminates the image display processing. The display of a list of thumbnail images 36 may be performed immediately when the acquisition of all the thumbnail images 36 to be displayed on the same screen is completed, or it may be performed in the order of the acquired thumbnail images 36.

[0033] Fig. 5 shows an example of display information displayed on a display device 42. As in Fig.As shown in Figure 5, the display information includes a thumbnail of the original image, an image processing result (e.g., information such as a positional deviation amount, an angular deviation amount, and the presence or absence of a defect), and other information (e.g., information about a component type, a component shape, head information, nozzle information, and camera information). For example, the display information is displayed in a list up to a predetermined number (e.g., three) on one screen, advances to the next screen when a "Next" button is pressed, and returns to the previous screen when a "Previous" button is pressed. The display information also includes a filter button for narrowing down the data to be displayed by specifying filter conditions.The filter button includes options for specifying the shooting date and time, specifying the image processing error code, specifying the component, specifying the component shape, specifying the head 23 used, specifying the suction nozzle 24 used, specifying the camera used, and the like. When the user presses the filter button, the processing section 31 searches for data under the filter conditions that match the filter button and displays thumbnail images 36 and status information 35 of the data that match the filter conditions on the display device 42.

[0034] At this time, when a defect occurs on the production line during production, the user can examine the images captured by the imaging section 20a and an image processing result indicating a defect or images closely related thereto to determine the cause of the defect. In this case, the user specifies search conditions and requests the management device 30 to perform a display, so that it is possible to display a list of thumbnail images of original images having an image processing result indicating a defect and original images highly relevant thereto on the display device 42, along with the information containing the image processing result.In the present embodiment, the processing section 31 of the management device 30 generates a thumbnail image of the received original image among the original images received from the modules 20 not only when the image processing result indicates an error, but also when other original images 34 that satisfy at least one of the image processing conditions with the received original image and have an image processing result indicating an error are stored in the storage section 33, even when the image processing result indicates a normal state. Therefore, it is possible to quickly display thumbnail images of an original image having an image processing result indicating an error and original images highly relevant to the original image in response to a user's request, and to use the thumbnail images to specify an error.Furthermore, compared with a case where thumbnails of all the original images received by each module 20 are generated in advance, it is possible to reduce a computational load when the thumbnails are generated in advance.

[0035] Here, a correspondence between main elements of the embodiment and main elements of the present disclosure described in the claims will be described. That is, the processing section 31 of the present embodiment, which executes S100 to S120 of image reception processing, corresponds to an acquisition section of the present disclosure; the processing section 31, which executes S140 of image reception processing and S250 of image display processing, corresponds to a generation section; and the processing section 31, which executes S270 of image display processing, and the display device 42 correspond to an output section. The imaging section 20a (marker camera 26, side camera 27, and part camera 28) corresponds to an imaging section, and the image processing section 20b corresponds to an image processing section.

[0036] It goes without saying that the present disclosure is in no way limited to the embodiment described above and can therefore be implemented in various aspects as long as the aspects are within the technical scope of the present disclosure.

[0037] For example, in the above-described embodiment, the processing section 31 generates a thumbnail image of the received original image 34 in advance not only when the image processing result of the received original image 34 indicates an error, but also when other original images 34 that match the received original image 34 in at least one item of status information 35 (image processing conditions) and have an image processing result indicating an error are stored in the storage section 33, even if the image processing result of the received original image 34 indicates "normal." However, the processing section 31 may also generate a thumbnail image in advance only for the original image 34 among the received original images 34 that has an image processing result indicating an error, and may generate thumbnail images of other original images 34 in response to a user request.

[0038] In the embodiment described above, the processing section 31 displays the thumbnails of the original images 34 on the display device 42 in response to a user request. However, the processing section 31 may output information including the thumbnails to another device or print the information in response to a user request.

[0039] Furthermore, in the above-described embodiment, the processing section 31 acquires the original images captured by the imaging section 20a (marking camera 26, side camera 27, and part camera 28) provided in the component mounter as the module 20, along with the status information, and generates in advance a thumbnail image of the original image selected from the acquired original images based on the status information. However, the present invention is not limited to the component mounter, and when the original images acquired by the imaging section 20a are acquired in other modules 20 including the imaging section 20a, such as a printing press, a print inspection machine, or a placement inspection machine, the thumbnail images can be generated in advance under the same conditions.

[0040] As described above, in the image output device according to the present disclosure, an original image and accompanying information including a result of image processing performed on the original image are acquired, and a thumbnail of the original image selected from the acquired original images based on the accompanying information is generated in advance. When the result of image processing is used to select an image to be confirmed later, the user can create in advance a thumbnail of the original image that is highly likely to be requested for output based on the accompanying information including the result of image processing. This makes it possible to speed up the output of the thumbnail image in response to the request by generating the thumbnail image in advance.Furthermore, compared with a case where thumbnails are generated for all acquired original images, it is possible to further reduce the overhead if the thumbnails are generated in advance.

[0041] In the image output device according to the embodiment of the present disclosure, the generation section can generate in advance the thumbnail image of an irregular image, which is at least one original image for which an abnormal result is obtained as a result of image processing, from the original images acquired by the acquisition section. In this way, the thumbnail image can be quickly output when the user wants to confirm the original image for which an abnormal result is obtained as a result of image processing.In this case, the accompanying information may include image processing conditions for performing image processing, and the generation section may generate in advance the thumbnail image of an original image for which a normal result is obtained as a result of image processing and which has at least one of the image processing conditions in common with the abnormal image from the original images acquired by the acquisition section. In this way, when the user confirms not only the original image for which an abnormal result is obtained as a result of image processing but also the relevant normal original image, the thumbnail images can be quickly output.

[0042] The present disclosure is not limited to the form of an image output device and may take the form of an image output system comprising, in addition to the image output device, an imaging section and an image processing section. Industrial Applicability

[0043] The present disclosure is applicable to an image output device and an image output system in the manufacturing industry. List of reference symbols

[0044] 10: Manufacturing system, 20: Module, 20a: Imaging section, 20b: Image processing section, 21: Feeder, 22: PCB conveying device, 23: Head, 24: Suction nozzle, 25: Head moving device, 26: Marking camera, 27: Side camera, 28: Part camera, 30: Management device, 31: Processing section, 32: Communication section, 33: Storage section, 34: Original image, 35: Status information, 36: Thumbnail image, 41: Input device, 42: Display device. QUOTES CONTAINED IN THE DESCRIPTION

[0000] This list of documents submitted by the applicant was generated automatically and is included solely for the convenience of the reader. This list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions. Cited patent literature

[0000] JP-A-2005-252790

[0003]

Claims

[1] An image output device comprising: an acquisition section configured to acquire original images and accompanying information including a result of image processing performed on the original images as information accompanying the original images; a generating section configured to generate in advance a thumbnail image of an original image selected from the original images acquired by the acquiring section on the basis of the accompanying information, and to generate, in response to a request, thumbnail images of original images not generated in advance; and an output section configured to output the thumbnail image generated by the generating section in response to a request. [2] The image output apparatus according to claim 1, wherein the generating section generates in advance the thumbnail image of an abnormal image from the original images acquired by the acquiring section, which is at least one original image for which an abnormal result is obtained as a result of the image processing. [3] The image output device according to claim 2, wherein the accompanying information contains image processing conditions for performing the image processing and the generating section generates in advance, from the original images acquired by the acquiring section, the thumbnail image of an original image for which a normal result is obtained as a result of the image processing and which has at least one of the image processing conditions in common with the abnormal image. [4] An image output system comprising: an imaging section provided in an inspection apparatus and configured to capture original images of an inspection object; an image processing section configured to perform image processing on the original images of the inspection object acquired by the imaging section and to inspect the inspection object; a capturing section configured to capture the original images of the inspection object captured by the imaging section and accompanying information containing an inspection result for the inspection object of the image processing section as information accompanying the original images; a generating section configured to generate in advance a thumbnail of an original image selected from the original images of the inspection object acquired by the acquiring section based on the accompanying information, and generate thumbnails of original images not generated in advance in response to a request; and an output section configured to output the thumbnail images generated by the generation section in response to a request.

Images