Image display system and image display method

Abstract

An image display system that displays an image captured by an imaging device includes: an imaging control unit that sets one or more imaging conditions among a plurality of imaging conditions and causes the imaging device to image an object on the basis of the imaging conditions; an image generation unit that generates, using an image captured by the imaging device, an image based on another imaging condition different from the imaging condition set by the imaging control unit among the plurality of imaging conditions; and a display control unit that causes a display device to display an image captured by the imaging device or generated by the image generation unit and an imaging condition of the image in a manner that a user can confirm.

Description

Technical Field

[0001] This specification discloses an image display system and an image display method. Background Technology

[0002] Previously, systems have been proposed that acquire and display multiple images in order to set appropriate shooting conditions for a subject (for example, see Patent Document 1). In this system, the imaging device captures and displays images based on all shooting conditions, allowing the operator to select multiple images from the displayed images. Furthermore, a composite image is generated by combining the multiple images, and appropriate shooting conditions are set based on the shooting conditions of each selected image. Existing technical documents Patent documents

[0003] Patent document 1: International Publication No. 2020 / 255365. Summary of the Invention The problem that the invention aims to solve

[0004] In the above system, in order to allow the operator to select multiple images and shooting conditions, and to make the shooting device capture images based on all shooting conditions, it takes a lot of time to acquire images.

[0005] The main objective of this disclosure is to reduce the time required to acquire images and to properly verify the images and their shooting conditions. Methods for solving problems

[0006] In order to achieve the above-mentioned main objectives, the following means are employed in this disclosure.

[0007] The image display system disclosed herein is an image display system for displaying images captured by an imaging device. Its main feature is that it comprises: an imaging control unit that sets one or more imaging conditions from a plurality of imaging conditions and causes the imaging device to capture an object based on those imaging conditions; an image generation unit that uses the image captured by the imaging device to generate an image based on other imaging conditions from the plurality of imaging conditions that differ from those set by the imaging control unit; and a display control unit that causes a display device to display the image captured by the imaging device or generated by the image generation unit, along with the imaging conditions of that image, in a manner that can be confirmed by a user.

[0008] In the image display system of this disclosure, one or more shooting conditions are set among multiple shooting conditions, causing the shooting device to capture an object, and the image captured by the shooting device is used to generate an image based on other shooting conditions different from the set shooting conditions. Furthermore, the display device displays the image captured or generated by the shooting device and the shooting conditions of that image in a manner that can be confirmed by the user. Thus, even without capturing all images based on multiple shooting conditions, the image and its shooting conditions can be displayed. Therefore, the time required to acquire an image can be reduced, and the image and its shooting conditions can be appropriately confirmed. Attached Figure Description

[0009] Figure 1 This is a schematic structural diagram of the mounting device 10. Figure 2 This is a schematic diagram of the structure of camera 20. Figure 3 This is a block diagram showing the electrical connection relationship between the installation device 10 and the management device 40. Figure 4 This is a flowchart illustrating an example of the registration and processing of shooting conditions. Figure 5 This is an explanatory diagram illustrating one example of shooting conditions. Figure 6 This is an illustrative diagram showing an example of the image required to generate a simulated image. Figure 7 This is an illustrative diagram showing an example of generating a simulated image. Figure 8 This is an explanatory diagram showing an example of element P as the subject of a photograph. Figure 9 This is an explanatory diagram illustrating an example of the relationship between shutter speed and brightness value. Figure 10 This is an explanatory diagram showing an example of shutter speed coefficient. Figure 11 This is an explanatory diagram showing an example of confirmation screen 50. Figure 12 This is an explanatory diagram showing an example of confirmation screen 50. Detailed Implementation

[0010] Embodiments of this disclosure will be described using the accompanying drawings. Figure 1 This is a schematic structural diagram of the mounting device 10. Figure 2 This is a schematic diagram of the structure of camera 20. Figure 3 This is a block diagram showing the electrical connection relationship between the mounting device 10 and the management device 40. Furthermore, in this embodiment, Figure 1 The left and right directions are the X-axis, the front and back directions are the Y-axis, and the up and down directions are the Z-axis.

[0011] The mounting device 10 picks up components and mounts them onto the substrate S, and includes a base 11, a substrate transport device 12, a mounting head 14, a moving device 16, a feeder 18, a component camera 19, a marking camera 20, and a control device 30. Figure 3 (Refer to). Multiple mounting devices 10 are arranged side-by-side along the substrate transport direction (X-axis direction) to form an assembly line. The assembly line including the mounting devices 10 is managed by a management device 40 (…). Figure 3 (Refer to) for management.

[0012] A substrate transport device 12 is mounted on a base 11 and has a pair of conveyor belts spaced apart along the front-to-back (Y-axis) direction and mounted horizontally (X-axis) along the sides. The substrate S is transported by driving the conveyor belts. Figure 1 Move from left to right.

[0013] The feeders 18 are mounted on a feeder table provided on the base 11 in a left-right (X-axis) direction. The feeder 18 has a reel with a belt containing a receiving element wound on it. A plurality of chambers for receiving elements are formed at equal intervals on the belt. The elements in the chambers are exposed by peeling off the film covering the surface of the belt near the element supply position and are picked up (adsorbed) by the mounting head 14.

[0014] The mounting head 14 includes a retainer for holding the nozzle 15 and a lifting device for raising and lowering the retainer. The nozzle 15 has a suction port at its front end, and the element is adsorbed by negative pressure supplied to the suction port by a negative pressure source (not shown). The mounting head 14 can be a head with a single nozzle 15, or it can be a rotating head with multiple nozzles 15 evenly spaced along the circumference of a cylindrical head body. Furthermore, a mechanical chuck or an electromagnetic chuck can be used instead of the nozzle 15 as a pickup element.

[0015] The moving device 16 moves the mounting head 14 along the XY plane (horizontal plane) in the front-back and left-right (XY axis directions). A part camera 19 is mounted on the base 11 and takes pictures of the components being suctioned by the nozzle 15 from below, outputting the captured images to the control device 30. A marking camera 20 is mounted on the lower part of the mounting head 14, and moves along with the mounting head 14 in the front-back and left-right (XY axis directions) directions via the moving device 16. The marking camera 20 takes pictures of the object from above and outputs the captured images to the control device 30. The objects to be photographed can include markings attached to the substrate S, components in the chamber of the tape fed by the feeder 18, and components mounted on the substrate S.

[0016] like Figure 2As shown, the marking camera 20 includes an illumination unit 21 and an imaging unit 25. The illumination unit 21 includes a side-illumination unit 22 and a direct-illumination unit (coaxial direct-illumination unit) 23. The imaging unit 25 includes a lens 26, a shutter 27, and an imaging element 28. The side-illumination unit 22 illuminates the object at an angle. The side-illumination unit 22 includes multiple light sources with different illumination colors, such as a red LED 22r emitting R (red) light and a blue LED 22b emitting B (blue) light. In the top view, the LEDs 22r and 22b are arranged in a ring around the lens 26. The direct-illumination unit 23 illuminates the object from the same direction as the optical axis of the lens 26. The direct-illumination unit 23 includes a semi-reflective mirror 24 arranged at a 45-degree angle relative to the optical axis of the lens 26, and a light source that illuminates the semi-reflective mirror 24 in a direction orthogonal to the optical axis of the lens 26 (horizontal direction). The incident illumination unit 23 has multiple light sources with different lighting colors, such as a red LED 23r that emits R (red) light and a blue LED 23b that emits B (blue) light. In addition, the side illumination unit 22 and the incident illumination unit 23 may also have green LEDs that emit G (green) light.

[0017] The lighting unit 21 has the following lighting modes: a side-lighting mode in which only the side-lighting unit 22 is lit, a spot-lighting mode in which only the spot-lighting unit 23 is lit, and a full-lighting mode in which both the side-lighting unit 22 and the spot-lighting unit 23 are lit. Furthermore, in each lighting mode, the lighting unit 21 illuminates any one of the two bright colors, R or B.

[0018] The shutter 27 is positioned between the lens 26 and the image sensor 28. By switching between allowing light passing through the lens 26 to pass through or blocking it, the exposure time of the image sensor 28 during shooting is adjusted. This exposure time can be adjusted by setting the shutter speed of the shutter 27. The image sensor 28 is configured as a monochrome image sensor (e.g., a monochrome CCD) that generates a monochrome image based on the received light. The image sensor 28 generates an image by receiving light emitted from the side illumination unit 22 and the incident illumination unit 23 and reflected by the object via the semi-reflective mirror 24 and the lens 26.

[0019] The control device 30 includes a CPU 32, a ROM 34, a RAM 36, a storage unit 38 such as a hard disk and a solid-state drive, an input / output port (not shown), and a communication port. The control device 30 outputs various control signals to the substrate transport device 12, the mounting head 14, the moving device 16, the feeder 18, the part camera 19, and the marking camera 20. Furthermore, the control device 30 receives detection signals from various sensors, including a position sensor that detects the position of the mounting head 14, and receives images captured by the part camera 19 and the marking camera 20. Additionally, the control device 30 performs image processing on the images captured by the part camera 19 and the marking camera 20, and executes various processing steps. The control device 30 is connected to the management device 40 via a communication network in a bidirectional communication manner, exchanging data and control signals with it.

[0020] The management device 40 is a general-purpose computer, equipped with a management and control unit 42 consisting of a CPU, ROM, RAM, etc.; input devices 44 such as a keyboard and mouse for operators to perform various input operations; a display 46 for displaying various information; and a storage unit 48 such as a hard disk or solid-state drive. The storage unit 48 stores a production plan for the substrate S. The production plan specifies which component to install on which substrate S in the mounting device 10, and how many substrates S with such components installed will be produced. The management device 40 instructs the control device 30 of the mounting device 10 to produce substrates S with components installed according to the production plan.

[0021] The mounting apparatus 10 configured in this way performs a mounting process for picking up components and mounting them onto the substrate S as follows. During the mounting process, the CPU 32 moves the mounting head 14 (nozzle 15) above the component supply position of the feeder 18, and lowers the nozzle 15 to pick up the component. Once the component is picked up, the CPU 32 moves the mounting head 14 above the component camera 19 and above the substrate S, lowering the nozzle 15 to mount the component onto the substrate S. The CPU 32 repeats this process for all components that are to be mounted.

[0022] Furthermore, in the mounting device 10, the CPU 32 processes the images captured by the part camera 19 and the marking camera 20, performing various recognition processes and corresponding processing based on the recognition results. For example, the CPU 32 causes the part camera 19 to capture images of components adsorbed by the nozzle 15, processes the captured images, identifies the adsorption deviation of the component relative to the nozzle 15 (image center), and corrects the target mounting position to eliminate the adsorption deviation. Additionally, the CPU 32 causes the marking camera 20 to capture images of markings attached to the substrate S, processes the captured images to identify the markings, and uses the identified position as a reference position to set the component mounting position coordinates. Furthermore, the CPU 32 causes the marking camera 20 to capture images of components in the chamber at the component supply position of the feeder 18, processes the captured images, identifies the positional deviation of the component relative to the center of the chamber, and corrects the adsorption position of the component to eliminate the positional deviation. Finally, the CPU 32 processes the images captured by the marking camera 20 to identify the component name, model, etc., and determines whether it is a correct component. The storage unit 38 contains pre-defined shooting conditions that allow each image to be captured under optimal shooting conditions matching the subject being photographed. The following example illustrates the process of registering shooting conditions for marking the camera element P of the camera 20 as the subject.

[0023] Figure 4 This is a flowchart illustrating an example of shooting condition registration processing, executed by the management control unit 42 (CPU) of the management device 40. In the shooting condition registration processing, the management control unit 42 first sets one or more shooting conditions (S100) that define a lighting color, lighting mode, and shutter speed (SS). For example, the marker camera 20 of this embodiment can set two lighting colors (R or B), three lighting modes (side-fire mode, direct-fire mode, or full-fire mode), and twenty shutter speeds (5ms intervals between 5ms and 100ms), thus having a total of 120 shooting conditions.

[0024] The management control unit 42, for example, sets 10 shooting conditions, from condition 1 to condition 10, in S100. Figure 5As shown, conditions 1 through 8 are a total of 8 conditions: the illumination color is either R or B, the illumination mode is either side-lit or direct-lit, and the shutter speed is either SS1 or SS2 (>SS1). Furthermore, conditions 9 and 10 are a total of 2 conditions: all multiple lights are extinguished and the shutter speed is either SS1 or SS2. Conditions 1 through 8 can also be referred to as the shooting conditions for the first illumination mode, which illuminates any one of the multiple lights; conditions 9 and 10 can also be referred to as the shooting conditions for the second illumination mode, which extinguishes all multiple lights. Conditions 9 and 10 are not the actual shooting conditions used, but are set to generate an image in a fully illuminated mode. Furthermore, the shooting conditions 1 through 10 are the minimum shooting conditions required to generate an image of all other shooting conditions different from these 10 shooting conditions, i.e., the remaining 110 shooting conditions.

[0025] Next, the management control unit 42, based on the shooting conditions set in S100, causes the marker camera 20 to capture images of element P (S110). In S110, the management control unit 42 sends an image capture command based on the shooting conditions determined in S100 to the control device 30 of the mounting device 10. The control device 30 controls the marker camera 20 to capture images and sends the captured images to the management control unit 42. Furthermore, in S110, a total of 10 images of element P can be captured based on the 10 set shooting conditions. Therefore, compared to capturing all 120 images based on 120 shooting conditions, the number of images captured can be significantly reduced, thereby significantly shortening the shooting time in S110.

[0026] Next, the management control unit 42 performs a simulated image generation process (S120) that uses the captured images to simulate the generation of images. Figure 6 This is an illustrative diagram showing an example of the image required to generate a simulated image. Figure 7 This is an illustrative diagram showing an example of generating a simulated image. For example... Figure 6 As shown, two images (Image 1 and Image 2) taken under any of conditions 1 to 8 are selected. The brightness values ​​of each pixel in the selected image are added together, and then the brightness values ​​of each pixel in Image 3 taken under any of conditions 9 and 10 are subtracted, thereby generating a simulated image. For example, the brightness values ​​of each pixel in Image 1 taken under condition 1 and the brightness values ​​of each pixel in Image 2 taken under condition 3 are added together, and then the brightness values ​​of each pixel in Image 3 taken under condition 9 are subtracted, thereby generating a simulated image No. 1 with a highlight color of R, a highlight mode of full illumination, and a shutter speed of SS1 (see reference). Figure 7 ).

[0027] Thus, in this embodiment, for an image in the full-light mode of any single bright color, it is simulated by adding the brightness value of the image in the side-lit mode of the same bright color and the brightness value of the image in the incident mode of the same bright color, and then subtracting the brightness value of the image in the off mode. Furthermore, the process is as follows: the brightness values ​​of two images (with a value of 2) are added together, and then the brightness value of the image in the off mode, which has a value one less than 2, is subtracted. Additionally, the shutter speeds of the images with added brightness values ​​and the images with subtracted brightness values ​​are the same. Furthermore, since the bright colors R and B can be shared in the images of conditions 9 and 10 of the off mode, the number of images that need to be captured can be reduced. That is, compared to capturing each image in the side-lit mode, incident mode, and full-light mode with bright color R, and each image in the side-lit mode, incident mode, and full-light mode with bright color B, the number of images that need to be captured can be reduced, thereby shortening the shooting time of S110.

[0028] Next, the management control unit 42 executes the shutter speed coefficient setting process (S130). Here, Figure 8 This is an explanatory diagram showing an example of a component P that is the subject of the photograph. As shown, for example, component P has a resin body B that is rectangular in top view and multiple metal leads L protruding outward from the body B. Figure 9 This is an illustrative diagram showing an example of the relationship between shutter speed and brightness value. In Figure 9 In the diagram, the horizontal axis represents shutter speed, and the vertical axis represents brightness value. Solid lines represent actual brightness variations. As shown, there is a tendency for the brightness value of the lead line L to be higher than that of the main body B, but the brightness value of either element exhibits a linear relationship with the shutter speed. The management control unit 42 calculates an approximate linear relationship between this brightness value and shutter speed for each pixel (see reference). Figure 9 (The dashed line in the middle).

[0029] Figure 10This is an explanatory diagram illustrating an example of shutter speed coefficients. As shown, the management control unit 42 establishes a correspondence between the illumination color (R, B) and the illumination mode (side-fire, direct fire, full illumination) and obtains the slope 'a' and intercept 'b' of a linear relationship for each pixel in the image as the shutter speed coefficients. For example, based on two images taken under conditions 1 and 2 with the same illumination color and illumination mode but different shutter speeds, the management control unit 42 obtains the correspondence between brightness values ​​and shutter speeds at two points per pixel. Based on this correspondence, it calculates and obtains the slope 'a' and intercept 'b' for each pixel with illumination color R and illumination mode of side-fire. Furthermore, the management control unit 42 also obtains shutter speed coefficients based on simulated images generated during simulated image generation processing. For example, the management control unit 42 obtains the correspondence between brightness value and shutter speed for two analog images No.1 and No.2 with the same illumination color and illumination mode but different shutter speeds, using two points for each pixel. Based on the correspondence between these two points, it obtains the slope a and intercept b of each pixel with illumination color R and illumination mode of full illumination mode.

[0030] Next, the management control unit 42 displays a confirmation screen (S140) for the user (operator) to confirm the image and shooting conditions. For example, the management control unit 42 displays on the display 46 such as... Figure 11 , Figure 12 The confirmation screen 50 shown is equipped with an image display bar 51, a highlight color specification bar 52, a highlight mode specification bar 53, a slider 54, a shutter speed display bar 55, a return button 56, and a confirmation button 57. Furthermore, the confirmation screen 50 also displays an indicator pointer (mouse pointer) 50a for operation via an input device 44 such as a mouse.

[0031] The image display bar 51 displays an image based on the shooting conditions specified by the user. In the highlight color specification bar 52, the highlight color can be specified by clicking the indicator pointer 50a; each time the indicator pointer 50a is clicked, the highlight color toggles between R and B. In the highlight mode specification bar 53, the highlight mode can be specified by clicking the indicator pointer 50a; each time the indicator pointer 50a is clicked, the highlight mode toggles between side-fire mode, direct fire mode, and full illumination mode. The slider 54 can be moved left or right by dragging the indicator pointer 50a to specify the shutter speed every 5ms; the further the slider is moved from left to right, the faster the shutter speed. The shutter speed display bar 55 displays the shutter speed changed by the slider 54. The return button 56 returns to the shooting conditions and image received before the specified settings. The confirm button 57 confirms the shooting conditions for the currently displayed image. The return button 56 and the confirm button 57 are clicked using the indicator pointer 50a.

[0032] When the confirmation screen 50 is displayed, the management control unit 42 determines whether a shooting condition specification operation (change operation) has been performed based on the user's operation on the confirmation screen 50 (S150); if it is determined that no operation has been performed, it proceeds to S200. Specifying the highlight color in the highlight color specification column 52, specifying the highlight mode in the highlight mode specification column 53, and specifying the shutter speed via the slider 54 are shooting condition specification operations. If the management control unit 42 determines that a specification operation has been performed, it determines whether the specified shooting condition (also called the specified condition) is a different shooting condition from the shooting condition set in S100, i.e., the shooting condition marked as the shooting condition in which the camera 20 has taken a picture (S160). If the specified condition belongs to any of the conditions 1 to 8, the management control unit 42 determines in S160 that it is not another shooting condition, reads the image taken under the specified condition (S170), displays it in the image display column 51 (S180), and proceeds to S200.

[0033] On the other hand, if the specified condition does not fall under any of conditions 1 to 8, the management control unit 42 determines in S160 that it is another shooting condition, generates an image based on the specified condition (S190), and displays it in the image display bar 51 (S180), then proceeds to S200. In S190, the management control unit 42 generates an image based on the specified illumination color, illumination mode, and shutter speed, and displays it in the image display bar 51. That is, the management control unit 42 reads the shutter speed coefficients (slope a, intercept b) that match the specified illumination color and illumination mode (see reference). Figure 10 Based on the shutter speed coefficient and the specified shutter speed, the brightness value of each pixel is calculated, and the generated image is displayed. For example, in... Figure 12 In the middle, the ratio is specified because slider 54 slides to the right. Figure 11 A large shutter speed, therefore producing a higher brightness value. Figure 11 A large, bright image is generated and displayed in the image display bar 51. Additionally, when the calculated brightness value exceeds the upper limit (maximum brightness value), the upper limit is used. Furthermore, when switching to full-light mode, the management control unit 42 calculates the brightness values ​​of each pixel in the full-light mode image generated in the simulated image generation process based on the shutter speed coefficient and the specified shutter speed, generates an image, and displays the generated image in the image display bar 51.

[0034] Furthermore, the user can confirm the image displayed in the image display bar 51 and select the image that is easily identifiable as element P in image processing, which is considered suitable for image processing. The user then determines the shooting conditions by operating the decision button 57 (decision operation). The management control unit 42 determines whether a shooting condition decision operation has been performed (S200). If it is determined that no decision operation has been performed, it returns to S150. The return button 56 has been omitted from the operation description. On the other hand, if it is determined that a decision operation has been performed, the management control unit 42 registers the shooting conditions of the displayed image with element P in a corresponding manner (S210), ending the shooting condition registration process. These shooting conditions are sent from the management device 40 to the control device 30 of the mounting device 10 and registered in the storage unit 38. Thereafter, when the control device 30 takes a picture of element P, it controls the marker camera 20 to take the picture based on these shooting conditions.

[0035] Here, the correspondence between the constituent elements of this embodiment and the constituent elements of this disclosure is clarified. The management control unit 42 performing the shooting condition registration processing S100 and S110 in this embodiment corresponds to the shooting control unit of this disclosure; the management control unit 42 performing the processing S120, S130, and S190 corresponds to the image generation unit; and the management control unit 42 performing the processing S140, S170, and S180 corresponds to the display control unit. Furthermore, the management control unit 42 performing the processing S200 and S210 corresponds to the decision unit. In this embodiment, by explaining the operation of the management device 40, an example of the image display method of this disclosure is also clarified.

[0036] In the management device 40 of the embodiments described above, 10 shooting conditions are set from a plurality of (e.g., 120) shooting conditions, and the marker camera 20 (shooting device) captures images based on the set shooting conditions. Furthermore, using the images captured by the marker camera 20, images based on other shooting conditions different from the set shooting conditions are generated, and the display 46 (display device) displays the images captured or generated by the marker camera 20 and their shooting conditions in a manner that can be confirmed by the user. Thus, even without capturing all images based on multiple shooting conditions, images and their shooting conditions can be displayed. Therefore, the time required to acquire images can be reduced, and images and their shooting conditions can be appropriately confirmed.

[0037] Furthermore, the minimum number of shooting conditions required to generate all images based on other shooting conditions different from the set shooting conditions is set to 10. Therefore, the number of images that the marker camera 20 needs to capture can be minimized, thereby reliably suppressing the time required to acquire images.

[0038] Furthermore, based on the user's decision (confirmation result) regarding the image displayed on the confirmation screen 50 of the display 46, the shooting conditions for marking the object to be photographed by the camera 20 are determined. By minimizing the time required to acquire an image, the determination of shooting conditions can be made quickly.

[0039] Furthermore, as 10 shooting conditions, a first lighting mode is set to illuminate any one of the multiple lights for each highlight color (R, B) and each illumination (sidelight, direct light), and a second lighting mode is set to extinguish all the multiple lights. Moreover, for the image needed to generate a full-light mode image illuminating all lights, two images are selected from those captured in the first lighting mode, the brightness values ​​of each pixel are added together, and then the brightness values ​​of each pixel in the image captured in the second lighting mode are subtracted by an image value, thereby generating a full-light mode image. Therefore, even without capturing images of all lighting modes that can be set for each highlight color of the multiple lights, it is possible to appropriately generate and display images corresponding to whether the highlight color and each illumination are illuminated.

[0040] Furthermore, based on the brightness values ​​of each pixel in images captured under two different shutter speeds (SS1, SS2), a relationship between shutter speed and brightness value (shutter speed coefficient) is set for each pixel. Then, based on this relationship, the brightness value of each pixel corresponding to the specified shutter speed is calculated, thereby generating and displaying an image corresponding to that shutter speed. Therefore, even without capturing images at all shutter speeds, it is possible to appropriately generate and display an image corresponding to any shutter speed.

[0041] Furthermore, this disclosure is not limited to the above-described embodiments at all, and it is self-evident that it can be implemented in various ways as long as it is within the technical scope of this disclosure.

[0042] In the above embodiment, images were captured at two different shutter speeds (SS1, SS2), but the method is not limited to this. That is, images can be captured under two or more shooting conditions with different shutter speeds in a way that allows setting the relationship between shutter speed and brightness value for each pixel.

[0043] In this implementation, eight shooting conditions for the first illumination mode and two shooting conditions for the second illumination mode are set as ten shooting conditions. An image for the full illumination mode is generated using images from the first illumination mode and the second illumination mode, but this is not a limitation. That is, any shooting condition to be set among multiple shooting conditions can be a shooting condition required to generate an image of a shooting condition different from the set shooting conditions, i.e., a shooting condition indicating that the camera 20 did not take a picture. Furthermore, items such as illumination color, whether it is illuminated, and shutter speed are examples of shooting conditions; any one of these items can be set, or all other items can be set.

[0044] For example, consider the case where both R (red) and B (blue) are lit, and the highlight color is set to P (purple). In this case, the image for the first highlight mode is selected as the image of condition 1 with highlight color R and side-lit mode, and the image of condition 5 with highlight color B and side-lit mode. The brightness values ​​of each pixel in the two selected images are added together, and then the brightness values ​​of each pixel in the image of condition 9, which is the image for the second highlight mode, are subtracted by an image amount. This generates an image with shutter speed SS1, highlight color P, and side-lit mode. If the shutter speed is SS2, then simply select the two images of conditions 2 and 6 as the first highlight mode images and add their brightness values, and select the image of condition 10 as the second highlight mode image and subtract an image amount of its brightness value. Furthermore, images in the incident mode can be generated in the same way.

[0045] Furthermore, when generating an image in full illumination mode P, the images selected as the first illumination mode are: the image with illumination color R and side-lit mode (condition 1), the image with illumination color R and side-lit mode (condition 3), the image with illumination color B and side-lit mode (condition 5), and the image with illumination color B and side-lit mode (condition 7). The brightness values ​​of each pixel in the four selected images are added together, and then the brightness values ​​of each pixel in the image with three times the image size (condition 9), which is the second illumination mode image, are subtracted. This generates an image with shutter speed SS1, illumination color P, and full illumination mode. If the shutter speed is SS2, then only the four images with conditions 2, 4, 6, and 8 are selected as the first illumination mode images and their brightness values ​​are added together; the image with condition 10 is selected as the second illumination mode image and its brightness value is subtracted by three times the image size. Thus, by selecting the desired image from the images captured in the first illumination mode, adding the brightness values ​​of each pixel in the selected n images, and then subtracting the brightness values ​​of each pixel in the image captured in the second illumination mode (with a value of (n-1), the brightness value of each pixel can be calculated and an image generated.

[0046] In this implementation, 10 shooting conditions are set as the minimum required number of shooting conditions, but it is not limited to this; more than the minimum number of shooting conditions can also be set. For example, 15 shooting conditions can be set by using 3 shutter speeds instead of 2. This improves the accuracy of the shutter speed coefficient setting, thereby generating simulated images with higher precision.

[0047] In this embodiment, the shooting conditions of the marking camera 20 are shown as being determined, but the embodiment is not limited to this; the shooting conditions of the part camera 19 can also be determined. Furthermore, the embodiment is not limited to determining shooting conditions; as long as the image and its shooting conditions are displayed on the display 46 in a manner that the user can confirm, it is acceptable. Additionally, the management device 40 (management control unit 42) has the functions of a shooting control unit, an image generation unit, and a display control unit, but the control device 30 and other devices may also have some of these functions. Furthermore, the shooting device is not limited to use in the mounting device 10, and the display device is not limited to the display 46 of the management device 40. Moreover, the image display is not limited to the field of component mounting processing; it can also be applied to image display in other technical fields.

[0048] This specification also discloses the technical idea of ​​changing "the image display system according to claim 1 or 2" to "the image display system according to any one of claims 1 to 3" in the original claim 4, and the technical idea of ​​changing "the image display system according to claim 1 or 2" to "the image display system according to any one of claims 1 to 4" in the original claim 5. Industrial applicability

[0049] This disclosure can be applied to the technical fields of image processing and component mounting processing. Explanation of reference numerals in the attached figures

[0050] 10 Mounting device, 11 Base, 12 Substrate handling device, 14 Mounting head, 15 Nozzle, 16 Moving device, 18 Feeder, 19 Part camera, 20 Marking camera, 21 Illumination unit, 22 Side-emitting illumination unit, 22b Blue LED, 22r Red LED, 23 Surface illumination unit, 23b Blue LED, 23r Red LED, 24 Semi-reflector, 25 Imaging unit, 26 Lens, 27 Shutter, 28 Imaging element, 30 Control device, 32 CPU, 34 ROM, 36 RAM, 38 Storage unit, 40 Management device, 42 Management control unit, 44 Input device, 46 Display, 48 Storage unit, 50 Confirmation screen, 50a Indicator pointer, 51 Image display bar, 52 Lighting color specification bar, 53 Lighting mode specification bar, 54 Slider, 55 Shutter speed display bar, 56 Return button, 57 Confirm button, B main body, L lead, P component, S substrate.

Claims

1. An image display system for displaying images captured by an imaging device, The image display system includes: The shooting control unit sets one or more shooting conditions from a plurality of shooting conditions, and causes the shooting device to shoot the object based on the shooting conditions; The image generation unit uses the image captured by the imaging device to generate an image based on shooting conditions different from those set by the imaging control unit among the plurality of shooting conditions; and The display control unit enables the display device to display, in a manner that the user can confirm, an image captured by the shooting device or generated by the image generation unit, and the shooting conditions of the image.

2. The image display system according to claim 1, wherein, The shooting control unit sets the minimum shooting conditions required for the image generation unit to generate all images based on the other shooting conditions, as one or more shooting conditions.

3. The image display system according to claim 1 or 2, wherein, The image display system also includes a decision unit that determines the shooting conditions when the shooting device shoots an object based on the user's confirmation of the image displayed by the display device.

4. The image display system according to claim 1 or 2, wherein, The shooting conditions include specifying whether each of the multiple lights in a plurality of lighting systems set for each of the multiple point colors is lit. As one or more shooting conditions, the shooting control unit sets a first lighting mode that illuminates any one of the plurality of lights according to each illumination color and each illumination, and sets a second lighting mode that extinguishes all of the plurality of lights. The image generation unit selects images from those captured in the first illumination mode to generate images based on illumination colors or whether the images are illuminated, which are different from the shooting conditions set by the shooting control unit. It adds up the brightness values ​​of each pixel of the selected images and then subtracts the brightness values ​​of each pixel of the images captured in the second illumination mode, which are one less than the number of selected images. The unit calculates the brightness value of each pixel and generates the image.

5. The image display system according to claim 1 or 2, wherein, The shooting conditions include the shutter speed of the shooting device. As one or more shooting conditions, the shooting control unit sets two or more different shutter speeds. The image generation unit sets a relationship between shutter speed and brightness value for each pixel based on the brightness values ​​of each pixel in images captured at two or more different shutter speeds, and calculates the brightness values ​​of each pixel corresponding to other shutter speeds different from the shutter speed set by the shooting control unit based on the relationship, thereby generating an image.

6. An image display method for displaying an image captured by an imaging device. The image display method includes the following steps: (a) Set one or more shooting conditions from a plurality of shooting conditions, and make the shooting device shoot the object based on the shooting conditions; (b) Using the images captured by the shooting device, generate images based on other shooting conditions that are different from the shooting conditions set in step (a) among the plurality of shooting conditions; as well as (c) Display the image captured by the camera or generated in step (b) and the shooting conditions of the image in a manner that can be confirmed by the user.

Images