Photographing Support Device, Photographing Support Method, and Photographing Support Program

Abstract

To provide a photographing support device, a photographing support method and a photographing support program enabling easy photographing of an image suitable for diagnosing the condition of an engine to be inspected.SOLUTION: A photographing support device for instructing a photographer about a position and an attitude of a camera comprises a storage device for storing structural information of an engine and an arithmetic unit. The arithmetic unit acquires a shape feature amount of a predetermined object included in the engine from a photographed image by pre-photographing, and determines whether or not the position and the attitude of the camera at the time of photographing fall within an acceptable range on the basis of the acquired shape feature amount and a reference feature amount of the object in the photographed image determined based on the structure information of the engine and a reference position and a reference attitude of the camera. When it is not within the allowable range, the arithmetic unit causes an instruction output unit of the camera to output an instruction to an operator to change at least one of the position and the attitude of the camera so that the position and the attitude of the camera fall within the allowable range.SELECTED DRAWING: Figure 4

Description

Technical Field

[0001] The present disclosure relates to a photographing support device, a photographing support method, and a photographing support program.

Background Art

[0002] In the inspection of large engines such as marine two-cycle diesel engines, it is important to regularly check the cylinder condition in order to maintain the engine performance during operation. The cylinder condition means, for example, sliding parts including a piston that slides by the vertical movement of the piston, a cylinder liner, etc., combustion chamber components including a piston, a cylinder liner, a cylinder cover, etc., or the state of the fuel injection system. However, in a large marine engine, since the piston is also large, it is not easy to remove the piston from the cylinder. Therefore, in order to check the cylinder condition in such an engine, an image of the piston inside the cylinder is taken through a scavenging port provided on the side surface of the cylinder, and the state of the piston and the piston ring assembled to the piston is recorded or diagnosed from the taken image.

[0003] More specifically, the internal space of the cylinder of such an engine is connected to a scavenging pipe through a scavenging port formed on the side surface of the lower part of the cylinder. The scavenging pipe has a size large enough for a person to enter. A photographer such as a ship crew member or a maintenance worker enters the scavenging pipe when the engine is stopped and takes a picture of the piston and the piston ring inside the cylinder through the scavenging port.

[0004] Patent Document 1 describes a photographing instruction device as follows. This photographing instruction device stores in advance images obtained by photographing each of a plurality of objects from each of a plurality of photographing directions. From these images, the photographing instruction device searches for an image similar to the acquired target image. When there are a plurality of searched images, the photographing instruction device calculates the similarity between images obtained by photographing the objects corresponding to the respective searched images from a photographing direction that is different by a predetermined angle in a predetermined direction from the photographing direction of the image. Next, the photographing instruction device outputs a photographing instruction for the object from a photographing direction that is different by a predetermined angle in a predetermined direction from the photographing direction of the target image based on the calculated similarity. The technology of this Patent Document 1 is a technology for specifying a photographed object from among a plurality of objects.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0006] By the way, since the photographing of the aforementioned piston and piston ring is performed based on the judgment of the individual photographer, if the position and photographing direction of the camera at the time of photographing are not appropriate, the photographed image may not be an image suitable for diagnosing the state of the engine. Also, there may be cases where the photographer does not fully understand what kind of photographed image is suitable for diagnosing the state of the engine.

[0007] The present disclosure has been made to solve the above problems, and an object thereof is to provide a photographing support device, a photographing support method, and a photographing support program that enable easy photographing of an image suitable for diagnosing the state of an engine to be inspected.

Means for Solving the Problems

[0008] In order to achieve the above object, a photographing support device according to an aspect of the present disclosure is a photographing support device that instructs a photographer of the position and orientation of a camera when photographing a piston through a scavenging port of a uniflow scavenging type two-cycle engine including a cylinder having a scavenging port and a piston that slides within the cylinder. The photographing support device includes a storage unit that stores structure information of the engine, and an arithmetic unit. The arithmetic unit causes the camera to start pre-photographing in which images are repeatedly photographed before and after main photographing for photographing a recording image, obtains a shape feature amount of a predetermined object included in the engine from the photographed images obtained by the pre-photographing, and determines, based on the obtained shape feature amount, the structure information of the engine, and a reference feature amount of the object in a photographed image determined based on a reference position and a reference orientation of the camera when photographing the object, whether the position and orientation of the camera during photographing are within an allowable range with respect to the reference position and the reference orientation of the camera. As a result of the determination process, when the position and orientation of the camera are not within the allowable range, an instruction is output to an instruction output unit of the camera to change at least one of the position and orientation of the camera so that the position and orientation of the camera are within the allowable range, and the instruction is output to an operator.

[0009] A shooting support method according to an aspect of the present disclosure is a shooting support device that instructs a photographer of the position and orientation of a camera when photographing a piston through a scavenging port of a uniflow scavenging two-cycle engine including a cylinder having a scavenging port and a piston that slides within the cylinder. The method causes the camera to start pre-shooting, which repeatedly captures images before and after the main shooting that captures a recording image, obtains a shape feature amount of a predetermined object included in the engine from the captured images obtained by the pre-shooting, and determines, based on the obtained shape feature amount, the structure information of the engine, and the reference feature amount of the object in a captured image determined based on the reference position and reference orientation of the camera when photographing the object, whether the position and orientation of the camera during shooting are within an allowable range with respect to the reference position and reference orientation of the camera. As a result of the determination process, when the position and orientation of the camera are not within the allowable range, an instruction is output to an operator to change at least one of the position and orientation of the camera so that the position and orientation of the camera are within the allowable range at the instruction output unit of the camera.

[0010] A shooting support program according to an aspect of the present disclosure is a shooting support program that instructs a photographer of the position and orientation of a camera when photographing a piston through a scavenging port of a uniflow scavenging two - cycle engine including a cylinder having a scavenging port and a piston that slides within the cylinder. The program causes a computer to start pre - shooting in which the camera repeatedly takes images before and after the main shooting for recording an image, obtains a shape feature amount of a predetermined object included in the engine from the captured images obtained by the pre - shooting, and determines, based on the obtained shape feature amount, the structure information of the engine, and the reference feature amount of the object in a captured image determined based on the reference position and reference orientation of the camera when photographing the object, whether the position and orientation of the camera during shooting are within an allowable range with respect to the reference position and reference orientation of the camera. As a result of the determination process, when the position and orientation of the camera are not within the allowable range, the program functions to output an instruction to an operator to change at least one of the position and orientation of the camera so that the position and orientation of the camera are within the allowable range.

Effect of the Invention

[0011] The present disclosure has the configuration described above, and has an effect of being able to provide a shooting support device, a shooting support method, and a shooting support program that enable easy shooting of an image suitable for diagnosing the state of an engine to be inspected.

Brief Description of the Drawings

[0012]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

BEST MODE FOR CARRYING OUT THE INVENTION

[0013] Hereinafter, preferred embodiments of the present disclosure will be described with reference to the drawings. In the following, the same or corresponding elements are denoted by the same reference numerals throughout all the drawings, and the overlapping description thereof will be omitted. In addition, for ease of understanding, the drawings schematically show each component, and the shape, dimensional ratio, etc. may not be accurately shown.

[0014] (Embodiment) FIG. 1 is a block diagram showing a schematic configuration of a camera incorporating an imaging support apparatus according to an embodiment of the present disclosure.

[0015] Camera 1 is, for example, a smartphone or a digital camera. Camera 1 includes an imaging unit 2, a display unit 3, an input unit 4, an image storage unit 5 that stores data of captured images, and a control unit 6.

[0016] The imaging unit 2 has a lens, an image sensor, and the like. The display unit 3 is composed of a liquid crystal display, an organic EL display, or the like. The input unit 4 is a touch panel installed on the screen of the display unit 3, and outputs an input signal based on the operation of the photographer to the arithmetic unit 7 of the control unit 6. Note that the input unit 4 is not limited to the touch panel, and various other configurations can be used. As another example, the input unit 4 may include a microphone or the like, and may be configured to output an input signal based on the voice operation of the photographer to the arithmetic unit 7 of the control unit 6.

[0017] The control unit 6 has an arithmetic unit 7 and a memory 8 for realizing the original functions of the camera, and an arithmetic unit 12 and a memory 13 that constitute the photographing support device 11. The arithmetic unit 7 and the arithmetic unit 12 include a computer such as a microcontroller. For example, the arithmetic units 7 and 12 include a CPU, a memory such as a RAM, and the like. Note that the arithmetic unit 7 and the arithmetic unit 12 may be configured as a common arithmetic device. Also, the memory 8 and the memory 13 may be configured as a common storage device.

[0018] In response to an input signal from the input unit 4 based on the operation of the photographer, the arithmetic unit 7 executes a control program stored in the memory 8, whereby the camera 1 performs well-known pre-photographing and main photographing. In pre-photographing, before and after main photographing, the imaging unit 2 captures video or repeatedly captures at a predetermined time interval, and the captured images are displayed on the display unit 3 as through images in real time. In main photographing, the captured image captured by the imaging unit 2 at the operation timing by a shutter operation is stored in the image storage unit 5. That is, the captured image by main photographing is stored as a recording image. The photographer can perform a desired photographing by performing a shutter operation while viewing the through image displayed on the display unit 3 during pre-photographing. Note that pre-photographing may be referred to as live view photographing, and the through image may be referred to as a live view image.

[0019] In the memory 13 of the photographing support device 11, a photographing support program, structural information of the engine, etc. are stored. That is, in the photographing support device 11, the photographing support program is installed as an application program in the memory 13, and is realized by the arithmetic unit 12 executing the photographing support program. The photographer uses the camera 1 to photograph the engine to be inspected mounted on the ship. At this time, the photographing support device 11 is made to function. Note that the "structural information" of the engine includes information in which coordinate values are input from CAD drawing data or the like so that the shape can be reconstructed in an arbitrary coordinate system.

[0020] Note that the functions of the elements disclosed in this specification can be executed using a general-purpose processor, a dedicated processor, an integrated circuit, an ASIC (Application Specific Integrated Circuits), a conventional circuit, or a circuit or processing circuit including a combination thereof configured or programmed to execute the disclosed functions. Since a processor includes transistors and other circuits, it is regarded as a processing circuit or a circuit. In this specification, a circuit, a unit, or a means is hardware that executes the listed functions, or is hardware programmed to execute the listed functions. The hardware may be the hardware disclosed in this specification, or may be other known hardware programmed or configured to execute the listed functions. When the hardware is a processor considered to be a type of circuit, the circuit, unit, or means is a combination of hardware and software, and the software is used in the configuration of the hardware or the processor.

[0021] [Configuration of Engine to be Inspected] FIG. 2 is a diagram showing an example of the engine to be inspected. The engine 100 shown in FIG. 2 is a large uniflow scavenging two-stroke diesel engine that is the main engine for propelling a ship. A two-stroke engine is also referred to as a two-cycle engine.

[0022] The engine 100 has a plurality of cylinders 110 extending in the vertical direction. Note that in FIG. 2, only one cylinder 110 is shown. In particular, in a uniflow scavenging two-stroke engine, each cylinder 110 has a scavenging port 120 on the circumferential surface of the lower portion and an exhaust port 130 on the upper portion. The engine 100 includes a piston 140, a fuel injection valve 150, and an exhaust valve 160 for each cylinder 110. The piston 140 has a cylindrical shape with an outer diameter corresponding to the inner diameter of the cylindrical cylinder 110. The piston 140 slides in the cylinder 110 so as to cross the scavenging port 120 in the vertical direction. That is, the sliding direction of the piston 140 is the vertical direction. An annular ring groove is formed on the circumferential surface of the piston 140, and an annular piston ring 210 is assembled in the ring groove. Further, the lower end portion of the piston rod 145 to which the piston 140 is attached at the upper end is connected to the crankshaft 180 via a connecting rod 170.

[0023] The fuel injection valve 150 is located at the upper end portion of the cylinder 110 and is supplied with fuel from a fuel supply device 190. The fuel supply device 190 can change the fuel injection pattern and fuel injection timing in the fuel injection valve 150. The exhaust valve 160 is a valve that opens and closes the exhaust port 130 and is driven by an exhaust valve drive device 200. The exhaust valve drive device 200 can change the opening / closing pattern and opening / closing timing of the exhaust valve 160.

[0024] The internal space of the cylinder 110 is connected to a scavenging pipe 220 via a scavenging port 120. The scavenging pipe 220 and the scavenging port 120 are connected via a scavenging chamber 230. The scavenging pipe 220 extends in the horizontal direction and is connected to a plurality of cylinders 110. Air is supplied to the engine 100 as scavenging through the scavenging pipe 220.

[0025] An air scavenging pipe 220 is connected to a supercharger 240. The supercharger 240 is configured to adiabatically compress the air supplied to the engine 100. The supercharger 240 includes a plurality of compressor blades, and by rotating around a rotating shaft 250, it has a compressor 260 that compresses the air introduced from the outside, and a turbine 270 that is connected to the rotating shaft 250 of the compressor 260 and generates the rotational power of the compressor 260.

[0026] The air compressed by the compressor 260 is supplied as scavenging air to the engine 100 through the air scavenging pipe 220 and the air scavenging chamber 230. The exhaust gas discharged from the exhaust port 130 due to combustion in the engine 100 flows into the turbine 270 of the supercharger 240. The turbine 270 includes a plurality of turbine blades, and when the turbine 270 rotates around the rotating shaft 250 by the inflowing exhaust gas, the compressor 260 rotates.

[0027] In such a marine engine 100, the air scavenging pipe 220 has a size large enough for a person to enter. A photographer such as a crew member or a maintenance worker of the ship enters the air scavenging pipe 220 or the air scavenging chamber 230 from a predetermined maintenance hatch when the engine is stopped, and photographs the piston 140 and the piston ring 210 in the cylinder 110 through the scavenging port 120. The engine 100 is configured to be able to adjust the vertical position of the piston 140 when the engine 100 is stopped. When photographing the piston 140 and the piston ring 210, the piston 140 is adjusted to be located at an inspection position P1 where the piston 140 and the piston ring 210 can be seen through the scavenging port 120. For example, the inspection position P1 is set at the lower limit position of the movement range of the piston 140 or a position a predetermined distance above the lower limit position.

[0028] [An example of how the engine looks in the photographed image] FIG. 3 is a diagram schematically showing an example of a captured image when the piston and piston rings are photographed through a scavenging port. As shown in FIG. 3, when the photographer takes a photograph as described above, the captured image G includes at least one scavenging port 120 and a part of the piston 140 and the piston ring 210 visible through the scavenging port 120. In the example of FIG. 3, three scavenging ports 120 are shown in the captured image G. The scavenging port 120 has an oval shape extending in the vertical direction, that is, the sliding direction of the piston 140. The oval shape is composed of an arc at the upper end and a lower end, and a straight line portion connecting the two arcs. In other words, the scavenging port 120 has an oval shape having a straight line portion in the longitudinal direction.

[0029] Also, in the example of FIG. 3, in the captured image G, four piston rings 210 assembled on the peripheral surface of the piston 140 and five ring lands 280 which are exposed portions on the peripheral surface of the piston 140 are shown. Since the outer peripheral surface of the piston ring 210 slides in contact with the inner peripheral surface of the cylinder 110, in the captured image G, the piston ring 210 has a higher brightness than the ring land 280. On the other hand, since the outer peripheral surface of the ring land 280 does not contact the inner peripheral surface of the cylinder 110, combustion residues, fuel residues, etc. accumulate on the outer peripheral surface, so in the captured image G, the ring land 280 has a lower brightness than the piston ring 210. For this reason, in the captured image G, through the scavenging port 120, a plurality of rectangular piston ring portions and a plurality of rectangular ring land portions are seen to be arranged alternately in the vertical direction.

[0030] Also, the side walls 120a and 120b of the scavenging port 120 extend in a direction inclined at a predetermined angle in the circumferential direction with respect to the radial direction of the cylinder 110 so that scavenging flows smoothly. For example, the scavenging port 120 is oriented such that the radially outer end of the scavenging port 120 is located at a position advanced clockwise with respect to the radially inner end with respect to the central axis of the cylinder 110.

[0031] Therefore, when photographing the piston 140 and the piston ring 210 in the cylinder 110 through the scavenging port 120, in order to prevent the shadow of the scavenging port 120 from falling on the piston ring 210 and the ring land 280, the photographer needs to take the photograph at an oblique angle with respect to the radial direction of the cylinder 110 according to the orientation of the scavenging port 120. Also, the degree to which the photographer grasps which photographed images are suitable for image diagnosis varies from photographer to photographer. Therefore, in the case of photographing based on the individual judgment of the photographer, it is not always possible to take an image suitable for diagnosing the state of the engine 100. Thus, the photographing support device 11 gives an instruction so that the photographer can take an image suitable for diagnosing the state of the engine 100.

[0032] Next, the operation of the photographing support device 11 will be described. The operation of the photographing support device 11 is realized by the processing of the arithmetic unit 12. The arithmetic unit 12 can give an instruction to the arithmetic unit 7 to cause the camera 1 to perform pre-photographing, main photographing, etc. In this example, the main photographing is automatically performed according to the instruction of the arithmetic unit 12 without the photographer performing a shutter operation. Then, the photographed image obtained by the main photographing is stored in the image storage unit 5 as a recording image. The recording image is used later when diagnosing the state of the engine.

[0033] The arithmetic unit 12 has two operation modes: a telephoto mode and a close-up mode. The telephoto mode is a photographing mode when the distance from the camera 1 to the object to be photographed is long compared to the close-up mode. Note that the images obtained during the telephoto mode or the close-up mode are regarded as through images.

[0034] FIG. 4 is a flowchart showing an example of the operation of the imaging support device 11 in the telephoto mode for photographing the scavenging port 120 using the camera 1, that is, an overview of the processing of the arithmetic unit 12. FIGS. 6 to 9 are diagrams used to explain the operation of the imaging support device 11 in the telephoto mode. The structure information of the engine 100 to be inspected is stored in the storage device 13. The structure information of the engine 100 includes the structure information of the scavenging port 120 including the shape and dimensions of the scavenging port 120, and the structure information of the cylinder 110 including the diameter of the cylinder 110 and the width of the piston ring 210.

[0035] When the photographer operates the input unit 4 to activate the imaging support device 11, for example, the telephoto mode is initially set. In the telephoto mode, the imaging support device 11 causes the camera 1 to start pre-imaging (step S1). In pre-imaging, the image captured by the imaging unit 2 is displayed on the display unit 3 in real time as a through-image. The object to be imaged in the telephoto mode is the entire part of the scavenging port 120. Specifically, the object to be imaged may be the entire contour part of the scavenging port 120, or the piston 140 and the plurality of piston rings 210 visible through the entire scavenging port 120.

[0036] In the telephoto mode, the imaging support device 11, for example, as shown in FIG. 6, overlays the scavenging port frame 31 corresponding to the shape of the scavenging port 120 on the through-image and displays it at the center of the screen of the display unit 3. The scavenging port frame 31 is a reference contour on the captured image of the scavenging port 120 defined based on the structure information of the scavenging port 120, which is one of the structure information of the engine 100. This scavenging port frame 31 is defined such that the image captured when the contour of the scavenging port 120 in the captured image coincides with the scavenging port frame 31 becomes an optimal image for diagnosing the state of the engine 100. That is, the photographer should align the contour of the scavenging port 120 in the captured image displayed on the display unit 3 with the scavenging port frame 31.

[0037] As described above, the position and orientation of the camera 1 that can capture an image of the imaging object (here, the entire scavenging port 120) that is optimal for diagnosing the state of the engine 100 are defined as the reference position and reference orientation of the camera 1 with respect to the imaging object.

[0038] Note that the position of the camera 1 is the three-dimensional position of the camera 1 with respect to the imaging object. More specifically, it is the position of the camera 1 in the vertical direction, horizontal direction, and depth direction with respect to the imaging object. In addition, the orientation of the camera 1 includes the degree of inclination of the camera 1 in the horizontal direction (the inclination angle in the torsional direction facing the front) and the direction of the camera 1 in the imaging direction (the inclination angle in the vertical, horizontal, and left-right directions facing the front).

[0039] Here, for example, when the camera 1 is at a predetermined reference position and reference orientation with respect to a predetermined imaging object, the two-dimensional information included in the image of the imaging object in the captured image captured by the camera 1, which is calculated based on the structural information of the engine 100, is defined as the "reference feature amount". In addition, the two-dimensional information included in the image of the imaging object in the captured image actually captured by the camera 1 is defined as the "shape feature amount". Then, the relative relationship such as the distance, deformation amount, and angle between the feature amounts when the images including these two feature amounts are superimposed is expressed as a numerical value, which is defined as the "difference" between the reference feature amount and the shape feature amount.

[0040] Whenever the imaging support device 11 acquires a captured image in the telephoto mode pre-capture from the imaging unit 2, it obtains the shape feature amount of the scavenging port 120 in the captured image. Then, based on the obtained shape feature amount and the reference feature amount of the scavenging port 120, it determines whether the position and orientation of the camera 1 at the time of shooting are within the allowable range with respect to the reference position and reference orientation of the camera 1 (step S2: determination process). Here, in this example, step S2 is to determine whether the difference between the shape feature amount of the scavenging port 120 in the captured image and the reference feature amount of the scavenging port 120 is within the allowable range consisting of a predetermined range, thereby determining whether the position and orientation of the camera 1 at the time of shooting are within the allowable range. That is, the fact that the above difference is within the allowable range means that the position and orientation of the camera 1 are within the allowable range. Of course, the allowable range regarding the above difference and the allowable range regarding the position and orientation of the camera 1 are different. The reference feature amount of the scavenging port 120 is, for example, information regarding the scavenging port frame 31, and is determined based on the structure information of the scavenging port 120 and the reference position and reference orientation of the camera 1.

[0041] In addition, the imaging support device 11 acquires the data of the through image, and detects the outlines of the straight line portions 123 and 124 (see FIG. 8) that extend in the vertical direction or substantially the vertical direction of at least the scavenging port 120 by image processing to recognize the scavenging port 120. That is, the scavenging port 120 is recognized by detecting the outlines of the two straight line portions 123 and 124 or the overall outline of the scavenging port 120 from the captured image.

[0042] In step S2, when the imaging support device 11 determines that the position and orientation of the camera 1 are not within the allowable range, that is, when it determines that the above difference is not within the allowable range, it outputs in real time an instruction to the photographer to change at least one of the position and orientation of the camera 1 on the display unit 3 of the camera 1 according to the above difference (step S3). This instruction to the photographer is an instruction to reduce the above difference so that the above difference is within the allowable range, and is, for example, displayed on the display unit 3 by being superimposed on the through image by characters, symbols, or characters and symbols. Here, the display unit 3 functions as an instruction output unit.

[0043] Specifically, as shown in FIG. 6, for example, in the imaging support device 11, when the extending direction of the straight portion of the scavenging port 120 in the captured image is inclined with respect to the extending direction of the straight portion of the scavenging port frame 31 and the inclination angle is not within the allowable range, symbols D1 and D2 of an instruction to rotate the posture of the camera 1 so that the inclination angle is within a predetermined allowable range are superimposed on the through image and displayed on the display unit 3. In this case, the angle α formed by the extending direction of the straight portion of the scavenging port 120 in the captured image and a predetermined direction is an example of a shape feature amount in the captured image, the angle β formed by the extending direction of the straight portion of the scavenging port frame 31 and the predetermined direction is an example of a reference feature amount, and the above inclination angle, which is the difference between the angle α and β, is an example of the difference between the shape feature amount and the reference feature amount.

[0044] Further, as shown in FIG. 6, when the scavenging port 120 in the captured image protrudes from the scavenging port frame 31 in the imaging support device 11, that is, when the camera 1 is too close to the scavenging port 120, an instruction to move the camera 1 away from the scavenging port 120 may be displayed on the display unit 3. Conversely, when the camera 1 is too far from the scavenging port 120, an instruction to move the camera 1 closer to the scavenging port 120 may be displayed on the display unit 3. Here, the instruction to move the camera 1 away and the instruction to move the camera 1 closer are examples of an instruction to change the position of the camera 1. In this case, for example, the first interval, which is the interval between the left and right straight portions of the scavenging port 120 in the captured image, can be used as the shape feature amount, and the reference interval, which is the interval between the left and right straight portions of the scavenging port frame 31, can be used as the reference feature amount. Then, the first interval and the reference interval are compared. When the first interval is smaller than the reference interval and the difference between the two is larger than the allowable value, the imaging support device 11 displays an instruction to move the camera 1 away on the display unit 3. Conversely, when the first interval is larger than the reference interval and the difference between the two is larger than the allowable value, the imaging support device 11 displays an instruction to move the camera 1 closer on the display unit 3. The range below the allowable value is the allowable range.

[0045] In addition, as shown in FIG. 8, the imaging support device 11 detects a circle 121 including an arc portion above the scavenging port 120 of the captured image and a circle 122 including an arc portion below it, and also detects straight line portions 123 and 124. When the sizes of the upper and lower circles 121 and 122 are different, that is, when the diameters of the circles 121 and 122 are different, an instruction to change the vertical position of the camera 1 is displayed on the display unit 3. For example, in the case of FIG. 8, the diameter of the upper circle 121 is smaller than the diameter of the upper arc of the scavenging port frame 31, and the difference between these diameters is larger than the allowable value, and the lower circle 122 is larger than the diameter of the lower arc of the scavenging port frame 31, and the difference between these diameters is larger than the allowable value. In this case, as shown in the explanatory diagram M1, an instruction to change the position of the camera 1 upward to make the imaging direction horizontal is displayed on the display unit 3. In the reverse case, an instruction to change the position of the camera 1 downward to make the imaging direction horizontal is displayed on the display unit 3. Note that in FIG. 8, only one scavenging port 120 as the target is illustrated in the display unit 3 for easy understanding.

[0046] In the description of the case of FIG. 8 above, the diameters of the upper and lower arcs of the scavenging port 120 in the captured image, which are the diameters of the upper and lower circles 121 and 122, are an example of the shape feature amount in the captured image, the diameters of the upper and lower arcs of the scavenging port frame 31 are an example of the reference feature amount, and the range within the allowable value is the allowable range. It is also conceivable to consider the difference between the diameters of the upper and lower circles 121 and 122 as an example of the shape feature amount in the captured image, and 0, which is the difference between the diameters of the upper and lower arcs of the scavenging port frame 31, as an example of the reference feature amount.

[0047] Also, when the vertical position of the camera 1 is at an appropriate position, the left and right straight portions 123, 124 of the scavenging port 120 in the captured image are parallel. When the straight portions 123, 124 are parallel and the scavenging port 120 in the captured image protrudes to the left from the scavenging port frame 31, the shooting support device 11 may cause the display unit 3 to display an instruction to move the position of the camera 1 to the right. Conversely, when the scavenging port 120 in the captured image protrudes to the right from the scavenging port frame 31, the shooting support device 11 may cause the display unit 3 to display an instruction to move the position of the camera 1 to the left. In this case, the horizontal position coordinates of the straight portions 123, 124 on the image may be used as the shape feature amount in the captured image, and the horizontal position coordinates of the left and right straight portions of the scavenging port frame 31 may be used as the reference feature amount.

[0048] Then, in step S2, when the shooting support device 11 determines that the position and posture of the camera 1 are within the allowable range, that is, when it is determined that the difference between the shape feature amount of the scavenging port 120 in the captured image and the reference feature amount of the scavenging port 120 is within the allowable range for all predetermined shape feature amounts, the shooting support device 11 causes the camera 1 to perform the main shooting (step S4). At this time, for example, the shutter speed and focal length of the camera 1 are adjusted so that the average luminance of the peripheral region R1 of the target scavenging port 120 shown in FIG. 7 is within a predetermined luminance range and the boundary portion of the scavenging port 120 in the boundary region R2 of the scavenging port 120 is clear, and then shooting is performed. In this captured image, the regions of the piston ring 210 and the ring land 280 are clear and stored in the image storage unit 5. As shown in FIG. 7, the state where any one scavenging port 120 fits exactly into the scavenging port frame 31 at the center of the screen is a state where the difference regarding all shape feature amounts is 0.

[0049] Furthermore, as shown in FIG. 9, the photographing support device 11 detects the positions of the plurality of piston rings 210 in the scavenging port 120 of the photographed image and stores the arrangement information of the piston rings 210. At this time, the photographing support device 11 detects, by image processing, a straight line that is the boundary between the high-brightness piston ring 210 and the low-brightness ring land 280 above and below it, and detects the high-brightness region as the piston ring 210. Also, the low-brightness region may be detected as the ring land 280. Each piston ring 210 and ring land 280 are detected with a quadrangle composed of four straight lines as the contour.

[0050] In step S2 above, the allowable range of differences regarding each shape feature amount used in this example is determined such that, when it is determined that the differences between the shape feature amounts of the scavenging port 120 in the photographed image and the reference feature amounts of the scavenging port 120 are within the allowable range for all shape feature amounts, the photographed image is a suitable image for the state diagnosis of the engine 100.

[0051] In the above telephoto mode, since the photographer only needs to position the camera 1 at an appropriate position and posture based on the instructions displayed overlaid on the through-image on the screen of the display unit 3, an image of the scavenging port 120 suitable for the state diagnosis of the engine 100 can be easily photographed. Also, in this example, since the target scavenging port frame 31 is displayed overlaid on the through-image, it becomes easier for the photographer to position the camera 1 at an appropriate position and posture.

[0052] Note that, in step S2 above, based on the difference between the shape feature amount of the object to be photographed (scavenging port 120) obtained from the photographed image by pre-photographing and the reference feature amount, and the reference position and reference posture of the camera 1 with respect to the object to be photographed, the position and posture of the camera 1 at the time of photographing are estimated, and it may be determined whether or not the estimated position and posture of the camera 1 are within the allowable range with respect to the reference position and reference posture of the camera 1.

[0053] Next, FIG. 5 is a flowchart showing an overview of the operation of the photographing support device 11 in the close-up mode, that is, an example of the processing of the arithmetic unit 12. FIGS. 10 to 13 are diagrams used for explaining the operation of the photographing support device 11 in the close-up mode.

[0054] For example, when the photographer approaches the camera 1 to the scavenging port 120 after the main shooting in the telephoto mode, the pre-shooting in the close-up mode is started (step S11). The object to be photographed in this close-up mode is the piston 140 visible through a part of the scavenging port 120. Specifically, the object to be photographed may be the piston ring 210 assembled to the piston 140, or the ring land 280 which is the exposed portion on the circumferential surface of the piston 140. Further, the object to be photographed may be both the piston ring 210 and the ring land 280. In this example, the object to be photographed is the piston ring 210.

[0055] When the pre-shooting in the close-up mode is started (step S11), and also after the main shooting (step S15) is completed, the photographing support device 11 displays marks D3 and D4 on the object to be photographed in the through-image displayed on the display unit 3, as shown in FIG. 10 for example. The mark D3 indicates that the object is the one for which the main shooting has been completed, and the mark D4 indicates that the object is the one for which the main shooting has not been performed. The photographing support device 11 may display the mark D4 based on the arrangement information of the piston ring 210 stored after the main shooting in the telephoto mode at the start of the pre-shooting in the close-up mode following the telephoto mode. By displaying such marks D3 and D4, the photographer can easily grasp the piston ring 210 to be photographed next.

[0056] The photographer approaches the camera 1 and positions the piston ring 210 approximately at the center of the through-image in order to photograph, for example, the second piston ring 210 from the top marked with Mark D4. Then, the imaging support device 11 selects the piston ring 210 as the object to be photographed (step S12), and displays a mark D5 indicating that the piston ring 210 has been selected as the object to be photographed in this actual photographing on the through-image. Note that an instruction for guiding the piston ring 210 to be approximately at the center of the through-image in order to select the piston ring 210 may be displayed on the through-image.

[0057] Then, every time the imaging support device 11 acquires a photographed image in the pre-photographing in the close-up mode from the imaging unit 2, it obtains the shape feature amount of the piston ring 210 selected as the object in the photographed image. Then, based on the obtained shape feature amount and the reference feature amount of the piston ring 210, it is determined whether the position and orientation of the camera 1 at the time of photographing are within the allowable range with respect to the reference position and reference orientation of the camera 1 (step S13: determination process). Here, in this example, step S13 is performed by determining whether the difference between the shape feature amount of the piston ring 210 selected as the object in the photographed image and the reference feature amount of the piston ring 210 is within an allowable range consisting of a predetermined range, to determine whether the position and orientation of the camera 1 at the time of photographing are within the allowable range. That is, the fact that the above difference is within the allowable range means that the position and orientation of the camera 1 are within the allowable range. Of course, the allowable range regarding the above difference and the allowable range regarding the position and orientation of the camera 1 are different.

[0058] The reference feature amount of the piston ring 210 is determined based on the structure information of the cylinder 110 and the reference position and reference orientation of the camera 1. The reference position and reference orientation of the camera 1 are determined as the position and orientation of the camera 1 with respect to the object to be photographed that can photograph an image of the object to be photographed (here, the piston ring 210) that is optimal for the state diagnosis of the engine 100.

[0059] Hereinafter, for example, as shown in FIG. 13, a reference contour 210S on a captured image of the piston ring 210 that can be determined based on information including the diameter of the cylinder 110, which is the structural information of the cylinder 110, and the width of the piston ring 210 will be described. Also, a contour in the captured image of the piston ring 210 actually captured by the camera 1 will be described as a captured contour 210R. The reference contour 210S of the piston ring 210 is determined such that an image captured when the captured contour 210R of the piston ring 210 in the captured image coincides with the reference contour 210S becomes an optimal image for the state diagnosis of the engine 100. Note that in this example, the reference contour 210S of the piston ring 210 is not displayed on the display unit 3.

[0060] In step S13, when the photographing support device 11 determines that the position and orientation of the camera 1 are not within the allowable range, that is, when it determines that the above difference is not within the allowable range, it outputs in real time an instruction to the photographer to change at least one of the position and orientation of the camera 1 to the display unit 3 of the camera 1 according to the above difference (step S14). This instruction to the photographer is an instruction for reducing the above difference so that the above difference is within the allowable range, and is displayed on the display unit 3, for example, by being superimposed on the through image by characters, symbols, or characters and symbols. Here, the display unit 3 functions as an instruction output unit.

[0061] Specifically, for example, as shown in the explanatory diagram M2 of FIG. 12, the area within the photographed contour 210R of the piston ring 210 in the photographed image is compared with the area within the reference contour 210S of the same piston ring 210. When the area within the photographed contour 210R is smaller than the area within the reference contour 210S and the difference between the two is larger than the allowable value, the photographing support device 11 causes the display unit 3 to display an instruction to move the camera 1 closer. Conversely, when the area within the photographed contour 210R of the piston ring 210 is larger than the area within the reference contour 210S and the difference between the two is larger than the allowable value, the photographing support device 11 causes the display unit 3 to display an instruction to move the camera 1 farther away. The areas within the photographed contour 210R and the reference contour 210S of the piston ring 210 can each be calculated as the area of a trapezoid. Here, the area within the reference contour 210S is set so that the piston ring 210 to be photographed has a desired resolution. In this case, the area within the photographed contour 210R is an example of a shape feature amount in the photographed image, the area within the reference contour 210S is an example of a reference feature amount, and the range below the allowable value is the allowable range.

[0062] When photographing the piston 140 and the piston ring 210 within the cylinder 110 through the scavenging port 120, in order to prevent the scavenging port 120 from casting a shadow on the piston ring 210 and the ring land 280, the photographer takes the photograph at an oblique angle with respect to the radial direction of the cylinder 110 in accordance with the orientation of the scavenging port 120. As a result, in the photographed image, there is a perspective difference in the horizontal direction for the piston ring 210 and the ring land 280 that are seen through the scavenging port 120. Due to such a perspective difference, the right side of the photographed contour 210R of the piston ring 210 becomes shorter than the left side. Note that in FIGS. 10, 11, etc. referred to above, the distortion due to the perspective difference is ignored in the illustration.

[0063] In addition, when the piston 140 moves up and down in the cylinder 110, sliding scratches extending in the vertical direction are formed on the piston ring 210. When diagnosing the state of the engine 100, for example, sliding scratches are detected from a photographed image of the piston ring 210, and a diagnosis such as determining the quality of the piston ring 210 is performed based on the state of the sliding scratches. By photographing the piston ring 210 obliquely from a predetermined angle with respect to the radial direction of the cylinder 110, it is easier to detect sliding scratches from the photographed image. Therefore, the reference contour 210S of the piston ring 210 is defined in a trapezoidal shape in consideration of the perspective difference in the horizontal direction, assuming that the piston ring 210 is photographed obliquely from a predetermined angle with respect to the radial direction of the cylinder 110. The predetermined angle is an angle set obliquely according to the direction of the scavenging port 120. In FIG. 13, for easier understanding, only one target piston ring 210 is illustrated in the display unit 3.

[0064] In addition, as shown in FIG. 13, the imaging support device 11 calculates the ratio d / c of the vertical lengths c and d of the imaged contour 210R of the piston ring 210 and compares it with the ratio b / a of the vertical lengths a and b of the reference contour 210S. Here, c is the vertical distance between the vertices H and J of the imaged contour 210R, and d is the vertical distance between the vertices I and K of the imaged contour 210R. Here, for example, if s is a tolerance value consisting of a predetermined positive value, when (d / c) - (b / a) > s, the imaging support device 11 causes the display unit 3 to display an instruction to move the position of the camera 1 to the left and perform imaging slightly to the right. Conversely, when (d / c) - (b / a) < (-s), the display unit 3 is caused to display an instruction to move the position of the camera 1 to the right and perform imaging slightly to the left. In this case, the ratio d / c of the vertical lengths of the imaged contour 210R of the piston ring 210 is an example of a shape feature amount in the photographed image, and the ratio b / a of the vertical lengths of the reference contour 210S is an example of a reference feature amount. Also, the range from (-s) to s is the allowable range.

[0065] In the above description, paying attention to the vertical lengths c and d of the piston ring 210, when the difference between the shape feature amount and the reference feature amount in the captured image of the piston ring 210 is not within the allowable range, the horizontal position and the shooting direction of the camera 1 are instructed. Similarly to this case, paying attention to the horizontal lengths L1 and L2 of the piston ring 210, when the difference between the shape feature amount and the reference feature amount in the captured image of the piston ring 210 is not within the allowable range, the vertical position and the shooting direction of the camera 1 may be instructed. Note that L1 is the horizontal distance between the vertices H and I of the captured contour 210R, and L2 is the horizontal distance between the vertices J and K of the captured contour 210R. In this case, for example, the ratio L2 / L1 of the horizontal length of the captured contour 210R of the piston ring 210 can be used as the shape feature amount in the captured image, and the ratio of the horizontal length of the reference contour 210S can be used as the reference feature amount, and the reference feature amount is 1. For example, if t is an allowable value consisting of a predetermined positive value, when (L2 / Ll)-1>t, the imaging support device 11 causes the display unit 3 to display an instruction to move the position of the camera 1 upward and make the shooting direction horizontal. Conversely, when (L2 / Ll)-1<(-t), an instruction to move the position of the camera 1 downward and make the shooting direction horizontal is displayed on the display unit 3. In this case, the range from (-t) or more to t or less is the allowable range.

[0066] Then, in step S13, when the imaging support device 11 determines that the position and orientation of the camera 1 are within the allowable range, that is, when it is determined that the difference between the shape feature amount of the piston ring 210 in the captured image and the reference feature amount of the piston ring 210 is within the allowable range for all the predetermined shape feature amounts, the imaging support device 11 causes the camera 1 to perform the main shooting (step S15). At this time, the shutter speed and the focal length of the camera 1 are adjusted so that the region of the piston ring 210 becomes clear, and the captured image is stored in the image storage unit 5.

[0067] Next, in step S16, the imaging support device 11 determines whether there is another imaging object. If there is another object, it returns to step S12 to select the next imaging object. If there is no other object, the close-up mode is terminated.

[0068] In step S13 above, the allowable range of differences regarding each shape feature amount used in this example is determined such that, for all shape feature amounts, when it is determined that the difference between the shape feature amount of the piston ring 210 in the captured image and the reference feature amount of the piston ring 210 is within the allowable range, the captured image is a suitable image for diagnosing the state of the engine 100.

[0069] In the above-described attachment shooting mode, since the photographer may place the camera 1 in an appropriate position and posture based on the instructions displayed superimposed on the through-image on the screen of the display unit 3, it is possible to easily capture an image of the piston ring 210 suitable for diagnosing the state of the engine 100.

[0070] Note that in step S13 above, based on the difference between the shape feature amount and the reference feature amount of the object to be photographed (for example, the piston ring 210) obtained from the captured image by pre-shooting, and the reference position and reference posture of the camera 1 with respect to the object to be photographed, the position and posture of the camera 1 at the time of shooting may be estimated, and it may be determined whether or not the estimated position and posture of the camera 1 are within the allowable range with respect to the reference position and reference posture of the camera 1.

[0071] In the present embodiment, when a predetermined first condition is satisfied in the telephoto mode, the transition to the attachment shooting mode may be made while continuing the pre-shooting, and when a predetermined second condition is satisfied in the attachment shooting mode, the transition to the telephoto mode may be made while continuing the pre-shooting. The above-described first condition is, for example, that when the camera 1 is brought closer to the piston 140 from the telephoto mode, the state changes from a state in which all parts of the contour of the scavenging port 120 are detected in the through-image, which is the pre-captured image, to a state in which the contours of the upper and lower arc portions cannot be detected. The second condition is, for example, that when the piston ring 210 selected as the object to be photographed in the through-image fails to be detected a predetermined number of times in succession in the attachment shooting mode.

[0072] In addition, in this embodiment, in step S4 of the telephoto mode and step S15 of the close-up mode, the arithmetic unit 12 of the photographing support device 11 causes the camera 1 to perform main photography. However, the present invention is not limited to this. For example, the arithmetic unit 12 of the photographing support device 11 may cause the display unit 3 to display an instruction for causing the photographer to perform a photographing operation. In this case, based on the photographing operation signal input from the input unit 4 by the photographer, the camera 1 performs main photography.

[0073] Also, in this embodiment, with regard to the position and orientation of the camera 1, the instruction items for instructing the photographer in the telephoto mode and the instruction items for instructing the photographer in the close-up mode are set separately, and different instruction items may be provided between the instruction items in the telephoto mode and the instruction items in the close-up mode. For example, as the instruction items in the telephoto mode, items related to the inclination in the left-right direction among the postures of the camera 1 and items related to the position of the camera 1 in the vertical direction may be set. And, in this case, as the instruction items in the close-up mode, items related to the photographing direction of the camera 1 with respect to the object to be photographed among the postures of the camera 1, items related to the position of the camera 1 in the distance direction from the object to be photographed, and items related to the position of the camera 1 in the vertical direction may be set.

[0074] Also, in this embodiment, the arithmetic unit 12 may identify the object included in the first captured image from the object specified in the second captured image captured before or after the first captured image. Here, the first captured image and the second captured image may be captured images obtained by pre-photography or captured images obtained by main photography.

[0075] For example, when shifting from the telephoto mode to the close-up mode, the captured image changes from the second captured image in which a plurality of scavenging ports 120 are captured as shown in, for example, FIG. 7, to the first captured image in which one scavenging port 120 is captured as shown in, for example, FIG. 10. In this case, the arithmetic unit 12 may acquire the arrangement information of the plurality of scavenging ports 120 from the second captured image to identify each scavenging port 120 and identify the scavenging port 120 included in the first captured image. Conversely, when shifting from the close-up mode to the telephoto mode, the captured image changes from the first captured image in which one scavenging port 120 is captured to the second captured image in which a plurality of scavenging ports 120 are captured. Also in this case, the arithmetic unit 12 may acquire the arrangement information of the plurality of scavenging ports 120 from the second captured image to identify each scavenging port 120 and identify the scavenging port 120 included in the first captured image. Here, the identification of the scavenging port 120 means, for example, recognizing which scavenging port 120 among the three scavenging ports 120 in FIG. 7, for example, it is.

[0076] Also, when shifting from the telephoto mode to the close-up mode, the captured image changes from the second captured image in which a plurality of piston rings 210 are captured as shown in, for example, FIG. 7, to the first captured image in which the piston ring 210 that is the object in the close-up mode is enlarged and captured as shown in, for example, FIG. 11. In this case, the arithmetic unit 12 may acquire the arrangement information of the plurality of piston rings 210 from the second captured image to identify each piston ring 210, and identify the enlarged and captured piston ring 210 included in the first captured image. Conversely, when shifting from the close-up mode to the telephoto mode, the captured image changes from the first captured image in which the piston ring 210 that is the object in the close-up mode is enlarged and captured, to the second captured image in which a plurality of piston rings 210 are captured. Also in this case, the arithmetic unit 12 may acquire the arrangement information of the plurality of piston rings 210 from the second captured image to identify each piston ring 210, and identify the enlarged and captured piston ring 210 included in the first captured image. Here, the identification of the piston ring 210 means, for example, recognizing which piston ring 210 among a plurality (here, four) of piston rings 210 it is.

[0077] An example of this case will be described. For example, in the telephoto mode and the close-up mode, the arithmetic unit 12 compares the shape feature amount obtained from the captured image by pre-capture with the reference feature amount, and based on the difference between the two compared values and the reference position and reference posture of the camera 1, estimates the position and posture of the camera 1 at the time of capture, and stores the estimated position and posture of the camera 1 as time-series data. Then, in the telephoto mode, the arrangement information of the plurality of piston rings 210 in the scavenging port 120 in the captured image by main capture or pre-capture is stored, and when shifting from the telephoto mode to the close-up mode, based on the stored arrangement information of the plurality of piston rings 210 and the time-series data, one piston ring 210 that is the object in the close-up mode may be identified.

[0078] Also, in this embodiment, the display unit 3 is used as the instruction output unit that outputs instructions to the photographer in the telephoto mode and the copy mode, but it is not limited to this. If the camera 1 is equipped with a speaker like a smartphone, the speaker may be used as the instruction output unit, and the instructions to the photographer may be given by voice output from the speaker. Further, when the camera 1 is a digital camera and is equipped with a monitor such as a liquid crystal monitor, the display unit 3 may be the monitor, or when it is equipped with an electronic viewfinder using liquid crystal or the like, the display unit 3 may be the electronic viewfinder.

[0079] Also, in this embodiment, the through image is displayed on the display unit 3 during pre-shooting, but it is not limited to this. When the through image during pre-shooting is not displayed on the display unit 3, or even if the through image is displayed, the instructions to the photographer may be given by voice output from the speaker.

[0080] Further, the camera 1 may be equipped with a vibrator and the vibrator may be used as the instruction output unit. For example, when the position and orientation of the camera 1 are not within the allowable range, the vibrator may be vibrated and the vibration may be stopped when it comes within the allowable range. Such a vibrator may be combined with the aforementioned display unit 3 or speaker and used as the instruction output unit.

[0081] From the above description, many improvements and other embodiments of the present disclosure will be apparent to those skilled in the art. Therefore, the above description should be construed as illustrative only and provided for the purpose of teaching those skilled in the art the best mode of carrying out the present disclosure. Without departing from the spirit of the present disclosure, the details of its structure and / or function can be substantially changed.

[0082] (Summary) When photographing the piston through the scavenging port of a uniflow scavenging two-cycle engine including a cylinder having a scavenging port and a piston sliding within the cylinder with a camera, a photographing support device according to an aspect of the present disclosure is a photographing support device that instructs a photographer of the position and orientation of the camera. The photographing support device includes a storage device that stores structure information of the engine and an arithmetic unit. The arithmetic unit causes the camera to start pre-photographing in which images are repeatedly photographed before and after the main photographing for photographing a recording image, obtains a shape feature amount of a predetermined object included in the engine from the photographed images obtained by the pre-photographing, and based on the obtained shape feature amount, the structure information of the engine, and a reference feature amount of the object in a photographed image determined based on a reference position and a reference orientation of the camera when photographing the object, performs a determination process of determining whether the position and orientation of the camera during photographing are within an allowable range with respect to the reference position and the reference orientation of the camera. As a result of the determination process, when the position and orientation of the camera are not within the allowable range, an instruction to the operator to change at least one of the position and orientation of the camera so that the position and orientation of the camera are within the allowable range is output to an instruction output unit of the camera.

[0083] According to this configuration, the photographer may set the camera at an appropriate position and orientation based on the instruction output from the instruction output unit, so that an image of an object suitable for diagnosing the state of the engine can be easily photographed.

[0084] The determination process may be configured to determine whether the position and orientation of the camera are within the allowable range by comparing the shape feature amount obtained from the captured image by pre-capture with the reference feature amount and determining whether the difference between the two compared values is within a predetermined range. In this case, the fact that the difference between the two compared values is within the predetermined range means that the position and orientation of the camera are within the allowable range. Therefore, when the result of the determination process indicates that the position and orientation of the camera are not within the allowable range, the arithmetic unit may output an instruction to the instruction output unit of the camera to change at least one of the position and orientation of the camera so that the difference between the two compared values is within the predetermined range, for the operator.

[0085] The determination process may be configured to compare the shape feature amount obtained from the captured image by pre-capture with the reference feature amount, estimate the position and orientation of the camera at the time of capture based on the difference between the two compared values and the reference position and reference orientation of the camera, and determine whether the estimated position and orientation of the camera are within the allowable range.

[0086] The camera is provided with a display unit that displays the captured image by pre-capture, and the arithmetic unit may cause the display unit of the camera to display an instruction to the photographer superimposed on the captured image by pre-capture.

[0087] When the result of the determination process indicates that the position and orientation of the camera are within the allowable range, the arithmetic unit may cause the camera to perform main capture.

[0088] The arithmetic unit has two operation modes: a telephoto mode and a close-up mode. In the telephoto mode, the object is the entire part of the scavenging port, and the determination process is performed. In the close-up mode, the object is the piston visible through a part of the scavenging port, and the determination process is performed.

[0089] Specifically, the object in the telephoto mode may be the entire contour portion of the scavenging port, or may be the piston and a plurality of piston rings assembled to the piston visible through the entire scavenging port. Further, the object in the close-up mode may be a piston ring assembled to the piston visible through the scavenging port, or may be a ring land which is an exposed portion on the peripheral surface of the piston.

[0090] Further, different items may be provided between the items for instructing the photographer regarding the position and orientation of the camera in the telephoto mode and the items for instructing the photographer regarding the position and orientation of the camera in the close-up mode.

[0091] Further, the arithmetic unit may be configured to shift to the close-up mode while continuing the pre-shooting when a predetermined first condition is satisfied in the telephoto mode, and to shift to the telephoto mode while continuing the pre-shooting when a predetermined second condition is satisfied in the close-up mode.

[0092] Further, in the telephoto mode, when the result of the determination process in the telephoto mode indicates that the position and orientation of the camera are within the allowable range, the arithmetic unit may cause the camera to perform main shooting, store the arrangement information of the plurality of piston rings in the scavenging port in the captured image obtained by this main shooting, and when shifting from the telephoto mode to the close-up mode, cause information based on the arrangement information (for example, marks D3, D4, etc. shown in FIG. 10) to be superimposed and displayed on the captured image obtained by pre-shooting on the display unit provided in the camera. Then, when the result of the determination process in the close-up mode indicates that the position and orientation of the camera are within the allowable range, the arithmetic unit may cause the camera to perform main shooting.

[0093] The calculator may identify the object included in the first captured image from the object identified in the second captured image captured before or after the first captured image. Here, the first captured image and the second captured image may be captured images obtained by pre-capture, or may be captured images obtained by main capture.

[0094] For example, when shifting from the telephoto mode to the macro mode, the captured image changes from the second captured image in which a plurality of scavenging ports are captured to the first captured image in which one scavenging port is captured. In this case, the calculator may obtain the arrangement information of the plurality of scavenging ports from the second captured image to identify each scavenging port, and identify the scavenging port included in the first captured image. Conversely, when shifting from the macro mode to the telephoto mode, the captured image changes from the first captured image in which one scavenging port is captured to the second captured image in which a plurality of scavenging ports are captured. Also in this case, the calculator may obtain the arrangement information of the plurality of scavenging ports from the second captured image to identify each scavenging port, and identify the scavenging port included in the first captured image.

[0095] Also, when shifting from the telephoto mode to the macro mode, the captured image changes from the second captured image in which a plurality of piston rings are captured to the first captured image in which the piston ring targeted in the macro mode is captured in an enlarged state. In this case, the calculator may obtain the arrangement information of the plurality of piston rings from the second captured image to identify each piston ring, and identify the enlarged piston ring included in the first captured image. Conversely, when shifting from the macro mode to the telephoto mode, the captured image changes from the first captured image in which the piston ring targeted in the macro mode is captured in an enlarged state to the second captured image in which a plurality of piston rings are captured. Also in this case, the calculator may obtain the arrangement information of the plurality of piston rings from the second captured image to identify each piston ring, and identify the enlarged piston ring included in the first captured image.

[0096] An example in this case will be described. For example, in the telephoto mode and the close-up mode, the arithmetic unit compares the shape feature amount obtained from the captured image by pre-capture with the reference feature amount, and based on the difference between the two compared values, the reference position and reference orientation of the camera, estimates the position and orientation of the camera at the time of shooting, and stores the estimated position and orientation of the camera as time-series data. Then, in the telephoto mode, the arrangement information of a plurality of piston rings in the scavenging port in the captured image by main shooting or pre-capture is stored, and when shifting from the telephoto mode to the close-up mode, based on the stored arrangement information of the plurality of piston rings and the time-series data, one piston ring that is the object in the close-up mode may be identified.

[0097] A shooting support method according to an aspect of the present disclosure is a shooting support device that instructs the position and orientation of a camera to a photographer when shooting a piston through a scavenging port of a uniflow scavenging type two-cycle engine including a cylinder having a scavenging port and a piston that slides in the cylinder with a camera, causes the camera to start pre-shooting that repeatedly shoots images before and after main shooting that shoots a recording image, obtains a shape feature amount of a predetermined object included in the engine from the captured image by pre-shooting, and based on the obtained shape feature amount, the reference feature amount of the object in the captured image determined based on the structural information of the engine and the reference position and reference orientation of the camera when shooting the object, performs a determination process to determine whether the position and orientation of the camera at the time of shooting are within an allowable range with respect to the reference position and reference orientation of the camera, and as a result of the determination process, when the position and orientation of the camera are not within the allowable range, outputs an instruction to an operator to change at least one of the position and orientation of the camera so that the position and orientation of the camera are within the allowable range to an instruction output unit of the camera.

[0098] A shooting support program according to an aspect of the present disclosure is a shooting support program that instructs a photographer of the position and orientation of a camera when photographing a piston through a scavenging port of a uniflow scavenging two-cycle engine including a cylinder having a scavenging port and a piston sliding in the cylinder. The computer causes the camera to start pre-shooting in which images are repeatedly taken before and after the main shooting for taking a recording image, obtains a shape feature amount of a predetermined object included in the engine from the captured images obtained by the pre-shooting, and based on the obtained shape feature amount, the structure information of the engine, and the reference feature amount of the object in the captured image determined based on the reference position and reference orientation of the camera when photographing the object, performs a determination process to determine whether the position and orientation of the camera during shooting are within an allowable range with respect to the reference position and reference orientation of the camera. As a result of the determination process, when the position and orientation of the camera are not within the allowable range, the computer functions to output an instruction to an operator to change at least one of the position and orientation of the camera so that the position and orientation of the camera are within the allowable range.

Explanation of Signs

[0099] 1 Camera 3 Display Unit 11 Shooting Support Device 12 Arithmetic Unit 13 Storage 100 Engine 110 Cylinder 120 Scavenging Port 140 Piston 210 Piston Ring 280 Ring Land

Claims

1. 1. A photography support device for instructing a photographer on the position and attitude of a camera when photographing a piston through a scavenging port of a uniflow scavenging two-stroke engine having a cylinder with a scavenging port and a piston that slides in the cylinder, the device comprising: a memory that stores structural information of the engine; a computing unit; The computing unit causing the camera to start pre-photographing, which repeatedly captures images before and after actual photography, which captures images for recording; determining a shape feature of a predetermined object included in the engine from the photographed image obtained by pre-photographing, and performing a determination process to determine whether or not the position and orientation of the camera at the time of photographing are within an allowable range for the reference position and orientation of the camera, based on the determined shape feature and a reference feature of the object in the photographed image that is determined based on structural information about the engine and a reference position and orientation of the camera at the time of photographing the object; If the result of the determination process indicates that the position and orientation of the camera are not within the allowable range, an instruction output unit of the camera outputs an instruction to an operator to change at least one of the position and orientation of the camera so that the position and orientation of the camera are within the allowable range. Photography support equipment.

2. The determination process includes: comparing the shape feature amount calculated from the image captured by the pre-photographing with the reference feature amount, and determining whether the difference between the two is within a predetermined range, thereby determining whether the position and orientation of the camera are within the allowable range; The photography support device according to claim 1 .

3. The determination process includes: comparing the shape feature amount determined from the image captured by pre-photography with the reference feature amount, estimating the position and orientation of the camera at the time of photographing based on the difference between the two compared values and the reference position and reference orientation of the camera, and determining whether the estimated position and orientation of the camera are within the allowable range; The photography support device according to claim 1 .

4. The camera includes a display unit that displays a captured image obtained by pre-photography, The computing unit displaying instructions to a photographer on the display unit of the camera superimposed on the image captured by the pre-photographing; 4. The photographing support device according to claim 1.

5. The computing unit If the result of the determination process indicates that the position and orientation of the camera are within the allowable range, the camera is caused to perform actual photography. The imaging support device according to any one of claims 1 to 4.

6. The arithmetic unit has two operation modes, a telephoto mode and a close-up mode, in the telephoto mode, the object is the entire part of the scavenging port, and the determination process is performed, in the close-up mode, the object is the piston visible through a part of the scavenging port, and the determination process is performed. The imaging support device according to any one of claims 1 to 5.

7. The arithmetic unit identifies the object included in the first captured image from the object specified in the second captured image captured before or after the first captured image. The imaging support device according to any one of claims 1 to 6.

8. An imaging support device that instructs a photographer of the position and orientation of a camera when photographing a piston through a scavenging port of a uniflow scavenging two-cycle engine including a cylinder having a scavenging port and a piston that slides inside the cylinder, causes the camera to start pre-capturing in which images are repeatedly captured before and after the main capture for capturing a recording image, obtains a shape feature amount of a predetermined object included in the engine from the captured images by pre-capturing, and based on the obtained shape feature amount, the structure information of the engine, and the reference feature amount of the object in the captured image determined based on the reference position and reference orientation of the camera when photographing the object, performs a determination process to determine whether the position and orientation of the camera during photographing are within an allowable range with respect to the reference position and reference orientation of the camera, when the result of the determination process indicates that the position and orientation of the camera are not within the allowable range, outputs an instruction to an operator to change at least one of the position and orientation of the camera so that the position and orientation of the camera are within the allowable range. Imaging support method.

9. An imaging support program that instructs a photographer of the position and orientation of a camera when photographing a piston through a scavenging port of a uniflow scavenging two-cycle engine including a cylinder having a scavenging port and a piston that slides inside the cylinder, causes a computer to start pre-capturing in which images are repeatedly captured before and after the main capture for capturing a recording image by the camera, Obtain the shape feature amount of a predetermined object included in the engine from the photographed image by pre-photographing, and based on the obtained shape feature amount, the structure information of the engine, and the reference feature amount of the object in the photographed image determined based on the reference position and reference posture of the camera when photographing the object, perform a determination process to determine whether the position and posture of the camera at the time of photographing are within the allowable range with respect to the reference position and reference posture of the camera. When the result of the determination process indicates that the position and posture of the camera are not within the allowable range, function to output an instruction to the operator to change at least one of the position and posture of the camera so that the position and posture of the camera are within the allowable range. Shooting support program.

Images