Inspection Support Device
The inspection support device enhances container inspection efficiency by identifying types and specifying positions, reducing time through superimposed images that guide inspectors.
Patent Information
- Application Number
- JP2021029115
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-02-25
- Publication Date
- 2024-11-05
- Estimated Expiration
- 2041-02-25
AI Technical Summary
The time required for inspecting containers varies due to differing mounting positions of parts depending on container type, necessitating visual search within entire images, which prolongs the inspection process.
An inspection support device that identifies container types and specifies inspection positions based on acquired identification information, generating superimposed images to guide inspectors efficiently.
Reduces inspection time by clearly indicating inspection positions, facilitating quicker and more accurate container inspections.
Smart Images

Figure 0007577568000001 
Figure 0007577568000002 
Figure 0007577568000003
Abstract
Description
[Technical field]
[0001] The present invention relates to a technique for assisting in the inspection of containers. [Background technology]
[0002] As a technology to assist in container inspection, Patent Document 1 discloses a technology in which a mobile object identifier (which obtains container numbers and vehicle numbers) and a camera installed at the container gate transmit images to a monitor in a monitoring room away from the gate, who then makes an assessment. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Patent No. 6740783 Summary of the Invention [Problem to be solved by the invention]
[0004] When trying to extract each part of a container, the attachment position of the parts varies depending on the type of container, so simply transmitting an image taken at the container gate to an inspector would require the inspector to visually search for the parts to inspect from the overall image, which could result in the inspection taking a long time. In view of the above background, an object of the present invention is to shorten the time required for container inspection. [Means for solving the problem]
[0005] In order to solve the above-mentioned problems, the present invention provides, as a first aspect, an inspection support device that acquires identification information that identifies the types of multiple containers, and, based on the identification information of the container to be inspected, identifies inspection positions of parts of the container that require inspection, which are determined according to the type.
[0006] According to the inspection support device of the first aspect, it is possible to shorten the time required for container inspection.
[0007] In the inspection support device of the first aspect described above, a configuration may be adopted as a second aspect in which a photographed image of the container to be inspected is acquired, and a superimposed image is generated by superimposing a positional image indicating the inspection position identified for the container on the photographed image.
[0008] According to the examination support device of the second aspect, the examination position can be made easier to understand.
[0009] In the inspection support device of the second aspect described above, when a captured image is acquired in which one side of the container to be inspected appears as a trapezoid, a configuration may be adopted as a third aspect in which the position image is superimposed on a corrected image in which the trapezoid is corrected to a rectangle.
[0010] According to the inspection support device of the third aspect, it is possible to grasp the inspection position by viewing the surface of the container from the front.
[0011] In the inspection support device of the first aspect described above, a configuration may be adopted as a fourth aspect in which a superimposed image is generated by superimposing a position image indicating the inspection position identified for the container on a schematic diagram of the container type identified by the identification information.
[0012] According to the inspection support device of the fourth aspect, the inspection position can be indicated even if it is not possible to photograph the container. [Brief description of the drawings]
[0013] [Figure 1] FIG. 1 is a diagram showing the overall configuration of an examination support system according to an embodiment. [Diagram 2] A diagram showing the hardware configuration of each device [Diagram 3] FIG. 1 is a diagram showing a functional configuration realized in an information processing system. [Figure 4] FIG. 1 is a diagram illustrating an example of an inspection position table. [Diagram 5] FIG. 1 is a diagram illustrating an example of the transition of images until a superimposed image is generated. [Figure 6] FIG. 1 is a diagram illustrating an example of an operation procedure in an output process. [Figure 7] FIG. 13 is a diagram illustrating an example of a superimposed image generated in a modified example. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0014] [1] Example FIG. 1 shows the overall configuration of an inspection support system 1 according to an embodiment. The inspection support system 1 is a system that supports the inspection of containers. A container is a vessel that holds various cargo items and is used when ships, trains, etc. transport cargo items. A container generally has a rectangular box shape, and various types of containers are used depending on the cargo items to be held.
[0015] The inspection supported by the inspection support system 1 is an inspection to check whether the container is in a normal state by looking at the appearance of the container, and includes an inspection item such as checking whether multiple levers for fixing the doors that open and close the container are in the correct positions. The inspection of the container is carried out at a gate provided in the container terminal where the containers are loaded, handled, stored, etc.
[0016] A gate is a place where containers are received, and where container status is checked, container numbers are collated, container weights are measured, and documents required for container handover are confirmed. An inspector is in charge of inspection at the gate, and the inspector inspects containers using inspection support system 1. Inspection support system 1 includes a server device 10, a gate device 20, an inspector terminal 30, and a communication line 2.
[0017] The communication line 2 is a communication system including a mobile communication network and the Internet, and relays data between devices (devices, terminals, systems, etc.) that communicate with the system itself. A server device 10 is connected to the communication line 2 via wired communication, and a gate device 20 and an inspector terminal 30 are connected to the communication line 2 via wireless communication. Note that communication between each device and the communication line 2 is not limited to the example in FIG. 1, and may be either wired communication or wireless communication.
[0018] The server device 10 is a device that performs various processes to support the inspection of containers, and is an example of the "inspection support device" of the present invention. The gate device 20 is a device installed near the gate, and performs tasks such as obtaining container numbers and photographing containers. The inspector terminal 30 is a terminal used by the inspector described above.
[0019] The inspector terminal 30 may be a tablet terminal or a smartphone that is easy for the inspector to carry and use at the inspection site. The server device 10 outputs support information, which is information for supporting the inspection of containers, to the inspector terminal 30, and the inspector terminal 30 displays the output support information, thereby supporting the inspection by the inspector. Details of the support information will be described later.
[0020] Fig. 2 shows the hardware configuration of each device. As shown in Fig. 2(a), the server device 10 is a computer including a processor 11, a memory 12, a storage 13, and a communication device 14. The processor 11 includes, for example, an arithmetic unit such as a CPU (=Central Processing Unit), a register, and peripheral circuits. The memory 12 is a recording medium readable by the processor 11, and includes a RAM (=Random Access Memory), a ROM (=Read Only Memory), and the like.
[0021] The storage 13 is a recording medium readable by the processor 11, and includes, for example, a hard disk drive or a flash memory. The processor 11 uses the RAM as a work area to execute programs stored in the ROM or the storage 13, thereby controlling the operation of each piece of hardware. The communication device 14 includes an antenna, a communication circuit, etc., and is a communication means for communicating via the communication line 2.
[0022] As shown in Fig. 2(b), the gate device 20 is a computer including a processor 21, a memory 22, a storage 23, a communication device 24, a plurality of imaging devices 25, and a reading device 26. The processor 21 to the communication device 24 are the same type of hardware as the processor 11 to the communication device 14 shown in Fig. 2(a). Each of the plurality of imaging devices 25 is a digital camera having an image sensor, an optical system, etc., and captures an object present in the direction of the optical axis.
[0023] The reading device 26 has a function of performing short-distance wireless communication such as RFID (Radio Frequency Identifier), and reads information from an external device such as an RFID tag. As shown in Fig. 2(c), the inspector terminal 30 is a computer including a processor 31, a memory 32, a storage 33, a communication device 34, and a UI (User Interface) device 35. The processor 21 to the communication device 24 are the same type of hardware as the processor 11 to the communication device 14 shown in Fig. 2(a).
[0024] The UI device 15 is an interface provided to a user (inspector in this embodiment) who uses the device itself. The UI device 15 has, for example, a display as a display means and a touch screen having a touch panel provided on the surface of the display, and displays images and accepts operations from the user. In the inspection support system 1, the processor of each device executes a program to control each part, thereby realizing each function described below.
[0025] 3 shows the functional configuration realized in the inspection support system 1. The server device 10 includes an identification information acquisition unit 101, a type determination unit 102, an inspection position identification unit 103, an image acquisition unit 104, a support information generation unit 105, and a support information output unit 106. The gate device 20 includes an identification information reading unit 201 and a container photographing unit 202. The inspector terminal 30 includes a support information display unit 301.
[0026] The identification information reading unit 201 of the gate device 20 reads identification information for identifying the types of multiple containers from each container. The types of containers include, for example, dry containers (containers for transporting at room temperature), reefer containers (containers that can adjust the temperature), open-top containers (containers without a roof), and tank containers (containers for transporting liquids). Note that the types of containers are not limited to these, and types according to other functions or types according to size may also be used.
[0027] For example, an RFID tag is attached to a container for which inspection support system 1 supports inspection. The RFID tag stores, for example, a container number, a size code, and a type code as identification information for identifying the type of container to which it is attached. The container number is an 11-digit string of numbers and letters defined by ISO6346, and consists of an owner code, a category ID, a serial number, and a check digit.
[0028] The owner code is a code that indicates the owner of the container. The category ID is information that indicates the type of container. The serial number is a number that is uniquely assigned by the container owner. The check digit is information that identifies whether the container number is correct or not. The size code is a code that indicates the size of the container, and the type code is a code that indicates the type of container.
[0029] The gate device 20 is installed in a position where it can wirelessly communicate with the RFID attached to a container to be inspected when the container passes through the gate. The identification information reading unit 201 of the gate device 20 wirelessly communicates with the RFID and reads the container number, size code, and type code stored in the RFID. The identification information reading unit 201 transmits read data indicating the read container number, size code, and type code to the server device 10.
[0030] The identification information acquisition unit 101 of the server device 10 acquires the container number, size code, and type code indicated in the read data transmitted from the gate device 20 as identification information for identifying the types of multiple containers. The identification information acquisition unit 101 supplies the acquired identification information (container number, size code, and type code) of the container to be inspected to the type determination unit 102.
[0031] The type determination unit 102 determines the type of the container based on the supplied identification information. In particular, the type determination unit 102 determines the category represented by the size indicated by the size code and the type indicated by the type code as the type of the container to be inspected. For example, if the size code and type code are "42G1", the type determination unit 102 determines that the container is a dry container 40 feet long and 8 feet 6 inches high, and if the size code and type code are "45R1", the type determination unit 102 determines that the container is a reefer container 40 feet long and 9 feet 6 inches high.
[0032] The type determination unit 102 supplies the determined type to the inspection position specifying unit 103. The inspection position specifying unit 103 specifies the inspection position of the portion of the container to be inspected that is determined according to the supplied type. Note that since the supplied type is determined by the type determination unit 102 based on the identification information of the container to be inspected, the inspection position specifying unit 103 will specify the inspection position of the container based on the identification information of the container to be inspected.
[0033] The inspection position specifying unit 103 specifies the inspection position using, for example, an inspection position table that associates container types with inspection positions. Figure 4 shows an example of an inspection position table. In the example of Figure 4, the inspection positions are expressed as "area", "target", "X", "Y", "H", and "W". "Area" indicates the direction of the surface to be inspected in the rectangular container. "Target" indicates the name of the part to be inspected.
[0034] "X" and "Y" indicate the X and Y coordinates of the representative position of the inspection area (e.g., the center of the inspection area) in a two-dimensional coordinate system with the origin being a reference position (e.g., the upper left corner) set on the surface to be inspected. "H" and "W" indicate the height and width of the inspection area. In this embodiment, the length of a unit vector in the two-dimensional coordinate system corresponds to 1 inch in real life (e.g., the length from the origin to (0, 1) is 1 inch), and "H" and "W" are also expressed in inches (W=10 means a width of 10 inches).
[0035] The inspection position specifying unit 103 specifies the inspection position associated in the inspection position table with the container type supplied from the type determining unit 102 as the inspection position of the container to be inspected. For example, if the container type is a dry container with a length of 40 feet and a height of 8 feet 6 inches, the inspection position specifying unit 103 first specifies the area as "right side" as shown in Fig. 4. Then, if the target is a "lock pin", the inspection position specifying unit 103 specifies X=40, Y=40, H=2, and W=8 as the inspection position.
[0036] In this case, it is indicated that the "lock pin" is present in a rectangular area 2 inches high and 8 inches wide, centered at a point 40 inches to the right and 40 inches down from the upper left corner of the right side of the container to be inspected. Similarly, if the target is an "axis cam," the inspection position identifying unit 103 identifies X=30, Y=0, H=10, and W=10 as the inspection position. In this way, the inspection position is represented by a rectangular area that indicates the part to be inspected. The inspection position identifying unit 103 supplies the identified inspection position to the image acquiring unit 104 and the support information generating unit 105.
[0037] When the identification information reading unit 201 of the gate device 20 reads the identification information, it supplies the identification information to the container photographing unit 202. When the identification information is supplied, the container photographing unit 202 controls the multiple imaging devices 25 shown in Fig. 2 to capture an image of the container identified by the supplied identification information, i.e., the container to be inspected. In the inspection support system 1, it is assumed that the multiple imaging devices 25 are each installed at a position where they can capture an image of one of the faces of the container.
[0038] The container photographing unit 202 causes the multiple imaging devices 25 to photograph each surface of the container, and transmits image data indicating the photographed images to the server device 10. The image data transmitted to the server device 10 is received by the image acquiring unit 104. The image data received by the image acquiring unit 104 also indicates images of surfaces that are not at the inspection position.
[0039] Therefore, the image acquiring unit 104 acquires, from among images of the container indicated by the received image data, a photographed image of the surface (e.g., the right side surface) indicated by the inspection position supplied from the inspection position specifying unit 103 as a photographed image of the container to be inspected. The image acquiring unit 104 supplies the acquired photographed image to the support information generating unit 105.
[0040] The support information generating unit 105 generates the above-mentioned support information (information for supporting the inspection of the container) using the supplied photographed image. Specifically, the support information generating unit 105 generates, as support information, a superimposed image in which a position image indicating the inspection position identified by the inspection position identifying unit 103 for the container to be inspected is superimposed on the photographed image. Note that the acquired image of the container may be an image of the surface of the container photographed obliquely.
[0041] In this case, the surface of the container is usually rectangular, but appears as a trapezoid on the image. When a captured image is acquired in which one surface of the container to be inspected appears as a trapezoid, the support information generating unit 105 generates a corrected image in which the trapezoid is corrected to a rectangle. The support information generating unit 105 corrects the surface of the container shown in the captured image to a rectangle, for example, using a well-known technique of so-called keystone correction, which corrects an image projected by a projector from a trapezoid to a rectangle.
[0042] The support information generating unit 105 generates a superimposed image by superimposing, as a position image, an image of a rectangular area indicating the identified inspection position on a corrected image representing a rectangular container surface. Fig. 5 shows an example of the transition of images until a superimposed image is generated. Fig. 5(a) shows a captured image G1 in which one surface D1 of a container C1 is captured as a trapezoid. Lock pins E1 and E2 are provided on the one surface D1.
[0043] Fig. 5(b) shows a corrected captured image C2 showing one surface D2 of container C1 corrected to a rectangle by the support information generating unit 105. Fig. 5(c) shows a superimposed image G3 in which position images F1 and F2 showing lock pins E1 and E2, which are inspection positions, are superimposed on the captured image C2 by the support information generating unit 105. The support information generating unit 105 supplies the superimposed image thus generated to the support information output unit 106 as support information.
[0044] The support information output unit 106 outputs the supplied support information (superimposed image) to, for example, a pre-registered inspector terminal 30. The support information display unit 301 of the inspector terminal 30 displays the support information output from the server device 10. The support information display unit 301 displays, for example, the superimposed image G3 shown in FIG. 5(c) as support information. By looking at the displayed superimposed image G3, an inspector can easily grasp the positions of the lock pins E1 and E2 to be inspected in the container C1.
[0045] The output process in which the processor 11 of the server device 10 outputs the support information will be described with reference to FIG. Fig. 6 shows an example of the operation procedure in the output process. The operation procedure in Fig. 6 is started, for example, when a container to be inspected is brought to the gate and the gate device 20 reads the identification information from the RFID tag attached to the container.
[0046] First, the processor 11 (identification information acquisition unit 101) acquires the container number, size code, and type code indicated in the read data transmitted from the gate device 20 as identification information of the container to be inspected (step S11). Next, the processor 11 (type determination unit 102) determines the type of the container to be inspected based on the acquired identification information (step S12).
[0047] Next, the processor 11 (inspection position specifying unit 103) specifies an inspection position of a portion of the container to be inspected that is determined according to the determined type (step S13). Next, the processor 11 (image acquiring unit 104) acquires a photographed image of the surface of the container to be inspected that is indicated by the specified inspection position as a photographed image of the container to be inspected (step S14).
[0048] Next, the processor 11 (support information generating unit 105) corrects the trapezoidal surface reflected in the acquired photographed image to become a rectangle (step S15), and generates a superimposed image by superimposing the position image indicating the inspection position identified in step S14 on the corrected photographed image (step S16).Then, the processor 11 (support information output unit 106) outputs the generated superimposed image to the inspector terminal 30 as support information (step S17).
[0049] In this embodiment, by identifying the inspection position of the container to be inspected as described above, the inspector can find the inspection position faster than when the inspection position is not identified, and the time required to inspect the container can be shortened. Also, by superimposing a position image on the photographed image, the inspection position can be made easier to understand than when the photographed image is not used. Also, by performing keystone correction on the photographed image, the inspection position can be grasped by viewing the container face from the front.
[0050] [2] Variations The above-described embodiment is merely one example of the implementation of the present invention, and may be modified as follows: Furthermore, the embodiment and each modification may be combined as necessary.
[0051] [2-1]Schematic diagram In the embodiment, the support information generating unit 105 generates the superimposed image using a photographed image of the container to be inspected, but the present invention is not limited to this. For example, the support information generating unit 105 may generate a superimposed image by superimposing a position image indicating the inspection position specified for the container on a schematic diagram of the container of the type identified by the acquired identification information.
[0052] Fig. 7 shows an example of a superimposed image generated in this modified example. In the example of Fig. 7, the support information generating unit 105 generates a superimposed image G4 by superimposing position images F1 and F2 indicating lock pins E1 and E2 on a schematic diagram H1 of a container. In this modified example, the support information generating unit 105 stores a schematic diagram indicating the parts to be inspected in the container in association with the type of container, and generates a superimposed image by reading out the schematic diagram stored in association with the identification information acquired by the identification information acquiring unit 101. According to this modified example, it is possible to show the inspection position to an inspector even if it is not possible to photograph the container.
[0053] [2-2] Trapezoid image In the embodiment, the support information generating unit 105 generates a superimposed image by correcting the trapezoidal container surface to a rectangle, but the present invention is not limited to this, and the superimposed image may be generated by using the trapezoidal image as it is. Even in this case, the inspection position can be made easier to understand compared to the case where there is no superimposed image.
[0054] [2-3] How to obtain identification information In the embodiment, the identification information acquisition unit 101 acquires the identification information read from the RFID tag, but the method of acquiring the identification information is not limited to this. For example, the identification information acquisition unit 101 first refers to the image of the container acquired by the image acquisition unit 104, and recognizes characters written on the surface of the container using a well-known character recognition technology.
[0055] Then, the identification information acquiring unit 101 acquires, from the recognized characters, identification information, i.e., character strings that conform to the rules for the container number, size code, and type code, as the identification information of the container to be inspected. According to this modification, it is possible to acquire identification information even for containers to which no RFID tag is attached.
[0056] [2-4] Type of identification information In the embodiment, the container number, the size code, and the type code are used as the container identification information, but this is not limited to this. For example, only the container number or only the size code and the type code may be used as the container identification information. Furthermore, any information other than these may be used as long as it can identify the type of container.
[0057] [2-5] Invention categories The present invention can be understood as information processing devices such as the server device 10, the gate device 20, and the inspector terminal 30. The present invention can also be understood as an information processing system such as the inspection support system 1 that includes those information processing devices. The present invention can also be understood as an information processing method for executing the operation procedures performed by those information processing devices, and as a program for causing a computer that controls the information processing device that realizes those information processing methods to function. This program may be provided in the form of a recording medium such as an optical disk on which it is stored, or may be provided in the form of being downloaded to a computer via a network such as the Internet and installed to make it available. [Explanation of symbols]
[0058] 1...inspection support system, 10...server device, 20...gate device, 30...inspector terminal, 101...identification information acquisition unit, 102...type determination unit, 103...inspection position identification unit, 104...image acquisition unit, 105...support information generation unit, 106...support information output unit, 201...identification information reading unit, 202...container photographing unit, 301...support information display unit.
Claims
1. Identification information for identifying the types of multiple containers is acquired, and an inspection position for a portion of the container that requires inspection is specified according to the type based on the identification information of the container to be inspected. Inspection support equipment.
2. A photographed image of the container to be inspected is acquired, and a superimposed image is generated by superimposing a position image indicating the inspection position identified for the container on the photographed image. The inspection support device according to claim 1 .
3. When the captured image shows one surface of the container to be inspected as a trapezoid, the position image is superimposed on a corrected image obtained by correcting the trapezoid into a rectangle. The inspection support device according to claim 2.
4. A superimposed image is generated by superimposing a position image indicating the inspection position specified for the container on a schematic diagram of the container type identified by the identification information. The inspection support device according to claim 1 .
Citation Information
Patent Citations
Gate control method and gate controller for container terminal
JP2004107031A
Method for inspecting lighting screen of display panel
JP2007132879A
Container condition confirming system in container terminal gate
JP2009143580A
Component inspection support device, control method and program
JP2015163847A
Gate management system, gate management method, and gate management program
JP6740783B2
