Information display device

Abstract

To make it easy to identify a place to be preferentially confirmed among abnormal places.SOLUTION: A tablet terminal 80 comprises: an absolute movement quantity acquisition part which acquires an absolute movement quantity indicative of magnitude of vibration on a conveyance path composed of a conveyance device based upon in-conveyance acceleration information on the conveyance path; an abnormality information acquisition part which acquires abnormality information as information related to an abnormal place on the conveyance path; and a display part 84 which displays the abnormality information and absolute movement quantity overlapping one another. In the tablet terminal, a communication part 81 acquires the in-conveyance acceleration information on the conveyance path composed of the conveyor device, and a processing part 82 calculates the absolute movement quantity based upon the acceleration information. Then the display part 84 displays the absolute movement quantity.SELECTED DRAWING: Figure 11

Description

[Technical field]

[0001] The present invention relates to an information display device that displays data collected about a transport device installed in, for example, a warehouse. [Background technology]

[0002] Conventionally, conveyor systems are often used as transport devices for storing and retrieving goods in warehouses, etc. In this type of conveyor system, detection units such as sensors are fixedly installed on components constituting the conveyor system or around the conveyor system to detect failures.

[0003] When a detection unit such as a sensor is fixedly installed, there is a problem that the detection range is limited. Therefore, the applicant has proposed an anomaly detection system that can detect anomalies in the entire conveyance route at low cost by conveying a container equipped with a camera, a sensor module, etc. as a conveyor device as a conveyed article, as described in Patent Document 1. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2020-142928 A Summary of the Invention [Problem to be solved by the invention]

[0005] Incidentally, the accumulated information collected by the system described in Patent Document 1 can be analyzed by a computer or the like, and information such as where an abnormality was detected along the transport route can be displayed on a terminal device carried by an operator, etc.

[0006] However, when multiple abnormalities are found, simply displaying the abnormalities poses a problem in that it is unclear which one should be given priority for checking.

[0007] The present invention is intended to solve the above-mentioned problems, and has an object to easily specify a location that should be checked preferentially among abnormal locations. [Means for solving the problem]

[0008] The invention described in claim 1, which has been made to solve the above problem, is an information display device comprising: an absolute movement amount acquisition unit that acquires an absolute movement amount indicating a magnitude of vibration on a transport path constituted by a transport device based on acceleration information during transport of the transport path; an abnormality information acquisition unit that acquires abnormality information which is information regarding an abnormal location on the transport path; and a display unit that displays the abnormality information and the absolute movement amount in an overlapping manner. Effect of the Invention

[0009] As described above, according to the present invention, the absolute movement amount and anomaly information are acquired, and the anomaly information and the absolute movement amount are displayed in an overlapping manner. Therefore, locations where the absolute movement amount is large can be determined to be locations where vibrations are large and where a serious malfunction may be occurring, and can be checked as a priority. [Brief description of the drawings]

[0010] [Figure 1] 1 is a top view of a container that collects data to be processed by an information processing device according to an embodiment of the present invention; [Diagram 2] FIG. 2 is a cross-sectional view of the container shown in FIG. 1 taken along line AA. [Diagram 3] FIG. 2 is a block diagram of the container shown in FIG. 1. [Figure 4] 2 is a flowchart of an operation for generating map information based on data collected by the container shown in FIG. 1. [Diagram 5] 2 is a flowchart of a trained model generation operation based on data collected in the container shown in FIG. 1. [Figure 6] 2 is a flowchart of an anomaly detection operation based on data collected in the container shown in FIG. 1. [Figure 7]FIG. 1 is a block diagram of a computer serving as an information processing device according to an embodiment of the present invention. [Figure 8] 13 is a diagram showing a case where a deviation occurs between drawing data and actual measurement data. [Figure 9] 8 is a flowchart of a correction operation in the computer shown in FIG. 7. [Figure 10] This is a map showing abnormal locations based on tracking data after a correction operation has been performed on a transport route based on drawing data. [Figure 11] 1 is a block diagram of a tablet terminal as an information display device according to an embodiment of the present invention. [Figure 12] 4 is a display example of an information display device according to an embodiment of the present invention. [Figure 13] This is an example of the display when the timeline in FIG. 12 is slid to the right. [Figure 14] This is a display example in the state where the map area in FIG. 12 is slid to the right. [Figure 15] This is a display example in the state in which the video area in FIG. 12 is slid to the left. [Figure 16] 13 is a modified example of the display example shown in FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] An information processing device and an information display device according to an embodiment of the present invention will be described with reference to Fig. 1 to Fig. 16. Fig. 1 is a top view of a container that collects data to be processed by an information processing device according to an embodiment of the present invention. Fig. 2 is a cross-sectional view of the container shown in Fig. 1 taken along line AA.

[0012] The container 1 is placed on a conveyor device 50 as a transport device and transported by the conveyor device 50. In Fig. 1, the container is transported in the direction of the arrow. Although Figs. 1 and 2 show a roller conveyor as the transport device, other transport devices such as a belt conveyor may also be used. Furthermore, although Figs. 1 and 2 show only a part of the conveyor device 50, the conveyor device 50 is installed, for example, in a warehouse and has a transport path consisting of straight lines, curves, a ramp, etc. Therefore, the conveyor device 50 may be composed of multiple conveyor devices.

[0013] 1 and 2 is formed in a substantially rectangular box shape and constitutes a storage section 11. The storage section 11 has an opening at the top to allow items to be put in and taken out. The storage section 11 is also composed of four side sections 11a, 11b, 11c, and 11d and a bottom section 11e.

[0014] 1 and 2, the side portions 11a and 11b are the short side portions of the rectangular parallelepiped, and the side portions 11c and 11d are the long side portions of the rectangular parallelepiped. In this embodiment, the side portion 11a is the front side, that is, the conveying direction (travel direction) side. Therefore, the side portion 11b is the rear side, the side portion 11c is the left side in the travel direction, and the side portion 11d is the right side in the travel direction.

[0015] The container 1 includes a camera 2, a control unit 3, sensor modules 4L and 4R, and a battery 5.

[0016] The camera 2 is a camera module having an imaging element such as a charge coupled device (CCD) image sensor or a complementary metal oxide semiconductor (CMOS) image sensor.

[0017] The camera 2 is composed of cameras 2a, 2b, 2c, 2d, and 2e. The cameras 2a to 2c are provided on the side surface portion 11a and photograph the front of the container 1. The cameras 2a to 2c are provided so as to mainly photograph the lower front side of the container 1 (see FIG. 2). The camera 2d is provided on the side surface portion 11c. The camera 2e is provided on the side surface portion 11d.

[0018] Camera 2a photographs the left front in the transport direction of container 1. Camera 2b photographs the center front in the transport direction of container 1. Camera 2c photographs the right front in the transport direction of container 1. Camera 2d photographs the left side in the transport direction of container 1. Camera 2e photographs the right side in the transport direction of container 1. Cameras 2a and 2c are well-known thermo cameras (infrared thermography). Cameras 2b, 2d, and 2e are wide-angle cameras.

[0019] In this embodiment, the cameras 2a and 2c can detect the temperature of the conveyor device 50 in the conveying direction. That is, the cameras 2a and 2c function as a state detection unit that detects the state in the forward direction with respect to the traveling direction of the conveyor device. The camera 2b may be a stereo camera.

[0020] The control unit 3 is provided further below the bottom surface portion 11e. In other words, the container 1 has a double bottom. The control unit 3 is directly or indirectly installed on a vibration absorbing member 8, such as a vibration absorbing mat. The vibration absorbing member 8 can make the control unit 3 and the like less susceptible to the effects of vibrations generated during transportation.

[0021] The control unit 3 estimates the current position (self-position) of the container 1 based on the image captured by the camera 2. The control unit 3 also learns the results detected by the sensor modules 4L, 4R by deep learning, and determines whether the results detected by the sensor modules 4L, 4R are within a normal range based on the learning results, thereby determining whether there is an abnormality. Details will be described later.

[0022] The sensor module 4L includes a sound sensor 4a and a vibration sensor 4c. The sensor module 4L is provided close to the side surface portion 11c. The sound sensor 4a is directly or indirectly installed on a vibration absorbing member 8, and the vibration sensor 4c is directly installed on the bottom surface of the container 1 below the vibration absorbing member 8.

[0023] The sensor module 4R is basically similar in configuration to the sensor module 4L. The sensor module 4R is different from the sensor module 4L in that it is provided closer to the side surface portion 11d. In other words, the sensor module 4L detects the state of the left side of the container 1 in the traveling direction, and the sensor module 4R detects the state of the right side of the container 1 in the traveling direction.

[0024] The sound sensor 4a collects external sounds and detects sounds emitted by a predetermined conveyor device 50. The sound sensor 4a can be configured, for example, with a unidirectional microphone and a frequency filter. The vibration sensor 4c detects vibrations applied to the container 1. The vibration sensor 4c can be configured with an acceleration sensor or the like. A three-axis acceleration sensor is preferable as the acceleration sensor, but a one-axis or two-axis acceleration sensor may also be used. In addition, the vibration sensor 4c does not have to be provided for each sensor module, and one may be provided for each container 1. In this embodiment, the sensor modules 4L and 4R are configured with two types of sensors, but other sensors such as optical sensors and magnetic sensors may also be used. That is, the sensor modules 4L and 4R function as a state detection unit that detects the state of the conveyor device 50.

[0025] The battery 5 is directly or indirectly mounted on a vibration absorbing member 8. The battery 5 supplies power to the camera 2, the control unit 3, and the sensor modules 4L and 4R. The container 1 also has a terminal (not shown) for charging the battery 5. Alternatively, the battery 5 may be detachable for charging.

[0026] A block diagram of the container (anomaly detection system) 1 according to this embodiment is shown in Fig. 3. As shown in Fig. 3, the control unit 3 includes a processing unit 3a and a storage unit 3b.

[0027] The processing unit 3a is composed of, for example, a microprocessor, and performs acquisition of detection values ​​of the various sensors described above, self-position estimation, deep learning, determination of the presence or absence of abnormalities, etc. That is, the processing unit 3a functions as a current position detection unit together with the camera 2.

[0028] The storage unit 3b is composed of a storage device such as an SSD (Solid State Drive), and accumulates and stores the detection results of the sensor modules 4L and 4R in association with the self-location-estimated position information. The storage unit 3b also stores layout (map) information of the transport route for self-location estimation.

[0029] Next, the operation of the container 1 having the above-mentioned configuration will be described with reference to the flowcharts of Figures 4 to 6. Figure 4 is a flowchart showing the generation of map information for estimating the container's own position from an image captured by the camera 2.

[0030] First, captured images are collected from the camera 2b (step S11), and the processing unit 3a extracts feature points from the collected captured images (step S12). Then, the processing unit 3a generates a 3D map (map information) of the transport route formed by the conveyor device 50 based on the extracted feature points (step S13). This 3D map is created by extracting and stitching together feature points from a plurality of images captured by the camera 2b while the conveyor device 50 is transporting the product, and contains information about the feature points on the transport route.

[0031] The map information does not have to be a three-dimensional map. For example, it may be two-dimensional information of a route consisting of straight lines and curves (see FIG. 8, for example). In this case, it is sufficient to detect the curves as the feature points.

[0032] FIG. 5 is a flowchart for generating a trained model by deep learning based on the detection results obtained by the sensor modules 4L and 4R and the thermal cameras 2a and 2c.

[0033] First, the detection results detected by the sensor modules 4L, 4R and the cameras 2a, 2c are collected (step S21), and the processing unit 3a learns the normal detection results of each sensor by well-known deep learning (step S22). That is, the detection results of the sensors when the conveyor device 50 is operating normally are learned. At this time, the normal state may have a certain range of values. Also, in this step, the normal state (detection result) is learned for each position of the conveyor device 50. This is because the range of normal sounds, temperatures, and vibrations often differ depending on the position of the conveyor device 50. That is, learning is performed in association with the position by referring to the three-dimensional map information. Then, the processing unit 3a generates a learned model that has learned a predetermined amount of detection results (step S23).

[0034] FIG. 6 is a flowchart for detecting anomalies using the map information generated in the flowchart of FIG. 4 and the trained model generated in the flowchart of FIG. 5.

[0035] First, the detection results detected by the sensor modules 4L, 4R and the cameras 2a, 2c are collected (step S31), and the processing unit 3a estimates the self-position of the container 1 based on the image captured by the camera 2b and the map information stored in the storage unit 3b (step S32). Then, the processing unit 3a judges whether the detection results collected in step S31 are within a normal range based on the trained model for the self-position estimated in step S32 (step S33). If the detection results are not within the normal range (step S33: NO), the processing unit 3a may report the abnormality detection by, for example, an alarm device (not shown), and store the position information of the abnormality detected in the storage unit 3b (step S34). On the other hand, if the detection results are within the normal range (step S33: YES), the processing unit 3a returns to step S31.

[0036] Here, step S33 is judged for each sensor. That is, it is judged whether the detection result for each sensor is within the normal range, and it is determined that the detection results of all sensors are normal if they are within the normal range. Therefore, if the detection result of one sensor is outside the normal range, it is determined that there is an abnormality.

[0037] In this way, for example, the following signs of failure can be detected. However, it is not necessary to identify the following details of the failure in the container 1, as long as it is possible to at least detect the presence of some abnormality at the relevant position. Then, the details of the failure can be identified by another measuring device, by an operator, or the like.

[0038] For example, the detection results of the sound sensor 4a can detect damage to the rollers or shafts of the conveyor device 50, non-transmission of driving force to the carrier rollers, free rotation of the rollers, etc. The detection results of the vibration sensor 4c can detect damage to the rollers or shafts of the conveyor device 50, tilt of the roller surface, non-transmission of driving force to the carrier rollers, free rotation of the rollers, etc. The detection results of the cameras 2a and 2c can detect abnormal heat generation in the power supply of the conveyor device 50, etc.

[0039] Furthermore, by combining the detection results of the sound sensor 4a and the determination results of the vibration sensor 4c, it is possible to detect a failure in the power supply of the conveyor device 50. Furthermore, by combining the detection results of the sound sensor 4a, the detection results of the cameras 2a and 2c, and the determination results of the vibration sensor 4c, it is possible to detect a failure in the motor of the conveyor device 50.

[0040] For example, the detection results of the sound sensor 4a alone can detect the occurrence of any of the following: damage to the rollers or shafts of the conveyor device 50, failure to transmit driving force to the carrier rollers, or rollers spinning freely. By correlating this with the position information based on the self-position estimation results, it is possible to identify where such a failure symptom occurred.

[0041] By the way, the control unit 3 of the container 1 can identify the abnormal part by the above method. However, for example, when the transportation route is displayed as a map and the abnormal part is displayed on the map, the transportation route (map information) created from the information collected by the container 1 may have a lower route recognition accuracy due to the influence of image blur caused by vibration during container transportation, and may deviate from the actual transportation route layout. Therefore, in this embodiment, the map information (actual measurement data) created from the data collected by the container 1 is corrected using a previously prepared transportation route drawing (drawing data), so that a map display that matches the actual transportation route can be made. Note that the actual measurement data described below is the above-mentioned two-dimensional map information.

[0042] 7 shows the functional configuration of a computer 70 as an information processing device that performs the above-mentioned correction process. The computer 70 may be installed near the conveyor device 50, or may be installed in a room separate from the conveyor device. The computer 70 may be a server computer or a personal computer, and may be a desktop type, a notebook type, a tablet type, or the like.

[0043] The computer 70 includes a communication unit 71, a processing unit 72, and a storage unit 73. The communication unit 71 performs wireless communication using a communication method such as Wi-Fi (registered trademark). The communication unit 71 receives abnormal locations and actual measurement data collected by the container 1. In this case, the container 1 also has a communication function. In addition, in FIG. 7, abnormality information (abnormal locations, abnormality details, etc.) and actual measurement data are received by wireless communication, but the information may be obtained by a wired connection using a Universal Serial Bus (USB) or a Local Access Network (LAN) after transportation, or may be obtained via a storage medium such as a memory card.

[0044] The processing unit 72 is formed of, for example, a microprocessor, and performs the above-mentioned correction process of the actual measurement data, etc. The storage unit 73 is formed of, for example, a storage device such as an SSD, and stores various data received by the communication unit 71.

[0045] In this embodiment, first, drawing data showing the transport route is prepared in advance. This drawing data is not based on actual measurement data, but is created from design data used when constructing the transport route. Therefore, the drawing data has accuracy in terms of the angle of curves and the length of straight lines, which will be described later, according to the actual transport route.

[0046] FIG. 8 shows a diagram in which there is a discrepancy between the drawing data and the measured data. In FIG. 8, the solid line indicates the measured data (hereinafter also referred to as tracking data), and the dashed line indicates the drawing data. That is, the measured data also includes information on the shape of the transport path. Symbols t1 to t10 indicate the curve positions on the path in the tracking data, and symbols d1 to d10 indicate the curve positions on the path in the drawing data. Note that symbols t0 and d0 indicate the start point of the path, and symbols t11 and d11 indicate the end point of the path.

[0047] In the drawing data, the curve position is registered as the reference position (registration can be detected and set manually). A curve connects one straight line and a straight line going in a different direction from the first straight line. The curve position may be, for example, the apex position of the curve, but it may also be the start point or end point of the curve. Meanwhile, in tracking data, curves can also be detected by detecting straight lines from a camera image using image recognition or the like. The curve position detected in the tracking data corresponds to the reference position. Since the position recognized as a curve may differ depending on the size of the curve, the curve position in the drawing data and the curve position in the tracking data are determined based on the same judgment criteria (apex position, start point, end point, etc.).

[0048] Due to the influence of the vibrations and the like described above, the tracking data may be acquired with different directions, angles of curves, lengths of straight lines, etc. from the drawing data, as shown in Fig. 8. Therefore, in this embodiment, the curve positions of the drawing data and the tracking data are superimposed, and the straight lines between the curves are corrected by, for example, linearly interpolating the tracking data.

[0049] Specifically, first, the start point t0 is superimposed on d0, and then each curve position is superimposed on the other. For example, the first curve position t1 in the tracking data is superimposed on the first curve position d1 in the corresponding drawing data. The superimposition of each curve position is similarly continued up to the end point. This superimposition is performed so as to match the tracking data to the drawing data. Then, linear interpolation is performed on the straight line portion between the superimposed curve positions of the tracking data. In this manner, the tracking data is corrected.

[0050] The above-mentioned correction operation is summarized in the flowchart of Fig. 9. First, the communication unit 71 acquires drawing data and tracking data (steps S41 and S42). Note that the order of steps S41 and S42 may be reversed. Then, the processing unit 72 performs a superposition process of the curve positions (step S43), and further performs linear interpolation (step S44).

[0051] As is clear from the above description, the communication unit 71 functions as a first acquisition unit that acquires drawing data in which a plurality of reference positions are set on a transport path formed by a transport device, and a second acquisition unit that acquires actual measurement data that is the shape of the transport path obtained by transporting on the transport path. In addition, the processing unit 72 functions as a detection unit that detects the corresponding position of the reference position in the actual measurement data, and a correction unit that superimposes the reference position of the drawing data and the corresponding position of the reference position in the actual measurement data to correct the path between the reference positions in the actual measurement data.

[0052] Figure 10 shows a map that displays abnormal locations based on tracking data after the above-mentioned correction operation has been performed on a transport route based on drawing data. In Figure 10, dashed lines indicate roller conveyors, solid lines indicate belt conveyors, "+" indicates connectors, "□" indicates elevators, "◇" indicates load sensors, "◯" indicates inspection hatches, and "☆" indicates the location of emergency stop switches. Additionally, "×" indicates abnormal locations. The color of abnormal locations may be changed depending on the type of abnormality, such as temperature abnormality, vibration abnormality, or sound abnormality.

[0053] The dashed lines, solid lines, "+", "□", "◇", "◯", and "☆" mentioned above are information related to equipment, and can be registered in advance in the drawing data. "X" is data obtained from tracking data (data obtained from container 1) whose position has been corrected using the correction process described above. As Fig. 10 is based on drawing data, it has a high degree of accuracy as a transport route. Furthermore, as abnormalities have also been corrected using the method described above, the position where the abnormality occurred is displayed with greater accuracy.

[0054] The map shown in Fig. 10 may be displayed alone on a terminal device or the like, but displaying it together with other information makes it easier to identify the cause of the abnormality. Fig. 12 shows an example of a display on the information display device according to this embodiment. Note that in the following explanation, the information display device will be described as a device equipped with a display having a touch panel (such as a tablet terminal or a smartphone), but the monitor screen of a notebook computer or desktop computer may also be used.

[0055] FIG. 11 shows a functional configuration of a tablet terminal 80 as an information display device. The tablet terminal 80 includes a communication unit 81, a processing unit 82, a storage unit 83, and a display unit 84. The communication unit 71 performs wireless communication using a communication method such as Wi-Fi (registered trademark). The communication unit 81 receives data such as data corrected by the computer 70, abnormality information collected by the container 1, and image information captured by the camera 2. The abnormality information includes an abnormal location and the contents of the abnormality (sound abnormality, temperature abnormality, vibration abnormality), etc. The data collected by the container 1 may be received via the computer 70 or directly. In addition, the data may be acquired not only via wireless communication but also via a wired connection such as USB or LAN, or via a storage medium such as a memory card.

[0056] The processing unit 82 is composed of, for example, a microprocessor, and is responsible for the overall control of the above-mentioned tablet terminal 80. The storage unit 83 is composed of, for example, a storage device such as an SSD, and stores various data received by the communication unit 81. The display unit 84 is composed of, for example, a liquid crystal display having a touch panel, and performs various displays and display switching, which will be described later.

[0057] Fig. 12 is a display example of a display unit such as a display of an information display device. In the display example of Fig. 12, the display areas are a timeline 101, a map area 102, and a video area 103, in that order from the left.

[0058] The timeline 101 is a diagram showing the time series (change over time) of abnormality detection status when the container 1 moves along the transfer route. The timeline 101 includes a time display section 101a and an information display section 101b. The time display section 101a shows the movement time from the start point (time progresses from bottom to top in FIG. 12). The information display section 101b displays an abnormal part 101b1 and an absolute movement amount 101b2. The abnormal part 101b1 and the absolute movement amount 101b2 are displayed overlapping each other.

[0059] The abnormal portion 101b1 indicates the time when the abnormality was detected, and corresponds to the abnormal portion described above. It is preferable that the abnormal portion 101b1 is displayed in an easily identifiable manner, such as by filling the abnormal portion in red.

[0060] The absolute movement amount 101b2 is calculated by the processing unit 82 based on the detection value of the acceleration sensor included in the tracking data. Specifically, it is a value calculated by adding up the absolute values ​​of the acceleration of each axis (x, y, z) of a three-axis acceleration sensor. The absolute movement amount calculated in this manner can indicate the magnitude of the vibration applied to the container 1. In other words, it can be said that a large vibration is applied to a location where the absolute movement amount is large.

[0061] In other words, in the tablet terminal 80, the communication unit 81 functions as an acceleration acquisition unit that acquires acceleration information during transportation on the transport path formed by the conveyor device 50, the processing unit 82 functions as a calculation unit and absolute movement amount acquisition unit that calculates an absolute movement amount indicating the magnitude of vibration on the transport path based on the acceleration information, and the display unit 84 displays the absolute movement amount.

[0062] The absolute movement amount may be calculated for each sampling period of the sensor, or may be calculated for multiple sampling periods together. For example, if the sampling period is 1000 Hz, the calculation is performed every millisecond, but it may also be calculated every 100 samples (0.1 seconds). For example, 100 samples may be added together, or one out of every 100 samples may be used for display. Alternatively, it may be the average value of the 100 samples.

[0063] Also, the absolute amount of movement is preferably calculated by adding up the absolute values ​​of the acceleration of each axis (x, y, z) of a three-axis acceleration sensor, but if the acceleration sensor used is two-axis or one-axis, the absolute value of the acceleration for two axes may be added up or the absolute value of the acceleration for one axis may be used. Also, if there are multiple acceleration sensors, the detection values ​​of all the acceleration sensors may be added up or the average value may be used.

[0064] By sliding the area of ​​the timeline 101 to the right, acceleration data 101c for each axis can be displayed as shown in Fig. 13. Note that in addition to acceleration, data (sound, etc.) acquired by the sensor modules 4L and 4R and temperature determined from images captured by the thermal cameras 2a and 2c may also be displayed. Sliding to the left while the acceleration data for each axis is displayed returns to the state shown in Fig. 12.

[0065] The map area 102 displays the map shown in Fig. 10. By sliding the area of ​​the map area 102 to the right, the map can be enlarged and displayed as shown in Fig. 14. Note that although the timeline 101 remains displayed in Fig. 14, the map may be displayed in full screen. By sliding the map to the left in the enlarged display state, it returns to the state shown in Fig. 12.

[0066] Video area 103 displays the video (captured image information) captured by camera 2. In Fig. 12, three videos can be displayed in video area 103. Therefore, for example, the videos from camera 2b, camera 2d, and camera 2e can be displayed simultaneously. In Fig. 12, video 103a is the video from camera 2b, video 103b is the video from camera 2d, and video 103c is the video from camera 2e.

[0067] Furthermore, the time of the video displayed in the video area 103 is displayed on the timeline 101. In Fig. 12, the video displayed in the video area 103 is the time indicating the position of the line indicated by the symbol L on the timeline 101.

[0068] In the video area 103, any video can be enlarged by sliding the area to the left as shown in Fig. 15. Note that the timeline 101 remains displayed in Fig. 15, but the video may be displayed in full screen. Sliding the enlarged video to the right returns it to the state shown in Fig. 12.

[0069] The display example shown in Fig. 12 may be modified as shown in Fig. 16. In the modified example shown in Fig. 16, the display areas are, from the left, a timeline 101, a map area 102, and a video area 103, similar to Fig. 12.

[0070] The timeline 101 includes a time display section 101a and an information display section 101b, similar to Fig. 12. The information display section 101b displays an abnormal section 101b1 and an absolute movement amount 101b2. The abnormal section 101b1 and the absolute movement amount 101b2 are displayed in an overlapping manner.

[0071] In Fig. 16, the abnormal part 101b1 is displayed for each of the left and right cameras 2a and 2c, which are thermo cameras. In Fig. 16, the abnormal part 101b1 indicating a temperature abnormality detected by the left camera 2a is displayed in the area indicated by the reference symbol 101c1, and the abnormal part 101b1 indicating a temperature abnormality detected by the right camera 2c is displayed in the area indicated by the reference symbol 101c2. In this way, it is possible to display on which side the abnormality was detected, making it easier to identify the location of the abnormality.

[0072] 16, jump buttons 101d1 and 101d2 are added. The jump buttons 101d1 and 101d2 are buttons for jumping (transitioning) the position of the line L to the next abnormal part 101b1. The jump button 101d1 jumps to the next abnormal part 101b1 in the upward direction in the figure, and the jump button 101d2 jumps to the next abnormal part 101b1 in the downward direction in the figure.

[0073] 16, scroll buttons 101e1 and 101e2 are added. The scroll buttons 101e1 and 101e2 are buttons for scrolling the timeline 101 in the time axis direction (up and down). The scroll button 101e1 scrolls in the upward direction in the figure, and the scroll button 101e2 scrolls in the downward direction in the figure.

[0074] 16, a temperature display section 101f and a total number of abnormalities 101g are added. The temperature display section 101f displays the temperature values ​​detected by the cameras 2a and 2c, and is displayed corresponding to each abnormal part 101b1. The total number of abnormalities 101g displays the total number of abnormal parts 101b1 detected by the camera 2a and the total number of abnormal parts 101b1 detected by the camera 2c.

[0075] The map area 102 in FIG. 16 is basically the same as in FIG. 12, but a numerical value at the time of the abnormality is displayed next to the abnormality location "X". In the case of "L52" displayed in FIG. 16, this indicates that the abnormality was detected by the left camera 2a, and that the detected temperature was 52°C. Note that this numerical value at the time of the abnormality does not need to be displayed at all abnormality locations "X", but may be displayed only at, for example, one selected location. In the case of one selected location, it is preferable to display the numerical value at the abnormal location by making the "X" larger and thicker than the others (the display color may be changed).

[0076] 16, a location corresponding to line L of timeline 101 is displayed as preview point P. In this way, it becomes possible to link and confirm position and time. Of course, preview point P moves when line L moves, but this preview point P may be always displayed in the center of map area 102. Furthermore, preview point P may be linked to the time of the image displayed in video area 103 (image captured at preview point P is displayed in video area 103).

[0077] The video area 103 in Fig. 16 is basically the same as that in Fig. 12. However, unlike Fig. 12, the video 103b may display the image from camera 2a, and the video 103c may display the image from camera 2c.

[0078] According to the present embodiment described above, the computer 70 acquires, via the communication unit 71, drawing data in which a plurality of curve positions are set on a conveyance path formed by the conveyor device 50, and tracking data which is the shape of the conveyance path obtained by conveying the material on the conveyance path. Then, the processing unit 72 detects the curve position in the tracking data, and corrects the path between the curve positions in the tracking data by superimposing the curve position in the drawing data and the curve position in the tracking data corresponding to the curve position.

[0079] By doing this, the curve position of the drawing data is superimposed on the curve position of the tracking data corresponding to the curve position of the drawing data, and the path between the curve positions in the tracking data is corrected, so that even if there is a deviation between the drawing data, which is the actual layout, and the tracking data, correction can be made, and the accuracy of identifying abnormal areas can be improved.

[0080] In addition, since the curve position is used as the reference position, it is easy to set the reference position. Furthermore, since the reference positions are also linear, linear interpolation is possible, which makes correction processing easy.

[0081] In addition, since the tracking data is obtained by transporting the container 1, which has cameras 2a, 2c and sensor modules 4L, 4R that detect the state of the conveyor device 50, along the transport path, the tracking data can be obtained automatically by transporting the container 1.

[0082] Furthermore, in the tablet terminal 80, the communication unit 81 acquires acceleration information during transport along the transport path constituted by the conveyor device 50, and the processing unit 82 calculates the absolute movement amount based on the acceleration information. Then, the display unit 84 displays the absolute movement amount. In this way, a location with a large absolute movement amount can be determined to be a location where vibrations are large and there is a possibility of a serious malfunction occurring, and can be checked with priority.

[0083] Furthermore, the acceleration information is three-axis acceleration information, and the calculation unit calculates the absolute movement amount by adding up the absolute values ​​of the acceleration of each of the three axes. Therefore, the vibrations applied to the container 1 from each of the directions (up and down, front and back, left and right) can be reflected in the absolute movement amount, and abnormal areas can be detected with greater accuracy.

[0084] Furthermore, since the display unit 84 displays the absolute amount of movement as a change over time, it is possible to identify the point in time at which a large vibration was applied, and thus the location of the abnormality can be quickly identified.

[0085] In addition, the tablet terminal 80 acquires abnormality occurrence information, which is information on the abnormality occurrence location on the conveying route, and the display unit 84 displays the abnormality occurrence information and the absolute movement amount in an overlapping manner, so that it is possible to show the relationship between the abnormality occurrence location and the location of large vibration. In addition, it is also easy to distinguish between abnormalities in the vibration system and abnormalities other than the vibration system.

[0086] The abnormality occurrence information also includes captured image information captured by a camera along the transport path, and the display unit 84 displays a timeline 101 on which the abnormality occurrence information and the absolute movement amount are superimposed, a map area 102 on which the layout of the transport path is displayed, and a video area 103 on which the captured image information is displayed. In this manner, three types of information can be displayed simultaneously. It is also possible to display the timeline, map, and captured image information in a linked manner, making it easier to search for the cause of the abnormality, etc.

[0087] It should be noted that the above-mentioned information display device does not necessarily need to perform the correction process performed by the computer 70, so long as it can obtain data that can be displayed as shown in Fig. 12 and the like. The information display device does not necessarily need to calculate the absolute movement amount, and may obtain an externally calculated amount. In other words, the information display device only needs to obtain at least the absolute correction amount and abnormality information and display them in an overlapping manner.

[0088] The timeline 101 may be displayed in terms of distance instead of time. In this case, the distance from the start point of the path to the abnormal location becomes clear.

[0089] Furthermore, the present invention is not limited to the above-mentioned embodiment. In other words, a person skilled in the art can implement the present invention by modifying it in various ways according to conventional knowledge without departing from the gist of the present invention. As long as the information processing device and information display device of the present invention are still provided even after such modifications, they are of course included in the scope of the present invention. [Explanation of symbols]

[0090] 1 Container (cargo) 2a Camera (status detection section) 2b Camera 2c Camera (status detection section) 2d camera 2e Camera 3. Control Unit 4L Sensor module (status detection section) 4R Sensor module (status detection section) 50 Transport device 70 Computers (information processing devices) 71 Communication unit (first acquisition unit, second acquisition unit) 72 Processing section (detection section, correction section) 80 Tablet terminal (information display device) 81 Communication Department (Acquisition Department) 82 Processing section (calculation section) 84 Display section 101 Timeline (Timeline section) 102 Map Area (Map Section) 103 Video Area (Video Section)

Claims

1. an absolute movement amount acquisition unit that acquires an absolute movement amount indicating a magnitude of vibration on a conveyance path configured by a conveyance device based on acceleration information during conveyance of the conveyance path; an abnormality information acquiring unit that acquires abnormality information that is information regarding an abnormal location on the transport path; a display unit that displays the abnormality information and the absolute movement amount in an overlapping manner, The abnormal location includes a location where a temperature abnormality is detected, a location where a vibration abnormality is detected, and a location where a sound abnormality is detected, The information display device according to the present invention, characterized in that the display unit displays a graph showing the change over time of the absolute movement amount, superimposed with a display showing a time when the abnormality was detected at the abnormal location.

2. an acceleration acquisition unit that acquires the acceleration information; a calculation unit that calculates the absolute movement amount based on the acceleration information; 2. The information display device according to claim 1, further comprising:

3. The acceleration information is three-axis acceleration information, 3. The information display device according to claim 1, wherein the absolute amount of movement is calculated by adding up absolute values ​​of the accelerations of the three axes.

4. 4. The information display device according to claim 1, wherein the display unit displays the absolute movement amount as a change over time.

5. An absolute movement amount acquisition unit that acquires an absolute movement amount indicating a magnitude of vibration on a transport path constituted by a transport device based on acceleration information during transport of the transport path; an abnormality information acquiring unit that acquires abnormality information that is information regarding an abnormal location on the transport path; a display unit that displays the abnormality information and the absolute movement amount in an overlapping manner, The abnormality information also includes image information captured by a camera on the transport path, The information display device is characterized in that the display unit displays a timeline section in which the abnormality information and the absolute movement amount are superimposed, a map section in which a layout of the transport path is displayed, and a video section in which the captured image information is displayed.

Images