Information processing system and information processing method

Abstract

This system provides an information processing system that allows images of objects being transported to be used as information associated with the operation information of a tower crane. [Solution] The system comprises: an operation information acquisition unit that acquires time-series operation information of a tower crane; an image acquisition unit that acquires images of objects being transported by the tower crane as information associated with the operation information; and an analysis unit that outputs analysis results obtained by analyzing the objects included in the images acquired by the image acquisition unit.

Description

[Technical Field]

[0001] The present disclosure relates to an information processing system. [Background Art]

[0002] Patent Document 1 discloses a data collection system that uses a receiving unit that receives identification information of an electronic tag attached to a detected object and a work monitoring camera that photographs the work situation in the vicinity of the hook of a crane hook, and associates the video of the work monitoring camera with the received identification information. [Prior Art Documents] [Patent Documents]

[0003] [Patent Document 1] Japanese Patent No. 5818064 [Summary of the Invention] [Problems to be Solved by the Invention]

[0004] However, in the technology disclosed in Patent Document 1, an image obtained by photographing an object transported by a tower crane cannot be used as information associated with the time-series operation information of the tower crane.

[0005] Therefore, in one aspect, an object of the present invention is to provide an information processing system or the like that can use an image obtained by photographing an object to be transported as information associated with the operation information of a tower crane. [Means for Solving the Problems]

[0006] In one aspect, an operation information acquisition unit that acquires time-series operation information of a tower crane, an image acquisition unit that acquires an image obtained by photographing an object transported by a tower crane as information associated with the operation information, An analysis unit outputs an analysis result obtained by analyzing the object included in the image acquired by the image acquisition unit, An information processing system is provided that includes the following features. [Effects of the Invention]

[0007] In one respect, according to the present invention, images of objects being transported can be used as information associated with the operation information of the tower crane. [Brief explanation of the drawing]

[0008] [Figure 1] This is a diagram showing the configuration of the information processing system in this embodiment. [Figure 2] This is a diagram showing the configuration of a tower crane. [Figure 3] This diagram illustrates the data structure of operational information. [Figure 3A] This diagram illustrates the data structure of event information. [Figure 4] This flowchart illustrates the specific processing steps in the event detection unit. [Modes for carrying out the invention]

[0009] Figure 1 shows the configuration of the information processing system in this embodiment, and Figure 2 shows the configuration of the tower crane.

[0010] As shown in Figure 1, the information processing system 10 of this embodiment includes an operation information acquisition unit 11 that acquires time-series operation information of the tower crane 50 (Figure 2), an image acquisition unit 12 that acquires images of objects being transported by the tower crane 50 as information associated with the operation information, and an analysis unit 13 that outputs analysis results obtained by analyzing the objects included in the images acquired by the image acquisition unit 12.

[0011] In addition, the information processing system 10 of the present embodiment includes an event detection unit 14 that detects events based on analysis results and operation information, a calculation unit 15 that calculates an index related to the operation efficiency of the tower crane 50 based on the events detected by the event detection unit 14, and a storage unit 16 that stores various data. Note that the information processing system 10 can be configured using one or more computers.

[0012] As shown in FIG. 1, the operation information acquisition unit 11 acquires time-series operation information of the tower crane 50 from the control device 5 of the tower crane 50 (FIG. 2). In addition, the operation information acquisition unit 11 can appropriately store the acquired operation information in the storage unit 16.

[0013] FIG. 3 is a diagram illustrating the data configuration of the operation information.

[0014] In the example of FIG. 3, the operation information is composed of a current time, a suspended load weight, a slewing angle, a boom angle, a hook position, a hoisting / lowering speed, etc., which are associated with each other.

[0015] The current time indicates the current time.

[0016] The suspended load weight indicates a measured value of the weight applied to the crane hook 53 and is information corresponding to the weight of the suspended load 60.

[0017] The slewing angle is information indicating the current angle of the boom 52 in the horizontal plane.

[0018] The boom angle is information indicating the current angle of the boom 52 in the vertical direction (up and down direction).

[0019] The hook position is information indicating the current distance (vertical distance) from the tip 52a of the boom 52 to the crane hook 53.

[0020] The hoisting / lowering speed is information indicating the current hoisting speed or lowering speed of the wire 55 to which the crane hook 53 is attached.

[0021] As shown in FIG. 1, the image acquisition unit 12 acquires an image of an object conveyed by the tower crane 50 and other images captured by the camera 20. Further, the image acquisition unit 12 can appropriately store the acquired images in the storage unit 16.

[0022] The camera 20 is installed, for example, near the tip 52a of the jib 52 and captures the periphery of the crane hook 53. Thereby, the suspended load 60 and the surrounding situation can be photographed from above. Further, the camera 20 can be installed, for example, near the column 51 or the driver's seat 54 of the tower crane 50. Thereby, the situation of the suspended load 60 and the surrounding work area 70 can be photographed from an angle other than above. Also, it becomes possible to photograph the situation below the suspended load 60.

[0023] The analysis unit 13 analyzes the object included in the image acquired by the image acquisition unit 12 using artificial intelligence and outputs the analysis result. For example, the analysis unit 13 can analyze and recognize the type, size, shape, etc. of the suspended load 60. In this case, by performing analysis based on images acquired from a plurality of cameras 20 that photograph the suspended load 60 at different angles, the accuracy of the analysis result regarding the suspended load 60 can be improved.

[0024] The event detection unit 14 detects an event based on the analysis result and the operation information. For example, the event detection unit 14 extracts the loading location and unloading location of the suspended load 60 lifted by the tower crane 50 based on the operation information, and specifies the weight, type, etc. of the conveyed suspended load 60, and can output this information as event information. Also, the event information can be stored in the storage unit 16. The calculation unit 15 can calculate an index value (described later) related to the operation efficiency of the tower crane 50 based on the event information stored in the storage unit 16.

[0025] FIG. 3A is a diagram illustrating the data configuration of the event information.

[0026] In the example in Figure 3A, the event information includes the event ID, start time, end time, and event details.

[0027] An event ID is a number or other piece of information that identifies an event.

[0028] The start time is the start time of the event identified by the event ID, and the end time is the end time of the event identified by the event ID. For example, in an event involving the transport of a suspended load 60 from a specific pick-up location to a specific unloading location, the start time may be the time when the suspended load 60 is lifted at the pick-up location, and the end time may be the time when the suspended load 60 is lowered at the unloading location.

[0029] The event details are information that indicates the content of the event identified by the event ID. In the example in Figure 3A, the event details include the type of load to be suspended, the amount of load to be suspended, the specific gravity of the load to be suspended, the start position, and the end position.

[0030] The type of suspended load is information indicating the type of suspended load 60 as analyzed by the analysis unit 13.

[0031] The lifting load is information indicating the weight of the lifted load 60, calculated based on the lifting load amount (Figure 3) included in the operational information.

[0032] The specific gravity of the suspended load is information indicating the specific gravity of the suspended load 60, calculated based on the size and shape of the suspended load 60 analyzed by the analysis unit 13 and the amount of suspended load (Figure 3A).

[0033] The starting position is information (coordinate information) indicating the location where the suspended load 60 is picked up, and the ending position is information (coordinate information) indicating the location where the suspended load 60 is unloaded.

[0034] The definition of an event is arbitrary; for example, the movement (change in posture) of the tower crane while it is not lifting the load 60 can be considered an event. Alternatively, the lifting and lowering processes of the load 60 can be considered separate events.

[0035] The calculation unit 15 calculates, for example, an index value related to the operational efficiency of the tower crane 50 based on the events detected by the event detection unit 14. For example, the calculation unit 15 can calculate the trend of the index value related to the operational efficiency of the tower crane 50 (for example, the trend every 30 minutes) based on the event information stored in the storage unit 16. Examples of index values ​​related to operational efficiency that can be used include the percentage of time the suspended load 60 is suspended, the number of suspended loads 60 that have been suspended, and the average value of the suspended load (Figure 3).

[0036] According to this embodiment, it is possible to improve the efficiency and optimization of lifting operations using tower cranes 50 at construction sites, etc., based on event information and indicators related to operational efficiency. For example, it is possible to optimize the number of tower cranes 50 to be installed at a site, or to formulate an efficient method for installing and operating tower cranes 50, based on event information and indicators related to operational efficiency.

[0037] Next, we will illustrate the specific processing performed by the event detection unit 14.

[0038] Figure 4 is a flowchart illustrating the specific processing steps in the event detection unit.

[0039] In step S102 of Figure 4, the event detection unit 14 determines whether or not the transport of the suspended load 60 has started based on the current operation information acquired from the control device 5 via the operation information acquisition unit 11. After waiting for the determination to be confirmed, the process proceeds to step S104.

[0040] Here, for example, the event detection unit 14 can affirm its decision if the lifting load amount (Figure 3) of the operational information, which had previously been close to zero, increases beyond a predetermined threshold.

[0041] In step S104, the event detection unit 14 acquires current operation information via the operation information acquisition unit 11.

[0042] In step S106, the event detection unit 14 obtains the results of the image analysis of the suspended load 60 performed by the analysis unit 13.

[0043] In step S108, the event detection unit 14 determines whether the transport of the suspended load 60 has been completed based on the current operational information obtained from the control device 5 via the operational information acquisition unit 11. After waiting for the determination to be confirmed, the process proceeds to step S110.

[0044] Here, for example, the event detection unit 14 can affirm its decision when the lifting load amount (Figure 3) of the operational information decreases to a predetermined value close to zero.

[0045] In step S110, the event detection unit 14 acquires current operation information via the operation information acquisition unit 11.

[0046] In step S112, the event detection unit 14 obtains the results of the image analysis of the suspended load 60 performed by the analysis unit 13.

[0047] In step S114, the event detection unit 14 creates event information, stores it in the storage unit 16, and proceeds to step S102.

[0048] Here, the event detection unit 14 creates event information as shown in Figure 3A. For example, the event detection unit 14 issues a new event ID and creates event information where the current time included in the operation information acquired in step S104 is the start time, and the current time included in the operation information acquired in step S110 is the end time.

[0049] Furthermore, the event detection unit 14 generates the event content (Figure 3A) included in the event information.

[0050] Here, for example, the type of suspended load is generated based on the analysis results of the image of the suspended load 60 obtained in step S106 by the analysis unit 13.

[0051] The lifting load is generated, for example, based on the lifting load included in the operational information acquired in step S104.

[0052] The specific gravity of the suspended load is generated, for example, based on the analysis results of the image of the suspended load 60 obtained by the analysis unit 13 in step S106 and the suspended load amount (Figure 3A). In this case, the specific gravity of the suspended load can be calculated based on the volume of the suspended load 60 shown in the analysis results of the image of the suspended load 60 and the suspended load amount (Figure 3A).

[0053] The starting position is calculated, for example, as coordinate information of the suspended load 60 corresponding to the attitude of the tower crane 50 included in the operational information acquired in step S104, i.e., the slewing angle, jib angle, and hook position. Note that line 71 in Figure 2 shows an arc corresponding to the position of the suspended load 60 corresponding to the current jib angle of the tower crane 50.

[0054] The end position is calculated, for example, as coordinate information of the suspended load 60 corresponding to the attitude of the tower crane 50, i.e., the slewing angle, jib angle, and hook position, which are included in the operational information acquired in step S110.

[0055] Furthermore, the analysis results of the image of the suspended load 60 acquired in step S112 may be reflected in the event content of the event information. For example, the state of the suspended load 60 placed at the unloading site, such as the orientation of the steel frame, can be included in the event content. Also, if the unloading site is also a construction site, the construction status can be analyzed and visualized through image analysis.

[0056] As shown in Figure 4, the event detection unit 14 acquires the information necessary to create event information simultaneously with the work corresponding to the event, and creates the event information. Although Figure 4 shows an example of creating event information in parallel with the progress of the work, the event detection unit 14 can also create event information at any time based on the information stored in the storage unit 16. As described above, the event information is stored in the storage unit 16 and used by the calculation unit 15, and can also be used for tracking and analysis. This ensures traceability without requiring manual work, and the analysis results of the stored event information can be used in construction plans, etc.

[0057] As described above, according to this embodiment, the operating status and workload of the tower crane 50 can be automatically grasped and visualized based on the analysis by the analysis unit 13. Furthermore, by introducing artificial intelligence-based image recognition and image analysis, the operating status and workload of the tower crane 50 can be acquired in real time based on images captured by the camera 20. Moreover, by combining the analysis by the analysis unit 13 with the operating information of the tower crane 50, it becomes possible to visualize and analyze the operating status of the tower crane 50.

[0058] For example, while the operational status of the Tower Crane 50 itself is known, it is difficult to obtain specific and accurate information about the lifting operations of the Tower Crane 50, which are directly related to construction site management. Furthermore, construction management personnel had to be present on-site and manually confirm and record the type and quantity of steel frames, exterior materials, etc., lifted each day.

[0059] In contrast, according to this embodiment, in addition to operational data indicating the operating status of the tower crane 50, such as the lifting weight and the amount of movement of the suspended load, the type and shape of the load can be automatically determined using artificial intelligence discrimination technology based on an image taken at the time the load was applied. By combining the discrimination results with the operational data, it becomes possible to visualize the details of the suspended load, as well as the construction site (installation location) and the amount of work, in real time and for each lifting operation, and to confirm and share this information.

[0060] Furthermore, the accumulation of data in the memory unit 16 enables automatic and accurate traceability without the need for manual work. Additionally, analyzing the accumulated data allows for the creation of optimal construction plans for new construction sites, for example.

[0061] As described above, this embodiment includes an operation information acquisition unit 11 that acquires time-series operation information of the tower crane 50, an image acquisition unit 12 that acquires images of objects being transported by the tower crane 50 as information associated with the operation information, and an analysis unit 13 that outputs analysis results obtained by analyzing the objects included in the images acquired by the image acquisition unit 12. Therefore, images of objects being transported can be used as information associated with the operation information of the tower crane 50.

[0062] Although the embodiments have been described in detail above, the invention is not limited to any particular embodiment, and various modifications and changes are possible within the scope of the claims. Furthermore, it is possible to combine all or more of the components of the embodiments described above. [Explanation of Symbols]

[0063] 10 Information Processing Systems 11. Operation Information Acquisition Unit 12 Image acquisition unit 13 Analysis Department 14 Event Detection Unit 15 Calculation Section 16 Memory section

Claims

1. An operation information acquisition unit that acquires time-series operation information of a tower crane, An image acquisition unit that captures images of objects being transported by a tower crane and acquires them as information associated with the aforementioned operational information, An analysis unit outputs an analysis result obtained by analyzing the object included in the image acquired by the image acquisition unit, An information processing system equipped with the following features.

2. The information processing system according to claim 1, further comprising an event detection unit that detects events based on the analysis results and the operational information.

3. The information processing system according to claim 2, wherein the aforementioned event includes a loading or unloading location for the object transported by a tower crane.

4. The information processing system according to claim 1, wherein the analysis results include the type or shape of the object.

5. The operation information acquisition step involves acquiring time-series operation information of the tower crane, Image acquisition step: Obtaining images of an object being transported by a tower crane, An analysis step which outputs an analysis result obtained by analyzing the object contained in the image acquired by the image acquisition step, Equipped with, An information processing method wherein the operational information includes information indicating the position of the object.

Images