Information processing apparatus, information processing method, and program

Abstract

To suitably manage scraps to be conveyed by a conveyance body.SOLUTION: An information processing apparatus (1) comprises: an information acquisition unit (100) for acquiring external appearance information on a scrap heap formed by heaping up scrap groups; and a position specification unit (101) for specifying a position in the scrap heap in which new scrap groups are present based on the external appearance information acquired respectively before and after new scrap groups are piled up on the scrap heap.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present disclosure relates to an information processing device, an information processing method, and a program. [Background technology]

[0002] Patent Document 1 discloses a scrap inventory information management method in which scrap is transported to a scrap yard if there is available space in the scrap yard, and if there is no available space in the scrap yard, the scrap is stored horizontally in an external storage area and then stored in the scrap yard. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2002-68478 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the scrap inventory information management method disclosed in Patent Document 1 does not specify where the scrap accumulated in the scrap yard is located in the scrap pile formed in the scrap yard.

[0005] One aspect of the present disclosure aims to appropriately manage scrap transported by a transporter. [Means for solving the problem]

[0006] In order to solve the above problem, an information processing device according to one embodiment of the present disclosure includes an information acquisition unit that acquires appearance information about the external shape of a scrap pile formed by piling up a group of scrap, which is a group of scrap transported by a carrier, and a position identification unit that identifies the position within the scrap pile where the new scrap group is located based on the appearance information acquired by the information acquisition unit before and after piling up the new scrap group on the scrap pile.

[0007] In order to solve the above-mentioned problems, an information processing method according to one embodiment of the present disclosure is executed by an information processing device capable of acquiring measurement results of the external shape of a scrap pile, acquiring a first external shape of the scrap pile measured before a new group of scrap is piled on the scrap pile, acquiring a second external shape of the scrap pile measured after the new group of scrap is piled on the scrap pile, and identifying the position within the scrap pile where the new group of scrap is located based on the first external shape and the second external shape.

[0008] In order to solve the above problem, an information processing device according to one embodiment of the present disclosure includes an information acquisition unit that acquires a third photographed image taken before transportation and a fourth photographed image taken after transportation of a pile of scraps formed by piling a group of scraps to be transported on a transport body, and a lot management unit that stores lot information for the group of scraps, including at least the third photographed image and the fourth photographed image, in a predetermined memory unit.

[0009] The information processing device according to each aspect of the present disclosure may be realized by a computer. In this case, the information processing device program that causes the computer to operate as each part (software element) of the information processing device to realize the information processing device on the computer, and the computer-readable recording medium on which the program is recorded, also fall within the scope of the present disclosure. [Effects of the Invention]

[0010] According to one aspect of the present disclosure, scrap transported by a transporter can be suitably managed. [Brief explanation of the drawings]

[0011] [Figure 1] FIG. 1 is a diagram showing an example of the flow of scrap until it is recycled. [Figure 2] FIG. 1 is a cross-sectional view showing an example of a scrap pile. [Figure 3] 1 is a diagram illustrating an example of a configuration of an information processing device according to a first embodiment of the present disclosure. [Figure 4] FIG. 1 is a cross-sectional view showing an example of a scrap pile. [Figure 5] 10 is a flow chart illustrating an example of an information processing method performed when piling up a new batch of scrap. [Figure 6] 1 is a flow chart illustrating an example of an information processing method performed when removing a batch of scrap from a scrap pile. [Figure 7] 10 is a flowchart relating to processing by a determination unit. [Figure 8] FIG. 10 is a diagram illustrating an example of lot information. [Figure 9] FIG. 10 is a diagram illustrating an example of notification performed by a notification unit according to the second embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0012] [Embodiment 1] Amid growing global interest in reducing CO2 emissions, the steel industry is focusing on steel recycling, and domestic distribution of scrap is expected to increase. Figure 1 shows an example of the flow of scrap from start to finish until it is recycled. Steel scrap S1 generated at a building demolition site or the like is loaded onto a transporter T1, such as a truck, and transported to a scrap dealer C2. At the scrap dealer C2, the scrap unloaded from the transporter T1 is piled up in a designated scrap yard. The piled scrap forms a scrap pile S2 in the scrap yard of the scrap dealer C2. For example, a lift magnet or heavy machinery is used to unload the scrap from the transporter T1 onto the scrap pile S2.

[0013] Steel scrap includes heavy scrap, which is graded according to thickness, dimensions (width x length or height x length) and unit weight. This scrap may contain impurities (tramp elements) such as copper and tin that are technically difficult to remove.

[0014] Scrap dealer C2 may use processing equipment C20 to perform various processes on scrap collected from dismantler C1 and other parties. For example, scrap dealer C2 cuts the scrap into pieces of a size that can be fed into a melting furnace such as an electric furnace C30. The processed scrap is loaded onto a carrier T2 such as a truck and transported to steel company C3. For example, lift magnets and heavy machinery are used to move the scrap from scrap pile S2 to processing equipment C20, move the processed scrap to scrap pile S3, and load the scrap from scrap pile S3 onto carrier T2.

[0015] At steel company C3, scrap unloaded from carrier T2 is piled up in a designated scrap yard. The piled up scrap forms scrap pile S4 in the scrap yard of steel company C3. For example, a lift magnet or heavy machinery is used to unload the scrap from carrier T2 onto scrap pile S4. At steel company C3, the scrap piled up on scrap pile S4 is melted in a melting furnace such as an electric furnace C30 and used to produce steel products C31. The produced steel products C31 are delivered to consumer C4.

[0016] If the scrap fed into a melting furnace such as an electric furnace C30 contains a large amount of tramp elements, cracks may occur during hot processing, preventing the proper production of steel products C31. To reduce the probability of defects occurring during the manufacturing process of steel products C31, it is preferable to store and manage the scrap unloaded in multiple batches from the carrier T2 in separate containers for each unloading. Alternatively, it is possible to store all of the scrap unloaded from the carrier T2 in a single container. However, such container-based management is not practical due to factors such as the space available in the scrap storage area and the durability of the container. Therefore, scrap unloaded from the carrier T2 is often stored in piles in the scrap storage area.

[0017] Employees of steel company C3 can roughly determine the type and amount of tramp elements contained in the scrap they receive based on the scrap's origin and scrap supplier C2. For example, scrap generated from a source likely to contain a lot of electrical wiring is likely to contain copper. Also, scrap received from scrap supplier C2, which handles scrap collected from a source likely to contain a lot of electrical wiring, is likely to contain copper.

[0018] An information processing device 1 according to an embodiment of the present disclosure is used to manage scrap piled up in a scrap yard of a steel company C3.

[0019] Figure 2 is a cross-sectional view showing an example of a scrap pile. Figure 2 shows an example of scrap pile S4 formed by scrap being piled up in a scrap yard of steel company C3. Hereinafter, a group of scrap that is transported at once by a carrier such as carrier T2 and piled up in a scrap yard or the like will be referred to as a scrap group.

[0020] In Figure 2, for the sake of convenience, the scrap pile is shown in cross section to clearly show the new scrap pile. In Figure 2, a ridge line M1 is shown in dashed lines, indicating the external shape of scrap pile S4 before the new scrap pile is piled up. A ridge line M2 is shown in solid lines, indicating the external shape of scrap pile S4 after the new scrap pile is piled up. The newly piled scrap lot LOT1 exists between ridge line M1 and ridge line M2.

[0021] The scrap yard is provided with a measuring unit 20 that measures the external shape of the scrap pile S4, etc. As mentioned above, in Fig. 2, for the sake of convenience, the external shape of the scrap pile S4 is illustrated in two dimensions, but in reality, the external shape of the scrap pile S4 is acquired as a three-dimensional shape with a predetermined position in the scrap yard as the origin.

[0022] The measuring unit 20 includes, for example, at least one of an imaging unit 21 and a three-dimensional scanner 22. The imaging unit 21 captures an image of the surface of the scrap pile S4. A plurality of imaging units 21 may be installed in the storage area. The three-dimensional scanner 22 scans the external shape of the scrap pile S4 and measures the three-dimensional shape of the scrap pile S4.

[0023] 3 is a diagram illustrating an example of the configuration of an information processing device according to embodiment 1 of the present disclosure. The information processing device 1 according to an embodiment of the present disclosure includes a control unit 10, a storage unit 11, an output unit 12, an input unit 13, and an input interface 14.

[0024] The control unit 10 is configured by a computer having, for example, one or more hardware processors such as a CPU (Central Processing Unit) and one or more memories such as a RAM (Random Access Memory) and a ROM (Read Only Memory), and performs various calculations by executing one or more programs stored in the memory by the one or more hardware processors. The storage unit 11 is, for example, an information recording medium such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive).

[0025] The storage unit 11 of the information processing device 1 stores a database of lot information, which is information about scrap piles piled up in the scrap yard of steel company C3. The lot information includes location information indicating the location of the scrap pile and an identification number. The location information includes, for example, the three-dimensional shape of scrap pile LOT1 in scrap pile S4 and the center coordinates of scrap pile LOT1. The identification information is information for identifying the scrap pile and is an ID determined by any method.

[0026] The scrap lot information also includes information that indicates the characteristics of the scrap, such as the supplier of the scrap, the origin of the scrap, the grade of heavy waste, the type and amount of tramp elements contained in the scrap, and the processing applied to the scrap.

[0027] The information indicating the supplier of the scrap load includes, for example, the company name and factory name of scrap trader C2 that delivered the scrap load to steel company C3, and the name and settings of processing equipment C20 used by scrap trader C2. The information indicating the source of the scrap load includes, for example, information for identifying dismantling trader C1.

[0028] The output unit 12 is, for example, a display or a speaker, and is used to output information under the control of the control unit 10. The input unit 13 is, for example, a keyboard, a mouse, or a touch panel, and is an input device used to input information. The input interface 14 is an interface used to exchange information between the information processing device 1 and the measurement unit 20.

[0029] The control unit 10 of the information processing device 1 executes the programs stored in the storage unit 11 to function as an information acquisition unit 100, a position identification unit 101, a lot management unit 102, and a notification unit 103.

[0030] The information acquisition unit 100 acquires appearance information indicating the external shape of the scrap pile from the measurement unit 20 via the input interface 14. The external shape of the scrap pile is, for example, the three-dimensional shape of the surface of the scrap pile. The information acquisition unit 100 may, for example, acquire measurement results of the three-dimensional shape of the scrap pile S4 from the three-dimensional scanner 22, or may estimate the three-dimensional shape of the scrap pile S4 from captured images acquired from the multiple imaging units 21.

[0031] The position identifying unit 101 identifies the position of the scrap pile in the scrap pile based on the appearance information acquired by the information acquiring unit 100. The position identifying unit 101 receives, for example, appearance information of the scrap pile S4 acquired before and after the new scrap pile LOT1 is piled on the scrap pile S4. The position identifying unit 101 identifies the position of the new scrap pile LOT1 in the scrap pile S4 based on the difference in appearance information before and after the new scrap pile is piled. The information indicating the position of the scrap pile includes, for example, the three-dimensional shape of the scrap pile and the center coordinates of the scrap pile. The three-dimensional shape of the scrap pile is, for example, point cloud data indicating the outer periphery (envelope) of the identified scrap pile.

[0032] On the other hand, when scrap is removed from the scrap pile S4, the position identification unit 101 identifies the location of the removed scrap based on the appearance information of the scrap pile S4 acquired by the information acquisition unit 100. The information indicating the location of the removed scrap includes, for example, the three-dimensional shape of the removed scrap and the identification information of the scrap group that included the removed scrap. For example, when all scrap included in the scrap group LOT1 is removed from the scrap pile S4, the position identification unit 101 identifies the three-dimensional shape of the removed scrap based on the difference between the appearance information of the scrap pile S4 before the scrap was removed and the appearance information of the scrap pile S4 after the scrap was removed. In this case, the identified three-dimensional shape of the removed scrap is the same as the three-dimensional shape of the scrap group LOT1. Furthermore, the position identification unit 101 identifies the identification information of the scrap group that included the removed scrap as the identification information of the scrap group LOT1 based on the position information indicating the location of the scrap group stored in the memory unit 11.

[0033] The lot management unit 102 manages a database of lot information stored in the memory unit 11. The lot management unit 102 stores lot information related to a new scrap group in the memory unit 11 based on the location information of the new scrap group whose location has been identified by the location identification unit 101. For example, as shown by reference numeral 1000 in FIG. 8 , the lot management unit 102 assigns an identification number to the location information of the new scrap group whose location has been identified by the location identification unit 101, and registers the new lot information in the database stored in the memory unit 11. When the lot management unit 102 stores the lot information in the memory unit 11, it may also store information indicating characteristics of the scrap group. The information indicating the characteristics of the scrap group may be obtained from the scrap trader C2 by any method, including verbally, and registered by any method, including input using the input unit 13.

[0034] The notification unit 103 acquires lot information from the database for scrap masses that exist or have existed within a predetermined range of the scrap pile, and issues a notification based on the acquired lot information from the output unit 12. The predetermined range includes the position of the scrap mass identified by the position identification unit 101, a range specified by the user using the input unit 13, etc. Based on the lot information notified by the notification unit 103, the user can adjust the amount of the scrap mass to be put into a melting furnace such as an electric furnace C30.

[0035] The processing of the notification unit 103 will be described using FIG. 4. FIG. 4 is a diagram showing an example of a scrap pile. In FIG. 4, scrap pile S4 is formed by piling up multiple scrap groups LOT2 to LOT8. The notification unit 103 may receive input of a predetermined position P1 using the input unit 13. When a user specifies a position P1 inside scrap pile S4, the notification unit 103 searches for lot information stored in the database, obtains lot information for scrap group LOT2, for which position P1 exists inside the three-dimensional shape included in the lot information, and performs notification based on the lot information for scrap group LOT2. The notification unit 103 may also obtain and provide lot information for scrap groups LOT3, LOT6, LOT7, and LOT8 that exist in the vicinity of scrap group LOT2.

[0036] 5 is a flowchart illustrating an example of an information processing method performed by the information processing device according to the first embodiment of the present disclosure. The information processing method illustrated in FIG. 5 is executed, for example, when a new batch of scrap LOT1 is piled on a scrap pile S4 in a scrap yard of a steel company C3.

[0037] In S100, the control unit 10 functions as the information acquisition unit 100 and acquires appearance information indicating the appearance shape (first appearance shape) of the scrap pile S4 before the new scrap group LOT1 is piled up.

[0038] In the next step S110, the control unit 10 functions as the information acquisition unit 100 and acquires appearance information indicating the appearance shape (second appearance shape) of the scrap pile S4 after the new scrap group LOT1 has been piled up.

[0039] In the next step S120, the control unit 10 functions as the position identification unit 101 and acquires information on the position of the new scrap group LOT1. For example, the control unit 10 acquires the three-dimensional shape and center coordinates of the new scrap group LOT1 based on the difference between the appearance information acquired in step S100 and the appearance information acquired in step S110.

[0040] In the following S130, the control unit 10 acquires information indicating the characteristics of the new scrap group LOT1. The control unit 10 receives, for example, via the input unit 13, input of information indicating the characteristics of the new scrap group LOT1.

[0041] In the following S140, the control unit 10 functions as the lot management unit 102 and stores in the database lot information that associates the information on the location of the new scrap group LOT1 obtained in S120 with information indicating the characteristics of the new scrap group LOT1 obtained in S130.

[0042] 6 is a flowchart illustrating an example of an information processing method performed by the information processing device according to the first embodiment of the present disclosure. The information processing method illustrated in FIG. 6 is executed, for example, when scrap is removed from a scrap pile S4 formed in a scrap yard of a steel company C3.

[0043] In S200, the control unit 10 functions as the information acquisition unit 100 and acquires appearance information indicating the appearance shape of the scrap pile S4 before the scrap is removed. In the following S210, the control unit 10 functions as the information acquisition unit 100 and acquires appearance information indicating the appearance shape of the scrap pile S4 after the scrap is removed. In the following S220, the control unit 10 functions as the position identification unit 101 and identifies the position of the scrap group from which the scrap has been removed. For example, the control unit 10 identifies the position of the scrap group from which the scrap has been removed based on the difference between the appearance information acquired in S200 and the appearance information acquired in S210.

[0044] In the next step S230, the control unit 10 updates the position information of the scrap group included in the lot information for the scrap group whose position was identified in step S220. For example, if some scrap is removed from a scrap group, the shape of the scrap group changes, so it is desirable to update the position information of the scrap group in this manner.

[0045] In the next step S240, the control unit 10 functions as the notification unit 103, and acquires the lot information of the scrap group whose position has been identified in step S220 from the database in the storage unit 11 and notifies the information.

[0046] When scrap is removed from scrap pile S4, scrap may be removed from multiple scrap groups simultaneously. For example, scrap may be removed across scrap groups LOT4 and LOT5 in FIG. 4. In S230, the control unit 10 updates information for all scrap groups from which scrap has been removed. For example, if scrap is removed from scrap groups LOT4 and LOT5, the control unit 10 updates the lot information for scrap groups LOT4 and LOT5. For example, if a portion of LOT4 is removed, the three-dimensional shape of LOT4 is reduced to the portion corresponding to the scrap group remaining in scrap pile S4. In addition, in S240, the control unit 10 notifies the lot information for all scrap groups from which scrap has been removed (in this example, scrap groups LOT4 and LOT5). At this time, the control unit 10 may notify the amount of scrap removed for each scrap group from which scrap has been removed. The notification regarding the amount of scrap removed from each scrap group may also include the mixing ratio of the scrap groups. The mixing ratio of scrap groups can be defined, for example, as the ratio of the volume of scrap from each scrap group to the volume of the removed scrap. In the example described above, it can be calculated as follows. That is, if the volumes of the area where the difference area between the appearance information acquired in S210 and the appearance information acquired in S210 overlap with the three-dimensional shapes of the areas where scrap groups LOT4 and LOT5 exist are V4 and V5, respectively, the mixing ratio of scrap group LOT4 can be expressed as V4 / (V4+V5), and the mixing ratio of scrap group LOT5 can be expressed as V5 / (V4+V5). Note that the definition of the mixing ratio of scrap groups is not limited to the one described here, and it can also be defined based on weight, for example.

[0047] Furthermore, when the removed scrap group is piled on a carrier or in a scrap yard, the lot information for the new scrap group may be stored in the database. The location information for the new scrap group may be acquired using the information acquisition unit 100 described above. It is preferable that the identification information of the new scrap group be different from that of the scrap group from which it was removed. The lot information for the new scrap group may inherit information indicating the characteristics of the scrap group from the scrap group from which it was removed. When scrap is removed from multiple scrap groups from which it was removed, quantifiable information included in the lot information, excluding location information, may be calculated based on the mixing ratio of the multiple scrap groups, and the calculated value may be included in the lot information for the new scrap group.

[0048] [Embodiment 2] Other embodiments of the present disclosure will be described below. For convenience of explanation, the same reference numerals will be used to designate components having the same functions as those described in the above embodiment, and the description thereof will not be repeated.

[0049] In the information processing device 1 according to the second embodiment of the present disclosure, the lot management unit 102 further includes in the lot information a first captured image of the surface of the scrap pile S4 taken by the imaging unit 21 when a new group of scraps LOT1 is piled up on the scrap pile S4.

[0050] Reference numeral 1001 in FIG. 8 is a diagram showing an example of lot information in the information processing device according to the second embodiment. Reference numeral 1001 in FIG. 8 illustrates an example of lot information for scrap group LOT2 shown in FIG. 4. As shown by reference numeral 1001 in FIG. 8, the lot information for scrap group LOT2 in the second embodiment includes at least an identification number, a pile-up date and time, the center coordinates of scrap group LOT2, three-dimensional shape data for scrap group LOT2 or a link to the three-dimensional shape data, and a first captured image or a link to the first captured image. If a lift magnet or the like is reciprocated multiple times when piling up scrap group LOT2, a first captured image may be taken for each reciprocation, and the multiple first captured images may be included in the lot information.

[0051] In the information processing device 1 of embodiment 2, when the notification unit 103 notifies lot information about a group of scraps present at a predetermined position in the scrap pile S4, it outputs the first photographed image included in the lot information to the output unit 12 such as a display.

[0052] 9 is a diagram showing an example of a notification made by the notification unit according to the second embodiment of the present invention. In FIG. 9, an appearance display section 30 showing the appearance of the scrap pile S4, an image display section 31, and an information display section 32 showing lot information are displayed on the output section 12 such as a display.

[0053] A predetermined cursor 33 is superimposed on a cross-sectional view of the external shape of the scrap pile S4 in the appearance display section 30. The position of the cursor 33 can be changed by operating the input section 13.

[0054] The image display section 31 displays the first photographed image of the scrap group present at the position indicated by the cursor 33. In FIG. 9, the scrap group LOT2 is present at the position indicated by the cursor 33, and therefore the first photographed image stored in the lot information of the scrap group LOT2 is displayed on the image display section 31.

[0055] The information display section 32 displays lot information for the scrap group present at the position indicated by the cursor 33. In Fig. 9, the scrap group LOT2 is present at the position indicated by the cursor 33, and therefore information such as the identification number and delivery date and time for the scrap group LOT2 is displayed.

[0056] Because scrap is heavy, scrap piles at the bottom of scrap pile S4 may be crushed by scrap piles above them. If any scrap pile in scrap pile S4 is crushed, the position of each scrap pile in scrap pile S4 will shift from the position where the lot information was stored when the scrap pile was piled. When a scrap pile is removed from scrap pile S4, the notification unit 103 notifies the user of the lot information and displays a first captured image of the scrap pile, allowing the user to determine whether or not there is a positional shift.

[0057] The image display unit 31 may display not only the lot information of the scrap group located at the position indicated by the cursor 33, but also the first captured images of the surrounding scrap groups. For example, the image display unit 31 may further display the first captured images included in the lot information of the scrap groups LOT3 to LOT8 (FIG. 4). If the scrap group LOT2 is not located at the position of the cursor 33 due to a misalignment, the user can determine the type of misalignment by comparing the results of an actual visual inspection of the scrap pile S4 with the first captured images included in the lot information of the scrap groups LOT3 to LOT8. Note that this visual inspection method may involve the worker directly viewing the scrap pile S4 with the naked eye, or the worker may view the scrap pile S4 via the imaging unit 21. As a result, even if a misalignment occurs, it is possible to determine which of the scrap groups LOT2 to LOT8 the scrap being removed from the scrap pile S4 belongs to. This allows employees of steel company C3 to roughly determine the type and content of tramp elements from the lot information of the scrap batch that included the removed scrap, and adjust the amount of scrap batch to be put into a melting furnace such as electric furnace C30.

[0058] [Embodiment 3] In the second embodiment, the user determines whether or not the group of scraps in the scrap pile is misaligned. In the information processing device 1 according to the third embodiment, the control unit 10 functions as a determination unit that determines whether or not the group of scraps in the scrap pile is misaligned.

[0059] FIG. 7 is a flowchart related to the processing of the determination unit. In S300, the control unit 10 of the information processing device 1 acquires the latest first captured image from the database stored in the memory unit 11. Here, the latest first captured image is the first captured image included in the lot information of the scrap group last piled in the scrap pile. In S300, the control unit 10 may acquire the first captured image included in the lot information of the scrap group present at a position designated by the user. For example, the first captured image may be acquired from the lot information of the scrap group LOT2 present at the position of the cursor 33 shown in FIG. 9.

[0060] In the next step S310, the control unit 10 of the information processing device 1 controls the imaging unit 21 to capture an image of the surface of the scrap pile S4 and obtain a second captured image. The timing for executing step S310 is, for example, when the group of scraps for which the first captured image was obtained in step S300 is removed from the scrap pile.

[0061] In the next step S320, the control unit 10 calculates the similarity between the first captured image acquired in S300 and the second captured image acquired in S310. The control unit 10 of the information processing device 1 converts the first captured image and the second captured image into feature quantities by inputting them into an encoder (feature quantity extractor) that converts images into feature quantities, and calculates, for example, the cosine similarity between the feature quantities. A convolutional neural network based on deep learning or a Transformer-type neural network can be used as the encoder.

[0062] As an encoder, for example, a model trained on a large number of general images available in the world, such as the public benchmark dataset ImageNet for image classification, can be applied. Furthermore, such a model can be used as a base for fine-tuning using images taken from scraps, or training can be performed from scratch using random weights as initial values. Self-supervised learning can also be used for training using scrap images. Self-supervised learning is a learning method that teaches a model how to extract image features by increasing the similarity of features between similar images and decreasing the similarity of features between different images. Since images of the same lot taken at different locations, angles, and times should be treated as similar, it is effective to prepare multiple such images from the same lot and then use them for training.

[0063] In the next step S330, the control unit 10 determines whether or not there is a positional displacement of the scrap group in the scrap pile based on the similarity calculated in step S320. For example, if the similarity calculated in step S320 is less than a predetermined threshold, the control unit 10 determines that there is a positional displacement of the scrap group in the scrap pile, and if the similarity calculated in step S320 is equal to or greater than the predetermined threshold, the control unit 10 determines that there is no positional displacement of the scrap group in the scrap pile.

[0064] When notifying the information, the notification unit 103 may calculate a probability representing the likelihood of the information based on the determination result of S330 or the similarity calculated in S320, and notify the user of the calculated probability along with the information. For example, in S300, the control unit 10 acquires the first captured images included in the lot information for each scrap group present within a predetermined distance from the position specified by the user. In S320, the control unit 10 calculates the similarity s between each of the first captured images acquired in S300 and the second captured image. LOT Then, in S320, the control unit 10 calculates the similarity s calculated for each of the first captured images. LOT The sum of s SUMThe notification unit 103 calculates a probability s LOT / s SUM is calculated and notified to the user.

[0065] [Modification] In the first to third embodiments, the database of lot information is stored in the storage unit 11 of the information processing device 1, but it may also be stored in a server provided outside the information processing device 1.

[0066] In the above-described first to third embodiments, the information processing device 1 is installed at the steel company C3. However, the installation location of the information processing device 1 is not limited to the steel company. For example, the information processing device 1 may be installed at the scrap dealer C2 to manage scrap piles S2 and S3 formed in the scrap yard of the scrap dealer C2. Alternatively, the information processing device 1 may be installed at both the steel company C3 and the scrap dealer C2, and information may be transmitted and received between the information processing device 1 of the steel company C3 and the information processing device 1 of the scrap dealer C2. A database of lot information may be stored in an external server, and the lot information may be shared between the information processing device 1 of the steel company C3 and the information processing device 1 of the scrap dealer C2. Alternatively, the information processing device 1 of the scrap dealer C2 may provide information indicating the characteristics of the delivered scrap load to the information processing device 1 of the steel company C3.

[0067] Furthermore, the scrap piles managed by the information processing device 1 are not limited to those formed in scrap yards. For example, the information processing device 1 may manage scrap piles formed by piling up scrap piles on a carrier T2 that transports the scrap piles to the steel company C3. Specifically, the measurement unit 20 may be provided in a work area where the scrap piles to be transported (transported) are piled up on the carrier T2, and the information acquisition unit 100 of the information processing device 1 may acquire a third photographed image of the scrap pile formed on the carrier T2 before transportation. Furthermore, the information acquisition unit 100 of the information processing device 1 may acquire a fourth photographed image of the scrap pile on the carrier T2 after transportation when the carrier T2 arrives at the steel company C3 (the designated destination of the scrap pile). The lot management unit 102 may calculate a similarity between the third photographed image and the fourth photographed image and determine, based on the similarity, whether the scrap piles piled up on the carrier T2 have been properly transported to the steel company C3. Here, cases in which the scrap piled on the transporter T2 has not been properly transported to the steelmaking company C3 include cases in which other scrap piles are mixed into the transporter T2 during transport or in which the contents of the transporter T2 are swapped during transport. The lot management unit 102 may determine that the scrap pile has been properly transported to the steelmaking company C3 when the calculated similarity is equal to or greater than a predetermined threshold, and may further include the third and fourth photographed images when storing lot information for the scrap pile. Furthermore, information indicating the characteristics of the scrap pile in the lot information may include individual identification information for the transporter T2. By further including the third and fourth photographed images of the scrap pile formed on the transporter T2 in the lot information, the traceability of the scrap pile in scrap distribution can be improved. Furthermore, the notification unit 103 may determine that the scrap pile has not been properly transported to the steelmaking company C3 when the similarity calculated by the lot management unit 102 is less than a predetermined threshold, and may notify the steelmaking company C3 that the scrap pile has not been properly transported.

[0068] The information processing device 1 may be an information terminal device such as a tablet terminal, a smartphone, etc. If the information terminal device has an imaging unit, the imaging unit may be used as the measurement unit 20.

[0069] The information processing device 1 is required to include at least an information acquiring unit 100 and a position specifying unit 101. At least one of the lot management unit 102, the notification unit 103, and the determination unit (FIG. 7) may be realized by another information processing device.

[0070] In the third embodiment, the determination unit shown in FIG. 7 determines whether or not the scrap group is misaligned based on the similarity between the most recent first captured image and the most recent second captured image. However, the determination unit is not limited to determining whether or not the scrap group is misaligned. For example, the determination unit may determine whether or not at least a portion of the scrap group is present in the scrap pile. An example of a case in which at least a portion of the scrap group is not present in the scrap pile is when the scrap group is missing from the scrap yard due to theft or an accident.

[0071] [Software implementation example] The functions of the information processing device 1 (hereinafter referred to as the "device") can be realized by a program that causes a computer to function as the device, and a program that causes a computer to function as each control block of the device (particularly each part included in the control unit 10).

[0072] In this case, the device includes a computer having at least one control device (e.g., a processor) and at least one storage device (e.g., a memory) as hardware for executing the program. The control device and storage device execute the program, thereby realizing the functions described in each of the above embodiments.

[0073] The program may be non-transitory and may be recorded on one or more computer-readable recording media. The recording media may or may not be included in the device. In the latter case, the program may be supplied to the device via any wired or wireless transmission medium.

[0074] In addition, some or all of the functions of each of the control blocks can be realized by logic circuits. For example, integrated circuits in which logic circuits that function as each of the control blocks are formed are also included in the scope of the present disclosure. In addition, the functions of each of the control blocks can also be realized by, for example, a quantum computer.

[0075] Furthermore, each process described in each of the above embodiments may be executed by AI (Artificial Intelligence). In this case, the AI ​​may run on the control device or on another device (for example, an edge computer or a cloud server).

[0076] 〔summary〕 The information processing device in aspect 1 of the present disclosure includes an information acquisition unit that acquires appearance information about the external shape of a scrap pile formed by piling up a group of scrap, which is a group of scrap transported by a carrier, and a position identification unit that identifies the position within the scrap pile where the new scrap group is located based on the appearance information acquired by the information acquisition unit before and after piling up the new scrap group on the scrap pile.

[0077] According to the above configuration, it is possible to identify where in the scrap pile a group of scrap pieces transported by a transporter is located, thereby enabling the scrap to be managed appropriately.

[0078] The information processing device in aspect 2 of the present disclosure further includes a lot management unit that, when the position identification unit identifies the position within the scrap pile where the new scrap group is located in aspect 1, stores lot information in a specified memory unit that includes at least position information indicating the position identified by the position identification unit.

[0079] According to the above configuration, the location information indicating the location identified by the location identifying unit is stored, which allows for more appropriate management of the group of scrap piled up in the scrap pile.

[0080] The information processing device in aspect 3 of the present disclosure is in aspect 2, and further includes an alarm unit that acquires the lot information for the group of scrap that exists or was present within a predetermined range of the scrap pile from the memory unit and issues an alarm based on the lot information acquired from the memory unit.

[0081] According to the above configuration, a notification is given based on lot information about scraps present within a predetermined range of the scrap pile, allowing the user to select scraps to be put into a melting furnace such as an electric furnace C30 and adjust the amount of scrap to be put into the melting furnace.

[0082] In the information processing device of aspect 4 of the present disclosure, in aspect 3, the appearance information includes a photographed image of the scrap pile, the lot information further includes a first photographed image which is the photographed image acquired by the information acquisition unit when the new scrap group is piled on the scrap pile, and the notification unit displays the first photographed image included in the lot information acquired from the memory unit.

[0083] According to the above configuration, the notification unit 103 displays the first captured image, thereby allowing the user to determine whether or not a positional deviation has occurred in the scrap pile.

[0084] The information processing device in aspect 5 of the present disclosure, in aspect 4, further includes a judgment unit that calculates the similarity between the first captured image included in the lot information and a second captured image, which is a captured image acquired by the information acquisition unit at the time the scrap group of the lot information is removed from the scrap pile, and determines whether at least a portion of the scrap group of the lot information is present in the scrap pile, and the notification unit notifies the judgment result of the judgment unit.

[0085] According to the above configuration, it is possible to inform the user whether or not a positional deviation has occurred in the scrap pile.

[0086] In the information processing device of aspect 6 of the present disclosure, in any of aspects 3 to 5, the position identification unit identifies a group of scrap from which scrap was removed from the scrap pile based on the appearance information acquired by the information acquisition unit before and after the scrap was removed from the scrap pile, and the notification unit acquires from the memory unit the lot information for the group of scrap that was located at the position where the scrap removed from the scrap pile was located, and issues a notification based on the lot information acquired from the memory unit.

[0087] According to the above configuration, information about the scrap removed from the scrap pile is notified to the user, allowing the user to grasp information about the scrap actually being put into a melting furnace such as an electric furnace C30, and obtain rough information about the amount and type of tramp elements contained in the scrap.

[0088] In the information processing device of aspect 7 of the present disclosure, in aspect 4, the information acquisition unit further acquires a third photographed image of the scrap pile formed by piling the scrap group on the transporting body transporting the scrap group to a specified destination, and a fourth photographed image of the scrap pile formed on the transporting body after it has arrived at the destination, and when the lot management unit stores the lot information for the scrap group transported by the transporting body, it includes the third photographed image and the fourth photographed image in the lot information.

[0089] According to the above configuration, it is possible to improve the traceability of scrap groups in scrap distribution.

[0090] The information acquisition method in aspect 8 of the present disclosure is executed by an information processing device capable of acquiring measurement results of the external shape of a scrap pile, and acquires a first external shape of the scrap pile measured before a new group of scrap is piled on the scrap pile, acquires a second external shape of the scrap pile measured after the new group of scrap is piled on the scrap pile, and identifies the position within the scrap pile where the new group of scrap is located based on the first external shape and the second external shape.

[0091] According to the above configuration, it is possible to identify where in the scrap pile a group of scrap pieces transported by a transporter is located, thereby enabling the scrap to be managed appropriately.

[0092] A program according to a ninth aspect of the present disclosure is a program for causing a computer to function as the information processing device according to the first aspect, and causes the computer to function as the information acquisition unit and the position identification unit.

[0093] The information processing device in aspect 10 of the present disclosure includes an information acquisition unit that acquires a third photographed image taken before transportation and a fourth photographed image taken after transportation of a scrap pile formed by piling a group of scraps to be transported on a transport body, and a lot management unit that stores lot information for the scrap group, including at least the third photographed image and the fourth photographed image, in a predetermined memory unit.

[0094] According to the above configuration, it becomes possible to determine whether a group of scraps transported by a transporter has been transported properly, and the scraps can be managed appropriately.

[0095] The present disclosure is not limited to the above-described embodiments, and various modifications are possible within the scope of the claims. Embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included in the technical scope of the present disclosure. [Explanation of symbols]

[0096] 1. Information processing equipment 10 Control Unit 11 Storage section 100 Information acquisition department 101 Location identification part 102 Lot Management Department 103 Information Department LOT1, LOT2, LOT3, LOT4, LOT5, LOT6, LOT7, LOT8 scrap group S2, S3, S4 scrap pile T1, T2 carriers

Claims

1. an information acquisition unit that acquires appearance information about the appearance shape of a scrap pile formed by piling up a group of scraps that is a group of scraps transported by a transporter; and a position identifying unit that identifies the position within the scrap pile where the new scrap group is located based on the appearance information acquired by the information acquiring unit before and after the new scrap group is piled up on the scrap pile.

2. 2. The information processing device according to claim 1, further comprising a lot management unit that, when the position specifying unit specifies the position within the scrap pile where the new scrap group exists, stores lot information including at least position information indicating the position specified by the position specifying unit in a predetermined storage unit.

3. 3. The information processing device according to claim 2, further comprising: a notification unit that acquires from the storage unit the lot information for the group of scrap that exists or has existed within a predetermined range of the scrap pile, and issues a notification based on the lot information acquired from the storage unit.

4. the appearance information includes a photographed image of the scrap pile; the lot information further includes a first captured image, which is the captured image acquired by the information acquisition unit when the new group of scraps is piled on the scrap pile; The information processing apparatus according to claim 3 , wherein the notification unit displays the first captured image included in the lot information acquired from the storage unit.

5. a determination unit that calculates a similarity between the first photographed image included in the lot information and a second photographed image that is a photographed image acquired by the information acquisition unit at a timing when the scrap group of the lot information is removed from the scrap pile, and determines whether or not at least a part of the scrap group of the lot information is present in the scrap pile; The information processing device according to claim 4 , wherein the notification unit notifies the determination result of the determination unit.

6. the position specifying unit specifies a group of scraps from which scraps have been removed from the scrap pile based on the appearance information acquired by the information acquiring unit before and after the scraps have been removed from the scrap pile; 4. The information processing device according to claim 3, wherein the notification unit acquires from the memory unit the lot information for the group of scrap that was present at a position where the scrap removed from the scrap pile was present, and issues a notification based on the lot information acquired from the memory unit.

7. the information acquisition unit further acquires a third photographed image of the pile of scrap formed by piling up the group of scraps on the carrier transporting the group of scraps to a predetermined destination, and a fourth photographed image of the pile of scrap formed on the carrier that has arrived at the destination; The information processing device according to claim 4 , wherein the lot management unit includes the third photographed image and the fourth photographed image in the lot information when storing the lot information for the group of scrap transported by the transporter.

8. The method is executed by an information processing device capable of acquiring the measurement results of the external shape of the scrap pile, obtaining a first external shape of the scrap pile measured before a new batch of scrap is piled on the scrap pile; obtaining a second external shape of the scrap pile measured after piling the new scrap into the scrap pile; and identifying a position within the scrap pile where the new scrap group exists based on the first external shape and the second external shape.

9. 2. A program for causing a computer to function as the information processing device according to claim 1, the program causing the computer to function as the information acquisition unit and the position identification unit.

10. an information acquisition unit that acquires a third photographed image of a pile of scrap formed by piling up a group of scrap to be transported on a transport body before the pile is transported and a fourth photographed image of the pile of scrap formed by piling up a group of scrap to be transported on a transport body; and a lot management unit that stores lot information including at least the third photographed image and the fourth photographed image for the group of scraps in a predetermined storage unit.

Images