Program, information processor and information processing method
A program using GPS and weighing sensors to track vehicle positions and loads in stockyards addresses the challenge of managing construction soil storage, ensuring efficient use and compliance by calculating storage amounts and alerting authorities to potential issues.
Patent Information
- Application Number
- JP2023223795
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-12-29
- Publication Date
- 2025-07-10
AI Technical Summary
The existing systems fail to effectively manage the storage amount of construction-generated soil in stockyards, leading to inefficiencies and potential overfilling or underutilization.
A program that tracks the position and loading amounts of transport vehicles entering and exiting the stockyard, using GPS and weighing sensors to calculate the storage amount by summing incoming and outgoing loads, and alerts authorities when thresholds are exceeded or conditions warrant additional monitoring.
Enables accurate management of stockyard storage, prevents overfilling, and allows for timely responses to potential issues such as landslides or illegal dumping, ensuring efficient use of storage space and compliance with regulations.
Smart Images

Figure 2025105327000001_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to a program, an information processing apparatus, and an information processing method.
Background Art
[0002] Patent Document 1 discloses a display device disposed at an entrance of a stockyard that temporarily stores an excavation soil group generated by excavation of an excavation planned section.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] However, the invention according to Patent Document 1 has a problem that the storage amount of construction-generated soil stored in the stockyard cannot be managed.
[0005] In one aspect, an object is to provide a program or the like for managing the storage amount of construction-generated soil stored in a stockyard.
Means for Solving the Problems
[0006] A program according to one aspect acquires first position information of a transport vehicle that transports construction-generated soil to a stockyard and a first loading amount of the construction-generated soil measured by the transport vehicle, and acquires second position information of a transport vehicle that transports construction-generated soil from the stockyard to a destination and a second loading amount of the construction-generated soil measured by the transport vehicle, and specifies the amount of stored construction-generated soil in the stockyard based on the first position information and the first loading amount, and the second position information and the second loading amount, acquired from a plurality of transport vehicles.
Effects of the Invention
[0007] On one side, it is possible to appropriately manage the storage amount of construction-generated soil stored in the stockyard.
Brief Description of Drawings
[0008]
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10
Figure 11
Figure 12
Figure 13
Figure 14
Figure 15
Figure 16
Figure 17
Figure 18
Figure 19
Figure 20
Figure 21
Figure 22
Figure 23
Figure 24
Figure 25
Figure 26
Figure 27
Figure 28
Figure 29
Figure 30
Figure 31
Mode for Carrying Out the Invention
[0009] (Embodiment 1) Hereinafter, embodiments of the present invention will be described with reference to the drawings.
[0010] FIG. 1 is an explanatory diagram showing an overview of a construction-generated soil management system according to Embodiment 1. The construction-generated soil management system includes a control device 1 and an information processing device 2. The construction-generated soil management system measures the loading amount of construction-generated soil with a transport vehicle, and based on the measured loading amount, identifies the amount of stored construction-generated soil in the stockyard (hereinafter referred to as the storage amount of the stockyard). The storage amount of the stockyard is, for example, the storage amount of the construction-generated soil stored in the stockyard. The control device 1 and the information processing device 2 transmit and receive information via a network N such as the Internet.
[0011] The control device 1 is mounted on a transport vehicle that transports construction-generated soil. In addition to the control device 1, the transport vehicle is provided with a loading platform. The loading platform is used for loading construction-generated soil. The control device 1 acquires the position information of the transport vehicle, the loading amount measured by the transport vehicle, the date and time information, etc. The position information of the transport vehicle is information that identifies the position of the transport vehicle, such as the address and longitude and latitude. The control device 1 is, for example, a server device, a personal computer, or a general-purpose tablet PC (personal computer, etc.).
[0012] The information processing device 2 is an information processing device that performs processing, storage, and transmission and reception related to the construction-generated soil management system. The information processing device 2 is, for example, a server device, a personal computer, or a general-purpose tablet PC (personal computer, etc.). The information processing device 2 may be a cloud server device that provides the functions included in the information processing device 2 as a cloud service. In the present embodiment, the server 2 is taken as an example for description of the information processing device 2, but it is not limited thereto.
[0013] FIG. 2 is a block diagram for explaining the internal configuration of the control device according to Embodiment 1. The control device 1 includes a control unit 11, a storage unit 12, a communication unit 13, a GPS (Global Positioning System) sensor 14, and a measuring device 15. Each of the above-described units is interconnected via a bus. The control unit 11 is configured using one or more processors such as a CPU (Central Processing Unit), an MPU (Micro-Processing Unit), or a GPU (Graphics Processing Unit). The control unit 11 executes various information processes and control processes performed by the control device 1 by appropriately executing a control program 12P (program product) stored in the storage unit 12. The control unit 11 acquires the position information of the transport vehicle, the load measured by the transport vehicle, and the date and time information, etc. The control unit 11 has a function of a clock that outputs the date and time information.
[0014] The storage unit 12 includes a RAM (Random Access Memory) or a ROM (Read Only Memory), etc. The storage unit 12 stores in advance the control program 12P executed by the control unit 11 and various data necessary for the execution of the control program 12P, etc. The storage unit 12 temporarily stores data, etc., generated when the control unit 11 executes the control program 12P. The communication unit 13 is a communication module that transmits and receives information to and from the server 2 via a network.
[0015] The GPS sensor 14 measures the position information of the transport vehicle at regular time intervals. The measuring device 15 is, for example, a weighing scale attached under the loading platform of the transport vehicle, and measures the load of construction-generated soil at regular time intervals. The communication unit 13 transmits the position information of the transport vehicle and the load of construction-generated soil acquired from the GPS sensor 14 and the measuring device 15 to the server 2 at regular time intervals.
[0016] The control unit 11 may measure the position information of the transport vehicle by a method other than the GPS sensor 14. For example, the control unit 11 may measure the position information of the transport vehicle based on the distance between the transport vehicle and the surrounding mobile phone base stations. The control unit 11 may measure the position information of the transport vehicle based on the beacon signal transmitted from the surrounding Wifi (registered trademark) access points. The control unit 11 may measure the position information of the transport vehicle and the loading amount of the construction-generated soil only at preset points.
[0017] Figure 3 is a block diagram for explaining the internal configuration of the server according to Embodiment 1. The server 2 includes a control unit 21, a storage unit 22, a communication unit 23, a mass storage unit 24, and a reading unit 25. Each of the above-described units is interconnected via a bus. The control unit 21 is configured using one or more processors such as a CPU, MPU, or GPU. The control unit 21 executes various information processes performed by the server 2 by appropriately executing the control program 22P (program product) stored in the storage unit 22. The control unit 21 executes various information processes and control processes related to the server 2 by appropriately executing various data and the like stored in the storage unit 22.
[0018] The storage unit 22 includes a RAM or a ROM or the like. The storage unit 22 stores in advance the control program 22P executed by the control unit 21 and various data and the like necessary for the execution of the control program 22P. The storage unit 22 temporarily stores data and the like generated when the control unit 21 executes the control program 22P. The communication unit 23 is a communication module that transmits and receives information to and from the control device 1 via the network N.
[0019] The mass storage unit 24 includes a RAM or a ROM or the like. The mass storage unit 24 stores the stockyard DB 241, the incoming DB 242, and the outgoing DB 243, which will be described later.
[0020] The reading unit 25 reads information stored in a portable storage medium 2a including a CD (Compact Disc)-ROM, a DVD (Digital Versatile Disc)-ROM, a USB (Universal Serial Bus) memory, an SD (Secure Digital) card, or the like. The control program 22P and various data stored in the storage unit 22 may be read by the control unit 21 from the portable storage medium 2a via the reading unit 25 and stored in the storage unit 22. Further, the control program 22P and various data stored in the storage unit 22 may be downloaded by the control unit 21 from an external device via the communication unit 23 and stored in the storage unit 22.
[0021] In the present embodiment, the storage unit 22 and the mass storage unit 24 may be configured as an integrated storage device. The mass storage unit 24 may be configured by a plurality of storage devices. The mass storage unit 24 may be an external storage device connected to the server 2.
[0022] FIG. 4 is an explanatory diagram showing an example of a record layout of a stockyard DB. A plurality of stockyards are provided. The stockyard DB 241 stores identification information of the stockyard, the storage capacity of the stockyard, and a predetermined threshold value. The identification information of the stockyard is, for example, the name of the stockyard, the location information of the stockyard, and information of an organization that manages the construction-generated soil. The stockyard DB 241 includes a name column, a location information column, a management information column, a storage capacity column, and a threshold value column. The name column stores the name of the stockyard. The location information column stores the location information of the stockyard. The location information of the stockyard is stored by an address and longitude and latitude. The management information column stores the address, telephone number, email address, etc. of an organization that manages the construction-generated soil. The organization that manages the construction-generated soil is, for example, a local government, a prefecture, a municipality, or the like. In the present embodiment, the organization that manages the construction-generated soil is described as a local government. The storage capacity column stores the storage capacity of the stockyard. The threshold value column stores a predetermined threshold value set in advance for each stockyard. The predetermined threshold value is, for example, the upper limit value of the storage capacity of the stockyard.
[0023] FIG. 5 is an explanatory diagram showing an example of the record layout of the incoming DB. The incoming DB 242 stores information transmitted from the control device 1 mounted on a transport vehicle that transports construction-generated soil to the stockyard. The incoming DB 242 includes a transport vehicle ID column, a position information column, a loading capacity column, and a date and time information column. The transport vehicle ID column stores a transport vehicle ID for identifying the transport vehicle. The position information column stores the position information of the transport vehicle. The position information of the transport vehicle is stored by address and longitude / latitude. When the transport vehicle approaches a predetermined position in the destination stockyard, the control unit 21 converts the position information of the transport vehicle into the name of the destination stockyard. The loading capacity column stores the loading capacity of the construction-generated soil. The date and time information column stores the date and time when the loading capacity was measured.
[0024] The incoming DB 242 may store information indicating the origin of the construction-generated soil in association with the transport vehicle ID. The information indicating the origin of the construction-generated soil is, for example, a construction number assigned to each construction site or the position information of the construction site. The information transmitted from the control device 1 may be stored in the incoming DB 242 via an external server.
[0025] The loading capacity of the transport vehicle ID 100A in FIG. 5 changes from 0 to W1 in the process of transporting construction-generated soil to Stockyard A, and changes from W1 to 0 in the process of unloading the construction-generated soil into Stockyard A. That is, the transport vehicle is unloading W1 as the loading capacity of the construction-generated soil into Stockyard A.
[0026] FIG. 6 is an explanatory diagram showing an example of the record layout of the carry-out DB. The carry-out DB 243 stores information transmitted from the control device 1 mounted on the transport vehicle that transports the construction-generated soil from the stockyard to the destination. The carry-out DB 243 includes a transport vehicle ID column, a position information column, a loading amount column, and a date and time information column. The transport vehicle ID column stores the transport vehicle ID for identifying the transport vehicle. The position information column stores the position information of the transport vehicle. The position information of the transport vehicle is stored by address and longitude / latitude. When the transport vehicle approaches a predetermined position in the destination stockyard, the control unit 21 converts the position information of the transport vehicle into the name of the destination stockyard. The loading amount column stores the loading amount of the construction-generated soil. The date and time information column stores the date and time when the loading amount was measured.
[0027] Similar to the carry-in DB 242, the carry-out DB 243 may store information indicating the origin of the construction-generated soil in association with the transport vehicle ID. The information transmitted from the control device 1 may be stored in the carry-out DB 243 via an external server.
[0028] The loading amount of the transport vehicle ID 100D in FIG. 6 changes from 0 to W4 in the process of transporting the construction-generated soil from the stockyard A to the destination, and changes from W4 to 0 in the process of unloading the construction-generated soil at the destination. That is, the transport vehicle unloads W4 as the loading amount of the construction-generated soil from the stockyard A.
[0029] This embodiment describes a procedure for the construction-generated soil management system to specify the storage amount of the stockyard based on the first position information and the first loading amount, and the second position information and the second loading amount acquired from a plurality of transport vehicles. The storage amount of the stockyard is updated, for example, at regular intervals by batch processing. The storage amount of the stockyard may be updated every time the construction-generated soil is carried in and out.
[0030] The communication unit 13 transmits the carrier vehicle ID, the position information of the carrier vehicle, the loading amount of construction-generated soil, and the date and time information to the server 2 at regular time intervals. The communication unit 13 may transmit the carrier vehicle ID, the position information of the carrier vehicle, the loading amount of construction-generated soil, and the date and time information to the server 2 when the carrier vehicle performs a specific operation such as dumping up. When the communication unit 23 receives the carrier vehicle ID, the position information of the carrier vehicle, the loading amount of construction-generated soil, and the date and time information from the communication unit 13, it stores the carrier vehicle ID, the position information of the carrier vehicle, the loading amount of construction-generated soil, and the date and time information in the incoming DB 242 or the outgoing DB 243, and executes the following processing.
[0031] The control unit 21 refers to the stockyard DB 241 and specifies the storage amount C1 from the record including the stockyard A. The control unit 21 refers to the incoming DB 242 and acquires the first position information of the carrier vehicle that transports the construction-generated soil to the stockyard A and the first loading amount of the construction-generated soil measured by the carrier vehicle. The first position information is, for example, the position information when the carrier vehicle transports the construction-generated soil into the stockyard. The first loading amount is, for example, the loading amount of the construction-generated soil when the carrier vehicle transports the construction-generated soil into the stockyard. The control unit 21 acquires the loading amount W1 from the carrier vehicle ID 100A whose first position information is the stockyard A. When another carrier vehicle ID whose first position information is the stockyard A is stored, the control unit 21 acquires the loading amount W2 from the corresponding carrier vehicle ID 100B. The control unit 21 totals the acquired loading amounts W1 and W2.
[0032] The control unit 21 refers to the delivery DB 243 to obtain the second position information of the transport vehicle that transports the construction generated soil from the stockyard to the delivery destination and the second load measured by the transport vehicle. The second position information is, for example, the position information at the time when the transport vehicle carried out the construction generated soil from the stockyard. The second load is, for example, the load of the construction generated soil at the time when the transport vehicle carried out the construction generated soil from the stockyard. The control unit 21 obtains the load W4 from the transport vehicle ID 100D whose second position information is the stockyard A. When other transport vehicle IDs whose second position information is the stockyard A are stored, the control unit 21 obtains the load W5 from the corresponding transport vehicle ID 100E. The control unit 21 sums up the obtained loads W4 and W5.
[0033] Based on the previously updated storage amount of the stockyard, the total of the first loads carried in, and the total of the second loads carried out, the control unit 21 identifies the storage amount of the stockyard. For example, the storage amount of the stockyard A is represented by C1 + (W1 + W2) - (W4 + W5). The control unit 21 updates the storage amount of the stockyard stored in the stockyard DB 241 based on the identified storage amount. The control unit 21 determines whether the update of the storage amount of the stockyard has been completed for other stockyards. When the control unit 21 determines that the update of the storage amount of the stockyard has not been completed for other stockyards, the control unit 21 repeats the same process for other stockyards. When the control unit 21 determines that the update of the storage amount of the stockyard has been completed for other stockyards, the control unit 21 ends the process.
[0034] FIG. 7 is a flowchart showing an example of the processing procedure of the construction generated soil management system according to Embodiment 1. The control unit 21 identifies the storage amount of the stockyard A from the stockyard DB 241 (step S101). The control unit 21 refers to the carry-in DB 242 and acquires the loading amount (first loading amount) from the transport vehicle ID whose position information is the stockyard A (first position information) (step S102). The control unit 21 determines whether or not another transport vehicle ID is stored in the stockyard A (step S103). When the control unit 21 determines that another transport vehicle ID is stored in the stockyard A (step S103: YES), it returns to step S102. When the control unit 21 determines that no other transport vehicle ID is stored in the stockyard A (step S103: NO), it totals the first loading amount of the stockyard A (step S104).
[0035] The control unit 21 refers to the carry-out DB 243 and acquires the loading amount (second loading amount) from the transport vehicle ID whose position information is the stockyard A (second position information) (step S105). The control unit 21 determines whether or not another transport vehicle ID is stored in the stockyard A (step S106). When the control unit 21 determines that another transport vehicle ID is stored in the stockyard A (step S106: YES), it returns to step S105. When the control unit 21 determines that no other transport vehicle ID is stored in the stockyard A (step S106: NO), it totals the second loading amount of the stockyard A (step S107).
[0036] The control unit 21 specifies the storage amount of the stockyard A by using the storage amount specified in step S101, the total first loading amount totaled in step S104, and the total second loading amount totaled in step S107 (step S108). Based on the storage amount specified in step S108, the control unit 21 updates the storage amount of the stockyard A stored in the stockyard DB241 (step S109). The control unit 21 determines whether the update of the storage amount has been completed for other stockyards stored in the stockyard DB241 (step S110). If the control unit 21 determines that the update of the storage amount has not been completed for other stockyards (step S110: NO), the process returns to step S101. If the control unit 21 determines that the update of the storage amount has been completed for other stockyards (step S110: YES), the process ends.
[0037] From Embodiment 1, the construction-generated soil management system can specify the storage amount of the stockyard based on the first position information and the first loading amount obtained from a plurality of transport vehicles, the second position information, and the second loading amount.
[0038] From Embodiment 1, the construction-generated soil management system can specify the storage amount of the stockyard for each stockyard.
[0039] (Embodiment 2) Embodiment 2 will describe a method in which the construction-generated soil management system outputs the identification information of the stockyard and the storage amount of the stockyard to the local government when a predetermined condition is satisfied. Descriptions of parts overlapping with Embodiment 1 will be omitted.
[0040] The predetermined condition is, for example, when the storage amount of the stockyard exceeds a predetermined threshold value and when the measured loading amount of the transport vehicle during the transportation of the construction-generated soil changes, etc. In Embodiment 2, the case where the storage amount of the stockyard exceeds a predetermined threshold value will be described, but it is not limited thereto.
[0041] The control unit 21 reads out the updated storage quantity of the stockyard and a predetermined threshold value from the stockyard DB 241. The control unit 21 determines whether or not the storage quantity of the stockyard exceeds the predetermined threshold value. When the control unit 21 determines that the storage quantity of the stockyard exceeds the predetermined threshold value, it outputs a notification (hereinafter referred to as a response request notification) to the local government requesting a response to the local government. As a method of outputting the identification information of the stockyard, the storage quantity of the stockyard, etc. to the local government, a pre-registered email address of the local government, etc. is used. The response request notification includes the identification information of the corresponding stockyard, the storage quantity of the stockyard, and a message requesting a response from the local government, etc.
[0042] When the control unit 21 determines that the storage quantity of the stockyard does not exceed the predetermined threshold value, it ends the process.
[0043] FIG. 8 is a flowchart showing an example of the processing procedure of the construction-generated soil management system according to Embodiment 2. The control unit 21 reads out the storage quantity of the stockyard and the threshold value from the stockyard DB 241 (step S201). The control unit 21 determines whether or not the read storage quantity exceeds the threshold value (step S202). When the control unit 21 determines that the read storage quantity does not exceed the threshold value (step S202: NO), it ends the process. When the control unit 21 determines that the read storage quantity exceeds the predetermined threshold value (step S202: YES), it outputs a response request notification to the local government (step S203).
[0044] From Embodiment 2, the construction-generated soil management system can output the location information of the stockyard and the storage quantity of the stockyard to the agency in charge of the management of the construction-generated soil when a predetermined condition is satisfied.
[0045] From Embodiment 2, the construction-generated soil management system determines whether or not the storage quantity of the stockyard exceeds a predetermined threshold value, and when it determines that the storage quantity exceeds the predetermined threshold value, it can output the location information of the stockyard and the storage quantity of the stockyard to the agency in charge of the management of the construction-generated soil.
[0046] (Embodiment 3) Embodiment 3 will explain a method by which the construction generated soil management system identifies the storage quantity in the stockyard based on the third loading quantity described in the first receipt and the fourth loading quantity described in the second receipt. Descriptions of parts overlapping with the above-described embodiments will be omitted.
[0047] The first receipt is issued when construction generated soil is carried into the stockyard. The first receipt describes the name of the stockyard, the third loading quantity, and carry-in data such as date and time information. The third loading quantity is, for example, the loading quantity of the construction generated soil carried into the stockyard from the transport vehicle. The second receipt is issued when construction generated soil is carried out of the stockyard to the unloading destination. The second receipt describes the name of the stockyard, the fourth loading quantity, and carry-out data such as date and time information. The fourth loading quantity is, for example, the loading quantity of the construction generated soil carried out from the stockyard to the transport vehicle.
[0048] The first receipt may be issued at a construction site or a construction work site where construction generated soil is carried into the stockyard. The second receipt may be issued at the unloading destination of the construction generated soil.
[0049] In Embodiment 3, the storage quantity of the stockyard calculated based on the first position information and the first loading quantity, and the second position information and the second loading quantity is described as the first storage quantity, and the storage quantity of the stockyard calculated based on the first receipt and the second receipt is described as the second storage quantity.
[0050] FIG. 9 is a block diagram for explaining the internal configuration of the server according to Embodiment 3. The mass storage unit 24 includes a stockyard DB 241, a first receipt DB 244, and a second receipt DB 245. The stockyard DB 241 stores the first storage quantity and the second storage quantity. The first receipt DB 244 stores the carry-in data described in the first receipt. The second receipt DB 245 stores the carry-out data described in the second receipt.
[0051] FIG. 10 is an explanatory diagram showing an example of a record layout of the stockyard DB according to Embodiment 3. The stockyard DB 241 includes a first storage amount column and a second storage amount column. The first storage amount column stores the first storage amount. The second storage amount column stores the second storage amount.
[0052] FIG. 11 is an explanatory diagram showing an example of a record layout of the first receipt certificate DB. The first receipt certificate DB 244 includes a name column, a third loading amount column, and a date and time information column. The name column stores the name of the stockyard. The third loading amount column stores the loading amount of the construction-generated soil carried into the stockyard from the transport vehicle. The date and time information column stores the date and time when the construction-generated soil was carried into the stockyard from the transport vehicle.
[0053] FIG. 12 is an explanatory diagram showing an example of a record layout of the second receipt certificate DB. The second receipt certificate DB 245 includes a name column, a fourth loading amount column, and a date and time information column. The name column stores the name of the stockyard. The fourth loading amount column stores the loading amount of the construction-generated soil carried out from the stockyard to the transport vehicle. The date and time information column stores the date and time when the construction-generated soil was carried out from the stockyard to the transport vehicle.
[0054] A method for specifying the second storage amount by the construction-generated soil management system of the present embodiment based on the third loading amount described in the first receipt certificate and the fourth loading amount described in the second receipt certificate will be described. The second storage amount is updated, for example, at regular intervals by batch processing. The second storage amount may be updated every time the construction-generated soil is carried in and out.
[0055] The first receipt certificate and the second receipt certificate are mailed to the local government. The incoming data stored in the first receipt certificate and the outgoing data described in the second receipt certificate are read by an external reading device. The read incoming data and outgoing data are transmitted to the server 2. The control unit 21 stores the transmitted incoming data and outgoing data in the first receipt certificate DB 244 and the second receipt certificate DB 245.
[0056] The first receipt and the second receipt may be sent by email to the operator who manages the transport vehicle. In that case, the loading data and the unloading data are extracted by the OCR (Optical Character Recognition / Reader) function installed in the operator's smartphone, computer, etc. that manages the transport vehicle. The extracted loading data and unloading data are sent to the server 2. The control unit 21 stores the sent loading data and unloading data in the first receipt DB 244 and the second receipt DB 245, and executes the following processing.
[0057] The control unit 21 identifies the second storage amount S1 from the stockyard DB 241. The control unit 21 refers to the first receipt DB 244 and identifies the third loading amounts Y1 and Y2 from the record including the stockyard A. The control unit 21 sums the identified third loading amounts Y1 and Y2. The control unit 21 refers to the second receipt DB 245 and identifies the fourth loading amounts Y4 and Y5 from the record including the stockyard A. The control unit 21 sums the identified fourth loading amounts Y4 and Y5. The control unit 21 identifies the second storage amount based on the previously updated second storage amount, the totaled third loading amount, and the fourth loading amount. For example, the second storage amount in the stockyard A is represented by S1+(Y1+Y2)―(Y4+Y5). The control unit 21 updates the second storage amount stored in the stockyard DB 241 based on the identified second storage amount.
[0058] The control unit 21 reads the updated second storage amount and a predetermined threshold value from the stockyard DB 241. The control unit 21 determines whether the second storage amount exceeds the predetermined threshold value. When the control unit 21 determines that the second storage amount exceeds the predetermined threshold value, it outputs a corresponding request notice to the local government. The control unit 21 reads the first storage amount and the second storage amount from the stockyard DB 241. Or, when the control unit 21 determines that the second storage amount does not exceed the predetermined threshold value, it reads the first storage amount and the second storage amount from the stockyard DB 241.
[0059] The control unit 21 calculates the difference between the first storage amount and the second storage amount. Specifically, the control unit 21 normalizes the larger of the first storage amount and the second storage amount to be 100. The control unit 21 subtracts the smaller from the larger of the normalized first storage amount and the second storage amount. For example, when the first storage amount and the second storage amount are 2000 and 1800 respectively, the control unit 21 normalizes the first storage amount and the second storage amount to 100 and 90. The control unit 21 calculates the difference (10) between the first storage amount and the second storage amount by subtracting the second storage amount (90) from the first storage amount (100).
[0060] The control unit 21 determines whether the difference between the first storage amount and the second storage amount exceeds a certain standard. When the first storage amount and the second storage amount are significantly different, the control unit 21 can presume that there is a problem with either the GPS sensor 14 and the measuring device 15 used to identify the first storage amount, or the first receipt and the second receipt used to identify the second storage amount. The certain standard is, for example, when the difference between the normalized first storage amount and the second storage amount is 5 or more. The certain standard may be set for each stockyard. The certain standard may be changed according to the usage situation. When the control unit 21 determines that the difference between the first storage amount and the second storage amount is 5 or more, it outputs a notice (hereinafter referred to as an investigation notice) to the local government requesting an investigation. The investigation notice includes the identification information of the corresponding stockyard, the first storage amount, the second storage amount, and a message requesting an investigation from the local government, etc.
[0061] The control unit 21 determines whether a series of processes have been completed for other stockyards. Or, when the control unit 21 determines that the difference between the first storage amount and the second storage amount is less than 5, it determines whether a series of processes have been completed for other stockyards. When the control unit 21 determines that a series of processes have been completed for other stockyards, it ends the process. When the control unit 21 determines that a series of processes have not been completed for other stockyards, it repeats the same process for other stockyards.
[0062] The control unit 21 may compare the first storage amount and the second storage amount by using the ratio between the first storage amount and the second storage amount instead of the difference therebetween.
[0063] FIG. 13 is a flowchart showing an example of a processing procedure of the construction-generated soil management system according to Embodiment 3. The control unit 21 identifies the second storage amount from the stockyard DB 241 (step S301). The control unit 21 identifies the third loading amount from the first receipt certificate DB 244 (step S302). The control unit 21 sums up the third loading amounts identified from the records including the same stockyard (step S303). The control unit 21 identifies the fourth loading amount from the second receipt certificate DB 245 (step S304). The control unit 21 sums up the fourth loading amounts identified from the records including the same stockyard (step S305). The control unit 21 identifies the second storage amount based on the second storage amount identified in step S301, the third loading amount summed up in step S303, and the fourth loading amount summed up in step S305 (step S306). The control unit 21 updates the second storage amount stored in the stockyard DB 241 based on the second storage amount identified in step S306 (step S307).
[0064] The control unit 21 reads out the updated second storage amount and the threshold value from the stockyard DB 241 (step S308). The control unit 21 determines whether or not the second storage amount exceeds the threshold value (step S309). When it is determined that the second storage amount exceeds the threshold value (step S309: YES), the control unit 21 outputs a corresponding request notice to the local government (step S310).
[0065] The control unit 21 reads the first storage quantity and the second storage quantity from the stockyard DB 241 (step S311). Or, when the control unit 21 determines that the second storage quantity does not exceed the threshold value (step S309: NO), the process proceeds to step S311. The control unit 21 calculates the difference between the first storage quantity and the second storage quantity (step S312). The control unit 21 determines whether the difference between the first storage quantity and the second storage quantity is 5 or more (step S313). When the control unit 21 determines that the difference between the first storage quantity and the second storage quantity is 5 or more (step S313: YES), it outputs an investigation notice to the local government (step S314). The control unit 21 determines whether a series of processes has been completed for other stockyards (step S315). Or, when the control unit 21 determines that the difference between the first storage quantity and the second storage quantity is not 5 or more (step S313: NO), the process proceeds to step S315. When the control unit 21 determines that a series of processes has been completed for other stockyards (step S315: YES), it ends the process. When the control unit 21 determines that a series of processes has not been completed for other stockyards (step S315: NO), it returns the process to step S301.
[0066] From Embodiment 3, the construction-generated soil management system can specify the second storage quantity based on the third loading quantity described in the first receipt and the fourth loading quantity described in the second receipt.
[0067] From Embodiment 3, the construction-generated soil management system can manage the storage quantity of the stockyard by collating the first storage quantity and the second storage quantity.
[0068] From Embodiment 3, when the construction-generated soil management system determines that the second storage quantity exceeds a predetermined threshold value, it can output the identification information of the stockyard and the storage quantity of the stockyard to the local government.
[0069] From Embodiment 3, when the construction-generated soil management system determines that the first storage quantity and the second storage quantity are not within a predetermined range, it can output the identification information of the stockyard and the storage quantity of the stockyard to the local government.
[0070] From Embodiment 3, when it is determined that the difference between the first storage amount and the second storage amount is not within a predetermined range, it can be presumed that there is a problem with either the GPS sensor 14 and the measuring device 15, or the first receipt certificate and the second receipt certificate.
[0071] (Embodiment 4) Embodiment 4 will explain a method in which, when the construction-generated soil management system satisfies a predetermined condition, an imaging instruction for the stockyard is output to a drone flying over the stockyard. Descriptions of parts overlapping with the above-described embodiments will be omitted.
[0072] The predetermined condition is, for example, when the storage amount in the stockyard exceeds a predetermined threshold value and when the weather around the stockyard is bad weather. The drone is, for example, an unmanned flying object capable of autonomous flight or flight by radio control.
[0073] FIG. 14 is an explanatory diagram showing an overview of the construction-generated soil management system according to Embodiment 4. The construction-generated soil management system includes a drone 3. The drone 3 flies over the stockyard according to an instruction from the server 2 and acquires an image of the stockyard. The drone 3 transmits an image of the stockyard to the server 2 during flight.
[0074] FIG. 15 is a block diagram for explaining the internal configuration of the drone. The drone 3 includes a control unit 31, a storage unit 32, a communication unit 33, a camera 34, a GPS sensor 35, and a movement mechanism 36. Each of the above-described units is interconnected via a bus. The control unit 31 is configured using one or more processors such as a CPU, MPU, or GPU. The storage unit 32 includes a RAM or a ROM, etc. The control unit 31 executes various information processes performed by the drone 3 by appropriately executing a control program 32P (program product) stored in the storage unit 32. The storage unit 32 stores in advance the control program 32P executed by the control unit 31 and various types of data necessary for the execution of the control program 32P. The storage unit 32 temporarily stores data generated when the control unit 31 executes the control program 32P. The communication unit 33 is a communication module that performs wireless communication with the server 2.
[0075] The camera 34 is an imaging device such as a CCD (Charge Coupled Device) camera, a CMOS (Complementary Metal Oxide Semiconductor) camera, an infrared camera, or a hyperspectral camera, for example. The camera 34 captures an image of the stockyard. The camera 34 is provided to capture the area below during the flight of the drone 3. The image of the stockyard captured by the camera 34 is an aerial photograph that shows the object from an overhead or bird's-eye view. The GPS sensor 35 measures the position information of the drone 3 at regular time intervals. The movement mechanism 36 includes a motor and an amplifier that drive the propellers provided on the drone 3. The movement mechanism 36 controls the driving of the motor and the amplifier based on an instruction from the control unit 31 to fly the drone 3.
[0076] The control unit 31 may obtain information on the terrain and undulations of the stockyard as survey results using a laser beam such as a green laser. In that case, the construction-generated soil management system can use the above-described survey results as one of the monitoring information for the stockyard. Specifically, the control unit 31 obtains the survey result at time point A (hereinafter referred to as survey result A) and the survey result at time point B (hereinafter referred to as survey result B). Time point A and time point B are, for example, the time point before the storage volume of the stockyard exceeds a predetermined threshold and the time point after the storage volume of the stockyard exceeds a predetermined threshold. The survey results A and B are, for example, 3D point cloud data and ortho-images of the stockyard. The control unit 31 transmits the survey results A and B to the server 2 respectively. The control unit 21 receives the survey results A and B transmitted from the drone 3. The control unit 21 obtains the volume change amount of the construction-generated soil stored in the stockyard based on the difference between the survey result A and the survey result B. The control unit 21 estimates the first weight change amount of the construction-generated soil stored in the stockyard based on the obtained volume change amount and the specific gravity of the construction-generated soil. The control unit 21 identifies the stockyard storage volumes at time point A and time point B using the incoming DB 242 and the outgoing DB 243. The control unit 21 obtains the second weight change amount of the construction-generated soil stored in the stockyard by calculating the difference between the stockyard storage volumes at time point A and time point B. The control unit 21 can monitor whether the volume change amount (weight change amount) of the stockyard from time point A to time point B matches the change amount of the stockyard storage volume by comparing the first weight change amount with the second weight change amount.
[0077] Thereby, when the value obtained by subtracting the weight change amount from the storage volume of the stockyard exceeds a predetermined threshold, the control unit 21 can transmit the first monitoring information indicating that the amount of earth and sand in the stockyard is unnaturally small compared to the storage volume to the person in charge of the local government. Further, when the value obtained by subtracting the storage volume of the stockyard from the weight change amount exceeds a predetermined threshold, the control unit 21 can transmit the second monitoring information indicating that the amount of earth and sand in the stockyard is unnaturally large compared to the original storage volume to the person in charge of the local government.
[0078] The control unit 31 may obtain the position information of the drone 3 by methods other than the GPS sensor 35. For example, the control unit 31 may obtain the position information of the drone 3 based on the distance between the drone 3 and the surrounding mobile phone base stations. The control unit 31 may obtain the position information of the drone 3 based on the beacon signal transmitted from the surrounding Wifi (registered trademark) access points. The control unit 31 may obtain the position information of the drone 3 only at preset points.
[0079] First, a method will be described in which when the storage amount in the stockyard exceeds a predetermined threshold, the construction generated soil management system outputs an imaging instruction for the stockyard to a drone flying over the stockyard.
[0080] The control unit 21 specifies the storage amount in the stockyard and the predetermined threshold from the stockyard DB 241. The control unit 21 determines whether the storage amount in the stockyard exceeds the predetermined threshold. When the control unit 21 determines that the storage amount in the stockyard does not exceed the predetermined threshold, the process ends. When the control unit 21 determines that the storage amount in the stockyard exceeds the predetermined threshold, the control unit 21 specifies the position information of the stockyard corresponding to the storage amount from the stockyard DB 241. The control unit 21 transmits the specified position information of the stockyard and the imaging instruction for the stockyard to the drone 3.
[0081] The control unit 31 receives the position information of the stockyard and the imaging instruction for the stockyard transmitted from the server 2. Based on the position information of the stockyard, the control unit 31 flies the drone 3 over the corresponding stockyard. The control unit 31 uses the camera 34 to image the stockyard. The control unit 31 transmits the imaged image of the stockyard to the server 2.
[0082] The control unit 21 receives the image of the stockyard transmitted from the drone 3. The control unit 21 outputs a notification (hereinafter referred to as a status confirmation notification) to the local government to prompt the confirmation of the status of the stockyard. The status confirmation notification includes the identification information of the stockyard, the image of the stockyard, and a message prompting the confirmation of the status of the stockyard, etc.
[0083] The control unit 21 may add information on the terrain and undulations of the stockyard to the status confirmation notification in association with the image of the stockyard.
[0084] Next, a method will be described in which when the weather around the stockyard recovers from bad weather, the construction-generated soil management system outputs an imaging instruction for the stockyard to a drone flying over the stockyard.
[0085] The control unit 21 receives weather information around the stockyard from an external agency at regular time intervals. The weather information includes, for example, clear, cloudy, rainy, heavy rain, storm, heavy snow, and stormy weather, etc. In Embodiment 4, the control unit 21 determines that the weather around the stockyard is fine weather when the weather information received from the external agency is clear, cloudy, or rainy. In Embodiment 4, the control unit 21 determines that the weather around the stockyard is bad weather when the weather information received from the external agency is heavy rain, storm, heavy snow, or stormy weather. Depending on the embodiment, the criteria for fine weather and bad weather may be changed as appropriate.
[0086] The control unit 21 acquires weather information around the stockyard from an external institution. Based on the acquired weather information around the stockyard, the control unit 21 determines whether the weather around the stockyard is bad weather. When the control unit 21 determines that the weather around the stockyard is bad weather, the control unit 21 outputs a notification to the local government to strengthen the monitoring of the stockyard (hereinafter referred to as the monitoring strengthening notification). The monitoring strengthening notification includes the identification information of the stockyard and a message prompting the monitoring of the corresponding stockyard. The control unit 21 acquires the weather information around the stockyard from the external institution again. Based on the acquired weather information around the stockyard, the control unit 21 determines whether the weather around the stockyard is fair weather. When the control unit 21 determines that the weather around the stockyard is fair weather, the control unit 21 transmits the position information of the stockyard and an imaging instruction for the stockyard to the drone 3. The subsequent processing is omitted because it is the same as the processing when the storage amount of the stockyard in Embodiment 3 exceeds a predetermined threshold value.
[0087] When the control unit 21 determines that the weather around the stockyard is not bad weather, the control unit 21 may acquire the weather information around the stockyard from the external institution after a certain period. When the control unit 21 determines that the weather around the stockyard is not fair weather, the control unit 21 may acquire the weather information around the stockyard from the external institution after a certain period.
[0088] FIG. 16 is a flowchart illustrating the case where the storage amount of the stockyard exceeds a predetermined threshold value.
[0089] The control unit 21 specifies the storage amount and the threshold value from the stockyard DB 241 (step S401). The control unit 21 determines whether the storage amount exceeds the threshold value (step S402). When the control unit 21 determines that the storage amount does not exceed the threshold value (step S402: NO), the control unit 21 ends the process. When the control unit 21 determines that the storage amount exceeds the threshold value (step S402: YES), the control unit 21 specifies the position information of the stockyard corresponding to the storage amount from the stockyard DB 241 (step S403). The control unit 21 transmits the specified position information and an imaging instruction for the stockyard to the drone 3 (step S404).
[0090] The control unit 31 receives the position information and imaging instruction transmitted from the server 2 (step S405). Based on the position information of the stockyard, the control unit 31 makes the drone 3 fly over the corresponding stockyard (step S406). The control unit 31 uses the camera 34 to image the stockyard (step S407). The control unit 31 transmits the image of the imaged stockyard to the server 2 (step S408).
[0091] The control unit 21 receives the image of the stockyard transmitted from the drone 3 (step S409). The control unit 21 outputs a situation confirmation notice to the local government (step S410).
[0092] FIG. 17 is a flowchart explaining the case where the weather around the stockyard has recovered from bad weather. In the flowchart shown in FIG. 17, steps S401 to S402 in the process shown in FIG. 16 are replaced with steps S501 to S505. Explanation of steps similar to those in FIG. 16 is omitted.
[0093] The control unit 21 acquires the weather information around the stockyard from an external agency (step S501). Based on the acquired weather information, the control unit 21 determines whether the weather around the stockyard is bad weather (step S502). When the control unit 21 determines that the weather around the stockyard is not bad weather (step S502: NO), the process returns to step S501. When the control unit 21 determines that the weather around the stockyard is bad weather (step S502: YES), the control unit 21 outputs a monitoring reinforcement notice to the local government (step S503). The control unit 21 acquires the weather information around the stockyard from the external agency again (step S504). Based on the acquired weather information, the control unit 21 determines whether the weather around the stockyard is fine weather (step S505). When the control unit 21 determines that the weather around the stockyard is not fine weather (step S505: NO), the process returns to step S504. When the control unit 21 determines that the weather around the stockyard is fine weather (step S505: YES), the process proceeds to step S403.
[0094] From Embodiment 4, when the construction-generated soil management system satisfies predetermined conditions, it can output an imaging instruction for the stockyard to a drone that flies over the stockyard and images the stockyard.
[0095] From Embodiment 4, when the construction-generated soil management system determines that the storage volume of the stockyard exceeds a predetermined threshold, it can output an imaging instruction for the stockyard to a drone that flies over the stockyard and images the stockyard.
[0096] From Embodiment 4, when the construction-generated soil management system determines that the weather around the stockyard is bad weather, after the weather around the stockyard recovers, it can output an imaging instruction for the stockyard to a drone that images the stockyard.
[0097] From Embodiment 4, by utilizing the image of the stockyard acquired from the drone, the construction-generated soil management system can discover precursors such as landslides occurring after bad weather.
[0098] (Embodiment 5) Embodiment 5 describes a method by which the construction-generated soil management system acquires information regarding the presence or absence of prohibited objects using a learning model. Descriptions of parts overlapping with the above-described embodiments are omitted.
[0099] FIG. 18 is a block diagram for explaining the internal configuration of the control device according to Embodiment 5. The control device 1 includes a camera 16. The camera 16 is an imaging device such as, for example, a CCD camera, a CMOS camera, an infrared camera, or a hyperspectral camera. The camera 16 images the load carried on the loading platform of the transport vehicle. The camera 16 may be configured to be externally connected to the control device 1 and capable of imaging the load.
[0100] FIG. 19 is a block diagram for explaining the internal configuration of the server according to Embodiment 5. The mass storage unit 24 includes a prohibited object output model 246 and a loaded object training data DB 247. The prohibited object output model 246 is an estimator (output device) that outputs information regarding the presence or absence of a prohibited object based on an image of a loaded object. The prohibited object is, for example, industrial waste that cannot be carried into a stockyard such as rubble, concrete, and plastic. The information regarding the presence or absence of a prohibited object is, for example, a probability value that the loaded object is a prohibited object and a probability value that the loaded object is not a prohibited object, a ratio of the prohibited object included in the loaded object, a type of the prohibited object included in the loaded object, or a segmentation image that specifies a region of the prohibited object in the image of the loaded object. In the present embodiment, an example in which a probability value that the loaded object is a prohibited object and a probability value that the loaded object is not a prohibited object are used as the information regarding the presence or absence of a prohibited object will be described, but the present invention is not limited thereto. The prohibited object output model 246 is a learned model generated by machine learning. The loaded object training data DB 247 stores training data for configuring the prohibited object output model 246.
[0101] The prohibited object output model 246 may be stored in the control device 1. Further, the prohibited object output model 246 may be stored in an external server connected to the control device 1 and the server 2.
[0102] FIG. 20 is an explanatory diagram showing an example of a record layout of the loaded object training data DB. The loaded object training data DB 247 includes a loaded object column and a determination column. The loaded object column stores an image of the loaded object loaded on the loading platform of the transport vehicle. The image of the loaded object includes an image of construction-generated soil that does not contain a prohibited object and images of prohibited objects such as rubble, concrete, and plastic. The determination column stores information indicating whether the image of the loaded object is a prohibited object. In the example of FIG. 20, an image of "construction-generated soil" as input data and "not a prohibited object" as output data are stored in association with each other.
[0103] FIG. 21 is an explanatory diagram regarding the prohibited object output model. FIG. 21 conceptually illustrates a process of generating the prohibited object output model 246. Based on FIG. 21, the process of generating the prohibited object output model 246 will be described.
[0104] The control unit 21 constructs, as the prohibited object output model 246, a neural network that performs deep learning to learn the feature amounts of the loaded objects in the image of the loaded objects, inputs the image of the loaded objects, and outputs a probability value that the loaded object is a prohibited object and a probability value that the loaded object is not a prohibited object. The neural network is, for example, a CNN (Convolution Neural Network). The neural network includes an input layer that receives the input of the pixel values of each pixel included in the image of the loaded objects, an output layer that outputs a probability value that the loaded object is a prohibited object and a probability value that the loaded object is not a prohibited object, and an intermediate layer that extracts the feature amounts of the image of the loaded objects.
[0105] The input layer has a plurality of nodes that receive the input of the pixel values of each pixel included in the image of the loaded objects, and passes the input pixel values to the intermediate layer. The intermediate layer has a plurality of nodes that extract the feature amounts of the image of the loaded objects, and passes the extracted feature amounts to the output layer. For example, when the prohibited object output model 246 is a CNN, the intermediate layer has a configuration in which a convolution layer that convolves the pixel values of each pixel input from the input layer and a pooling layer that maps the pixel values convolved by the convolution layer are alternately connected, and finally extracts the feature amounts of the image of the loaded objects while compressing the pixel information included in the image of the loaded objects. The output layer has one or a plurality of nodes that output information regarding the presence or absence of a prohibited object, and outputs a probability value that the loaded object is a prohibited object and a probability value that the loaded object is not a prohibited object based on the feature amounts of the image of the loaded objects output from the intermediate layer. The values output from each node of the output layer are, for example, values from 0 to 1. The sum of the probability values output from each output node is 1.0 (100%).
[0106] In Embodiment 5, the prohibited object output model 246 will be described as a CNN, but it is not limited to this. The prohibited object output model 246 may use any object detection algorithm such as RCNN (Regions with Convolutional Neural Network), Fast RCNN, Faster RCNN, SDD (Single Shot Multibook Detector), YOLO (You Only Look Once), SVM (Support Vector Machine), Bayesian network, Transformer network, regression tree, or U-Net (U-Shaped Network) instead of the CNN.
[0107] The control unit 21 performs learning using the training data in which the image of the loaded object stored in the loaded object training data DB 247 is associated with the information indicating whether the loaded object is a prohibited object. Specifically, the control unit 21 inputs the image of the loaded object to the input layer, and after performing arithmetic processing in the intermediate layer, outputs from the output layer the probability value that the loaded object is a prohibited object and the probability value that the loaded object is not a prohibited object. The output layer includes, for example, a sigmoid function or a softmax function, and outputs the probability value that the loaded object is a prohibited object and the probability value that the loaded object is not a prohibited object based on the feature amount output from the intermediate layer.
[0108] In the example of FIG. 21, when the image of the loaded object is input to the prohibited object output model 246, the probability value that it is a prohibited object and the probability value that the loaded object is not a prohibited object are 0.95 and 0.05. The control unit 21 acquires the higher of the two probability values output from the output layer as the estimation result. In the example of FIG. 21, the control unit 21 outputs "is a prohibited object" as the estimation result among "is a prohibited object" or "is not a prohibited object".
[0109] The control unit 21 may output the estimation result using a predetermined threshold value. In that case, when the probability value of "is a prohibited object", which is 0.95, is equal to or higher than a predetermined threshold value (for example, 0.8), the control unit 21 outputs "is a prohibited object" as the estimation result.
[0110] The control unit 21 compares the estimation result output from the output layer with the information indicating whether the load, which is labeled in the image of the load as training data, is an object to be prohibited, that is, the correct value. When the image of the load included in the training data is input to the prohibited object output model 246, the control unit 21 learns so that the output value from the node corresponding to the correct value included in the training data approaches 1 and the output values from the other output nodes approach 0. The control unit 21 optimizes the parameters used for the arithmetic processing in the intermediate layer so that the output value from the output layer approaches the correct value. The parameters are, for example, the weights (coupling coefficients) of the nodes or the coefficients of the activation functions used in each node, etc. The optimization method used for the parameters is not particularly limited, but the control unit 21 optimizes various parameters using, for example, the error backpropagation method.
[0111] The control unit 21 performs the above processing on the images of the loads included in the training data to generate the prohibited object output model 246. The control unit 21 stores the generated prohibited object output model 246 in the mass storage unit 24.
[0112] The process of generating the above-described prohibited object output model 246 may be performed by an external server or the like. In that case, the prohibited object output model 246 generated by an external server or the like is downloaded from the external server or the like to the server 2 through the network N.
[0113] The control unit 21 determines whether the current position of the transport vehicle is around the stockyard. Whether the current position of the transport vehicle is around the stockyard is determined based on the distance between two points, namely, the position information of the transport vehicle and the position information of the stockyard. For example, when the distance between two points, namely, the position information of the transport vehicle and the position information of the stockyard, is not within several kilometers, the control unit 21 determines that the current position of the transport vehicle is not around the stockyard. When the control unit 21 determines that the current position of the transport vehicle is not around the stockyard, it conducts the determination again after a certain period. On the other hand, when the distance between two points, namely, the position information of the transport vehicle and the position information of the stockyard, is within several kilometers, the control unit 21 determines that the current position of the transport vehicle is around the stockyard. When the control unit 21 determines that the current position of the transport vehicle is around the stockyard, it transmits an imaging instruction for the load carried on the loading platform of the transport vehicle to the control device 1.
[0114] The control unit 11 receives the imaging instruction of the load transmitted from the server 2. The control unit 11 uses the camera 16 to image the load carried on the loading platform of the transport vehicle. The control unit 11 transmits the image of the imaged load to the server 2.
[0115] The control unit 21 receives the image of the load transmitted from the control device. The control unit 21 inputs the image of the load into the prohibited object output model 246. The control unit 21 obtains an estimation result indicating whether the load is a prohibited object based on the output value from the prohibited object output model 246. Specifically, the control unit 21 obtains the higher of the two probability values output from the output layer as the estimation result. The control unit 21 determines whether the load is a prohibited object based on the estimation result of the prohibited object output model 246. When the control unit 21 determines that the load is not a prohibited object, it ends the process. When the control unit 21 determines that the load is a prohibited object, it outputs a notice to the management company of the transport vehicle indicating that the load contains a prohibited object. The notice indicating that the load contains a prohibited object includes the transport vehicle ID, date and time information, the image of the load, the loading amount of the construction-generated soil, and a message requesting the stop of the load-in.
[0116] The timing at which the control unit 21 transmits an imaging instruction to the control device 1 is not limited to the case where it is determined that the current position of the transport vehicle is around the stockyard. For example, when the transport vehicle loads construction-generated soil onto the loading platform, the control unit 21 may transmit an imaging instruction to the control device 1.
[0117] The control unit 21 may output a notification to the local government indicating that the loaded item contains a prohibited object. The control unit 21 may output a notification to the management company of the transport vehicle and the local government indicating that the loaded item contains a prohibited object.
[0118] FIG. 22 is a flowchart showing a generation procedure of a prohibited object output model. The control unit 21 acquires training data from the loaded item training data DB 247 (step S601). The control unit 21 generates a prohibited object output model 246 that takes the image of the loaded item as an input and outputs the type of the loaded item, using the acquired training data (step S602). The control unit 21 stores the generated prohibited object output model 246 in the mass storage unit 24 (step S603).
[0119] FIG. 23 is a flowchart showing an example of a processing procedure of the construction-generated soil management system according to Embodiment 5. The control unit 21 determines whether the position of the transport vehicle is within several kilometers from the stockyard (step S701). When it is determined that the position of the transport vehicle is not within several kilometers from the stockyard (step S701: NO), the control unit 21 returns the process to step S701. When it is determined that the position of the transport vehicle is within several kilometers from the stockyard (step S701: YES), the control unit 21 transmits an imaging instruction for the loaded item loaded on the loading platform of the transport vehicle to the control device 1 (step S702).
[0120] The control unit 11 receives the imaging instruction transmitted from the server 2 (step S703). The control unit 11 images the loaded item loaded on the loading platform of the transport vehicle using the camera 16 (step S704). The control unit 11 transmits the image of the imaged loaded item to the server 2 (step S705).
[0121] The control unit 21 receives the image transmitted from the control device (step S706). The control unit 21 inputs the received image to the prohibited object output model 246 (step S707). The control unit 21 obtains an estimation result indicating whether the loaded object is a prohibited object based on the output value from the prohibited object output model 246 (step S708). The control unit 21 determines whether the loaded object is a prohibited object based on the obtained estimation result (step S709). When it is determined that the loaded object is a prohibited object (step S709: YES), the control unit 21 outputs a notification to the management company of the transport vehicle indicating that the loaded object contains a prohibited object (step S710). When it is determined that the loaded object is not a prohibited object (step S709: NO), the control unit 21 ends the process.
[0122] From Embodiment 5, the construction-generated soil management system can estimate whether the loaded object is a prohibited object by inputting an image of the loaded object into the learning model.
[0123] From Embodiment 5, the construction-generated soil management system can output a notification to the management company of the transport vehicle indicating that the loaded object contains a prohibited object based on the estimation result of the learning model.
[0124] From Embodiment 5, the construction-generated soil management system can prevent the entry of prohibited objects into the stockyard by outputting a notification to the management company of the transport vehicle indicating that the loaded object contains a prohibited object.
[0125] (Embodiment 6) Embodiment 6 describes a method by which the construction-generated soil management system uses a learning model to obtain information regarding the presence or absence of construction-generated soil from an out-of-area image (hereinafter referred to as an out-of-area image) outside the area of the stockyard. Descriptions of parts overlapping with the above-described embodiments are omitted.
[0126] FIG. 24 is a block diagram for explaining the internal configuration of the server according to Embodiment 6. The mass storage unit 24 includes a construction-generated soil determination model 248 and a construction-generated soil training data DB 249. The construction-generated soil determination model 248 is an estimator (output device) that outputs information regarding the presence or absence of construction-generated soil based on an out-of-area image. The area outside the stockyard is, for example, an area around the stockyard within several tens to several hundreds of meters from the boundary line of the stockyard. The out-of-area image is acquired by a drone. The information regarding the presence or absence of construction-generated soil is, for example, a probability value indicating the inclusion of construction-generated soil and a probability value indicating the non-inclusion of construction-generated soil, or a segmentation image that specifies the area containing construction-generated soil in the out-of-area image. The construction-generated soil determination model 248 is a learned model generated by machine learning. The construction-generated soil training data DB 249 stores training data for constructing the construction-generated soil determination model 248.
[0127] The construction-generated soil determination model 248 may be stored in the control device 1. Further, the construction-generated soil determination model 248 may be stored in an external server connected to the control device 1 and the server 2.
[0128] A method for acquiring an out-of-area image from a captured image around the stockyard will be described.
[0129] FIG. 25 is an explanatory diagram showing an example of a photographed image around the stockyard. The photographed image around the stockyard taken by the drone includes the stockyard, the area outside the stockyard, and other areas. In FIG. 25, the stockyard is an area surrounded by a solid line near the center within the photographed image around the stockyard. The stockyard is specified by the position information of the stockyard stored in the large-capacity storage unit 24 or map data, etc. The area outside the stockyard is an area around the stockyard within several tens to several hundreds of meters from the boundary line of the stockyard. The area outside the stockyard is specified by estimating the distance from the number of pixels in the photographed image around the stockyard. The other areas are the areas in the photographed image around the stockyard excluding the stockyard and the area outside the stockyard.
[0130] FIG. 26 is an explanatory diagram showing an example of a photographed image in which the stockyard and other areas are masked. In FIG. 26, the masked stockyard and other areas are indicated by hatching. The control unit 21 masks the stockyard and other areas specified from the photographed image around the stockyard shown in FIG. 25. In the subsequent processing, the image shown in FIG. 26 is treated as an image outside the area.
[0131] Although FIG. 25 represents the stockyard, the area outside the stockyard, and other areas in a rectangular shape, the shapes of the stockyard, the area outside the stockyard, and other areas are not limited to this. Although an image showing the entire stockyard is used in FIG. 25, it is not limited to this. An image showing a part of the stockyard may also be used. The control unit 21 may obtain the image outside the area shown in FIG. 26 by edge detection or the like.
[0132] FIG. 27 is an explanatory diagram showing an example of a record layout of a construction-generated soil training data DB. The construction-generated soil training data DB 249 includes an out-of-area image column and a determination column. The out-of-area image column stores out-of-area images. The out-of-area images include an image of the construction-generated soil being carried into an area outside the stockyard and an image of the construction-generated soil not being carried into an area outside the stockyard. The determination column stores information indicating whether or not the construction-generated soil is included. As an example of the data stored in the construction-generated soil training data DB 249, an image of the "state where the construction-generated soil is carried into an area outside the stockyard", which is the input data, and "including the construction-generated soil", which is the output data, are stored in association with each other.
[0133] FIG. 28 is an explanatory diagram regarding a construction-generated soil determination model. In FIG. 28, a process of generating a construction-generated soil determination model 248 is conceptually illustrated. Based on FIG. 28, the process of generating the construction-generated soil determination model 248 will be described.
[0134] The control unit 21 constructs, as the construction-generated soil determination model 248, a neural network that performs deep learning to learn the feature amounts of out-of-area images, inputs out-of-area images, and outputs a probability value indicating that the construction-generated soil is included and a probability value indicating that the construction-generated soil is not included. The neural network is, for example, a CNN. The neural network includes an input layer that receives out-of-area images, an output layer that outputs a probability value indicating that the construction-generated soil is included and a probability value indicating that the construction-generated soil is not included, and an intermediate layer that extracts the feature amounts of out-of-area images.
[0135] The input layer has a plurality of nodes that receive the input of the pixel values of each pixel included in the off-area image, and passes the input pixel values to the intermediate layer. The intermediate layer has a plurality of nodes that extract the feature amounts of the off-area image, and passes the extracted feature amounts to the output layer. For example, when the construction-generated soil determination model 248 is a CNN, the intermediate layer has a configuration in which a convolutional layer that convolves the pixel values of each pixel input from the input layer and a pooling layer that maps the pixel values convolved by the convolutional layer are alternately connected, and finally extracts the feature amounts of the off-area image while compressing the pixel information included in the off-area image. The output layer has one or a plurality of nodes that output information indicating whether or not construction-generated soil is included, and outputs a probability value that construction-generated soil is included and a probability value that construction-generated soil is not included based on the feature amounts of the off-area image output from the intermediate layer. The values output from each node of the output layer are, for example, values between 0 and 1. The sum of the probability values output from each output node is 1.0 (100%).
[0136] The construction-generated soil determination model 248 may use any object detection algorithm such as RCNN, Fast RCNN, Faster RCNN, SDD, YOLO, SVM, Bayesian network, transformer network, regression tree, or U-Net.
[0137] The control unit 21 performs learning using training data in which an off-area image and information indicating whether or not construction-generated soil is included are associated. Specifically, the control unit 21 inputs the off-area image to the input layer, and through the arithmetic processing in the intermediate layer, outputs a probability value that construction-generated soil is included and a probability value that construction-generated soil is not included. The output layer includes, for example, a sigmoid function or a softmax function, and outputs a probability value that construction-generated soil is included and a probability value that construction-generated soil is not included based on the feature amounts output from the intermediate layer.
[0138] In the example of FIG. 28, when an out-of-area image is input to the construction-generated soil determination model 248, probability values of 0.91 and 0.09 are output as the probability value that construction-generated soil is included and the probability value that construction-generated soil is not included, respectively. The control unit 21 obtains the higher probability value as the estimation result from the two output probability values. In the example of FIG. 28, the control unit 21 outputs "construction-generated soil is included" as the estimation result among "construction-generated soil is included" or "construction-generated soil is not included".
[0139] The control unit 21 may output the estimation result using a predetermined threshold value. In that case, when the probability value of 0.91, which is the probability value that "construction-generated soil is included", is equal to or greater than a predetermined threshold value (for example, 0.8), the control unit 21 outputs "construction-generated soil is included" as the estimation result.
[0140] The control unit 21 compares the estimation result based on the probability value output from the output layer with information indicating whether or not the construction-generated soil included in the out-of-area image as training data, that is, the correct value. When the out-of-area image included in the training data is input to the construction-generated soil determination model 248, the control unit 21 learns so that the output value from the node corresponding to the correct value included in the training data approaches 1 and the output values from the other output nodes approach 0. The control unit 21 optimizes the parameters used for the arithmetic processing in the intermediate layer so that the output value from the output layer approaches the correct value. The method of optimizing the parameters is the same as that in Embodiment 5, so the description is omitted.
[0141] The control unit 21 performs the above processing on the out-of-area images included in the training data to generate the construction-generated soil determination model 248. The control unit 21 stores the generated construction-generated soil determination model 248 in the mass storage unit 24.
[0142] The process of generating the above-described construction-generated soil determination model 248 may be performed by an external server or the like. In that case, the construction-generated soil determination model 248 generated by an external server or the like is downloaded from the external server or the like to the server 2 through the network N.
[0143] The control unit 21 identifies the location information of the stockyard from the stockyard DB 241. The control unit 21 transmits the location information of the stockyard and the imaging instruction outside the area of the stockyard to the drone 3.
[0144] The control unit 31 receives the location information of the stockyard and the imaging instruction outside the area of the stockyard transmitted from the server 2. Based on the location information of the stockyard, the control unit 31 makes the drone 3 fly over the sky around the corresponding stockyard. The control unit 31 uses the camera 34 to image the area outside the stockyard. The control unit 31 transmits the off - area image to the server 2.
[0145] The control unit 21 receives the off - area image transmitted from the drone 3. The control unit 21 performs masking processing on the stockyard and other areas included in the received off - area image. Through the masking process, an image as shown in FIG. 26 is generated. The control unit 21 inputs the masked off - area image into the construction - generated soil determination model 248. Based on the output value from the construction - generated soil determination model 248, the control unit 21 obtains an estimation result indicating whether construction - generated soil is included. Specifically, the control unit 21 obtains the higher of the two output probability values as the estimation result. Based on the estimation result of the construction - generated soil determination model 248, the control unit 21 determines whether construction - generated soil is included. When the control unit 21 determines that construction - generated soil is included, it outputs a notice to the local government indicating that construction - generated soil has been carried into the area outside the stockyard. The notice that construction - generated soil has been carried into the area outside the stockyard includes the identification information of the stockyard, the off - area image, and a message prompting confirmation of the area outside the stockyard, etc. When the control unit 21 determines that construction - generated soil is not included, it ends the process.
[0146] In Embodiment 6, the construction-generated soil determination model 248 will be described as being a CNN, but it is not limited to this. The construction-generated soil determination model 248 may use an AE (Auto Encoder). In that case, the control unit 21 inputs, to the auto encoder, an out-of-area image in a state where construction-generated soil has not been carried into the area around the stockyard among the images used as training data in the CNN. The control unit 21 can generate the construction-generated soil determination model 248 based on the feature amounts extracted from the auto encoder in the process of regenerating the input out-of-area image. When the generated construction-generated soil determination model 248 receives an out-of-area image as input, it outputs a regenerated out-of-area image based on the feature amounts extracted from the auto encoder. The control unit 21 acquires the regenerated out-of-area image from the out-of-area image using the generated construction-generated soil determination model 248. The control unit 21 calculates the difference between the out-of-area image and the regenerated out-of-area image. The control unit 21 determines whether or not the calculated difference is equal to or less than a predetermined threshold value. The predetermined threshold value is, for example, a value obtained by averaging the differences between a plurality of out-of-area images used as training data and a plurality of out-of-area images regenerated corresponding to the out-of-area images. When the control unit 21 determines that the calculated difference is equal to or less than the predetermined threshold value, it determines that construction-generated soil has not been carried into the area outside the stockyard. When the control unit 21 determines that the calculated difference is not equal to or less than the predetermined threshold value, it determines that construction-generated soil has been carried into the area outside the stockyard.
[0147] FIG. 29 is a flowchart showing the generation process of the construction-generated soil determination model. The control unit 21 acquires training data from the construction-generated soil training data DB 249 (step S801). The control unit 21 generates a construction-generated soil determination model 248 that takes an out-of-area image as input and outputs a probability value indicating the inclusion of construction-generated soil and a probability value indicating the non-inclusion of construction-generated soil, using the acquired training data (step S802). The control unit 21 stores the generated construction-generated soil determination model 248 in the mass storage unit 24 (step S803).
[0148] FIG. 30 is a flowchart showing an example of the processing procedure of the construction-generated soil management system according to Embodiment 6. FIG. 30 is a flowchart explaining the case where a CNN is used for generating the construction-generated soil determination model 248. The control unit 21 identifies the position information of the stockyard from the stockyard DB 241 (step S901). The control unit 21 transmits the identified position information and an imaging instruction outside the area of the stockyard (step S902).
[0149] The control unit 31 receives the position information and the imaging instruction transmitted from the server 2 (step S903). Based on the position information of the stockyard, the control unit 31 causes the drone 3 to fly above the vicinity of the corresponding stockyard (step S904). The control unit 31 uses the camera 34 to image the area outside the stockyard (step S905). The control unit 31 transmits the imaged outside-area image to the server 2 (step S906).
[0150] The control unit 21 receives the outside-area image transmitted from the drone 3 (step S907). The control unit 21 performs masking processing on the stockyard and other areas included in the received outside-area image (step S908). The control unit 21 inputs the masked outside-area image into the construction-generated soil determination model 248 (step S909). The control unit 21 obtains an estimation result indicating whether or not construction-generated soil is included based on the output value from the construction-generated soil determination model 248 (step S910). The control unit 21 determines whether or not construction-generated soil is included based on the estimation result of the construction-generated soil determination model 248 (step S911). When it is determined that construction-generated soil is included (step S911: YES), the control unit 21 outputs a notification to the local government that construction-generated soil has been carried into the area outside the stockyard (step S912). When it is determined that construction-generated soil is not included (step S911: NO), the control unit 21 ends the process.
[0151] (Modification example) FIG. 31 is a flowchart showing an example of the processing procedure of the construction-generated soil management system according to Embodiment 6. FIG. 31 is a flowchart explaining the case where an autoencoder is used for generating the construction-generated soil determination model 248. In the flowchart shown in FIG. 31, in the processing shown in FIG. 30, steps S909 to S912 are replaced with steps S1001 to S1007. Explanation of steps similar to those in FIG. 30 is omitted. The control unit 21 inputs the out-of-area image subjected to the masking process into the construction-generated soil determination model 248 (step S1001). The control unit 21 acquires the out-of-area image regenerated from the construction-generated soil determination model 248 (step S1002). The control unit 21 calculates the difference between the out-of-area image and the regenerated out-of-area image (step S1003). The control unit 21 determines whether the calculated difference is equal to or less than a predetermined threshold value (step S1004). When the control unit 21 determines that the calculated difference is equal to or less than the predetermined threshold value (step S1004: YES), it determines that the construction-generated soil has not been carried into the area outside the stockyard (step S1005). When the control unit 21 determines that the calculated difference is not equal to or less than the predetermined threshold value (step S1004: NO), it determines that the construction-generated soil has been carried into the area outside the stockyard (step S1006). The control unit 21 outputs a notification to the local government indicating that the construction-generated soil has been carried into the area outside the stockyard (step S1007).
[0152] From Embodiment 6, the construction-generated soil management system can estimate whether the construction-generated soil is included outside the area of the stockyard using the learning model.
[0153] From Embodiment 6, the construction-generated soil management system can output a notification to the local government indicating that the construction-generated soil has been carried into the area outside the stockyard based on the estimation result by the learning model.
[0154] From Embodiment 6, the construction-generated soil management system can quickly respond to the illegal dumping of the construction-generated soil by outputting a notification to the local government indicating that the construction-generated soil has been carried into the area outside the stockyard.
[0155] The matters described in each of the above embodiments can be combined with each other. Also, the independent claims and dependent claims described in the claims can be combined with each other in all possible combinations regardless of the citation form. Furthermore, the claims use a form (multi-claim form) of describing claims that cite two or more other claims, but it is not limited to this. A form of describing a multi-claim (multi-multi-claim) that cites at least one multi-claim may be used.
[0156] The embodiments disclosed this time should be considered as illustrative in all respects and not restrictive. The scope of the present invention is shown not by the above meaning but by the claims, and it is intended that all changes within the meaning and scope equivalent to the claims are included.
Explanation of Signs
[0157] 1 Control device 11 Control unit 12 Storage unit 12P Control program 13 Communication unit 14 GPS sensor 15 Measuring device 16 Camera 2 Information processing device (server) 21 Control unit 22 Storage unit 22P Control program 23 Communication unit 24 Mass storage unit 25 Reading unit 241 Stockyard DB 242 Inward DB 243 Outward DB 244 First receipt certificate DB 245 Second receipt certificate DB 246 Prohibited object output model 247 Load training data DB 248 Construction-generated soil determination model 249 Construction-generated soil training data DB 3 Drone 31 Control unit 32 Memory unit 32P Control program 33 Communication unit 34 Camera 35 GPS sensor 36 Moving mechanism 2a Portable storage medium
Claims
1. To obtain the first position information of a transport vehicle that transports construction-generated soil to a stockyard and the first loading amount of the construction-generated soil measured by the transport vehicle, To obtain the second position information of a transport vehicle that transports construction-generated soil from the stockyard to a destination and the second loading amount of the construction-generated soil measured by the transport vehicle, Based on the first position information and the first loading amount, and the second position information and the second loading amount obtained from a plurality of transport vehicles, to specify the amount of stored construction-generated soil in the stockyard A program for causing a computer to execute the process.
2. A plurality of the stockyards are provided, The program according to claim 1, wherein the amount of stored construction-generated soil is specified for each stockyard. The program according to claim 1.
3. When a predetermined condition is satisfied, to output the identification information of the stockyard and the amount of stored construction-generated soil to an agency that governs the management of the construction-generated soil The program according to claim 1.
4. To determine whether the amount of stored construction-generated soil exceeds a predetermined threshold value, When it is determined that the threshold value is exceeded, to output the identification information and the amount of stored construction-generated soil to an agency that governs the management of the construction-generated soil The program according to claim 3.
5. To obtain the third loading amount described in a first receipt issued when transporting the construction-generated soil to the stockyard, To obtain the fourth loading amount described in a second receipt issued when transporting the construction-generated soil from the stockyard to the destination, Based on the third loading amount and the fourth loading amount obtained from a plurality of first receipts and second receipts, to specify the amount of stored construction-generated soil The program according to claim 1.
6. To obtain an image of the load carried on the transport vehicle, When an image of the load is input, to input the obtained image of the load to a learning model that outputs information regarding the presence or absence of prohibited objects for which entry into the stockyard is prohibited, and to output information regarding the presence or absence of the prohibited objects The program according to claim 1.
7. To determine whether the amount of stored construction-generated soil exceeds the threshold value, When it is determined that the threshold value is exceeded, to output an imaging instruction for the stockyard to a drone that flies over the stockyard and images the stockyard The program according to claim 4.
8. When the specified conditions are satisfied, an imaging instruction for the stockyard is output to a drone that flies over the stockyard and images the stockyard. The program according to claim 1.
9. Determine whether the weather around the stockyard is bad weather, When it is determined that the weather is bad weather, after the weather around the stockyard has recovered, the imaging instruction is output to the drone. The program according to claim 8.
10. An out-of-area image outside the area of the stockyard is acquired by the drone, When an out-of-area image is input, the acquired out-of-area image is input to a learning model that outputs information regarding the presence or absence of construction-generated soil, and information regarding the presence or absence of construction-generated soil is output. The program according to any one of claims 7 to 9.
11. An information processing apparatus including a control unit, The control unit, acquires first position information of a transport vehicle that transports construction-generated soil to the stockyard and a first loading amount of the construction-generated soil measured by the transport vehicle, acquires second position information of a transport vehicle that transports construction-generated soil from the stockyard to a destination and a second loading amount of the construction-generated soil measured by the transport vehicle, specifies the amount of stored construction-generated soil in the stockyard based on the first position information and the first loading amount, and the second position information and the second loading amount, acquired from a plurality of transport vehicles. Information processing apparatus.
12. Acquire the first position information of the transport vehicle that transports construction-generated soil to the stockyard and the first loading amount of the construction-generated soil measured by the transport vehicle, acquire the second position information of the transport vehicle that transports construction-generated soil from the stockyard to the destination and the second loading amount of the construction-generated soil measured by the transport vehicle, Specify the amount of stored construction-generated soil in the stockyard based on the first position information and the first loading amount, and the second position information and the second loading amount, acquired from a plurality of transport vehicles. Information processing method.
Citation Information
Patent Citations
Travel detector of recording medium
JP1984031456A