Waste accommodation condition information recording device, method and program

The waste storage state information recording device addresses the issue of obscured waste storage by recording and updating waste states using detection and imaging, enabling accurate recognition and automated waste management.

JP2024170165APending Publication Date: 2024-12-06KOBELCO ECO SOLUTIONS CO LTD

Patent Information

Application Number
JP2023087180
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-26
Publication Date
2024-12-06

AI Technical Summary

Technical Problem

The agitation of waste in storage units can cause overlapping and obscuring of waste, making it difficult to accurately assess the storage state from above, and potentially leading to unstirred waste.

Method used

A waste storage state information recording device that includes a storage state storage section, a detection state acquisition unit, and an update unit to record and update the storage state of waste at predetermined timings, using height measurement, imaging, and identification to determine the three-dimensional position and type of waste, and track movement and exposure.

Benefits of technology

Enables accurate recognition of waste storage state even when waste overlaps, allowing for automated selection of stirring targets and proper waste management.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024170165000001_ABST
    Figure 2024170165000001_ABST
Patent Text Reader

Abstract

To provide a waste accommodation condition information recording device, the method, and the program that can appropriately recognize the accommodation condition of waste even when the accommodation condition of waste is detected from above.SOLUTION: A waste accommodation condition information recording device 1000 according to the present invention comprises an accommodation state storage unit 61 that stores the accommodation state of waste accommodated in an accommodation part, a detection accommodation state acquisition unit 1 that acquires the accommodation state of the waste at a predetermined detection timing, and an accommodation state update unit 25 that compares the accommodation state of the waste stored in the accommodation state storage unit 61 with the accommodation state of the waste acquired in the detection accommodation state acquisition unit 1, updates the accommodation state of the waste stored in the accommodation state storage unit 61 according to the result of the comparison, and stores the updated accommodation state of the waste in the accommodation state storage unit 61.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a waste storage state information recording device, a waste storage state information recording method, and a waste storage state information recording program for recording the storage state of waste stored in a storage unit. [Background technology]

[0002] Waste that is deemed useless or unnecessary by its owner and discarded as garbage is generally burned in an incinerator for incineration. When burning this waste, the waste is stirred so as to homogenize it in order to achieve stable combustion in the incinerator. For example, Patent Document 1 discloses a device for mixing such waste.

[0003] The waste mixing state evaluation device disclosed in Patent Document 1 includes an acquisition unit that acquires an image of the waste stored in a storage unit, an identification and extraction unit that identifies and extracts the occupied area of ​​the waste for each type of waste in the image, and an evaluation unit that evaluates the mixing state of the waste stored in the storage unit based on each occupied area for each type of waste extracted by the identification and extraction unit. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent Publication No. 2021-117867 Summary of the Invention [Problem to be solved by the invention]

[0005] However, the waste stored in the storage unit is stirred as described above as necessary, but because the stirring causes the waste to be picked up from one location and dropped to another location, or the waste is dropped by the input of a delivery vehicle, the dropped waste piles up on top of the waste in the location where it was dropped, and the waste in the location where it was dropped becomes buried and cannot be seen from above. In particular, if the waste in the location where it was dropped has not been stirred, there is a risk that the waste in the location where it was dropped will not be stirred.

[0006] The present invention has been made in consideration of the above-mentioned circumstances, and its object is to provide a waste storage status information recording device, a waste storage status information recording method, and a waste storage status information recording program that can properly recognize the waste storage status even when the waste storage status is detected from above. [Means for solving the problem]

[0007] As a result of various investigations, the inventors have found that the above object can be achieved by the present invention described below. That is, a waste storage state information recording device according to one aspect of the present invention comprises a waste storage state storage unit that stores the storage state of waste stored in a storage unit, a detected storage state acquisition unit that acquires the storage state of the waste at a predetermined detection timing, and a storage state update unit that compares the storage state of the waste stored in the waste storage state storage unit with the storage state of the waste acquired by the detected storage state acquisition unit, updates the storage state of the waste stored in the waste storage state storage unit according to a result of the comparison, and stores the updated storage state of the waste in the waste storage state storage unit. Preferably, in the above-mentioned waste storage state information recording device, the detected storage state acquisition unit is an interface that is connected to a storage state detection unit that detects the storage state of the waste at a predetermined detection timing and acquires the storage state of the waste at the predetermined detection timing from the storage state detection unit. Preferably, in the above-mentioned waste storage state information recording device, the detected storage state acquisition unit is a storage state detection unit that detects the storage state of the waste at the predetermined detection timing.

[0008] Such a waste storage status information recording device stores the waste storage status in a storage status memory unit and updates it with the waste storage status obtained at a specified detection timing. Therefore, even if waste overlaps, the storage status before the overlapping can be recorded. Therefore, by referring to the memory contents of the storage status memory unit, the waste storage status can be properly recognized even when the waste storage status is detected from above.

[0009] In another aspect, in the waste storage state information recording device described above, the storage state of the waste is represented by at least the three-dimensional position of the waste and the type of the waste.

[0010] Such a waste storage status information recording device can record the storage status of waste by type of waste.

[0011] In another aspect, in the waste storage state information recording device, the waste storage state storage section further stores information on whether or not the waste has been moved.

[0012] Such a waste storage status information recording device stores whether or not the waste has been moved, so that by referring to the contents stored in the storage status memory unit, it is possible to recognize whether or not movement has been carried out and to appropriately select the object to be stirred.

[0013] In another aspect, in the above-mentioned waste storage status information recording device, the waste storage status memory unit further stores whether or not the surface of the waste stored in the storage unit is exposed to the waste.

[0014] Such a waste storage status information recording device stores whether or not the waste is exposed, and therefore by referring to the contents stored in the storage status memory unit, it is possible to recognize whether or not the waste is exposed, in other words, whether or not the waste is buried in layers.

[0015] In another aspect, in these above-mentioned waste storage state information recording devices, the storage state of the waste is represented at least by the three-dimensional position of the waste and the type of the waste, and the detection and storage state acquisition unit includes a height measuring unit that measures the height of the waste stored in the storage unit within the storage unit, an imaging unit that generates an image of the waste stored in the storage unit within the storage unit, an identification and extraction unit that identifies and extracts the waste occupation area for each type of waste in the waste image generated by the imaging unit, and a waste position calculation unit that determines the three-dimensional position of the occupation area as the three-dimensional position of the waste for each waste occupation area extracted by the identification and extraction unit based on the height measured by the height measuring unit and the image of the waste generated by the imaging unit.

[0016] Such a waste storage status information recording device identifies and extracts the waste occupation area for each type of waste, and for each waste occupation area, determines the three-dimensional position of the occupation area as the three-dimensional position of the waste, so that the waste storage status can be recorded for each waste occupation area.

[0017] In another aspect, in the waste storage state information recording device, the storage state update section resets the storage state of the waste stored in the storage state memory section at a predetermined reset timing.

[0018] Such a waste storage state information recording device can start storing (recording) from the waste storage state at a predetermined reset timing. For example, by setting the predetermined reset timing to the start of work, the waste storage state from the start of work can be recognized by referring to the memory contents of the storage state memory unit, and the waste can be appropriately mixed.

[0019] In another aspect, the waste storage state information recording device described above further comprises an agitation target selection unit that selects an agitation target based on the storage state of the waste stored in the storage state memory unit.

[0020] Since such a waste accommodation state information recording device includes an agitation object selection section, the selection of the agitation object can be automated.

[0021] A waste storage status information recording method according to another aspect of the present invention comprises a storage process for storing the storage status of waste stored in a storage section in a waste storage status memory section; a detection storage status acquisition process for acquiring the storage status of the waste at a predetermined detection timing; and a storage status update process for comparing the waste storage status stored in the waste storage status memory section with the waste storage status acquired in the detection storage status acquisition process, updating the waste storage status stored in the waste storage status memory section according to the result of the comparison, and storing the updated waste storage status in the waste storage status memory section.

[0022] This type of waste storage status information recording method stores the waste storage status in a storage status memory unit and updates it with the waste storage status obtained at a specified detection timing. Therefore, even if waste overlaps, the storage status before the overlapping can be recorded. Therefore, by referring to the memory contents of the storage status memory unit, the waste storage status can be properly recognized even when the waste storage status is detected from above.

[0023] A waste storage state information recording program according to another aspect of the present invention is a program for causing a computer to function as any one of the waste storage state information recording devices described above.

[0024] According to this, a waste storage state information recording program can be provided, and this waste storage state information recording program has the same operational effects as those of the above-mentioned waste storage state information recording device. Effect of the Invention

[0025] The waste storage state information storage device, waste storage state information recording method, and waste storage state information recording program according to the present invention can appropriately recognize the waste storage state even when the waste storage state is detected from above. [Brief description of the drawings]

[0026] [Figure 1] 1 is a diagram showing a configuration of a waste storage state information recording device according to an embodiment; [Diagram 2] As an example, this is a schematic diagram showing the configuration of an incineration facility around a garbage pit. [Diagram 3] FIG. 13 is a diagram showing point cloud data of the height of garbage as an example. [Figure 4] FIG. 13 is a diagram showing, as an example, a dust image and a dust occupation area identified and extracted from the dust image. [Diagram 5] As an example, this is a diagram for explaining the three-dimensional position of the area occupied by garbage (the three-dimensional position of waste). [Figure 6] FIG. 13 is a diagram illustrating an example of an xy coordinate system that is set for a dust image. [Figure 7] FIG. 13 is a diagram showing an example of an accommodation status information table. [Figure 8] FIG. 13 is a diagram showing an example of a detection and accommodation state information table (list). [Figure 9] FIG. 13 is a diagram for explaining a process for updating the storage status of waste, as an example. [Figure 10] FIG. 13 is a diagram illustrating a process of updating a lower layer flag, as an example. [Figure 11] FIG. 13 is a diagram for explaining the movement of garbage due to stirring, as an example. [Figure 12] 4 is a flowchart showing the operation of the waste storage state information recording device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0027] Hereinafter, one or more embodiments of the present invention will be described with reference to the drawings. However, the scope of the invention is not limited to the disclosed embodiments. In addition, configurations with the same reference numerals in each drawing indicate that they are the same configurations, and their description will be omitted as appropriate. In this specification, when referring to a general term, a reference numeral without a subscript is used, and when referring to an individual configuration, a reference numeral with a subscript is used.

[0028] The waste storage state information recording device in the embodiment is a device that records the storage state of waste stored in a storage unit. The waste is discarded as garbage because the owner judges it to be useless or unnecessary. This waste storage state information recording device includes a storage state storage unit, a detected storage state acquisition unit, and a storage state update unit. The storage state storage unit stores the storage state of the waste stored in the storage unit. The detected storage state acquisition unit acquires the storage state of the waste at a predetermined detection timing. The storage state update unit compares the storage state of the waste stored in the waste storage state storage unit with the storage state of the waste acquired by the detected storage state acquisition unit, updates the storage state of the waste stored in the waste storage state storage unit according to the result of the comparison, and stores the updated storage state of the waste in the waste storage state storage unit. Hereinafter, such a waste storage state information recording device and a waste storage state information recording method and a waste storage state information recording program implemented therein will be described in more detail.

[0029] FIG. 1 is a diagram showing the configuration of a waste storage state information recording device in an embodiment. FIG. 2 is a schematic diagram showing the configuration of an incineration facility around a garbage pit, as an example. FIG. 2A is a schematic diagram showing the garbage pit and its surroundings in a plan view (schematic diagram when viewed from the Z direction), and FIG. 2B is a schematic diagram showing the garbage pit and its surroundings in a side view (schematic diagram when viewed from the X direction). FIG. 3 is a diagram showing point cloud data of the height of garbage, as an example. FIG. 4 is a diagram showing a garbage image and an occupied area of ​​garbage identified and extracted from the garbage image, as an example. FIG. 5 is a diagram for explaining the three-dimensional position of the occupied area of ​​garbage (three-dimensional position of waste), as an example. FIG. 6 is a diagram for explaining an xy coordinate system set in a garbage image, as an example. FIG. 7 is a diagram showing a storage state information table, as an example. FIG. 8 is a diagram showing a detected storage state information table (list), as an example. FIG. 9 is a diagram for explaining a process for updating the storage state of waste, as an example. FIG. 10 is a diagram for explaining a process for updating a lower layer flag, as an example. FIG. 11 is a diagram for explaining the movement of dirt due to agitation, as an example.

[0030] In the present embodiment, the waste storage state information recording device 1000 is used, for example, as shown in FIG. 2, to record the storage state of the waste in a waste pit PT that receives, stores, and stores the waste. The waste corresponds to an example of waste, and is collected and transported by a waste collection truck VC, and is dumped from the waste collection truck VC into the waste pit PT through one of a plurality of dump ports DA for dumping the waste. The waste pit PT corresponds to an example of a storage section, and is provided, for example, in an incineration facility that incinerates waste, and is a facility that temporarily stores and stores the waste before incinerating the waste. Alternatively, for example, the waste pit PT is provided in a sorting facility that sorts waste by predetermined type, and is a facility that temporarily stores and stores the waste before sorting the waste. Here, an example of an incineration facility will be described.

[0031] Hereinafter, the waste will be described using the term "garbage," as an example, except where it is specifically emphasized that the waste is such, and the storage unit will be described using the term "garbage pit PT," as an example, except where it is specifically emphasized that the waste is such.

[0032] The garbage pit PT is, for example, a roughly rectangular parallelepiped empty space (recess) with a bottom and walls made of concrete and an open top. Garbage pits PT come in a variety of forms, including a single pit in which the empty space is used as a whole without being partitioned, and a multi-pit in which the empty space is used in multiple compartments by dividing it with a partition wall. In this embodiment, the garbage pit PT is a double pit in which the space is used in two compartments by dividing it with a partition wall (not shown).

[0033] The garbage pit PT is equipped with a crane CR. When an XYZ orthogonal coordinate system is set as shown in FIG. 2, the crane CR is configured to be movable along the Z direction (the vertical direction of the paper in FIG. 2B) relative to the crane girder CG, and is configured to be movable along the Y direction (the horizontal direction of the paper in FIG. 2B) guided by the crane girder CG, and the crane girder CG is configured to be movable along the X direction (the front-back direction of the paper in FIG. 2B) guided by a runway rail (not shown) extending in the X direction. This allows the crane CR to be movable in each of the three-dimensional directions of the Z direction, Y direction, and X direction. The origin of the XYZ orthogonal coordinate system is set at a predetermined corner on the bottom surface of the garbage pit PT as shown in FIG. 3, but in FIG. 2, for convenience of drawing, the coordinate origin of the XYZ orthogonal coordinate system is shifted and the XYZ orthogonal coordinate system is illustrated.

[0034] More specifically, the crane CR includes a hoist drum around which a wire rope is wound to suspend a bucket so that it can be raised and lowered along the Z direction, a drive unit (first drive unit) such as a motor that drives the hoist drum, traveling wheels for traveling on the crane girder CG while being guided by the crane girder CG, and a lifting cart having a drive unit (second drive unit) such as a motor that drives the traveling wheels. The crane girder CG includes a member extending along the Y direction, first and second traverse wheels provided on both ends of the member, respectively, for traveling on the runway rail while being guided by the runway rail, and a drive unit (third drive unit) such as a motor that drives the first and second traverse wheels in synchronization.

[0035] The position of the crane (crane position) is represented, for example, by the tip position of the crane CR or the center position of the bucket of the crane CR. The position of the crane CR in the Z direction (Z coordinate value of the crane position) is determined, for example, by the payout amount (payout length) of the wire rope that is connected to the bucket and suspends the bucket. The payout amount of the wire rope is determined, for example, by detecting the rotation amount of the hoist drum with, for example, a rotary encoder (Z-direction rotary encoder). The output of the Z-direction rotary encoder is monitored by, for example, a console (control console) CL for controlling the operation of the crane CR and the operation around the garbage pit PT, and the payout amount of the wire rope is determined by the console CL based on the output of the Z-direction rotary encoder, thereby determining the Z-coordinate value of the crane position. The position of the crane CR in the Y direction (Y coordinate value of the crane position) is determined, for example, by detecting the rotation amount of the traveling wheel with, for example, a rotary encoder (Y-direction rotary encoder). The output of the Y-direction rotary encoder is monitored by the console CL, and the amount of rotation of the traveling wheels is determined based on the output of the Y-direction rotary encoder by the console CL, thereby determining the Y-coordinate value of the crane position. The X-direction position of the crane CR (X-coordinate value of the crane position) is determined, for example, by detecting the amount of rotation of the traverse wheels (at least one of the first and second traverse wheels) using, for example, a rotary encoder (X-direction rotary encoder). The output of the X-direction rotary encoder is monitored by the console CL, and the amount of rotation of the traverse wheels is determined based on the output of the X-direction rotary encoder by the console CL, thereby determining the X-coordinate value of the crane position.

[0036] In a building that houses a garbage pit PT, the multiple input ports DA are provided on a side wall of the building that extends from one wall of the garbage pit PT toward the ceiling of the building, so as to be arranged side by side at a predetermined interval (first interval) along the X direction. In the example shown in FIG. 2, three first to third input ports DA-1 to DA-3 are provided, and are shown by dashed lines in FIG. 2A. On the opposite side of the multiple input ports DA from the side where the garbage pit PT is arranged, a platform PH is provided, which is a flat space where a garbage collection truck VC passes and where the garbage collection truck VC parks and stops when it inputs the loaded garbage from the input port DA into the garbage pit PT. On the other wall side of the garbage pit PT, an input hopper HP is provided adjacent to the garbage pit PT. In the example shown in FIG. 2, the input hopper HP is provided with three first to third input hoppers HP-1 to HP-3, each of which is connected to an incinerator not shown.

[0037] The garbage truck VC, which has collected and loaded garbage, enters the incineration facility through the gate GT, and its weight is measured in the weighing building WM. The garbage transported by the garbage truck VC is dumped into the garbage pit PT through the dump port DA, where it is stored. The garbage stored in the garbage pit PT is leveled or mixed by a crane CR as necessary, for example, by the judgment of an operator (user) or by the judgment of a computer. The garbage stored in the garbage pit PT is introduced into the incinerator and incinerated by the garbage picked up by the crane CR from the garbage pit PT and dumped into a dump hopper HP. A console CL for controlling the operation of the crane CR is disposed in an operation room (operation room, central control room) OR. The operation room OR is disposed adjacent to the garbage pit PT so that the operator can visually check the garbage stored in the garbage pit PT and the crane CR. The number of dump ports DA and the number of dump hoppers HP are arbitrary and are not limited to the example shown in FIG. 2.

[0038] A waste storage status information recording device 1000 that records the garbage storage status (an example of the waste storage status) in such a garbage pit PT includes, for example, a detection storage status acquisition unit 1, a control processing unit 2, an input unit 3, an output unit 4, an interface unit (IF unit) 5, and a memory unit 6, as shown in Figures 1 and 2.

[0039] The detected storage state acquisition unit 1 is a device that acquires the storage state of the garbage at a predetermined detection timing. The storage state of the garbage is represented at least by the three-dimensional position of the garbage and the type of the garbage. The detected storage state acquisition unit 1 may be, for example, an interface that is connected to a storage state detection unit that detects the storage state of the garbage at a predetermined detection timing and acquires the storage state of the garbage at the predetermined detection timing from the storage state detection unit, but in this embodiment, it is a storage state detection unit that detects the storage state of the garbage at the predetermined detection timing.

[0040] The storage state detection unit, which is an example of the detection storage state acquisition unit 1, includes a height measurement unit HM, an imaging unit CA, an identification and extraction unit 22, a waste position calculation unit 23, and a clock unit 24.

[0041] The height measuring unit HM is connected to the control processing unit 2 by wire or wirelessly, and is a device that measures the height of the garbage stored in the garbage pit PT in the garbage pit PT according to the control of the control processing unit 2. The height measuring unit HM outputs the measured height of the garbage to the control processing unit 2. In this embodiment, the height measuring unit HM is disposed, for example, as shown in FIG. 2, above the garbage pit PT so that the entire upper surface of the garbage pit PT can be overlooked, for example, at an installation position (first installation position) at a predetermined height on the extension of the other wall surface of the garbage pit PT so as to overlook the garbage pit PT from diagonally above. Alternatively, for example, the height measuring unit HM may be disposed above (directly above) the center position of the garbage pit PT. The height measuring unit HM is, for example, a laser range finder that scans the upper surface of the garbage stored in the garbage pit PT at a predetermined interval (first interval) and measures the distance to the upper surface of the garbage to generate point cloud data. In addition, if one laser range finder cannot measure the entire upper surface of the garbage pit, multiple laser range finders may be used. The laser range finder HM, which is an example of the height measurement unit HM, outputs the measured point cloud data to the control processing unit 2. The height of the garbage is obtained based on the distance to the upper surface of the garbage, the measurement direction at that time, and the depth dimension of the garbage pit PT. More specifically, the laser range finder HM measures the point cloud data of the distance in an rθφ polar coordinate system (first local coordinate system) with its optical axis as the coordinate axis r and measurement directions as θ and φ, and converts the measured point cloud data of the distance into point cloud data of the height in the XYZ orthogonal coordinate system (world coordinate system) by a well-known conventional method based on the first installation position, the optical axis direction of the laser range finder HM, the depth dimension of the garbage pit PT, and the like. An example of this is shown in FIG. 3. The process of converting the point cloud data of the distance into point cloud data of the height may be performed by the control processing unit 2. In this case, the laser range finder HM outputs to the control processing unit 2 point cloud data of the distance in the first local coordinate system.

[0042] The imaging unit CA is connected to the control processing unit 2 by wire or wirelessly, and is a device that generates an image of the garbage contained in the garbage pit PT in the garbage pit PT according to the control of the control processing unit 2. The imaging unit CA outputs the generated image of the garbage (garbage image) to the control processing unit 2. In this embodiment, the imaging unit CA is disposed at a predetermined height (second disposition position) on the extension of one wall surface of the garbage pit PT so as to overlook the garbage pit PT from diagonally above, for example, above the garbage pit PT so as to be able to image the entire upper surface of the garbage pit, as shown in FIG. 2. Alternatively, for example, the imaging unit CA may be disposed above (directly above) the center position of the garbage pit PT. The imaging unit CA is, for example, a digital camera. Note that, when the entire upper surface of the garbage pit cannot be imaged by one digital camera, multiple digital cameras may be used. The imaging unit CA outputs the generated image of the garbage to the control processing unit 2. An example of this is shown in FIG. 4. In addition, in FIG. 4, the area occupied by dust identified and extracted by the identification and extraction unit 22 from the dust image shown in FIG. 4 is also shown by a rectangle (□).

[0043] The identification and extraction unit 22 identifies and extracts the area occupied by the dust for each type of dust in the dust image generated by the imaging unit CA. In this embodiment, the identification and extraction unit 22 is functionally configured in the control processing unit 2 as described later.

[0044] For example, the identification and extraction unit 22 may be one disclosed in the above-mentioned Patent Document 1. More specifically, the identification and extraction unit 22 includes a machine learning model that has been trained to identify the area occupied by the dust for each type of dust in an image generated by the imaging unit CA. In this embodiment, when a dust image is input, the machine learning model identifies the image area containing the dust as the area occupied by the dust for each type of dust from the dust image, specifies the position and size (size, area, number of pixels), calculates the reliability representing the degree of reliability of the identification for the identified dust area as a percentage, and outputs the area occupied by the dust (position, size), the type (classification) of the dust, and the reliability. The machine learning model is configured to include a model that utilizes a known method used for machine learning, such as linear regression, a Boltzmann machine, a neural network, a support vector machine (SVM), a Bayesian network, a decision tree, and a random forest. In this embodiment, a convolution neural network (CNN), which is one type of neural network, is used for the machine learning model, and parameters of the CNN are determined by the machine learning, and the discrimination ability of the CNN is acquired.

[0045] Then, the identification and extraction unit 22 finally judges whether the area occupied by garbage identified by the machine learning model is garbage or not based on the reliability output from the machine learning model. More specifically, the identification and extraction unit 22 compares the reliability output from the machine learning model with a predetermined threshold (judgment threshold) according to the type of garbage output from the machine learning model together with the reliability, and finally judges the area occupied by garbage when the reliability is equal to or greater than the judgment threshold, and does not finally judge the area occupied by garbage when the reliability is less than the judgment threshold. By setting the judgment threshold for each type of garbage, it is possible to more appropriately judge whether the area is that type of garbage or not. An example of the identification and extraction result is shown in FIG. 4. The machine learning model used in the example shown in Figure 4 can identify the following types of garbage: bags of garbage, sludge, vegetation (including pruning trees), cardboard, futons, waste plastic, and crushed pieces of combustible bulky garbage.In Figure 4, the occupancy areas identified and extracted as garbage are represented by rectangles (□), with occupation area ARr being the occupation area of ​​the crushed pieces, occupation area ARp being the occupation area of ​​the waste plastic, occupation area ARt being the occupation area of ​​the vegetation, and the occupied areas that are not numbered due to their large number and for convenience of drawing are the occupation areas of the bags of garbage.

[0046] The waste position calculation unit 23 determines, for each occupied area of ​​garbage extracted by the identification and extraction unit 22, the three-dimensional position of that occupied area as the three-dimensional position of the garbage based on the height measured by the height measurement unit HM and the image of the garbage generated by the imaging unit CA.

[0047] More specifically, for each of the waste occupation areas extracted by the identification and extraction unit 22, the waste position calculation unit 23 obtains the two-dimensional position of the waste occupation area on the image of the waste, converts the obtained two-dimensional position of the waste occupation area to a three-dimensional position in the XYZ orthogonal coordinate system, and selects (extracts) the height (point data) closest to the converted three-dimensional position from among the heights (point cloud data) measured by the laser distance meter HM, for example, by Euclidean distance, as the three-dimensional position of the waste occupation area. The two-dimensional position of the waste occupation area is defined as the center position CP of the waste occupation area, for example, as shown in FIG. 5. In this case, the waste position calculation unit 23 obtains the two-dimensional positions of the four corners of the rectangular occupation area in the waste image, and obtains the position of the intersection of the two diagonals to obtain the center position CP of the waste occupation area. 6, for example, when an xy orthogonal coordinate system (second local coordinate system) is set for a dust image with the upper left corner of the dust image in plan view as the coordinate origin and each side of the dust image as the x-axis and y-axis, respectively, the conversion to a three-dimensional position in the XYZ orthogonal coordinate system can be performed by determining the correspondence between the second local coordinate system and the XYZ orthogonal coordinate system (world coordinate system) by a well-known conventional method based on so-called camera external parameters (second installation position and optical axis direction) and so-called camera internal parameters (focal length, aberration, etc.) of the imaging unit CA. Note that in the above description, the height closest to the converted three-dimensional position from among the heights measured by the laser range finder HM is selected as the three-dimensional position of the dust occupation area, but the three-dimensional position of the dust occupation area may be determined by interpolation based on the heights measured by the laser range finder HM around the converted three-dimensional position.

[0048] The clock unit 24 measures time in terms of year, month, day, hour, minute and second.

[0049] When the sampling timing (detection timing) at a predetermined sampling interval arrives, the detection and storage status acquisition unit 1 configured as described above measures the height of the garbage using the height measurement unit HM, generates a garbage image using the imaging unit CA, acquires the current time of the clock unit 24 as the detection time of the detection timing, stores the measured garbage height and the generated garbage image in memory unit 6 in association with the detection time of the acquired detection timing, identifies and extracts the garbage occupation area and the type of garbage from the generated garbage image by the identification and extraction unit 22, determines the three-dimensional position of the garbage occupation area by the waste position calculation unit 23, and stores the occupation area of ​​the garbage, its three-dimensional position and its type in memory unit 6 in association with the generated garbage image.

[0050] Returning to Fig. 1, the input unit 3 is connected to the control processing unit 2 and is a device that inputs, for example, various commands and various data necessary for operating the waste storage state information recording device 1000 to the waste storage state information recording device 1000, such as a keyboard, a mouse, or a plurality of input switches to which predetermined functions are assigned. The output unit 4 is connected to the control processing unit 2 and is a device that outputs the commands and data input from the input unit 3 and the waste storage state (the garbage storage state in this example) in accordance with the control of the control processing unit 2, such as a display device such as a CRT display, a liquid crystal display, or an organic EL display, or a printing device such as a printer.

[0051] The input unit 3 and the output unit 4 may form a so-called touch panel. In the case of forming this touch panel, the input unit 3 is a position input device that detects and inputs an operation position, for example, a resistive film type or a capacitive type, and the output unit 4 is a display device. In this touch panel, the position input device is provided on the display surface of the display device, and one or more input contents that can be input to the display device are displayed. When a user touches a display position that displays the input content that the user wants to input, the position is detected by the position input device, and the display content displayed at the detected position is input to the waste accommodation state information recording device 1000 as the user's operation input content. In such a touch panel, the user can easily intuitively understand the input operation, and therefore a waste accommodation state information recording device 1000 that is easy for the user to handle is provided.

[0052] The IF unit 5 is a circuit connected to the control processing unit 2 and inputs and outputs data to and from an external device under the control of the control processing unit 2, and is, for example, an interface circuit for RS-232C, which is a serial communication method, an interface circuit using the Bluetooth (registered trademark) standard, an interface circuit for infrared communication such as the IrDA (Infrared Data Association) standard, and an interface circuit using the USB (Universal Serial Bus) standard. The IF unit 5 is also a circuit for communicating with an external device, and may be, for example, a data communication card or a communication interface circuit conforming to the IEEE802.11 standard. If the detection and accommodation state acquisition unit 1 is the above-mentioned interface, the IF unit 5 may also serve as this interface.

[0053] The storage unit 6 is connected to the control processing unit 2, and is a circuit that stores various predetermined programs and various predetermined data under the control of the control processing unit 2.

[0054] The various predetermined programs include, for example, a control processing program, and the control processing program includes, for example, a control program, an identification and extraction program, a waste position calculation program, a clock program, and a storage status update program. The control program controls each of the units 1, 3 to 6 of the waste storage status information recording device 1000 according to the function of each unit. The identification and extraction program is a program that identifies and extracts the occupied area of ​​the waste for each type of waste in the waste image generated by the imaging unit CA. The waste position calculation program is a program that determines, for each occupied area of ​​the waste extracted by the identification and extraction program, the three-dimensional position of the occupied area as the three-dimensional position of the waste based on the height measured by the height measurement unit HM and the waste image generated by the imaging unit CA. The clock program is a program that measures time in years, months, days, hours, minutes, and seconds. The storage status update program is a program that compares the garbage storage status stored in the storage status memory unit 61 described below with the garbage storage status acquired by the detection and storage status acquisition unit 1, updates the garbage storage status stored in the storage status memory unit 61 according to the result of the comparison, and stores the updated garbage storage status in the storage status memory unit 61.

[0055] The various types of specified data include data necessary for executing each of these programs, such as the storage state at a specified detection timing (e.g., the current detection timing) and past storage states that have already been detected (recorded).

[0056] Such a storage unit 6 includes, for example, a ROM (Read Only Memory) which is a nonvolatile storage element, an EEPROM (Electrically Erasable Programmable Read Only Memory) which is a rewritable nonvolatile storage element, etc. The storage unit 6 also includes a RAM (Random Access Memory) which serves as a so-called working memory of the control processing unit 2 for storing data generated during execution of the predetermined program, etc. The storage unit 6 may also be configured to include a hard disk device with a relatively large storage capacity.

[0057] The storage unit 6 functionally includes a storage state storage unit 61 and a detected storage state storage unit 62 in order to store each of the storage states described above.

[0058] The storage status memory unit 61 stores past storage statuses that have already been detected (recorded). The garbage storage status is represented at least by the three-dimensional position of the garbage and the type of the garbage. In this embodiment, the storage status memory unit 61 further includes the detection timing, whether or not the garbage has been moved, and whether or not the garbage is exposed to the surface of the garbage stored in the garbage pit PT.

[0059] In this embodiment, the storage state is stored in the storage state storage unit 61 in table format. 7, the storage status information table DB in which this storage status is registered includes an ID field 611 in which an identifier (ID) for specifying and identifying the garbage in the occupied area is registered, a detection time field 612 in which the detection time of the detection timing for the garbage in the occupied area specified by the ID registered in the ID field 611 is registered, a first detection position field 613 in which the two-dimensional position of the garbage in the occupied area specified by the ID registered in the ID field 611 is registered, a second detection position field 614 in which the three-dimensional position of the garbage in the occupied area specified by the ID registered in the ID field 611 is registered, a garbage type field 615 in which the type of garbage in the occupied area specified by the ID registered in the ID field 611 is registered, a movement processing flag field 616 in which the movement processing flag for the garbage in the occupied area specified by the ID registered in the ID field 611 is registered, and a lower layer flag field 617 in which the lower layer flag (exposure flag) for the garbage in the occupied area specified by the ID registered in the ID field 611 is registered, and has a record for each detection timing and occupied area. The ID is generated as a serial number from the beginning when the identification and extraction unit 22 identifies and extracts an occupied area, and is assigned to the occupied area. The movement processing flag indicates whether or not the garbage has been moved, and the movement processing flag "1" indicates that the garbage has been moved and processed, and the movement processing flag "0" indicates that the garbage has not been moved and is unprocessed. The lower layer flag (exposure flag) indicates whether or not the garbage is exposed to the surface of the garbage stored in the garbage pit PT, and the lower layer flag "1" indicates that the garbage in the occupied area is layered below the other garbage because other garbage is overlapped on top of the garbage in the occupied area, i.e., not exposed to the surface, and the lower layer flag "0" indicates that the garbage in the occupied area is not layered below the other garbage because other garbage is not overlapped on top of the garbage in the occupied area, i.e., exposed to the surface. In the storage state information table DB shown in FIG. 7, the two-dimensional position of the occupied area in the garbage image can be registered.

[0060] The detected storage state memory unit 62 stores the storage state at a predetermined detection timing. The detected storage state acquisition unit 1 repeatedly acquires the garbage storage state, and the detected storage state memory unit 62 stores the garbage storage state acquired by the detected storage state acquisition unit 1 at the current detection timing.

[0061] In this embodiment, the storage state at the detection timing is stored in table format (list format) in the detected storage state storage unit 62. The detected storage state information table (detected storage state information list) LS, which registers the storage state at the detection timing, includes, for example, an ID field 621 for registering the ID, a detection time field 622 for registering the detection time of the detection timing for the garbage in the occupation area specified by the ID registered in the ID field 611, a first detection position field 623 for registering the two-dimensional position of the garbage in the occupation area specified by the ID registered in the ID field 611, a second detection position field 624 for registering the three-dimensional position of the garbage in the occupation area specified by the ID registered in the ID field 611, and a garbage type field 625 for registering the type of garbage in the occupation area specified by the ID registered in the ID field 611, as shown in Fig. 8, and has a record for each occupation area.

[0062] The control processing unit 2 is a circuit for controlling each of the units 1, 3 to 6 of the waste storage status information recording device 1000 according to the function of each unit, and for recording storage status information. The control processing unit 1 is configured, for example, with a CPU (Central Processing Unit) and its peripheral circuits. In the control processing unit 2, a control unit 21, an identification and extraction unit 22, a waste position calculation unit 23, a clock unit 24, and a storage status update unit 25 are functionally configured by executing the control processing program.

[0063] The control section 21 controls each of the sections 1, 3 to 6 of the waste collection state information recording device 1000 in accordance with the function of each section, and is in charge of controlling the waste collection state information recording device 1000 as a whole.

[0064] As described above, the identification and extraction section 22 identifies and extracts the area occupied by the dust for each type of dust in the dust image generated by the imaging section CA.

[0065] As described above, for each occupied area of ​​garbage extracted by the identification and extraction unit 22, the waste position calculation unit 23 determines the three-dimensional position of the occupied area as the three-dimensional position of the garbage based on the height measured by the height measurement unit HM and the garbage image generated by the imaging unit CA.

[0066] As described above, the clock unit 24 measures time in terms of year, month, day, hour, minute and second.

[0067] The storage status update unit 25 compares the storage status of the garbage stored in the storage status memory unit 61 with the storage status of the garbage acquired by the detection and storage status acquisition unit 1, updates the storage status of the garbage stored in the storage status memory unit 61 according to the result of the comparison, and stores the updated storage status of the garbage in the storage status memory unit 61. In this embodiment, the storage status update unit 25 compares the storage status of the garbage registered in the storage status information table DB stored in the storage status memory unit 61 with the storage status of the garbage registered in the detected storage status information table LS acquired by the detected storage status acquisition unit 1 at the current detection timing and stored in the detected storage status memory unit 62, and as a result of the comparison, adds to the storage status information table DB a record that is not in the storage status information table DB but is in the detected storage status information table LS, and if there is a record in the storage status information table DB but not in the detected storage status information table LS, the lower layer flag registered in the lower layer flag field 617 of the record in the storage status information table DB is changed to ``1'', thereby performing the update, and storing the updated storage status information table DB in the storage status memory unit 61.

[0068] More specifically, the following process is executed for each record in the detected storage status information table LS. The storage status update unit 25 first extracts from the storage status information table DB records that match the type of waste registered in the waste type field 625 of that record in the detected storage status information table LS, and that have a movement processing flag of "0" indicating unprocessed and a lower layer flag of "0" indicating that the lower layer is not present (exposed). If the record is not extracted, the storage status update unit 25 determines that there is no record in the storage status information table DB that matches the record in the detected storage status information table LS. On the other hand, when the record is extracted, the accommodation status update unit 25 calculates, for each extracted record (record of the accommodation status information table DB), a Euclidean distance, for example, between the two-dimensional position of the occupied area registered in the first detection position field 623 of the record of the accommodation status information table DB and the two-dimensional position of the occupied area registered in the first detection position field 623 of the record of the detected accommodation status information table LS, in order to select a record that matches the record of the detected accommodation status information table LS from the extracted records. If the calculated distance is equal to or less than a predetermined threshold (same occupancy area determination threshold), it is determined that the record of the detected accommodation status information table LS corresponds to the record of the accommodation status information table DB and that the record of the detected accommodation status information table LS is in the accommodation status information table DB. If the calculated distance exceeds the same occupancy area determination threshold, it is determined that the record of the detected accommodation status information table LS does not correspond to the record of the accommodation status information table DB. Then, if there is no record in the storage status information table DB corresponding to the record in the detected storage status information table LS among the extracted records (records in the storage status information table DB), the storage status update unit 25 determines that there is no record in the storage status information table DB that matches the record in the detected storage status information table LS.In addition, if there are multiple records among the extracted records (records in the storage status information table DB) that are determined to match the record in the detected storage status information table LS, the storage status update unit 25 determines that the record with the shortest (closest) distance is the record in the storage status information table DB that corresponds to the record in the detected storage status information table LS.

[0069] Then, after executing the above-mentioned process for each record in the detected accommodation status information table LS, the accommodation status update unit 25 adds a new record in the detected accommodation status information table LS to the accommodation status information table DB when it is determined that the matching record is not present in the accommodation status information table DB. At this time, the accommodation status update unit 25 registers the defaults "0" in the movement processing flag field 616 and the lower level flag field 617 of the newly added record. For example, when the accommodation status information table DB shown in FIG. 7 is stored in the accommodation status memory unit 61 and the detected accommodation status information table LS shown in FIG. 8 is stored in the detected accommodation status memory unit 62, a record in the detected accommodation status information table LS having “006” registered in the ID field 621 is determined to match a record in the accommodation status information table DB having “003” registered in the ID field 611, and a record in the detected accommodation status information table LS having “004” registered in the ID field 621 and a record in the detected accommodation status information table LS having “005” registered in the ID field 621 are determined to not exist in the accommodation status information table DB and are newly added to the accommodation status information table DB as shown in FIG. 9, and the default value of “0” is registered in the movement processing flag field 616 and the lower level flag field 617 of these, respectively.

[0070] Then, the accommodation status update unit 25 extracts records from the accommodation status information table DB that were not determined to correspond to records in the detected accommodation status information table LS in the above-mentioned process, extracts records having an unprocessed "0" registered in the movement processing flag field 616 from the extracted records, and registers "1" indicating a lower layer (not exposed) in the lower layer flag field 617 of the extracted records. For example, in the example shown in Fig. 7 to Fig. 9, as shown in Fig. 10, a lower layer flag "1" is registered in the lower layer flag field 617 of a record in the accommodation status information table DB having "002" registered in the ID field 611.

[0071] Then, the accommodation status update unit 25 stores the accommodation status information table DB thus updated, in the accommodation status storage unit 61, the accommodation status information table DB shown in FIG.

[0072] Here, the movement processing flag registered in the movement processing flag field 616 in the storage status information table DB stored in the storage status memory unit 61 is updated from "0" to "1" when the garbage in the occupied area is moved by the crane CR to be put into the input hopper HP, when it is moved for mixing, or when it is moved for transloading. For example, as shown in FIG. 11, when garbage in an occupied area ARt is picked up by a crane CR at a three-dimensional gripping position PS1 and then dropped from the crane CR at a drop position PS2, the console CL transmits the three-dimensional gripping position PS1 to the storage status information recording device 1000, and when the storage status information recording device 1000 receives this three-dimensional gripping position PS1, the storage status update unit 25 selects (extracts) a record from the storage status information table DB stored in the storage status memory unit 61, in which the three-dimensional position of the occupied area AR that is closest to the three-dimensional gripping position PS1, for example in Euclidean distance, is registered in the second detection position field 614, and a lower layer flag of "1" is registered in the lower layer flag field 617 of the selected record, thereby updating and storing the storage status information table DB. For example, in the example shown in Figures 10 and 11, the move processing flag "0" registered in the move processing flag field 616 of a record in the storage status information table DB in which "003" is registered in the ID field 611 is changed to "1", and "1" is registered in the move processing flag field 616 of this record (the changed storage status information table DB is not shown).

[0073] Here, whether or not the garbage has been moved can be identified by referring to the movement processing flag registered in the movement processing flag field 616. However, the lower layer flag may further include a lower layer flag "2" indicating that the garbage has been moved and processed, and when the movement processing flag "0" registered in the movement processing flag field 616 is changed to "1", the lower layer flag registered in the lower layer flag field 617 may be changed to "2".

[0074] In the above description, the storage status update unit 25 determines whether a record in the detected storage status information table LS matches a record in the storage status information table DB based on the two-dimensional position of the occupied area, but the determination of the match may be performed based on the three-dimensional position of the occupied area. Also, in the above description, the Euclidean distance is used, but the Manhattan distance, the Chebyshev distance, or the like may be used.

[0075] The control processing unit 2, input unit 3, output unit 4, IF unit 5 and storage unit 6 can be configured by, for example, a desktop or notebook computer. The computer configuring each of these units 2 to 6 may be placed, for example, in an operation room OR and incorporated into the console CL (or may serve as the console CL), or may be separate from the console CL.

[0076] Next, the operation of this embodiment will be described with reference to the flow chart of FIG 12, which shows the operation of the waste accommodation state information recording device.

[0077] When the waste storage status information recording device 1000 having such a configuration is powered on, it initializes the necessary parts and starts its operation. In the control processing unit 2, a control unit 21, an identification and extraction unit 22, a waste position calculation unit 23, a clock unit 24 and a storage status update unit 25 are functionally configured by executing the control processing program.

[0078] The waste storage state information recording device 1000 repeatedly executes the following processes at predetermined sampling intervals.

[0079] 12, at the current sampling timing (detection timing), in this embodiment, the waste collection state information recording device 1000 acquires point cloud data of the garbage height and a garbage image by the detection and collection state acquisition unit 1 (S1). More specifically, the control processing unit 2 acquires point cloud data of the garbage height measured by the laser rangefinder HM from the laser rangefinder HM, and acquires the garbage image generated by the imaging unit CA from the imaging unit CA.

[0080] Next, the waste collection status information recording device 1000 acquires the current time from the clock unit 24 of the control processing unit 2 as the detection time of the detection timing, and stores this acquired detection time in the memory unit 6 in correspondence with the point cloud data of the garbage height and the garbage image acquired in process S1 (S2).

[0081] Next, the waste collection state information recording device 1000 causes the identification and extraction unit 22 of the control processing unit 2 to identify and extract the occupied area of ​​the waste for each type of waste in the waste image acquired from the imaging unit CA in process S1 (S3). The identification and extraction unit 22 assigns an ID to the extracted occupied area.

[0082] Next, the waste storage status information recording device 1000, for each waste occupation area extracted by the identification and extraction unit 22 by process S3, determines the three-dimensional position of the occupation area as the three-dimensional position of the waste (S4) using the waste position calculation unit 23 of the control processing unit 2, based on the height point cloud data acquired from the laser rangefinder HM by process S1 and the waste image acquired from the imaging unit CA by process S1.

[0083] Next, the waste storage state information recording device 1000 generates a detected storage state information table LS by the storage state update unit 25 of the control processing unit 2 from the detection time of the detection timing acquired in process S2, the two-dimensional position of the occupied area and the type of waste and its ID identified and extracted in process S3, and the three-dimensional position of the occupied area obtained in process S4, and stores it in the detected storage state memory unit 62. The generated detected storage state information table LS is compared with the storage state information table DB stored in the storage state memory unit 61, and as a result of the comparison, a record that is not in the storage state information table DB but is in the detected storage state information table LS is updated to the storage state information table LS. A new record is added to the information table DB (a move processing flag of "0" and a lower layer flag of "0" are registered in the move processing flag field 616 and the lower layer flag field 617 of this newly added record, respectively), and if there is a record in the storage status information table DB that is not in the detected storage status information table LS, the lower layer flag registered in the lower layer flag field 617 of this record in the storage status information table DB is changed to "1," thereby carrying out the update, and the updated storage status information table DB is stored in the storage status memory unit 61 (S5), and this processing for the current detection timing is terminated.

[0084] When the waste storage status information recording device 1000 receives a command at the input unit 3 instructing output of the storage status information table DB stored in the storage status storage unit 61, the waste storage status information recording device 1000 outputs the storage status information table DB stored in the storage status storage unit 61 to the output unit 4. Note that the waste storage status information recording device 1000 may output the storage status information table DB stored in the storage status storage unit 61 to an external device via the IF unit 5 as necessary.

[0085] As described above, the waste storage status information recording device 1000 in the embodiment, and the waste storage status information recording method and waste storage status information recording program implemented therein store the waste storage status in the storage status memory unit 61 and update it with the waste storage status acquired at a predetermined detection timing. Therefore, even if waste overlaps, the storage status before the overlapping can be recorded. Therefore, by referring to the storage status information stored in the storage status memory unit 61, the waste storage status can be properly recognized even when the waste storage status is detected from above.

[0086] The waste storage state information recording device 1000, the waste storage state information recording method and the waste storage state information recording program can record the storage state of waste by type of waste.

[0087] The above-mentioned waste storage status information recording device 1000, waste storage status information recording method and waste storage status information recording program store whether or not the waste has been moved, so that by referring to the contents stored in the storage status memory unit 61, it is possible to recognize whether or not movement has been carried out and to appropriately select the object to be stirred.

[0088] The waste storage status information recording device 1000, waste storage status information recording method and waste storage status information recording program store the presence or absence of exposure to the waste, so that by referring to the contents stored in the storage status memory unit 61, it is possible to recognize whether the waste is exposed, in other words, whether the waste is buried overlapping each other.

[0089] The above-mentioned waste storage status information recording device 1000, waste storage status information recording method and waste storage status information recording program identify and extract the waste occupation area for each type of waste, and for each waste occupation area, determine the three-dimensional position of the occupation area as the three-dimensional position of the waste, so that the waste storage status can be recorded for each waste occupation area.

[0090] In the above embodiment, the storage state update unit 25 may reset the storage state of the waste stored in the storage state storage unit 61 at a predetermined reset timing (first modified embodiment). That is, the storage state of the waste stored in the storage state storage unit 61 is deleted, and the storage state of the waste is newly stored in the storage state storage unit 61 based on the storage state of the waste acquired by the detection storage state acquisition unit 1. Such a waste storage state information recording device 1000 can start storing (recording) from the storage state of the waste at the predetermined reset timing. For example, by setting the predetermined reset timing to the start of work, the storage status of the waste from the start of work can be recognized by referring to the stored contents of the storage state storage unit 61, and the waste can be appropriately mixed. The predetermined reset timing can also be, for example, midnight when the date changes, the start of the delivery of waste, the elapse of a predetermined time from the previous reset timing, or the time when the amount of stored waste has decreased to such an extent that the average value, maximum value, or minimum value of the waste height in the receiving pit or the storage pit falls below a predetermined height. When the garbage pit PT is a double pit, the receiving pit is a pit into which garbage is dumped from the garbage collection vehicle VC, and the storage pit is a pit that stores the garbage transferred from the receiving pit.

[0091] Furthermore, in the above-described embodiment (including the first modified embodiment), the waste storage state information recording device 1000 may further include an agitation target selection unit 26 that selects an agitation target based on the storage state of the waste stored in the storage state memory unit 61, as shown by a dashed line in Fig. 1 (second modified embodiment). In the above-described example, the agitation target selection unit 26 selects an agitation target based on the storage state of the waste registered in the storage state information table DB stored in the storage state memory unit 61. Since such a waste storage state information recording device 1000 includes the agitation target selection unit 26, the selection of the agitation target can be automated.

[0092] More specifically, the stirring target selection unit 26 divides the surface of the garbage contained in the garbage pit PT into a plurality of sections, obtains the degree of stirring for each section, and selects the least stirred section as the stirring target. For example, when a predetermined horizontal plane in the garbage pit PT is divided into sections of a predetermined size and the area occupied by the garbage is projected onto the horizontal plane, the stirring target selection unit 26 first obtains the degree of stirring for each section. The size of the section may be arbitrary, but is set, for example, to a range that can be grabbed in one go by the bucket of the crane CR. The stirring degree AG is an evaluation value that indicates the degree of stirring of the garbage, and is given, for example, by a weighted average value of a first stirring degree AG1 on the surface of the garbage and a second stirring degree AG2 in the depth direction (AG=α×AG1+(1-α)×AG2). The variable α that defines the weight is appropriately set in advance within the range of 0<α<1, depending on which of the first and second stirring degrees AG1 and AD2 is to be emphasized during stirring. The first agitation degree AG1 is obtained by assigning a score, for example "1", to pixels belonging to the occupied area of ​​the dust obtained by the identification and extraction unit 22, and adding up (totaling) the scores assigned to the pixels of the occupied area belonging to the partition when the occupied area is projected onto the horizontal plane. Similarly, the second agitation degree AG2 is obtained by assigning a score, for example "1", to pixels belonging to the occupied area of ​​the dust obtained by the identification and extraction unit 22, and adding up (totaling) the scores assigned to the pixels of the occupied area belonging to the partition when the occupied area with the lower layer flag set to "1" is projected onto the horizontal plane. Of course, there may be cases where a plurality of occupied areas are projected onto the horizontal plane, some or all of which have the lower layer flag set to "1".In one example, the size of the partition is 30 [pixels] x 30 [pixels], and when a first occupancy area AR1 of the dirt on the surface is projected onto the partition, if 10 pixels belong to the first occupancy area AR1, then AG1 = 10; when a second occupancy area AR2 with a lower layer flag of "1" is projected onto the partition, if 7 pixels belong to the second occupancy area AR2, and further when a third occupancy area AR3 with a lower layer flag of "1" is projected onto the partition, if 11 pixels belong to the third occupancy area AR3, then AG2 = 7 + 11 = 18, and the degree of agitation AG = 10α + 18 (1 - α).The agitation target selection unit 26 then obtains the degree of agitation AG for each partition by scanning the partition over the entire horizontal plane. The scanning may be performed so that the sections do not overlap, but in this embodiment, the sections are rectangular, and the scanning is performed so that the center positions of the sections coincide with the points of the point cloud data. Therefore, the sections may overlap in part. The stirring target selection unit 26 then compares the stirring degrees AG thus obtained for each point of the point cloud data with each other, and selects the least stirred section as the stirring target. In this example, a score is given to the pixel corresponding to the area occupied by the garbage, that is, the unstirred area, so that the greater the stirring degree AG, the less stirred it is. Therefore, the stirring target selection unit 26 selects the point of the point cloud data with the greatest stirring degree AG as the stirring target. That is, the point of the point cloud data with the greatest stirring degree AG is selected as the gripping position PS of the crane CR. When there are multiple points of the point cloud data with the greatest stirring degree AG, one of the multiple points is selected according to a preset rule (convention). The rule is, for example, a rule that selects the closest point to the current position of the crane CR from the viewpoint of the operational efficiency of the crane CR. Alternatively, for example, the rule may be a rule that selects the point at which the garbage is highest from the viewpoint of leveling the garbage height, or a rule that assigns a priority to each type of garbage since the calorific value differs for each type of garbage, and selects the point with the highest priority.

[0093] When the mixing target is selected in this way, the waste storage state information recording device 1000 transmits the three-dimensional position of the selected mixing target point to the console CL as the gripping position PS of the crane CR. When the console CL receives the gripping position PS of the crane CR, it controls the crane CR to grip the waste at the received gripping position PS.

[0094] Here, in the above-described embodiment, the storage status update unit 25 updated the movement processing flag when it received the grab position PS from the console CL, but in this second variant, in addition to this, or instead of this, the storage status update unit 25 may update the movement processing flag when the stirring target selection unit 26 transmits the grab position to the console CL.

[0095] Furthermore, in the above-described embodiment (including the first and second variants), a move processing flag and a move processing flag field 616 are provided, and the move processing flag is updated as described above, but at the timing of updating the move processing flag as described above, the record for which the move processing flag is to be updated may be deleted from the storage status information table DB, and the move processing flag and the move processing flag field 616 may be omitted.

[0096] In order to express the present invention, the present invention has been described adequately and sufficiently through the embodiments with reference to the drawings in the above description, but it should be recognized that those skilled in the art can easily change and / or improve the above-mentioned embodiments. Therefore, unless the changes or improvements made by those skilled in the art are at a level that departs from the scope of the claims described in the claims, the changes or improvements are interpreted as being included in the scope of the claims. [Explanation of symbols]

[0097] 1000 Waste storage status information recording device HM Height measurement unit CA Imaging Unit AR occupied area DB storage status information table LS detection and accommodation status information table 1. Detection and storage status acquisition unit 2. Control processing section 6 Memory section 21 Control section 22 Identification and extraction unit 23 Waste position calculation unit 24 Clock Section 25 Containment Status Update Division 26 Mixing object selection section 61 Storage status memory unit 62 Detection and storage state memory unit

Claims

1. a waste storage state storage unit that stores the storage state of the waste stored in the storage unit; a detection and storage state acquisition unit that acquires the storage state of the waste at a predetermined detection timing; a storage state update unit that compares the waste storage state stored in the waste storage state storage unit with the waste storage state acquired by the detection and storage state acquisition unit, updates the waste storage state stored in the waste storage state storage unit according to a result of the comparison, and stores the updated waste storage state in the waste storage state storage unit. Waste storage status information recording device.

2. The waste storage state is represented by at least a three-dimensional position of the waste and a type of the waste.

2. A waste storage state information recording device according to claim 1.

3. The waste storage state storage unit further stores whether or not the waste has been moved.

3. A waste storage state information recording device according to claim 2.

4. The waste storage state storage unit further stores whether or not the surface of the waste stored in the storage unit is exposed to the waste.

3. A waste storage state information recording device according to claim 2.

5. The waste storage state is represented by at least a three-dimensional position of the waste and a type of the waste; The detection and storage state acquisition unit a height measuring unit for measuring the height of the waste contained in the storage unit; an imaging unit in the storage unit that generates an image of the waste stored in the storage unit; an identification and extraction unit that identifies and extracts an area occupied by the waste for each type of the waste in the image of the waste generated by the imaging unit; a waste position calculation unit that calculates, for each waste occupation area extracted by the identification and extraction unit, a three-dimensional position of the waste occupation area as a three-dimensional position of the waste based on the height measured by the height measurement unit and the image of the waste generated by the imaging unit.

2. A waste storage state information recording device according to claim 1.

6. The storage state update unit resets the storage state of the waste stored in the waste storage state memory unit at a predetermined reset timing.

2. A waste storage state information recording device according to claim 1.

7. Further comprising an agitation target selection unit that selects an agitation target based on the storage state of the waste stored in the waste storage state storage unit, 2. A waste storage state information recording device according to claim 1.

8. a storage step of storing the storage state of the waste stored in the storage unit in a waste storage state storage unit; a detection and storage state acquisition step of acquiring a storage state of the waste at a predetermined detection timing; a storage state update step of comparing the waste storage state stored in the waste storage state storage unit with the waste storage state acquired in the detection and storage state acquisition step, updating the waste storage state stored in the waste storage state storage unit according to a result of the comparison, and storing the updated waste storage state in the waste storage state storage unit. Method for recording waste storage status information.

9. A waste storage state information recording program for causing a computer to function as the waste storage state information recording device according to any one of claims 1 to 7.

Citation Information

Patent Citations

  • Information processing apparatus, information processing method, and control program

    JP2019007633A

  • Refuse crane control system, refuse crane control method, information processor, and program

    JP2022029405A

  • Waste agitation state evaluation device and waste agitation state evaluation method

    JP2021117867A

Cited By

  • Control system, control method for the control system, and program

    JP7890498B1