Work management apparatus, work management system, work management method, and program

Abstract

To determine whether a task for a package to be performed by a driver of a vehicle is a task that falls within a predetermined scope, on the basis of a video.SOLUTION: Task information designation means designates task information indicating a predetermined task to be performed on a specific package, the task being determined with a consignor of the specific package, out of packages to be loaded onto or unloaded from a vehicle. Task information acquisition means acquires the task information designated by the task information designation means. Video data acquisition means acquires video data generated by imaging a task performed by a driver of the vehicle for the specific package. Task analysis means identifies a task performed by the driver on the basis of the video data. Determination means determines whether the task identified by the task analysis means is the predetermined task specified in the task information, and outputs a result of the determination.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present disclosure relates to a work management device, a work management system, a work management method, and a program. [Background technology]

[0002] In recent years, the logistics industry has been facing difficulties in securing drivers for vehicles that transport cargo. Therefore, in order to reduce the burden on drivers, measures to reduce and improve the efficiency of work associated with cargo transportation are being considered. Therefore, a method is required to analyze whether drivers are performing their work efficiently.

[0003] For example, Patent Document 1 proposes a video processing device that, based on information obtained by filming a worker's work, detects that a worker has performed work that differs from the instructions as inappropriate work. This allows the video processing device to immediately report the video of the inappropriate work. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Publication No. 2021-149422 Summary of the Invention [Problem to be solved by the invention]

[0005] In addition to driving a transport vehicle, a transport vehicle driver may also perform tasks such as loading and unloading cargo. However, if a driver is overwhelmed with tasks other than driving a transport vehicle, the efficiency of the driver's original work will decrease. Therefore, it is desirable for the driver to work within the scope of the work content agreed upon in advance with the customer and not perform any other work.

[0006] On the other hand, there may be cases where the customer requests the driver to perform work outside the scope of the agreement, such as loading and unloading luggage, at the departure or arrival points of the transportation. In this case, the driver may be forced to load and unload luggage.

[0007] In order to avoid a decline in the efficiency of drivers due to work outside the scope of the agreement, it is desirable for the transportation company, which is the employer that has contracted the transportation, to negotiate the work content with the customer based on the driver's actual work status. However, it is currently difficult for transportation companies to know the actual work status of drivers at the loading and unloading site. [Means for solving the problem]

[0008] A work management device according to one embodiment comprises a work information designation means for designating work information indicating predetermined work to be performed on a specific piece of cargo, which has been agreed upon with the shipper of the specific piece of cargo to be loaded onto or unloaded from a vehicle; a work information acquisition means for acquiring the work information designated by the work information designation means; a video data acquisition means for acquiring video data generated by capturing images of the work performed by the driver of the vehicle on the specific piece of cargo; a work analysis means for identifying the work performed by the driver based on the video data; and a determination means for determining whether the work identified by the work analysis means is the predetermined work specified in the work information and outputting the determination result.

[0009] A work management system according to one embodiment comprises an imaging means for imaging the work performed by the driver of a vehicle on cargo being loaded and unloaded onto the vehicle; a work information designation means for designating work information indicating predetermined work to be performed on specific cargo among the cargo being loaded and unloaded onto the vehicle, which is determined between the shipper of the specific cargo and the shipper; a work information acquisition means for acquiring the work information designated by the work information designation means; a video data acquisition means for acquiring video data generated by the imaging means capturing the work performed by the driver of the vehicle on the specific cargo; a work analysis means for identifying the work performed by the driver based on the video data; and a determination means for determining whether the work identified by the work analysis means is the predetermined work specified in the work information and outputting the determination result.

[0010] A work management method according to one embodiment specifies work information indicating predetermined work to be performed on a specific piece of cargo to be loaded and unloaded onto a vehicle, as determined between the shipper of the specific piece of cargo, acquires the specified work information, acquires video data generated by capturing images of the work performed by the driver of the vehicle on the specific piece of cargo, identifies the work performed by the driver based on the video data, determines whether the identified work is the predetermined work specified in the work information, and outputs the determination result.

[0011] A program in one embodiment causes a computer to perform the following processes: specifying work information indicating specified work to be performed on a specific piece of cargo, which has been agreed upon with the shipper of the specific piece of cargo to be loaded and unloaded onto a vehicle; acquiring the specified work information; acquiring video data generated by capturing images of the work performed by the driver of the vehicle on the specific piece of cargo; identifying the work performed by the driver based on the video data; and determining whether the identified work is the specified work specified in the work information and outputting the determination result. [Effects of the Invention]

[0012] According to the present disclosure, it is possible to determine, based on video, whether the work performed by the vehicle driver on luggage is within a specified range. [Brief explanation of the drawings]

[0013] [Figure 1] 1 is a diagram illustrating a schematic configuration of a work management system according to an embodiment; [Figure 2] FIG. 10 is a diagram illustrating a modified example of the work management system according to the embodiment. [Figure 3] FIG. 10 is a diagram illustrating a modified example of the work management system according to the embodiment. [Figure 4] 1 is a block diagram schematically illustrating a configuration of a work management device according to an embodiment; [Figure 5] 1 is a block diagram schematically illustrating a configuration of a work management device according to an embodiment; [Figure 6] FIG. 10 is a diagram illustrating an example of a work information designation database. [Figure 7] FIG. 10 is a diagram illustrating an example of a work information database. [Figure 8] 1 is a flowchart of an operation of a work management device according to an embodiment. [Figure 9] 1 is a block diagram schematically illustrating a configuration of a work management device according to an embodiment; [Figure 10] 1 is a flowchart of an operation of a work management device according to an embodiment. [Figure 11] 1 is a block diagram schematically illustrating a configuration of a work management device according to an embodiment; [Figure 12] 1 is a flowchart of an operation of a work management device according to an embodiment. [Figure 13] 1 is a block diagram schematically illustrating a configuration of a work management device according to an embodiment; [Figure 14] 1 is a flowchart of an operation of a work management device according to an embodiment. [Figure 15] FIG. 1 is a diagram illustrating an example of the configuration of a computer for realizing a work management device. DETAILED DESCRIPTION OF THE INVENTION

[0014] Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the drawings, the same elements are designated by the same reference numerals, and redundant explanations will be omitted as necessary.

[0015] When referring to one embodiment below, it means that the present invention can be applied to any one of the embodiments described below or a combination of two or more embodiments, and is not limited to a specific embodiment.

[0016] Embodiment 1 This section describes a work management system that monitors the work of a driver of a vehicle transporting luggage using video. FIG. 1 is a diagram that schematically illustrates the configuration of a work management system according to one embodiment. The work management system 1000 includes an imaging device 1 and a work management device 100. The imaging device 1, for example, captures images of a driver 4 driving a vehicle 2 working at the departure and arrival points of the vehicle 2 transporting luggage 3. In FIG. 1, the imaging device 1 is an imaging device that is fixedly installed at a specific location, such as a surveillance camera at the departure and arrival points of the vehicle 2. The imaging device 1 transmits captured video data DAT to the work management device 100. In FIG. 1, the work management device 100 and the imaging device 1 are, for example, connected via a cable 5 to enable bidirectional communication.

[0017] The imaging device 1 may be any of various imaging devices installed in the vehicle 2 that can capture images of the driver 4's work status, such as a camera installed in the vehicle 2 for use in autonomous driving (AD) or advanced driver-assistance systems (ADAS). FIG. 2 is a diagram illustrating a modified example of a work management system according to an embodiment. In the example of FIG. 2, the imaging device 1 is configured as a camera for ADAS and is installed so as to be able to capture images of, for example, the rear of a luggage compartment 2A of the vehicle 2. An openable door 2B is installed at the rear of the luggage compartment 2A of the vehicle 2. Baggage to be transported is loaded into the luggage compartment 2A with the door 2B open, and then unloaded from the luggage compartment 2A. In the example of FIG. 2, the imaging device 1 may transmit video data DAT to the work management device 100, for example, via various commonly used wired or communication lines or networks.

[0018] The work management device 100 is installed, for example, in a facility of an organization to which the driver 4 belongs, such as a delivery management center of a transportation company. However, the location where the work management device 100 is installed is not limited to this, and the work management device 100 may be installed in any location.

[0019] The imaging device 1 may also store the video data DAT in a storage device via various communication means. FIG. 3 is a diagram illustrating a modified example of a work management system according to an embodiment. In the example of FIG. 3, compared to the example of FIG. 2, a storage device 6 is further provided in the vehicle 2. The imaging device 1 stores the video data DAT in the storage device 6. This allows the storage device 6 to store video data DAT captured on multiple different occasions. The work management device 100 may acquire the video data DAT stored in the storage device 6 via any communication means as needed. The storage device 6 may be a storage device installed in the vehicle 2 or a storage device detachable from the vehicle 2. If the storage device 6 is detachable from the vehicle 2, for example, as shown in FIG. 3, when the vehicle 2 moves to a facility where the work management device 100 is installed, the storage device 6 may be detached from the vehicle 2 and connected to the work management device 100 via a cable 7. This allows the work management device 100 to acquire the video data DAT from the storage device 6 as needed.

[0020] The work management device 100 determines whether the work performed by the driver 4 at the work site is within the scope of the agreement with the customer, based on the video data DAT received from the imaging device 1. Then, the work management device 100 outputs the determination result DET.

[0021] 4 is a block diagram illustrating a configuration of a task management device according to an embodiment. The task management device 100 includes a video data acquisition unit 11, a task information designation unit 12, a task information acquisition unit 13, a task analysis unit 14, and a determination unit 15.

[0022] The video data acquisition unit 11 acquires the video data DAT to be analyzed from either or both of the imaging device 1 and the storage device 6 as appropriate.

[0023] The work information designation unit 12 acquires designation information S that designates the work information to be applied to the package included in the video data DAT based on the package identification information ID that identifies the package included in the video data DAT acquired by the video data acquisition unit 11.

[0024] The baggage identification information ID may be acquired, for example, by a driver or the like reading a slip attached to the baggage and inputting the information into a terminal, or by reading a barcode attached to the slip. The acquired baggage identification information ID may be linked to the video data DAT by the video data acquisition unit 11 or the work information designation unit 12.

[0025] The work information designation unit 12 designates work information corresponding to the package identification information ID by referring to a work information designation database stored in, for example, an external storage device or a storage device provided in the work management device 100. Then, the work information designation unit 12 outputs designation information S indicating the designated work information to the work information acquisition unit 13.

[0026] Fig. 5 is a block diagram showing a schematic configuration of a work management device according to an embodiment. In Fig. 5, work management device 100 is further provided with information database 10. Information database 10 stores work information specification database 10A and work information database 10B that defines the content of work information.

[0027] 6 is a diagram showing an example of a work information designation database. In the work information designation database 10A, a package identification information ID that identifies a package is linked to the corresponding designated work information. The package identification information ID is information for identifying each package, such as a slip number. The designated work information may be a symbol or number indicating the work information to be applied, or the name of the work information.

[0028] FIG. 7 is a diagram illustrating an example of a work information database. The work information database 10B includes multiple pieces of work information R, each of which specifies a task to be performed by a driver, as specified in one row of the table in FIG. 7 . The work information R is information specifying the work to be performed by the driver when loading and unloading cargo, as agreed upon in advance between the user of the driver 4 and the shipper. The specified work content may be specified, for example, by text, such as a contract concluded between the user of the driver 4 and the shipper or work instructions provided to the driver 4 by the user. In this case, the work information R may be extracted by manually reading the contract or work instructions to extract the types of work within the specified scope. Alternatively, the types of work within the specified scope may be extracted by applying a general natural language processing model to the contract or work instructions. The work information R may be composed of symbols, numbers, character strings, etc., indicating the extracted types of work. The work information R may be generated in advance according to the actual conditions of the contract or work instructions, such as for each cargo, each packaging style, or each shipper.

[0029] The work information acquisition unit 13 acquires work information R indicating the range of work to be performed on the package 3 from a work information database stored in an external storage device or a storage device provided in the work management device 100, based on the designation information S received from the information database 10. Here, the work information acquisition unit 13 acquires the designated work information R from the work information database 10B of the above-mentioned information database 10. The work information acquisition unit 13 outputs the acquired work information R to the determination unit 15.

[0030] The task analysis unit 14 inputs the video data DAT into the task determination model, and outputs the identification result of the driver's task contained in the video data DAT from the task determination model as the analysis result RES to the determination unit 15. The task analysis unit 14 can use various methods that function as a classifier that can identify the type of task of the driver contained in the video data DAT. For example, the task analysis unit 14 may be a trained model constructed by machine learning of training data consisting of video data captured on a site where the driver performs the task and a label indicating the task type. The video data included in the training data may be, for example, video data captured on video of tasks previously performed by multiple workers at a package delivery site.

[0031] The determination unit 15 compares the analysis result RES with the work information R and determines whether the video data DAT includes any non-standard work, which is work that is not specified as being performed by the driver in the work information R. Then, the determination unit 15 outputs the determination result DET. If multiple works are identified in the video data DAT, the determination result DET may include a determination result as to whether each work is a non-standard work.

[0032] The determination unit 15 can output the determination result DET in various ways. For example, the determination unit 15 may display text information or a diagram indicating the determination result DET on a display device such as a display. The determination unit 15 may also print and output the text information or a diagram indicating the determination result DET using a printer, for example. Furthermore, the determination unit 15 may output a sound notifying the user of the determination result DET using an audio output device such as a speaker, for example.

[0033] The following describes the operation of each element included in the work management apparatus 100. Fig. 8 is a flowchart of the operation of the work management apparatus according to one embodiment.

[0034] Step S11 The video data acquisition unit 11 acquires the video data DAT to be analyzed.

[0035] Step S12 The work information designation unit 12 refers to the information database 10 based on the package identification information ID, and acquires designation information S for the work information to be applied to the package included in the video data DAT.

[0036] Step S13 The work information acquisition unit 13 acquires work information R from the information database 10 based on the designation information S of the work information.

[0037] Step S14 The task analysis unit 14 inputs the video data DAT into the task determination model, and outputs an analysis result RES indicating the identification result of the driver's task included in the video data DAT.

[0038] Step S15 The determination unit 15 compares the analysis result RES with the work information R to determine whether the driver is performing an unspecified work.

[0039] Step S16 The determination unit 15 outputs a determination result DET.

[0040] As described above, the work management device 100 can suitably determine whether the driver 4 is performing work that deviates from the prescribed work set for each piece of luggage.

[0041] Then, by the work management device 100 outputting information about work that deviates from regulations, the employer of the driver 4 or the like can grasp the actual state of work that deviates from regulations. This allows the employer to warn the shipper not to have the driver perform work that does not conform to regulations. Furthermore, if there is a need for the employer to require the driver to perform work that is not included in the current regulations, the employer can negotiate with the shipper to revise the regulations or contract.

[0042] In this configuration, it is only necessary to define the work that the driver 4 should perform, and therefore the work content can be easily defined. Therefore, the work content can be defined more easily compared to the case where an unspecified work is defined, where it is difficult to predict what type of work it is. Furthermore, since it is only necessary to detect any work other than the defined work as an unspecified work, it is possible to accurately detect an unspecified work.

[0043] Therefore, by reducing the opportunities for the driver 4 to perform unspecified work, it is possible to reduce the burden on the driver 4. As a result, it is possible to improve the efficiency of package delivery and resolve the driver shortage.

[0044] Embodiment 2 In the first embodiment, the work information to be applied is selected according to the characteristics of the luggage. However, the work information may be selected based on other information. In the present embodiment, a work management device is described that selects work information by further using the characteristics of the driver 4.

[0045] 9 is a block diagram showing a schematic configuration of a work management device according to one embodiment. Work management device 200 has a configuration in which information database 10 and work information acquisition unit 13 of work management device 100 according to the first embodiment are replaced with information database 20 and work information acquisition unit 22, respectively. Work management device 200 also has a driver identification unit 21.

[0046] The information database 20 stores driver identification information DR for identifying each of a plurality of drivers, such as their appearances and characteristics. In addition, the work information is stored in association with the designation information S and the driver identification information DR.

[0047] The driver identification unit 21 appropriately references the driver identification information DR from the information database 20 to identify the person who is the driver 4 included in the video data DAT. Then, the driver identification unit 21 acquires the driver identification information DR corresponding to the identification result from the information database 20. The driver identification unit 21 outputs the acquired driver identification information DR to the work information acquisition unit 22.

[0048] The work information acquisition unit 22 acquires work information R indicating the range of work to be performed on the luggage 3 according to the identified driver from the information database 20 based on the driver identification information DR and the work information designation information S. The work information acquisition unit 22 outputs the acquired work information R to the determination unit 15.

[0049] Other configurations of the work management device 200 are similar to those of the work management device 100, so redundant explanations will be omitted.

[0050] Next, a description will be given of the operation of the work management apparatus 200. Fig. 10 is a flowchart of the operation of the work management apparatus according to one embodiment.

[0051] Steps S21 and S22 Steps S21 and S22 are similar to steps S11 and S12 in FIG. 8, respectively, and therefore will not be described again.

[0052] Step S23 The driver identification unit 21 acquires driver identification information DR from the information database 20 based on the person identification result of the video data DAT.

[0053] Step S24 The work information acquisition unit 22 acquires work information R corresponding to the identified driver from the information database 20 based on the driver identification information DR and the work information designation information S.

[0054] Steps S25 to S27 Steps S25 to S27 are similar to steps S14 to S16 in FIG. 8, respectively, and therefore will not be described again.

[0055] As described above, the work management device 200 can select appropriate work information in accordance with not only the characteristics of the cargo but also the characteristics of the driver, thereby making it possible to manage work in accordance with the characteristics of the driver.

[0056] Embodiment 3 In the first embodiment, the system is described as determining whether the driver is performing work outside the specified range, but it is also possible to add other work to be determined as appropriate. For example, it is possible that there are work tasks that the driver should be prohibited from performing to ensure work safety. Therefore, in this embodiment, a work management device is described that can also detect whether the driver has performed a work that is prohibited from the driver.

[0057] 11 is a block diagram illustrating a schematic configuration of a work management device according to an embodiment. The work management device 300 has a configuration in which the information database 10, the work information acquisition unit 13, and the determination unit 15 of the work management device 100 according to the first embodiment are replaced with an information database 30, a work information acquisition unit 31, and a determination unit 32, respectively.

[0058] The information database 30 of the work management device 300 further stores prohibited work information P that specifies the work that is prohibited for the driver.

[0059] The work information acquisition unit 31 acquires work information R indicating the range of work to be performed on the luggage 3 from the information database 30 based on the work information designation information S. The work information acquisition unit 31 also acquires prohibited work information P from the information database 30. The work information acquisition unit 31 outputs the acquired work information R and prohibited work information P to the determination unit 32.

[0060] Similar to the determination unit 15, the determination unit 32 determines whether the driver 4 is performing an unspecified task based on the analysis result RES and the task information R. Furthermore, the determination unit 32 determines whether the driver is performing a task that is prohibited for drivers based on the analysis result RES and the prohibited task information P.

[0061] Other configurations of the work management device 300 are the same as those of the work management device 100, so duplicated explanations will be omitted.

[0062] Next, a description will be given of the operation of the work management apparatus 300. Fig. 12 is a flowchart of the operation of the work management apparatus according to one embodiment.

[0063] Steps S31 to S33 Steps S31 to S33 are similar to steps S11 to S13 in FIG. 8, respectively, and therefore will not be described again.

[0064] Step S34 The work information acquisition unit 31 further acquires prohibited work information P from the information database 30.

[0065] Steps S35 and S36 Steps S35 and S36 are similar to steps S14 and S15 in FIG. 8, respectively, and therefore will not be described again.

[0066] Step S37 Based on the analysis result RES and the prohibited work information P, the determination unit 32 determines whether the driver is performing a work that is prohibited for drivers.

[0067] Step S38 The determination unit 32 combines the determination results in steps S36 and S37 and outputs them as a determination result DET.

[0068] As described above, the work management device 300 can detect whether the driver is performing not only unspecified work but also prohibited work. Therefore, based on the detection results, the user of the work management device 300 can warn the driver or provide guidance to prevent prohibited work. This can reduce the risk of the driver performing dangerous work, for example, and ensure the driver's safety.

[0069] Embodiment 4 In the above embodiment, the detection of irregular work performed by a driver was described. However, even if an operation is irregular according to an agreement with a customer, the operation or behavior performed by a driver may include operations that do not need to be detected as irregular work. For example, in addition to working with luggage, a driver may also walk, exercise, or eat during a break. It is considered that such actions commonly performed by humans do not need to be detected even if they are irregular. Therefore, in this embodiment, a work management device is described that can avoid detecting predetermined permissible work as irregular work even if a driver's behavior corresponds to irregular work.

[0070] 13 is a block diagram illustrating a configuration of a work management device according to an embodiment. The work management device 400 has a configuration in which the information database 10, the work information acquisition unit 13, and the determination unit 15 of the work management device 100 according to the first embodiment are replaced with an information database 40, a work information acquisition unit 41, and a determination unit 42, respectively.

[0071] The information database 40 of the work management device 400 further stores allowable work information AL that defines actions performed by the driver that are not detected as unspecified work even if they correspond to unspecified work.

[0072] The work information acquisition unit 41 acquires work information R indicating the range of work to be performed on the luggage 3 from the information database 40 based on the work information designation information S. The work information acquisition unit 41 also acquires allowable work information AL from the information database 40. The work information acquisition unit 41 outputs the acquired work information R and allowable work information AL to the determination unit 42.

[0073] Similar to the determination unit 15, the determination unit 42 determines whether the driver 4 is performing an unspecified task based on the task information R. The determination unit 42 also determines whether the task detected as an unspecified task based on the task information R is an allowable task indicated by the allowable task information AL. The determination unit 42 then outputs the determination result DET.

[0074] Other configurations of the work management device 400 are the same as those of the work management device 100, so duplicated explanations will be omitted.

[0075] Next, a description will be given of the operation of the work management apparatus 400. Fig. 14 is a flowchart of the operation of the work management apparatus according to one embodiment.

[0076] Steps S41 to S43 Steps S41 to S43 are similar to steps S11 to S13 in FIG. 8, respectively, and therefore will not be described again.

[0077] Step S44 The work information acquisition unit 41 further acquires allowable work information AL from the information database 40.

[0078] Steps S45 and S46 Steps S45 and S46 are similar to steps S14 and S15 in FIG. 8, respectively, and therefore will not be described again.

[0079] Step S47 The determination unit 42 determines whether the work detected as an unspecified work in step S46 is an allowable work indicated by the allowable work information AL, and then excludes the work that corresponds to the allowable work from the unspecified work.

[0080] Step S48 After step S47, the determination unit 42 outputs a determination result DET indicating the determination result as to whether or not the work performed on the video data DAT is an unspecified work.

[0081] As a result, the work management device 400 can avoid detecting permissible work as irregular work even when the driver's behavior corresponds to irregular work. This makes it possible to accurately detect irregular work that should actually be detected.

[0082] Other embodiments Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above-described embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. Furthermore, each embodiment can be combined with other embodiments as appropriate.

[0083] The work management apparatus 300 according to the third embodiment has been described as a modified example of the work management apparatus 100 according to the first embodiment. However, the work management apparatus 300 may also acquire work information based on the driver's identification information, as in the second embodiment.

[0084] The work management apparatus 400 according to the fourth embodiment has been described as a modified example of the work management apparatus 100 according to the first embodiment. However, the work management apparatus 400 may also acquire work information based on the driver's identification information, as in the second embodiment. The work management apparatus 400 may also determine whether or not a prohibited work has been performed, as in the third embodiment. Furthermore, the work management apparatus 400 may also combine the acquisition of work information based on the driver's identification information with the determination of whether or not a prohibited work has been performed.

[0085] The work defined by the work information may be updated as needed by the user of the work management device giving an instruction to change the work information to the work management device in accordance with an agreement with the customer.

[0086] The user of the work management device may update the work defined as prohibited work and permissible work as appropriate by providing the work management device with prohibited work designation information and permissible work designation information, which specify the work defined as prohibited work and permissible work, respectively, depending on the judgment results.

[0087] In the above embodiment, the work information acquisition unit 13 and the determination unit 15 are described separately, but this is merely for convenience of explanation. For example, the work information acquisition unit 13 and the determination unit 15 may be constructed as a model that performs similar determination processing based on video data and work information.

[0088] In the above-described embodiment, the model used by the work analysis unit 14 may be re-learned in accordance with information indicating the appropriateness of the determination result DET given to the work management device by a user who uses the determination result DET. Furthermore, the determination criteria in the determination unit 15 may be changed in accordance with the information indicating the appropriateness of the determination result DET.

[0089] In the above embodiment, video data is used, but the video data is not limited to video data. The video data may be a single still image, a frame-by-frame video consisting of a set of multiple still images, or the like.

[0090] In the above-described embodiment, the work management device according to the present disclosure has been described primarily as a hardware configuration, but this is not limited thereto. It is also possible to realize the work management device according to the present disclosure by having a computer execute a computer program to perform any process. These processes may be realized by having a computer including at least one processor (e.g., a microprocessor, CPU, GPU, MPU, or DSP (Digital Signal Processor)) execute the program. Specifically, one or more programs including instructions for causing a computer to perform these algorithms related to transmission signal processing or reception signal processing may be created, and the programs may be supplied to the computer.

[0091] A computer program can be stored and supplied to a computer using various types of non-transitory computer-readable media. Non-transitory computer-readable media include various types of tangible storage media. Examples of non-transitory computer-readable media include magnetic storage media (e.g., flexible disks, magnetic tapes, hard disk drives), magneto-optical storage media (e.g., magneto-optical disks), CD-ROMs (Read Only Memory), CD-Rs, CD-R / Ws, and semiconductor memories (e.g., mask ROMs, PROMs (Programmable ROMs), EPROMs (Erasable PROMs), flash ROMs, and RAMs (Random Access Memory)). The program may also be supplied to a computer by various types of transitory computer-readable media. Examples of transitory computer-readable media include electrical signals, optical signals, and electromagnetic waves. The transitory computer-readable media can supply the program to a computer via a wired communication path such as an electric wire or optical fiber, or via a wireless communication path.

[0092] An example of the configuration of a computer for realizing the work management device is shown below. Fig. 15 is a diagram showing an example of the configuration of a computer for realizing the work management device. The work management device can be realized by a computer 9000, such as a dedicated computer or a personal computer (PC). However, the computer does not need to be physically single; multiple computers may be used when performing distributed processing. As shown in Fig. 15, the computer 9000 includes, for example, a processor 9001, a ROM (Read Only Memory) 9002, a RAM (Random Access Memory) 9003, a storage unit 9004, a communication interface 9005, and a user interface 9006.

[0093] The processor 9001, ROM 9002, RAM 9003, storage unit 9004, communication interface 9005, and user interface 9006 are connected to each other so as to be able to communicate with each other via a bus 9007. Note that although explanation of OS software for operating the computer is omitted, it is also installed in the computer 9000 as appropriate.

[0094] The ROM is configured by, for example, a nonvolatile semiconductor memory device, etc. The ROM 9002 stores information such as various programs used by the computer 9000.

[0095] The storage unit 9004 is configured by various storage devices such as a hard disk, a solid state disk, etc. Furthermore, the storage unit 9004 is not limited to a storage device installed in the computer 9000, but may be a storage device external to the computer 9000. The external storage device may be a cloud storage connected to the computer 9000 via various communication means, for example, a network. The storage unit 9004 stores information such as various programs and data used by the computer 9000.

[0096] The RAM 9003 is configured by a volatile semiconductor memory device, etc. Programs, data, and other information used by the processor 9001 are loaded into the RAM 9003 from one or both of the ROM 9002 and the storage unit 9004 as appropriate.

[0097] The processor 9001 may be configured with, for example, a CPU (Central Processing Unit). The processor 9001 may also include not only a CPU but also a GPU (Graphics Processing Unit). A GPU is suitable for performing routine processing in parallel, and when applied to processing in a neural network, for example, it can improve processing speed compared to a CPU. The processor 9001 executes various processes based on various programs stored in the ROM 9002 or various programs and data held in the RAM 9003, as appropriate. The processor 9001 may also store data generated by processing in the RAM 9003 or the storage unit 9004, as appropriate.

[0098] The communication interface 9005 is an interface that connects the computer 9000 to a communication network such as the Internet or an intranet via various wired communication means or wireless communication means, etc. This allows the computer 9000 to communicate with other devices, systems, sensors, etc. that are connected to the communication network.

[0099] The user interface 9006 includes, for example, a display unit that provides information so that the user can recognize it using a display device or the like, and an audio output unit that outputs audio. The user interface 9006 also includes an input unit that allows the user to input information to the computer 9000 by operating a keyboard, mouse, touch panel, or the like. The user interface 9006 may also include devices such as sensors that obtain information useful to the user.

[0100] Although the computer 9000 has been described as a single device here, this is merely an example. The computer 9000 may be composed of multiple physically separated devices. Some of the multiple devices may be portable devices, and other devices may be stationary devices.

[0101] Each drawing is merely an example for describing one or more embodiments. Each drawing may relate not only to one particular embodiment, but also to one or more other embodiments. As will be understood by those skilled in the art, various features or steps described with reference to any one drawing can be combined with features or steps shown in one or more other drawings to create, for example, an embodiment not explicitly shown or described. Not all features or steps shown in any one drawing are necessary to describe an exemplary embodiment, and some features or steps may be omitted. The order of steps described in any drawing may be changed as appropriate.

[0102] A part or all of the above-described embodiments can be described as, but not limited to, the following supplementary notes.

[0103] (Supplementary Note 1) A work management device comprising: a work information designation means for designating work information indicating predetermined work to be performed on a specific piece of cargo, which has been agreed upon with the shipper of the specific piece of cargo to be loaded onto or unloaded from a vehicle; a work information acquisition means for acquiring the work information designated by the work information designation means; a video data acquisition means for acquiring video data generated by capturing images of the work performed by the driver of the vehicle on the specific piece of cargo; a work analysis means for identifying the work performed by the driver based on the video data; and a determination means for determining whether the work identified by the work analysis means is the predetermined work specified in the work information, and outputting a determination result.

[0104] (Appendix 2) The work management device described in Appendix 1, wherein the work analysis means inputs the video data to be estimated into a model constructed by pre-machine learning of learning data consisting of learning video data capturing work performed by a vehicle driver and label information indicating the content of the work linked to the learning video data, and outputs an identification result of the work performed by the driver contained in the video data from the model, and the judgment means outputs the judgment result based on the identification result and the work information.

[0105] (Appendix 3) A work management device as described in Appendix 2, wherein the work analysis means re-learns the model based on information indicating the appropriateness of the judgment result, or the judgment means changes the criteria for judging whether the work identified by the work analysis means is the specified work specified in the work information.

[0106] (Appendix 4) A work management device described in any one of Appendices 1 to 3, wherein the work information is extracted from a document indicating the specified work to be performed on the specific package, as determined between the shipper of the specific package and the work management device.

[0107] (Appendix 5) A work management device described in any one of Appendices 1 to 4, wherein the work information acquisition means acquires prohibited work information indicating prohibited work that the driver is prohibited from performing, and the determination means determines whether the work identified by the work analysis means is the prohibited work.

[0108] (Appendix 6) A work management device described in any one of Appendices 1 to 5, wherein the work information acquisition means acquires permissible work information indicating permissible work that the driver is permitted to perform, and the determination means excludes, from the work that is determined to not be the specified work specified in the work information, work that falls under the permissible work.

[0109] (Supplementary Note 7) The work management device according to Supplementary Note 6, wherein the allowable work information is designated in accordance with allowable work designation information that designates the allowable work.

[0110] (Supplementary Note 8) The work management device according to Supplementary Note 5, wherein the prohibited work information is designated in accordance with prohibited work designation information that designates the prohibited work.

[0111] (Appendix 9) A cargo management system comprising: an imaging means for imaging work performed by a driver of a vehicle on cargo being loaded and unloaded onto the vehicle; a work information designation means for designating work information indicating predetermined work to be performed on a specific cargo among the cargo being loaded and unloaded onto the vehicle, which work information is determined between the shipper of the specific cargo and the shipper; a work information acquisition means for acquiring the work information designated by the work information designation means; a video data acquisition means for acquiring video data generated by the imaging means capturing the work performed by the driver of the vehicle on the specific cargo; a work analysis means for identifying the work performed by the driver based on the video data; and a determination means for determining whether the work identified by the work analysis means is the predetermined work specified in the work information, and outputting a determination result.

[0112] (Appendix 10) A cargo management method that specifies work information indicating predetermined work to be performed on a specific cargo among the cargo to be loaded and unloaded onto a vehicle, as determined between the shipper of the specific cargo, acquires the specified work information, acquires video data generated by capturing images of the work performed by the driver of the vehicle on the specific cargo, identifies the work performed by the driver based on the video data, determines whether the identified work is the predetermined work specified in the work information, and outputs the determination result.

[0113] (Appendix 11) A program that causes a computer to execute the following processes: a process of specifying work information indicating predetermined work to be performed on a specific piece of cargo, which has been agreed upon with the shipper of the specific piece of cargo to be loaded onto or unloaded from a vehicle; a process of acquiring the specified work information; a process of acquiring video data generated by capturing images of the work performed by the driver of the vehicle on the specific piece of cargo; a process of identifying the work performed by the driver based on the video data; and a process of determining whether the identified work is the predetermined work specified in the work information and outputting the determination result. [Explanation of symbols]

[0114] 1. Imaging device 2 vehicles 2A Luggage compartment 2B Door 3. Luggage 4. Driver 5, 7 Cable 6 Storage device 10, 20, 30, 49 Information Database 11 Video data acquisition unit 12 Work information specification section 13, 22, 31, 41 Work information acquisition unit 14 Work Analysis Department 15, 32, 42 Judgment section 21 Driver Identification Unit 100, 200, 300, 400 work management device 1000 Work Monitoring System 9000 computers 9001 processor 9002 ROM 9003 RAM 9004 Storage section 9005 Communication Interface 9006 User Interface 9007 Bus AL Allowable Work Information P Prohibited work information DAT video data DET judgment result DR Driver Identification Information ID Baggage identification information R Work Information RES analysis results S Specification information

Claims

1. a work information specifying means for specifying work information indicating a predetermined work to be performed on a specific piece of cargo, which is determined between the cargo owner and the specific piece of cargo to be loaded onto or unloaded from a vehicle; a work information acquisition means for acquiring the work information designated by the work information designation means; a video data acquisition means for acquiring video data generated by capturing an image of an operation performed by a driver of the vehicle on the specific luggage; task analysis means for identifying tasks performed by the driver based on the video data; a determination means for determining whether the work identified by the work analysis means is the predetermined work defined in the work information and outputting a determination result. Work management device.

2. the task analysis means inputs the video data to be estimated into a model constructed by pre-machine learning of learning data consisting of learning video data capturing tasks performed by a vehicle driver and label information associated with the learning video data, and outputs an identification result of the task performed by the driver contained in the video data from the model; The determination means outputs the determination result based on the identification result and the work information. The work management device according to claim 1 .

3. Based on information indicating the suitability of the judgment result, The task analysis means retrains the model, or the determination means changes the criteria for determining whether the work identified by the work analysis means is the predetermined work specified in the work information. The work management device according to claim 2 .

4. The work information is extracted from a document that indicates the predetermined work to be performed on the specific package, which is agreed upon between the shipper of the specific package and the shipper. The work management device according to claim 1 or 2.

5. the work information acquisition means acquires prohibited work information indicating prohibited work that the driver is prohibited from performing, the determination means determines whether the work identified by the work analysis means is the prohibited work. The work management device according to claim 1 or 2.

6. the work information acquisition means acquires permissible work information indicating permissible work that the driver is permitted to perform, the determination means excludes, from among the works determined not to be the predetermined works specified in the work information, those works that fall under the allowable works, from the works determined not to be the predetermined works specified in the work information; The work management device according to claim 1 or 2.

7. The allowable work information is specified in accordance with allowable work designation information that designates the allowable work. The work management device according to claim 6.

8. an imaging means for imaging an operation performed by a driver of the vehicle regarding a load being loaded onto or unloaded from the vehicle; a work information designation means for designating work information indicating a predetermined work to be performed on a specific piece of cargo, which is determined between the cargo owner and the specific piece of cargo to be loaded onto and unloaded from the vehicle; a work information acquisition means for acquiring the work information designated by the work information designation means; a video data acquisition means for acquiring video data generated by the imaging means capturing an image of an operation performed by the driver of the vehicle with respect to the specific baggage; task analysis means for identifying tasks performed by the driver based on the video data; a determination means for determining whether the work identified by the work analysis means is the predetermined work defined in the work information and outputting a determination result. Work management system.

9. Specifying work information indicating a predetermined work to be performed on a specific piece of cargo, which is determined between the shipper of the specific piece of cargo and the shipper of the specific piece of cargo to be loaded onto or unloaded from the vehicle; Acquire the specified work information; acquiring video data generated by capturing an image of an operation performed by a driver of the vehicle on the specific load; Identifying an operation performed by the driver based on the video data; determining whether the identified work is the predetermined work defined in the work information, and outputting the determination result; Work management methods.

10. A process of designating work information indicating a predetermined work to be performed on a specific piece of cargo, which is determined between the cargo owner and the specific piece of cargo to be loaded onto or unloaded from a vehicle; A process of acquiring the specified work information; A process of acquiring video data generated by capturing an image of an operation performed by a driver of the vehicle on the specific luggage; A process of identifying an operation performed by the driver based on the video data; determining whether the identified work is the predetermined work defined in the work information and outputting the determination result; program.

Images