Work time management system

Abstract

To provide an efficient work time management system which reduces human cost for managing work time of a vehicle.SOLUTION: A work time management system 1 includes: an acquisition unit 31 which acquires a video captured by an imaging apparatus 11; vehicle detection means 33 which detects the presence of a predetermined vehicle (concrete mixer truck) from the video acquired by the acquisition means 31; vehicle identification information recognition means 34 which recognizes identification information (vehicle registration number) of the vehicle; work time determination means 36 which determines the time at which the vehicle is detected from the acquired video and the identification information of the vehicle is recognized, as work start time, and determines the time at which the vehicle is no longer detected from the acquired video and the identification information of the vehicle is no longer recognized after the start of the work, as work completion time; and work status determination means 37 which associates the work start time and work completion time determined by the work time determination means 36 with the identification information of the vehicle to determine work status.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to a work time management system, and more particularly to a work time management system for managing the work time of special-purpose vehicles such as mixer trucks. [Background technology]

[0002] Traditionally, there have been vehicles commonly known as mixer trucks that transport and supply ready-mixed concrete produced in plants to construction sites. To ensure the quality of ready-mixed concrete, the Japanese Industrial Standards (JIS) stipulate that the entire process from the start of mixing at the plant to the end of unloading must be completed within a set time. Therefore, for mixer trucks, not only must entry and exit from the actual construction site be managed, but time management from the start of unloading to the completion of unloading is also required. Furthermore, when multiple mixer trucks are used to transport ready-mixed concrete, unloading is carried out in order from the first mixer truck to arrive, so it is also important to keep track of each mixer truck individually.

[0003] In the past, managing the entry and exit of mixer trucks to and from construction sites, as well as managing the time from the start to the completion of unloading, required the allocation of personnel, which resulted in high personnel costs. Furthermore, the more multiple mixer trucks enter and exit a construction site, the more complicated the management becomes, so a system that can manage the time more efficiently for each individual vehicle was needed.

[0004] As a technology for managing the entry and exit of special-purpose vehicles such as mixer trucks, for example, Patent Document 1 discloses a vehicle tracking system for tracking vehicles such as refuse collection trucks at waste treatment facilities. The vehicle tracking system includes an imaging device that captures bird's-eye images of a platform PF including a vehicle parking area PA and a slow-down area SA, and an image processing device that analyzes the captured images obtained in time series by the imaging device to track the position of the vehicles. The platform PF is set as a vehicle tracking area, and is configured to track the position of each vehicle within the platform PF using the image processing device.

[0005] The image processing device performs vehicle detection using the learning model MD, extracts a detection area including the target vehicle from the captured image at each time point, and derives the movement trajectory of the target vehicle by, for example, identifying the center coordinates of the extracted detection areas as the vehicle position. Two reference lines, a first reference line and a second reference line, are set in advance near the parking area PA, and entry and exit of the vehicle to the parking area PA is determined based on whether the derived movement trajectory of the vehicle crosses the area between the first reference line and the second reference line. This makes it possible to count the number of vehicles parked in the parking area PA. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] Japanese Patent Publication No. 2023-125865 Summary of the Invention [Problem to be solved by the invention]

[0007] Conventional image processing systems such as the one in Patent Document 1 can count the number of parked vehicles by distinguishing between garbage collection vehicles and general vehicles using an image processing device, and can count the number of parked vehicles by vehicle type. However, they do not distinguish between each garbage collection vehicle individually and manage the working hours, etc., of each vehicle.

[0008] The present invention has been made to solve the above-mentioned problems, and aims to provide an efficient work time management system that reduces personnel costs and manages specific work times for each vehicle. [Means for solving the problem]

[0009] In order to achieve the above object, the invention described in claim 1 is a work time management system for managing work time for specified vehicle work, comprising: a photographing device including an imaging means for continuously capturing images within a predetermined parking area that has been set in advance; a server connected to the photographing device via a predetermined network; and a plurality of various communication terminals that can be carried by multiple users and can be connected to the server via the predetermined network, wherein the server comprises: an acquisition unit that acquires the image captured from the photographing device; a vehicle detection means that detects the presence of a vehicle in the image acquired by the acquisition unit; a vehicle identification information recognition means that recognizes the vehicle's identification information from the image acquired by the acquisition unit; a work time determination means that determines, as the work start time, the time when both the vehicle detection means and the vehicle's identification information recognition means have detected the vehicle from the image acquired by the acquisition unit, and determines, as the work end time, the time when the vehicle is no longer detected or the vehicle's identification information is no longer recognized from the image acquired by the acquisition unit after the work has started; and a work status determination means that links the work start time and work end time determined by the work time determination means to the vehicle's identification information to determine the work status, and the communication terminal comprises a display unit that displays the work status determined by the work status determination means.

[0010] The invention described in claim 2 is the configuration of the invention described in claim 1, wherein the photographing device further includes an audio acquisition means for acquiring audio generated at the work site, the acquisition unit acquires the audio acquired by the audio acquisition means, and the server further includes an audio recognition means for recognizing predetermined work sounds that occur twice in association with predetermined work from the audio acquired by the acquisition unit, and the work time determination means, when there is a work period that includes the occurrence time of the predetermined work sound recognized by the audio recognition means, determines the occurrence time of the first work sound of the predetermined work sounds recognized by the audio recognition means as a corrected work start time and determines the occurrence time of the second work sound as a corrected work end time, corrects the work start time determined by the work time determination means to match the corrected work start time, and corrects the work end time determined by the work time determination means to match the corrected work end time, and the work status determination means determines the work status by linking the work start time and work end time corrected by the work time determination means to the vehicle identification information.

[0011] The invention described in claim 3 is a configuration of the invention described in claim 1, in which the photographing device further includes an audio acquisition means for acquiring audio generated at the work site, the acquisition unit acquires the audio acquired by the audio acquisition means, the server further includes an audio recognition means for recognizing a first work sound generated in conjunction with the start of a specified work from the audio acquired by the acquisition unit, the work time determination means, if there is a work time that includes the occurrence time of the first work sound recognized by the audio recognition means, determines the occurrence time of the first work sound as a corrected work start time and corrects the most recent work start time determined by the work time determination means to match it with the corrected work start time, and the work status determination means links the work start time corrected by the work time determination means to the vehicle's identification information to determine the work status.

[0012] The invention described in claim 4 is configured in such a way that, in the invention described in claim 3, the voice recognition means can recognize from the acquired voices that they are different from the first work sound and recognize a second work sound that occurs upon completion of a specified work, the work time determination means, if there is a work time that includes the occurrence time of the second work sound recognized by the voice recognition means, determines the occurrence time of the second work sound as a corrected work end time and corrects the most recent work end time determined by the work time determination means to match it with the corrected work end time, and the work status determination means determines the work status by linking the work end time corrected by the work time determination means to the vehicle's identification information.

[0013] The invention described in claim 5 is the configuration of the invention described in claim 1, wherein the vehicles include at least a first vehicle and a second vehicle that performs work after the first vehicle, there is a time period when the first vehicle and the second vehicle are parked side by side, the specified parking area is set to a first range in which the first vehicle is imaged and a second range in which the second vehicle is imaged, the acquisition unit acquires images for each of the first range and the second range, the vehicle detection means and the vehicle identification information recognition means each detect vehicles and recognize vehicle identification information for each of the first range and the second range, the work time determination means determines the work start time and work end time for each of the first vehicle and the second vehicle, and the work status determination means determines the work status by linking the work start time and work end time determined by the work time determination means for each of the first vehicle and the second vehicle with the vehicle identification information.

[0014] The invention of claim 6 is the configuration of the invention of claim 5, wherein the image capturing device further includes an audio capturing means for capturing audio generated at the work site, the capturing unit captures the audio captured by the audio capturing means, and the server further includes an audio recognition means for recognizing predetermined work sounds that are generated multiple times in association with predetermined work from the audio captured by the capturing unit, and the work time determination means, when there is a work period including the occurrence time of the predetermined work sound recognized by the audio recognition means, determines the occurrence time of a first occurrence of the predetermined work sound recognized by the audio recognition means as the corrected work start time of the first vehicle, corrects the most recent work start time determined by the work time determination means to match it with the corrected work start time of the first vehicle, and determines the occurrence time of a second occurrence of the predetermined work sound recognized by the audio recognition means as the corrected work end time of the first vehicle. the most recent work end time determined by the work time determination means is corrected to match the corrected work end time of the first vehicle, the time when the third work sound of the predetermined work sounds recognized by the voice recognition means is determined to be the corrected work start time of the second vehicle, the most recent work start time determined by the work time determination means is corrected to match the corrected work start time of the second vehicle, the time when the fourth work sound of the predetermined work sounds recognized by the voice recognition means is determined to be the corrected work end time of the second vehicle, and the most recent work end time determined by the work time determination means is corrected to match the corrected work end time of the second vehicle, and the work status determination means determines the work status for each of the first and second vehicles by linking the work start time and work end time corrected by the work time determination means to the vehicle identification information. [Effects of the Invention]

[0015] According to the work time management system of the present invention, work start times and work end times can be managed by linking them to vehicles on a network, thereby reducing personnel costs and providing an efficient work time management system. [Brief explanation of the drawings]

[0016] [Figure 1] FIG. 1 is a schematic diagram showing the overall configuration of a work time management system according to the present invention. [Figure 2] System configuration diagram of the work time management system shown in Figure 1 [Figure 3] FIG. 2 is a functional block diagram showing an example of the imaging device, server, and communication terminal that make up the work time management system shown in FIG. 1. [Figure 4] Flowchart showing the process flow of the work time management system shown in Figure 1 [Figure 5] Schematic diagram showing a state in which a vehicle is parked in a parking area [Figure 6] FIG. 6 is a diagram illustrating an example of a display screen of a communication terminal showing a state in which the vehicle shown in FIG. 5 has started work; [Figure 7] FIG. 6 is a diagram illustrating an example of a display screen of the communication terminal showing a state in which the vehicle shown in FIG. 5 has completed work. [Figure 8] FIG. 1 is a schematic diagram showing the overall configuration of another work time management system according to the present invention. [Figure 9] FIG. 1 is a schematic diagram illustrating a state in which a first vehicle is parked in a first range of a parking area; [Figure 10] FIG. 1 is a schematic diagram showing a state in which a first vehicle is working in a first range of the parking area and a second vehicle is parked in a second range of the parking area; [Figure 11] FIG. 11 is a diagram illustrating an example of a display screen of a communication terminal showing the work status of the first vehicle and the second vehicle shown in FIG. 10; [Figure 12] FIG. 1 is a schematic diagram showing a state in which a first vehicle has left a first area, a second vehicle is working in a second area of ​​the parking area, and a third vehicle is attempting to park in the first area. [Figure 13] FIG. 13 is a diagram illustrating an example of a display screen of a communication terminal showing the work status of the first vehicle, the second vehicle shown in FIG. 12, and the third vehicle; [Figure 14] FIG. 10 is a schematic diagram showing a state in which a third vehicle is working in a first range of the parking area; [Figure 15] FIG. 15 is a diagram illustrating an example of a display screen of a communication terminal showing the work status of the second vehicle and the third vehicle shown in FIG. 14; [Figure 16] FIG. 1 is a functional block diagram showing an example of a photographing device, a server, and a communication terminal that constitute another work time management system of the present invention. [Figure 17] A schematic diagram showing the relationship between the determination of work start time and work end time by vehicle detection and recognition of vehicle identification information, and the correction of work start time and work end time by voice. [Figure 18] A flowchart showing the process flow of the work time management system shown in FIG. 16. [Figure 19] FIG. 10 is a diagram illustrating an example of a display screen of a communication terminal showing a state in which a vehicle is waiting. [Figure 20] FIG. 10 is a diagram illustrating an example of a display screen of a communication terminal showing a state in which a vehicle is being worked on; [Figure 21] FIG. 10 is a diagram illustrating an example of a display screen of a communication terminal showing a state in which a vehicle has completed work. [Figure 22] A schematic diagram showing the relationship between the determination of work start time and work end time by vehicle detection and recognition of vehicle identification information, and the correction of work start time and work end time by voice. [Figure 23] FIG. 10 is a diagram illustrating an example of a display screen of a communication terminal showing the work status of a first vehicle and a second vehicle. [Figure 24] FIG. 10 is a diagram illustrating an example of a display screen of a communication terminal showing the work status of a first vehicle, a second vehicle, and a third vehicle. [Figure 25] FIG. 10 is a diagram illustrating an example of a display screen of a communication terminal showing the work status of a second vehicle and a third vehicle. DETAILED DESCRIPTION OF THE INVENTION

[0017] FIG. 1 is a schematic diagram showing the overall configuration of a work time management system according to the present invention.

[0018] Referring to FIG. 1, the work time management system 1 in the first embodiment manages the predetermined work time of a vehicle, and in this first embodiment, manages the time related to the unloading of ready-mixed concrete from a mixer truck (hereinafter, when simply referring to "unloading" or "work," this refers to the unloading of ready-mixed concrete). Note that the vehicle may be a special-purpose vehicle other than a mixer truck, or a vehicle for various other work purposes. Furthermore, the work may be other work, such as the unloading of asphalt mixture from an asphalt transport truck.

[0019] The construction site 3, which is a work site where the work hours of the mixer truck 4 are managed by the work time management system 1, consists of a parking area 7 where the mixer truck 4 is parked when unloading, a construction area 8 where the actual construction of the building takes place, and a pump truck 5 between the parking area 7 and the construction area 8 that receives ready-mixed concrete from the mixer truck 4 and sends it to the construction area 8.

[0020] A photographing device 11, which will be described later, is installed next to the pump truck 5 in order to photograph the mixer truck from behind. Note that the photographing device 11 may be placed in a position other than next to the pump truck, as long as it can photograph the mixer truck 4 and the vehicle identification information (vehicle registration number) of the mixer truck 4, which will be described later, within the parking area 7.

[0021] FIG. 2 is a system configuration diagram of the work time management system shown in FIG. 1, and FIG. 3 is a functional block diagram showing an example of the photographing device, server, and communication terminal that make up the work time management system shown in FIG. 1.

[0022] Referring to Figures 1 to 3, the work time management system 1 has a photographing device 11 including an imaging means 21 that continuously captures images within a predetermined parking area 7, a server 13 connected to the photographing device 11 via a predetermined network (Internet 12), and a variety of communication terminals 15 that can be carried by a plurality of users 16 and can be connected to the server 13 via the predetermined network (Internet 14).

[0023] In this first embodiment, the predetermined parking area 7 that has been set up in advance is the area in which the mixer truck 4 is parked when unloading. This parking area 7 is not limited to the planar area where the tires of the mixer truck 4 are placed, but also includes a spatial area that includes the entire mixer truck 4. Furthermore, when the work time management system 1 is applied to vehicles other than mixer trucks, an appropriate parking area can be set depending on the vehicle and the work.

[0024] In this first embodiment, the image capturing device 11 uses a webcam connected to the server 13 via the Internet 12, which is a predetermined network. The imaging means 21 refers to the camera body of the webcam. The image capturing device 11 continuously captures images of the parking area 7 and transmits them from the output unit 25 to the server 13 via the Internet 12, which is a predetermined network. Note that the image capturing device 11 may use an independent video camera instead of a webcam, and may transmit the captured images to the server 13 via a wireless or wired connection. The present invention also includes cases where the image capturing device 11 and the server 13 are connected via other networks, such as a LAN or WAN, in addition to the Internet 12.

[0025] The server 13 is an information processing device capable of various information processing and information transmission / reception, and is constructed in the cloud (cloud computing). The server 13 constructed in the cloud is a virtual computer having a virtual CPU or virtual MPU (central processing unit), a virtual main memory, and a virtual cache memory (memory), and running on an independent operating system (virtual OS), and a large-capacity virtual storage area is formed. As a cloud, not only can Infrastructure as a Service (IaaS), Platform as a Service (PaaS), and Software as a Service (SaaS) be used, but all cloud platforms that will be developed in the future can also be used.

[0026] The server 13 may be a physical computer. In this case, the server 13 and the communication terminal 15 are connected via a predetermined network, the Internet 14. The server 13 and the communication terminal 15 may form a network in a client-server model, or may form a network via a blockchain.

[0027] The server 13, which is a physical computer, includes a central processing unit (CPU or MPU) and memory (main memory and cache memory), and has a built-in large-capacity storage area (large-capacity hard disk). Although not shown, input devices such as a keyboard and a mouse, and output devices such as a display and a printer are connected to the server 13 via interfaces.

[0028] The server 13 is managed, for example, by a system provider that provides (manages and operates) the work time management system 1. When a cloud server is used, the server 13 is configured (formed) in a data center contracted by the system provider (business corporation) that provides (manages and operates) the work time management system 1. When a physical server is used, the server 13 is installed in a building or data center of the system provider (business corporation). Multiple servers 13 may be installed, or the server 13 may be realized by multiple virtual machines installed in a single server.

[0029] Server identification information (server identification identifier) ​​that identifies the server 13 is stored in a large-capacity storage area of ​​the server 13. The server identification information (server identification identifier) ​​can be the IP address, MAC address, URL, email address, cookie information, or individual identification number of the server 13, or the server 13 can independently generate a unique identifier that identifies itself, and the generated identifier can be used as the server identification information.

[0030] Server 13 has various server functions such as a DNS server function, a database server function, a web server function, a mail server function, and a document server function, and is divided into software according to each server function. Server 13 can access and log in to an unspecified number of servers and communication terminals 15 (smartphones, tablets, etc.) with no access restrictions using Internet 14 via a plurality of various DNS servers, etc., connected to Internet 14, and can transmit various data to an unspecified number of servers and communication terminals 15, as well as receive various data from an unspecified number of servers and communication terminals 15.

[0031] Such a server 13 has an acquisition unit 31 that acquires video images captured by the imaging device 11, and the video images acquired by this acquisition unit 31 are stored in a video storage unit 32. In this first embodiment, the video storage unit 32 is constructed within the server 13 as cloud storage, but an external storage device such as a hard disk drive (HDD) or a solid state drive (SSD) may also be used.

[0032] The server 13 also includes a vehicle detection unit 33 that detects the presence of a vehicle, a mixer truck 4, in the video stored in the video storage unit 32 (video acquired by the acquisition unit 31), and a vehicle identification information recognition unit 34 that recognizes the vehicle registration number printed on the license plate of the mixer truck 4, which serves as vehicle identification information, from the video acquired by the acquisition unit 31. In this first embodiment, the vehicle is not limited to the mixer truck 4, and the type of vehicle, such as an asphalt transporter or tanker, can be selected depending on the work being managed. Furthermore, the identification information is not limited to the vehicle registration number, and can be anything that can identify an individual vehicle, such as the color or scratches on the body, or an identification mark different from the license plate. Various existing multi-object tracking (MOT, object tracking technology) techniques can be used for vehicle detection. Various existing optical character recognition / reader (OCR, character recognition technology) techniques can also be used for vehicle identification information recognition.

[0033] Furthermore, the server 13 includes a work time determination means 36 that determines the start and end times of unloading the mixer truck 4, and a work status determination means 37 that determines the start and end times of unloading the mixer truck 4 based on the start and end times, in association with the vehicle registration number of the mixer truck 4. Details of the processes related to determining the start and end times and determining the work status will be described later. The work status determined by the work status determination means 37 is then stored in a work status memory unit 38. The work status memory unit 38 is constructed within the server 13, similar to the video memory unit 32, but may also be an external storage device such as an HDD or SSD. The work status stored in the work status memory unit 38 is transmitted from the transmission unit 19 to the communication terminal 15 via the Internet 14, which is a predetermined network.

[0034] The communication terminal 15 is a terminal used by the user 16, and is an information processing device (computer) such as a smartphone, a tablet terminal, or a personal computer. In Fig. 2, one tablet terminal 15a, one personal computer (PC) 15b, and one smartphone 15c are illustrated as the communication terminals 15, but the number is not limited to that shown in Fig. 2, and in reality, there are multiple tablet terminals, PCs, and smartphones of various types connected to the server 13 via the Internet 14. Furthermore, the communication terminal 15 includes all communication terminals that will be developed in the future and that can connect to the Internet 14.

[0035] The user 16 is, for example, the manager of the construction site 3 who actually manages the work hours, but is not limited to this and also includes people involved in the production and transportation of ready-mixed concrete. Furthermore, the location where the user 16 uses the work time management system may be a place other than the construction site 3, such as a ready-mixed concrete production plant. The communication terminal 15 may be owned by the construction company (corporation) of the construction site 3 and loaned to the user 16, or it may be owned personally by the user 16. Furthermore, in addition to the Internet 14, the case where the communication terminal 15 and the server 13 are connected by another network such as a LAN or WAN is also included.

[0036] Communication terminal 15 can connect to Internet 14 using a web browser, and can access and log in to an unspecified number of other servers (virtual servers or physical servers) using Internet 14, and can use various search engines on Internet 14. Communication terminal 15 can access and log in to server 13 using the URL of server 13, and can provide various data (text data and image data) to a plurality of other external servers including server 13 using Internet 14, and can receive various data from a plurality of other external servers including server 13 using Internet 14.

[0037] The communication terminal 15 is equipped with a display unit 42 that displays the work status determined by the work status determination means 37. The work time management system 1 is provided as a web application, and the user 16 accesses a predetermined URL from the browser of the communication terminal 15 and manages the work time of the mixer truck using an application that runs on the web browser. However, the system is not limited to this, and may be provided as a native application that is downloaded (installed) directly to the communication terminal 15.

[0038] The communication terminal 15 and the server 13 are equipped with a computer configured with a processing device such as a CPU (Central Processing Unit), various programs interpreted and executed on the processing device, and an internal memory such as a RAM (Random Access Memory) for storing programs and various data, and the computer realizes a control means for executing various processes. Note that the program here includes a basic control program such as an OS (Operating System) and an application program that is started on the OS and realizes a specific function.

[0039] In addition, the communication terminal 15 and the server 13 are equipped with a memory unit for temporarily or permanently storing various data or programs to be processed, and this memory unit is composed of memory units such as a main memory unit, auxiliary memory units such as an internal HDD or an internal SSD, and external memory units such as a memory card, an external SSD, or an external HDD.

[0040] Next, the process of work time management by the work time management system 1 will be specifically described.

[0041] Fig. 4 is a flowchart showing the processing flow of the work time management system shown in Fig. 1. Fig. 5 is a schematic diagram showing a state in which a vehicle is parked in a parking area, where (a) is a plan view and (b) is a diagram showing the state photographed by a photographing device. Fig. 6 is a diagram showing an example of the display screen of a communication terminal showing the state in which the vehicle shown in Fig. 5 has started work, and Fig. 7 is a diagram showing an example of the display screen of a communication terminal showing the state in which the vehicle shown in Fig. 5 has finished work.

[0042] 1 to 3 as well as FIG. 4 and FIG. 5, in the work time management system 1, the photographing device 11 is installed next to the pump truck 5, and continuously photographs a predetermined parking area 7 for the mixer truck 4 using the imaging means 21, which is a camera (S101). This parking area 7 is set to a range that will accommodate at least the entire width and height of the mixer truck 4 when the mixer truck 4 is parked. When the mixer truck 4 enters the construction site 3, it parks backward in the parking area 7. Therefore, the photographing device 11 captures the mixer truck 4 from behind. The photographed video is acquired by the acquisition unit of the server 13 via the Internet 12 by the output unit 25 (S102), and is stored in the video storage unit 32 with information such as the date and time of the photo taken attached.

[0043] Next, the vehicle detection means 33 uses object detection technology to detect the presence of the mixer truck 4 from the video stored in the video storage unit 32, as shown by the bounding box B, which is a dotted line surrounding the vehicle in FIG. 5(b) (S103). Various existing machine learning models, such as Region Based Convolutional Neural Networks (R-CNN), You Only Look Once (YOLO), and Single Shot Multibox Detector (SSD), can be used as object detection technology. Additionally, the vehicle detection means 33 tracks the vehicle using object tracking technology, and tracks the detected mixer truck 4. Various existing methods, such as Simple Online and Realtime Tracking (SORT) using a Kalman filter, can be used as object tracking technology. Note that vehicle detection (object detection) and vehicle tracking (object tracking) may be configured as two stages that are realized separately, or as an end-to-end system that is operated in an integrated manner.

[0044] Next, the vehicle identification information recognition means 34 recognizes the vehicle registration number 9 written on the license plate of the mixer truck 4, which is the identification information of the vehicle detected by the vehicle detection means 33 (S104). Existing OCR technology may be used as the character recognition technology.

[0045] The work time determination means 36 determines the time when both the mixer truck 4 is detected (vehicle detection) and the vehicle registration number 9 is recognized (vehicle identification number recognition) as the work start time (S105).

[0046] Furthermore, the work status determination means 37 determines the work status by linking the work start time determined by the work time determination means 36 with the vehicle registration number 9 of the mixer truck 4, which is the vehicle's identification information. In other words, the work status determination means 37 determines the work status as in progress when the mixer truck 4 has started work but has not yet finished (S106). The work status determined as in progress by the work status determination means 37 is stored in the work status memory unit 38. The work status stored in the work status memory unit 38 is transmitted from the transmission unit 39 to the communication terminal 15 via the Internet 14. The display unit 42 of the communication terminal 15 displays the transmitted work status (S107). As illustrated in FIG. 6, this work status indicates that the entry start time for vehicle number 4902 is 09:19 (time), and the status is displayed as "entering." This display of "entering" indicates that the work status determined by the work status determination means 37 is in progress. Thereafter, the display of "entering" on the communication terminal 15 indicates that the work is currently in progress.

[0047] Next, once unloading is complete, the mixer truck 4 quickly leaves the parking area 7 to undergo vehicle cleaning, etc. The vehicle detection means 33 tracks the movement of the mixer truck 4 from the video stored in the video storage unit 32 until the mixer truck 4 disappears from the parking area 7. Thereafter, the work time determination means 36 determines the time when it is no longer possible to track the mixer truck 4 as the work end time (S108).

[0048] Furthermore, the work status determination means 37 associates the work completion time determined by the work time determination means 36 with the vehicle registration number 9 of the mixer truck 4, which is the vehicle's identification information, and determines that the work status is work completed (S109). The work status determined by the work status determination means 37 is stored in the work status memory unit 38. The work status stored in the work status memory unit 38 is transmitted from the transmission unit 39 to the communication terminal 15 via the Internet 14. The display unit 42 of the communication terminal 15 displays the transmitted work status (S110). As illustrated in FIG. 7, the work status for vehicle number 4902 indicates that entry was completed at 09:32 (time), and the status is displayed as "completed." This display of "completed" indicates that the work status determined by the work status determination means 37 is that work has been completed. Thereafter, the display of "completed" displayed on the communication terminal 15 indicates that the work status is in progress.

[0049] The work end time in S108 was determined from the time when the mixer truck 4 could no longer be tracked, but if the mixer truck 4 moves, it may become impossible to read the vehicle registration number 9 before the mixer truck 4 can no longer be tracked. Therefore, the time when the vehicle registration number 9 could no longer be read may be determined as the work end time.

[0050] By configuring the work time management system 1 as described above, work start times and work end times can be managed by linking them to vehicles on a network, thereby reducing personnel costs and providing an efficient work time management system.

[0051] FIG. 8 is a schematic diagram showing the overall configuration of another work time management system according to the present invention.

[0052] A work time management system 61 in the second embodiment is based on the work time management system 1 in the first embodiment and manages the work status of a plurality of vehicles.

[0053] The basic configuration of the work time management system 61, including the configuration of the camera 11, server 13, communication terminal 15, and user 16, as well as their respective functions, is the same as that of the first embodiment, so here we will focus on the differences.

[0054] Referring to FIG. 8 , the parking area 67 of the construction site 63 is configured to allow two mixer trucks to be parked side by side. The parking area 67 is configured with a first range 71 in which the first vehicle (first mixer truck 74) that arrives first is imaged, and a second range 72 in which the second vehicle (second mixer truck 76) that arrives later is imaged. When multiple mixer trucks are used to transport ready-mixed concrete, from the viewpoint of improving work efficiency and stabilizing construction quality, the first mixer truck 74 that arrived first unloads first, and the second mixer truck 76 that arrived later waits on the spot. After the first mixer truck 74 completes unloading, it leaves the parking area 67, and the second mixer truck 76 then unloads. A new first vehicle, another mixer truck, parks in the vacant first range and waits for unloading. In this way, mixer trucks can be parked side by side in the first range 71 and the second range 72 of the parking area 67, allowing for repeated unloading operations without leaving significant gaps between them.

[0055] In the work time management system 61 operated at such a construction site 63, the acquisition unit 31 acquires images for each of the first range 71 and the second range 72, the vehicle detection means 33 and the vehicle identification information recognition means 34 each detect the mixer truck (vehicle detection) and recognize the mixer truck's vehicle registration number (vehicle identification information) for each of the first range 71 and the second range 72, the work time determination means 36 determines the work start time and work end time for each of the first mixer truck 74, which is the first vehicle, and the second mixer truck 76, which is the second vehicle, and the work status determination means 37 determines the work status by linking the work start time and work end time determined by the work time determination means 36 for each of the first mixer truck 74 and the second mixer truck 76 with the vehicle registration numbers of the first mixer truck 74 and the second mixer truck 76.

[0056] Next, a flow of managing the work time of a plurality of vehicles by the work time management system 61 at the construction site 63 will be described below.

[0057] FIG. 9 is a schematic diagram showing a state in which a first vehicle is parked in a first range of a parking area, where (a) is a plan view and (b) is a diagram showing the state photographed by a photographing device.

[0058] 9 and again to FIG. 4, first, the first mixer truck 74, which is the first vehicle, is parked backward in the first range 71 of the parking area 67. At this time, the work time management system 61 sequentially executes the processes from S101 to S107 of FIG. 4 for this first mixer truck 74. As a result, similar to the explanation for the mixer truck 4 in the first embodiment, the work status of the first mixer truck 74, which is linked to the vehicle registration number 75 of the first mixer truck 74, which is the vehicle's identification information, is displayed on the communication terminal 15 as "work in progress." As illustrated again in FIG. 6, the work status for vehicle number 4902 indicates that entry started at 09:19 (time), and the status is displayed as "entering."

[0059] Fig. 10 is a schematic diagram showing a state in which a first vehicle is being worked on in a first range of the parking area and a second vehicle is parked in a second range of the parking area, (a) is a plan view, and (b) is a diagram showing the state photographed by a photographing device. Fig. 11 is a diagram showing an example of a display screen of a communication terminal showing the work status of the first vehicle and the second vehicle shown in Fig. 10.

[0060] 10 and again with reference to FIG. 4, while the first mixer truck 74 is working, the second mixer truck 76, which is a second vehicle, is parked backwards in the second range 72 of the parking area 67 located to the side of the first mixer truck 74. At this time, the work time management system 61 sequentially executes the processes from S101 to S107 of FIG. 4 for the second mixer truck 76. As a result, similar to the description of the mixer truck 4 in the first embodiment, the work status of the second mixer truck 76 linked to the vehicle registration number 77 of the second mixer truck 76, which is the vehicle's identification information, is displayed on the communication terminal 15 as "work in progress." As illustrated in FIG. 11, the work status for vehicle number 4906 indicates that the start of input is 09:30 (time), and the status is displayed as "in progress."

[0061] However, unloading of mixer trucks is normally performed one at a time, and two trucks do not perform the same operation at the same time. Therefore, in order to avoid the simultaneous display of the "Putting in Progress" message, the system may be configured so that the work status determination means 37 determines that the second mixer truck 76 (vehicle number 4906) is "Waiting" until the first mixer truck 74 (vehicle number 4902) has finished work, and displays "Waiting" on the display unit. Alternatively, the system may be configured so that the work status of the second mixer truck 76 (vehicle number 4906) is determined to be "Working," but displays "Waiting" at the display stage. Furthermore, the system may be configured so that the putting in start time can be manually adjusted later based on the work start time.

[0062] 12 is a schematic diagram showing a state in which a first vehicle has left a first area, a second vehicle is unloading in a second area of ​​the parking area, and a third vehicle is about to park in the first area, where (a) is a plan view and (b) is a diagram showing the state photographed by a photographing device. Also, FIG. 13 is a diagram showing an example of a display screen of a communication terminal showing the work status of the first vehicle, the second vehicle shown in FIG. 12, and the third vehicle.

[0063] In this second embodiment, this new first vehicle will be referred to as a third vehicle for convenience in order to distinguish it from the first mixer vehicle 74, which is the previous first vehicle.

[0064] 12 and again to FIG. 4, when the first mixer truck 74 (not shown) finishes unloading, it exits the first range 71 of the parking area 67. At that time, the work time management system 61 executes the processes from S108 to S110 of FIG. 4 in order for this first mixer truck 74. As a result, similar to the explanation for the mixer truck 4 in the first embodiment, the work status indicating that work has been completed for the first mixer truck 74 linked to the vehicle registration number 75 is displayed on the communication terminal 15. As exemplified in FIG. 13, the work status for vehicle number 4902 indicates that entry was completed at 09:32 (time), and the status is displayed as "completed."

[0065] If the work status of the second mixer truck 76 (vehicle number 4906) is displayed as "waiting," the work status of the first mixer truck 74 (vehicle number 4902) may be changed to "driving" when the work status is completed.

[0066] As the first mixer truck 74 leaves, while the second mixer truck 76 is working, a third vehicle, a third mixer truck 78, parks backwards in the first range 71 of the vacant parking area 67. At this time, the work time management system 61 sequentially executes the processes from S101 to S107 in FIG. 4 for this third mixer truck 78. As a result, similar to the explanation for the mixer truck 4 in the first embodiment, the work status related to the start of work for the third mixer truck 78, which is linked to the vehicle registration number 77 of the third mixer truck 78, which is the vehicle's identification information, is displayed on the communication terminal 15. As shown in FIG. 13 as an example, the work status for vehicle number 640 indicates that entry started at 09:40 (time), and the status is displayed as "entering."

[0067] To avoid the simultaneous display of "Putting in Progress" similar to the relationship between the first mixer truck 74 and the second mixer truck 76, the system may be adjusted so that the third mixer truck 78 (vehicle number 640) is displayed as "Waiting" until the second mixer truck 76 (vehicle number 4906) has finished work. Also, the system may be configured so that the putting in start time, which is the start time of work, can be manually adjusted later.

[0068] Fig. 14 is a schematic diagram showing a state where a third vehicle is working in a first range of the parking area, (a) is a plan view, and (b) is a view showing the state photographed by a photographing device. Fig. 15 is a diagram showing an example of a display screen of a communication terminal showing the working status of the second vehicle and the third vehicle shown in Fig. 14.

[0069] Referring to FIG. 14 and again to FIG. 4, when the second mixer truck 76 finishes unloading, it exits the second range 72 of the parking area 67. At that time, the work time management system 61 executes the processes from S108 to S110 of FIG. 4 in order for this second mixer truck 76. Then, similar to the explanation for the mixer truck 4 in the first embodiment, a work status indicating that work has been completed for the second mixer truck 76 linked to the vehicle registration number 77 is displayed on the communication terminal 15. As illustrated in FIG. 15, the work status for vehicle number 4906 indicates that the entry completion time is 09:42 (time), and the status is displayed as "completed."

[0070] If the work status of the third mixer truck 78 (vehicle number 640) is displayed as "waiting," the work status of the second mixer truck 76 (vehicle number 4906) may be changed to "driving" when the work status is completed.

[0071] Furthermore, although not shown, a fourth mixer truck, which is a new second vehicle, parks backwards and unloads in the second range 72 of the vacant parking area 67. After that, mixer trucks continue to park alternately in the first range and the second range and unload, and each time this happens, the work time management system 61 executes the processes of S101 to S107 and S108 to S110 shown in Fig. 4 for each vehicle.

[0072] As described above, the work time management system 61 determines the work start time and work end time and the work status for each of the first range 71 and the second range 72, thereby making it possible to manage the work start and end times of multiple vehicles in parallel, resulting in a more efficient work time management system 61.

[0073] The mixer trucks 4, 74, 76, and 78 described in the first and second embodiments rotate their drums forward at high speed to mix the ready-mixed concrete immediately before transferring it to the pump truck 5 in order to ensure the quality of the ready-mixed concrete (normal rotation is about 1.5 rotations per minute, and high-speed rotation is about 13 rotations per minute). The rotation noise generated during this process is higher-pitched and louder than the normal rotation noise of the drum. In addition, just before the end of unloading, the drum is rotated in the reverse direction at high speed to ensure the ready-mixed concrete is discharged reliably. The rotation noise generated during this process is higher-pitched and louder than the normal rotation noise of the drum. The high-speed rotation noise generated at the start of work and the high-speed rotation noise generated at the end of work are often perceived as the same sound by the human ear, but strictly speaking, they are different sounds.

[0074] FIG. 16 is a functional block diagram showing an example of a photographing device, a server, and a communication terminal that constitute another working time management system of the present invention.

[0075] Referring to Figure 16 and again to Figures 1 and 2, the configurations and functions of the photographing device 111, Internet 112, server 113, Internet 114, communication terminal 115 and user 116 of the work time management system 101 in the third embodiment are basically the same as the configurations and functions of the photographing device 11, Internet 12, server 13, Internet 14, communication terminal 15 and user 16 in the first embodiment, so here we will mainly explain the differences.

[0076] Referring to FIG. 16 and again to FIGS. 1 and 2, the photographing device 111 of the work time management system 101 includes, in addition to the imaging means 121, an audio acquisition means 123 that continuously acquires audio generated at the construction site 3. The audio may be acquired intermittently at predetermined times, such as when a sound louder than a preset volume is generated. In this third embodiment, the imaging means 121 has the same configuration as the imaging means 21 in the first embodiment. The audio acquisition means 123 is a microphone built into the webcam and is omnidirectional, capturing audio around the microphone almost uniformly. The audio acquired by the audio acquisition means 123 is sent from the output unit 125 to the server 113 via the Internet 112, a predetermined network, and is acquired by the acquisition unit 131 of the server 113. The audio acquisition means 123 is not limited to a microphone built into the webcam, and an independent web microphone may also be used. Using a unidirectional or narrow-directional microphone is preferable because it allows audio to be acquired from the direction of the desired audio.

[0077] The audio acquired by the acquisition unit 131 is stored in the video / audio storage unit 132 with information such as the audio acquisition date and time attached. In the third embodiment, the video / audio storage unit 132 is constructed in the server 113 as cloud storage, similar to the video storage unit 32 in the first embodiment, but an external storage device such as an HDD or SSD may also be used.

[0078] The server 113 has a voice recognition means 135 that recognizes, from the acquired voice, predetermined work sounds that occur twice in association with predetermined work. In this third embodiment, the predetermined work refers to the unloading of ready-mixed concrete from the mixer truck 4, and the predetermined work sound refers to the high-speed rotation sound of the drum that occurs at the start and end of the unloading operation. Furthermore, since the difference between the high-speed rotation sound that occurs at the start and the high-speed rotation sound that occurs at the end is slight, this third embodiment does not distinguish between these sounds. Note that the predetermined work and predetermined work sounds are not limited to these, and may also include work on vehicles other than the mixer truck and the sounds that occur in association with such work.

[0079] The technology for speech recognition can be appropriately selected from existing machine learning models for speech recognition.

[0080] The vehicle detection means 133 and the vehicle identification information recognition means 134 of the server 113 are configured similarly to the vehicle detection means 33 and the vehicle identification information recognition means 34 of the first embodiment.

[0081] As in the first embodiment, the work start time and work end time of the mixer truck 4 are determined by the work time determination means 136 as the time when the vehicle detection means 133 detects the mixer truck 4 (vehicle detection) from the video acquired by the acquisition unit 131 and the vehicle identification information recognition means 134 recognizes the vehicle registration number (vehicle identification information) of the mixer truck 4 as the work start time, and the time when the mixer truck 4 is no longer detected or the vehicle registration number of the mixer truck 4 is no longer recognized from the video acquired by the acquisition unit 131 after work has started as the work end time. In addition, the work status determination means 137 links the work start time and work end time determined by the work time determination means 136 with the vehicle identification information to determine the work status.

[0082] The work time determination means 136 determines the time when the high-speed rotation sound of the mixer truck 4 recognized by the voice recognition means 135 occurs as a corrected work start time or a corrected work end time depending on the number of times the sound occurs, and corrects the work start time to match the corrected work start time and the work end time to match the corrected work end time. Furthermore, the work status determination means 137 of the server 113 determines the work status by linking the work start time and work end time corrected by the work time determination means 136 with the identification information (vehicle registration number) of the mixer truck 4. Details of the processes related to the determination of the work start time and work end time, the correction of the work start time and work end time, and the determination of the work status will be described later.

[0083] The work status determined by work status determination means 137 is stored in work status storage unit 138. Work status storage unit 138 is constructed as cloud storage within server 113, similar to video / audio storage unit 132, but an external storage device such as an HDD or SSD may also be used. The work status stored in work status storage unit 138 is transmitted from transmission unit 119 to communication terminal 115 via Internet 114, which is a predetermined network, in the same manner as in the first embodiment.

[0084] Next, a method for correcting the work start time and work finish time will be described.

[0085] FIG. 17 is a schematic diagram showing the relationship between the determination of the work start time and work end time based on vehicle detection and recognition of vehicle identification information, and the correction of the work start time and work end time based on voice.

[0086] 17 and again referring to FIGS. 5 and 16, the work time WT1 shown in the upper part of FIG. 17 is the work time of the mixer truck 4 based on the work start time st1 and the work end time et1 determined by detecting the vehicle and recognizing the vehicle's identification information. The work start time st1 and the work end time et1 correspond to the work start time and the work end time of the mixer truck 4 determined by the work time determination means 36 in the first embodiment.

[0087] When there is a work time (work time WT1) that includes the time of occurrence of the high-speed rotation sound (predetermined work sound) of the mixer truck 4 recognized by the voice recognition means 135 shown in the middle of FIG. 17 , the work time determination means 136 determines the time of occurrence of the first high-speed rotation sound (first work sound) of the high-speed rotation sounds recognized by the voice recognition means 135 as the corrected work start time ast1 of the mixer truck 4. Then, the work start time st1 of the mixer truck 4 determined by the work time determination means 136 is corrected to match the corrected work start time ast1, resulting in the corrected work start time st1'. Also, the work end time aet1 of the mixer truck 4 is determined to be the corrected work end time aet1 of the mixer truck 4. Then, the work end time et1 of the mixer truck 4 determined by the work time determination means 136 is corrected to match the corrected work end time aet1, resulting in the corrected work end time et1'. It should be noted that the first work sound and the second work sound are defined as the sound that occurs first and the sound that occurs later within one work period, respectively.

[0088] Then, the corrected work time based on the corrected work start time st1' and corrected work end time et1' of the mixer truck 4 becomes the work time WT1' shown in the lower part of Fig. 17. This corrected work start time st1', corrected work end time et1', and work time WT1' are more accurate as they reflect the actual unloading time compared to the original work start time st1, work end time et1, and work time WT1, which simply include the time spent parking.

[0089] Note that the work times WT2 and WT3 shown in the upper part of FIG. 17 are independent work times that occur after the work time WT1 and correspond to the work time WT1. As with the work time WT1, the work time determination means 136 corrects the work start times st2 and st3 and the work end times et2 and et3 to match the corrected work start times ast2 and ast3 and the corrected work end times aet2 and aet3, respectively, to obtain corrected work start times st2' and st3' and corrected work end times et2' and et3'. Based on this, corrected work times WT2' and WT3' are derived. The number of occurrences of work sounds, which are used as the basis for determining the corrected work start times ast2 and ast3 and the corrected work end times aet2 and aet3, is counted as the first occurrence, the second occurrence, and so on, each time the work time is divided. That is, with the horizontal axis representing the flow of time, the third and fourth occurrences of the work sounds used as the basis for determining the corrected work start time ast2 and the corrected work end time aet2 shown in the middle of Figure 17 are counted as the first and second occurrences. Similarly, the fifth and sixth occurrences of the work sounds used as the basis for determining the corrected work start time ast3 and the corrected work end time aet3 of work time WT3 are counted as the first and second occurrences. This rule also applies to work times after WT3 (not shown).

[0090] Next, the process of work time management by the work time management system 101 will be specifically described.

[0091] Fig. 18 is a flowchart showing the processing flow of the work time management system shown in Fig. 16. Also, Fig. 19 is a diagram showing an example of a display screen of a communication terminal showing a state in which a vehicle is waiting, Fig. 20 is a diagram showing an example of a display screen of a communication terminal showing a state in which a vehicle is working, and Fig. 21 is a diagram showing an example of a display screen of a communication terminal showing a state in which a vehicle has finished working.

[0092] 18 to 21, and again with reference to FIGS. 5, 16, and 17, in the work time management system 101, the photographing device 111 is installed next to the pump truck 5, and continuously photographs the parking area 7 for the mixer truck 4 using the imaging means 121, which is a camera (S201). This parking area 7 is set to a range that can accommodate at least the entire width and height of the mixer truck 4 when the mixer truck 4 is parked. When the mixer truck 4 enters the construction site 3, it parks backward in the parking area 7. Therefore, the photographing device 111 captures the mixer truck 4 from behind. In addition, at the same time as capturing images, the photographing device 111 also captures sounds generated by the mixer truck 4 and surrounding sounds using the audio capture means 123. The photographed images and captured audio are output from the output unit 125, acquired by the acquisition unit 131 of the server 113 (S202), and stored in the video / audio storage unit 132 with the date and time of the image capture and the date and time of the audio capture, etc., attached. The vehicle detection means 133 uses object detection technology to detect the presence of the mixer truck 4, which is a vehicle, from the video stored in the video and audio storage unit 132 (S203). As the object detection technology, various existing machine learning models such as R-CNN, YOLO, and SSD can be used. In addition, the vehicle detection means 133 tracks the vehicle using object tracking technology, and tracks the detected mixer truck 4. As the object tracking technology, various existing methods such as SORT using a Kalman filter can be used. Note that the vehicle detection (object detection) and vehicle tracking (object tracking) may be configured as two stages that are realized separately, or may be configured as an end-to-end system that is operated in an integrated manner.

[0093] Next, the vehicle identification information recognition means 134 recognizes the vehicle registration number 9 written on the license plate, which is the vehicle identification information of the mixer truck 4 detected by the vehicle detection means 133 (S204). Existing OCR technology can be used to recognize the number.

[0094] The work time determination means 136 determines the time when both the mixer truck 4 is detected (vehicle detection) and the vehicle registration number 9 is recognized (vehicle identification number recognition) as the work start time st1 (S205).

[0095] Furthermore, the work status determination means 137 determines the work status by linking the work start time st1 determined by the work time determination means 136 with the vehicle registration number 9 of the mixer truck 4, which is the vehicle's identification information. In other words, when only the work start time st1 of the mixer truck 4 has been determined, the work status determination means 137 determines that the mixer truck 4 has arrived at the parking area but has not yet started high-speed rotation, and therefore determines the work status to be ``standby for work'' (S206). The work status ``standby for work'' determined by the work status determination means 137 is stored in the work status memory unit 138. The work status stored in the work status memory unit 138 is transmitted from the transmission unit 139 to the communication terminal 115. The display unit 142 of the communication terminal 115 displays the transmitted work status (S207). As illustrated in FIG. 19, the work status for vehicle number 4902 does not display a time, and the status is displayed as ``standby.'' This display of "Waiting" indicates the work status of waiting for work as determined by the work status determination means 137. Thereafter, the display of "Waiting" displayed on the communication terminal 115 indicates this work status of waiting for work.

[0096] Next, just before the actual start of unloading, the mixer truck 4 performs a first high-speed rotation. The high-speed rotation sound (predetermined work sound) generated when the mixer truck 4 starts work is acquired by the acquisition unit 131 and stored in the video and audio storage unit 132. The audio recognition means 135 then recognizes this first high-speed rotation sound from the audio stored in the video and audio storage unit 132 (S208). The work time determination means 136 determines the time when the first high-speed rotation sound occurred as the corrected work start time ast1. The work time WT1 determined by detecting the vehicle and recognizing the vehicle's identification information is then corrected to match this corrected work start time ast1, and this is set as the corrected work start time st1' (S209).

[0097] Furthermore, the work status determination means 137 associates the work start time st1 corrected by the work time determination means 136 with the vehicle registration number 9 of the mixer truck 4, which is the vehicle's identification information, and determines the work status to be "working" (S210). In other words, the work status determination means 137 determines the work status to be "working" when work has not been completed since the work start time st1 of the mixer truck 4 was corrected. The work status "working" determined by the work status determination means 137 is stored in the work status memory unit 138. The work status stored in the work status memory unit 138 is transmitted from the transmission unit 139 to the communication terminal 115. The display unit 142 of the communication terminal 115 displays the transmitted work status (S211). As illustrated in FIG. 20, the work status for vehicle number 4902 indicates that input started at 09:21 (time), and the status is displayed as "in progress." This display of "in progress" indicates that the work status is in progress as determined by the work status determination means 37. Thereafter, the display of "in progress" displayed on the communication terminal 115 indicates that the work status is in progress.

[0098] Next, just before unloading is completed, the mixer truck 4 performs a second high-speed rotation. The high-speed rotation sound (predetermined work sound) generated as the mixer truck 4 finishes work is acquired by the acquisition unit 131 and stored in the video and audio storage unit 132. The voice recognition means 135 then recognizes this second high-speed rotation sound from the audio stored in the video and audio storage unit 132 (S212). The work time determination means 136 determines the time when the second high-speed rotation sound occurs as the corrected work end time aet1.

[0099] Next, once unloading is complete, the mixer truck 4 immediately leaves the parking area 7 to be washed or otherwise carried out. The vehicle detection means 133 tracks the movement of the mixer truck 4 from the video stored in the video and audio storage unit 132 until the mixer truck 4 is no longer present. Thereafter, the work time determination means 136 determines the time at which it is no longer possible to track the mixer truck 4 as the work end time et1 (S213).

[0100] Then, this determined work end time et1 is corrected to match the corrected work end time aet1 determined by recognizing the second high-speed rotation sound, which is a predetermined work sound, to obtain the corrected work end time et1' (S214).

[0101] Furthermore, the work status determination means 137 associates the work completion time et1' corrected by the work time determination means 136 with the vehicle registration number 9 of the mixer truck 4, which is the vehicle's identification information, and determines the work status as work completion (S215). The work status determined by the work status determination means 137 is stored in the work status memory unit 138. The work status associated with the vehicle registration number 9 stored in the work status memory unit 138 is transmitted from the transmission unit 139 to the communication terminal 115. The display unit 142 of the communication terminal 115 displays the transmitted work status (S216). As illustrated in FIG. 21, the work status for vehicle number 4902 indicates that entry was completed at 09:31 (time), and the status is displayed as "completed." This display of "completed" indicates the work status determined by the work status determination means 137 as being work completion. Thereafter, the display of "completed" displayed on the communication terminal 115 indicates this work status as being work completion.

[0102] The work end time et1 was determined from the time when it became impossible to track the mixer truck 4, but if the mixer truck 4 moves, it may become impossible to read the vehicle registration number 9 before it becomes impossible to track the mixer truck 4. Therefore, as in the first embodiment, the time when it becomes impossible to read the vehicle registration number 9 may be determined as the work end time et1.

[0103] The work time management system 101 is configured to correct the work start time and work end time determined by vehicle detection and recognition of vehicle identification information as described above using voice recognition, thereby obtaining more accurate work start time and work end time, thereby enabling more accurate management of work time.

[0104] FIG. 22 is a schematic diagram showing the relationship between the determination of the work start time and work end time based on vehicle detection and recognition of vehicle identification information, and the correction of the work start time and work end time based on voice.

[0105] Referring to Figure 22 and again to Figures 8 and 16, the work time management system 161 in this fourth embodiment is based on the work time management system 101 of the third embodiment and manages the work status of multiple vehicles.

[0106] The configurations and functions of the photographing device 111, the Internet 112, the server 113, the Internet 114, the communication terminal 115, and the user 116 of the work time management system 161 are basically the same as those of the third embodiment. In addition, the rules regarding the entry and exit of vehicles (mixer trucks) and work are also basically the same as those of the third embodiment, so the differences will be mainly explained here.

[0107] In the fourth embodiment, the imaging means 121 has the same configuration as the imaging means 21 in the first embodiment.

[0108] In this fourth embodiment, the audio acquisition means 123 of the imaging device 111 is a non-directional microphone built into a single webcam. The acquisition unit 131 of the server 113 chronologically acquires audio generated at the construction site 63 acquired by the audio acquisition means 123 without distinguishing whether the audio originated from the first range 71 or the second range 72, and stores the audio in the video / audio storage unit 132. The audio may be acquired continuously or intermittently at a predetermined timing, such as when a sound louder than a preset volume is generated. The audio acquisition means 123 may use a unidirectional microphone or the like corresponding to each of the first and second ranges to more reliably capture audio. The audio recognition means 135 recognizes the high-speed rotation sound of the first and second mixer trucks 74 and 76, which is a predetermined work sound. This high-speed rotation sound occurs twice for each mixer truck: immediately before unloading begins and immediately after unloading ends, and multiple times depending on the number of mixer trucks operating.

[0109] The audio acquired by the acquisition unit 131 is stored in the video / audio storage unit 132 with information such as the audio acquisition date and time attached. In the fourth embodiment, the video / audio storage unit 132 is constructed in the server 113 as cloud storage, similar to the video storage unit 32 in the first embodiment, but an external storage device such as an HDD or SSD may also be used.

[0110] The server 113 has a voice recognition means 135 that recognizes predetermined work sounds that occur multiple times in association with predetermined work from the acquired voice. In this fourth embodiment, the predetermined work refers to the unloading of ready-mixed concrete from the mixer truck 4, and the predetermined work sound refers to the high-speed rotation sound of the drum that occurs at the start and end of the unloading operation. Furthermore, since the difference between the high-speed rotation sound that occurs at the start and the high-speed rotation sound that occurs at the end is slight, this fourth embodiment does not distinguish between these sounds. Note that the predetermined work and predetermined work sounds are not limited to these, and may also include work on vehicles other than the mixer truck and the sounds that occur in association with such work.

[0111] The technology for speech recognition can be appropriately selected from existing machine learning models for speech recognition.

[0112] The vehicle detection means 133 and the vehicle identification information recognition means 134 of the server 113 are configured similarly to the vehicle detection means 33 and the vehicle identification information recognition means 34 of the first embodiment.

[0113] As in the third embodiment, the work start time and work end time of the first mixer vehicle 74 and the second mixer vehicle 76 are determined by the work time determination means 136 as the time when both the vehicle detection means 133 detects the first mixer vehicle 74 and the second mixer vehicle 76 (vehicle detection) from the video acquired by the acquisition unit 131 and the vehicle identification information recognition means 134 recognizes the vehicle registration numbers (vehicle identification information) of the first mixer vehicle 74 and the second mixer vehicle 76 as the work start time, and the time when the detection of the first mixer vehicle 74 and the second mixer vehicle 76 or the recognition of the vehicle registration numbers of the first mixer vehicle 74 and the second mixer vehicle 76 from the video acquired by the acquisition unit 131 after work has started is determined as the work end time. In addition, the work status determination means 137 associates the work start time and work end time determined by the work time determination means 136 with the vehicle registration numbers of the first mixer vehicle 74 and the second mixer vehicle 76 to determine the work status.

[0114] The work time determination means 136 determines the occurrence times of the high-speed rotation sounds of the first mixer vehicle 74 and the second mixer vehicle 76 recognized by the voice recognition means 135 as corrected work start times or corrected work end times depending on the number of times the sounds are generated, and corrects the work start time to match the corrected work start time and the work end time to match the corrected work end time. Furthermore, the work status determination means 137 of the server 113 determines the work status by linking the work start time and work end time corrected by the work time determination means 136 with the identification information (vehicle registration numbers) of the first mixer vehicle 74 and the second mixer vehicle 76. Details of the processes related to the determination of the work start time and work end time, the correction of the work start time and work end time, and the determination of the work status will be described later.

[0115] The work status determined by the work status determination means 137 is stored in a work status storage unit 138. The work status stored in the work status storage unit 138 is transmitted from a transmission unit 119 to a communication terminal 115 via the Internet 114, which is a predetermined network, in the same manner as in the first embodiment.

[0116] Next, a method for correcting the work start time and work finish time will be described.

[0117] The first range of work time WT11 shown in the upper part of Fig. 22 is the work time of the mixer truck 74 (first vehicle) based on the work start time st11 and work end time et11 determined by vehicle detection and recognition of the vehicle's identification information. The second range of work time WT12 is the work time of the second mixer truck 76 (second vehicle) based on the work start time st12 and work end time et12 determined by vehicle detection and recognition of the vehicle's identification information. The work start time st11 and work end time et11 correspond to the work start time and work end time of the first mixer truck 74 determined by the work time determination means 136 in the second embodiment, and the work start time st12 and work end time et12 correspond to the work start time and work end time of the second mixer truck 76 determined by the work time determination means 136. Because there are time periods when the first mixer truck 74 and the second mixer truck 76 are parked side by side, when the horizontal axis represents the flow of time, the work time WT11 in the first range based on the work start time and work end time determined by vehicle detection and recognition of vehicle identification information and the work time WT12 in the second range partially overlaps. This causes the occurrence of time periods during which the message "Putting in progress" appears multiple times simultaneously when displaying the work status on a communication terminal, as described in the second embodiment.

[0118] Based on this premise, when there is a work time (work times WT11, WT12) that includes the time of occurrence of high-speed rotation sounds (predetermined work sounds) of the first mixer vehicle 74 and the second mixer vehicle 76 recognized by the voice recognition means 135, the work time determination means 136 determines the time of occurrence of the first high-speed rotation sound (first work sound) of the high-speed rotation sounds recognized by the voice recognition means 135 as the corrected work start time ast11 of the first mixer vehicle 74 (first vehicle). Then, the work time determination means 136 corrects the most recent work start time st11 determined by the work time determination means 136 to match it with the corrected work start time ast11 of the first mixer vehicle 74, resulting in the corrected work start time st11'. Furthermore, the work time determination means 136 determines the time of occurrence of the second high-speed rotation sound (second work sound) of the high-speed rotation sounds recognized by the voice recognition means 135 as the corrected work end time aet11 of the first mixer vehicle 74. Then, the most recent work end time et11 determined by the work time determination means 136 is corrected to match the corrected work end time aet11 of the first mixer vehicle 74, and this is set as the corrected work end time et11'. Furthermore, of the high-speed rotation sounds recognized by the voice recognition means 135, the time of occurrence of the third high-speed rotation sound (third work sound) is determined as the corrected work start time ast12 of the second mixer vehicle 76 (second vehicle). Then, the most recent work start time st12 determined by the work time determination means 136 is corrected to match the corrected work start time ast12 of the second mixer vehicle 76, and this is set as the corrected work start time st12'. Furthermore, of the high-speed rotation sounds recognized by the voice recognition means 135, the time of occurrence of the fourth high-speed rotation sound (fourth work sound) is determined as the corrected work end time aet12 of the second mixer vehicle 76. Then, the latest work end time et12 determined by the work time determination means 136 is corrected to match the corrected work end time aet12 of the mixer truck, to obtain the corrected work end time et12'.

[0119] As a result, the work time based on the corrected work start time st11' and corrected work end time et11' of the first mixer vehicle 74 becomes the work time WT11' shown in the lower part of Fig. 22. Also, the work time based on the corrected work start time st12' and corrected work end time et12' of the second mixer vehicle 76 becomes the work time WT12' shown in the lower part of Fig. 22. This prevents the work time WT11' in the first range and the work time WT12' in the second range from overlapping, eliminating the problem of there being multiple time periods when the message "driving in progress" is displayed simultaneously when the work status is displayed on the communication terminal.

[0120] The work sounds that form the basis for determining the corrected work start times ast11 and ast12 and the corrected work end times aet12 and aet13 occur twice per work time. In the first range of work time (work time WT11), the work sound that occurs first is the first work sound, and the work sound that occurs later is the second work sound. In the second range of work time (work time WT12), the work sound that occurs first is the third work sound, and the work sound that occurs later is the fourth work sound. This combination is treated as one unit, and this rule is also applied to the subsequent work times WT3 and onward.

[0121] That is, the work time WT13 of the first range shown in the upper part of Fig. 22 is the work time of the third mixer truck 78, which is a new first vehicle, based on the work start time st13 and the work end time et13 determined by vehicle detection and recognition of the vehicle's identification information. In this fourth embodiment, this new first vehicle is referred to as the third vehicle for convenience in order to distinguish it from the previous first vehicle, the first mixer truck 74. A portion of the work time WT13 of the third mixer truck 78 overlaps with a portion of the work time WT12 of the second mixer truck 76. By replacing the fifth high-speed rotation sound with the first high-speed rotation sound and the sixth high-speed rotation sound with the second high-speed rotation sound, the same correction process as that performed for the first mixer truck 74 can be performed.

[0122] Then, the work time based on the corrected work start time st13' and the corrected work end time et13' of the third mixer vehicle 78 becomes the work time WT13' shown in the lower part of Fig. 22. For subsequent mixer vehicles (not shown), the processes performed for the first mixer vehicle 74 and the second mixer vehicle 76 can be repeated by replacing them with the first vehicle and the second vehicle, respectively.

[0123] Next, the flow of managing the work times of a plurality of vehicles by the work time management system 161 will be described below.

[0124] 9, 16, and 18 again, first, the first mixer truck 74, which is the first vehicle, is parked backward in the first range 71 of the parking area 67. At this time, the work time management system 161 sequentially executes the processes from S201 to S207 in FIG. 18 for this first mixer truck 74. As a result, similar to the explanation for the mixer truck 4 in the first embodiment, the work status of the first mixer truck 74, which is linked to the vehicle registration number 75 of the first mixer truck 74, which is the vehicle's identification information, that is, "waiting for work," is displayed on the communication terminal 115. As shown in the example of FIG. 19 again, the work status is displayed as "waiting" for vehicle number 4902 without displaying the time.

[0125] FIG. 23 is a diagram illustrating an example of a display screen of a communication terminal showing the work status of the first vehicle and the second vehicle.

[0126] 10, 16, and 18 again, next, immediately before the actual start of unloading, the first mixer vehicle 74 performs a first high-speed rotation. Accordingly, when the voice recognition means 135 recognizes the high-speed rotation sound of the first mixer vehicle 74, which is a predetermined work sound, the work time management system 161 sequentially executes the processes from S208 to S211 of FIG. 4 for this first mixer vehicle 74. As a result, similar to the description of the first mixer vehicle 74 in the third embodiment, the work status of the first mixer vehicle 74 linked to the vehicle registration number 75 of the first mixer vehicle 74, which is the vehicle's identification information, that the first mixer vehicle 74 is currently working is displayed on the communication terminal 115. As illustrated in FIG. 23, the work status for vehicle number 4902 indicates that the start of loading is 09:21 (time), and the status is displayed as "loading in progress."

[0127] While the first mixer truck 74 is working, the second mixer truck 76, which is a second vehicle, is parked backward in the second range 72 of the parking area 67 located to the side of the first mixer truck 74. At this time, the work time management system 161 sequentially executes the processes from S201 to S207 in FIG. 18 for this second mixer truck 76. As a result, similar to the description regarding the first mixer truck 74 in the third embodiment, a work status of the second mixer truck 76 that is linked to the vehicle registration number 77 of the second mixer truck 76, which is vehicle identification information, that is, that the second mixer truck 76 is waiting for work is displayed on the communication terminal 15. As shown in the example of FIG. 23, the work status is displayed as "waiting" for the vehicle number 4906 without displaying the time.

[0128] FIG. 24 is a diagram illustrating an example of a display screen of a communication terminal showing the work status of the first vehicle, the second vehicle, and the third vehicle.

[0129] 12, 16, and 18 again, the first mixer truck 74 performs a second high-speed rotation just before unloading is completed, then finishes unloading and exits the first range 71 of the parking area 67. At that time, the work time management system 161 sequentially executes the processes from S212 to S216 of FIG. 18 for this first mixer truck 74. As a result, similar to the explanation for the first mixer truck 74 in the third embodiment, a work status indicating that work has been completed for the first mixer truck 74 linked to the vehicle registration number 75 is displayed on the communication terminal 115. As illustrated in FIG. 24, the work status for vehicle number 4902 indicates that entry was completed at 09:31 (time), and the status is displayed as "completed."

[0130] Next, just before the actual unloading begins, the second mixer vehicle 76 performs a first high-speed rotation. Accordingly, when the voice recognition means 135 recognizes the high-speed rotation sound of the second mixer vehicle 76, which is a predetermined work sound, the work time management system 161 sequentially executes the processes from S208 to S211 in FIG. 18 for this second mixer vehicle 76. As a result, similar to the explanation for the first mixer vehicle 74 in the third embodiment, the work status of the second mixer vehicle 76 linked to the vehicle registration number 77 of the second mixer vehicle 76, which is the vehicle's identification information, that is, "Work in Progress" is displayed on the communication terminal 115. As illustrated in FIG. 24, the work status for vehicle number 4906 indicates that loading started at 09:32 (time), and the status is displayed as "loading in progress."

[0131] In parallel with the unloading of the second mixer truck 76, the third vehicle, the third mixer truck 78, is parked backwards in the first range 71 of the vacant parking area 67. At this time, the work time management system 161 sequentially executes the processes from S201 to S207 in FIG. 18 for this third mixer truck 78. As a result, similar to the explanation for the first mixer truck 74 in the third embodiment, the work status of the third mixer truck 78, which is linked to the vehicle registration number 79 of the third mixer truck 78, which is the vehicle identification information, that is, "waiting for work," is displayed on the communication terminal 115. As shown in the example of FIG. 24, the work status is displayed as "waiting" for the vehicle number 640 without displaying the time.

[0132] FIG. 25 is a diagram illustrating an example of a display screen of a communication terminal showing the work status of the first vehicle, the second vehicle, and the third vehicle.

[0133] 14, 16, and 18 again, the second mixer truck 76 performs a second high-speed rotation just before unloading is completed, then finishes unloading and exits the second range 72 of the parking area 67. At that time, the work time management system 161 sequentially executes the processes from S212 to S216 of FIG. 18 for this second mixer truck 76. As a result, similar to the explanation for the first mixer truck 74 in the third embodiment, a work status indicating that work has been completed for the second mixer truck 76 linked to the vehicle registration number 77 is displayed on the communication terminal 115. As illustrated in FIG. 25, the work status for vehicle number 4906 indicates that entry was completed at 09:42 (time), and the status is displayed as "completed."

[0134] Next, when the voice recognition means 135 recognizes the high-speed rotation sound of the third mixer truck 78, which is the predetermined work sound, the work time management system 161 sequentially executes the processes from S208 to S211 in Fig. 18 for this second mixer truck 76. As a result, similar to the explanation for the first mixer truck 74 in the third embodiment, a work status indicating that the third mixer truck 78 is working and linked to the vehicle registration number 79 of the third mixer truck 78, which is the vehicle's identification information, is displayed on the communication terminal 115. As shown in Fig. 25, the work status indicates that the entry start time for vehicle number 640 is 09:43 (time), and the status is displayed as "entering."

[0135] Furthermore, although not shown, in parallel with the unloading of the third mixer truck 78, a fourth mixer truck, which is a new second vehicle, parks backwards in the second range 72 of the vacant parking area 67. Thereafter, mixer trucks continue to alternately enter and exit the first range 71 and the second range 72 to unload, and each time this occurs, the work time management system 61 executes the processes of S201 to S107, S208 to S211, and S212 to S116 shown in Fig. 4 for each vehicle.

[0136] As described above, the work time management system 161 corrects the work start time and work end time of work performed in each of the first range 71 and the second range 72 using audio, thereby obtaining more accurate work start time and work end time for multiple vehicles, thereby enabling more accurate management of work time.

[0137] In the third and fourth embodiments described above, the work time determination means 136 corrects both the work start time and the work end time, but it may also correct only the work start time depending on the actual situation at the site.

[0138] 16 to 18 and 22 again, the voice recognition means 135 recognizes a first work sound (the sound of the drum rotating at high speed when unloading of the mixer truck begins) that occurs in conjunction with the start of unloading of the mixer truck, which is a predetermined work, from the voice acquired by the acquisition unit 131. Then, if there is a work time WT1, WT1' that includes the time of occurrence of the first work sound recognized by the voice recognition means 135, the work time determination means 136 determines the time of occurrence of the first work sound as corrected work start times ast1, ast11', and corrects the most recent work start times st1, st11 determined by the work time determination means 136 to match them with the corrected work start times ast1, ast11'. In addition, the work status determination means 137 determines the work status by linking the work start times st1', st11' corrected by the work time determination means 136 to the vehicle identification information. That is, the processing of S201 to S211 shown in FIG. 18 is executed assuming that the first work sound corresponds to the first high-speed rotation sound in the third and fourth embodiments.

[0139] By doing this, a more accurate work start time can be obtained, and therefore more accurate management of work time becomes possible. Furthermore, although the work start time of the mixer truck is corrected using the high-speed rotation sound of the drum as described in the third and fourth embodiments, the work end time of the mixer truck is not corrected. Therefore, this is particularly effective in cases where, depending on the situation at the construction site or the operation status of the mixer truck, the high-speed rotation sound made by the mixer truck at the end of unloading overlaps with the high-speed rotation sound made by the next mixer truck at the start of unloading, making it difficult to accurately recognize voices.

[0140] 16 to 18 and 22 again, the voice recognition means 135 recognizes a second work sound (the high-speed rotation sound of the drum when unloading of the mixer truck is completed) that is generated upon completion of a predetermined work and that can be recognized as different from the first work sound from among the sounds acquired by the voice acquisition unit 131. If there is a work time WT1, WT11 that includes the time of occurrence of the second work sound recognized by the voice recognition means 135, the work time determination means 136 determines the time of occurrence of the second work sound as corrected work end times aet1, aet11, and corrects the most recent work end times et1, et11 determined by the work time determination means 136 to match them with the corrected work end times aet1, aet11. Additionally, the work status determination means 137 determines the work status by linking the work end times et1', et11' corrected by the work time determination means 136 with the vehicle's identification information. That is, the second work sound is treated as equivalent to the second high-speed rotation sound in the third and fourth embodiments, and the processes of S212 to S216 shown in FIG. 18 are executed.

[0141] In this way, a more accurate work end time can be obtained, enabling more accurate management of work hours. In particular, since the voice recognition means can recognize the high-speed rotation sound of the mixer truck drum that occurs when work ends as different from the first work sound, which is the high-speed rotation sound of the mixer truck drum that occurs when work starts, even if the high-speed rotation sounds associated with the start and end of work of adjacent mixer trucks overlap, the work start and end times of each can be accurately determined. [Explanation of symbols]

[0142] 1, 61, 101, 161...Work time management system 4...Mixer truck (vehicle) 7, 67...Parking area 9, 75, 77, 79... Vehicle registration number (vehicle identification information) 42, 142...Display section 11, 111...Filming equipment 12, 112...Internet (prescribed network) 13, 113...server 14, 114...Internet (prescribed network) 15, 115...Communication terminal 15a...Tablet device 15b...Personal Computer 15c...smartphone 21, 121...imaging means 31, 131...Acquisition Department 33, 133...Vehicle detection means 34, 134...Vehicle identification information recognition means 36, 136...Work time determination means 37, 137...Work status determination means 42, 142...Display section 71...First range 72...Second range 74...Mixer truck (first vehicle) 76...Mixer truck (second vehicle) 78...Mixer Truck (New First Vehicle) 123...Audio acquisition means 135...Voice recognition means WT1, WT11, WT12, WT13...Working time st1, st11, st12, st13...Work start time et1, et11, et12, et13...Work completion time ast1, ast11, ast12, ast13... Correction work start time aet1, aet11, aet12, aet13... Correction work end time In addition, the same reference numerals in each drawing indicate the same or corresponding parts.

Claims

1. A work time management system for managing work time related to predetermined work on a vehicle, The system comprises a photographing device including an imaging means for continuously capturing images of a predetermined parking area, a server connected to the photographing device via a predetermined network, and a variety of communication terminals that can be carried by a plurality of users and can be connected to the server via the predetermined network, The server includes an acquisition unit that acquires the captured image from the imaging device; a vehicle detection means for detecting the presence of the vehicle in the image acquired by the acquisition unit; a vehicle identification information recognition means for recognizing the vehicle identification information from the image acquired by the acquisition unit; a work time determination means for determining, as a work start time, the time when the vehicle is detected by the vehicle detection means and the vehicle identification information is recognized by the vehicle identification information recognition means from the video acquired by the acquisition unit, and for determining, as a work end time, the time when the vehicle is no longer detected or the vehicle identification information is no longer recognized from the video acquired by the acquisition unit after the start of work; a work status determination means for determining a work status by linking the work start time and work end time determined by the work time determination means with the identification information of the vehicle; The communication terminal is provided with a display unit that displays the work status determined by the work status determination means.

2. The photographing device further includes a sound capturing means for capturing sounds generated at the work site, the acquisition unit acquires the voice acquired by the voice acquisition means, The server further includes a voice recognition unit that recognizes a predetermined work sound that occurs twice in association with the predetermined work from the voice acquired by the acquisition unit, When there is a work period including the time when a predetermined work sound recognized by the voice recognition means occurs, the work time determination means determines the time when a first work sound occurs among the predetermined work sounds recognized by the voice recognition means as a corrected work start time and determines the time when a second work sound occurs as a corrected work end time, corrects the work start time determined by the work time determination means to match the corrected work start time, and corrects the work end time determined by the work time determination means to match the corrected work end time, The work time management system according to claim 1 , wherein the work status determination means determines the work status by linking the work start time and the work end time corrected by the work time determination means with the identification information of the vehicle.

3. The photographing device further includes a sound capturing means for capturing sounds generated at the work site, the acquisition unit acquires the voice acquired by the voice acquisition means, the server further includes a voice recognition unit configured to recognize a first work sound generated in association with the start of the predetermined work from the voices acquired by the acquisition unit, the work time determination means, when there is a work period including a time at which a first work sound recognized by the voice recognition means occurs, determines the time at which the first work sound occurs as the corrected work start time, and corrects the most recent work start time determined by the work time determination means to match it with the corrected work start time; The work time management system according to claim 1 , wherein the work status determination means determines the work status by linking the work start time corrected by the work time determination means with the identification information of the vehicle.

4. the voice recognition means recognizes a second work sound that is different from the first work sound from the acquired voice and that is generated in association with the completion of the predetermined work; the work time determination means, when there is a work period including a time at which a second work sound recognized by the voice recognition means occurs, determines the time at which the second work sound occurs as a corrected work end time, and corrects the most recent work end time determined by the work time determination means to match the corrected work end time; The work time management system according to claim 3 , wherein the work status determination means determines the work status by linking the work completion time corrected by the work time determination means with the identification information of the vehicle.

5. The vehicles include at least a first vehicle and a second vehicle that performs work after the first vehicle, There is a time period during which the first vehicle and the second vehicle are parked side by side, The predetermined parking area is set to a first range in which the first vehicle is imaged and a second range in which the second vehicle is imaged, the acquisition unit acquires video for each of the first range and the second range; the vehicle detection means and the vehicle identification information recognition means each perform vehicle detection and vehicle identification information recognition for each of the first range and the second range, the work time determination means determines the work start time and the work end time for each of the first vehicle and the second vehicle; 2. The work time management system according to claim 1, wherein the work status determination means determines the work status by linking the work start time and work end time determined by the work time determination means for each of the first vehicle and the second vehicle with the identification information of the vehicle.

6. The photographing device further includes a sound capturing means for capturing sounds generated at the work site, the acquisition unit acquires the voice acquired by the voice acquisition means, The server further includes a voice recognition unit that recognizes a predetermined work sound that occurs multiple times in association with the predetermined work from the voice acquired by the acquisition unit, When there is a work time including the occurrence time of a predetermined work sound recognized by the voice recognition means, the work time determination means determines the occurrence time of a first work sound among the predetermined work sounds recognized by the voice recognition means as the corrected work start time of the first vehicle, corrects the most recent work start time determined by the work time determination means to match it with the corrected work start time of the first vehicle, determines the occurrence time of a second work sound among the predetermined work sounds recognized by the voice recognition means as the corrected work end time of the first vehicle, and corrects the most recent work start time determined by the work time determination means to be consistent with the corrected work start time of the first vehicle. correcting the end time to match the corrected work end time of the first vehicle, determining the occurrence time of the third work sound of the predetermined work sounds recognized by the voice recognition means as the corrected work start time of the second vehicle, correcting the most recent work start time determined by the work time determination means to match the corrected work start time of the second vehicle, determining the occurrence time of the fourth work sound of the predetermined work sounds recognized by the voice recognition means as the corrected work end time of the second vehicle, and correcting the most recent work end time determined by the work time determination means to match the corrected work end time of the second vehicle; 6. The work time management system according to claim 5, wherein the work status determination means determines the work status for each of the first vehicle and the second vehicle by linking the work start time and work end time corrected by the work time determination means with the vehicle identification information.

Images