Work information management method, work information management system, and program

The work information management system addresses information defects by determining and displaying the operating status of work devices, enhancing user convenience and clarity.

JP2026070550APending Publication Date: 2026-04-28YANMAR HLDG CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
YANMAR HLDG CO LTD
Filing Date
2024-10-16
Publication Date
2026-04-28

AI Technical Summary

Technical Problem

Conventional work information management systems face challenges in providing convenient user experience due to information defects exceeding predetermined standards, such as information loss, which can confuse users about the status of work devices.

Method used

A work information management system that determines periods of information deficiency and operating status of work devices by analyzing multiple types of information, and outputs this status alongside the defective information to provide a clearer user interface.

Benefits of technology

Enhances user convenience by clearly indicating the operating status of work devices during information defects, reducing suspicion and improving user understanding.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2026070550000001_ABST
    Figure 2026070550000001_ABST
Patent Text Reader

Abstract

To provide work information in a manner that is highly convenient for the user. [Solution] The work information management method includes determining a period of deficiency in the work equipment that has a defect exceeding a standard, based on or based on the absence of the first type of work information, based on the first type of work information relating to the work equipment used for work in the field; determining the operating status of the work equipment during the determined deficiency period, based on or based on the absence of the second type of work information relating to the work equipment; and outputting output information indicating the determined operating status.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a work information management method, a work information management system, and a program.

Background Art

[0002] In recent years, with the progress of agricultural informatization, technologies for managing work information (for example, the position information of a work device or image information obtained by photographing the work of a work device) related to work devices operating in a field have been developed.

[0003] In relation to this, Patent Document 1 discloses a technique for acquiring information indicating an image captured during work in addition to position information indicating the current position of a work device. The work device of Patent Document 1 generates information indicating the position of the work device using a positioning device and generates information indicating a video during work using a photographing device.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] For example, when managing multiple types of work information related to a work device during work using the technique of Patent Document 1, due to a defect in the device for acquiring a specific type of information or the like, a defect exceeding a predetermined standard (for example, information loss) may occur in the specific type of work information. In such a case, if simply outputting the defective information, it may be difficult for a user who refers to the specific type of work information to determine what happened during work and may feel suspicious. As described above, when managing multiple types of work information using the conventional technique, there is a problem that the convenience for the user is low.

[0006] In light of the above circumstances, one of the purposes of this disclosure is to provide work information in a manner that is highly convenient for users. Other purposes can be understood from the following description and the description of the embodiments. [Means for solving the problem]

[0007] The means for solving the problem are described below using the numbers and symbols used in the embodiments for carrying out the invention. These numbers and symbols are added in parentheses for reference to show an example of the correspondence between the claims and the embodiments for carrying out the invention. Therefore, the claims should not be interpreted restrictively because of the parenthetical statements.

[0008] The work information management method according to the embodiment includes: determining a period of deficiency in the first type of work information that exceeds a standard, based on first type of information relating to a work device (FM) that performs work in a field (F), or based on the absence of first type of information; determining the operating status of the work device (FM) during the determined deficiency period, based on second type of information relating to the work device (FM), or based on the absence of second type of work information; and outputting output information indicating the determined operating status (FM).

[0009] The work information management system (1) according to the embodiment includes: a defect determination unit (120) that determines a defect period in which the first type of work information has defects exceeding a standard based on a first type of information relating to a work device (FM) that performs work in a field (F), or based on the absence of the first type of information; a state determination unit (130) that determines the operating state of the work device (FM) during the defect period determined by the defect determination unit (120) based on a second type of information relating to the work device (FM), or based on the absence of the second type of work information; and an information output unit (140) that outputs output information indicating the operating state (FM) determined by the state determination unit (130).

[0010] The programs (P1, P2, P3) according to the embodiment cause the computers (14, 24, 34) to perform the following actions: determine a period of defects in the first type of work information that exceeds a standard, based on the acquisition status of the first type of information regarding the work equipment (FM) used for work in the field (F); determine the operating status of the work equipment (FM) during the determined period of defects, based on the acquisition status of the second type of information regarding the work equipment (FM); and output output information indicating the determined operating status (FM). [Effects of the Invention]

[0011] According to the above configuration, work information can be provided in a manner that is highly convenient for the user. [Brief explanation of the drawing]

[0012] [Figure 1] This is a block diagram showing the configuration of a work information management system according to an embodiment. [Figure 2] This is a block diagram showing the configuration of a work information management device according to an embodiment. [Figure 3] This is a block diagram showing the configuration of a terminal device according to an embodiment. [Figure 4] This is a block diagram showing the configuration of the generating apparatus according to the embodiment. [Figure 5] This is a block diagram showing the functional configuration of the work information management system according to the embodiment. [Figure 6] This figure shows an example of device information according to the embodiment. [Figure 7] This is a flowchart showing the processes executed by the work information management system according to the embodiment. [Figure 8A] This is a flowchart showing the processes executed by the work information management system according to the embodiment. [Figure 8B] This is a flowchart showing the processes executed by the work information management system according to the embodiment. [Figure 9] This figure shows an example of accumulated work information according to the embodiment. [Figure 10]It is a diagram showing an example of updated accumulation work information according to an embodiment. [Figure 11] It is a diagram showing an example of an image displayed by the work information management system according to an embodiment. [Figure 12] It is a diagram showing an example of an image displayed by the work information management system according to an embodiment. [Figure 13] It is a diagram showing an example of an image displayed by the work information management system according to an embodiment. [Figure 14] It is a diagram showing an example of an image displayed by the work information management system according to an embodiment. [Figure 15] It is a diagram showing an example of trajectory information according to a modification. [Figure 16] It is a diagram showing an example of an image displayed by the work information management system according to a modification. [Figure 17] It is a diagram showing an example of an image displayed by the work information management system according to a modification.

Mode for Carrying Out the Invention

[0013] (Embodiment 1) Hereinafter, the work information management system according to the embodiment will be described with reference to the drawings. As shown in FIG. 1, the work information management system 1 includes a work information management device 10, one or more terminal devices (for example, terminal devices 20_1, terminal devices 20_2,...), and one or more work devices FM that perform work in one or more fields F. When distinguishing a plurality of terminal devices from each other is not necessary, they may simply be referred to as the terminal device 20.

[0014] The work device FM may be, for example, an agricultural machine capable of working in field F, such as a tractor, combine harvester, or harvester. Alternatively, the work device FM may be an agricultural drone that performs work in field F. The work device FM may be equipped with multiple generation devices (e.g., generation device 30_1, generation device 30_2, ..., etc.). When multiple generation devices are not distinguished from each other, they may simply be referred to as generation device 30. Multiple generation devices 30 may continuously generate different types of work information (e.g., image information taken around the work device FM, or positioning information indicating the location of the work device FM) for the same work performed by the work device FM.

[0015] The work information management device 10, one or more terminal devices 20, and one or more generating devices 30 can communicate with each other via network NT. Network NT is, for example, the Internet. In addition, in field F, positioning signals transmitted by positioning satellite GP can be received using a positioning device.

[0016] The work information management system 1 of this embodiment sequentially displays multiple types of work information continuously generated by multiple generation devices 30 for work currently being performed or previously performed by the work device FM on the screen of the terminal device 20 (for example, screen S in Figure 3). At this time, a problem occurring in a certain generation device 30 during a certain period of the work period (for example, failure of the generation device 30, communication failure, battery depletion, or physical detachment from the work device FM) may cause defects exceeding a predetermined standard (for example, complete or partial loss of information) in a specific type of work information. The period during which the work device FM has performed work and defects exceeding the standard occur in the work information to be processed (also called the first type of work information) is also called the period of deficiency of that type of work information. In this embodiment, other work information that may not have defects exceeding the standard during at least a part of the period of deficiency of the first type of work information is also called the second type of work information. For example, the second type of work information may be information generated and output by a different generation device 30 than the first type of work information.

[0017] For example, if the first type of work information is image information taken around the work device FM, the image information may be displayed sequentially in chronological order of capture, but during the period of deficiency, the images may be interrupted (or distorted). In this case, a user who was referring to the first type of work information may not know what happened with the work device FM and may become suspicious. For example, if the user is the manager of field F, they may mistakenly think that the worker using the work device FM has interrupted their work and may contact the worker who was actually performing the work. Therefore, the work information management system 1 of this embodiment determines the operating status of the work device FM during the period of deficiency (for example, whether it is in operation or not) based on the acquisition status of the second type of information during the period of deficiency. Then, when displaying the first type of work information, the work information management system 1 displays information indicating the operating status of the work device FM during the period of deficiency, in addition to or instead of the first type of work information. Thus, the work information management system 1 of this embodiment can provide the user with information regarding the operating status of the work device FM during the period of deficiency.

[0018] To generate multiple types of work information, the work device FM may be equipped with multiple generation devices 30 that operate independently. In addition, one or more generation devices 30 may be installed on the work device FM after the fact, rather than during factory manufacturing. In such a configuration, if a problem occurs in one of the multiple generation devices 30, it is likely that the other generation devices 30 will not experience any problems. According to the work information management system 1 of this embodiment, even in such cases, the degree to which the user feels suspicious can be reduced, and work information can be provided in a manner that is highly convenient for the user.

[0019] The configuration of the work information management system 1 will now be described. The work information management device 10 included in the work information management system 1 comprises an input / output device 12, an arithmetic unit 14, a communication device 16, and a storage device 18, as shown in Figure 2. The work information management device 10 is, for example, a computer with server functionality. The functions of the work information management device 10 may be provided via the cloud through the NT network.

[0020] The input / output device 12 receives information for the arithmetic unit 14 to perform processing. The input / output device 12 also outputs the results of the processing performed by the arithmetic unit 14. The input / output device 12 includes various input and output devices, such as a keyboard, mouse, microphone, display, speaker, and touch panel.

[0021] The communication device 16 is connected to the network NT in a communicative manner and communicates with external devices (e.g., terminal device 20 and generation device 30) of the work information management device 10 via the network NT. The communication device 16 transfers information acquired from external devices to the arithmetic unit 14. It also transfers information generated by the arithmetic unit 14 to external devices. The communication device 16 includes various interface devices with data communication functions, such as a NIC (Network Interface Card) and a USB (Universal Serial Bus).

[0022] The storage device 18 stores a program P1, which includes various data and instructions for the work information management device 10 of this embodiment to perform the processing described later. The storage device 18 is used as a non-transitory tangible storage medium for storing this data and instructions. The program P1 may be provided as a computer program product recorded on a computer-readable storage medium M1. The storage medium M1 may be a portable physical medium such as a CD (Compact Disc), DVD (Digital Versatile Disc), or USB (Universal Serial Bus) memory. Alternatively, the storage medium M1 may be a storage device of an external server that stores the program P1. In this case, the program P1 may be provided as a computer program product that can be downloaded from the server.

[0023] The arithmetic unit 14 reads a program P1 containing instructions and data for executing at least a part of the processing described later from the storage device 18 and executes it. The arithmetic unit 14 includes, for example, a central processing unit (CPU).

[0024] As shown in Figure 3, the terminal device 20 included in the work information management system 1 comprises an input / output device 22, an arithmetic unit 24, a communication device 26, and a storage device 28. The terminal device 20 is, for example, a mobile device such as a tablet or a smartphone. However, the terminal device 20 may also be a stationary personal computer or a notebook computer.

[0025] The input / output device 22 receives information for the arithmetic unit 24 to perform processing. The input / output device 22 also outputs the results of the processing performed by the arithmetic unit 24. The input / output device 22 includes various input and output devices. Furthermore, the input / output device 22 includes a touch panel or display that functions as a screen S. If the terminal device 20 is a personal computer, the input / output device 22 may include a keyboard, mouse, microphone, etc.

[0026] The communication device 26 is connected to the network NT in a communicative manner and communicates with external devices (for example, the work information management device 10 or the generation device 30) of the terminal device 20 via the network NT. The communication device 26 transfers information acquired from the external device to the computing device 24. It also transfers information generated by the computing device 24 to the external device. The communication device 26 includes various interface devices with communication functions, such as transceivers used in wireless communication such as wireless LAN (Local Area Network) and cellular networks.

[0027] The storage device 28 stores a program P2, which includes various data and instructions for the work information management system 1 of this embodiment to execute the processing described later. The storage device 28 is used as a non-temporary storage medium for storing this data and instructions. The program P2 may be provided as a computer program product recorded on a computer-readable storage medium M2. The storage medium M2 may be a portable physical medium such as a CD, DVD, or USB memory. Alternatively, the storage medium M2 may be a storage device of an external server that stores the program P2. In this case, the program P2 may be provided as a computer program product that can be downloaded from the server.

[0028] The arithmetic unit 24 reads a program P2 containing instructions and data for executing at least a part of the processing described later from the storage device 28 and executes it. For example, the arithmetic unit 24 includes a central processing unit (CPU).

[0029] As shown in Figure 4, the generation device 30 includes a sensor device 31, an input / output device 32, an arithmetic unit 34, a communication device 36, a storage device 38, and a power source 39.

[0030] The sensor device 31 includes a sensor device for sensing the status of the work device FM during the work period in which the work device FM moves over the field F and performs agricultural work. For example, if the type of work information corresponding to the generation device 30 is image information of the work of the work device FM, the sensor device 31 may include a camera unit including an optical system and an image sensor, and a clock for measuring the time of shooting. Alternatively, if the type of work information corresponding to the generation device 30 is positioning information, the sensor device 31 may include a GNSS (Global Navigation Satellite System) receiver. This sensor device 31 can receive positioning signals from positioning satellites GP and measure the positioning position and positioning time of the work device FM. Alternatively, the sensor device 31 may measure the position of the work device FM by self-position estimation using a quantum compass.

[0031] The input / output device 32 receives information for the arithmetic unit 34 to perform processing. The input / output device 32 also outputs the results of the processing performed by the arithmetic unit 34. The input / output device 32 may also include various input and output devices such as speakers, touch panels, keyboards, mice, microphones, and displays.

[0032] The communication device 36 is connected to the network NT in a communicative manner and communicates with external devices of the generation device 30 (e.g., the work information management device 10 or the terminal device 20) via the network NT. The communication device 36 transfers information acquired from the work information management device 10 to the arithmetic unit 34. The communication device 36 also transfers information generated by the arithmetic unit 34 to the work information management device 10. The communication device 36 includes various interface devices with wireless communication capabilities, such as cellular network or wireless LAN transceivers. In this embodiment, a communication device 36 belonging to a certain generation device 30 may establish a communication means specific to that generation device 30 (e.g., a cellular network or wireless LAN communication) in order to transmit the work information generated by that generation device 30.

[0033] The storage device 38 stores a program P3 containing various data and instructions for the work information management system 1 of this embodiment to execute the processing described later. The storage device 38 is used as a non-temporary storage medium for storing this data and instructions. The program P3 may be provided as a computer program product recorded on a computer-readable storage medium M3. The storage medium M3 may be a portable physical medium such as a CD, DVD, or USB memory. Alternatively, the storage medium M3 may be a storage device of an external server that stores the program P3. In this case, the program P3 may be provided as a computer program product that can be downloaded from the server.

[0034] The power source 39 supplies the sensor device 31, the input / output device 32, the arithmetic unit 34, the communication device 36, and the storage device 38 with the power necessary for their operation. The power source 39 includes, for example, a primary battery or a secondary battery. In this embodiment, the power source 39 of a certain generation device 30 includes a battery specific to that generation device 30 for transmitting power to each part of that generation device 30. The power source 39 of a certain generation device 30 (for example, a generation device 30_2 including a positioning device) may be a vehicle battery mounted on the work device FM. The state in which the power source 39 supplies sufficient power to each part of the generation device 30 and the processing described later can be executed is sometimes referred to as the running state of the generation device 30, and the state in which the power supply is stopped or reduced is sometimes referred to as the non-running state.

[0035] Furthermore, the power source 39 may have an automatic startup function that activates the generation device 30 in synchronization with the power source (e.g., engine) of the work device FM changing from a non-started state to an started state, without requiring a user to start the generation device 30. In addition, the power source 39 may have an automatic shutdown function that deactivates the generation device 30 in synchronization with the power source of the work device FM changing from an started state to a non-started state, without requiring a user to shut it down.

[0036] The arithmetic unit 34 reads a program P3 containing instructions and data for executing at least a part of the processing described later from the storage device 38 and executes it. For example, the arithmetic unit 34 includes a central processing unit (CPU). Note that the arithmetic unit 34 of a certain generation device 30 (for example, a generation device 30_2 including a positioning device) may be an ECU (Electronic Control Unit) that is incorporated into the work device FM and controls various parts of the work device FM.

[0037] Next, the functions of the work information management system 1 will be explained with reference to Figure 5. The generation device 30 realizes the functions of the sampling unit 310 and output unit 320 in Figure 5 when the calculation unit 34 in Figure 4 executes program P3.

[0038] The sampling unit 310 of the generation device 30 generates work information of a type corresponding to the generation device 30 at predetermined timings (for example, a 1-second cycle or a 1-minute cycle) while the generation device 30 is running, as described later. For example, the generation device 30 measures the status of the work device FM using the sensor device 31 at a predetermined sampling period at a predetermined timing. The sampling unit 310 then generates work information indicating the status of the work device FM measured using the sensor device 31. The timing at which the sampling unit 310 performs sampling (for example, the sampling period) may differ for each of the multiple generation devices 30 installed on the same work device FM. When the generation device 30 is recording video, the sampling unit 310 may generate frame images at predetermined frame intervals (for example, 1 / 30th of a second).

[0039] The output unit 320 of the generation device 30 transmits the work information generated by the sampling unit 310 to the work information management device 10 using the communication device 36. For example, the generation device 30 measures the status of the work device FM using the sensor device 31 at a predetermined output cycle (e.g., a 1-second cycle or a 1-minute cycle). The work information output by the output unit 320 may include information that identifies the generation device 30 (e.g., an identifier). The work information may also include information that identifies the work device FM on which the generation device 30 is installed. The timing of the output by the output unit 320 (e.g., the output cycle) may differ for each of the multiple generation devices 30 installed on the same work device FM.

[0040] The work information management device 10 of the work information management system 1 realizes the functions of the information acquisition unit 110, defect determination unit 120, state determination unit 130, information output unit 140, and information storage unit 150 shown in Figure 5, when the calculation unit 14 in Figure 2 executes program P1.

[0041] The information storage unit 150 stores information necessary for the work information management device 10 to execute processing. For example, the information storage unit 150 pre-stores field information D1 and equipment information D2 before starting the processing shown in Figures 7, 8A, and 8B. In addition, the information storage unit 150 may store accumulated work information D3 before starting the processing shown in Figures 8A and 8B. Furthermore, the information storage unit 150 may store setting information, such as thresholds used in the processing described later.

[0042] Field information D1 stores information that identifies one or more fields F (e.g., an identifier) ​​and information indicating the geographical extent of each field F, in association with each other. The information indicating the geographical extent of a field F may include information indicating the coordinates (e.g., latitude and longitude) of the vertices of the polygonal field F. Field information D1 may also include map information showing a map image of the geographical extent that includes the field F.

[0043] As shown in Figure 6, the device information D2 stores information indicating the work device FM for each of the one or more work devices FM that are the target of processing by the work information management system 1, a generation device 30 that generates work information for the work device FM, and a terminal device 20 that serves as the output destination for the information about the work device FM. In the example in Figure 6, the device information D2 stores, in association with "device ID" indicating one or more work devices FM, "first generation device" and "second generation device" indicating multiple generation devices 30 that generate work information for the work device FM, and "first output terminal" and "second output terminal" that serve as the output destination for the information about the work device FM. In this embodiment, "first output terminal" indicates a terminal device 20 (for example, terminal device 20_1) that serves as the output destination for output information including first type work information and information indicating the operating status of the work device FM during the period of deficiency of the first type work information. Furthermore, the "second output terminal" refers to a terminal device 20 (for example, terminal device 20_2) to which notification information indicating an abnormality in the generation or output of the first type of work information by the generation device 30_1 is output during the period of deficiencies in the first type of work information.

[0044] Furthermore, if there are three or more generating devices 30 or terminal devices 20 associated with the work device FM, the device information D2 includes information indicating the generating devices 30 or terminal devices 20 for each of those three or more devices.

[0045] As will be described later, the accumulated work information D3 stores the work information generated by the generation device 30, which generates work information for each work device FM.

[0046] The information acquisition unit 110 of the work information management device 10 in Figure 5 acquires information necessary for the processing described later from the information storage unit 150 or external devices (for example, terminal device 20 and generation device 30). The information acquisition unit 110 may provide the acquired information to the defect determination unit 120, the status determination unit 130, the information output unit 140, and the information storage unit 150.

[0047] As described later, the defect determination unit 120 determines the defect period in which the first type of work information contains defects that exceed the criteria set by the settings, based on the acquisition status of the first type of work information.

[0048] As will be described later, the status determination unit 130 determines which of several states the operating state of the work device FM during the period of deficiency is based on the acquisition status of the second type of work information during the period of deficiency.

[0049] As will be described later, the information output unit 140 outputs output information to the terminal device 20 that includes information indicating the operating status of the work device FM during the defect period determined by the status determination unit 130.

[0050] The terminal device 20 realizes the functions of the display unit 210 shown in Figure 5 when the arithmetic unit 24 shown in Figure 3 executes program P2.

[0051] The display unit 210 displays an image, which will be described later, based on the output information output by the information output unit 140.

[0052] Next, the processes executed by the work information management system 1 will be described. Each of the multiple generation devices 30 of the work information management system 1 starts the processes shown in Figure 7 in response to the generation device 30 transitioning from a non-started state to an started state. For example, the generation device 30 transitions to an started state in synchronization with the power source (e.g., engine) of the work device FM starting up.

[0053] In the process shown in Figure 7, first, in step S1002, the output unit 320 of the generation device 30 establishes communication with the work information management device 10. For example, the output unit 320 of the generation device 30 may establish communication with the work information management device 10 by using the communication means provided by its own device's communication device 36 to transmit to the work information management device 10 an identifier indicating its own device, that it has entered a startup state, and that it has started transmitting work information. The startup information may further include information indicating the timing at which the sampling unit 310 samples (for example, information on the sampling period) and information indicating the timing at which the output unit 320 outputs output information (for example, information on the output period). The startup information may also further include information indicating the type of work information corresponding to the generation device 30.

[0054] Next, in step S1004, the sampling unit 310 determines whether the current time is a sampling time when sampling should be performed. For example, the sampling unit 310 determines that it is a sampling time if time corresponding to the sampling period (e.g., 1 second) has passed since the time when communication was established in step S1002 or the time when the previous sampling was performed (step S1004: YES). In this case, step S1006 is then executed. On the other hand, the sampling unit 310 determines that it is not a sampling time if time corresponding to the sampling period (e.g., 1 second) has not passed since the time when communication was secured or the time when the previous sampling was performed (step S1004: NO). In this case, step S1008 is then executed.

[0055] In step S1006, the sampling unit 310 generates work information. For example, when the sampling time arrives, the sampling unit 310 uses the sensor device 31 to sense the working status of the work device FM. For example, if the type of work information corresponding to the generation device 30 is image information, the sampling unit 310 uses the sensor device 31 to capture an image of the work device FM in operation. Alternatively, if the type of work information corresponding to the generation device 30 is positioning information, the sampling unit 310 uses the sensor device 31 to measure the current position of the work device FM. The sampling unit 310 then generates work information indicating the sensing result and the sampling time. After step S1006 is completed, step S1008 is executed.

[0056] In step S1008, the output unit 320 determines whether the current time is the output time for outputting work information. For example, the output unit 320 determines that it is the output time if time corresponding to the output cycle (e.g., 1 second or 1 minute) has passed since the time communication was secured in step S1002 or the time the previous work information was output (step S1008: YES). In this case, step S1010 is executed next. On the other hand, the output unit 320 determines that it is not the output time if time corresponding to the output cycle has not yet passed since the time communication was secured in step S1002 or the time the previous work information was output (step S1008: NO). In this case, step S1012 is executed next. The output cycle of the generation device 30 may be the same as or different from the sampling cycle.

[0057] In step S1010, the output unit 320 outputs work information. For example, the output unit 320 outputs any unoutputted work information to the work information management device 10 using the communication means established in step S1002. For example, the output unit 320 may output all the work information generated in step S10006 after the previously executed step S1010, or it may output only some of the work information (for example, the latest work information). After step S1010 is completed, step S1012 is executed.

[0058] In step S1012, the output unit 320 determines whether the work is finished or not. For example, the output unit 320 determines that the work is finished if the automatic shutdown function of the power source 39 of the generation device 30 is activated in response to the work device FM transitioning to a non-started state (step S1012: YES). In this case, step S1014 is executed next. On the other hand, the output unit 320 determines that the work is not finished if the work device FM remains in an started state and the automatic shutdown function of the power source 39 of the generation device 30 is not activated (step S1012: NO). In this case, the process returns to step S1004, and the loop of steps S1004 to S1012 is repeated until the work of the work device FM is finished. The work information management device 10 may repeat the loop of steps S1004 to S1012 at a predetermined period (for example, the shortest period among the shooting period, sampling period, and output period). The work information management device 10 may repeat the loop at a period corresponding to the common factor of the shooting period, sampling period, and output period (for example, 0.1 seconds if the shooting period is 0.2 seconds, the sampling period is 1.5 seconds, and the output period is 4.9 seconds).

[0059] In step S1014, the output unit 320 outputs termination information. For example, the output unit 320 uses the communication means established in step S1002 to output termination information to the work information management device 10, indicating that the work is finished and the output of work information by the generation device 30 has stopped. Alternatively, the output unit 320 may disconnect the communication means established in step S1002 in step S1014. Once step S1014 is completed, the process shown in Figure 7 is finished. The period from the time step S1002 is executed to the time step S1014 is executed may correspond to the work period during which the work device FM performed the target work.

[0060] Multiple generation devices 30 each execute the process shown in Figure 7, thereby asynchronously generating multiple types of work information, which are then output to the work information management device 10. However, problems such as malfunctions, communication failures, or battery depletion may occur in the generation device 30 while it is executing the process shown in Figure 7. In such cases, the work information generated and output by that generation device 30 may contain significant noise or suffer from partial data loss. Alternatively, during the period in which the problem occurs, the generation device 30 may be unable to generate or output work information even if the work device FM is performing work.

[0061] When the work information management device 10 receives the startup information output by the output unit 320 of the generation device 30 in step S1002 of the process in Figure 7, it starts the processing in Figures 8A and 8B. Note that if the work information management device 10 receives startup information for another generation device 30 (for example, generation device 30_2) while the execution of Figures 8A and 8B, which were started in response to the startup information of the generation device 30 to be processed (for example, generation device 30_1), it may start Figures 8A and 8B again in parallel with the conventional processing in response to that startup information.

[0062] In the process shown in Figure 8A, first, in step S2002, the information acquisition unit 110 determines the type of work device FM and work information. For example, the information acquisition unit 110 determines the work device FM to be processed based on the startup information received at the start of processing and the device information D2.

[0063] As an example, the information acquisition unit 110 determines, among the work devices FM registered in the device information D2 in Figure 6, the work device FM in which a generation device 30 matching the generation device 30 indicated by the startup information is registered as the work device FM that is currently performing or has performed the work to be processed. Furthermore, the information acquisition unit 110 may determine the type of work information to be processed (first type) based on information indicating the type of work information corresponding to the generation device 30 included in the startup information. If the device information D2 includes type information indicating the type of work information corresponding to each generation device 30, the information acquisition unit 110 may determine the first type based on this type information.

[0064] Next, in step S2004 of Figure 8A, the information acquisition unit 110 determines whether or not it has received work information. For example, if the information acquisition unit 110 receives new work information output by the generation device 30 in step S1010 of Figure 7 using the communication device 16, it determines that it has received work information (step S2004 of Figure 8A; YES). In this case, step S2008 is executed next. On the other hand, if the information acquisition unit 110 has not yet received any new work information, it determines that it has not received any work information (step S2004; NO). In this case, step S2006 is executed next.

[0065] In step S2006, the deficiency determination unit 120 determines whether the length of the period of non-reception exceeds a certain threshold. For example, the deficiency determination unit 120 uses the time when step S2002 was executed, or the time when the work information was received in the previously executed step S2008, as the reference time, and compares the length of the period of non-reception from the reference time to the current time with a threshold value determined by the settings. As an example, the deficiency determination unit 120 may use a value obtained by adding a predetermined margin to the output cycle indicated by the startup information as the threshold value.

[0066] As a result of the comparison, if the length of the period of non-reception is less than the threshold, the deficiency determination unit 120 determines that the period of non-reception does not exceed the standard (step S2006; NO). In this case, step S2004 is executed next, and steps S2004 to S2006 are repeated until new work information is received or the period of non-reception exceeds the standard. On the other hand, if the period of non-reception is greater than or equal to the threshold, the deficiency determination unit 120 determines that the period of non-reception has exceeded the standard (step S2006; YES). In this case, since the length of the period during which work information cannot be obtained is considered to have exceeded the standard, step S2012 in Figure 8B is executed next. In this case, it can also be said that the deficiency determination unit 120 determined that there is a defect in the work information that exceeds the standard, based on the absence of work information.

[0067] In step S2008 of Figure 8A, the information acquisition unit 110 stores the work information received in step S2004. For example, the information acquisition unit 110 stores the newly acquired work information in the stored work information D3 shown in Figure 9. In the example in Figure 9, the stored work information D3 stores the following in association: "Work device" which indicates the identifier of the work device determined in step S2002; "Type" which indicates the type of work information determined in step S2002; "Sampling time" which indicates the time when the work information was sampled; and "Content" which indicates the status of the work device FM during work at the sampling time. For example, if the first type of work information is image information, the "Content" indicates an image of the work taken at the sampling time. Alternatively, if the first type of work information is positioning information, the "Content" indicates the position of the work device FM at the sampling time. If multiple pieces of work information generated at different sampling times are output in step S1010 of Figure 7, the information acquisition unit 110 stores each of these pieces of work information in the stored work information D3.

[0068] As described later, the work information management device 10 sequentially executes the process of step S2008, which stores the first type of work information in the stored work information D3, in response to the generation device 30 (for example, generation device 30_1) that is the target of this process sequentially generating and outputting the first type of work information. In parallel with this process, the work information management device 10 may also execute a process to sequentially store the second type of work information, which is sequentially generated and output by other generation devices 30 (for example, generation device 30_2) corresponding to the same work performed by the same work device FM, in the stored work information D3.

[0069] Next, in step S2010 of Figure 8A, the defect determination unit 120 determines whether or not there are defects in the work information newly stored in step S2008 that exceed the criteria defined in the settings. For example, if the defect determination unit 120 determines that there are defects that exceed the criteria through the determination process described below (step S2010; YES), then step S2012 of Figure 8B is executed. On the other hand, if the defect determination unit 120 determines that there are no defects that exceed the criteria through the determination process described below (step S2010; NO), then step S2016 of Figure 8B is executed.

[0070] For example, the defect determination unit 120 may determine whether or not there are data omissions exceeding a standard in the work information based on the sampling time of the newly stored work information. As an example, for each of the one or more newly stored work information, the defect determination unit 120 calculates the interval (also called the actual sampling interval) between the sampling time of the work information and the sampling time of the work information of the same type stored in the stored work information D3 that was sampled immediately before. If there is work information in which the actual sampling interval exceeds a predetermined threshold, the defect determination unit 120 may determine that there are data omissions and defects exceeding the standard (Step S2010; YES). On the other hand, if the actual sampling interval for any of the work information is below a predetermined threshold, the defect determination unit 120 determines that there are no defects exceeding the standard (Step S2010; NO).

[0071] Furthermore, as part of the determination process in step S2010, the defect determination unit 120 may first discard any defect information if one or more of the newly stored work information are defect information containing some kind of defect. In this case, it is equivalent to not having acquired any work information of type 1 at the sampling time of the defect information. For example, the defect determination unit 120 may determine any work information with an invalid data structure or data volume among the newly stored work information as defect information.

[0072] As described above, if the deficiency determination unit 120 determines in step S2006 of Figure 8A that there is a defect in the first type of work information exceeding the standard based on the absence of the first type of work information (step S2006; YES), or if the deficiency determination unit 120 determines in step S2010 of Figure 8A that there is a defect in the first type of work information exceeding the standard based on the first type of work information (step S2010; YES), then there is a problem with the acquisition status of the first type of work information, and the next step is executed in step S2012 of Figure 8B. In step S2012, the deficiency determination unit 120 determines the deficiency period in which the first type of work information has a defect exceeding the standard.

[0073] For example, if the deficiency determination unit 120 determines in step S2006 of Figure 8A that the length of the period during which the first type of work information has not been received exceeds the standard, it may determine that the period of non-reception is the deficiency period. In this case, the deficiency determination unit 120 may determine the period from the time the work information was last received to the current time as the deficiency period corresponding to the period of non-reception.

[0074] Furthermore, if the deficiency determination unit 120 determines in step S2010 of Figure 8A that there is a data gap in the first type of work information, it may determine the period corresponding to the data gap as the deficiency period. In this case, for work information where the actual sampling interval exceeds a predetermined threshold, the deficiency determination unit 120 may determine the time between the sampling time of the work information and the immediately preceding sampling time as the deficiency period corresponding to the data gap. Note that the deficiency period corresponding to the unreceived period and the deficiency period corresponding to the data gap may be collectively referred to as the information absence period. Note that the period within the work period of the work device FM that is not an information absence period may be referred to as the normal period.

[0075] Furthermore, in step S2012 of Figure 8B, if the information absence period determined in step S2012 executed in the previous loop and the information absence period determined in the current step S2012 are consecutive in time, the deficiency determination unit 120 may determine the combined information absence period as the deficiency period. Furthermore, the deficiency determination unit 120 may determine that the information absence periods are consecutive if there is no normal period of the first type of work information between the two information absence periods.

[0076] Next, in step S2014 of Figure 8B, the state determination unit 130 determines the operating state of the work device FM during the deficiency period. For example, the state determination unit 130 determines whether the work device FM is in a first state (operating) or a second state (not operating) based on the acquisition status of the second type of work information sampled during the deficiency period of the first type of work information stored in the accumulated work information D3. In this embodiment, the first state is when the power source (e.g., engine) of the work device FM is running, and the second state is when it is not running.

[0077] For example, the state determination unit 130 may determine that the work device FM was in operation during the defect period determined in step S2012 if the stored work information D3 contains information of the second type of work information sampled during the defect period determined in step S2012. On the other hand, the state determination unit 130 may determine that the work device FM was in a non-operational state during the defect period determined in step S2012 if the stored work information D3 does not contain information of the second type of work information sampled during the defect period determined in step S2012. In this case, the state determination unit 130 may exclude from this process any work information of the second type that was determined to be defect information in step S2010 of Figure 8A, which was performed with respect to that second type of work information.

[0078] Alternatively, the state determination unit 130 may determine that the work device FM was in operation during the first period of the period of deficiency in the first type of work information that overlaps with the normal period of the second type of work information. Furthermore, the state determination unit 130 may determine that the work device FM was in a non-operational state during the second period of the period of deficiency in the first type of work information that overlaps with the period of deficiency in the second type of work information.

[0079] Furthermore, within the first type of deficiency period, the period during which the work device FM is determined to be in the first state may be called the first type of work information deficiency activation period, and the period during which it is determined to be in the second state may be called the first type of work information deficiency shutdown period. In addition, the state determination unit 130 may determine that the work device FM was in the first state during the normal period of the first type of work information.

[0080] Next, in step S2015 of Figure 8B, the information output unit 140 updates the stored work information D3. For example, the information output unit 140 generates stored work information D3a by updating the stored work information D3 based on the deficiency period determined in step S2012 and the operating status determined in step S2014.

[0081] For example, if step S2014 determines an information absence period that exceeds the sampling period of the first type of work information, the information output unit 140 in step S2015 of Figure 8B may generate stored work information D3a by adding dummy work information corresponding to the missing first type of work information to the stored work information D3. For example, as shown in Figure 10, in stored work information D3a, dummy information dd_1 and dummy information dd_2 are added between work information d_1 corresponding to the time immediately before the information absence period and work information d_2 corresponding to the time immediately after the information absence period, with the sampling time being the time when the first type of work information should have been sampled. The following explanation will take the case where the sampling time of dummy information dd_1 is included in the faulty startup period and the sampling time of dummy information dd_2 is included in the faulty shutdown period as an example.

[0082] Next, in step S2016 of Figure 8B, the information output unit 140 outputs output information. For example, the information output unit 140 uses the communication device 16 to output output information to the terminal device 20, which indicates the first type of work information stored in the accumulated work information D3 and the operating status of the work device FM during the deficiency period determined in step S2015. The information output unit 140 outputs output information to the terminal device 20 (for example, terminal device 20_1) indicated by the "first output terminal" corresponding to the work device FM determined in step S2002 of Figure 8A, among the candidate terminal devices 20 of output stored in the device information D2 shown in Figure 6.

[0083] As an example, the information output unit 140 outputs output information that includes unoutputted work information of the first type of work information, the period of deficiency of the first type of work information determined in step S2012 of Figure 8B, and information indicating the operating status of the work device FM during the period of deficiency of the first type of work information determined in step S2014. Furthermore, if steps S2012 and S2014 are executed in the processing of the second type of work information, the information output unit 140 may output output information that further includes unoutputted second type of work information, the period of deficiency of the second type, and information indicating the operating status of the work device FM during the period of deficiency of the second type. The output information may also include information indicating the work device FM determined in step S2002 of Figure 8A. The output information may also include information indicating a map image of the field F where the work was performed, which is stored in the field information D1.

[0084] Next, in step S2018, the display unit 210 of the terminal device 20 displays information related to the output information. For example, if the first type of work information is image information and the second type of work information is positioning information, the display unit 210 displays image information as shown in Figures 11 to 14 on the screen S of the input / output device 22 as information related to the output information. In the example of Figures 11 to 14, the display unit 210 displays the position of the work device FM indicated by the second type of work information overlaid on the map information of the field F in the display area A1 of the screen S. The display unit 210 also displays an image of the work of the work device FM indicated by the first type of work information in the display area A2 of the screen S. The display unit 210 also displays information indicating the work device FM (e.g., an identifier) ​​and information indicating the startup status of the work device FM at the sampling time of the currently displayed first type of work information (e.g., a string of characters or symbols) in the display area A3 of the screen S. Furthermore, the display unit 210 displays information indicating the sampling time of the currently displayed first type of work information in display area A4 on screen S.

[0085] If the output information includes multiple types of work information, the display unit 210 may update the images shown in the display area A1, which are based on the types of work information, in the order of sampling time.

[0086] As shown in Figure 11, if the sampling time of the currently displayed Type 1 work information does not fall within the period of defects in Type 1 work information, the display unit 210 displays information in display area A3 indicating that the work device FM is in the first state. In addition, the display unit 210 displays in display area A1 a code indicating the position of the work device FM in a manner (for example, a first color) that indicates that there are no defects exceeding the standard in the Type 1 work information.

[0087] As shown in Figure 12, if the sampling time of the currently displayed first type of work information (e.g., dummy information dd_1) falls within the faulty startup period of the first type of work information, the display unit 210 displays information in display area A3 indicating that the work device FM is in the first state (e.g., the string "Operating"). In addition, the display unit 210 displays in display area A1 a code indicating the position of the work device FM in a manner that indicates that a malfunction exceeding the standard has occurred in the first type of work information (e.g., a second color and the string "× Camera"). In the example in Figure 12, the display unit 210 displays information in display area A3 indicating that a malfunction exceeding the standard has occurred in the first type of work information (e.g., the string "Camera image cannot be displayed normally").

[0088] As shown in Figure 13, if the sampling time of the currently displayed first type of work information (e.g., dummy information dd_2) falls within the period of incomplete operation of the first type of work information, the display unit 210 displays information in display area A3 indicating that the work device FM is in the second state (e.g., the string "Stopped"). In addition, the display unit 210 displays the code indicating the position of the work device FM in display area A1 in a manner that indicates that the work device FM is in the second state (e.g., a third color and an "×" mark). In the example in Figure 13, the display unit 210 displays information in display area A3 indicating that the work device FM is in the second state (e.g., the string "Stopped").

[0089] Furthermore, if the output information includes multiple pieces of second-type work information, the display unit 210 may update the second-type work information displayed in display area A1 according to the sampling time, in synchronization with updating the first-type work information that is displayed.

[0090] Furthermore, as shown in Figure 14, if the sampling time of the first type of work information falls within the faulty activation period of the second type of work information, the display unit 210 displays information in display area A3 indicating that the work device FM is in the first state (for example, the string "Operating"). In addition, the display unit 210 displays in display area A1 a code indicating the position of the work device FM in a manner that indicates that a malfunction exceeding the standard has occurred in the second type of work information (for example, a second color and the string "× position"). In the example in Figure 14, the display unit 210 displays information in display area A3 indicating that a malfunction exceeding the standard has occurred in the second type of work information (for example, the string "Positioning cannot be performed correctly").

[0091] Next, in step S2020 of Figure 8B, the information output unit 140 determines whether the work is finished or not. For example, the information output unit 140 may determine that the work is finished if it receives the completion information output by the generation device 30_1 in step S1014 of Figure 7 (step S2020: YES). In this case, the processing in Figures 8A and 8B is completed. On the other hand, if the information output unit 140 has not yet received the completion information output by the generation device 30_1, it may determine that the work is not finished (step S2020: NO). In this case, the processing from step S2004 of Figure 8A to step S2020 of Figure 8B is repeated for the next output cycle of the generation device 30_1.

[0092] As described above, the work information management system 1 performs the processing shown in Figures 7, 8A, and 8B for each of the multiple types of work information. Therefore, the work information management system 1 may use information used as the first type of work information in one process (for example, work information generated by the generation device 30_1) as the second type of work information in another process. Also, the work information management system 1 may use information used as the second type of work information in one process (for example, work information generated by the generation device 30_2) as the first type of work information in another process.

[0093] As described above, the work information management system 1 of this embodiment can display operational information of the work device FM during a period of deficiency in the first type of work information where defects exceeding the standard exist. Therefore, it is possible to reduce the sense of suspicion that a user who was referring to the first type of work information might feel during the period of deficiency. Furthermore, if the sampling period and output period of the generation device 30_1 are sufficiently short, by repeating the processing from step S2004 in Figure 8A to step S2020 in Figure 8B, the display unit 210 can update and display the first type of work information (for example, image information indicating the work of the work device FM) with low latency in step S2018. In this case, even during a period of deficiency in the first type of work information, which is updated and displayed in near real-time, it is possible to display information indicating whether the work device FM is currently in operation or not, based on the second type of work information or based on the absence of the second type of work information.

[0094] (modified version) The configuration described in the embodiment is just one example, and the configuration can be changed as long as it does not impair the functionality.

[0095] For example, one or more of the information acquisition unit 110, deficiency determination unit 120, status determination unit 130, information output unit 140, and information storage unit 150 of the work information management device 10 may be implemented in a distributed manner by two or more computers. Alternatively, for example, one or more of the functions of the work information management device 10 may be provided by the terminal device 20.

[0096] Furthermore, if the work information generated by the generation device 30 can be obtained from an external device (for example, an external server device that collects work information), the information acquisition unit 110 may acquire the operational information from this external device instead of the generation device 30. In this case, the work information management system 1 does not need to include the work device FM and the generation device 30.

[0097] Furthermore, the work information management device 10 may include a functional unit corresponding to the display unit 210 of the terminal device 20. In this case, the functional unit corresponding to the display unit 210 may display information as shown in Figures 11 to 14 on the screen of the display device of the input / output device 12 of the work information management device 10 in step S2018 of Figure 8B. In this case, the work information management system 1 does not need to include the terminal device 20.

[0098] Furthermore, the first type of work information and the second type of work information may be different types of information from those described in the above embodiments. For example, the first type of work information or the second type of work information may be operation information indicating the operating status of the work device FM. For example, the operation information may include one or more of the following: information indicating the positioning location of the work device FM, information indicating the speed of the work device FM, information indicating the power load of the work device FM (e.g., engine speed), and information indicating the operating status of the work device FM. The information indicating the operating status of the work device FM may also be information indicating whether or not the agricultural machinery installed on the work device FM is in operation. For example, the information indicating the operating status may show the sensing result of the clutch sensor indicating the connection status of the clutch that supplies power to the agricultural machinery installed on the work device FM at the sampling time. Furthermore, if the sensor device 31 includes a sensor that senses vibrations that occur during the operation of the agricultural machinery, or a sensor that senses sounds during operation, the information indicating the operating status may show the sensing result of such vibrations or sounds. For example, the state determination unit 130 may determine in step S2014 of Figure 8B that the working device FM is in a first state of operation if the vibration or sound indicated by the information showing the operating status is greater than a predetermined threshold.

[0099] Furthermore, the first type of work information and the second type of work information may be generated by the same generation device 30. For example, if the generation device 30 is a video camera equipped with a shooting device capable of capturing images and a microphone capable of recording sound, the first type of work information may indicate the frame images that constitute each frame of the video, and the second type of work information may indicate the sound for each frame period. A work information management system 1 with such a configuration can provide information about the operating status of the work device FM based on the presence or absence of sound information, even if, for example, the video camera can detect sound but is unable to capture video. Also, the first type of work information and the second type of work information may be the same type of information (for example, location information or video information) generated by different generation devices 30.

[0100] The generation device 30, which generates the first or second type of work information, does not necessarily have to be provided on the work device FM. For example, the generation device 30 may be an imaging device that photographs the work device FM at a location away from the work device FM.

[0101] Furthermore, if the second type of work information includes positioning information of the work device FM, the work information management system 1 may display the movement trajectory of the work device FM based on the positioning information in step S2018 of Figure 8B. In this modified example, for example, in step S2016 of Figure 8B, the information output unit 140 generates trajectory information D4 that connects the positions of the work device FM at each sampling time indicated by the positioning information in a time series. The information output unit 140 then outputs output information that includes the generated trajectory information D4.

[0102] Track information D4 may include multiple pieces of information indicating individual tracks, such as shown in Figure 15, which are formed by drawing a straight line between two consecutive positioning locations indicated by the positioning information. In the example in Figure 15, track information D4 includes a "track ID" indicating the identifier of multiple individual tracks, "first position" and "second position" indicating the start and end points of each individual track, respectively, and a "type" indicating the type of the individual track. Note that if the tracks are consecutive, the "second position" of one individual track will coincide with the "first position" of the immediately following individual track. As an example, "first position" and "second position" indicate the coordinates (e.g., latitude and longitude) that show the geographical location of the start and end points of the individual track. "Type" stores information indicating whether the individual track corresponds to a period of deficiency in the first type of work information (e.g., image information) or to a normal period.

[0103] For example, if either (or both) of the sampling time of the positioning information corresponding to "First Position" and the sampling time of the positioning information corresponding to "Second Position" falls within the period of deficiency of the first type of information, the information output unit 140 may determine that the individual trajectory corresponds to the period of deficiency of the first type of information and set the "Type" of the corresponding row to "Defective". On the other hand, if neither (or either) of the sampling time of "First Position" and the sampling time of "Second Position" falls within the period of deficiency, the information output unit 140 may determine that the individual trajectory corresponds to the normal period and set the "Type" of the corresponding row to "Normal".

[0104] Then, in step S2018 of Figure 8B, the display unit 210 of the terminal device 20 displays the individual trajectories corresponding to the defective period and the individual trajectories corresponding to the normal period in different ways, based on the trajectory information D4. For example, as shown in Figure 16, the display unit 210 displays the movement trajectory of the work device FM from the start of work to the present in the display area A1. In the example of Figure 16, the display unit 210 displays a symbol (e.g., a black circle) indicating the work device FM at a position corresponding to the current position of the work device FM on the map image of the field F in the display area A1. The display unit 210 also displays the individual trajectories stored in the trajectory information D4 on the map image of the field F in a first way (e.g., a thick solid line) for the individual trajectory corresponding to the normal period and in a second way (e.g., a thin dotted line) for the individual trajectory corresponding to the defective period.

[0105] Furthermore, the generation device 30 of the work information management system 1 may output all work information for the work period at once after the work of the work device FM has been completed. In this case, in step S1014 of Figure 7, the output unit 320 may output all work information generated during the work period. In this modified example, steps S1008 and S1010 may be omitted.

[0106] In a modified example where work information is output all at once after the work of the work device FM is completed, steps S2004 and S2006 in Figure 8A and step S2020 in Figure 8B may be omitted.

[0107] Furthermore, the work information management system 1 may output notification information to inform the user that a problem has occurred in the generation or output of the first type of work device by the generation device 30_1 during the period of deviation of the first type of work information. In this modified version, for example, after step S2012 is completed, the information output unit 140 may output notification information to the terminal device 20. The notification information may include, for example, audio or text information prompting the user operating the work device FM to check the generation device 30 (for example, generation device 30_1) that corresponds to the first type of work information provided on the work device FM. In this modified version, for example, the display unit 210 of the terminal device 20 uses the input / output device 22 to inform the user that a malfunction exceeding the standard has occurred in the first type of information based on the notification information.

[0108] In this case, the terminal device 20 to which the output is sent may be different from the terminal device 20 to which the output information is sent in step S2016. For example, the information output unit 140 may output notification information to the terminal device 20 (for example, terminal device 20_2) indicated by the "second output terminal" corresponding to the work device FM determined in step S2002 in Figure 8A, among the candidate terminal devices 20 for output stored in the device information D2 shown in Figure 6. In this case, the input / output device 22 of terminal device 20_2 may output an audio message or display text indicating that there is a problem with the generation or output of the first type of work device by the generation device 30_1, based on the notification information.

[0109] Furthermore, in step S2014 of Figure 8B, the state determination unit 130 of the work information management device 10 may determine that the work device FM is in the first state if it has been able to acquire non-defective information from a predetermined number (for example, 1) or more of the generation devices 30 during the period when the work information (first type of work information) generated by a certain generation device 30 is defective. In this modified example, in step S2014 of Figure 8B, the state determination unit 130 may determine that the work device FM is in the second state during the period when it has been able to acquire non-defective information from fewer than a predetermined number of the generation devices 30 during the period when it is defective.

[0110] Note that the processing order of the process for determining the deficiency period (for example, step S2012 in Figure 8B) and the processing order for determining the operating state (for example, step S2014) may be reversed. For example, after step S2008 in Figure 8A, the state determination unit 130 determines that the period during which work information can be successfully acquired from a predetermined number or more of the multiple generation devices 30 is the period in the first state, and the period during which it cannot be acquired is the period in the second state. After that, the deficiency determination unit 120 may determine for each generation device 30 whether or not there is a deficiency period, similar to step S2014. Even with this processing order, the work information management system 1 can provide information about the operating state of the work device FM regarding the deficiency period of the first type of work information.

[0111] For example, the generation device 30 may have a function to transition between an ON state, which generates or outputs work information, and an OFF state, which temporarily stops the generation or output of work information. As an example, the input / output device 32 of the generation device 30 may include an interface that accepts a user operation to temporarily switch to the OFF state, such as a camera off switch. In this case, if the sampling unit 310 of the generation device 30 detects a user operation to temporarily stop the generation of work information, it may skip step S1006 in Figure 7.

[0112] While the generation device 30 is in the off state, the output unit 320 may output normal information indicating that its own device is functioning normally, instead of work information. In this modified example, in step S2012 of Figure 8B, the period during which normal information, which does not include work information indicating the state of the work device FM, is received from the generation device 30 corresponding to the first type of work information may be determined to be a period of deficiency in the first type of information. Then, during the period during which normal information is received from the generation device 30, the state determination unit 130 may determine in step S2014 that the state of the work device FM is the first state and the state of the generation device 30 is in the off state.

[0113] If the state determination unit 130 determines that the generation device 30 is in the off state, the information output unit 140 outputs output information during the period of deficiency of the first type of information, which includes information indicating that the generation device 30 is in the off state and information indicating which generation device 30 is in the off state. In addition, the display unit 210 of the terminal device 20 may display information indicating that the generation device 30 is in the off state, such as the text string "The camera is off," as an output image.

[0114] Furthermore, the first type of information and the second type of information do not necessarily have to be displayed simultaneously on the same screen S. For example, the display unit 210 of the terminal device 20 may switch between displaying the first type of information (e.g., video information of the work of the work device FM) and the second type of information (e.g., information indicating the position of the work device FM) on the screen S. The display unit 210 may also switch the displayed information based on a user operation indicating a screen switch (e.g., if the input / output device 22 is a touch panel, a flick operation on the panel). In this modified example, when the first type of information is displayed, information indicating the startup status of the work device FM at the sampling time of the currently displayed first type of work information may also be displayed. Alternatively, the display unit 210 of the terminal device 20 may display the first type of information and information indicating the operating status, but may not display the second type of information.

[0115] Furthermore, as shown in Figure 17, the first type of information and the second type of information may be displayed on different screens (for example, screen S1 and screen S2). For example, the display unit 210 of the first terminal device 20 may display the second type of work information (for example, the location of the work device FM) overlaid on the map information of the field F in the display area A1 of screen S1. On the other hand, the display unit 210 of the second terminal device 20 may display the first type of work information (for example, an image of the work device FM in operation) in the display area A2 of screen S2. In addition, the display unit 210 of the second terminal device 20 may display information indicating the work device FM (for example, an identifier) ​​and information indicating the startup status of the work device FM at the sampling time of the currently displayed first type of work information in the display area A3 of screen S2. In this modified example, for instance, device information D2 may store information indicating a terminal device 20 that outputs one type of work information (e.g., location information) and another terminal device 20 that outputs a different type of work information (e.g., video information) for each work device FM. Then, in S2016 of Figure 8B, the information output unit 140 may output each type of work information to the terminal device 20 indicated by device information D2.

[0116] The embodiments and modifications described above are merely examples, and the configurations described in each embodiment may be arbitrarily changed and / or combined as long as they do not impair the function. Furthermore, some of the functions described in the embodiments may be omitted if the necessary functions can be achieved.

[0117] (Note) The work information management method, work information management system, and program described in each embodiment can be described as follows.

[0118] The work information management method relating to the first aspect is: Based on the first type of work information relating to the work equipment used for work in the field, or based on the absence of the said first type of work information, the period of deficiency in the said first type of work information that exceeds the standard, The operating status of the work device is determined during the period of deficiency determined based on the second type of work information relating to the work device, or based on the absence of the second type of work information. Outputting output information indicating the determined operating state, Includes.

[0119] The work information management method relating to the second embodiment is the work information management method relating to the first embodiment, Determining the operating state includes determining whether the work device is in operation during the period of malfunction, based on the second type of work information relating to the operating state of the work device during the period of malfunction, or based on the absence of the second type of work information during the period of malfunction.

[0120] The work information management method relating to the third aspect is a work information management method relating to the second aspect, Outputting the aforementioned output information includes, if it is determined that the work device was operating during the period of malfunction, outputting the aforementioned output information which includes information indicating that the work device was operating during the period of malfunction.

[0121] The work information management method relating to the fourth aspect is a work information management method relating to the third aspect, As the first type of work information, the camera mounted on the work device sequentially acquires image information showing images taken at different shooting times, The method further includes displaying the captured images in chronological order based on the output information which includes the image information, Displaying the aforementioned captured image includes, if it is determined that the work device was operational during the malfunction period, displaying information indicating that the work device was operational during the malfunction period.

[0122] The work information management method relating to the fifth aspect is a work information management method relating to any of the second to fourth aspects, The second type of work information includes information indicating the positioning location of the work device, The system further includes, based on the second type of work information, displaying the movement trajectory of the work device corresponding to the normal period not included in the defective period in the first mode, and the movement trajectory corresponding to the defective period in the second mode.

[0123] The work information management method relating to the sixth aspect is a work information management method relating to any of the second to fifth aspects, The second type of work information includes operational information of the work device, which indicates one or more of the following: the positioning position of the work device, the speed of the work device, the power load of the work device, and the operating status of the work device.

[0124] The work information management method relating to the seventh aspect is a work information management method relating to any of the second to fifth aspects, The first type of work information includes operational information of the work device indicating one or more of the following: the positioning position of the work device, the speed of the work device, the power load of the work device, and the operating status of the work device. The second type of work information includes image information showing images taken at different shooting times by a shooting device mounted on the work device.

[0125] The work information management method relating to the eighth aspect is a work information management method relating to any of the second to seventh aspects, To acquire the first type of work information generated using the first device, To acquire the two types of work information generated using the second device, If it is determined that the work device is operating during the period of malfunction, the system will notify that there is a malfunction in the first device. It also includes.

[0126] The work information management method relating to the ninth aspect is a work information management method relating to any of the first to eighth aspects, To acquire the first type of work information generated using the first device and transmitted using the first communication means, To acquire the second type of work information generated using the second device and transmitted using the second communication means, It also includes.

[0127] The work information management method relating to the 10th aspect is a work information management method relating to any of the 1st to 9th aspects, Based on the aforementioned second type of work information, or based on the absence of the aforementioned second type of work information, to determine if the aforementioned second type of work information has defects exceeding the standard, and to determine the period of deficiency in the aforementioned second type of work information. To determine the operating status of the work device during the period of deficiency of the second type of work information, which was determined based on the first type of work information or the absence of the first type of work information, It also includes.

[0128] The work information management system relating to the 11th aspect is: A defect determination unit that determines a defect period in which the work equipment used for work in the field has defects exceeding a standard, based on or on the absence of the first type of work information, A state determination unit that determines the operating state of the work device during the defect period determined by the defect determination unit, based on a second type of work information relating to the work device, or based on the absence of the second type of work information; An information output unit outputs output information indicating the operating state determined by the state determination unit, It is equipped with.

[0129] The program relating to the 12th aspect is: On the computer, Based on the first type of work information relating to the work equipment used for work in the field, or based on the absence of the said first type of work information, the period of deficiency in the said first type of work information that exceeds the standard, To determine the operating status of the work device during the period of deficiency determined based on the second type of work information relating to the work device, or based on the absence of the second type of work information; Outputting output information indicating the determined operating state, Make it run. [Explanation of Symbols]

[0130] 1. Work Information Management System 10 Work information management device 12 Input / Output Devices 14 Arithmetic unit 16. Communication equipment 18 Storage device 110 Information Acquisition Department 120 Department for Determining Deficiencies 130 State determination unit 140 Information Output Unit 150 Information storage section 20, 20_1, 20_2 Terminal devices 22 Input / Output Devices 24 Arithmetic unit 26 Communication equipment 28 Storage device 210 Display section 30, 30_1, 30_2 generator 31 Sensor device 32 Input / Output Devices 34 Arithmetic unit 36 Communication equipment 38 Storage device 39 Power Source 310 Sampling Unit 320 Output section Microsoft Network Field F FM work equipment P1, P2, P3 Program M1, M2, M3 storage medium D1 Field Information D2 device information D3 Accumulated work information D4 Track Information d_1, d_2 Work information dd_1, dd_2 Dummy information GP positioning satellites S, S1, S2 screen A1~A4 display area

Claims

1. Based on the first type of work information relating to the work equipment used for work in the field, or based on the absence of the first type of work information, the period of deficiency in the first type of work information that exceeds the standard is determined, The operating status of the work device is determined based on the second type of work information relating to the work device, or based on the absence of the second type of work information, during the period of deficiency. Outputting output information indicating the determined operating state, including, Work information management method.

2. Determining the operating state includes determining whether the work device is in operation during the period of failure, based on the second type of work information relating to the operating state of the work device during the period of failure, or based on the absence of the second type of work information during the period of failure. The work information management method according to claim 1.

3. Outputting the aforementioned output information includes, when it is determined that the work device was operating during the period of failure, outputting the aforementioned output information which includes information indicating that the work device was operating during the period of failure. The work information management method according to claim 2.

4. As the first type of work information, the camera mounted on the work device sequentially acquires image information showing images taken at different shooting times, The method further includes displaying the captured images in chronological order based on the output information which includes the image information, Displaying the aforementioned captured image includes, if it is determined that the work device was operational during the malfunction period, displaying information indicating that the work device was operational during the malfunction period. The work information management method described in claim 3.

5. The second type of work information includes information indicating the positioning location of the work device, Based on the second type of work information, the method further includes displaying, in a first manner, the movement trajectory of the work device corresponding to the normal period not included in the defective period, and in a second manner, the movement trajectory corresponding to the defective period. The work information management method according to claim 2.

6. The second type of work information includes operational information of the work device indicating one or more of the following: the positioning position of the work device, the speed of the work device, the power load of the work device, and the operating status of the work device. The work information management method according to claim 2.

7. The first type of work information includes operational information of the work device indicating one or more of the following: the positioning position of the work device, the speed of the work device, the power load of the work device, and the operating status of the work device. The second type of work information includes image information showing images taken at different shooting times by a shooting device mounted on the work device. The work information management method according to claim 2.

8. To acquire the first type of work information generated using the first device, To acquire the second type of work information generated using the second device, If it is determined that the work device is operating during the period of malfunction, the system will notify that there is a malfunction in the first device. This also includes, The work information management method according to claim 2.

9. To acquire the first type of work information generated using the first device and transmitted using the first communication means, To acquire the second type of work information generated using the second device and transmitted using the second communication means, This also includes, The work information management method according to claim 1.

10. Based on the aforementioned second type of work information, or based on the absence of the aforementioned second type of work information, to determine the period of deficiency in the aforementioned second type of work information if there are defects in the aforementioned second type of work information that exceed the standard, Based on the first type of work information, or based on the absence of the first type of work information, the operating status of the work device during the period of deficiency of the second type of work information is determined. This also includes, The work information management method according to claim 1.

11. A defect determination unit that determines a defect period in which the work equipment used for work in the field has defects exceeding a standard, based on or on the absence of the first type of work information, A state determination unit that determines the operating state of the work device during the defect period determined by the defect determination unit, based on a second type of work information relating to the work device, or based on the absence of the second type of work information; An information output unit outputs output information indicating the operating state determined by the state determination unit, Equipped with, Work information management system.

12. On the computer, Based on the first type of work information relating to the work equipment used for work in the field, or based on the absence of the first type of work information, the period of deficiency in the first type of work information that exceeds the standard is determined, Based on the second type of work information relating to the work device, or based on the absence of the second type of work information, the operating status of the work device during the period of deficiency is determined. Outputting output information indicating the determined operating state, A program to execute.

Citation Information

Patent Citations

  • Remote Control System

    JP7072553B2