Data collection system, information processing apparatus, information processing method, program, and working machine
The data collection system addresses the challenges of determining operating conditions and generating teacher data by acquiring and providing data with metadata that satisfies predetermined conditions, enhancing efficiency and analysis capabilities.
Patent Information
- Application Number
- JP2022500463
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2020-02-14
- Filing Date
- 2021-02-12
- Publication Date
- 2025-06-03
- Estimated Expiration
- 2041-02-12
AI Technical Summary
Existing data collection systems for industrial machines face challenges in determining the operating conditions of collected data and require separate processes for generating teacher data, which can be time and labor intensive.
A data collection system that includes a data request unit, an input unit, a data acquisition unit, and an incentive granting unit, which acquires data from work machines with work attachments and provides original data with metadata that satisfies predetermined conditions, allowing for efficient data collection and analysis.
The system enables the collection of data that satisfies predetermined conditions, facilitating analysis and machine learning applications by providing clear and relevant data, thereby reducing the time and labor required for data preparation.
Smart Images

Figure 0007687599000001 
Figure 0007687599000002 
Figure 0007687599000003
Abstract
Description
Technical Field
[0001] The present disclosure relates to a data collection system and the like.
Background Art
[0002] Conventionally, technologies for collecting various data related to industrial machines and performing various analyses and the like are known (see, for example, Patent Documents 1 and 2).
[0003] Patent Document 1 discloses a technology for collecting various data related to an excavator and analyzing (evaluating) the operation characteristics of an operator from viewpoints such as workability and energy saving.
[0004] Also, in Patent Document 2, a technology for collecting operation data of a working machine and performing an analysis related to failure prediction is known (see Patent Document 2).
Prior Art Documents
Patent Documents
[0005]
Patent Document 1
Patent Document 2
Summary of the Invention
Problems to be Solved by the Invention
[0006] However, for example, based on a certain piece of data alone, it may not be possible to determine what operating conditions of the industrial machine the data corresponds to. Also, for example, when performing machine learning (supervised learning) using the collected data, correct data (teacher data) corresponding to the collected data is required, and simply collecting data may not enable the desired analysis. Further, for example, a separate process for generating teacher data is required, and as a result, it may not be possible to prepare sufficient teacher data from the perspectives of time, labor, etc. Therefore, it is desirable to collect data with clear features that satisfy predetermined conditions required for analysis, such as data to which metadata satisfying predetermined conditions corresponding to the content of the analysis is attached, or data that satisfies predetermined conditions corresponding to the content of the analysis.
[0007] Therefore, in view of the above problems, an object is to provide a technology capable of collecting data that satisfies predetermined conditions.
Means for Solving the Problems
[0008] To achieve the above object, in one embodiment of the present disclosure, Requirement data that satisfies predetermined conditions, a data request unit that requests the user to acquire the requirement data regarding a work machine having a work attachment, an input unit that receives an input from a user, Based on the request to acquire the requirement data from the data request unit in response to the input received by the input unit, The requirement a data acquisition unit that acquires data, when the data is acquired by the data acquisition unit, Requirement an incentive granting unit that performs processing related to granting an incentive to the user, An original data providing unit that provides original data as operation data of the work machine, A notification unit that notifies the user of the content of the original data, is provided with 、 The data acquisition unit acquires the requirement data from the original data in response to an input regarding the original data received by the input unit, The original data is data regarding at least one of the state of the work machine during operation of the work machine, the state of the surrounding environment of the work machine, and the state of the operator of the work machine a data collection system is provided.
[0009] Also, in another embodiment of the present disclosure, Requirement data that satisfies predetermined conditions, corresponding to the request to acquire the requirement data regarding a work machine having a work attachment User Is performed, In response to an input to a predetermined input section, The requirement When the data is acquired, a process for granting an incentive to the user is performed. An incentive granting unit, An original data providing unit that provides the user with original data as operation data of the work machine, The requirement data is acquired from the original data in response to an input regarding the original data received by the input unit, The original data is data regarding at least one of the state of the work machine during operation of the work machine, the state of the surrounding environment of the work machine, and the state of the operator of the work machine , An information processing device is provided.
[0010] In still another embodiment of the present disclosure, An information processing method performed by an information processing device, Requirement data that satisfies predetermined conditions, corresponding to the request to acquire the requirement data regarding a work machine having a work attachment User Is performed, In response to an input to a predetermined input section, The requirement When the data is acquired, a process for granting an incentive to the user is performed. An incentive granting step, An original data providing step of providing the user with original data as operation data of the work machine, including The requirement data is acquired from the original data in response to an input regarding the original data received by the input unit, The original data is data regarding at least one of the state of the work machine during operation of the work machine, the state of the surrounding environment of the work machine, and the state of the operator of the work machine , A method for processing information is provided.
[0011] In still another embodiment of the present disclosure, In the information processing device, Requirement data that satisfies predetermined conditions, corresponding to the request to acquire the requirement data regarding a work machine having a work attachment User Is performed, In response to an input to a predetermined input section, The requirement When the data is acquired, a process for granting incentives to the user is carried out. An incentive granting step, Execute an original data providing step of providing the user with original data as operation data of the work machine, The required data is obtained from the original data in response to an input related to the original data received by the input unit, The original data is data related to at least one of the state of the working machine during operation of the working machine, the state of the surrounding environment of the working machine, and the state of the operator of the working machine R, The program is provided.
[0012] In still another embodiment of the present disclosure, In the information processing device, A claim involving the granting of incentives to a user, related to a work machine having a work attachment that satisfies predetermined conditions Requirement A request receiving step of receiving a request for data acquisition from the outside, An input step of receiving an input from the user, According to the input received in the input step, satisfying the predetermined conditions The requirement A data acquisition step of acquiring data, A notification step of notifying the user of the content of the original data as the operation data of the working machine; To execute 、 In the data acquisition step, the required data is acquired from the original data in response to an input related to the original data received in the input step, The original data is data related to at least one of the state of the working machine during operation of the working machine, the state of the surrounding environment of the working machine, and the state of the operator of the working machine Of, A program is provided. Also, in still other embodiments of the present disclosure, A work attachment, A claim involving the granting of incentives to a user, including a request receiving unit that receives a request for acquiring operation data that satisfies predetermined conditions from the outside, An input unit that receives the input from the user, According to the input received by the input unit, satisfying the predetermined conditions The A data acquisition unit that acquires operation data, A notification unit that notifies the user of the content of the original data as the operation data of the working machine; Comprising 、 The data acquisition unit acquires the operation data from the original data in response to an input related to the original data received by the input unit, The original data is data related to at least one of the state of the working machine during operation of the working machine, the state of the surrounding environment of the working machine, and the state of the operator of the working machine Of, A work machine is provided.
Advantages of the Invention
[0013] According to the above-described embodiments, data that satisfies predetermined conditions can be collected.
Brief Description of the Drawings
[0014]
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10
Figure 11
Figure 12
Figure 13
Figure 14
Figure 15
Figure 16
Figure 17
Figure 18
Mode for Carrying Out the Invention
[0015] Hereinafter, embodiments will be described with reference to the drawings.
[0016] [Overview of the data collection system] With reference to FIGS. 1 to 4, an example of the data collection system 1 according to the present embodiment will be described.
[0017] FIGS. 1 and 2 are schematic diagrams showing an example and another example of the data collection system 1 according to the present embodiment. FIGS. 3 and 4 are diagrams showing an example and another example of the outline of the operation of the data collection system 1 according to the present embodiment.
[0018] As shown in FIGS. 1 and 2, the data collection system 1 includes a plurality of user devices 10 and a data request device 20.
[0019] In response to a request signal from the data request device 20, the data collection system 1 acquires (collects) data (hereinafter, "request data") corresponding to the request signal by a user making a predetermined input in each of the plurality of user devices 10. The request data is data that satisfies a predetermined condition. Details of the request data will be described later.
[0020] Each of the plurality of user devices 10 is used by any one of a plurality of users (hereinafter, "supply users") on the supply side of the request data in the data collection system 1. Each of the plurality of user devices 10 may be associated with a specific supply user or may be shared by a plurality of supply users.
[0021] The user device 10 is, for example, a user terminal. The user terminal includes, for example, a mobile terminal. The mobile terminal includes, for example, a mobile phone, a smartphone, a tablet terminal, a laptop computer terminal, etc. Further, the user terminal may include, for example, a stationary terminal such as a desktop computer terminal. Further, the user device 10 may be, for example, a server. Further, the user device 10 may be a mechanical device (for example, an industrial machine, etc.) that operates when the supplying user performs an operation. The industrial machine includes, for example, a movable mobile industrial machine (so-called working machine) such as a shovel or a bulldozer that can travel. Further, the industrial machine includes, for example, a stationary industrial machine installed in a factory such as a machine tool or an injection molding machine.
[0022] A plurality of user devices 10 are each communicably connected to the data request device 20 through the communication line NW1. The communication line NW1 includes, for example, a wide area network (WAN: Wide Area Network). The wide area network may include a mobile communication network having a base station at its end. Further, the wide area network may include, for example, a satellite communication network using a communication satellite. Further, the wide area network may include, for example, the Internet network. Further, the communication line NW1 may include, for example, a short-range communication network based on a communication standard such as WiFi or Bluetooth (registered trademark). Further, the communication line NW1 may include, for example, a local area network (LAN: Local Area Network) or a one-to-one communication line. The same applies to the communication line NW2 described later. Thereby, the plurality of user devices 10 can receive signals and data from the data request device 20 or transmit signals and data to the data request device 20.
[0023] The data request device 20 transmits a request signal for requesting acquisition (generation) of requested data to each of the plurality of user devices 10 through the communication line NW1. Then, the data request device 20 collects (receives) the requested data acquired by the user device 10 from the user device 10 in response to the input from the supplying user in response to the request.
[0024] The data request device 20 is, for example, a cloud server installed at a location relatively far from a plurality of user devices 10. Further, the data request device 20 may be, for example, an edge server installed at a location relatively close to some or all of the user devices 10. In this case, there may be a plurality of data request devices 20. Also, the data request device 20 may be, for example, a mobile terminal or a stationary terminal.
[0025] Also, as shown in FIG. 2, the data collection system 1 may further include a demand user device 30.
[0026] The demand user device 30 is used by a user on the demand side of the requested data (hereinafter, "demand user") in the data collection system 1. The number of demand user devices 30 included in the data collection system 1 may be one or a plurality.
[0027] The demand user device 30 is, for example, a terminal device. Terminal devices include, for example, mobile terminals and stationary terminal devices. Also, the demand user device 30 may be, for example, a server.
[0028] The demand user device 30 is communicably connected to the data request device 20 through the communication line NW2. Thereby, the demand user device 30 can transmit a signal to the data request device 20 or receive data from the data request device 20.
[0029] For example, as shown in FIG. 3, in response to an input regarding the demand for data from an operator or the like, the data request device 20 determines the specification of the requested data and the content of the incentive to the supply user for the provision of the requested data. Then, the data request device 20 transmits a request signal for the requested data, including the specification of the requested data and the content of the incentive to the supply user for the provision of the requested data, to the user device 10.
[0030] In response to the reception of a request signal, the user device 10 presents the specifications of the requested data for the supplying user and the content of the incentive. Then, in response to the input from the supplying user, the user device 10 acquires the requested data and returns it to the data request device 20.
[0031] The data request device 20 can collect the requested data by receiving the requested data returned from a plurality of user devices 10. Then, for each supplying user who has cooperated in the acquisition of the requested data, the data request device 20 grants an incentive for the provision of the requested data. Also, the requested data may be provided (sold) to the demanding user. In this case, the requested data is transmitted to the demanding user device 30 through the communication line NW2.
[0032] Also, for example, as shown in FIG. 4, the demanding user device 30 determines the specifications of the requested data in response to the input regarding the data demand from the demanding user (when the demanding user is a company, its employees, etc.). Then, the demanding user device 30 transmits a data collection request including the specifications of the requested data to the data request device 20.
[0033] In response to the reception of the data collection request, the data request device 20 determines the content of the incentive from the specifications of the requested data. Then, similar to the case of FIG. 3, the data request device 20 transmits a request signal for the requested data, including the specifications of the requested data and the content of the incentive for the supplying user for the provision of the requested data, to the user device 10.
[0034] Similar to the case of FIG. 3, in response to the reception of the request signal, the user device 10 presents the specifications of the requested data for the supplying user and the content of the incentive. Then, in response to the input from the supplying user, the user device 10 acquires the requested data and returns it to the data request device 20.
[0035] Similar to the case of FIG. 3, the data request device 20 can collect request data by receiving request data returned from a plurality of user devices 10. Further, the data request device 20 gives an incentive for providing the request data to each supply user who has cooperated in acquiring the request data. Then, the data request device 20 transmits (provides) the collected request data to the demand user device 30. Thereby, the demand user device 30 can acquire request data corresponding to the demand of the demand user via the data request device 20.
[0036] Hereinafter, in the present embodiment, the configuration and operation of the user device 10 and the data request device 20 in the data collection system 1 will be mainly described.
[0037] [Specific Example of Configuration of Data Collection System] Next, in addition to FIGS. 1 to 4, with reference to FIGS. 5 and 6, a specific example of the configuration of the data collection system 1 will be described.
[0038] FIGS. 5 and 6 are block diagrams showing an example and another example of the configuration of the data collection system 1, respectively.
[0039] [Configuration of User Device] As shown in FIGS. 5 and 6, the user device 10 includes a control device 11, a communication device 12, an output device 13, and an input device 14. Further, as shown in FIG. 6, the user device 10 may include a data acquisition device 15.
[0040] The control device 11 performs various controls related to the user device 10.
[0041] The functions of the control device 11 may be realized by, for example, any hardware, or any combination of hardware and software, etc. For example, the control device 11 is mainly configured around a computer including a CPU (Central Processing Unit), a memory device such as a RAM (Random Access Memory), a non-volatile auxiliary storage device such as a ROM (Read Only Memory), and an interface device for input / output with the outside. Hereinafter, the same may apply to the control device 21 of the data request device 20 described later.
[0042] As shown in FIG. 5, the control device 11 includes a notification unit 111 and a requested data acquisition unit 112. Further, as shown in FIG. 6, the control device 11 may include an original data providing unit 113. The functions of the notification unit 111, the requested data acquisition unit 112, and the original data providing unit 113 are each realized, for example, by executing a predetermined program installed in the auxiliary storage device on the CPU.
[0043] The communication device 12 is connected to the communication line NW1 and communicates with the data request device 20.
[0044] The output device 13 outputs various types of information provided to the supply user from the user device 10. The output device 13 includes, for example, a display device that outputs visual information (information image) and a lighting device (lamp). The display device includes, for example, a liquid crystal display, an organic EL (Electroluminescence) display, etc. The lighting device can notify the supply user of information, for example, by the presence or absence of lighting, brightness, color, blinking pattern, etc. Further, the output device 13 includes, for example, a sound output device that outputs auditory information (predetermined sounds, voices, etc.). The sound output device includes, for example, a buzzer, a speaker, etc.
[0045] The input device 14 receives an input from the supplying user. The input device 14 includes, for example, an operation input device that receives an operation input from the supplying user. The operation input device may include, for example, a keyboard, a mouse, a button, a toggle, a touch panel, a touch pad, etc. Further, the input device 14 may include, for example, a voice input device that receives a voice input from the supplying user, a gesture input device that receives a gesture input from the supplying user, etc. The voice input device includes, for example, a microphone. Further, the gesture input device includes, for example, an imaging device that images the gesture of the supplying user.
[0046] The data acquisition device 15 acquires data related to at least one of the state of the mechanical device, the state of the surrounding environment of the mechanical device, and the state of the operator (supplying user) of the mechanical device, for example, when the user device 10 is a mechanical device operated by the operation of the supplying user. The data acquisition device 15 includes, for example, various sensors. Further, the data acquisition device 15 may include, for example, a control device that generates (acquires) control data of the mechanical device. The control device may be the same as or different from the control device 11. The data acquired by the data acquisition device 15 is taken into the control device 11.
[0047] In response to a request signal received from the data request device 20 by the communication device 12, the notification unit 111 notifies the supplying user of the content of the request signal through the output device 13. Specifically, the notification unit 111 notifies the supplying user of the content of the requested data defined in the request signal in a visual or auditory manner through the output device.
[0048] The request data acquisition unit 112 acquires (generates) request data according to an input signal corresponding to an input received by the input device 14. Specifically, the supplying user checks the content (specification) of the request data requested from the data request device 20 through the output device 13, and performs an input (for example, an operation input) for acquiring (generating) the request data through the input device 14. Thereby, the request data acquisition unit 112 can acquire request data according to the input from the supplying user. The request data acquisition unit 112 transmits the acquired request data to the data request device 20 through the communication device 12. At this time, the request data acquisition unit 112 also transmits the identification information of the supplying user using the user device 10 (hereinafter, "user identification information") to the data request device 20. The user identification information is, for example, a unique ID (Identifier) for each of a plurality of supplying users. Thereby, the data request device 20 can identify the supplying user using the user device 10 that is the transmission source of the request data.
[0049] The original data providing unit 113 provides the original data corresponding to the request data to the request data acquisition unit 112. Specifically, the original data providing unit 113 provides the original data from among various types of data imported from the data acquisition device 15.
[0050] <Configuration of Data Request Device> As shown in FIGS. 5 and 6, the data request device 20 includes a control device 21 and a communication device 22.
[0051] The control device 21 performs various controls related to the data request device 20.
[0052] As shown in FIG. 5, the control device 21 includes a data request unit 211, an original data providing unit 212, an original data storage unit 213, a requested data storage unit 214, a point processing unit 215, and a ledger storage unit 216. Further, as shown in FIG. 6, when the original data providing unit 113 is included in the user device 10, the original data providing unit 212 and the original data storage unit 213 may be omitted. The functions of the data request unit 211, the original data providing unit 212, and the point processing unit 215 are respectively realized, for example, by a predetermined program installed in an auxiliary storage device being executed on the CPU. Also, the functions of the original data storage unit 213, the requested data storage unit 214, and the ledger storage unit 216 are realized, for example, by a storage area defined in advance in the internal memory of the control device 21.
[0053] Note that the functions of the data request device 20 (control device 21) may be shared by a plurality of devices. For example, the functions of the data request unit 211, the original data providing unit 212, the original data storage unit 213, the requested data storage unit 214, and the point processing unit 215 and the ledger storage unit 216 may be mounted on different devices.
[0054] The communication device 22 is connected to the communication line NW1 and communicates with a plurality of user devices 10. Also, the communication device 22 may be connected to the communication line NW2 and communicate with the demand user device 30.
[0055] The data request unit 211 distributes a request signal defining the content of the requested data to each of the plurality of user devices 10 through the communication device 22.
[0056] Note that when the content of the requested data is fixed, the data request unit 211 may be omitted. This is because even if the user device 10 does not receive the request signal, it can grasp the content of the requested data if it is registered in advance in the internal memory of the control device 11.
[0057] The original data providing unit 212 transmits the original data corresponding to the requested data to the user device 10 through the communication device 22.
[0058] The original data storage unit 213 stores original data corresponding to the requested data. The original data may be, for example, operation data uploaded from a plurality of industrial machines to the data request device 20. The operation data may include, for example, at least one of data related to the state of the industrial machine during operation, data related to the state of the surrounding environment of the industrial machine, and data related to the state of the operator of the industrial machine.
[0059] The requested data storage unit 214 stores the requested data received from the user device 10 by the communication device 22.
[0060] The point processing unit 215 performs processing related to point assignment and the like for a predetermined point program (hereinafter, simply referred to as the "point program"). When the requested data is acquired (received) from the user device 10, the point processing unit 215 performs processing related to point assignment to the supply user (hereinafter, the "source user") using the source user device 10. Specifically, the point processing unit 215 performs processing to add (append) points as an incentive from a predetermined source to the remaining point balance of the source user in the point ledger stored in the ledger storage unit 216. As a result, with the effect of incentive (point) assignment, more supply users can be made to participate in the activity of acquiring (generating) requested data. Therefore, the data request device 20 can more easily collect more requested data.
[0061] The point program may be a point program independently operated in the data collection system 1, or may be a general-purpose point program operated by another organization. In the latter case, the ledger storage unit 216 may be omitted, and the point processing unit 215 may be in a mode of requesting point assignment based on a predetermined source to a server or the like of the point program's administrative office.
[0062] The point ledger is stored in the ledger memory unit 216. The point ledger records the remaining points and the like of each of the registered multiple supply users.
[0063] Furthermore, the functions of the point processing unit 215 and the ledger memory unit 216 may be transferred to the user device 10. In this case, by applying the Distributed Ledger Technology, when each of the multiple user devices 10 updates the point ledger, it may transmit the content of the updated point ledger to other user devices 10 and share the content of the point ledger as a whole.
[0064] As described above, in this embodiment, the input device 14 (an example of an input unit) receives an input from the supply user. Also, the request data acquisition unit 112 (an example of a data acquisition unit) acquires request data (for example, request data related to industrial machinery) that satisfies a predetermined condition in response to the input received by the input device 14. Then, when the request data acquisition unit 112 acquires request data that satisfies a predetermined condition, the point processing unit 215 (an example of an incentive granting unit) performs processing related to granting an incentive to the supply user, specifically, processing of adding points to the remaining points of the supply user.
[0065] Thereby, the data request device 20 can give an incentive to the supply user to cooperate in acquiring the request data. Therefore, along with granting an incentive to the supply user, the data request device 20 can collect request data whose features are clear and that satisfy a predetermined condition required for analysis, for example.
[0066] Furthermore, the incentive given to the supply user may be other than the addition (granting) of points to the supply user's point balance in the point program. For example, the incentive given to the supply user may be the distribution of a predetermined coupon or the like to the user terminal (e.g., smartphone, etc.) used by the supply user. In this case, as a process related to the granting of the incentive, the control device 21 performs a process of requesting the distribution server that distributes the coupon to distribute the coupon to a specific user terminal through the communication device 22. Also, for example, the incentive given to the supply user may be the right to win or the right to increase the winning probability in the provision of articles, services, etc. in an online (web) lottery, or an invitation to an invitation-only lottery. Also, for example, the incentive given to the supply user may be a cash refund instead of a point reduction. Also, for example, the incentive given to the supply user may be any benefit that the supply user receives online. Benefits that the supply user receives online include, for example, the granting of a "like" on the data collection system 1 or other online systems, the right to rank up in a rank provided in multiple stages, the granting of points for rank up, an increase in the point grant rate due to rank up, and the like.
[0067] [Specific Examples of Methods for Collecting Request Data] Next, with reference to FIGS. 7 to 17, specific examples of methods for collecting request data will be described.
[0068] [First Example of Method for Collecting Request Data] FIG. 7 is a flowchart schematically showing a first example of a process (hereinafter, "request data acquisition process") related to the acquisition of request data by the user device 10 (control device 11). FIG. 8 is a diagram showing a first example of a screen (hereinafter, "request screen") for notifying the content of the request data displayed on the output device 13 (display device). FIG. 9 is a diagram showing an example of the request data acquired by the user device 10 (request data acquisition unit 112).
[0069] In this example, in the user device 10, in response to a predetermined input to the input device 14, a predetermined application program (hereinafter simply referred to as "app") is started, whereby functions such as the request data acquisition unit 112 become effective. Then, in response to the start of the app, a start signal is transmitted to the data request device 20. This flowchart starts in response to the start of the app. The same applies to the cases of the third to fifth examples (FIGS. 12, 14, and 16) described later.
[0070] As shown in FIG. 7, in step S102, the notification unit 111 receives (acquires) a request signal transmitted from the data request device 20 in response to the start signal through the communication device 12. The request signal defines request data that combines original data and metadata regarding the original data that satisfies a predetermined condition. Specifically, request data that combines original data and correct answer data for supervised learning using the original data is defined. For example, when performing machine learning (supervised learning) to generate a model for determining the presence or absence of a predetermined object (e.g., a person) in an image, data representing the presence or absence of the predetermined object in the image data as the original data corresponds to the correct answer data. Also, for example, when performing machine learning not only to determine the presence or absence of a predetermined object in an image but also to recognize the image area containing the predetermined object, data for specifying the image area of the predetermined object contained in the image data as the original data corresponds to the correct answer data. Also, for example, when performing machine learning to generate a model for determining the presence or absence of an abnormality from the content of the operation data of an industrial machine, data representing whether the operation data as the original data corresponds to the normal state or the abnormal state of the industrial machine corresponds to the correct answer data.
[0071] When the process of step S102 is completed, the control device 11 proceeds to step S104.
[0072] Note that the request signal may be distributed from the data request device 20 to the user device 10 before the start of this flowchart. In this case, the process of step S102 is omitted.
[0073] In step S104, the notification unit 111 acquires the original data. When the process of step S104 is completed, the control device 11 proceeds to step S106.
[0074] In step S106, the notification unit 111 causes the output device 13 (display device) to display a request screen based on the data and the like acquired in the processes of steps S102 and S104.
[0075] For example, as shown in FIG. 8, the request screen includes original data information 501, request data information 502, and incentive information 503.
[0076] The original data information 501 represents the content of the original data (image data). In this example, the original data information 501 corresponds to image data captured by an imaging device mounted on the working machine, and the image data shows a worker (person) existing in a region relatively close to the working machine. In this case, the user device 10 may be, for example, the working machine, and as described above, the original data providing unit 113 may provide the image data acquired by the data acquisition device 15 (imaging device) to the notification unit 111 and the request data acquisition unit 112. Then, the supply user (for example, the operator of the working machine) sitting in the operator's seat of the working machine can use the output device 13 and the input device 14 installed near the operator's seat to cooperate in acquiring the request data during breaks or other times. The same may apply to the following cases of the third example (FIG. 13) and the fifth example (FIG. 17) described later.
[0077] The request data information 502 represents the content of the request data. In this example, the request data information 502 states "Please enclose the area of the person with a rectangle". Thus, the supply user can recognize that, as the correct data to be combined with the original data (image data), it is sufficient to draw a figure (rectangle) that specifies the image area including the person in the image data.
[0078] Incentive information 503 represents the content (amount of points) of the incentive obtained when cooperating in the acquisition of request data, that is, the drawing operation of the figure for identifying the image area in which the person of the image data is included. In this example, the incentive information 503 describes that 10 points are given as an incentive. Thereby, the supply user can grasp the content of the incentive obtained by cooperating in the acquisition of request data. Therefore, the supply user can determine whether to cooperate in the acquisition of request data in consideration of the content of the incentive.
[0079] Returning to FIG. 7, when the process of step S106 is completed, the control device 11 proceeds to step S108.
[0080] In step S108, the request data acquisition unit 112 determines whether correct answer data has been input through the input device 14. If the correct answer data has not been input through the input device 14, the request data acquisition unit 112 proceeds to step S110. If the input of the correct answer data is completed, the request data acquisition unit 112 proceeds to step S112.
[0081] In step S110, the control device 11 determines whether a predetermined input for ending the application (hereinafter, "application end input") has been performed through the input device 14. If the application end input has not been performed through the input device 14, the control device 11 returns to step S108. If the application end input has been performed, the control device 11 proceeds to step S116.
[0082] On the other hand, in step S112, the request data acquisition unit 112 outputs request data obtained by combining the original data and the correct answer data. The request data may be a data set in which the original data and the correct answer data (metadata) are combined separately, or may be data in which the correct answer data (metadata) is attached to the original data by tagging, labeling, or the like. The same applies to the cases of the second to fifth examples (FIGS. 10 to 17) described later.
[0083] For example, as shown in FIG. 9, when assuming the request screen of FIG. 8, request data is output in which a figure (rectangle) for specifying an image area including a person as correct answer data is drawn superimposed on the image data as the original data. Further, the output request data may be a data set combining the image data (original data) and the correct answer data representing the pixel range for specifying the area including a person in the image data. Further, the output request data may be data in which correct answer data representing the pixel range for specifying the area including a person in the image data is added to the image data (original data).
[0084] Returning to FIG. 7, when the process of step S112 is completed, the control device 11 proceeds to step S114.
[0085] In step S114, the control device 11 determines whether an input to end the application has been made through the input device 14. When the input to end the application has not been made through the input device 14, the control device 11 returns to step S104 and repeats the process for acquiring request data regarding new original data (the processes of steps S104 to S112). On the other hand, when the input to end the application has been made through the input device 14, the control device 11 proceeds to step S116.
[0086] In step S116, the request data acquisition unit 112 transmits the output request data to the data request device 20 through the communication device 12. Thereby, the data request device 20 can acquire the output request data. When there is no output request data, the process of step S116 is omitted.
[0087] When the process of step S116 is completed, the control device 11 ends the process of this flowchart.
[0088] Thus, in this example, the original data providing units 113 and 212 provide the original data. Also, the notification unit 111 notifies the supplying user of the content of the original data through the output device 13. Then, the request data acquisition unit 112 acquires request data that satisfies a predetermined condition based on the original data in response to an input related to the original data received by the input device 14.
[0089] Thereby, the data collection system 1 (data request device 20) can collect request data based on the original data.
[0090] Also, in this example, the request data acquisition unit 112 acquires request data that is a combination of the original data and metadata that satisfies a predetermined condition and is generated in response to an input related to the original data received by the input device 14.
[0091] Thereby, the data collection system 1 (data request device 20) can collect request data that includes metadata that satisfies a predetermined condition required for analysis or the like.
[0092] Also, in this example, the metadata combined with the original data is data representing the correct answer for supervised learning (correct answer data).
[0093] Thereby, the data collection system 1 (data request device 20) can collect request data that can be used as teacher data for supervised learning.
[0094] For example, in industrial machinery, when an object to be monitored (e.g., a person) enters the surrounding proximity area, there is a possibility that safety may decrease. Therefore, in industrial machinery, a process may be performed to determine the presence or absence of the object to be monitored and the relative position of the object to be monitored based on data related to the objects around the industrial machinery (e.g., image data capturing the state around the industrial machinery).
[0095] In contrast, in this example, the data collection system 1 (data request device 20) can collect request data including correct data representing an image area where a monitoring target (person) exists in original data (image data) representing the state around the industrial machine. Therefore, by performing supervised learning using the collected request data to generate a learned model or updating the learned model by additional learning of the learned model, a learned model for determining the presence or absence and position of the monitoring target can be obtained and applied to the industrial machine.
[0096] <Second Example of Request Data Collection Method> FIG. 10 is a flowchart schematically showing a second example of request data acquisition processing by the user device 10 (control device 11). FIG. 11 is a diagram showing a second example of a request screen displayed on the output device 13.
[0097] In this example, the user device 10 is a predetermined industrial machine (for example, a working machine such as an excavator), and the supplying user is an operator of the industrial machine. When the user device 10 (industrial machine) is activated, it transmits an activation signal to the data request device 20 through the communication device 12. This flowchart is started in response to the activation of the industrial machine (for example, turning on the key switch or power supply).
[0098] As shown in FIG. 10, in step S202, the notification unit 111 receives (acquires) a request signal transmitted from the data request device 20 in response to the activation signal through the communication device 12. The request signal defines request data that combines the original data and metadata related to the original data that satisfies a predetermined condition. Specifically, request data is defined that combines operation data (operation data) during operation from the start to the stop of the industrial machine as the original data with data related to the attributes of the operator (hereinafter, "operator attribute data") while the industrial machine is in use (being operated). The operator attribute data includes, for example, age, years of experience as an operator (operation history), and the like.
[0099] When the process of step S202 is completed, the control device 11 proceeds to step S204.
[0100] Note that the request signal may be distributed from the data request device 20 to the user device 10 before the start of this flowchart. In this case, the process of step S202 is omitted.
[0101] In step S204, the notification unit 111 causes the output device 13 (display device) to display a request screen based on the request signal acquired in the process of step S202.
[0102] For example, as shown in FIG. 11, the request screen includes original data information 801, metadata information 802, and incentive information 803.
[0103] The original data information 801 represents the content of the original data included in the request data. In this example, the original data information 801 describes "Please cooperate in the collection of driving data", and represents the content of requesting the supply user (operator) to cooperate in the collection of driving data as the original data.
[0104] The metadata information 802 represents the content of the metadata included in the request data. In this example, the metadata information 802 describes questions regarding the age of the supply user (operator) and the number of years of experience (driving history) of the supply user as an operator of the industrial machine (excavator). The user device 10 can acquire the answer data to the questions as operator attribute data (metadata regarding driving data) by asking the supply user to answer the questions through the input device 14.
[0105] Incentive information 803 represents the content (amount of points) of the incentive obtained when cooperating in the acquisition of request data, that is, the collection of operation data. In this example, the incentive information 803 describes that, as an incentive, 5 points are granted for cooperating in the collection of one hour of operation data. Thereby, the supplying user can grasp the content of the incentive obtained by cooperating in the acquisition of request data. Therefore, the supplying user can determine whether to cooperate in the acquisition of request data in consideration of the content of the incentive.
[0106] Returning to FIG. 10, when the process of step S204 is completed, the control device 11 proceeds to step S206.
[0107] In step S206, the control device 11 determines whether operator attribute data has been input through the input device 14. When the operator attribute data has been input, the control device 11 proceeds to step S208. When the operator attribute data has not been input (for example, when the content of the output device 13 has been transitioned from the request screen to another screen without inputting the operator attribute data), the processing of this flowchart is terminated.
[0108] In step S208, the original data providing unit 113 starts collecting operation data as the original data. When the process of step S208 is completed, the control device 11 proceeds to step S210.
[0109] In step S210, the control device 11 determines whether the operation of the industrial machine has stopped. For example, when the key switch or power switch of the industrial machine is turned off, the control device 11 determines that the operation of the work machine has stopped. When the operation of the industrial machine has stopped, the control device 11 proceeds to step S212. When the operation has not stopped, it waits until the operation stops (repeats the processing of this step until the operation stops).
[0110] In step S212, the request data acquisition unit 112 acquires request data obtained by combining the operation data (original data) collected by the original data providing unit 113 after the processing in step S208 and the operator attribute data (meta data). Then, the request data acquisition unit 112 transmits the acquired request data to the data request device 20 through the communication device 12. As a result, the data request device 20 can acquire request data obtained by combining the operation data as the original data and the operator attribute data request data as the meta data.
[0111] In this way, in this example, the request data acquisition unit 112 acquires request data that is a combination of the original data and meta data that satisfies a predetermined condition and is generated in response to an input related to the original data received by the input device 14. Specifically, the original data is operation data during the operation of the industrial machine (data related to at least one of the state of the industrial machine, the state of the surrounding environment of the industrial machine, and the state of the operator of the industrial machine), and the meta data is data related to the attributes of the operator of the industrial machine.
[0112] As a result, the data collection system 1 (data request device 20) can collect request data that can analyze, for example, the correlation between the operator of the industrial machine and the operation data of the industrial machine. Therefore, the operator can be evaluated from the analysis results, the characteristics of skilled operators can be clarified from the analysis results, and the results can be used for the training of operators.
[0113] <Third Example of Request Data Collection Method> FIG. 12 is a flowchart schematically showing a third example of request data acquisition processing by the user device 10 (control device 11). FIG. 13 is a diagram showing a third example of a request screen displayed on the output device 13.
[0114] As shown in FIG. 12, in step S302, the notification unit 111 receives (acquires) a request signal transmitted from the data request device 20 in response to an activation signal through the communication device 12. The request signal defines request data selected as data that meets a predetermined condition from among a plurality of pieces of original data to be provided.
[0115] When the process of step S302 is completed, the control device 11 proceeds to step S304.
[0116] In step S304, the notification unit 111 acquires a plurality of original data. When the process of step S304 is completed, the control device 11 proceeds to step S306.
[0117] In step S306, the notification unit 111 causes the output device 13 (display device) to display a request screen based on the data and the like acquired in the processes of steps S302 and S304.
[0118] For example, as shown in FIG. 13, the request screen includes original data information 1001, request data information 1002, and incentive information 1003.
[0119] The original data information 1001 represents the contents (a plurality of image data) of a plurality (three in this example) of original data specified as options. In this example, the original data information 1001 corresponds to a plurality (three) of image data captured by an imaging device mounted on a working machine, and each image data shows a worker (person).
[0120] The request data information 1002 represents the content of the request data, and specifically represents a predetermined condition (selection condition) for selecting the request data from among a plurality of original data (image data). In this example, the request data information 1002 states, "Which one shows the helmet best?" Thus, the supplying user can recognize that they only need to select the image data in which the helmet is shown best from among the plurality of original data (image data).
[0121] Note that in this example, a selection condition is set such that one piece of original data is selected as the request data from among the plurality of original data, but a selection condition may also be set such that two or more pieces of original data are selected as the request data from among the plurality of original data.
[0122] Incentive information 1003 represents the content (amount of points) of the incentive obtained when cooperating with the acquisition of request data, that is, the operation of selecting and acquiring the image in which the helmet is most clearly shown from among a plurality of image data. In this example, the incentive information 1003 describes that 10 points are granted as an incentive. Thereby, the supply user can grasp the content of the incentive obtained by cooperating with the acquisition of request data. Therefore, the supply user can determine whether to cooperate with the acquisition of request data in consideration of the content of the incentive.
[0123] Returning to FIG. 12, when the process of step S306 is completed, the control device 11 proceeds to step S308.
[0124] In step S308, the control device 11 determines whether an input for selecting some of the plurality of original data has been made through the input device 14 and has been confirmed. When no input for selecting some of the plurality of original data has been made through the input device 14 or when an input for selection has been made but has not been confirmed, the control device 11 proceeds to step S310. On the other hand, when a selection input for selecting some of the plurality of original data has been made through the input device 14 and has been confirmed, the control device 11 proceeds to step S312.
[0125] In step S310, the control device 11 determines whether an input for ending the application has been made through the input device 14. When no input for ending the application has been made through the input device 14, the control device 11 returns to step S308. When an input for ending the application has been made, the control device 11 proceeds to step S316.
[0126] On the one hand, in step S312, the request data acquisition unit 112 outputs, as request data, the original data selected according to the input of the supplying user received by the input device 14 from among a plurality of original data. For example, the request data acquisition unit 112 may output, as request data, data obtained by combining each selected original data with data representing selection conditions (condition data).
[0127] When the process of step S312 is completed, the control device 11 proceeds to step S314.
[0128] In step S314, the control device 11 determines, through the input device 14, whether an input to end the application has been made. When no input to end the application has been made through the input device 14, the control device 11 returns to step S304 and repeats the process for acquiring request data regarding new original data (the processes of steps S304 to S312). On the other hand, when an input to end the application has been made through the input device 14, the control device 11 proceeds to step S316.
[0129] In step S316, the request data acquisition unit 112 transmits, through the communication device 12, the output request data to the data request device 20. Thereby, the data request device 20 can acquire the output request data. When there is no output request data, the process of step S316 is omitted.
[0130] When the process of step S316 is completed, the control device 11 ends the process of this flowchart.
[0131] As described above, in this example, the request data acquisition unit 112 selectively acquires data that satisfies a predetermined condition from among a plurality of original data according to a selection input regarding the plurality of original data received by the input device 14.
[0132] Thereby, the data collection system 1 (data request device 20) can selectively collect, as request data, the original data that satisfies a predetermined condition required by analysis or the like from among a plurality of original data.
[0133] For example, around industrial machines, it is often the case that a person (worker) wearing a helmet performs work. In such a case, by applying a learned model that recognizes the presence or absence of a helmet and the position of the helmet, etc., from the image data obtained by imaging the surroundings of the industrial machine, it is possible to recognize the presence or absence of the worker as the monitoring target and its position.
[0134] On the other hand, in this example, the data collection system 1 (data request device 20) can selectively collect the image data in which the helmet appears from among the image data group representing the state around the industrial machine. Therefore, by using the image data group in which the helmet appears to perform supervised learning to generate a learned model or update the learned model by additional learning of the learned model, a learned model for determining the presence or absence of the monitoring target and its position can be obtained and applied to the industrial machine.
[0135] <Fourth Example of Method for Collecting Request Data> FIG. 14 is a flowchart schematically showing a fourth example of the request data acquisition process by the user device 10 (control device 11). FIG. 15 is a diagram showing a fourth example of the request screen displayed on the output device 13.
[0136] As shown in FIG. 14, in step S402, the notification unit 111 receives (acquires) a request signal transmitted from the data request device 20 in response to the activation signal through the communication device 12. The request signal defines requested data that is newly acquired as data meeting a predetermined condition. For example, the newly acquired requested data may include, as described later, newly captured image data that satisfies a predetermined condition. Also, for example, the newly acquired requested data may be operation data collected (acquired) by an industrial machine when a predetermined condition is satisfied. Specifically, the newly acquired requested data may be operation data acquired in response to a predetermined input (e.g., operation of a predetermined button switch) of a supply user (operator) when an abnormality occurs in the industrial machine as the user device 10. Also, it may be operation data acquired in response to a predetermined input of a supply user (operator) when defective products occur in a machine tool, an injection molding machine, or the like. In these cases, the requested data acquisition unit 112 can acquire operation data when a predetermined condition is satisfied by, for example, retrospectively extracting operation data temporarily stored in a ring buffer and recording it in a non-volatile storage device.
[0137] When the process of step S402 is completed, the control device 11 proceeds to step S404.
[0138] In step S404, the notification unit 111 causes the output device 13 (display device) to display a request screen based on the request signal acquired in step S302.
[0139] For example, as shown in FIG. 15, the request screen includes requested data information 1201, 1202 and incentive information 1203.
[0140] The request data information 1201 represents the content of the request data in character information. Specifically, it represents the content of a predetermined condition (acquisition condition) that the newly acquired request data should satisfy in character information. In this example, the request data information 1201 states, "Please take a photo of a person and a tree side by side." As a result, the supplying user can recognize that, for example, using the camera installed in the user device 10 such as a smartphone, they can take (acquire) a photo (image data) of a person and a tree side by side.
[0141] The request data information 1202 represents the content of the request data in visual information. In this example, the request data information 1202 is an illustrative image imitating a photo of a person and a tree side by side. As a result, the supplying user can more clearly recognize what kind of photo (image data) should be acquired.
[0142] The incentive information 1203 represents the content (amount of points) of the incentive obtained when cooperating in the acquisition of the request data, that is, the acquisition (taking) of a photo of a person and a tree side by side. In this example, the incentive information 1203 states that, as an incentive, points will be awarded within the range of 1 point to 100 points. As a result, the supplying user can grasp the content of the incentive obtained by cooperating in the acquisition of the request data. Therefore, the supplying user can consider the content of the incentive and determine whether to cooperate in the acquisition of the request data. In this case, the point processing unit 215 varies the amount of points to be added (appended) to the point balance of the supplying user in the point ledger according to the content (quality) of the request data acquired by the request data acquisition unit 112. As a result, the data collection system 1 (user device 10) can encourage the supplying user to acquire higher-quality request data.
[0143] The supplying user may, for example, newly take a picture of a person and a tree side by side, and through the input device 14, perform a predetermined input (hereinafter, "input of acquisition request") to request to acquire the captured image data as request data. Further, the supplying user may select image data in which a person and a tree are side by side from the image data already stored in the user device 10 (for example, a smartphone or the like), and through the input device 14, perform an input of an acquisition request for the selected image data. Thereby, the user device 10 (request data acquisition unit 112) can acquire the corresponding image data as request data in response to the input of the acquisition request received by the input device 14.
[0144] Returning to FIG. 14, when the process of step S404 ends, the control device 11 proceeds to step S406.
[0145] In step S406, the control device 11 determines whether an input of a data acquisition request has been received through the input device 14. If the control device 11 has not received an input of a data acquisition request through the input device 14, it proceeds to step S408, and if an input of a data acquisition request has been received, it proceeds to step S410.
[0146] In step S408, the control device 11 determines whether an input to end the application has been made through the input device 14. If the control device 11 has not received an input to end the application through the input device 14, it returns to step S406, and if an input to end the application has been made, it proceeds to step S414.
[0147] On the other hand, in step S410, the request data acquisition unit 112 outputs the data (acquired data) specified by the acquisition request received through the input device 14 as request data. For example, the request data acquisition unit 112 may output data obtained by combining the acquired data and data representing acquisition conditions (condition data) as request data.
[0148] When the process of step S410 is completed, the control device 11 proceeds to step S412.
[0149] In step S412, the control device 11 determines whether an input to end the application has been made through the input device 14. If the control device 11 determines that an input to end the application has not been made through the input device 14, it returns to step S404 and repeats the processes related to obtaining new request data (the processes of steps S404 to S410). On the other hand, if the control device 11 determines that an input to end the application has been made through the input device 14, it proceeds to step S414.
[0150]
[0149] In step S414, the request data acquisition unit 112 transmits the output request data to the data request device 20 through the communication device 12. As a result, the data request device 20 can acquire the output request data. If there is no output request data, the process of step S414 is omitted.
[0151] As described above, in this example, the request data acquisition unit 112 acquires request data that newly satisfies a predetermined condition (acquisition condition) in response to an input received by the input device 14.
[0152] As a result, the data collection system 1 (data request device 20) can collect request data that satisfies a predetermined condition required for analysis or the like from a state where there is no original data.
[0153]
[0150] For example, a working machine may perform work in a place where trees are lined up around (for example, in a mountainous area or the like). Therefore, when a learned model for recognizing a person (worker) from image data obtained by imaging the surroundings of the working machine is generated, it is desirable to minimize situations such as misidentifying the trees in the background of the image data as a person or overlooking a person existing between the background trees.
[0154] In contrast, in this example, it is possible to intensively collect image data in which a person and a tree are lined up together. As a result, machine learning (supervised learning) is performed using the image data in which a person and a tree are lined up together as teacher data, thereby obtaining a trained model with high accuracy in recognizing a person from the image data in which a person and a tree are shown together, and it can be applied to a working machine used in a mountainous area or the like.
[0155] <Fifth Example of Request Data Collection Method> FIG. 16 is a flowchart schematically showing a fifth example of request data acquisition processing by the user device 10 (control device 11). FIG. 17 is a diagram showing a fifth example of a request screen displayed on the output device 13.
[0156] In step S502, the notification unit 111 receives (acquires) a request signal transmitted from the data request device 20 in response to the activation signal through the communication device 12. The request signal defines request data as processed data that satisfies a predetermined condition for the original data. For example, the processed data may include image data obtained by changing some colors of the original data (image data) to other colors. Also, for example, the processed data may include data obtained by anonymizing personal information included in the original data. Specifically, the processed data may be image data obtained by blurring the face portion of the original data (image data).
[0157] When the process of step S502 is completed, the control device 11 proceeds to step S504.
[0158] In step S504, the notification unit 111 acquires the original data. When the process of step S504 is completed, the control device 11 proceeds to step S506.
[0159] In step S506, the notification unit 111 causes the output device 13 (display device) to display a request screen based on the data and the like acquired in the processes of steps S502 and S504.
[0160] For example, as shown in FIG. 17, the request screen includes original data information 1401, request data information 1402, and incentive information 1403.
[0161] The original data information 1401 represents the content of the original data (image data). In this example, the original data information 1401 corresponds to image data captured by an imaging device mounted on a working machine, and a worker (person) is shown in the image data.
[0162] The request data information 1402 represents the content of the request data. Specifically, it represents a predetermined condition (processing condition) that the processed data corresponding to the original data should satisfy. In this example, the request data information 1402 states "Please make the upper garment red." Thus, the supply user can recognize that they only need to process the upper garment of the worker in the image data to red through the input via the input device 14.
[0163] The incentive information 1403 represents the content (amount of points) of the incentive obtained when cooperating in the acquisition of the request data, that is, the processing of the image data (acquisition of image data including a worker with a red upper garment). In this example, the incentive information 1403 states that 10 points are granted as an incentive. Thus, the supply user can grasp the content of the incentive obtained by cooperating in the acquisition of the request data. Therefore, the supply user can determine whether to cooperate in the acquisition of the request data considering the content of the incentive.
[0164] Returning to FIG. 16, when the processing in step S506 is completed, the control device 11 proceeds to step S508.
[0165] In step S508, the control device 11 determines whether the processing of the original data is completed. If the processing of the original data is not completed, the control device 11 proceeds to step S510. If the processing of the original data is completed, the control device 11 proceeds to step S512.
[0166] In step S510, the control device 11 determines whether an input to end the application has been made through the input device 14. If the control device 11 determines that an input to end the application has not been made through the input device 14, it returns to step S508. If an input to end the application has been made, it proceeds to step S516.
[0167] On the other hand, in step S512, the request data acquisition unit 112 outputs processed data (processed data) based on the original data as request data. For example, the request data acquisition unit 112 may output data obtained by combining the processed data and data representing processing conditions (condition data) as the request data.
[0168] When the process of step S512 is completed, the control device 11 proceeds to step S514.
[0169] In step S514, the control device 11 determines whether an input to end the application has been made through the input device 14. If the control device 11 determines that an input to end the application has not been made through the input device 14, it returns to step S504 and repeats the process related to the acquisition of new request data (the processes of steps S504 to S512). On the other hand, if the control device 11 determines that an input to end the application has been made through the input device 14, it proceeds to step S516.
[0170] In step S516, the request data acquisition unit 112 transmits the output request data to the data request device 20 through the communication device 12. As a result, the data request device 20 can acquire the output request data. If there is no output request data, the process of step S516 is omitted.
[0171] As described above, in this example, the request data acquisition unit 112 acquires request data obtained by performing processing that satisfies a predetermined condition (processing condition) on the original data in response to an input related to the original data received by the input device 14.
[0172] As a result, the data collection system 1 (data request device 20) can collect requested data (processed data) obtained by subjecting the original data to processing that satisfies predetermined conditions required for analysis and the like.
[0173] For example, the upper garment of a worker working around an industrial machine may be red. In such a case, by applying a learned model that recognizes the presence or absence of a red upper garment and the position of the red upper garment from among the image data obtained by imaging the surroundings of the industrial machine to the industrial machine, it is possible to recognize the presence or absence of the worker as the monitoring target and the position thereof.
[0174] In contrast, in this example, the data collection system 1 (data request device 20) can intensively collect image data including a worker whose upper garment color has been processed to red. Therefore, by performing supervised learning using a group of image data in which a worker wearing a red upper garment appears, generating a learned model, or updating the learned model by additional learning of the learned model, a learned model for determining the presence or absence of the monitoring target and the position thereof can be obtained and applied to the industrial machine.
[0175] <Another example of the method for collecting requested data> For example, the data collection system 1 (data request device 20) may collect video data instead of or in addition to still image data as the requested data. Further, the data collection system 1 may collect audio data or data that is a combination of image data and audio data instead of or in addition to image data (at least one of still image data and video data) as the requested data.
[0176] Further, for example, the data collection system 1 (data request device 20) may collect request data by combining image data (still image or moving image) as original data and metadata including character information for explaining the image data. The explanation of the image data may include keywords, sentences (explanation texts), etc. for explaining the image data. For example, the explanation of the image data may include attributes of the people shown in the image data (e.g., "young male"), emotions (e.g., "angry"), expressions (e.g., "smiling"), content of actions (e.g., "about to leave for school"), etc. Further, the explanation of the image data may include the location, situation, weather, etc. of the background shown in the image data. Also, when the image data is image data acquired by a work machine (e.g., a shovel), for example, the explanation of the image data may include an explanation regarding the operating status of a specific function of the work machine at that time (e.g., "the function of detecting people around the work machine misdetects non-people").
[0177] [Other specific examples of the configuration of the data collection system] Next, with reference to FIG. 18, other specific examples of the configuration of the data collection system will be described.
[0178] FIG. 18 is a block diagram showing still another example of the configuration of the data collection system 1. Hereinafter, the description will focus on the parts different from the above-mentioned one example (FIG. 5) and other examples (FIG. 6).
[0179] As shown in FIG. 18, in addition to the configuration of FIG. 5, the data request device 20 (control device 11) includes a temporary storage unit 217 and a data confirmation unit 218.
[0180] Note that in this example, the temporary storage unit 217 and the data confirmation unit 218 are added to the configuration of FIG. 5, but the temporary storage unit 217 and the data confirmation unit 218 may also be added to the configuration of FIG. 6.
[0181] The temporary memory unit 217 temporarily stores the request data received from the user device 10 by the communication device 22. The request data stored in the temporary memory unit 217 may be erased even after a certain period of time has elapsed.
[0182] The data confirmation unit 218 checks (determines) whether the request data received from the user device 10 satisfies a predetermined condition defined by the data request unit 211. When the request data received from the user device 10 satisfies the predetermined condition, it notifies the point processing unit 215 to that effect and stores the target request data temporarily stored in the temporary memory unit 217 in the request data storage unit 214. On the other hand, when the request data received from the user device 10 does not satisfy the predetermined condition, the data confirmation unit 218 notifies the point processing unit 215 to that effect. As a result, the request data that is temporarily stored in the temporary memory unit 217 and does not satisfy the predetermined condition is erased. Further, when the request data received from the user device 10 does not satisfy the predetermined condition, the data confirmation unit 218 may actively erase the target request data temporarily stored in the temporary memory unit 217. As a result, only the request data that is actually confirmed to satisfy the predetermined condition among the data received from the user device 10 as request data is stored in the request data storage unit 214.
[0183] For example, the data confirmation unit 218 may determine whether the request data satisfies a predetermined condition by inputting the request data into a predetermined learned model.
[0184] Also, for example, when the control device 21 receives request data from a user device 10 (hereinafter, "one user device 10") used by one supply user, the control device 21 may cause another supply user different from the one supply user to confirm whether the request data satisfies a predetermined condition. In this case, the control device 21 transmits, through the communication device 22, a request signal for requesting confirmation of whether the request data including the request data received from the one user device 10 satisfies a predetermined condition to the user device 10 (hereinafter, "other user device 10") used by another supply user. As a result, the notification unit 111 of the other user device 10 (control device 11) causes the output device 13 (display device) to display a screen (hereinafter, "request screen") for requesting confirmation of the request data. On the request screen, for example, the content of the request data, the content of the incentive for the request, and the like are displayed. Then, when an input regarding the confirmation result is received through the input device 14, the control device 11 transmits, through the communication device 12, data (hereinafter, "confirmation result data") corresponding to the input content regarding the confirmation result to the data request device 20. As a result, the data request device 20 can receive the confirmation result data. Therefore, the data confirmation unit 218 can determine whether the request data received from the one user device 10 satisfies a predetermined condition based on the confirmation result data. Also, when the confirmation result data is received from the other user device 10 by the communication device 22, the point processing unit 215 performs a process of adding (appending) a predetermined amount of points to the remaining point balance of the point ledger of the other supply user. As a result, due to the effect of granting the incentive (points), more supply users can be made to participate in the confirmation work of the request data.
[0185] In addition, when the control device 21 does not receive the confirmation result data from the other user device 10 by the communication device 22, the control device 21 may transmit, through the communication device 22, a request signal for requesting confirmation of the request data to another user device 10 corresponding to yet another supply user.
[0186] Thus, in this example, the data verification unit 218 (an example of a determination unit) determines whether the data acquired by the request data acquisition unit 112 satisfies a predetermined condition. Then, when it is determined by the data verification unit 218 that the data acquired by the request data acquisition unit 112 satisfies the predetermined condition, the point processing unit 215 performs processing related to the granting of points as an incentive to the supplying user.
[0187] Thereby, the data collection system 1 (data request device 20) can actually collect only the data that has been confirmed to satisfy the predetermined conditions required for analysis and the like. Therefore, analysis and the like can be performed more efficiently.
[0188] Also, in this example, the notification unit 111 (an example of another notification unit) of another user device 10 notifies the content of the request data acquired by the request data acquisition unit 112 of one user device 10 to another supplying user. Then, the data verification unit 218 determines whether the request data acquired by the request data acquisition unit 112 of one user device 10 satisfies the predetermined condition according to the input regarding the confirmation result of whether the request data satisfies the predetermined condition, which is received by the input device 14 (an example of another input unit) of another user device 10.
[0189] Thereby, the data collection system 1 (data request device 20) can confirm whether the request data actually satisfies the predetermined condition with the cooperation of other supplying users.
[0190] Also, in this example, when an input regarding the confirmation result is received by the input device 14 of another user device 10, the point processing unit 215 performs processing related to the granting of points as an incentive to another supplying user.
[0191] As a result, the data collection system 1 (data request device 20) can obtain the cooperation of other supply users for the confirmation work of the requested data due to the effect of the incentive. Therefore, the data collection system 1 can specifically introduce the confirmation work of whether the requested data actually satisfies a predetermined condition.
[0192] Also, in this example, the data confirmation unit 218 determines whether the requested data acquired by the requested data acquisition unit 112 satisfies a predetermined condition by inputting the requested data acquired by the requested data acquisition unit 112 into a predetermined learned model.
[0193] As a result, the data collection system 1 (data request device 20) can specifically confirm whether the requested data satisfies a predetermined condition by using a learned model capable of determining the success or failure of a predetermined condition with acceptable accuracy.
[0194] [Modifications and Changes] Although the embodiments have been described in detail above, the present disclosure is not limited to such specific embodiments, and various modifications and changes are possible within the scope of the gist described in the claims.
[0195] For example, in the above-described embodiment, the data collection system 1 mainly targets data related to industrial machines, but may also target data other than data related to industrial machines. For example, the data collection system 1 may target data related to home appliances that are communicably connected to the data collection system 1 (data request device 20) via the Internet or the like. Also, for example, the data collection system 1 may target data related to automobiles that are communicably connected to the data collection system 1 (data request device 20) via a mobile communication network or the like.
[0196] Finally, this application claims priority based on Japanese Patent Application No. 2020-023838 filed on February 14, 2020, and incorporates the entire contents of the Japanese patent application by reference.
Explanation of Reference Numerals
[0197] 1 Data collection system 10 User device 11 Control device 12 Communication device 13 Output device (notification unit, other notification unit) 14 Input device (input unit, other input unit) 20 Data request device 21 Control device 22 Communication device 30 Demand user device 111 Notification unit 112 Request data acquisition unit (data acquisition unit) 113 Original data providing unit 211 Data request unit 212 Original data providing unit 213 Original data storage unit 214 Request data storage unit 215 Point processing unit (incentive granting unit) 216 Ledger storage unit 217 Temporary storage unit 218 Data confirmation unit (judgment unit)
Claims
1. A data request unit that requests a user to obtain the request data regarding a work machine having a work attachment, the request data satisfying predetermined conditions, an input unit that receives an input from a user, a data acquisition unit that acquires the request data according to the input received by the input unit based on the request for acquisition of the request data from the data request unit, an incentive granting unit that performs processing regarding granting of an incentive to the user when the request data is acquired by the data acquisition unit, an original data providing unit that provides original data as operation data of the work machine, a notification unit that notifies the user of the content of the original data, and the data acquisition unit acquires the request data from the original data according to the input regarding the original data received by the input unit, wherein the original data is data regarding at least one of a state of the work machine during operation of the work machine, a state of a surrounding environment of the work machine, and a state of an operator of the work machine, a data collection system.
2. The data acquisition unit acquires the request data as a combination of the original data and metadata that satisfies the predetermined conditions with respect to the original data, the metadata being generated according to the input regarding the original data received by the input unit. The data collection system according to claim 1.
3. The metadata is data representing a correct answer for supervised learning. The data collection system according to claim 2.
4. The metadata is data regarding an attribute of an operator of the work machine. The data collection system according to claim 2.
5. The data acquisition unit selectively acquires the request data that satisfies the predetermined conditions from among a plurality of the original data according to a selection input regarding the plurality of the original data received by the input unit. The data collection system according to claim 1.
6. The data acquisition unit acquires the request data obtained by performing processing that satisfies the predetermined conditions on the original data according to the input regarding the original data received by the input unit. The data collection system according to claim 1.
7. It includes a determination unit that determines whether or not the request data acquired by the data acquisition unit satisfies the predetermined conditions. When the determination unit determines that the request data acquired by the data acquisition unit satisfies the predetermined conditions, the incentive granting unit performs processing related to granting an incentive to the user. The data collection system according to any one of claims 1 to 6.
8. Another notification unit that notifies other users of the content of the request data acquired by the data acquisition unit, Another input unit that receives an input from the other user, and The determination unit determines whether the request data acquired by the data acquisition unit satisfies the predetermined conditions in response to an input regarding a confirmation result as to whether the request data acquired by the data acquisition unit and received by the other input unit satisfies the predetermined conditions. The data collection system according to claim 7.
9. When an input regarding the confirmation result is received by the other input unit, the incentive granting unit performs processing related to granting an incentive to the other user. The data collection system according to claim 8.
10. The determination unit determines whether the request data acquired by the data acquisition unit satisfies the predetermined conditions by inputting the request data acquired by the data acquisition unit into a predetermined learned model. The data collection system according to claim 7.
11. An incentive granting unit that performs processing related to granting an incentive to a user when the request data is acquired in response to an input to a predetermined input unit by the user in response to a request for acquisition of the request data regarding a work machine having a work attachment and satisfying predetermined conditions, A raw data providing unit that provides the user with raw data as operation data of the work machine, and The request data is acquired from the raw data in response to an input regarding the raw data received by the input unit. The raw data is data related to at least one of a state of the work machine during operation of the work machine, a state of a surrounding environment of the work machine, and a state of an operator of the work machine. An information processing apparatus.
12. An information processing method performed by an information processing apparatus, When the required data that satisfies the predetermined conditions is acquired in response to an input to a predetermined input unit made by a user in response to a request for acquisition of the required data regarding a work machine having a work attachment, an incentive granting step of performing processing regarding granting of an incentive to the user; a source data providing step of providing the user with source data as operation data of the work machine; and the required data is acquired from the source data in response to an input regarding the source data received by the input unit; the source data is data regarding at least one of a state of the work machine during operation of the work machine, a state of a surrounding environment of the work machine, and a state of an operator of the work machine; An information processing method.
13. In an information processing apparatus, when the required data that satisfies the predetermined conditions is acquired in response to an input to a predetermined input unit made by a user in response to a request for acquisition of the required data regarding a work machine having a work attachment, an incentive granting step of performing processing regarding granting of an incentive to the user; a source data providing step of providing the user with source data as operation data of the work machine; and causing the steps to be executed, the required data is acquired from the source data in response to an input regarding the source data received by the input unit; the source data is data regarding at least one of a state of the work machine during operation of the work machine, a state of a surrounding environment of the work machine, and a state of an operator of the work machine; A program.
14. In an information processing apparatus, a request receiving step of receiving from the outside a request for acquisition of required data regarding a work machine having a work attachment, the request being a request accompanied by granting of an incentive to a user and satisfying a predetermined condition; an input step of receiving an input from the user; a data acquisition step of acquiring the required data that satisfies the predetermined condition in response to the input received in the input step; a notification step of notifying the user of the content of source data as operation data of the work machine; and causing the steps to be executed, in the data acquisition step, the required data is acquired from the source data in response to an input regarding the source data received in the input step; The original data is data related to at least one of the state of the working machine during operation of the working machine, the state of the surrounding environment of the working machine, and the state of the operator of the working machine. Program.
15. A working attachment, A request receiving unit that receives, from the outside, a request for granting an incentive to a user and a request for acquiring operation data that satisfies a predetermined condition, An input unit that receives an input from the user, A data acquisition unit that acquires the operation data that satisfies the predetermined condition in response to the input received by the input unit, A notification unit that notifies the user of the content of the original data as operation data of the working machine, The data acquisition unit acquires the operation data from the original data in response to an input related to the original data received by the input unit, The original data is data related to at least one of the state of the working machine during operation of the working machine, the state of the surrounding environment of the working machine, and the state of the operator of the working machine. Working machine.
Citation Information
Patent Citations
Operation evaluation system and operation evaluation method for construction machine
JP2009235833A
Diagnostic device
JP2017045215A
Correct / incorrect determining system
JP2020017112A
Maintenance information coordination system
WO2013145203A1