Information processing method, information processing device, and program

The information processing method addresses inefficient quality management by notifying users of critical work quality deviations, optimizing inspections and reducing resource use.

JP7797497B2Active Publication Date: 2026-01-13PANASONIC INTELLECTUAL PROPERTY CORP OF AMERICA
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
JP2023520771
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2021-05-12
Filing Date
2022-01-31
Publication Date
2026-01-13
Estimated Expiration
2042-01-31

AI Technical Summary

Technical Problem

The quality of work cannot be efficiently managed due to variations in worker expertise and the time-consuming nature of quality inspections, leading to potential undetected substandard work.

Method used

An information processing method that acquires design information with reference values, compares it to actual measurement information from work images, and notifies users of differences within specific ranges to focus quality checks on critical areas.

Benefits of technology

Enhances efficient management of work quality by reducing unnecessary inspections and power consumption, while ensuring accurate identification of discrepancies.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007797497000001
    Figure 0007797497000001
  • Figure 0007797497000002
    Figure 0007797497000002
  • Figure 0007797497000003
    Figure 0007797497000003
Patent Text Reader

Abstract

In the present invention, design information that is related to work and that has a reference value and an allowable range which includes the reference value, is acquired (S101), the acquired design information and actual measurement information that is related to the work and that is obtained from an image of an object on which the work has been performed are compared to specify a difference between the design information and the actual measurement information (S102), and, if the specified difference falls within a predetermined range which is close to the upper limit or the lower limit of the allowable range, the user is notified (S103).
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to an information processing method, an information processing device, and a program. [Background technology]

[0002] There is a system that efficiently determines the progress of construction work and the like (see Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 6700580 Summary of the Invention [Problem to be solved by the invention]

[0004] However, there is a problem in that the quality of work cannot be controlled efficiently.

[0005] Therefore, the present invention provides an information processing method and the like that supports efficient management of work quality. [Means for solving the problem]

[0006] An information processing method according to one aspect of the present invention is an information processing method that acquires design information relating to work, the design information having a reference value and an acceptable range that includes the reference value, compares the acquired design information with actual measurement information relating to the work obtained from an image of an object on which the work has been performed, identifies a difference between the design information and the actual measurement information, and notifies a user if the identified difference falls within a predetermined range that is near the upper or lower limit of the acceptable range.

[0007] These comprehensive or specific aspects may be realized as a system, device, integrated circuit, computer program, or computer-readable recording medium such as a CD-ROM, or may be realized as any combination of a system, device, integrated circuit, computer program, and recording medium. [Effects of the Invention]

[0008] The information processing method of the present invention can assist in efficiently managing the quality of work. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a schematic diagram showing the configuration of a support system according to an embodiment. [Figure 2] FIG. 2 is a block diagram showing a functional configuration of the support device according to the embodiment. [Figure 3] FIG. 3 is a schematic diagram showing the appearance of a pillar, which is an example of the target of the work. [Figure 4] FIG. 4 is an explanatory diagram illustrating an example of design information according to the embodiment. [Figure 5] FIG. 5 is an explanatory diagram illustrating an example of work information according to the embodiment. [Figure 6] FIG. 6 is an explanatory diagram showing a first example of a monitoring range in the embodiment. [Figure 7] FIG. 7 is an explanatory diagram showing a second example of a monitoring range in the embodiment. [Figure 8] FIG. 8 is a schematic diagram showing an example of actual measurement information according to the embodiment. [Figure 9] FIG. 9 is a schematic diagram illustrating an example of proficiency level information according to the embodiment. [Figure 10] FIG. 10 is a flow diagram showing a support method according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] (Findings that form the basis of the present invention) The present inventors have found that the following problems arise with regard to the quality control of work, as described in the "Background Art" section.

[0011] At construction sites and other worksites, many workers perform many different tasks. The level of expertise of each worker varies from task to task. Therefore, it is common for the quality of work to vary depending on the level of expertise of each worker and each task.

[0012] Conventionally, in order to maintain the quality of work at a certain level or above, the quality of the objects (also simply referred to as objects) on which work is performed is inspected. However, at a site where many tasks are performed, inspecting the quality of all the objects would take a great deal of time, causing delays in construction, and requiring a large amount of hardware resources or power consumption for quality inspection. Furthermore, while it is assumed that some of the objects are extracted and inspected in some way, it may happen that objects with quality below a certain level cannot be detected. This may result in work that is below a certain level remaining undetected.

[0013] Thus, there is a problem that the quality of work cannot be managed efficiently.

[0014] Therefore, the present invention provides an information processing method and the like that supports efficient management of work quality.

[0015] An information processing method according to one aspect of the present invention is an information processing method that acquires design information relating to work, the design information having a reference value and an acceptable range that includes the reference value, compares the acquired design information with actual measurement information relating to the work obtained from an image of an object on which the work has been performed, identifies a difference between the design information and the actual measurement information, and notifies a user if the identified difference falls within a predetermined range that is near the upper or lower limit of the acceptable range.

[0016] According to the above aspect, the information processing method notifies the user when the difference between the design information and the actual measurement information falls within a predetermined range. Therefore, when the user receives the notification, the user can pay relatively high attention to checking the quality of the object that is the target of the work related to the notification, and can focus on that checking. Then, by checking the quality of the object, the user can check the quality of the work performed on that object. In this way, the above information processing method can support efficient management of work quality.

[0017] In other words, if a user checks the quality of a larger number of objects with a relatively high level of attention, the amount of processing by a device such as a computer used for the check will increase, and power consumption may also increase. According to the above information processing method, the user is notified when the difference between the design information and the actual measurement information is within a predetermined range, thereby suppressing an increase in the amount of processing by a device such as a computer used for the check and also suppressing an increase in power consumption.

[0018] For example, when making the notification, the predetermined range having a width according to the characteristics of the work may be determined, and the notification may be made using the determined predetermined range.

[0019] According to the above aspect, the width of the predetermined range is adjusted according to the characteristics of the task, and therefore whether or not to notify the user is adjusted according to the characteristics of the task. As a result, the number of times the user checks the quality of the object, which requires relatively high attention, is more appropriately adjusted. This information processing method can support more efficient management of the quality of the task.

[0020] For example, when making the notification, the larger the amount of information contained in the image, the narrower the predetermined range that is determined, and the notification may be made using the determined predetermined range.

[0021] According to the above aspect, whether or not to notify the user is adjusted depending on the amount of information in the image showing the work object. As a result, the number of times the user checks the quality of the object, which requires relatively high attention, is more appropriately adjusted while increasing the weight of checking the quality of the work using images with relatively little information. In this way, it is possible to support efficient management of the quality of the work depending on the amount of information in the image.

[0022] For example, the proficiency level of the worker who performed the work may be further obtained, and when making the notification, the higher the proficiency level of the worker who performed the work that was the basis for identifying the difference, the narrower the specified range may be determined, and the notification may be made using the determined specified range.

[0023] According to the above aspect, whether or not to notify the user is adjusted depending on the level of proficiency of the worker who performed the work. As a result, the number of times the user checks the quality of the object, which requires relatively high attention, is more appropriately adjusted while increasing the weight of checking the quality of the work performed by a worker with a relatively low level of proficiency. In this way, it is possible to support efficient management of the quality of the work depending on the level of proficiency of the worker who performed the work.

[0024] For example, before identifying the difference, the image may be captured by controlling an imaging device, and the actual measurement information may be obtained by performing image analysis processing on the captured image, and the difference may be identified using the obtained actual measurement information.

[0025] According to the above aspect, an image is captured by controlling an imaging device, and a difference between design information and actual measurement information is identified based on the captured image. Therefore, the difference can be identified using an image captured solely for the purpose of identifying the difference, and the identified difference becomes more appropriate. This can support more appropriate and efficient management of work quality.

[0026] For example, when obtaining the proficiency level of the worker who performed the work and identifying the difference, the imaging device may be controlled to capture an image with a greater amount of information the lower the proficiency level of the worker performing the work.

[0027] According to the above aspect, the amount of information in the captured image is adjusted depending on the level of proficiency of the worker who performed the work. The less skilled the worker, the greater the amount of information in the image, which increases the accuracy of the actual measurement information, thereby enabling more accurate identification of discrepancies. This allows for more accurate notification to the user. This can help manage the quality of work more accurately and efficiently.

[0028] For example, the imaging device may be mounted on an aircraft controlled by a pilot.

[0029] According to the above aspect, differences are identified using images captured by an imaging device mounted on an aircraft, and the user is notified. This allows for more accurate identification of differences using images captured from a more appropriate position and angle, which more appropriately capture the work target. This allows for more accurate notification to the user. This can help manage the quality of work more accurately and efficiently.

[0030] For example, when obtaining the pilot's level of proficiency in piloting the aircraft and identifying the difference, the imaging device may be controlled to capture an image with a greater amount of information the lower the pilot's level of proficiency.

[0031] According to the above aspect, the amount of information in the captured image is adjusted depending on the level of proficiency of the pilot of the aircraft. The less skilled the operator, the greater the amount of information in the image, which increases the accuracy of the actual measurement information, thereby enabling more accurate identification of discrepancies. This allows for more accurate notification to the user. This can help manage the quality of work more accurately and efficiently.

[0032] For example, the pilot's proficiency in piloting the aircraft may be further obtained, and when making the notification, the higher the pilot's proficiency, the narrower the specified range may be determined, and the notification may be made using the determined specified range.

[0033] According to the above aspect, the amount of information in the captured images is adjusted according to the level of proficiency of the pilot of the aircraft. As a result, the number of times the user checks the quality of the object, which requires relatively high attention, is more appropriately adjusted while increasing the weight of checking the quality of the work using images captured when the aircraft is operated by a pilot with a relatively low level of proficiency. In this way, it is possible to support efficient management of the quality of the work according to the level of proficiency of the pilot who operated the aircraft.

[0034] For example, when the notification is made, the image may be further provided so that the user can view the provided image.

[0035] According to the above aspect, the user can easily judge the quality of the work by visually checking the image of the object on which the work has been performed. As a result, the information processing method can support easier management of the quality of the work.

[0036] Furthermore, an information processing device according to one aspect of the present invention is an information processing device that includes an acquisition unit that acquires design information related to work, the design information having a reference value and an acceptable range that includes the reference value; an identification unit that identifies a difference between the design information and the actual measurement information by comparing the acquired design information with actual measurement information related to the work obtained from an image of an object on which the work was performed; and a notification unit that notifies a user when the identified difference falls within a predetermined range.

[0037] According to the above aspect, the same effects as those of the above information processing method are achieved.

[0038] A program according to one aspect of the present invention is a program that causes a computer to execute the above information processing method.

[0039] According to the above aspect, the same effects as those of the above information processing method are achieved.

[0040] These comprehensive or specific aspects may be realized as a system, device, integrated circuit, computer program, or computer-readable recording medium such as a CD-ROM, or may be realized as any combination of a system, device, integrated circuit, computer program, or recording medium.

[0041] Hereinafter, the embodiments will be specifically described with reference to the drawings.

[0042] The embodiments described below are all comprehensive or specific examples. The numerical values, shapes, materials, components, component placement and connection configurations, steps, and step order shown in the following embodiments are merely examples and are not intended to limit the present invention. Furthermore, among the components in the following embodiments, components that are not described in the independent claims that represent the highest concepts are described as optional components.

[0043] (Embodiment) In this embodiment, an information processing method and an information processing device that support efficient management of work quality will be described. This information processing method will also be referred to as a support method, and this information processing device will also be referred to as a support device.

[0044] FIG. 1 is a schematic diagram showing the configuration of a support system 1 according to this embodiment.

[0045] 1 is a system for a user U to efficiently manage the quality of work performed by a worker P at a work site 5. The user U is, for example, a manager who manages the quality of work performed at the work site 5.

[0046] The assistance system 1 includes an assistance device 10 and a terminal 20. The assistance device 10 is communicatively connected to the terminal 20 and to devices (e.g., an imaging device 7) located at the work site 5 via a network N. The network N may include the Internet, a mobile phone carrier network, a public network, a local area network, or the like.

[0047] The work site 5 is a place where work is performed by a worker P. The work site 5 is, for example, a building site, and may also be called a construction site or a building site. At the work site 5, an imaging device 7 is disposed that captures images of objects (for example, pillars, walls, floors, ceilings, doors, other equipment, etc.) on which work is performed by the worker P.

[0048] The imaging device 7 captures images by photographing and provides the captured images to the support device 10. The work may be, for example, joining pillars, installing walls, or arranging equipment. The imaging device 7 can capture images in accordance with a control signal received from the support device 10 via the network N. The imaging device 7 may be an imaging device with pan, tilt, or zoom functions. In this case, the imaging device 7 changes the orientation of the lens by panning, tilting, or zooming in accordance with the control signal received from the support device 10 via the network N.

[0049] Furthermore, the imaging device 7 may be an imaging device having a function of adjusting imaging parameters (specifically, the number of dimensions (2D or 3D, etc.), resolution (HD (High Definition), 4K or 8K, etc.)). In this case, the imaging device 7 changes the imaging parameters in accordance with a control signal received from the support device 10 via the network N.

[0050] 1 shows the imaging device 7 attached to the ceiling of the work site 5, the present invention is not limited to this, and the imaging device 7 may be attached to a moving object, for example, a moving object that moves on the floor, wall, or ceiling, or an air vehicle (a so-called drone) that flies through the space of the work site 5. The moving object may move autonomously based on information indicating the surrounding situation sensed by a sensor or the like, or may move by being operated by a pilot. The pilot may or may not be on board the moving object.

[0051] The support device 10 is a device that supports the user U in managing the quality of work. The support device 10 acquires images captured by the imaging device 7, and based on the acquired images, notifies the user U of work that has been performed by the worker P and that particularly requires confirmation by the user U. The processing executed by the support device 10 will be described in detail later.

[0052] The terminal 20 is a terminal used by the user U to manage the quality of work. An example will be described in which the terminal 20 is located at a location different from the work site 5, but this is not limiting, and the terminal 20 may be located within the work site 5. The terminal 20 is a personal computer, a smartphone, a tablet, or the like.

[0053] The terminal 20 presents to the user U an image showing an object that is the target of work performed by the worker P at the work site 5 on the display screen. The image is, for example, an image captured by the imaging device 7.

[0054] Furthermore, the support device 10 notifies the terminal 20 of the work that particularly requires confirmation by the user U. An image may be provided along with the notification. It is expected that the user U will check the work performed by the worker P in general with normal attention, and will check the work notified by the support device 10 with even more attention than usual.

[0055] FIG. 2 is a block diagram showing the functional configuration of the support device 10 according to this embodiment.

[0056] 2, the support device 10 includes, as functional units, an acquisition unit 11, an identification unit 12, a notification unit 13, and a control unit 14. The functional units included in the support device 10 can be realized by a processor (e.g., a CPU (Central Processing Unit)) (not shown) included in the support device 10 executing a predetermined program using a memory (not shown).

[0057] The acquisition unit 11 is a functional unit that acquires design information. The design information is predetermined design information related to a task, and has a reference value and an allowable range including the reference value. The acquisition unit 11 also acquires images captured by the imaging device 7. The images acquired by the acquisition unit 11 show an object that is the target of the task performed by the worker P.

[0058] The reference value is information indicating the dimensions, curvature, angle, etc. (also referred to as dimensions, etc.) of an object. More specifically, the dimensions of an object may be the length, height, depth, thickness, width, etc. of the object. The reference value indicates the dimensions, etc. of the object that should be achieved by the work.

[0059] The acceptable range is a range that includes the reference value, in other words, a predetermined range to which the reference value belongs.

[0060] More specifically, the tolerance range is a range in which the lower limit is a value smaller than the reference value by a predetermined value (generally also referred to as the lower tolerance) and the upper limit is a value larger than the reference value by a predetermined value (generally also referred to as the upper tolerance). The tolerance range indicates the range of dimensions, etc. that are acceptable for the dimensions of an object achieved by the work. The tolerance range can also be said to indicate the precision required for the work, in other words, the degree to which the reference value must be achieved. The tolerance range generally includes, but is not limited to, values ​​equal to the upper or lower limit. The upper tolerance and lower tolerance may be different.

[0061] The identifying unit 12 is a functional unit that identifies a difference between the design information and the actual measurement information. The identifying unit 12 identifies a difference between the design information and the actual measurement information by comparing the design information acquired by the acquiring unit 11 with the actual measurement information related to the work obtained from an image of the object on which the work was performed.

[0062] The actual measurement information includes actual measurement values ​​such as the dimensions of an object. The difference between the design information and the actual measurement information is, for example, the difference between a reference value included in the design information and the actual measurement value included in the actual measurement information, and this case will be described as an example. Note that the difference is, for example, the difference obtained by subtracting the reference value from the actual measurement value, but it is also possible to use a value derived using the difference or ratio between the actual measurement value and the reference value.

[0063] When identifying a difference between the design information and the actual measurement information, the identification unit 12 may acquire actual measurement information by performing image analysis processing on an image captured by the imaging device 7 before identifying the difference, and identify the difference using the acquired actual measurement information. The imaging device 7 is caused to capture an image by transmitting a control signal for capturing an image from the control unit 14 to the imaging device 7. In this case, the imaging device 7 transmits an image generated by capturing an image to the support device 10. The identification unit 12 acquires the image transmitted in this manner via the acquisition unit 11 and subjects it to the image analysis processing and the like.

[0064] Furthermore, when identifying the difference between the design information and the actual measurement information, the identification unit 12 may control the image capture device 7 via the control unit 14 so that the lower the proficiency level of the worker performing the work, the greater the amount of information the image will contain. In this case, it is assumed that the identification unit 12 has acquired proficiency level information indicating the proficiency level of the worker performing the work. Here, a greater amount of information may include a greater number of dimensions, which is an imaging parameter of the image, or a higher resolution, which is an imaging parameter of the image. For example, an image with three dimensions (i.e., a 3D image) contains more information than an image with two dimensions (i.e., a 2D image). Furthermore, an image with 2K resolution contains more information than an image with HD resolution, and further, an image with 4K resolution contains more information.

[0065] Furthermore, when the imaging device 7 is mounted on an aircraft, the identification unit 12 may control the imaging device 7 via the control unit 14 to capture an image with a greater amount of information when identifying a difference between the design information and the actual measurement information, as the pilot of the aircraft has a lower level of proficiency. In this case, it is assumed that the identification unit 12 has acquired proficiency information indicating the pilot's proficiency in piloting the aircraft. Note that the identification unit 12 may control the imaging device 7 via the control unit 14 as described above, and also control the aircraft via the control unit 14.

[0066] The notification unit 13 is a functional unit that notifies the user U. When the difference between the design information and the actual measurement information identified by the identification unit 12 falls within a predetermined range, the notification unit 13 notifies the user U via the terminal 20. The predetermined range is a predetermined range that is near the upper or lower limit of an allowable range when the reference value is set to zero. The predetermined range is also referred to as a monitoring range (or a first monitoring range) for the difference.

[0067] It can also be said that the notification unit 13 issues the notification when the actual measurement information belongs to a predetermined range that is near the upper or lower limit of the allowable range included in the design information. The predetermined range is also referred to as the monitoring range (or second monitoring range) for the actual measurement information. The fact that the actual measurement information belongs to the second monitoring range is essentially the same as the fact that the difference between the design information and the actual measurement information belongs to the first monitoring range. The first monitoring range or the second monitoring range may also be simply referred to as the monitoring range. In the following, an example will be described in which the notification unit 13 uses the difference between the design information and the actual measurement information and the first monitoring range.

[0068] When the difference between the design information and the actual measurement information falls within the first monitoring range, it is not easy for the user U to determine whether the actual measurement information is within the allowable range, and it can be said that the user U should monitor the quality of the work with greater attention than usual. Therefore, it is expected that the notification by the notification unit 13 will encourage the user U to perform the above monitoring.

[0069] The width of the monitoring range is smaller than the width of the tolerance range. More specifically, the width of the monitoring range is within about 10% to 20% of the width of the tolerance range, and even more particularly, within a few percent.

[0070] Furthermore, when the notification unit 13 determines that the identified difference is within the allowable range and is not within the monitoring range, the notification unit 13 does not notify the user U. In this case, it can be said that the notification unit 13 restricts notification to the user U. This is because, in this case, it is clear that the actual measurement information is within the allowable range, and therefore, with the user U's usual focus, it can be easily determined that the quality of the work is at or above a certain level.

[0071] Furthermore, when the notification unit 13 determines that the identified difference is not within the allowable range and that the difference is not within the monitoring range, the notification unit 13 does not notify the user U. In this case, it can be said that the notification unit 13 restricts notification to the user U. This is because, in this case, it is clear that the actual measurement information is not within the allowable range, and therefore, with the user U's usual focus, it can be easily determined that the quality of the work is below a certain level.

[0072] Furthermore, when issuing a notification, the notification unit 13 may determine a monitoring range having a width according to the characteristics of the work, and may issue a notification using the determined monitoring range.

[0073] Furthermore, when making a notification, the notification unit 13 may determine a monitoring range with a narrower width as the amount of information included in the image increases, and may make a notification using the determined monitoring range.

[0074] Furthermore, when making a notification, the notification unit 13 may determine a monitoring range with a narrower width the higher the proficiency level of the worker who performed the work that served as the basis for identifying the difference, and may make a notification using the determined monitoring range. In this case, it is assumed that the notification unit 13 has acquired proficiency level information indicating the proficiency level of the worker who performed the work.

[0075] Furthermore, when making a notification, the notification unit 13 may determine a monitoring range with a narrower width as the pilot of the aircraft becomes more skilled, and may make a notification using the determined monitoring range. In this case, it is assumed that the notification unit 13 has acquired proficiency information indicating the pilot's proficiency in piloting the aircraft.

[0076] When making the notification, the notification unit 13 may further provide the image acquired by the acquisition unit 11 so that the monitor can view the provided image.

[0077] The control unit 14 is a functional unit that controls the imaging device 7. The control unit 14 controls the imaging device 7 by transmitting a control signal for controlling the imaging device 7 to the imaging device 7 via the network N. Specifically, the control signal is a signal for controlling the pan, tilt, or zoom function of the imaging device 7, or a signal for changing imaging parameters.

[0078] In addition, when the imaging device 7 is mounted on the aircraft, the control unit 14 may control the aircraft as well as the imaging device 7. The control unit 14 controls the aircraft by transmitting a control signal for controlling the aircraft to the aircraft via the network N. Specifically, the control signal is a signal for controlling the aircraft to ascend, descend, move forward, move backward, move left and right, or rotate left and right, etc. In this case, the aircraft needs to be connected to the support device 10 via the network N so as to be able to communicate with each other.

[0079] The information used by the support device 10 will be specifically described below.

[0080] Fig. 3 is a schematic diagram showing the appearance of a pillar, which is an example of an object to be worked on, and Fig. 4 is a schematic diagram showing an example of design information in this embodiment.

[0081] A pillar 30, which is an example of the object of work shown in FIG.

[0082] 4 is an explanatory diagram showing an example of design information in this embodiment. The design information shown in FIG. 4 is information that is predetermined depending on the object that is the target of work, and is an example of design information acquired by acquisition unit 11.

[0083] The design information shown in Fig. 4 includes, for example, a reference value and a tolerance range for the length L of the column 30 shown in Fig. 3. For example, the reference value for the length L is 2500 mm, and the tolerance is ±2.0 mm (i.e., the upper tolerance is 2.0 mm, and the lower tolerance is -2.0 mm).

[0084] The design information may be information including a reference value and a tolerance. In this case, the tolerance range can be calculated using the reference value and the tolerance, and the tolerance range calculated in this way can be used.

[0085] 5 is an explanatory diagram showing work information 40, which is an example of work information in this embodiment. The work information 40 shown in FIG. 5 is an example of work information 40 held by the identification unit 12.

[0086] The work information 40 shown in Fig. 5 is information including, for each work, a work ID, design information for the work, a monitoring range, and a worker. One entry (one line) shown in Fig. 5 corresponds to one work.

[0087] The job ID is an identifier that can uniquely identify the job indicated in the entry. The job ID can be any information format that can uniquely identify the job, and may include numbers, letters, or symbols. A job with a job ID of 01 is also called job 01. For example, job 01 is joining columns, and job 02 is arranging equipment.

[0088] The design information includes the reference values ​​and tolerances for the work indicated in the entry, and corresponds to the design information shown in FIG.

[0089] The monitoring range is information that determines the monitoring range for the work indicated by the entry. The monitoring range for the difference (first monitoring range) includes a range in which the lower limit is a value that is smaller by the monitoring range than the upper limit of the tolerance range when the reference value is set to zero, and the upper limit is a value that is larger by the monitoring range than the upper limit of the tolerance range when the reference value is set to zero. The monitoring range for the difference also includes a range in which the lower limit is a value that is smaller by the monitoring range than the lower limit of the tolerance range when the reference value is set to zero, and the upper limit is a value that is larger by the monitoring range of the tolerance range.

[0090] The monitoring range for the actual measurement information (second monitoring range) includes a range in which the lower limit is a value smaller than the upper limit of the allowable range by the monitoring width, and the upper limit is a value larger than the upper limit of the allowable range by the monitoring width. The monitoring range for the actual measurement information also includes a range in which the lower limit is a value smaller than the lower limit of the allowable range by the monitoring width, and the upper limit is a value larger than the lower limit of the allowable range by the monitoring width.

[0091] The worker indicates the worker who performed the work indicated in the entry.

[0092] The monitoring range determined by the monitoring width will be specifically described with reference to FIG.

[0093] FIG. 6 is an explanatory diagram showing a first example of a monitoring range in this embodiment.

[0094] The two monitoring ranges A and B shown in FIG. 6 are examples of monitoring ranges (first monitoring ranges) for differences in the object that is the target of the work 01 shown in FIG.

[0095] The two monitoring ranges A and B shown in FIG. 6 are used when the notification unit 13 determines the difference between the design information and the actual measurement information.

[0096] The monitoring range A is a range of (-2±0.2) mm, that is, a range of -2.2 mm to -1.8 mm, which is close to the lower limit value of -2 mm of the allowable range (-2 mm to 2 mm) set from the reference value set to zero.

[0097] Moreover, the monitoring range B is in the vicinity of the upper limit value 2 mm of the above-mentioned allowable range (-2 mm to 2 mm), that is, in the range of (2±0.2) mm, that is, in the range of 1.8 mm to 2.2 mm.

[0098] When the difference between the design information and the actual measurement information falls within the monitoring range A or B, the notification unit 13 notifies the user U.

[0099] FIG. 7 is a schematic diagram showing a second example of the monitoring range in this embodiment.

[0100] Two monitoring ranges C and D shown in FIG. 7 are examples of monitoring ranges (second monitoring ranges) for actual measurement values ​​of the target of the work 01 shown in FIG.

[0101] The two monitoring ranges C and D shown in FIG. 7 are used when the notification unit 13 makes a determination on the actual measurement information.

[0102] The monitoring range C is a range of (2498±0.2) mm, that is, a range of 2497.8 mm to 2498.2 mm, which is close to the lower limit value 2498 mm of the allowable range (2498 mm to 2502 mm) set from the reference value 2500 mm.

[0103] Furthermore, the monitoring range C is in the vicinity of the upper limit value 2502 mm of the allowable range (2498 mm to 2502 mm), that is, the range of (2502±0.2) mm, that is, the range of 2501.8 mm to 2502.2 mm.

[0104] When the actual measurement value falls within the monitoring range C or D, the notification unit 13 notifies the user U.

[0105] FIG. 8 is an explanatory diagram showing an example of actual measurement information in this embodiment.

[0106] An image 50 shown in FIG. 8 is an example of an image captured by the imaging device 7 of a pillar 30, which is an object on which work has been carried out at the work site 5.

[0107] The identification unit 12 acquires the image 50 via the acquisition unit 11, and performs image analysis processing on the image 50 to identify the actual length M of the pillar 30 shown in the image 50. The actual length M of the pillar 30 can be identified by appropriate calculation processing using the length of the pillar 30 on the image 50, the position in real space of the imaging device 7 that captured the image 50, the imaging direction, imaging parameters, the distance in real space between the imaging device 7 and the pillar 30, etc.

[0108] The identification unit 12 uses the actual length M of the pillar 30 identified as described above as actual measurement information to determine whether it belongs to the monitoring range (more specifically, the second monitoring range), and controls whether or not to issue a notification via the notification unit 13 depending on the result of the determination.

[0109] FIG. 9 is a schematic diagram showing an example of proficiency level information in this embodiment.

[0110] 9 may be used when the identification unit 12 controls the imaging device 7 via the control unit 14, or when the notification unit 13 determines the width of the monitoring range. The proficiency information is held by, for example, the identification unit 12 or the control unit 14, but is not limited to this, and may be held by another functional unit of the support device 10.

[0111] The proficiency information shown in Fig. 9 is information indicating the proficiency of each worker for each task. One entry (one line) shown in Fig. 9 indicates the proficiency of one worker for one task.

[0112] The skill level information includes the worker ID, the work content, and the skill level.

[0113] The worker ID is an identifier that can uniquely identify the worker indicated in the entry. The worker ID may be any information in a format that can uniquely identify the worker, and may include numbers, letters, symbols, etc.

[0114] The task ID is an identifier that can uniquely identify the task indicated in the entry, and is the same as the task ID included in the task information (see FIG. 5).

[0115] The proficiency level indicates the proficiency level of the worker associated with the worker ID indicated in the entry, at the task associated with the task ID indicated in the entry. The proficiency level is indicated, for example, in one of three levels: A, B, and C, but the notation indicating the proficiency level is not limited to this. Furthermore, the proficiency level is not limited to three levels.

[0116] For example, the proficiency information shown in FIG. 9 indicates that a worker with worker ID P (referred to as worker P) has a proficiency level of A for a task with task ID 01 (referred to as task 01).

[0117] Furthermore, the proficiency level information shown in FIG. 9 indicates that the proficiency level of worker P for task 02 is B.

[0118] Furthermore, the skill level information shown in FIG. 9 indicates that the skill level of worker Q for task 01 is B.

[0119] The proficiency information may include the pilot's proficiency in piloting the aircraft, which may be used when the identification unit 12 controls the image capture device 7 via the control unit 14 or when the notification unit 13 determines the width of the monitoring range.

[0120] FIG. 10 is a flow diagram showing the support method according to this embodiment.

[0121] As shown in FIG. 10, in step S101, the acquiring unit 11 acquires design information.

[0122] In step S102, the identifying unit 12 compares the design information acquired in step S101 with the actual measurement information related to the work, thereby identifying a difference between the design information and the actual measurement information.

[0123] In step S103, the notification unit 13 notifies the user U if the difference identified in step S102 is within a predetermined range (that is, a monitoring range) that is close to the upper or lower limit of the allowable range.

[0124] Through the above series of processes, the support device 10 can efficiently manage the quality of the work.

[0125] In the above embodiments, each component may be configured with dedicated hardware, or may be realized by executing a software program suitable for each component. Each component may be realized by a program execution unit such as a CPU or processor reading and executing a software program recorded on a recording medium such as a hard disk or semiconductor memory. Here, the software that realizes the support device of the above embodiments is the following program.

[0126] In other words, this program causes a computer to execute an information processing method that acquires design information related to work, the design information having a reference value and an acceptable range that includes the reference value, compares the acquired design information with actual measurement information related to the work obtained from an image of the object on which the work was performed, identifies a difference between the design information and the actual measurement information, and notifies a user if the identified difference falls within a specified range that is near the upper or lower limit of the acceptable range.

[0127] While the assistance device according to one or more aspects has been described above based on the embodiments, the present invention is not limited to these embodiments. As long as it does not deviate from the spirit of the present invention, various modifications conceivable by those skilled in the art to the present embodiments, or configurations constructed by combining components of different embodiments, may also be included within the scope of one or more aspects. [Industrial Applicability]

[0128] The present invention can be used in a system for managing the quality of work. [Explanation of symbols]

[0129] 1. Support System 5. Work site 7. Imaging device 10 Support equipment 11 Acquisition Department 12 Specific section 13 Notification Department 14 Control Unit 20 terminals 30 pillars 40 Work Information 50 images N Network P worker U User

Claims

1. An information processing method executed by an information processing device, comprising: acquiring design information relating to the work, the design information having a reference value and an allowable range including the reference value; By comparing the acquired design information with actual measurement information relating to the work obtained from an image of the object on which the work has been performed, a difference between the design information and the actual measurement information is identified; It is determined whether the identified difference falls within a predetermined range that is near the upper or lower limit of the tolerance range, and if it is determined that the difference falls within the predetermined range, a notification is given to the user. Information processing methods.

2. When making the above notification, The predetermined range having a width according to the characteristics of the work is determined, and the notification is made using the determined predetermined range. The information processing method according to claim 1 .

3. When making the above notification, determining a predetermined range having a narrower width as the amount of information included in the image increases, and making the notification using the determined predetermined range; The amount of information contained in the image is large, including a large number of dimensions, which is an imaging parameter of the image, or a high resolution, which is an imaging parameter of the image.

3. The information processing method according to claim 1.

4. Furthermore, the proficiency level of the worker who performed the work is acquired, When making the above notification, The higher the level of skill of the worker who performed the work that was the basis for identifying the difference, the narrower the width of the predetermined range that is determined, and the notification is made using the determined predetermined range. The information processing method according to any one of claims 1 to 3.

5. moreover, Before identifying the difference, an imaging device is controlled to capture the image; Acquire the actual measurement information by performing image analysis processing on the captured image; The difference is identified using the acquired actual measurement information. The information processing method according to any one of claims 1 to 4.

6. Furthermore, the proficiency level of the worker who performed the work is acquired, When identifying the differences, The lower the skill level of the worker performing the work, the greater the amount of information the image capturing device is controlled to capture. The information processing method according to claim 5 .

7. The imaging device is mounted on a flying object operated by a pilot.

7. The information processing method according to claim 5 or 6.

8. Furthermore, the pilot's proficiency in piloting the aircraft is acquired, When identifying the differences, The lower the skill level of the operator, the greater the amount of information the image capturing device is controlled to capture. The information processing method according to claim 7.

9. Furthermore, the pilot's proficiency in piloting the aircraft is acquired, When making the above notification, The higher the skill level of the operator, the narrower the width of the predetermined range that is determined, and the notification is made using the determined predetermined range.

9. The information processing method according to claim 7 or 8.

10. When the notification is made, the image is further provided, and the provided image is then viewed by the user. The information processing method according to any one of claims 1 to 9.

11. an acquisition unit that acquires design information relating to a task, the design information having a reference value and an allowable range including the reference value; an identification unit that identifies a difference between the design information and actual measurement information by comparing the acquired design information with actual measurement information related to the work obtained from an image of an object on which the work has been performed; a notification unit that determines whether the identified difference falls within a predetermined range that is near the upper or lower limit of the allowable range, and notifies a user when it is determined that the difference falls within the predetermined range. Information processing device.

12. A program that causes a computer to execute the information processing method according to any one of claims 1 to 10.

Citation Information

Patent Citations

  • Method for supervising line construction by utilizing air-ground fusion true three-dimensional scene

    CN112257497A

  • Situation determination system, situation determination method, and situation determination program

    JP6700580B2

  • Component inspection method

    US20180300873A1