Attention calling system and attention calling device

Abstract

To provide an attention calling system and an attention calling device which call an attention to a worker for an object and an object subjected to operation, and which can improve the precision of a confirmation work.SOLUTION: An attention calling system 100 that calls an attention to a worker for an object obtains an object image 50 of an object 4, and setting information on the imaging of the object image 50, determines whether an object image 51 subjected to attention calling is included in the object image 50 or not, sets, if the object image 51 subjected to attention calling is included in the object image 50, coordinate information on the center of the object image 51 subjected to attention calling and instruction information 6 that requests an attention calling to be displayed with the coordinate information based on the setting information, obtains the coordinate information and the instruction information 6, and outputs those pieces of information by emitting a light beam.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an attention calling system and an attention calling device that call the attention of a worker to an object. [Background technology]

[0002] 2. Description of the Related Art Conventionally, an X-ray imaging apparatus as disclosed in Patent Document 1, for example, has been proposed as a method for identifying a location of an object by irradiating the object with a light laser.

[0003] The X-ray imaging apparatus disclosed in Patent Document 1 aims to improve operability when setting the X-ray irradiation field and shorten the examination time, and is equipped with an X-ray imaging means capable of taking an X-ray image of a subject, a surface imaging means capable of imaging the surface of the subject including the X-ray irradiation field, and a display means capable of displaying the imaged surface image. The X-ray imaging means is equipped with a stereo X-ray tube capable of irradiating X-rays toward the subject from different focal positions and two sets of apertures capable of each limiting the irradiation range of X-rays from the focal positions, while the surface imaging means irradiates lasers toward the subject from laser markers arranged at two positions each conjugate to the focal positions, thereby forming a laser marker frame on the surface of the subject corresponding to the aperture opening, and is capable of imaging the surface image of the subject with this laser marker frame formed. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Publication No. 06-217973 Summary of the Invention [Problem to be solved by the invention]

[0005] Here, when an operator checks a device (such as a medical device) on which the operator will be working or the operation of the device, the operator currently checks the object or the operation location visually. Therefore, the check result may include check errors or oversights due to the installation conditions of the device and the operator's skills and experience, and there are concerns about insufficient attention during the check work and operation. In this regard, in the technology disclosed in Patent Document 1, the laser marker frame is formed on the surface of a subject at a close distance, so the operator cannot identify the device or operation location on which the operator should work from among multiple objects. Due to these circumstances, there is a demand for improving the accuracy of the check work of the device and the operation target on which the operator will work.

[0006] Therefore, the present invention has been devised in consideration of the above-mentioned problems, and its purpose is to provide an attention warning system and an attention warning device that can warn a worker of an object or an operation target, thereby improving the accuracy of the confirmation work. [Means for solving the problem]

[0007] The attention warning system of the first invention is an attention warning system for warning an operator of an object, and is characterized in that it comprises: an acquisition means for acquiring an object image of the object and setting information related to capturing the object image; a discrimination means for discriminating whether or not the acquired object image includes an attention warning object image for warning an operator; a setting means for setting coordinate information of the center of the attention warning object image and the instruction information to be displayed on the coordinate information based on the setting information if the discrimination means determines that the object image includes the attention warning object image; and a light emission means for emitting the instruction information onto the coordinate information with a light beam based on the coordinate information and the instruction information set by the setting means.

[0008] The attention warning system of the second invention is characterized in that, in the first invention, the instruction information set by the setting means is an image having information regarding at least one of a cross image, an X-shaped image, and a graphic image.

[0009] The warning system of the third invention is characterized in that, in the first or second invention, the instruction information set by the setting means is information having a format related to at least any one of the color related to the emitted light of the instruction information and the emitted light pattern.

[0010] The attention warning system according to a fourth invention is characterized in that, in the first invention, the instruction information set by the setting means has sound information relating to at least one of a voice corresponding to the instruction information and an alert.

[0011] The attention warning system of the fifth invention is characterized in that, in the first invention, when the discrimination result of the discrimination means includes a plurality of the attention drawing object images, the setting means sets the coordinate information and the instruction information with the highest priority, or the coordinate information and the instruction information sequentially, based on at least one of the priority of tasks linked to the plurality of the attention drawing object images or the skill of the worker.

[0012] The attention drawing device of the sixth invention is an attention drawing device that draws the attention of an operator to an object, and is characterized in that it comprises an acquisition unit that acquires an object image of the object and setting information related to capturing the object image, a discrimination unit that determines whether the acquired object image includes an attention drawing object image that draws attention, a setting unit that, if the discrimination unit determines that the object image includes the attention drawing object image, sets coordinate information of the center of the attention drawing object image and the instruction information to be displayed on the coordinate information based on the setting information, and a light emission unit that acquires the coordinate information and the instruction information set by the setting unit, and emits the instruction information onto the coordinate information with a light beam. Effect of the Invention

[0013] According to the first to fifth aspects of the invention, the acquisition unit acquires an object image of an object and setting information related to capturing the object image. Therefore, it is possible to determine whether or not the object image includes an attention-attracting object image that draws attention. This makes it possible to draw the worker's attention to the object or operation target, thereby improving the accuracy of the confirmation work.

[0014] According to the first to fifth aspects of the invention, the discrimination means discriminates whether or not the object image includes an attention-attracting object image for attracting attention. Therefore, when the object image includes the attention-attracting object image, information for instructing attention can be set based on the setting information. This makes it possible to draw the worker's attention to the object or operation target, thereby improving the accuracy of the confirmation work.

[0015] In particular, according to the second aspect of the present invention, the instruction information includes at least one of a cross image, an X-shaped image, and a graphic image. Therefore, the equipment and operation location that the worker should work on can be identified from among a plurality of objects. This makes it possible to call the worker's attention to the object or operation target, thereby improving the accuracy of the confirmation work.

[0016] In particular, according to the third aspect of the present invention, the instruction information has a format related to at least one of the color and the pattern of the light emitted by the instruction information. Therefore, the equipment and the operation location where the worker should work can be identified from among multiple objects. This makes it possible to call the worker's attention to the object or the operation target, and improve the accuracy of the confirmation work.

[0017] In particular, according to the fourth aspect of the present invention, the instruction information includes sound information related to at least one of a voice corresponding to the instruction information and an alert. Therefore, it is possible to confirm that there is a device or an operation location that the worker should work on among a plurality of objects. This makes it possible to call the worker's attention to the object or operation target, thereby improving the accuracy of the confirmation work.

[0018] In particular, according to the fifth aspect of the present invention, when the discrimination result of the discrimination means includes multiple attention-attracting object images, the setting means sets the highest priority coordinate information and instruction information, or sequentially sets the coordinate information and instruction information. Therefore, from among the multiple objects, it is possible to identify the equipment or operation location that the worker should work on with the highest priority or that corresponds to at least one of the worker's skills. This makes it possible to call the worker's attention to the object or operation target, thereby improving the accuracy of the confirmation work.

[0019] According to the sixth aspect of the present invention, the acquisition unit acquires an object image of an object and setting information related to capturing the object image. Therefore, it is possible to determine whether or not the object image includes an attention-attracting object image that draws attention. This makes it possible to draw the worker's attention to the object or the operation target, thereby improving the accuracy of the confirmation work. [Brief description of the drawings]

[0020] [Figure 1] FIG. 1 is a schematic diagram showing an example of an attention calling system according to the present embodiment. [Diagram 2] Fig. 2(a) is a schematic diagram showing an example of an object image captured by the attention calling device in this embodiment. Fig. 2(b) is a schematic diagram showing an example of a light emitting operation of the attention calling device in this embodiment. Fig. 2(c) is a schematic diagram showing an example of a light emitting operation of the attention calling device in this embodiment. [Diagram 3] FIG. 3(a) is a schematic diagram showing an example of the configuration of an attention calling device in this embodiment, and FIG. 3(b) is a schematic diagram showing an example of the function of the attention calling device in this embodiment. [Figure 4] FIG. 4 is a schematic diagram showing an example of the reference database in this embodiment. [Diagram 5] FIG. 5 is a flowchart showing an example of the operation of the attention calling system in this embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0021] Hereinafter, an example of an attention calling system and an attention calling device according to an embodiment of the present invention will be described with reference to the drawings.

[0022] An example of an attention calling system 100 and an attention calling device 1 according to the present embodiment will be described with reference to FIG.

[0023] 1, an attention calling system 100 in this embodiment includes an attention calling device 1. The attention calling device 1 may be connected to another terminal 2 and a server 3 via a communication network 5, for example.

[0024] The attention calling system 100 calls the attention of an object 4 to a worker working at place A. If place A is, for example, a hospital, then object 4 is a medical device, and if place A is, for example, a factory, then object 4 is a machine tool. Object 4 may be installed singly at place A, or multiple objects may be installed, such as object 4a and object 4b. Object 4b may be equipped with a monitor 4c that displays the operating status of the equipment, for example. Object 4 may be configured (not shown) to include various instruments for checking the status, in addition to levers, handles, and the like with which the worker performs work.

[0025] The attention calling device 1 includes a camera 1a that captures an image of an object 4 installed in, for example, place A, and a light outlet 1b that emits a light beam that calls the worker's attention to the position and operation of the object 4. The camera 1a may be, for example, a known camera, or may be a network camera or a Web camera equipped with a wireless function that enables communication with the terminal 2 and the server 3.

[0026] The warning system 100 may, for example, determine in advance the identity of a worker working at location A based on the identification information on an ID card held by the worker, or by facial recognition, biometric authentication, etc. (not shown) of the worker, and identify the worker working at location A based on the results of the determination.

[0027] In the attention warning system 100, as shown in FIG. 2, for example, an object image 50 of an object 4 installed at a location A is obtained via an attention warning device 1, the object 4 on which a worker is working is identified, instruction information 6 is projected onto the object 4 installed at the location A, and the worker is alerted.

[0028] 2(a) shows an image of a space in place A captured by an attention calling device 1 installed in place A in the attention calling system 100, and a captured object image 50 includes, for example, a plurality of objects 4a and 4b. The attention calling device 1 may capture the situation in place A as a video (movie) or the like in addition to an image (still image).

[0029] 2(b) shows that in the attention calling system 100, for example, an object 4a on which a worker will work is identified based on an object image 50 and various setting information when the object image 50 is captured (starting point information, spatial information, difference information, position information, shooting information, shooting angle, etc.), and the center of the identified object 4a is indicated by instruction information 6 using a light beam. This allows a subject in place A, for example, to identify the device on which he or she should work from among multiple devices, and to accurately confirm the device on which he or she should work, thereby improving the accuracy of the confirmation work.

[0030] 2(c) shows that in the attention calling system 100, the object 4b on which the worker is to work is identified based on the object image 50 and various setting information when the object image 50 is captured (starting point information, spatial information, difference information, position information, shooting information, shooting angle, etc.), and the center of the monitor 4c to be confirmed on the identified object 4b is indicated by the instruction information 6 using a light beam. This allows the subject in place A, for example, to accurately confirm that the device on which he or she is to work is the object 4b and further the monitor 4c of the object 4b, improving the accuracy of the confirmation work.

[0031] The shape of the instruction information 6 may be a line, a cross, an X, or a graphic image. The instruction information 6 may be red, green, or blue, or may have a solid or broken line pattern, or may be emitted so that the instruction information 6 flashes. Furthermore, the instruction information may include, for example, a voice corresponding to the instruction information and sound information such as an alert, and may be output from a speaker (not shown) of the attention calling device 1 in conjunction with the projection of the light beam.

[0032] (Attention device 1) Next, an example of the attention calling device 1 in this embodiment will be described with reference to Fig. 3. Fig. 3(a) is a schematic diagram showing an example of the configuration of the attention calling device 1 in this embodiment, and Fig. 3(b) is a schematic diagram showing an example of the function of the attention calling device 1 in this embodiment.

[0033] 3(a), the attention calling device 1 includes a housing 10, a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, a storage unit 104, and I / Fs 105 to 109. The components 101 to 109 are connected to each other via an internal bus 120.

[0034] The CPU 101 controls the entire attention calling device 1. The ROM 102 stores the operation code of the CPU 101. The RAM 103 is a working area used when the CPU 101 operates. The storage unit 104 stores various information such as evaluation target information and a reference database. As the storage unit 104, for example, a data storage device such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive) is used.

[0035] I / F 105 is an interface for transmitting and receiving various information with other terminals 2, servers 3, etc., and may also be an interface for transmitting and receiving various information with other terminals 2, servers 3, etc. via a communication network 5 such as the Internet.

[0036] The I / F 106 is an interface for outputting light emission information as a light beam from the light emission unit 113. For example, the light emission unit 113 may be provided in the attention calling device 1 with light emission units 113 (light emission ports 1b) that emit light in vertical and horizontal lines, each of which is individually provided to emit light in a plurality of directions (not shown).

[0037] The I / F 107 is an interface for inputting captured image data from the camera unit 112 and various setting information related to capturing images. The camera unit 112 may be, for example, a network camera that is attached integrally to the attention calling device 1, for example, a camera that is installed on the ceiling of the place A, or a camera (not shown) that is provided on a terminal or the like that is held or worn by the operator or another operator.

[0038] The I / F 108 is an interface for transmitting and receiving information to and from the input unit 111. For example, a keyboard or the like is used as the input unit 111, and an evaluator or the like who uses the attention calling device 1 inputs various pieces of information or control commands for the attention calling device 1, or the like, via the input unit 111.

[0039] The I / F 109 is an interface for transmitting and receiving various information to and from the display unit 110. The display unit 110 outputs various information such as the evaluation results stored in the storage unit 104, or the processing status of the attention calling device 1. As the display unit 110, for example, a display is used, and it may be, for example, a touch panel type.

[0040] For example, the same I / F 105 to I / F 109 may be used, or a plurality of I / Fs may be used for each of I / F 105 to I / F 109. At least one of camera unit 112, light emitting unit 113, terminal 2, server 3, communication network 5, input unit 111, and display unit 110 may be detached depending on the situation.

[0041] <Database> Next, an example of a database in this embodiment will be described with reference to Fig. 4. The database is stored in, for example, the server 3, and also in, for example, the storage unit 104, and various information stored in the database, data table, etc. is extracted as necessary.

[0042] The database is composed of various data tables including at least a "user data table", an "object data table", a "warning target data table", and an "instruction information data table" as shown in Fig. 4. The various data tables constituting the database are composed by linking the respective data.

[0043] <<User data table>> The user data table stores, for example, a "user ID" that indicates data for identifying the worker performing the work, a "user name" that indicates the name of the worker, "user information" that indicates detailed information about the worker, and an "object ID" that identifies the object that is the target of a warning, each of which is associated with the user ID.

[0044] <<Object data table>> The object data table stores, for example, an "object ID" that indicates data for identifying the object that is the target of the warning, an "object name" that corresponds to the object ID and indicates the name and model number of the object installed in each location, an "object image" that is an image of the object such as equipment that is the target of the warning, "coordinate information (starting point, space, difference)" that indicates various coordinate information such as the position that will be the starting point of the warning within the location where the object is installed, the spatial position within the location, and the differential distance from the camera position installed within the location, and an "alert target ID" that identifies the object or condition for which the warning is to be issued.

[0045] <<Data table for which attention is required>> The attention target data table stores, in correspondence with the attention target ID, for example, a "warning target ID" indicating data for identifying the target to be warned about, a "warning target name" indicating the name or model number of the target to be warned about for each target, an "object image" capturing an image of the target or state of the device or other device to be warned about, "coordinate information (center, space, difference)" indicating various coordinate information such as the center position of the object to be warned about, its spatial position within the location, and the difference between the angle of the camera 1a of the attention warning device 1 at which the object was photographed and the center position of the object to be warned about, and an "instruction ID" identifying the instruction information 6 that instructs the warning, etc.

[0046] <<Instruction information data table>> The instruction information data table stores, for example, an "instruction ID" indicating data for identifying the instruction information 6, and in correspondence with the instruction ID, a "display format" indicating a display format for shining light on the center of the object to be alerted, an "instruction format" indicating various formats of the emitted instruction information 6, and "coordinate information (center, space, difference)" indicating various coordinate information such as the position of the center of the object to be alerted of the emitted light beam (light laser), the spatial position within the location, and the difference between the angle of the camera 1a of the attention warning device 1 at which the object was photographed and the center position of the object to be alerted.

[0047] For each object, the following items are stored in correspondence with each other: "Warning target name" indicating the name, model number, etc. of the object to be warned about; "Object image" capturing an image of the object or state of the device or other object to be warned about; "Coordinate information (center, space, difference)" indicating various coordinate information such as the center position of the object to be warned about, its spatial position within the location, and the difference between the angle of the camera 1a of the warning device 1 at which the object was photographed and the center position of the object to be warned about; and an "Instruction ID" identifying the instruction information 6 that issues an instruction to warn about the object.

[0048] In addition, the database may store associations between, for example, past object images 50 and attention-calling object images 51 acquired in advance (not shown) and reference information associated with the past object images 50 and attention-calling object images 51, and may store, for example, a learning model having associations. The database may store, for example, past object images 50, attention-calling object images 51, setting information, discrimination results, coordinate information, instruction information evaluation target information, and reference information. The associations may be constructed by machine learning using multiple learning data, for example, with the past object images, attention-calling object images, and reference information as a set of learning data. As a learning method, for example, deep learning such as a convolutional neural network may be used.

[0049] The past evaluation target information may include, for example, composite data and a similarity. The composite data is indicated by three or more levels of similarity between the composite data and the past image data or the past discrimination information. The composite data may be stored in the database in the form of a numerical value, a matrix, a histogram, or the like, or may be stored in the form of an image, a character string, or the like.

[0050] Fig. 3(b) is a schematic diagram showing an example of the functions of the attention calling device 1. The attention calling device 1 includes an acquisition unit 11, a discrimination unit 12, a setting unit 13, and a light emitting unit 14, and may also include, for example, a storage unit 15. Note that each function shown in Fig. 3(b) is realized by the CPU 101 using the RAM 103 as a working area to execute a program stored in the storage unit 104 or the like, and may be controlled by, for example, artificial intelligence.

[0051] <Acquisition part 11> The acquisition unit 11 acquires an object image 50 of an object and setting information when the object image 50 was captured. The acquisition unit 11 acquires an object image 50 of an object 4 in place A, for example, by a camera 1a of the attention calling device 1. For example, when the attention calling device 1 is fixedly installed in place A, the acquisition unit 11 captures an image of the object from the fixed installation position. Note that the attention calling device 1 may be remotely operated, for example, from the terminal 2 via a communication network 5, and may remotely capture an image of the object 4 in place A. Furthermore, for example, the camera 1a may be worn by a worker, and the object image 50 of the object 4 from the worker's line of sight may be acquired.

[0052] For example, when acquiring an object image 50 of an object 4 in place A, the acquisition unit 11 acquires various types of information regarding the object image 50 and stores the acquired various types of information in the storage unit 104. The acquisition unit 11 may store the acquired attention object image 50 and various types of setting information in a database of the server 3 via the communication network 5.

[0053] The object image 50 acquired by the acquisition unit 11 may be, for example, a still image or a video. The acquisition unit 11 may acquire still images or videos by, for example, referring to the "user data table" shown in Fig. 4, or may automatically acquire the images based on, for example, the behavior, posture, speech, and other conditions of the worker. Furthermore, the acquisition unit 11 may acquire the user ID of a worker who has been detected by an entrance / exit management device (not shown) as a person to be alerted entering place A, and may capture an image of the object 4 in the space within place A.

[0054] 4, and includes at least various setting information such as location information where the attention drawing device 1 is installed, the space in place A based on the location information, the direction and image capturing angle (pan, tilt, zoom) at which the camera 1a captures the object 4, and the distance to the object 4. This makes it possible to accurately obtain an object image 50 including the object 4, to draw the worker's attention to the object or operation target, and to improve the accuracy of the confirmation work.

[0055] The acquisition unit 11 acquires, for example, various shooting conditions as setting information together with the object image 50. Note that the acquisition unit 11 may acquire the object image 50 and the setting information based on, for example, the work content and skills of the worker, the shape, specifications (performance, function, interface, design, etc.) of the object installed at the place A, the number of installed objects, etc., and the frequency and period are arbitrary.

[0056] The acquisition unit 11 also receives various types of information transmitted to the attention calling device 1. The acquisition unit 11 receives various types of information, such as coordinate information and instruction information, transmitted from an external terminal, such as another terminal 2, via, for example, the communication network 5 and the I / F 105.

[0057] <Discrimination part 12> The discrimination unit 12 discriminates whether or not an attention-attracting object image 51 for attracting attention is included in the object image 50 acquired by the acquisition unit 11. The discrimination unit 12 refers to the "object data table" and the "attention-attracting object data table" shown in Fig. 4, and discriminates whether or not the object image 50 acquired by the acquisition unit 11 includes images of attention-attracting objects 4a to 4c, for example.

[0058] The discrimination unit 12 may discriminate whether or not the object image 50 includes attention-attracting objects 4a-4c that draw attention, based on, for example, the object image 50 acquired by the acquisition unit 11 and various setting information at the time of capturing the object image 50. The discrimination unit 12, for example, refers to a database of the server 3 and discriminates whether or not the acquired object image 50 includes images of the attention-attracting objects 4a-4c by AI discrimination processing using a known similar image comparison technique, a similar image search technique, artificial intelligence, machine learning, or the like.

[0059] The discrimination unit 12, for example, refers to a database of the server 3 and selects an image that is the same as or similar to an image of the attention-calling object included in the captured object image 50. As the first data, data that partially or completely matches the attention-calling object may be selected, or, for example, similar data may be selected. When each image is represented by numerical values ​​such as a matrix, a numerical range included in the selected first data may be set in advance.

[0060] For example, when discriminating an object image 50 of object 4 acquired by a worker "user ID=002", the discrimination unit 12 refers to the "user data table" in the database and discriminates that the object on which "user ID=002" is working (the object to be focused on) is "object ID=B001 (for example, object 4)".

[0061] Next, the discrimination unit 12 acquires, for example, an image of the object image 50 linked to "object ID=B001" (object image=B001), and through a process such as known image discrimination, discriminates the similarity, degree of agreement, etc. between the object image 50 and the "object image=B001" linked to "object ID=B001" using known image comparison techniques, etc.

[0062] Next, when the discrimination unit 12 discriminates that the object 4 is the object image "B001" based on the discrimination result of the object image 50 and "object image=B001" linked to "object ID=B001", it discriminates the presence or absence of an attention-attention object linked to the object image "B001" by referring to the data record of the "attention-attention object ID". If, for example, the object image "B001" is included in the object image "B001", the discrimination unit 12 determines that there is an attention-attention object linked to the object image "B001", and acquires "attention-attention object ID=BB01". Here, the attention-attention object corresponding to "attention-attention object ID=BB01" will be described below as the attention-attention object 4c shown in FIG. 2.

[0063] <Settings section 13> The setting unit 13 sets the coordinate information of the center of the attention-attention object (attention-attention object image) and the instruction information 6 to be displayed. The setting unit 13 refers to the "attention-attention object data table" shown in Fig. 4, for example, to identify the attention-attention object ID (e.g., "attention-attention object ID=BB01") included in the object image 50, and acquires an instruction ID (e.g., "instruction ID=11") to instruct the attention-attention object.

[0064] The instruction ID is, for example, an ID for identifying the content of an instruction given to the attention-attracting objects 4a to 4c to attract the attention of an operator. As information corresponding to the instruction ID, for example, various setting information such as what instruction information is to be emitted to the attention-attracting objects 4a to 4c is stored in the "instruction information data table".

[0065] The setting unit 13 refers to the "instruction information data table" shown in Fig. 4 based on the instruction ID. The setting unit 13 acquires instruction information corresponding to, for example, (e.g., "instruction ID = 11"), and sets it as information to be transmitted to the light projection unit 14. The setting unit 13 refers to the "attention-attention object data table" and acquires an image of "attention-attention object image = BB01 (attention-attention object 4c)" linked to "attention-attention object ID = BB01" and "coordinate information (center, space, difference) = ***, ***, ***".

[0066] The setting unit 13 compares the position information (coordinate information) included in the setting information of the object 4 acquired by the acquisition unit 11 together with the object image 50 with the "coordinate information (center, space, difference) = ***, ***, ***" of the attention-drawing object 4c, obtains coordinates adjusted so that the instruction information is located at the center of the attention-drawing object 4c, and stores these in the "coordinate information (center, space, difference) = ***, ***, ***" linked to "instruction ID = 11".

[0067] The setting unit 13 sets "display format = laser light," "display format = red, cross, solid line, direction B (360°), alert A, time, ...," and "coordinate information (center, space, difference) = ***, ***, ***" linked to "instruction ID = 11" as the coordinate information and instruction information to be emitted by the light emission unit 14.

[0068] The setting unit 13 sets various pieces of instruction information 6, for example, by referring to an "instruction information data table." The instruction information set by the setting unit 13 may be, for example, an image having information on at least one of a cross image, an X-shaped image, and a graphic image. The graphic image may be, for example, a circle, a rectangle, or an icon indicating a position. The instruction information set by the setting unit 13 may be, for example, information having a format related to at least one of the color related to the emitted light of the instruction information and the emitted light pattern.

[0069] The parameters of the irradiated light pattern may include, for example, a color, blinking as an irradiated light pattern, a roll rotation angle of the cross image, the X-shaped image, and the graphic image, as well as, for example, a roll rotation angle. The setting unit 13 may set, for example, a rotation speed of the roll angle as a parameter for the cross image, the X-shaped image, and the graphic image as a pattern. The setting unit 15 may set, for example, a parameter for displaying the cross image, the X-shaped image, and the graphic image in a fixed manner, as well as a parameter for rotating the cross image clockwise, counterclockwise, alternately rotating clockwise and counterclockwise, rotating quickly, rotating slowly, and the like.

[0070] The instruction information set by the setting unit 13 may be, for example, sound information related to at least one of a voice corresponding to the instruction information and an alert.

[0071] Furthermore, for example, when a plurality of attention-attracting object images 4a to 4c are included in the discrimination result of the discrimination unit 12, the setting unit 13 may set the coordinate information and the instruction information 6 with the highest priority based on the priority of the work associated with the plurality of attention-attracting object images 4a to 4c or the skill of the worker. Alternatively, the setting unit 13 may set the coordinate information and the instruction information 6 in sequence.

[0072] Since the object image 50 includes the attention-attracting object image 4c according to the determination result by the determination unit 12, the setting unit 13 may output the setting result, which sets the coordinate information of the center of the attention-attracting object image 4c and the instruction information based on the setting information, to the light-emitting unit, for example, via the I / F 106. The output may be such that the determination result is transmitted to the display unit 110, for example, via the I / F 107, and also that the determination result is transmitted to another terminal 2, for example, via the I / F 105.

[0073] <Light emitting part 14> The light projection unit 14 refers to the "indication information data table" and, based on the coordinate information and indication information set by the setting unit 13, projects the indication information onto the coordinate information using a light beam.

[0074] For example, when there are a plurality of pieces of coordinate information and instruction information set by the setting unit 13, the light emitting unit 14 may emit light to the workers in sequence. In this case, the setting unit 13 may display the pieces of coordinate information and instruction information in sequence based on the setting information related to the workers and the priority of the tasks performed by the workers.

[0075] <Memory unit 15, database> The storage unit 15 extracts, as necessary, various pieces of information such as a database stored in the storage unit 104. The storage unit 15 stores in the storage unit 104 various pieces of information acquired or generated by each of the components 11 to .

[0076] <Camera 1a (camera unit 112)> The camera unit 112 is, for example, a known camera that captures an image of the object 4 and generates image data. For example, a network camera, a Web camera, or the like is used as the camera unit 112, and a plurality of the camera units may be used remotely. The camera unit 112 may be, for example, built into the attention calling device 1, or may be separated from the attention calling device 1, or may be configured to be held by an operator.

[0077] <Light emitting port 1b (light emitting unit 113)> The light projection unit 113 acquires coordinate information for projecting the instruction information 6, and a display format, instruction format, etc. related to the light beam of the projected instruction information 6, and projects the light beam from the light projection port 1b of the attention drawing device 1 to the center of the object to be drawn to attention.

[0078] The light beam may be emitted using, for example, a known technology related to a laser marking device. For example, a plurality of light emission ports 1b may be used in the attention calling device 1. The light emission port 1b may be built into the attention calling device 1, or may be configured to be separated, for example.

[0079] <Communication Network 5> The communication network 5 is, for example, an Internet network to which the attention-attracting device 1 and the like are connected via a communication circuit. The communication network 5 may be configured as a so-called optical fiber communication network. The communication network 5 may be realized by a known communication network such as a wireless communication network in addition to a wired communication network.

[0080] <Other device 2> The other terminal 2 may be, for example, an electronic device embodied in the same manner as the attention-calling device 1. The other terminal 2 may, for example, be a central control device capable of communicating with a plurality of attention-calling devices 1. The other terminal 2 may, for example, be connectable to a plurality of attention-calling devices 1, and may acquire object images 50 captured by each of the attention-calling devices 1. This may enable, for example, determination as to whether or not an attention-calling object image 51 for calling attention is included in the object images 50 captured at a plurality of locations, and if the object images 50 include an attention-calling object image 51 as a result of the determination, the instruction information 6 may be set based on the setting information, and the worker may be alerted to the object or operation target, thereby improving the accuracy of the confirmation work.

[0081] <Server 3> The server 3 stores, for example, the various types of information described above. The server 3 accumulates, for example, various types of information transmitted via the communication network 5. The server 3 may store, for example, information similar to that stored in the storage unit 104, and transmit and receive various types of information to and from one or more attention calling devices 1 via the communication network 5. That is, the attention calling device 1 may use the server 3 instead of the storage unit 104.

[0082] (An example of the operation of the attention calling system 100) Next, a description will be given of an example of the operation of the attention calling system 100 in this embodiment. Fig. 5 is a flowchart showing an example of the operation of the attention calling system 100 in this embodiment.

[0083] <Acquisition means S110> 5, the acquisition unit 11 acquires an object image 50 of the object 4 and setting information related to capturing the object image 50 (acquisition means S110). The acquisition unit 11 acquires, for example, the object image 50 of the object and various setting information when the object image 50 is captured. The acquisition unit 11 stores the acquired object image 50 of the object 4 and various setting information in the storage unit 104 via the storage unit 15, for example.

[0084] <Discrimination means S120> Next, the discrimination unit 12 discriminates whether or not the image of the attention-attracting object 4a-4c is included (discrimination means S120). The discrimination unit 12 discriminates whether or not the image of the object 50 includes the attention-attracting object 4a-4c that issues a warning, based on the object image 50 acquired by the acquisition unit 11 and various setting information at the time of capturing the object image 50. The discrimination unit 12 may, for example, refer to a database and discriminate whether or not the acquired object image 50 includes the image of the attention-attracting object 4a-4c by image processing using, for example, a known similar image search, artificial intelligence, machine learning, or the like.

[0085] Further, the discrimination unit 12 generates a discrimination result by using format data such as an output format stored in the storage unit 104. The discrimination unit 12 may store the discrimination result in the storage unit 104 via the storage unit 15, for example.

[0086] <Setting Means S130> Next, the setting unit 13 sets the coordinate information of the center and the instruction information to be displayed (setting means S130). The setting unit 13 may output the determination result to the display unit 110 or the like. The setting unit 13 may output the determination result to another terminal 2 or the server 3 via the communication network 5, for example.

[0087] For example, when the object image 50 includes an image of an object requiring attention, the setting unit 13 sets coordinate information of the center of the image of the object requiring attention and instruction information 6 instructing an attention to be displayed in the coordinate information based on the setting information. The setting unit 13 refers to a database based on, for example, the discrimination result of the discrimination unit 12, acquires various corresponding coordinate information and instruction information 6, and generates setting information such that the instruction information 6 is displayed in the coordinate information of the center of the object requiring attention.

[0088] <Light emission means S140> The light emitting unit 14 emits a light beam to the center of the object to be monitored based on the coordinate information and instruction information 6 set by the setting unit 13 (light emitting means S140). The light emitting unit 14 is installed, for example, at location A as the attention calling target device 1, but for example, a plurality of light emitting units 14 (light emitting units 113) may be installed. In this case, for example, the setting unit 13 sets the coordinate information and instruction information 6 for each of the attention calling objects 4a to 4c, and light is emitted from each light emitting unit 14 (light emitting port 1b).

[0089] The light emitting unit 14 may emit the instruction information 6 set by the setting unit 13 to the attention drawing objects 4a-4c using, for example, a light emitting technique related to a known laser marking device or the like. For example, a plurality of light emitting ports 1b of the attention drawing device 1 may be used, and the light emitting ports 1b may be configured to be built into the attention drawing device 1 or to be separated, for example.

[0090] For example, when there are a plurality of pieces of coordinate information and instruction information set by the setting unit 13, the light emitting unit 14 may emit light to the workers in sequence. In this case, the setting unit 13 may display the pieces of coordinate information and instruction information in sequence based on the setting information related to the workers and the priority of the tasks performed by the workers.

[0091] This ends the operation of the attention calling system 100 in this embodiment.

[0092] According to this embodiment, the acquisition unit 11 acquires the object image 50 of the object and various setting information related to the capture of the object image 50. The installation information may include various information related to the worker and authentication information for identifying the worker, etc., acquired at the location A, and may also include various information linked to the user ID of the worker by referring to a "user data table" or the like, and be acquired by including it in the setting information. Therefore, it is possible to confirm that there is a device or operation location that the worker should work on among multiple objects. This makes it possible to call the worker's attention to the object or operation target, and improve the accuracy of the confirmation work.

[0093] Furthermore, according to this embodiment, the user information includes various information for evaluating the worker's attention, such as information on the department, information on the job, information on the role, skills (expert to beginner, etc.), and employment history. Therefore, it is possible to give instructions suited to the worker's job and work response, etc. This makes it possible to call the worker's attention to the object or operation target, thereby improving the accuracy of the confirmation work.

[0094] Moreover, according to this embodiment, the setting information includes instruction information. The instruction information includes the size and brightness of place A, the number of devices to be installed, and the like. Therefore, it is possible to give instructions adapted to the space of the place, the devices (objects) installed in the space, the work and work responses of the worker, and the like. This makes it possible to call the worker's attention to the objects and the objects to be operated, thereby improving the accuracy of the confirmation work.

[0095] Furthermore, according to this embodiment, the display format includes a pattern. The pattern may be, for example, an animation, a text, a message, or the like. This makes it possible to convey instructions or actions to the space (such as a wall) of place A by using a message. This makes it possible to convey actions regarding objects or objects to be operated to the worker. This makes it possible to call the worker's attention to the object or object to be operated, and improve the accuracy of the confirmation work.

[0096] Although the embodiment of the present invention has been described, this embodiment is presented as an example and is not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope and spirit of the invention, and are included in the scope of the invention and its equivalents described in the claims. [Explanation of symbols]

[0097] 1: Alert device 1a: Camera 1b: Light aperture 2: Terminal 3: Server 4: Object 4a: Object 4b: Object 4c: Monitor 5: Communication network 6 :Instruction information 10: Housing 11: Acquisition part 12:Discrimination part 13: Setting section 14: Light emitting part 15: Storage section 50: Object image 51: Image of object to be warned 100: Warning system 101: CPU 102: ROM 103: RAM 104: Preservation Department 105: Interface 106: Interface 107: Interface 108: Interface 109: Interface 110: Display section 111: Input section 112: Camera unit 113: Light-emitting unit A: Location S110: Acquisition means S120: Discrimination means S130: Setting means S140: Light emitting means

Claims

1. An attention calling system for calling an operator's attention to an object, An acquisition means for acquiring an object image of the object and setting information related to capturing the object image; A determination means for determining whether or not the acquired object image includes an attention-attracting object image for attracting attention; a setting means for setting, based on the setting information, coordinate information of a center of the attention-attracting object image and instruction information for instructing an attention-attracting object to be displayed at the coordinate information, when the determination result of the determination means indicates that the attention-attracting object image is included in the object image; a light projection means for projecting the instruction information onto the coordinate information by a light beam based on the coordinate information and the instruction information set by the setting means; To be prepared The alert system is characterized by:

2. The instruction information set by the setting means is an image having information regarding at least one of a cross image, an X-shaped image, and a graphic image.

2. The attention calling system according to claim 1,

3. The instruction information set by the setting means has a format related to at least one of a color of the irradiated light and an irradiated light pattern of the instruction information.

3. The attention calling system according to claim 1 or 2,

4. The instruction information set by the setting means has sound information related to at least one of a voice corresponding to the instruction information and an alert.

2. The attention calling system according to claim 1,

5. When a plurality of attention-attracting object images are included in the discrimination result of the discrimination means, the setting means sets the coordinate information and the instruction information with the highest priority, or the coordinate information and the instruction information in sequence, based on at least one of the priorities of tasks associated with the plurality of attention-attracting object images or the skills of the worker.

2. The attention calling system according to claim 1,

6. An attention drawing device for drawing the attention of an operator to an object, an acquisition unit that acquires an object image of the object and setting information related to capturing the object image; a discrimination unit that discriminates whether or not the acquired object image includes an attention-attracting object image that draws attention; a setting unit that sets coordinate information of a center of the attention-attracting object image and the instruction information to be displayed on the coordinate information based on the setting information when the object image includes the attention-attracting object image as a result of the determination by the determination unit; a light projection unit that acquires the coordinate information and the instruction information set by the setting unit and projects the instruction information onto the coordinate information by a light beam; To be prepared An attention-calling device characterized by the above.

Images