INFORMATION PROCESSING DEVICE, INFORMATION PROCESSING METHOD AND INFORMATION PROCESSING PROGRAM

Abstract

Information processing device (10), comprising: a work target detection unit (20) for detecting an attention device group consisting of at least one device to which a working user pays attention; a confusion factor estimation unit (30) for setting each device, except for a work target device included in the attention device group, as a target attention device, the work target device being a device corresponding to a work that the user needs to perform, and for calculating a relationship score indicating a relationship between the target attention device and the work target device and indicating a degree of confusion of the user in choosing between the target attention device and the work target device; and a presentation information control unit (40) for referring to a presentation information database (93) that records presentation information to acquire presentation information based on the calculated relationship status, the presentation information being information to be presented to the user to help the user become aware of the work target device.

Description

Technical FieldThe present disclosure relates to an information processing apparatus, an information processing method, and an information processing program.Prior ArtThere is a technology that measures a line of sight of a user to detect an area that the user is looking at and presents information associated with the detected area to the user. Patent Literature 1 discloses a technology that provides a user with an appropriate guidance video in an automated teller machine (ATM) or the like by displaying a guidance video associated with an image that the user is looking at. Patent Literature 2 discloses an information processing apparatus that estimates, by means of an estimation unit, whether and when a user is confused about a certain operation and then assists the user in performing his task. Patent Literature 3 describes a support unit that detects whether a user needs support in executing an operation target and then supports it. The unit is designed to correctly support the user even in an environment having a large number of operation targets.Reference listPatent LiteraturePatent Literature 1: JP 2018-055320 APatent Literature 2: JP 2006-209 259 APatent Literature 3: JP 2008-257 363 ASummary of the InventionTechnical ProblemIn order to support workers at workstations or in work acquisition using virtual spaces or the like, there is a need for a technology for appropriately presenting information to a user who is a worker depending on confusion of the user in selection of a facility. Normally, there are many types of work and many types of work target devices that are incorporated into this technology. A problem is therefore that realization of this technology based on the technology disclosed in Patent Literature 1 is impractical because the association cost would be enormous.An object of the present disclosure is to appropriately present information to a user depending on confusion of the user in selection of a facility for assisting the worker at a work place, in work acquisition using a virtual space or the like, and so on by determining information presented to the user on the basis of a relationship between an attention facility group to which the working user pays attention and a work target facility. The work target device is a device corresponding to the work to be performed by the user.Solution of the ProblemAn information processing apparatus according to the present disclosure includes a work target acquisition unit for acquiring an attention device group consisting of at least one device that a working user pays attention; a confusion factor estimation unit for setting each device other than a work target device included in the attention device group as a target attention device, the work target device being a device corresponding to a work that the user needs to perform, and for calculating a relationship state indicating a relationship between the target attention device and the work target device and indicating a degree of confusion of the user in selection between the target attention device and the work target device; and a presentation information control unit for referring to a presentation information database that records presentation information to acquire presentation information based on the calculated relationship state, wherein the presentation information is information to be presented to the user to help the user become aware of the work target device.Advantageous Effects of the InventionAccording to the present disclosure, a confusion factor estimation unit calculates a relationship level based on an attention device group and a work target device, and a presentation information control unit acquires presentation information based on the relationship level. The relationship level is synonymous with a value indicating a relationship. Therefore, according to the present disclosure, information can be appropriately presented to a user depending on confusion of the user in selection of a facility for assisting the worker in the work place, in work acquisition using a virtual space, etc., by determining the information to be presented to the user on the basis of a value indicating a relationship between the attention facility group to which the working user pays attention and the work target facility.Brief Description of the DrawingsFIG. 1 is a diagram showing an example of a configuration of an information processing apparatus 10 according to Embodiment 1; FIG. 2 is a diagram describing data stored in a process DB 91 according to Embodiment 1; FIG. 3 is a diagram describing data stored in a device DB 92 according to Embodiment 1; FIG. 4 is a diagram describing data stored in a presentation information DB 93 according to Embodiment 1; FIG. 5 is a diagram showing an example of a hardware configuration of the information processing apparatus 10 according to Embodiment 1; FIG. 6 is a diagram showing a break-away of an operation of the information processing apparatus 10 according to Embodiment 1; FIG. 7 is a diagram showing a concrete example of a work plan according to Embodiment 1; FIG. 8 is a diagram describing a method for calculating a relationship score; FIG. 9 is a diagram describing a method for calculating a relationship score; FIG. 10 is a flowchart showing an operation of the information processing apparatus 10 according to Embodiment 1; FIG. 11 is a diagram illustrating an example of the hardware configuration of the information processing apparatus 10 according to a variation of Embodiment 1; FIG. 12 is a diagram showing an example of the configuration of the information processing apparatus 10 according to Embodiment 2; FIG. 13 is a diagram showing an example of the configuration of the information processing apparatus 10 according to Embodiment 3; FIG. 14 is a diagram showing an example of the configuration of the information processing apparatus 10 according to Embodiment 4; FIG. 15 is a diagram describing relationship weights according to Embodiment 4; FIG. 16 is a diagram describing data stored in a relationship weighting DB 94 according to Embodiment 4; FIG. 17 is a diagram showing an example of the configuration of the information processing apparatus 10 according to Embodiment 5; FIG. 18 is a flowchart illustrating an operation of the information processing apparatus 10 according to Embodiment 5; FIG. 19 is a diagram describing how a relationship weight updating unit 70 according to Embodiment 5 updates relationship weights, where (a) is table data indicating uniform weights and (b) is table data indicating weights depending on types of devices; and FIG. 20 is a flowchart showing the operation of the information processing apparatus 10 according to Embodiment 6.DESCRIPTION OF EMBODIMENTSIn the description and drawings of the embodiments, the same and corresponding elements are denoted by the same reference numerals. The description of elements denoted by the same reference sign will be omitted or simplified as appropriate. Arrows in representations indicate primarily data or processing flows. "Unit" may be interpreted as "circuit", "step", "operation", "sequence", or "circuit", as appropriate.Embodiment 1.This embodiment will be described below with reference to the drawings.*** Description of configuration ***FIG. 1 shows an example of a configuration of an information processing apparatus 10 according to this embodiment. As illustrated in FIG. 1, the information processing apparatus 10 includes a work target acquisition unit 20, a confusion factor estimation unit 30, a presentation information control unit 40, a work step DB 91, a facility DB 92, and a presentation information DB 93. DB is an abbreviation for database.The work target acquisition unit 20 acquires an attention device group and acquires information indicating a work target device. The attention device group is composed of at least one device that a working user pays attention. The work target device is a device corresponding to the work to be performed by the user. The work target device is determined according to a work plan or the like. The work target device may be composed of two or more devices. However, there may be a case where the attention device group does not include the work target device. The work target acquisition unit 20 acquires the attention device group on the basis of an area that the user is looking at. This range is calculated based on data indicating user's lines of sight measured by a line-of-sight sensor 3. The work target acquisition unit 20 may acquire the work plan of the user from an external source, or may acquire user information and select the work plan corresponding to the acquired user information from the work plans stored in the information processing device 10. The user information is information indicating an identifier or the like of the user.The confusion factor estimation unit 30 sets each device other than the work target device included in the attention device group as a target attention device, and estimates a confusion factor for calculating a relationship state that is a state indicating a relationship between the target attention device and the work target device, and indicates a confusion degree of the user in selection between the target attention device and the work target device. The confusion factor estimating unit 30 may calculate the relationship level based on the content of the work to be performed by the user. The confusion factor estimating unit 30 calculates the relationship level for each confusion factor. The confusion factor is a factor that causes confusion for the user in selecting between the target attention device and the work target device.The presentation information control unit 40 acquires presentation information based on the relationship state calculated by the confusion factor estimation unit 30. The presentation information is information that is presented to the user and helps the user know the work target device.The operation DB 91 records data indicating operations, the content of the work to be performed on the target device, and so on. FIG. 2 is a figure describing data stored in a process step DB 91. As a specific example, the operation DB 91 stores data indicating a step ID, a step name, the content, a work target device ID, and a work ID. ID is an abbreviation for identification.The step ID indicates an identifier identifying each operation.The step name indicates a name given to each operation.The content indicates a specific procedure to be performed for each operation.The work target device ID indicates an identifier of the device to be processed in each operation.The work ID indicates an identifier identifying each work field.The device DB 92 records data indicating the positional relationships of devices, device type names, and so on. The positional relationships of the facilities are specified by, for example, a three-dimensional computer-aided design model (3D CAD) or by layout data. FIG. 3 is a figure describing data stored in a device DB 92. In the facility DB 92, for example, data indicating a facility ID, a facility type, a model name, and installation coordinates are stored. The confusion factor estimation unit 30 may refer to the facility DB 92 to search for facilities, calculate a distance between the facilities based on the installation coordinates of the facilities, and calculate a relationship level using the calculated distance.The device ID indicates an identifier identifying each device.The device type indicates a type of the respective device.The model name indicates a model name of each device.The installation coordinates indicate coordinates at which each device is installed.The data stored in the device DB 92 may be 3D arrangement data or the like instead of table data. By calculating the inter-device distance using coordinate information of the devices included in arrangement data, substantially the same effect as when calculating the inter-device distance using table data can be obtained.FIG. 4 is a figure describing data stored in a presentation information DB 93. The presentation information DB 93 records presentation information and stores, for example, data indicating a presentation information ID, a device ID, a type of presentation information, and a presentation information file name. Recording presentation information includes recording information that references presentation information, such as a file name.The presentation information ID denotes an identifier that identifies the information to be presented to the user.The device ID indicates an identifier that identifies a device corresponding to the information to be presented to the user.The type of the presentation information indicates a type of the information to be presented to the user.The presentation information file name indicates a name of a file that identifies a device corresponding to the information to be presented to the user.The presentation information control unit 40 searches the presentation information DB 93 for the information to be presented to the user using the highest relational state as a guide. When the presentation information DB 93 includes table data as indicated in FIG. 4, the presentation information control unit 40 searches the table data and acquires a file indicated by the search result. It is assumed that table data or the like indicating each relationship between a relationship type corresponding to a relationship state and a type of presentation information has been prepared in advance.The information processing apparatus 10 is connected to the line-of-sight sensor 3 and a display 5. The information processing device 10 may acquire data measured by the line-of-sight sensor 3 without being connected to the line-of-sight sensor 3.The line-of-sight sensor 3 is a sensor that measures a line-of-sight of the user. The line-of-sight sensor 3 may be a camera or an infrared sensor installed in a working environment, or may be mounted on a device worn by the user. The portable device is, for example, a head-mounted display (HMD).The display device 5 is a device that displays images, such as a liquid crystal display (LCD).FIG. 5 shows an example of a hardware configuration of the information processing apparatus 10 according to this embodiment. The information processing apparatus 10 is constituted by a computer. The information processing apparatus 10 may be composed of a plurality of computers.As illustrated in FIG. 5, the information processing apparatus 10 is a computer including hardware such as a processor 11, a work memory 12, an auxiliary storage device 13, an input / output interface (IF) 14, and a communication device 15. These hardware components are connected to each other by a signal line 19.The processor 11 is an integrated circuit (IC) that performs operational processing and controls the hardware included in the computer. As a concrete example, the processor 11 is a central processing unit (CPU), a digital signal processor (DSP), or a graphics processing unit (GPU).The information processing apparatus 10 may include a plurality of processors as an alternative to the processor 11. The plurality of processors share the role of the processor 11.The working memory 12 is typically a volatile storage device. The working memory 12 is also referred to as a main storage device or a main storage. The working memory 12 is, for example, a RAM (random access memory). Data stored in the working memory 12 is saved in the auxiliary storage device 13 as needed.The auxiliary storage device 13 is typically a nonvolatile storage device. The auxiliary storage device 13 is, for example, a read only memory (ROM), a hard disk drive (HDD), or a flash memory. Data stored in the auxiliary storage device 13 is loaded into the working memory 12 as needed.The working memory 12 and the auxiliary storage device 13 may be configured as one unit.The input / output IF 14 is a port to which an input device and an output device are connected. The input / output IF 14 is, for example, a USB port. As a concrete example, the input device is a keyboard and a mouse. As a concrete example, the output means is a display.The communication device 15 is a receiver and a transmitter. The communication device 15 is, for example, a communication chip or a network interface card (NIC).Each unit of the information processing apparatus 10 may use the input / output IF 14 and the communication device 15 for communication with other devices, etc., as needed.The auxiliary storage device 13 stores an information processing program. The information processing program is a program that causes a computer to realize the functions of each unit included in the information processing apparatus 10. The information processing program is loaded into the work memory 12 and executed by the processor 11. The functions of each unit of the information processing apparatus 10 are realized by software.Data used in the execution of the information processing program, data obtained by the execution of the information processing program, etc. are suitably stored in a storage device. Each unit of the information processing apparatus 10 suitably uses the storage means. As a concrete example, the storage device is composed of at least one of the working memory 12, the auxiliary storage device 13, a register in the processor 11, and a cache memory in the processor 11. data and information may have substantially the same meaning. The storage device may be independent of the computer.The functions of the working memory 12 and the auxiliary storage device 13 may be realized by other storage devices.The information processing program may be recorded on a computer readable non-transitory recording medium. The nonvolatile recording medium is, as a specific example, an optical disk or a flash memory. The information processing program can be provided as a program product.*** Description of Operation**A flow of operation of the information processing apparatus 10 corresponds to an information processing method. A program that realizes the operation of the information processing apparatus 10 is equivalent to the information processing program.FIG. 6 is a diagram describing a break of the operation of the information processing apparatus 10. The flow of the operation of the information processing apparatus 10 will be described with reference to FIG. 6.First, the work target acquisition unit 20 extracts each target device located in a line-of-sight distribution of the user at a certain period of time. The work target acquisition unit 20 acquires information indicating the work target facility by referring to the work plan of the day, information indicating the facility that was last operated, or the like. Here, it is assumed that the work target device is a device D 2, but the user is confused as to whether to select a device D 1 or the device D 2 as the work target device.Next, the confusion factor estimation unit 30 examines a relationship between the device D 1 and the device D 2. At this time, the confusion factor estimation unit 30 may refer to the operation DB 91 and evaluate the proximity in the sequence of steps or the similarity in step content between the step related to the device D 1 and the step related to the device D 2. Alternatively, the confusion factor estimation unit 30 may refer to design data, CAD data, or the like indicated in the device DB 92, and evaluate the similarity of the type between the device D 1 and the device D 2, the proximity of the physical distance between the device D 1 and the device D 2, and so on.Next, the confusion factor estimating unit 30 evaluates the proximity with respect to each relationship examined.Next, the presentation information control unit 40 determines presentation information based on the results of evaluation by the confusion factor estimation unit 30. at this time, for example, rules regarding correspondences between relationship types and types of presentation information are set in advance, and the presentation information control unit 40 determines the presentation information according to the set rules.FIG. 7 shows a concrete example of the work plan. In the concrete example, the work schedule is information including a date, a start time, an end time, a work ID, and a staff ID.The date indicates a date on which the user performs the work.The start time indicates a time at which the user starts working.The end time indicates a time at which the user ends the work.The work ID indicates an identifier identifying the work.The personal ID indicates an identifier that identifies the user who is responsible for the work.FIG. 8 is a diagram describing a method for calculating a relationship level. As a concrete example, the confusion factor estimating unit 30 calculates a relationship level with reference to the work plan and the work step DB 91.In FIG. 8, it is assumed that the step ID indicating a real operation, i.e., the operation that the user needs to perform next is STEP001-0002, and the user also notes a device P 0005 in addition to a device P 0008. In this case, the confusion factor estimation unit 30 evaluates a relationship between the real operation and each operation related to the facility P 0005. At this time, the confusion factor estimation unit 30 may calculate a relationship score based on <Nähe in the sequence of steps> using step IDs as indicators, or may calculate a relationship score based on <Ähnlichkeit in the step content>.The following describes <negth in the step sequence> and <digence in the step content> which are types of relationships.<Nähe in Sequence of Steps>When the value of a relationship level with respect to <Nähe in the step sequence> is large, it is considered that the user is confused because the steps in the step sequence are close to each other.A concrete example of a method for calculating a relationship level with respect to <Nähe in the step sequence> will be described.First, the confusion factor estimating unit 30 uses the name or the like of each device included in the device group A as a key, and searches the work plan for a work that targets the device corresponding to each key.Next, the confusion factor estimating unit 30 examines the proximity between the consecutive number of each fetched operation and the consecutive number of the real operation and calculates a relationship level so that the closer the consecutive numbers are to each other, the higher the value of the relationship level.When the operation DB 91 is a graphic database, the distance between the nodes corresponding to the operations may be used for calculating the proximity between the operations. In this case, the attribute information of an edge is synonymous with a type of relationship such as <proximate of the step sequence>.< Of Step Content>When the value of a relationship level with respect to <Ähnlichkeit in the step content> is large, it is considered that the user is confused due to the similarity in the content of the work.A concrete example of a method for calculating a relationship level with respect to <Ähnlichkeit of the step content> will be described.First, the confusion factor estimating unit 30 uses the name or the like of each device included in the device group A as a key, and searches the work plan for a work that targets the device corresponding to each key.Next, the confusion factor estimating unit 30 compares the text of the retrieved operation with the text of the real operation, and calculates a relationship level based on the comparison result. At this time, for example, the confusion factor estimation unit 30 uses a method that compares distances between words by converting words into vectors such as Word2Ve.FIG. 9 is a diagram describing a method for calculating a relationship level. As a concrete example, the confusion factor estimating unit 30 calculates a relationship level with reference to the work plan and the facility DB 92.In FIG. 9, it is assumed that the step ID indicating the real operation is STEP001-0002, and the user also notes the device P0005 in addition to the device P0008. In this case, the confusion factor estimation unit 30 may calculate a relationship score based on <Nähe in physical distance> or may calculate a relationship score based on <Ähnlichkeit of characteristics>.Hereinafter, the <Nähe in physical distance> and <Ähnlichkeit of characteristics> which are types of relationships will be described.<Nähe in Physical Distance>A concrete example of a method for calculating a relationship level with respect to <Nähe in physical distance> will be described.The confusion factor estimation unit 30 calculates the distance between the examined facilities with reference to data representing position information of the facilities, such as 3D CAD data or Building Information Modeling (BIM), and calculates a relationship level so that the smaller the distance, the higher the value of the relationship level.< Of Properties>A concrete example of a method for calculating a relationship level with respect to <Ähnlichkeit of Characteristics> will be described. The characteristics of a device are, for example, a shape of the device, a model number of the device, a combination thereof, or the like.The confusion factor estimation unit 30 calculates similarity of characteristics or the like between facilities by referring to information indicating features in a 3D model, BIM data or the like, or indicating a parts table or the like. The features are, for example, a name of the device model and a device type. The device type is, as a concrete example, a bolt or a brake. The confusion factor estimating unit 30 calculates a relationship level so that the value of the relationship level is high when the types between devices match or when the model names between devices match, for example. In calculating similarity of characteristics, the confusion factor estimation unit 30 may calculate similarity between words using a method such as Word2Ve.FIG. 10 is a flowchart showing an example of the operation of the information processing apparatus 10. Referring to FIG. 10, the operation of the information processing apparatus 10 will be described.(Step S 101)The work target acquisition unit 20 acquires the facility group A that the user pays attention based on the data measured by the line-of-sight sensor 3. The facility group A corresponds to the attention facility group. A method of acquiring the facility group A is, as a specific example, a method in which a line-of-sight distribution of the user is created using line-of-sight images of the user and information on the viewpoint position of the user acquired in a certain period of time, and each facility included in the created line-of-sight distribution is acquired as the facility group A. As a concrete example, the gaze position of the user is acquired by capturing an image of the position of the iris of the user with a camera or by detection with an infrared sensor or the like.(Step S 102)The work target acquisition unit 20 refers to the work plan and acquires information indicating the real work content that the user needs to perform and the work target device B.The information indicating the real work content and the work target device B is acquired by referring to the work plan for the day, the work completion information input by the user, or the like. The work target acquisition unit 20 may estimate the work content and the work target device B on the basis of movement data of the user.(Step S 103)The confusion factor estimating unit 30 determines whether the device group A is composed of only the work target device B.When the facility group A is composed of only the work target facility B, it is considered that the user is not confused, so that the information processing apparatus 10 ends the processing of this flowchart. In other cases, the information processing apparatus 10 proceeds to step S 104.In step S 104 and the following steps, the confusion factor estimation unit 30 examines a relationship to each device included in the device group A when the work target device B is included in the device group A, and examines a relationship between each device included in the device group A and the work target device B in other cases.(Step S 104)The confusion factor estimation unit 30 refers to the operation DB 91 and the facility DB 92, and examines the relationship between each facility except the work target facility B included in the facility group A and the work target facility B. At this time, the confusion factor estimation unit 30 calculates a relationship level.(Step S 105)The presentation information control unit 40 extracts a relationship score C that is closest by referring to each relationship score calculated by the confusion factor estimation unit 30.In the example illustrated in FIG. 6, the relationship level corresponding to <Ähnlichkeit of Characteristics> is the highest. Therefore, the presentation information control unit 40 extracts <Ähnlichkeit of Properties> as the relationship C.(Step S 106)The presentation information control unit 40 selects one type of presentation information on the basis of the device group A, the work target device B, and the relationship C, and acquires presentation information D corresponding to the selected type of presentation information by referring to the presentation information DB 93. At this time, the presentation information control unit 40 refers to information indicating correspondences between relationship types and types of presentation information.In the example indicated in FIG. 6, the type of presentation information corresponding to <Ähnlichkeit of properties> is the "model name information+ Zeichnung". Therefore, the presentation information control unit 40 acquires data indicating the model name information and the drawing of the work target device as the presentation information D.(Step S 107)The presentation information control unit 40 displays the presentation information D acquired in step S 106 on the display device 5.*** Description of Effects of Embodiment 1 ***As described above, according to this embodiment, each device that the user pays attention is extracted, and a relationship type and relationship proximity between each extracted device and the work target device are calculated with reference to work steps, device information, or the like, and then information is presented to the user depending on the calculated result. Therefore, according to this embodiment, appropriate information can be presented to the user confused in the selection between the work target device and another device without performing a great deal of association work.*** Other Configurations ***<Variante 1>FIG. 11 shows an example of a hardware configuration of the information processing apparatus 10 according to this variation.The information processing apparatus 10 includes a processing circuit 18 instead of the processor 11, instead of the processor 11 and the working memory 12, instead of the processor 11 and the auxiliary storage device 13, or instead of the processor 11, the working memory 12 and the auxiliary storage device 13.The processing circuit 18 is hardware that realizes at least a part of the units included in the information processing apparatus 10.The processing circuit 18 may be dedicated hardware or may be a processor that executes programs stored in the memory 12.When the processing circuit 18 is dedicated hardware, a specific example of the processing circuit 18 is a single circuit, a composite circuit, a programmed processor, a parallel-programmed processor, an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), or a combination thereof.The information processing apparatus 10 may include a plurality of processing circuits, as an alternative to the processing circuit 18. The plurality of processing circuits share the role of the processing circuit 18.In the information processing apparatus 10, some functions may be realized by dedicated hardware, and the remaining functions may be realized by software or firmware.In a specific example, the processing circuit 18 is implemented by hardware, software, firmware, or a combination thereof.The processor 11, the working memory 12, the auxiliary storage device 13, and the processing circuit 18 are collectively referred to as "processing circuit". That is, the functions of the functional constituent elements of the information processing apparatus 10 are realized by the processing circuit.The information processing apparatus 10 according to other embodiments may also be configured in the same manner as this variant.Embodiment 2.Differences from the above-described embodiments will be described below mainly with reference to the drawings.*** Description of configuration ***FIG. 12 shows an example of the configuration of the information processing apparatus 10 according to this embodiment. The information processing apparatus 10 is connected to a finger joint sensor 4. The information processing device 10 can acquire data measured by the finger joint sensor 4 without being connected to the finger joint sensor 4.The information processing apparatus 10 according to this embodiment is different from the information processing apparatus 10 according to Embodiment 1 mainly in that the work target acquisition unit 20 recognizes the attention device group on the basis of the positions of the user's finger joints.*** Description of Operation**The operation of the information processing apparatus 10 according to this embodiment, which is different from the operation of the information processing apparatus 10 according to Embodiment 1, will be mainly described below.(Step S 101)This step is substantially the same as step S 101 according to Embodiment 1. however, the work target acquisition unit 20 uses the data measured by the finger joint sensor 4 instead of the data measured by the line-of-sight sensor 3.*** Description of Effects of Embodiment 2 ***As described above, according to this embodiment, by using a sensor that acquires the positions of the finger joints instead of a sensor that acquires the observed positions, substantially the same effects as the effects according to Embodiment 1 can be obtained.*** Other Configurations ***<Variante 2>In step S 101, the work target acquisition unit 20 may use both of the data measured by the line-of-sight sensor 3 and the data measured by the finger joint sensor 4.Embodiment 3.Differences from the above-described embodiments will be described below mainly with reference to the drawings.*** Description of configuration ***FIG. 13 shows an example of the configuration of the information processing apparatus 10 according to this embodiment. The information processing apparatus 10 is connected to both the line-of-sight sensor 3 and the finger joint sensor 4.The information processing apparatus 10 according to this embodiment is different from the information processing apparatus 10 according to Embodiment 1 mainly in that the work target acquisition unit 20 acquires the attention device group on the basis of both the area that the user is looking at and the positions of the user's finger joints.*** Description of Operation**The operation of the information processing apparatus 10 according to this embodiment, which is different from the operation of the information processing apparatus 10 according to Embodiment 1, will be mainly described below.(Step S 101)This step is substantially the same as step S 101 according to Embodiment 1. however, the work target acquisition unit 20 acquires the facility group A that the user pays attention on the basis of the data measured by the line-of-sight sensor 3 and the data measured by the finger joint sensor 4.(Step S 102)This step is substantially the same as step S 102 according to Embodiment 1. however, when the device group A includes a plurality of devices including the work target device B, and the user's fingers remain in the vicinity of the work target device B, the work target acquisition unit 20 determines that the user is not confused, and excludes any device other than the work target device B included in the device group A from the device group A.*** Description of Effects of Embodiment 3 ***If only data indicating the line of sight of the user is used, it may be erroneously detected that "the user is confused" even if the user is not actually confused. By using both the line of sight and the positions of the user's finger joints, false detection can be avoided. As a result, according to this embodiment, more suitable information can be presented to the user.Embodiment 4.Differences from the above-described embodiments will be described below mainly with reference to the drawings.*** Description of configuration ***FIG. 14 shows an example of the configuration of the information processing apparatus 10 according to this embodiment.The information processing apparatus 10 according to this embodiment includes a user information acquisition unit 50, a relationship weight acquisition unit 60, and a relationship weight DB 94 in addition to the constituent elements included in the information processing apparatus 10 according to Embodiment 1. The information processing apparatus 10 is connected to a sensor 2 and an input device 7.The user information acquisition unit 50 acquires user information.The relationship weight acquisition unit 60 acquires relationship weights from the relationship weight DB 94 as appropriate. The value of a weighting parameter is set for each combination of devices. The value of a weight parameter may be set based on attributes of the user. The attributes of the user are, for example, an employment duration of the user and an error history of the work of the user.When there are a plurality of types of relationships between two devices, the weighting parameter corresponding to the combination of the two devices may be prepared for each type of relationship of the plurality of types of relationships. FIG. 15 is a diagram describing relationship weights when there are a plurality of types of relationships between two devices. FIG. 15 indicates weighting parameters corresponding to the combination of the device D 1 and the device D 2 and concerning various types of relationships. W D1D2-a indicates a weighting parameter related to a physical distance, W D1D2-b indicates a weighting parameter related to a proximity in the sequence of operations, and W D1D2-c indicates a weighting parameter related to a proximity of the characteristics. As a concrete example, it is assumed that in calculating a relationship between the device D 1 which is the work target device and the device D 2 which is not the work target device, the weighting parameter corresponding to the device D 1 and the device D 2 and concerning the proximity in the sequence of the work steps is 0.8. In this case, the value of the relationship level corresponding to the device D1 and the device D2 and concerning the proximity in the sequence of the working steps is 0.8 times the value of the relationship level for the combination of the device D1 and the device D2 and concerning the proximity in the sequence of the working steps calculated without using the relationship weighting.The confusion factor estimating unit 30 calculates the relationship level using the relationship weight.The sensor 2 is a collective term for the line-of-sight sensor 3 and the finger joint sensor 4.The input device 7 is an input device such as a keyboard.The relationship weighting DB 94 is a database that records relationship weights.FIG. 16 is a diagram describing the relationship weighting DB 94. In FIG. 16, each row indicates the work target device, and each column indicates a device to which the user draws attention among the devices different from the work target device. As a specific example, the data indicated in FIG. 16 is edited for each user. For each type of relationship, data may be prepared as indicated in FIG. 16.*** Description of Operation**The operation of the information processing apparatus 10 according to this embodiment, which is different from the operation of the information processing apparatus 10 according to Embodiment 1, will be mainly described below.(Step S 104)This step is substantially the same as step S 104 according to Embodiment 1. however, in the calculation of a relationship score, the confusion factor estimation unit 30 refers to the relationship weight DB 94 and uses the relationship weight corresponding to the relationship score to be calculated. At this time, the confusion factor estimation unit 30 acquires user information from the input device 7, and the user acquires the weight parameter associated with the acquired user information from the relationship weight DB 94.*** Description of Effects of Embodiment 4 ***As described above, according to this embodiment, more appropriate information can be presented to the user by estimating a confusion factor using the relationship weight appropriate for the characteristics of each user.Embodiment 5.Differences from the above-described embodiments will be described below mainly with reference to the drawings.*** Description of configuration ***FIG. 17 shows an example of the configuration of the information processing apparatus 10 according to this embodiment.The information processing apparatus 10 according to this embodiment includes a relationship weight updating unit 70 in addition to the constituent elements included in the information processing apparatus 10 according to Embodiment 4.The relationship weight updating unit 70 updates the relationship weights recorded in the relationship weight DB 94 on the basis of whether the confusion factor corresponding to the presentation information acquired from the presentation information control unit 40 is correct or incorrect.*** Description of Operation**FIG. 18 is a flowchart illustrating an example of the operation of the information processing apparatus 10 according to this embodiment. Referring to FIG. 18, the operation of the information processing apparatus 10 will be described. Step S 101 to step S 106 are as described above.(Step S 507)The presentation information control unit 40 displays, on the display 5, the presentation information D acquired in step S 106 and information indicating the confusion factor corresponding to the relationship C extracted in step S 105.(Step S508)The user determines whether the confusion factor displayed on the display device 5 is correct or incorrect, and inputs the determined result to the input device 7.The relationship weight updating unit 70 receives information indicating the result of the determination as to whether the confusion factor displayed on the display device 5 is correct or incorrect, and updates the relationship weight recorded in the relationship weight DB 94 on the basis of the received information. As a specific example, a case where the confusion factor estimation unit 30 has estimated that the user is confused about the relationship concerning <Ähnlichkeit of Characteristics> with respect to the device D 1 and the device D 2, which is a false result, is considered. In this case, the relationship weight updating unit 70 updates the value of the weight parameter with respect to the device D 1 and the device D 2 associated with this relationship, so that the value of the relationship level with respect to the device D 1 and the device D 2 corresponding to this relationship becomes smaller. In this example, the value of W D1D2-c indicated in FIG. 15 is updated to a smaller value.FIG. 19 is a diagram describing how the relationship weight updating unit 70 updates the relationship weights. As a concrete example, the relationship weights are set as indicated in (a) in the initial stage. Then, when the relationship weights update unit 70 updates the relationship weights, the relationship weights are indicated as in (b).*** Description of Effects of Embodiment 5 ***As described above, the relationship weight updating unit 70 according to this embodiment updates the relationship weights so that more appropriate information can be presented to the user when the tendency of confusion occurring during the work changes due to the increasing experience of the user, etc.Embodiment 6.Differences from the above-described embodiments will be described below mainly with reference to the drawings.*** Description of configuration ***The information processing apparatus 10 according to this embodiment is substantially the same as the information processing apparatus 10 according to Embodiment 5.The presentation information control unit 40 according to this embodiment acquires pieces of presentation information from the presentation information DB 93 corresponding to the values of the relationships. The pieces of presentation information acquired by the presentation information control unit 40 are displayed on the display device 5 in descending order of the relationships corresponding to the respective pieces of presentation information.*** Description of Operation**FIG. 20 is a flowchart showing an example of the operation of the information processing apparatus 10 according to this embodiment. Referring to FIG. 20, the operation of the information processing apparatus 10 will be described. Step S 101 to step S 104 are as described above.(Step S 605)The presentation information control unit 40 extracts a relationship group C' consisting of relationships having relatively high relationship state values. The presentation information control unit 40 may determine whether each relationship is to be included in the relationship group C' in some manner.(Step S 606)The presentation information control unit 40 acquires a presentation information group D' from the presentation information DB 93 on the basis of the facility group A, the work target facility B, and the relationship group C'.(Step S 607)First, the presentation information control unit 40 checks the relationship state value associated with each piece of presentation information in the presentation information group D', and selects the presentation information associated with the highest relationship state value among the checked relationship state values as the presentation information D. At this time, the presentation information control unit 40 may sort the pieces of presentation information included in the presentation information group D' according to the relationship state value associated with each piece of presentation information.Subsequently, the presentation information control unit 40 displays, on the display 5, the presentation information D and information indicating the confusion factor corresponding to the relationship associated with the presentation information D.(Step S 608)The user determines whether the confusion factor displayed on the display device 5 is correct or incorrect, and inputs the determined result to the input device 7.The relationship weight update unit 70 acquires information indicating that the confusion factor is correct or incorrect.(Step S 609)When the information acquired from the relationship weight update unit 70 indicates that the confusion factor is correct in step S 608, the information processing apparatus 10 proceeds to step S 611. In other cases, the information processing apparatus 10 proceeds to step S 610.(Step S 610)This step is substantially identical to step S 607. However, the presentation information control unit 40 selects the presentation information D not from a presentation information group D' but from a presentation information group consisting of each piece of presentation information included in the presentation information group D' and not selected as the presentation information D in the processing of this flowchart. In selecting the presentation information D, the presentation information control unit 40 may use the results of checking the relationships in step S 607.(Step S611)This step is substantially identical to step S 508. However, there may be a case where the relationship weight updating unit 70 receives pieces of information each indicating a result of determination as to whether each of a plurality of confusion factors is correct or incorrect. In this case, the relationship weights stored in the relationship weight DB 94 may be updated based on all the received pieces of information.*** Description of Effects of Embodiment 6 ***As described above, the relationship weight updating unit 70 according to this embodiment updates the relationship weights based on whether the confusion factors are correct or incorrect, so that the probability of being able to present appropriate information to the user is increased.*** Further Embodiments ***The above embodiments may be freely combined or arbitrary constituent elements of each of the embodiments may be modified. Alternatively, in each of the embodiments, each constituent element may be omitted.The embodiments are not limited to those in Embodiments 1 to 6, but various modifications may be made as needed. The processes described in the flowcharts or the like may be appropriately modified.List of reference characters2: Sensor, 3: Line-of-sight sensor, 4: Finger joint sensor, 5: Display device, 7: Input device, 10: Information processing apparatus, 11: Processor, 12: Random access memory, 13: Auxiliary storage device, 14: Input / output IF, 15: Communication device, 18: Processing circuit, 19: Signal line, 20: Work target acquisition unit, 30: Confusion factor estimation unit, 40: Presentation information control unit, 50: User information acquisition unit, 60: Relationship weight acquisition unit, 70: Relationship weight update unit, 91: Operation DB, 92: Device DB, 93: Presentation information DB, 94: Relationship weight DB.

Claims

An information processing apparatus (10) comprising: a work target acquisition unit (20) for acquiring an attention device group consisting of at least one device that a working user pays attention; a confusion factor estimation unit (30) for setting each device other than a work target device included in the attention device group as a target attention device, wherein the work target device is a device corresponding to a work that the user needs to perform, and for calculating a relationship state indicating a relationship between the target attention device and the work target device and indicating a degree of confusion of the user in selection between the target attention device and the work target device; A presentation information control unit (40) for referring to a presentation information database (93) that records presentation information to acquire presentation information based on the calculated relationship state, wherein the presentation information is information to be presented to the user to help the user become aware of the work target device.The information processing apparatus (10) according to claim 1, wherein the work target acquisition unit (20) acquires the attention device group on the basis of an area that the user is looking at.The information processing apparatus (10) according to claim 1 or 2, wherein the work target acquisition unit (20) acquires the attention device group on the basis of a position of a finger joint of the user.The information processing apparatus (10) according to any one of claims 1 to 3, wherein the confusion factor estimation unit (30) calculates the relationship level based on the content of the work that the user needs to perform.The information processing apparatus (10) according to any one of claims 1 to 4, wherein the confusion factor estimation unit (30) calculates the relationship level using a relationship weight defined between the work target device and each device except the work target device included in the attention device group.The information processing apparatus (10) according to claim 5, wherein the confusion factor estimation unit (30) calculates the relationship level for each confusion factor that causes confusion for the user in the selection between the target attention device and the work target device, the information processing apparatus (10) further comprising a relationship weight updating unit (70) for updating the relationship weight on the basis of whether a confusion factor corresponding to the acquired presentation information is correct or incorrect.The information processing apparatus (10) according to claim 6, wherein the presentation information control unit (40) refers to the presentation information database (93) to acquire pieces of presentation information according to the values of the relationship level, and wherein the acquired pieces of presentation information are displayed on a display device (5) in descending order of the relationship levels respectively corresponding to the acquired presentation information.An information processing method comprising: acquiring, by a computer, an attention device group consisting of at least one device that a working user pays attention; setting each device except a working target device included in the attention device group as a target attention device, wherein the working target device is a device corresponding to a work that the user needs to perform, and calculating, by the computer, a relationship level indicating a relationship between the target attention device and the working target device and indicating a degree of confusion of the user in selection between the target attention device and the working target device; and referring to a presentation information database (93) that records presentation information to acquire presentation information based on the calculated relationship state, wherein the presentation information is information to be presented to the user to help the user become aware of the work target device, by the computer.An information processing program that causes an information processing apparatus (10), which is a computer, to execute: a work target acquisition process of acquiring an attention device group consisting of at least one device that a working user pays attention; a confusion factor estimation process of setting each device other than a work target device included in the attention device group as a target attention device, wherein the work target device is a device corresponding to a work that the user needs to perform, and calculating a relationship level indicating a relationship between the target attention device and the work target device and indicating a confusion degree of the user in selection between the target attention device and the work target device; and a presentation information control process of referring to a presentation information database (93) that records presentation information to acquire presentation information based on the calculated relationship state, wherein the presentation information is information to be presented to the user to help the user become aware of the work target device.

Images