Information presenting device, information presenting method, and program

Abstract

When diminishing an area Er to be diminished or an object Et to be diminished in an image (video) Prm captured by an imaging unit 11 and displayed to a display unit 16 by applying diminishing processing thereto, the present invention visually presents attention attraction information at for causing an inattentional overlook phenomenon to a worker (user) HW by showing the same in an attention attraction information display area Dr on the Prm, or (and) auditorily presents the same by outputting from a sound output unit 17. Then, after the attention attraction information at is presented, the object Er to be diminished or the object Et to be diminished in the image (video) Prm is diminished by applying diminishing processing (Fe).

Description

Information presentation device, information presentation method, and program

[0001] FIELD Embodiments of the present invention relate to an information presentation device, an information presentation method, and a program.

[0002] The human attention function works by limiting unnecessary information from the multiple pieces of information perceived by the five senses and recognizing only the necessary information. Therefore, for example, when doing desk work, it is possible to concentrate on the work by selectively recognizing only the information necessary for the work.

[0003] However, the restriction of perceived information may not work well, resulting in unnecessary information being treated as necessary information, and the person being distracted by such unnecessary information and unable to concentrate, resulting in distraction.

[0004] As a countermeasure for visually-based distractions, for example, Non-Patent Document 1 discloses a method of substituting the attention function of limiting information by using Diminished Reality (DR) technology, which processes an image in a part of the screen to make that part physically invisible, i.e., not visually perceptible.

[0005] When performing the concealment, in Non-Patent Document 1, the concealment processing selected by the user is immediately superimposed on the screen.

[0006] "Study on a system for suppressing inattention during work using dimmed reality," Hagiyama et al., IEICE Techniques, vol.123, no.228, MVE2023-22, pp.1-5, 2023.

[0007] In conventional methods of restricting information using disappearing reality (DR) technology, the appearance of the object being concealed changes suddenly when it is concealed, causing a visual sense of incongruity for the user. Therefore, the act of concealing itself may become a new source of distraction.

[0008] The present invention has been made in consideration of such problems, and aims to provide an information presentation device, an information presentation method, and a program that can prevent the disappearance process itself from becoming a new source of distraction when the disappearance process is performed using disappearing reality (DR) technology.

[0009] An information presentation device according to an embodiment of the present invention includes a control unit that executes the following processes: a process of outputting attention-attracting information that causes a user to overlook an area due to inattention when concealing an area to be concealed in an image displayed on a display unit; and a process of concealing the area to be concealed after outputting the attention-attracting information.

[0010] According to an information presentation device of an embodiment of the present invention, when performing a disappearance process using disappearing reality (DR) technology, it is possible to prevent the disappearance process itself from becoming a new distraction factor.

[0011] FIG. 1 is a diagram illustrating an example of an overview of an information presentation device 10 according to an embodiment of the information presentation device, information presentation method, and program of the present invention. FIG. 2 is a functional block diagram illustrating the functional configuration of the information presentation device 10. FIG. 3 is a block diagram illustrating the hardware configuration of the information presentation device 10. FIG. 4 is a flowchart illustrating an information presentation process executed by the information presentation device 10. FIG. 5 is a flowchart illustrating an attention-attracting information setting process in the information presentation process executed by the information presentation device 10. FIG. 6 is a diagram illustrating, by example, an output (presentation) state of attention-attracting information at on an image (video) Prm displayed on the display unit 16 in accordance with the information presentation process of the information presentation device 10, and an application state of a concealment process (Fe) to a concealment target region Er (or a concealment target Et).

[0012] Hereinafter, an information presentation device, an information presentation method, and a program according to embodiments of the present invention will be described with reference to the accompanying drawings.

[0013] (Outline of the embodiment) FIG. 1 is a diagram illustrating an example of an outline of an information presentation device 10 according to an embodiment of the information presentation device, the information presentation method, and the program of the present invention.

[0014] The information presentation device 10 according to the embodiment is realized, for example, as a head mounted display (HMD) with a camera. Note that the information presentation device 10 may be realized by any device having similar functions instead of the HMD.

[0015] 1A , the information presentation device 10 (HMD) according to the embodiment is worn on the head of a user (worker HW). Here, it is assumed that the worker HW is sitting on a chair CH in a room RM and working on information such as characters, symbols, and images displayed on a display (display screen) DP of a personal computer PC (personal computer) installed on a desk DK, as a work object Wt.

[0016] The information presentation device 10 (HMD) includes a camera (imaging unit) 11, for example, provided in the center of the front of the device housing, a display unit 16, for example, provided on the inner surface of the device housing corresponding to the field of view of the worker HW so as to cover the field of view, and a sound output unit (speaker) 17, for example, provided on the upper left and right sides of the device housing.

[0017] The camera (imaging unit) 11 captures (takes) a wide-angle image in the direction of the worker HW's line of sight, and the display unit 16 displays an image (video) Prm of the room RM in the direction of the worker HW's line of sight captured by the camera (imaging unit) 11, corresponding to the worker HW's field of view, as shown in Figure 1 (B), for example.

[0018] The worker HW performs work on the work object Wt by operating the keyboard KB and mouse MS while viewing the image (video) Prm including the PC displayed on the display unit 16 of the information presentation device 10 (HMD).

[0019] In addition, the work object Wt of the worker HW is not limited to information displayed by the PC, but may be included in the image (video) Prm captured by the camera (imaging unit) 11 and displayed on the display unit 16, and may change depending on the actions of the worker HW.

[0020] In FIG. 1, the information presentation device 10 (HMD) sets, among the people and objects (person HM, clock TK, calendar CL, mug MG, keyboard KB, mouse MS, etc.) around the work target Wt in the image (video) Prm captured by the camera (imaging unit) 11, an area or object that is unnecessary for the work of the worker HW and should be concealed (an area or object that is likely to distract the attention of the worker HW), for example, an area including the person HM as an area Er to be concealed or an object Et to be concealed including the person HM.

[0021] The information presentation device 10 (HMD) sets a concealment effect Fe corresponding to the area Er (area including a person HM) to be concealed or the object Et (person HM) to be concealed contained in the image (video) Prm, and generates concealment processing data to conceal the area Er or the object Et.

[0022] When the information presentation device 10 (HMD) uses the concealment processing data to conceal an area Er or an object Et to be concealed, it generates attention attracting information data including attention attracting information (attention attracting information at) to divert the attention of the worker HW from the concealment processing (causing an oversight due to inattention).

[0023] The attention attracting information data is generated as information related to the content of the work performed by the worker HW in a visual format such as text, figures, or video, or in an auditory format such as voice or sound, or in a combination thereof. When the attention attracting information data is generated in a visual format, the attention attracting information data also includes information indicating an area (attention attracting information display area Dr) in which the attention attracting information at should be composited and displayed on the image (video) Prm being displayed on the display unit 16.

[0024] When attention-attracting information data is generated in a visual format, the information presentation device 10 (HMD) displays the attention-attracting information at in the attention-attracting information display area Dr on the image (video) Prm being displayed, as shown in Figure 1 (B), for example, and then performs the concealment process by displaying the concealment effect Fe of the concealment processing data in the area Er to be concealed or the object Et to be concealed.

[0025] Furthermore, when attention-attracting information data is generated in an auditory format, the information presentation device 10 (HMD) outputs attention-attracting information at such as voice or sound from the sound output unit 17, as shown in FIG. 1(B), and then performs the concealment process by synthesizing the concealment effect Fe of the concealment processing data with the area Er to be concealed or the object Et to be concealed and displaying it.

[0026] In this way, the information presentation device 10 (HMD) presents the attention attracting information at before the erasure process for the area Er to be erased or the object Et to be erased, and by directing the attention of the worker HW to the attention attracting information at, the worker HW will not be focused on the erasure process being performed and will not notice, or will have difficulty noticing, the change in appearance of the object to be erased. Therefore, it is possible to prevent the erasure process itself from becoming a new cause of distraction.

[0027] (Configuration of the embodiment) FIG. 2 is a functional block diagram showing the functional configuration of the information presentation device 10. As shown in FIG.

[0028] The information presentation device 10 includes an imaging unit (camera) 11 , a memory unit 12 , a masking processing unit 13 , an attention attracting information processing unit 14 , a synthesis unit 15 , a display unit 16 , and a sound output unit 17 .

[0029] The imaging unit (camera) 11 captures video. Specifically, it is a camera capable of capturing moving images, and captures an image (video) Prm in the line of sight of the worker (user) HW.

[0030] The storage unit 12 stores or reads out various data necessary for the information presentation device 10 to execute various functions.

[0031] The masking processing unit 13 processes a partial area of ​​the image Prm captured by the imaging unit 11 based on a masking reality (DR) technique to change the appearance of the image.

[0032] The attention attracting information processing unit 14 processes information that attracts attention (attention attracting information) in order to divert the attention of the worker (user) HW from the erasure processing when applying the erasure processing set by the erasure processing processing unit 13.

[0033] The combining unit 15 combines the image Prm captured by the imaging unit 11 with data related to the erasure processing (erasure processing data) generated by the erasure processing unit 13 and data related to the display (presentation) of the attention attracting information at (visual form) generated by the attention attracting information processing unit 14 (attention attracting information data) to generate a new image Prm. The combined new image Prm is sent to the display unit 16.

[0034] In addition, if the concealment processing data and attention attracting information data are not transmitted from the concealment processing processing unit 13 and the attention attracting information processing unit 14 to the synthesis unit 15, i.e., if concealment is not performed, the synthesis unit 15 sends the video Prm sent from the imaging unit 11 to the display unit 16 as is without processing the video Prm.

[0035] The display unit 16 is configured using, for example, an LCD (Liquid Crystal Display), and displays the video Prm sent from the synthesis unit 15 .

[0036] The sound output unit 17 is configured using, for example, a speaker, and outputs the attention attracting information at (auditory form) generated by the attention attracting information processing unit 14 as voice or sound.

[0037] In addition, in a standalone type information presentation device 10 (HMD) equipped with a control unit (processor), a system program (OS: Operating System), etc., the concealment processing unit 13, the attention-attracting information processing unit 14, and the synthesis unit 15 may be realized to operate integrally on the information presentation device 10 (HMD), or may be realized to operate on a tablet terminal (smartphone), PC, etc. to which the information presentation device 10 (HMD) is connected and used.

[0038] <Configuration of the Erasure Processing Unit 13> The erasure processing unit 13 selects an area (area to be erased Er) or an object (object to be erased Et) that is likely to attract the attention of the worker (user) HW from a partial area of ​​the image Prm captured by the imaging unit 11, and then performs erasure processing based on DR technology. The erasure processing unit 13 can be realized using any existing DR technology, but for the purpose of providing an overview, one form of realization will be shown here.

[0039] The masking process unit 13 includes a determination unit 131, an area selection unit 132, an effect selection unit 133, and an effect generation unit .

[0040] The judgment unit 131 judges whether or not there is an area (area to be obscured Er) or object (object to be obscured Et) that is likely to attract the attention of the worker (user) HW in the image (video) Prm captured (photographed) by the imaging unit 11.

[0041] The determination of whether the worker (user) HW will be attracted (distracted) is made by performing image analysis on the video Prm using any existing technology, specifically technology such as object recognition, color identification, and brightness identification, and determining whether the information on the object, color, brightness, etc. calculated as a result matches predetermined conditions stored, for example, in the storage unit 12. Note that instead of making a systematic determination, the worker (user) HW himself / herself may use, for example, an input device (not shown) connected to the information presentation device 10 (HMD) to specify an area (area Er to be obscured) or an object (object Et to be obscured) in the image (video) Prm displayed on the display unit 16.

[0042] The area selection unit 132 sets an area (area to be obscured Er) or an area (position) of an object (object to be obscured Et) in the image (video) Prm determined by the determination unit 131 .

[0043] The effect selection unit 133 selects one of a plurality of applicable types of concealment effects based on a predetermined selection method as the method of image processing to be applied based on the DR technology. The types of concealment effects include, for example, "transparency" and "outline" which change the appearance of an area or object by superimposing it on a background, "blur" which changes the resolution, "low saturation" and "low salience" which change the saturation, and "low contrast" which changes the brightness.

[0044] The selection of the concealment effect may be performed by the worker (user) HW himself / herself, for example, by using an input device (not shown) connected to the information presentation device 10 (HMD) to select from among multiple types of concealment effect candidates displayed selectably on the display unit 16.

[0045] The effect generation unit 134 generates the concealment processing data and sends the generated concealment processing data to the attention attraction information processing unit 14. Here, the concealment processing data includes information capable of specifying the area (position) in the image (video) set (specified) by the area selection unit 132, and information capable of identifying the (type of) concealment effect selected (specified) by the effect selection unit 133.

[0046] <Configuration of the attention attracting information processing unit 14> The attention attracting information processing unit 14 performs processing that may cause an oversight phenomenon due to inattention when applying the erasure processing based on the erasure processing data generated by the erasure processing unit 13. Here, the oversight phenomenon due to inattention is a phenomenon in which a physical stimulus that is thought to be sufficiently perceptible visually cannot be detected because intentional attention is not being paid to it.

[0047] The attention attracting information processing unit 14 includes an attention attracting information selection unit 141 and an attention attracting information generation unit 142 .

[0048] After receiving the erasure processing data from the erasure processing unit 13, the attention attracting information selecting unit 141 selects attention attracting information at that may cause an oversight phenomenon due to inattention.

[0049] The attention attraction information at may be selected using, for example, fixed, predetermined attention attraction information at stored in the storage unit 12, or may be dynamically generated and used. In the case of dynamically generating the attention attraction information at, for example, a mechanism may be provided in which a work schedule written (saved) in the information presentation device 10 (HMD) or in a tablet terminal or PC of the worker HW connected to the information presentation device 10 (HMD) is acquired and referenced as an information source indicating the progress of the work (task) of the worker HW, and the attention attraction information at related to the content of the work (task) to be performed by the worker HW may be generated based on the written (saved) content of the information source.

[0050] Furthermore, when multiple pieces of attention attracting information at are applicable, any selection method may be used to select, for example, attention attracting information at pre-stored in the storage unit 12. As a method for selecting the attention attracting information at, in addition to a random selection method, for example, it is also possible to select and set the attention attracting information at to be applied based on the characteristics of the erasure target area Er or the erasure target object Et, the characteristics of the erasure effect Fe applied to the erasure target area Er or the erasure target object Et, and the characteristics of the worker (user) HW himself / herself obtained based on attribute information of the worker (user) HW.

[0051] The attention attracting information at may be presented in any format and with any content as long as it can induce oversight due to inattention. For example, a text message related to the content of the work may be displayed, such as "Pay attention to the screen!" to encourage attention to the work object Wt displayed on the PC display DP, or "Check the progress!" to remind the user of the progress of the work.

[0052] Furthermore, the attention attracting information at may be realized in a visual form such as a graphic or video, or in an auditory form such as a voice (verbal sound) or a sound (non-verbal sound), other than text. A combination of these may also be presented. When presented in a visual form, effects such as blinking may be added. When the attention attracting information at is presented auditorily, it is presented by outputting it as voice or sound from the sound output unit 17.

[0053] The attention attracting information generating unit 142 generates attention attracting information data including the attention attracting information at selected or generated by the attention attracting information selecting unit 141, and transmits this to the combining unit 15 together with the erasure processing data transmitted from the effect generating unit 134 of the erasure processing unit 13. Here, the attention attracting information data is data including the attention attracting information at to be applied, and when presented in a visual format, also includes information regarding the position of an area (attention attracting information display area Dr) to be displayed by combining it with the image (video) Prm being displayed on the display unit 16.

[0054] The attention attracting information display area Dr may be located anywhere as long as it can be easily overlooked due to inattention. For example, it may be located as far away as possible from the obscuring processing area (the obscuring target area Er or the obscuring target object Et) and near the work area (work object Wt) so as to divert attention from the obscuring processing and encourage attention to the vicinity of the work area (work object Wt). Specifically, on a two-dimensional plane on the display unit 16, within a circle whose center is the center of the work area (work object Wt) and whose radius is a predetermined number of pixels as an area in which attention attracting information at can be placed, the farthest point (the furthest point) from the center of the obscuring processing area (Er / Et) is calculated, and the position of the attention attracting information display area Dr is set so that this farthest point becomes the center point of the attention attracting information display area Dr.

[0055] In addition, the attention attracting information at and the working area (Wt) applicable in the embodiment are typically set in advance by a system administrator, etc., but are not limited to this. Furthermore, recognition of the working area (Wt) during system operation may be realized using any existing object detection technology, etc.

[0056] FIG. 3 is a block diagram showing the hardware configuration of the information presentation device 10. As shown in FIG.

[0057] As shown in FIG. 3, the information presentation device 10 includes a control circuit (processor) 21 which serves as a control unit.

[0058] The control circuit 21 is connected via a system and data bus to a memory 22 such as RAM, a storage device 23 including a storage medium 23a such as a magnetic disk or SSD (Solid State Drive), a user interface 24 including keys, switches, a touch panel, an external input terminal for the user to operate from the outside, and a display for outputting data, a speaker, a printer, and an external output terminal, an imaging module 27 including a CCD (Charge Coupled Device), an acoustic module 28 including an amplifier, a speaker, and a wired communication module 25 and / or a wireless communication module 26 for communicating with the outside.

[0059] When connecting the information presentation device 10 to a tablet terminal or a PC, the connection may be made via, for example, a wired communication module 25 and / or a wireless communication module 26 .

[0060] The control circuit 21 controls the operation of each part of the information presentation device 10 based on management information stored in or read from a management information area 22b of the memory 22, in accordance with a control program that controls the processing of the information presentation device 10 and that is stored in a control program area 22a of the memory 22. The control circuit (processor) 21 is not limited to one processor, and may include multiple processors.

[0061] The control program stored in the control program area 22a of the information presentation device 10 includes functions corresponding to the processes performed by the imaging unit 11, memory unit 12, obscuration processing unit 13, attention-attracting information processing unit 14, synthesis unit 15, display unit 16, and sound output unit 17 described with reference to Figure 3.

[0062] In addition, the management information area 22b of the information presentation device 10 also functions as the memory unit 12 described with reference to Figure 3, and stores or reads out data that is input, acquired, generated, updated, output, etc. in accordance with each process performed by the imaging unit 11, the obscuration processing unit 13, the attention-attracting information processing unit 14, the synthesis unit 15, the display unit 16, and the sound output unit 17.

[0063] When the information presentation device 10 is connected to a tablet terminal or a PC for use, the tablet terminal or PC is configured with the same hardware as the information presentation device 10. Functions corresponding to the processes performed by the concealment processing unit 13, the attention-attracting information processing unit 14, and the synthesis unit 15 may be executed in cooperation with a control unit (processor) of the tablet terminal or PC.

[0064] In the information presentation device 10 configured in this manner, the control circuit (control unit) 21 controls the operation of each unit in accordance with the instructions written in the control program, and the software and hardware work together to realize various functions as described in the operation explanation below.

[0065] (Operation of the embodiment) Next, the operation of the information presentation device 10 of the embodiment will be described.

[0066] FIG. 4 is a flowchart showing the information presentation process executed by the information presentation device 10. As shown in FIG.

[0067] <Overview of overall operation of information presentation processing> The imaging unit (camera) 11 photographs (captures) and acquires a video (image) Prm in the direction of the worker HW's line of sight, and sequentially sends the photographed video Prm to the synthesis unit 15 and the masking processing unit 13 (step S0).

[0068] The determination unit 131 determines whether or not there is an area Er or object Et to be obscured that is likely to attract the attention of a user (worker) HW in the image Prm sent from the imaging unit 11 (step S1).

[0069] If the judgment unit 131 determines that there is no area Er or object Et to be obscured (if the answer is "No" in step S1), that is, if obscuration is not to be performed, the obscuration processing data is not sent to the synthesis unit 15, and the image Prm is sent to the display unit 16 as is and displayed without being processed.

[0070] If the judgment unit 131 determines that the image Prm sent from the imaging unit 11 contains an area Er or object Et to be obscured that is likely to attract the attention of the user (worker) HW (if "Yes" in step S1), the area selection unit 132 selects (sets) the area Er or object Et to be obscured (step S2), and the effect selection unit 133 selects (sets) the type of obscuring effect to be applied to the object to be obscured, and the effect generation unit 134 generates obscuring processing data (step S3).

[0071] In addition, the order of the process performed by the area selection unit 132 in step S2 to select (set) the area Er or object Et to be erased and the process performed by the effect selection unit 133 in step S3 to select (set) the type of erasure effect to be applied to the object to be erased may be reversed.

[0072] Thereafter, the attention attracting information processing unit 14 sets attention attracting information for causing an oversight phenomenon due to inattention (step S4).

[0073] Then, the synthesis unit 15 synthesizes attention attracting information with the image Prm sent from the imaging unit 11 and displays and presents it on the display unit 16, and then synthesizes the obscuration processing data and displays the image Prm on the display unit 16 in which the area Er or object Et to be obscured has been obscured (step S5).

[0074] <Details of Operation at Each Processing Step of Information Presentation Processing> Step S1: The determination unit 131 determines whether or not there is an area Er or object Et to be concealed that is likely to distract the attention of the user (worker) HW in the image Prm sent from the imaging unit 11. Specifically, for example, image analysis is performed on the image Prm using techniques such as object detection, color identification, and brightness identification, and the like, and the determination is made based on whether or not the information on the object, color, brightness, etc. calculated as a result matches predetermined conditions stored in the storage unit 12.

[0075] Here, the predetermined condition is, for example, that objects that are thought to attract the attention of the user (worker) HW are stored in advance in a database in the memory unit 12, and information such as the newly recognized object, color, brightness, etc. is present in the database.

[0076] The determination of whether or not there is an area Er or an object Et to be obscured in the image Prm may be performed by the user (worker) HW himself / herself, rather than being performed automatically by the system. For example, when the user (worker) HW viewing the image Prm through the display unit 16 finds an area or object in the image Prm that is distracting the user (worker) HW regardless of the work the user (worker) HW is doing, the user (worker) HW operates an input device (keyboard, mouse, etc.) connected to the information presentation device 10 (HMD) to specify the distracting area or object, thereby causing the determination unit 131 to determine that there is an area Er or an object Et to be obscured.

[0077] Step S2: The region selection unit 132 selects (sets) a region Er (specific region) or an object Et (specific object) to be erased. For example, when selecting a specific region Er to be erased that was determined in step S1 as a region containing an attention-grabbing color, a region of any shape may be selected. For example, when selecting a specific region as a rectangle, the region is selected by specifying various information that can identify the region (for example, the coordinates of each vertex of the rectangular region).

[0078] As in step S1, the user (worker) HW may select the area by himself / herself. In this case, the user (worker) HW operates an input device connected to the information presentation device 10 (HMD) to input various pieces of information that can identify the area.

[0079] Furthermore, when selecting the specific object Et to be erased determined in step S1, the selection may be made using an existing object recognition technology. In this case, for example, by having the user (operator) HW specify any coordinates in an area including the object to be erased, the object (specific object Et) displayed at the location including the coordinates is recognized, and the shape of the object (specific object Et) is selected as the area to be erased.

[0080] In addition, when the object to be obscured moves on the screen, for example, when a pedestrian HM is to be obscured, an existing moving object tracking technique is used to select and move the area to be obscured in accordance with the moving object to be obscured.

[0081] Step S3: The effect selection unit 133 selects (sets) the type of erasure effect to be applied to the erasure target, and the effect generation unit 134 generates erasure processing data.

[0082] The type of the concealment effect is selected by selecting one from among the applicable concealment effects based on a predetermined selection method. Any existing method can be used as the selection method. For example, if there are multiple applicable concealment effects, the user (operator) HW can select one of the available concealment effects by displaying them on the display unit 16 and presenting them to the user (operator) HW using an input device.

[0083] Any type of obscuration effect can be used as long as it is applicable to DR technology. For example, as shown in Non-Patent Document 1, "transparency" and "outline" which change the appearance of an object by superimposing it on a background, "blur" which changes the resolution, "low saturation" and "low salience" which change the saturation, and "low contrast" which changes the brightness can be used.

[0084] The area selection unit 132 selects (sets) the area Er or object Et to be obscured, and the effect selection unit 133 selects (sets) the type of obscuration effect to be applied to the object to be obscured. Information (e.g., coordinates) identifying the area Er or object Et and information indicating the type of obscuration effect are then sent to the effect generation unit 134.

[0085] The effect generating unit 134 generates the erasure processing data so as to apply the selected erasure effect to the selected region (Er / Et), and sends the generated erasure processing data to the attention attracting information processing unit 14.

[0086] Step S4: When the attention attracting information processing section 14 receives the erasure processing data from the erasure processing section 13, it sets attention attracting information for causing an oversight phenomenon due to inattention.

[0087] FIG. 5 is a flowchart showing the attention attracting information setting process in the information presentation process executed by the information presentation device 10. As shown in FIG.

[0088] When the attention attracting information selection unit 141 receives the erasure processing data from the erasure processing unit 13 (if "Yes" in step S41), it selects attention attracting information at that may cause an oversight phenomenon due to inattention (step S42).

[0089] If the selected attention attracting information at is configured in a visual format ("Yes" in step S43), the attention attracting information selection unit 141 sets (step S44) the position of an area (attention attracting information display area Dr) in which the attention attracting information at is displayed and presented on the image (video) Prm captured (pictured) by the imaging unit 11. If the selected attention attracting information at is configured in an auditory format ("No" in step S43), the attention attracting information display area Dr is not set.

[0090] The attention attracting information generating unit 142 generates attention attracting information data based on the attention attracting information at selected by the attention attracting information selecting unit 141 (step S45). Here, the attention attracting information data is data including the attention attracting information at to be applied. If the attention attracting information at is configured in a visual format, it also includes information about the position of the display area (attention attracting information display area Dr) on the image (video) Prm.

[0091] The attention attracting information processing unit 14 combines the masking process data received from the masking process processing unit 13 with the visual form of the attention attracting information data generated by the attention attracting information generating unit 142 and transmits them to the synthesis unit 15 (step S46). The attention attracting information data in the auditory form is also sent to the sound output unit 17.

[0092] If the answer to step S41 is "No," that is, if the erasure processing data has not been sent from the erasure processing unit 13, the attention attracting information setting process is terminated.

[0093] Figure 6 is a diagram showing, as an example, the output (presentation) state of attention-attracting information at on the image (video) Prm displayed on the display unit 16 in accordance with the information presentation process of the information presentation device 10, and the application state of the obscuration processing (Fe) to the obscuration target area Er (or obscuration target Et).

[0094] Step S5: Based on the obscuration processing data and the attention attracting information data (visual format) sent from the attention attracting information processing unit 14, the synthesis unit 15 synthesizes the attention attracting information at (here, in text format, "Pay attention to the screen!") in the attention attracting information display area Dr on the video (image) Prm sent from the camera (imaging unit) 11, as shown in Figure 6, and presents it by displaying it on the display unit 16.

[0095] Furthermore, if attention attracting information data (auditory format) is generated in the attention attracting information generating unit 142 of the attention attracting information processing unit 14, the attention attracting information at in auditory format (here, audio format "Pay attention to the screen!") is output as audio by the sound output unit 17 and presented, as shown in Figure 6.

[0096] After this, the area Er to be obscured or the object Et to be obscured (here, the area Er including the pedestrian HM or the area Et of the pedestrian HM) on the video (image) Prm on which the attention attracting information "Pay attention to the screen!" at is displayed (or audio output) is subjected to obscuration processing by combining the obscuration effect Fe as shown in FIG. 6, and the result is displayed on the display unit 16.

[0097] In this embodiment, information about work on a PC is used as attention attracting information at as an example of encouraging the worker (user) HW to concentrate on that work. However, the attention attracting information at may also be realized for any work other than work on a PC using information about that work, as long as the information causes an oversight due to inattention.

[0098] (Summary of the embodiment) According to the information presentation device 10 of the embodiment, when applying an erasure process to the region Er or the object Et to be erased in the image (video) Prm that is photographed (captured) by the imaging unit 11 and displayed on the display unit 16, attention attracting information at for causing an oversight phenomenon due to inattention is presented to the worker (user) HW by visually displaying it in the attention attracting information display region Dr on the image (video) Prm and / or (and) audibly outputting it from the sound output unit 17. Then, after presenting the attention attracting information at, the region Er or the object Et to be erased in the image (video) Prm is subjected to an erasure process (Fe) to be erased.

[0099] Furthermore, according to the information presentation device 10 of the embodiment, the attention attracting information at is presented as information related to the content of the work being performed by the worker (user) HW, for example, in order to encourage the worker (user) HW to concentrate on the work, and the presentation of the attention attracting information at itself reduces the possibility of causing further distraction to the worker (user) HW.

[0100] Furthermore, according to the information presentation device 10 of the embodiment, the attention attracting information display area Dr on the image (video) Prm that visually displays the attention attracting information at is positioned as far away (farthest away) as possible from the obscuring target area Er or the obscuring target Et and in the vicinity (within a specified range) of the work area (work target Wt) in order to effectively cause oversight due to inattention.

[0101] Therefore, according to the information presentation device 10 of the embodiment, when performing a disappearance process using disappearing reality (DR) technology, it is possible to prevent the disappearance process itself from becoming a new distraction factor.

[0102] The methods described in the embodiments may be stored as a program (software means) that can be executed by a computer on a recording medium such as a magnetic disk (e.g., a floppy disk, a hard disk, etc.), an optical disk (e.g., a CD-ROM, a DVD, an MO, etc.), or a semiconductor memory (e.g., a ROM, a RAM, a flash memory, etc.), or may be transmitted and distributed via a communication medium. The program stored on the medium also includes a configuration program that configures the software means (including not only executable programs but also tables and data structures) that the computer executes. The computer that implements this system reads the program stored on the recording medium and, in some cases, configures the software means using the configuration program, and executes the above-described processing by having the operation controlled by this software means. The recording medium may be a storage medium, such as a magnetic disk or semiconductor memory, installed inside the computer or in a device connected via a network, and may be distributed for distribution.

[0103] The present invention is not limited to the above-described embodiments, and various modifications can be made in the implementation stage without departing from the spirit of the invention. Furthermore, the embodiments may be implemented in appropriate combinations, in which case the combined effects can be obtained. Furthermore, the above-described embodiments include various inventions, and various inventions can be extracted by combining selected elements from the disclosed elements. For example, if the problem can be solved and the desired effect can be obtained even if some elements are deleted from all elements shown in the embodiments, the configuration from which these elements are deleted can be extracted as an invention.

[0104] DESCRIPTION OF SYMBOLS 10... Information presentation device (HMD) 11... Imaging unit (camera) 12... Memory unit 13... Concealment processing unit 131... Determination unit 132... Area selection unit 133... Effect selection unit 134... Effect generation unit 14... Attention attracting information processing unit 141... Attention attracting information selection unit 142... Attention attracting information generation unit 15... Synthesis unit 16... Display unit 17... Sound output unit 21... Control circuit (control unit: processor) 22... Memory 23... Storage device 24... User interface 25... Wired communication module 26... Wireless communication module 27... Imaging module 28... Sound module Prm... Image (video) HW... Worker (user) PC... Personal computer DP... Display Wt... Work object Er... Concealment target area Et... Concealment target Fe... Concealment effect HM... Person Dr... Attention attracting information display area at ...Attention-grabbing information

Claims

1. An information presentation device having a control unit that executes the following processes: outputting attention-attracting information that causes a user to overlook an area due to inattention when concealing an area to be concealed in an image displayed on a display unit; and concealing the area to be concealed after outputting the attention-attracting information.

2. The information presentation device according to claim 1, wherein the attention attracting information includes information relating to an operation to be performed by the user.

3. An information presentation device as described in claim 1 or claim 2, wherein the image includes the object of work to be performed by the user, and the control unit synthesizes and outputs the attention-attracting information at a position on the image displayed on the display unit that is farthest from the area to be obscured and within a predetermined range from the object of work.

4. An information presentation device according to claim 1 or claim 2, wherein the control unit outputs the attention attracting information as sound from a sound output unit.

5. An information presentation device as described in claim 1 or claim 2, wherein the control unit executes a process of acquiring the user's work schedule, and a process of generating the attention attracting information based on the work schedule.

6. An information presentation device as described in claim 1 or claim 2, wherein the display unit is provided on an inner surface corresponding to the field of view of a housing worn on the user's head so as to cover the field of view of the user, and the image is captured by an imaging unit provided on the front surface of the housing.

7. An information presentation method in which a control unit of an information presentation device executes the following steps: outputting attention-attracting information that causes a user to overlook something due to inattention when concealing an area that should be concealed from an image displayed on a display unit; and concealing the area that should be concealed after outputting the attention-attracting information.

8. A program that causes a control unit of an information presentation device to function to execute the following process: outputting attention-attracting information that causes a user to overlook something due to inattention when concealing an area that should be concealed from an image displayed on the display unit; and concealing the area that should be concealed after outputting the attention-attracting information.

Images