Information processing device, program and method

Abstract

To provide an information processing device capable of concealing a portion of information to be presented to a user.SOLUTION: In an information leakage suppression system 100, an information processing device (a user terminal 120) for concealing a portion of a generation image to be generated by an image generation device to generate a display image to be displayed on an image display device, includes: in an output control part of a control device 170, a work position specification part (a browsing area determination part) for specifying a work position being one or more positions or ranges which are disposed at the portion of the generation image and are positions or ranges designated or referred to by a user of the image display device; an object area determination part (a concealed area determination part) for determining an object area being an area to be concealed on the basis of the work position specified by the work position specification part; and a work area determination part (the browsing area determination part) for determining a work area to be disposed at the portion of the generation image and being an area including the work position.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an information processing device, a program, and a method. [Background technology]

[0002] Patent Document 1 discloses an information display device that automatically sets itself to prevent others from peeking when it is determined that there is a risk of others peeking. Patent Document 2 discloses an electronic device that performs anti-peeking control when it detects the line of sight of a person other than the user. Patent Document 3 discloses a technology that acquires line-of-sight information of a user's gaze on a screen image for each user and displays which display area in the screen image the user has gazed on. (Prior art document) (Patent Documents) (Patent Document 1) JP 2012-129701 A (Patent Document 2) Patent No. 6474921 (Patent Document 3) Patent No. 6485522 Summary of the Invention [Means for solving the problem]

[0003] In a first aspect of the present invention, an information processing device is provided. The information processing device, for example, conceals a part of a generated image generated by an image generating device, and generates a display image to be displayed on an image display device. The information processing device, for example, includes a work position identification unit that identifies a work position, which is one or more positions or ranges arranged in a part of the generated image and is a position or range specified or referenced by a user of the image display device. The information processing device, for example, includes a target area determination unit that determines a target area, which is an area to be concealed, based on the work position identified by the work position identification unit. The information processing device, for example, includes a work area determination unit that determines a work area, which is an area arranged in a part of the generated image and includes the work position.

[0004] The information processing device may include a division unit that divides the generated image into a plurality of sections. The information processing device may include a value derivation unit that derives a value of information included in each section for at least a portion of the plurality of sections. In the information processing device, the target area determination unit may determine the target area based on the value derived by the value derivation unit and the work position identified by the work position identification unit.

[0005] In the information processing device, the target area determination unit may (a) determine that at least one of the multiple sections that is located outside the range of the working area and has a value greater than a predetermined first degree is to be concealed. The target area determination unit may (b) determine that the working area is not to be concealed when the working area does not include any of the multiple sections whose value is greater than a predetermined second degree. The target area determination unit may (c) determine that at least one of the multiple sections whose value is greater than the second degree is to be concealed when the working area includes any of the multiple sections whose value is greater than the second degree. In the information processing device, the second degree may be greater than the first degree. In the information processing device, the working area determination unit may determine the range of the working area based on the value derived by the value derivation unit, which is (i) the value of information included in a section including the working position among the multiple sections, or (ii) the value of information included in the working position.

[0006] The information processing device may include a mode determination unit that determines a mode of concealment of the target area based on the value derived by the value derivation unit, which is the value of the information included in the target area. The information processing device may include a proximity detection unit that detects the approach of the user to the image display device when a distance between the user and the image display device becomes smaller than a predetermined value. In the information processing device, the mode determination unit may determine to reduce a size of at least one selected from the group consisting of character strings, pictures, figures, tables, photographs, and videos, and parts of these, included within the working area, when the approach of the user to the image display device is detected.

[0007] In a second aspect of the present invention, there is provided a method for generating an image. The method is, for example, a method for generating a display image to be displayed on an image display device by concealing a part of a generated image generated by an image generating device. An operating subject of each step of the method may be a computer.

[0008] The above method includes, for example, a work position identification step of identifying a work position, which is one or more positions or ranges located in a part of the generated image and which is a position or range specified or referenced by a user of the image display device.The above method includes, for example, a target area determination step of determining a target area, which is an area to be concealed, based on the work position identified in the work position identification step.The above method includes, for example, a work area determination step of determining a work area, which is an area located in a part of the generated image and which includes the work position.

[0009] In a third aspect of the present invention, a program is provided. The program may be a program for causing a computer to function as the information processing device according to the first embodiment. The program may be a program for causing a computer to execute the method according to the second embodiment. A computer-readable medium storing the program may be provided. The computer-readable medium may be a non-transitory computer-readable medium. The computer-readable medium may be a computer-readable recording medium.

[0010] The above summary of the invention does not list all of the necessary features of the present invention. Also, subcombinations of these features may also be inventions. [Brief description of the drawings]

[0011] [Figure 1] 1 shows an example of a system configuration of an information leakage prevention system 100. [Diagram 2] An example of an original image 200 is shown diagrammatically. [Diagram 3] An example of an output image 300 is shown diagrammatically. [Figure 4] 13 illustrates an example of information processing in the control device 170. [Diagram 5] 2 shows an example of the internal configuration of the control device 170. [Figure 6] 13 shows an example of the internal structure of the value map generating unit 582. [Figure 7] 7 shows a schematic diagram of an example of the data structure of a data table 700. [Figure 8] 13 shows an example of the internal configuration of the concealment processing unit 584. [Figure 9] 9 illustrates an example of a data structure of a data table 900. [Figure 10] 10 shows a schematic diagram of an example of the data structure of a data table 1000. [Figure 11] 13 illustrates an example of information processing in the leakage prevention support unit 586. [Figure 12] 13 is a schematic diagram showing another example of information processing in the leakage prevention support unit 586. [Figure 13] 2 shows another example of a method for dividing the original image 200. [Figure 14] An example of the system configuration of a computer 3000 is shown in schematic form. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] The present invention will be described below through the embodiments of the invention, but the following embodiments do not limit the invention according to the claims. In addition, not all of the combinations of features described in the embodiments are necessarily essential to the solution of the invention. In addition, in the drawings, the same reference numbers may be used for the same or similar parts, and duplicated explanations may be omitted. In addition, a person skilled in the art who has come into contact with the description of this specification can understand that technical matters described in one embodiment may be applied to other embodiments to the extent that there is no technical contradiction.

[0013] (Overview of information leakage prevention system 100) An overview of the information leakage prevention system 100 will be described with reference to Figures 1, 2, and 3. Figure 1 shows an example of a system configuration of the information leakage prevention system 100. In this embodiment, the information leakage prevention system 100 can conceal a part of information presented to a user. For example, the information leakage prevention system 100 conceals a part of an image displayed by a terminal managed by the information leakage prevention system 100 in response to an instruction from an administrator of the terminal or a user of the terminal.

[0014] In this embodiment, the information leakage prevention system 100 will be described in detail with an example in which the information leakage prevention system 100 (i) first generates an original image 200 that has not been subjected to an anonymization process, and (ii) then anonymizes at least a part of the original image 200 to generate an output image 300 to be presented to a user. Fig. 2 shows an example of the original image 200. Fig. 3 shows an example of the output image 300.

[0015] 1, in this embodiment, the information leakage prevention system 100 includes, for example, a user terminal 120. In this embodiment, the user terminal 120 includes, for example, a housing 130, a display device 140, an environmental sensor 150, an input device 160, and a control device 170. In this embodiment, the display device 140 includes, for example, a display area 142. In this embodiment, the environmental sensor 150 includes a distance sensor 152, a camera 154, and a radio wave detector 156.

[0016] In this embodiment, the user terminal 120 outputs various types of information to the user. The user terminal 120 may output information by an image or by sound. The user terminal 120 may accept information input from the user. The user terminal 120 is configured to be able to execute various types of information processing.

[0017] In this embodiment, the details of the user terminal 120 will be described by taking as an example a case where the user terminal 120 outputs an image. For example, a user of the user terminal 120 inputs, via the input device 160, instructions to the user terminal 120 for the BIOS, the operating system (sometimes referred to as an OS), or an application program (sometimes referred to as a program as a general term for these) that runs on the user terminal 120. The user terminal 120 executes information processing according to the instructions, and displays an image showing the result of the information processing in the display area 142.

[0018] In this embodiment, the user terminal 120 generates the output image 300 by concealing, for example, a part of the original image 200 generated by a program running on the user terminal 120. The user terminal 120 displays the output image 300 in the display area 142 of the display device 140. In this way, the output image 300 is presented to the user. According to this embodiment, a part of the output image 300 is concealed. Therefore, even if the output image 300 displayed in the display area 142 is viewed by a person other than the user who is in the vicinity of the display area 142, information leakage can be suppressed. Examples of the program that generates the original image 200 include a BIOS, an operating system (sometimes referred to as an OS), and various application programs.

[0019] Examples of the user terminal 120 include a personal computer and a mobile terminal. Examples of the mobile terminal include a mobile phone, a smartphone, a PDA (registered trademark), a tablet, a notebook computer or laptop computer, and a wearable computer.

[0020] In this embodiment, the housing 130 supports the display device 140, the environmental sensor 150, the input device 160, and the control device 170. Each of the display device 140, the environmental sensor 150, the input device 160, and the control device 170 may be at least partially housed inside the housing 130, or may be attached to the outside of the housing 130.

[0021] In this embodiment, the display device 140 outputs various images. The display device 140 may output an image or stop outputting an image according to an instruction from the control device 170. The display device 140 may adjust the brightness or contrast of an image according to an instruction from the control device 170. The display device 140 can output an image, stop outputting an image, or adjust the brightness or contrast of an image according to an instruction from the control device 170, for example, by controlling the operation of pixels based on data output by the control device 170. Examples of the display device 140 include a display and a projector.

[0022] In this embodiment, an image output by the display device 140 (sometimes referred to as an output image) is displayed in the display area 142. In this embodiment, the display area 142 is disposed in the housing 130. In this embodiment, the display area 142 is disposed on approximately the same surface as at least a portion of the environmental sensor 150.

[0023] In this embodiment, the environmental sensor 150 acquires various information related to the surrounding environment of the display area 142. The environmental sensor 150 may include one or more sensors for acquiring the above-mentioned various information. Examples of the above-mentioned sensors include a sensor for acquiring various images, a sensor for acquiring sound, a sensor for detecting brightness, a sensor for detecting temperature, a sensor for detecting distance or depth, a receiver for receiving wireless signals, and the like. The information acquired or generated by the one or more sensors included in the environmental sensor 150 is output to the control device 170, for example.

[0024] In this embodiment, the distance sensor 152 measures the distance between the distance sensor 152 and each of one or more objects arranged around the display area 142. Examples of the periphery of the display area 142 include positions within the range of the viewing angle of the display area 142, and positions whose distance from the display area 142 is within a predetermined numerical range. The distance sensor 152 may acquire point cloud data of each of the above objects. The point cloud data may be three-dimensional point cloud data.

[0025] In addition, the relative positional relationship between the display area 142 and the distance sensor 152 is known. Therefore, the distance sensor 152 may derive the distance between the display area 142 and each of the above-mentioned objects based on the distance between the distance sensor 152 and each of the above-mentioned objects and the relative positional relationship between the display area 142 and the distance sensor 152.

[0026] Distance sensor 152 may detect the approach of a user of user terminal 120 to display device 140 or display area 142. For example, distance sensor 152 measures the distance between the user of user terminal 120 and display device 140 or display area 142. When the distance between the user of user terminal 120 and display device 140 or display area 142 becomes smaller than a predetermined value, distance sensor 152 may detect the approach of the user to the image display device.

[0027] The principle and / or details of the procedure by which the distance sensor 152 measures the above-mentioned distance are not particularly limited. Examples of the distance sensor 152 include (i) a sensor that captures an image, and (ii) a sensor that measures the distance to an object by using sound waves, ultrasonic waves, electromagnetic waves, lasers, etc. Examples of the distance sensor 152 include a stereo camera, a monocular camera depth distance measurement device (sometimes referred to as a monocular depth estimation device), LiDAR, a non-contact proximity sensor, etc. An optical member such as a fisheye lens or an ultra-wide-angle lens may be attached to the above-mentioned camera.

[0028] In this embodiment, the camera 154 captures an image of the periphery of the display area 142. The image may be a still image or a moving image. Details of the camera 154 are not particularly limited. The camera 154 may be an image sensor for capturing a two-dimensional image, or an infrared camera for capturing an infrared image (sometimes referred to as a thermal image). The camera 154 may be a monocular camera or a stereo camera. The camera 154 may be a 180-degree camera or a 360-degree camera. In addition, when the distance sensor 152 includes an image sensor, the user terminal 120 does not need to include the camera 154.

[0029] In this embodiment, the radio wave detector 156 detects radio waves of a wireless signal. The radio wave detector 156 may measure the strength of the wireless signal. Examples of the wireless signal include a GPS signal, a WiFi (registered trademark) signal, and a Bluetooth (registered trademark) signal. As a result, for example, the control device 170 can analyze the detected radio waves to estimate the installation position of the display area 142.

[0030] In this embodiment, the input device 160 accepts input from the user of the user terminal 120. Examples of the above input include input related to the operation and / or settings of the user terminal 120, input related to the operation and / or settings of various programs running on the user terminal 120, and input related to the content of the work executed by the programs. The input device 160 outputs information input by the user to the input device 160 to the control device 170. Examples of the input device 160 include a keyboard, a pointing device, a touch panel, a camera, and a microphone.

[0031] In this embodiment, the control device 170 controls the user terminal 120. The control device 170 executes various types of information processing in the user terminal 120. Details of the control device 170 will be described later.

[0032] The information processing method may be a method for generating a display image to be displayed on an image display device by concealing a part of a generated image generated by an image generating device. Each step of the information processing method may be executed by, for example, a computer.

[0033] In one embodiment, the method includes, for example, an image acquisition step of acquiring a generated image, which is an image generated by an image generation device. The method includes, for example, a division step of dividing the generated image into a plurality of sections. The method includes, for example, a value derivation step of deriving a value of information contained in each section for at least a portion of the plurality of sections. The method includes, for example, a work position identification step of identifying a work position. In the method, the work position is one or more positions or ranges arranged in a portion of the generated image, and is (i) a position or range of an input by a user of the image display device, and / or (ii) a position or range of the user's line of sight. The method includes, for example, a target area determination step of determining a target area, which is an area to be concealed, based on the value derived in the value derivation step and the work position identified in the work position identification step.

[0034] In another embodiment, the method includes a work position identification step of identifying a work position, which is, for example, one or more positions or ranges located in a part of the generated image and designated or referenced by a user of the image display device.The method includes, for example, a target area determination step of determining a target area, which is an area to be concealed, based on the work position identified in the work position identification step.The method includes, for example, a work area determination step of determining a work area, which is an area located in a part of the generated image and includes the work position.

[0035] (Outline of original image 200 and output image 300) 2 and 3, the original image 200 and the output image 300 will be described in detail, taking as an example a case where a window 210 is displayed full screen when a program for concealing a part of the original image 200 (sometimes referred to as a concealment program) is executed. As described above, in this embodiment, the information leakage prevention system 100 (i) first generates an original image 200 that has not been subjected to concealment processing, and (ii) then conceals at least a part of the original image 200 to generate an output image 300 to be presented to a user. The output image 300 includes an area (sometimes referred to as a concealment area) in which at least a part of information to be presented to a user (sometimes referred to as presented information) is concealed.

[0036] 2, in this embodiment, an original image 200 has an image of a full-screen displayed window 210. In this embodiment, the window 210 includes a control area 212 and an image output area 214.

[0037] As described above, the window 210 corresponds to the anonymization program. The original image 200 shows an example of a screen displayed in the display area 142 after the anonymization program has been started up and in a state in which the anonymization program is not executing an anonymization process.

[0038] In this embodiment, one or more objects for displaying various information related to control of the window 210 and / or control of the concealment program are arranged in the control area 212. For example, the control area 212 has an object 222 for presenting to the user operations (sometimes referred to as a menu) available to the user, and an object 224 for presenting to the user ON / OFF of the concealment process.

[0039] The control area 212 may have an object (not shown) for presenting the name of the concealed program (sometimes called the title) to the user, an object (not shown) for allowing the user to change the size of the window 210, and an object (not shown) for allowing the user to select whether to display or hide the window 210.

[0040] In this embodiment, the image output area 214 displays, for example, a background image (not shown) generated by the OS, presentation information 216 which is information presented to the user by the OS, and images of a window 230 and a window 240 corresponding to a program or file other than the OS and the concealment program. In this embodiment, the window 230 includes a control area 232, an image output area 234, and presentation information 236. In this embodiment, the window 240 includes a control area 242, an image output area 244, and presentation information 246.

[0041] In this embodiment, the control area 232 has one or more objects arranged therein for displaying various information relating to the control of the window 230 and / or the control of the program or file corresponding to the window 230. The image output area 234 displays presentation information 236, which is information presented to the user by the program or file corresponding to the window 230.

[0042] In this embodiment, the control area 242 has one or more objects arranged therein for displaying various information relating to the control of the window 240 and / or the control of the program or file corresponding to the window 240. The image output area 244 displays presentation information 246, which is information presented to the user by the program or file corresponding to the window 230.

[0043] 3, in this embodiment, the output image 300 has an image of the window 210 displayed full screen. In this embodiment, the window 210 includes a control area 212 and an image output area 214.

[0044] As described above, the window 210 corresponds to the anonymization program. The output image 300 shows an example of a screen displayed in the display area 142 in a state in which the anonymization program is executing an anonymization process after the anonymization program has been started up.

[0045] In this embodiment, one or more objects for displaying various information related to the control of the window 210 and / or the control of the concealment program are arranged in the control area 212. According to this embodiment, in addition to the object 222 and the object 224, the control area 212 is arranged with an object 326 for presenting the operation mode of the concealment process to the user, and an object 328 for presenting the aspect and / or strength of the concealment process to the user.

[0046] In this embodiment, one or more objects 318 for concealing at least a portion of the presented information 216 are arranged in the image output area 214. Similarly, one or more objects 338 for concealing at least a portion of the presented information 236 are arranged in the image output area 234. Furthermore, one or more objects 348 for concealing at least a portion of the presented information 246 are arranged in the image output area 244.

[0047] The images of these objects are not particularly limited as long as they can conceal the image of the original image 200. The degree of concealment (sometimes called strength) may be determined by initial settings, or may be determined by the administrator or user as described above. The images of these objects will be described in detail later.

[0048] In this embodiment, a viewing area 360 for the user to view information included in the original image 200 is set in the output image 300. One or more viewing areas 360 may be set in the output image 300. The viewing area 360 is set, for example, so as to include one or more viewing positions 362 that are positions or ranges where the degree to which the user who is working requests viewing is estimated to exceed a predetermined level. An object may be placed on the inner and outer boundaries of the viewing area 360 to indicate the boundary, or the object may not be placed.

[0049] According to one embodiment, no anonymization process is performed within the viewing area 360. This allows the user to view the information located within the viewing area 360. As a result, the user can continue working even during the period when anonymization process is being performed.

[0050] According to another embodiment, the anonymization process is also performed inside the viewing area 360. In this case, the degree of anonymization inside the viewing area 360 may be weaker than the degree of anonymization outside the viewing area 360. This allows the user to view the information arranged inside the viewing area 360. On the other hand, the information arranged inside the viewing area 360 can be prevented from being viewed by people other than the user who are in the vicinity of the display area 142.

[0051] According to still another embodiment, the necessity of concealment processing inside the viewing area 360 is switched depending on the state of the user. For example, the control device 170 analyzes an image of the user captured by the camera 154 to determine whether an event related to the state of the user has occurred. If it is determined that the above-mentioned event has not occurred, the control device 170 determines whether or not concealment processing inside the viewing area 360 is necessary depending on the various embodiments described above. On the other hand, if it is determined that the above-mentioned event has occurred, the control device 170 decides to conceal the inside of the viewing area 360. Examples of the above-mentioned event include an event that the user has closed their eyes, an event that a saccade has occurred, and the like.

[0052] Viewing position 362 may be a position or range located on a portion of original image 200. In one embodiment, viewing position 362 may be a position or range specified or referenced by a user. In other embodiments, viewing position 362 may be (i) a position or range of user input and / or (ii) a position or range of a user's line of sight. In yet other embodiments, viewing position 362 may be a position or range pointed to by a user's finger, hand, or arm (which may be referred to as a user's finger, etc.).

[0053] The position of the user's input is exemplified by the position of a pointer, a cursor, etc. The range of the user's input is exemplified by the range selected by a pointer, a cursor, etc. The device used for the above input is not particularly limited. Examples of the above device include a keyboard, a pointing device, a microphone (voice input), a gesture recognition device (gesture input), etc. The position or range of the user's gaze is determined, for example, by the control device 170 analyzing an image of the user captured by the camera 154.

[0054] The position pointed by the user's finger or the like is determined, for example, by the control device 170 analyzing data of the user's finger or the like acquired by a gesture recognition device. Examples of the gesture recognition device include a camera (for example, the camera 154) and a LiDAR (for example, the distance sensor 152).

[0055] More specifically, the control device 170 first analyzes data of the user's finger etc. acquired by the gesture recognition device to determine the relative positional relationship between the user's finger etc. and the representative point of the user terminal 120. The control device 170 also analyzes the above data to determine the posture of the user's finger etc. Next, the control device 170 specifies the position pointed to by the user's finger, hand or arm in the display area 142 of the display device 140 based on the above relative positional relationship and the posture of the user's finger etc.

[0056] The range pointed by the user's finger or the like may be (i) an area including the position pointed by the user's finger, hand, or arm, and (ii) a predetermined shape and / or size. The range pointed by the user's finger or the like may be adjusted according to the relative positional relationship between the user's finger or the like and the representative point of the user terminal 120.

[0057] Comparing a case where the control device 170 determines the viewing position 362 based on the position or range pointed to by the user's finger, etc., with a case where the control device 170 determines the viewing position 362 based on the position or range of the user's line of sight, the accuracy of the viewing position 362 is improved by the control device 170 determining the viewing position 362 based on the position or range pointed to by the user's finger, etc. As a result, the user experience is improved.

[0058] The information leakage prevention system 100 may be an example of an information processing device. The user terminal 120 may be an example of an information processing device. The display device 140 may be an example of an image display device. The environment sensor 150 may be an example of a proximity detection unit. The distance sensor 152 may be an example of a proximity detection unit. The control device 170 may be an example of an image generating device or an information processing device. The original image 200 may be an example of a generated image. The output image 300 may be an example of a display image. The object 318 or the area where the object 318 is arranged may be an example of a target area. The object 338 or the area where the object 338 is arranged may be an example of a target area. The object 348 or the area where the object 348 is arranged may be an example of a target area. The viewing area 360 may be an example of a working area. The viewing position 362 may be an example of a working position.

[0059] (An example of another embodiment) In this embodiment, the information leakage prevention system 100 has been described in detail by taking as an example a case in which the user terminal 120 conceals a part of the original image 200 to generate the output image 300. However, the information leakage prevention system 100 is not limited to this embodiment. In other embodiments, the user terminal 120 may be configured to be able to communicate with another computer arranged outside the user terminal 120, and may execute the various information processes described above in cooperation with the other computer. For example, at least a part of the control device 170 may be realized by the other computer.

[0060] In the present embodiment, the details of the information leakage prevention system 100 have been described by taking as an example a case where the display area 142 and the environmental sensor 150 are arranged on approximately the same plane. However, the information leakage prevention system 100 is not limited to the present embodiment. In other embodiments, at least one of the display area 142 and the environmental sensor 150 may be arranged outside the housing 130 as long as the relative positional relationship between the display area 142 and the environmental sensor 150 can be specified.

[0061] In this embodiment, the details of the information leakage prevention system 100 have been described by taking as an example a case in which the above-mentioned concealment object 318, object 338, and object 348 are arranged in a part of the image output area 214, and the viewing area 360 is arranged in another part of the image output area 214. However, the information leakage prevention system 100 is not limited to this embodiment. In other embodiments, the image output area 214 may be entirely concealed except for the inside of the viewing area 360. The concealment object may be referred to as a concealment object.

[0062] In the present embodiment, the information leakage prevention system 100 has been described in detail by taking as an example a case where there is a single legitimate user who can receive the presentation information output by the user terminal 120. However, the information leakage prevention system 100 is not limited to the present embodiment. In other embodiments, there may be a plurality of legitimate users who can receive the presentation information output by the user terminal 120. In this case, a plurality of viewing areas 360 corresponding to the plurality of users may be arranged on the screen displayed in the display area 142.

[0063] For example, there is a case where user A and user B view an image displayed in display area 142 while user A operates user terminal 120. Control device 170 determines one or more viewing positions 362 corresponding to user A and one or more viewing positions 362 corresponding to user B according to a procedure similar to that in the case where there is a single user. Control device 170 also determines the range of one or more viewing areas 360 corresponding to user A and the range of one or more viewing areas 360 corresponding to user B according to a procedure similar to that in the case where there is a single user.

[0064] Any known authentication method may be adopted as a method for authenticating each of user A and user B as a legitimate user. The control device 170 may distinguish between a person who is a legitimate user and a person who is not a legitimate user according to the distance from the user terminal 120.

[0065] In this embodiment, the details of the information leakage prevention system 100 are described by taking as an example a case where the above-mentioned concealment process is executed while the concealment process function is enabled. However, the information leakage prevention system 100 is not limited to this embodiment. In another embodiment, the information leakage prevention system 100 executes the above-mentioned concealment process while (i) the concealment process function is enabled and (ii) peeping from a person who is not a legitimate user is detected. This improves the user experience. Any known method may be adopted to detect peeping from a person who is not a legitimate user.

[0066] In the present embodiment, the details of the information leakage prevention system 100 have been described by taking as an example a case in which the information leakage prevention system 100 manages information presented by an image displayed in a single display area 142. However, the information leakage prevention system 100 is not limited to the present embodiment.

[0067] In another embodiment, the information leakage prevention system 100 may manage information presented by images displayed on the multiple display areas 142. For example, the user terminal 120 includes multiple display devices 140 or display areas 142, and the control device 170 manages the generation and / or display of screens displayed on each of the multiple display devices 140 or display areas 142.

[0068] More specifically, the control device 170 may control the color, pattern, and / or range of one or more concealment objects arranged on the display screen of each of the multiple display devices 140 or display areas 142, and may control the range of one or more viewing areas arranged on the display screen of each of the multiple display devices 140 or display areas 142. For example, when the user's line of sight is located inside the first display area 142 and a cursor or pointer is arranged in the second display area 142, one or more first viewing areas are arranged inside the first display area 142, and one or more second viewing areas are arranged inside the second display area 142. Thereby, for example, a screen in which the viewing areas are arranged can be displayed on each of the multiple display devices 140 or display areas 142.

[0069] Examples of the range of an object include the position of the object in display area 142, the size of the object, and / or the shape of the object. Examples of the range of a viewing area include the position of the viewing area in display area 142, the size of the viewing area, and / or the shape of the viewing area.

[0070] In still another embodiment, the control device 170 may control the manner of information concealment in each of the multiple display devices 140 or display areas 142. The control device 170 controls the manner of information concealment, for example, so that the manner of information concealment in a display device or display area in which the position and / or range of the user's gaze is located differs from the manner of information concealment in a display device or display area in which the position and / or range of the user's gaze is not located. The control device 170 may control the manner of information concealment so that the strength of information concealment in a display device or display area in which the position and / or range of the user's gaze is located is greater than the strength of information concealment in a display device or display area in which the position and / or range of the user's gaze is not located.

[0071] (Overview of the masking process) Fig. 4 shows an example of information processing in the control device 170. Specifically, an example of the above-mentioned anonymization processing will be described with reference to Fig. 4. According to this embodiment, first, in step 422 (step may be abbreviated as S), the control device 170 starts the above-mentioned anonymization program.

[0072] As a result, the window 210 corresponding to the masking program is displayed in full screen in the foreground. The image displayed in the window 210 immediately after the masking program is started is generated based on, for example, settings related to the masking program.

[0073] (a) When the setting related to the anonymization program indicates that a predetermined image or an image generated or selected by a predetermined algorithm is to be displayed immediately after the start, the control device 170 displays the image in the display area 142. (b) When the setting related to the anonymization program indicates that anonymization processing is not required immediately after the start, the control device 170, for example, determines to display the original image 200 in the display area 142. (c) When the setting related to the anonymization program indicates that anonymization processing is required immediately after the start, the control device 170, for example, determines to anonymize at least a part of the original image 200 according to the setting related to the anonymization program. The control device 170, for example, determines to display the output image 300 in the display area 142. In this case, the details of the anonymization processing (for example, the target and manner of anonymization) may be determined based on the above-mentioned setting.

[0074] In one embodiment, the start-up process of the anonymization program is automatically executed upon start-up of the user terminal 120. In another embodiment, the start-up process of the anonymization program is executed in response to an instruction from a user.

[0075] In still another embodiment, when it is not confirmed that the user terminal 120 is located within a predetermined area, the activation process of the concealment program may be automatically executed. Examples of the predetermined area include an area where the administrator of the user terminal 120 permits the use of the user terminal 120, a room used by an organization to which the user belongs, the user's office, the user's home, etc. Whether or not the user terminal 120 is located within the predetermined area may be determined based on an image of the surroundings of the display area 142 captured by the camera 154, or based on information included in a wireless signal detected by the radio wave detector 156.

[0076] Next, in S424, the control device 170 determines the target of anonymization. For example, the control device 170 determines an operation mode related to the target of anonymization. Examples of the operation mode related to the target of anonymization include (a) a mode in which anonymization is performed in principle, and anonymization is not performed exceptionally in an area estimated to be necessary for the user's work (sometimes referred to as a first mode), and (b) a mode in which anonymization is not performed in principle, and anonymization is performed exceptionally in an area estimated to be viewed by a person other than the user who is present near the display area 142 (sometimes referred to as a second mode).

[0077] In this embodiment, in order to facilitate understanding of the information leakage prevention system 100, the details of the information leakage prevention system 100 will be described by taking as an example a case where the control device 170 operates in the first mode. The control device 170 can be configured to be able to change the operation mode related to the object of anonymization in response to, for example, an instruction from an administrator or a user.

[0078] Thereafter, the control device 170 executes a process for generating an image for updating the display screen of the display area 142. For example, first, in S432, the control device 170 generates an original image 200. The control device 170 generates the original image 200 based on, for example, an output from the OS and / or an application program other than the concealment program.

[0079] Next, in S434, the control device 170 analyzes the original image 200 and extracts one or more pieces of presentation information included in the original image 200. Examples of the presentation information include at least one selected from a group consisting of a character string, a picture, a diagram, a table, a photograph, and a video, as well as some of these. The control device 170 generates a database (sometimes referred to as a value map) that stores information indicating the range that each of the one or more pieces of presentation information occupies in the original image 200 and information indicating the value of each of the one or more pieces of presentation information in association with each other. The value map will be described in detail later.

[0080] Next, in S436, the control device 170 determines the extent of the viewing area 360 described above. In one embodiment, the control device 170 determines the extent of the viewing area 360 based on, for example, a position or range specified or referenced by a user. In another embodiment, the control device 170 determines the extent of the viewing area 360 by, for example, analyzing the user's line of sight and / or operation. The procedure for determining the extent of the viewing area 360 will be described in detail later.

[0081] The control device 170, for example, acquires information indicating the viewing position 362 specified by the user via any device used by the user. This allows the control device 170 to determine the position or range specified by the user. The viewing position 362 or the range of the viewing area 360 determined by analyzing the user's operation may be an example of the position or range specified by the user.

[0082] The control device 170 acquires information indicating the user's movement, voice, and / or gaze from, for example, the environmental sensor 150. The control device 170 estimates the viewing position 362 based on the user's movement, voice, and / or gaze. This allows the control device 170 to determine the position or range referred to by the user. The viewing position 362 or the range of the viewing area 360 determined by analyzing the user's gaze may be an example of the position or range referred to by the user.

[0083] Next, in S438, the control device 170 determines the range of the concealment area described above. As described above, the user cannot view the presented information arranged inside the concealment area.

[0084] In one embodiment, the control device 170 determines the range of the anonymized area based on the range of the viewing area 360. The control device 170, for example, determines to make all or part of the outside of the viewing area 360 the anonymized area. The control device 170 may determine not to provide an anonymized area inside the viewing area 360. In another embodiment, the control device 170 determines the range of the anonymized area based on a value map. The control device 170, for example, determines the range of the anonymized area so that information having a value exceeding a predetermined standard is anonymized. In yet another embodiment, the control device 170 determines the range of the anonymized area based on the range of the viewing area 360 and the value map. The control device 170, for example, uses a first criterion for determining the range of the anonymized area inside the viewing area 360 and a second criterion for determining the range of the anonymized area outside the viewing area 360 to determine the range of the anonymized area so that information having a value exceeding each standard is anonymized.

[0085] Furthermore, the control device 170 determines the manner of concealment for each of the one or more concealment regions. Examples of the manner of concealment include the type of concealment processing (sometimes referred to as a concealment method), the strength of the concealment processing, etc. The control device 170 can make the presented information invisible or difficult to see by adjusting the manner of the concealment processing.

[0086] Examples of the types of concealment include a conversion process to another image, and a superimposition process of another image. Examples of the conversion process to another image include a mosaic process, a blurring process, and a mixing process. Examples of the strength of the concealment process include a degree of mixing of another image, a degree of superimposition of another image, a transmittance of the superimposed image, a display size of the presented information (e.g., a character size), a contrast of the presented information, a color of the presented information and background, and a brightness of the screen or a part of the screen. Examples of the degree of mixing of another image include a fineness of the mosaic, a strength of blurring, and the like.

[0087] For example, in the output image 300 described with reference to Fig. 3, an object 318, an object 338, and an object 348 are arranged in the concealed region. This conceals the presentation information 216, the presentation information 236, and the presentation information 246 in the original image 200 described with reference to Fig. 2. The presentation information concealed by each object may be referred to as the presentation information corresponding to each object.

[0088] As described above, for example, an image obtained by mosaic processing an image of presentation information corresponding to each object (sometimes referred to as a mosaic processed image) is used as the image of each object in the output image 300. By arranging the above-mentioned mosaic processed image at the position of each object in the output image 300, an output image 300 in which important presentation information is concealed is obtained.

[0089] Next, in S442, the control device 170 performs a concealment process on the concealment area of ​​the original image 200 to generate the output image 300. Also, in S444, the control device 170 controls the display device 140 to display the output image 300 in the display area 142. The control device 170 repeats the processes of S432 to S444. In this way, the concealment process is executed.

[0090] 5 is a schematic diagram showing an example of the internal configuration of the control device 170. In this embodiment, the control device 170 includes, for example, a setting information storage unit 520, a program control unit 532, a window control unit 534, an input control unit 540, and an output control unit 550. In this embodiment, the output control unit 550 includes an original image generation unit 560, a window information acquisition unit 572, a line of sight information acquisition unit 574, an operation information acquisition unit 576, and an image processing unit 580. In this embodiment, the image processing unit 580 includes a value map generation unit 582, a concealment processing unit 584, a leakage prevention support unit 586, and an output image generation unit 588.

[0091] In this embodiment, the setting information storage unit 520 stores information (sometimes referred to as setting information) on various settings of the information leakage prevention system 100 and / or the user terminal 120. The setting information includes, for example, information on the settings of the anonymization program. Examples of the settings of the anonymization program include (i) settings on the necessity or target of anonymization by the anonymization program and / or the mode of the anonymization, and (ii) various settings on the processing immediately after the anonymization program is started.

[0092] In this embodiment, the program control unit 532 controls various programs that operate on the user terminal 120. The program control unit 532 may control the start-up process of the above programs, may control the operation of the above programs, or may control the termination process of the above programs.

[0093] In this embodiment, the window control unit 534 executes various controls related to windows corresponding to various programs operating on the user terminal 120. The window control unit 534 outputs, for example, various information related to the above-mentioned windows (sometimes referred to as window information) to the window information acquisition unit 572. Examples of the window information include information indicating the range of the window on the screen (e.g., position, shape, size, etc.), information regarding various objects arranged in the window, and information indicating the type of flag assigned to the window. Examples of the above-mentioned flag include no copying, no screenshot, no capture, etc.

[0094] In this embodiment, the input control unit 540 controls various types of information input to the user terminal 120. In one embodiment, the input control unit 540 acquires data output by the environment sensor 150. The input control unit 540 acquires, for example, image data output by the camera 154, and outputs the image data to the line of sight information acquisition unit 574.

[0095] In another embodiment, the input control unit 540 controls the operation of the input device 160. The input control unit 540 receives, for example, various instructions input by the user to the input device 160. Examples of the instructions include instructions regarding the operation of the user terminal 120, and instructions for various programs running on the user terminal 120. This allows the input control unit 540 to specify, for example, the position or range of an input by the user.

[0096] The input control unit 540 outputs, for example, the above instruction to the operation information acquisition unit 576. The input control unit 540 may output information indicating the position or range of an input by the user to the operation information acquisition unit 576. The input control unit 540 may output information indicating the content input by the user to the input device 160 to the operation information acquisition unit 576.

[0097] In this embodiment, the output control unit 550 controls the output of information presented to the user. In one embodiment, the output control unit 550 controls the output of image information. In another embodiment, the output control unit 550 controls the output of audio information.

[0098] In this embodiment, the original image generating unit 560 generates the original image 200. In this embodiment, the window information acquiring unit 572 acquires window information relating to each of the one or more windows included in the original image 200 from the window control unit 534.

[0099] In this embodiment, the gaze information acquisition unit 574 acquires an image of the user captured by the camera 154 from the input control unit 540. The gaze information acquisition unit 574 analyzes the image of the user to identify the position and / or range of the gaze in the original image 200. Any known method may be adopted as a method for identifying the position and / or range of the gaze.

[0100] In one embodiment, the gaze information acquisition unit 574 analyzes the image to identify a normal vector of the user's face. The gaze information acquisition unit 574 estimates the position and / or range of the user's gaze in the original image 200 using the normal vector of the user's face. In another embodiment, the gaze information acquisition unit 574 analyzes the image to identify a normal vector of the user's iris. The gaze information acquisition unit 574 estimates the position and / or range of the user's gaze in the original image 200 using the normal vector of the user's iris.

[0101] In this embodiment, the operation information acquisition unit 576 acquires various pieces of information (sometimes referred to as operation information) that the user inputs to the input device 160 from the input control unit 540. As described above, examples of the operation information include (i) information indicating various instructions or contents that the user inputs to the input device 160, and (ii) information indicating the position or range of the input by the user.

[0102] In this embodiment, the image processing unit 580 conceals a part of the original image 200 generated by the original image generation unit 560, and generates an output image 300 to be displayed in the display area 142 of the display device 140. The image processing unit 580 may control the operation of the display device 140 to cause the output image 300 to be displayed in the display area 142.

[0103] In this embodiment, the value map generating unit 582 generates the above-mentioned value map. Details of the value map generating unit 582 will be described later. In this embodiment, the anonymization processing unit 584 executes the above-mentioned anonymization processing. Details of the anonymization processing unit 584 will be described later.

[0104] The leakage prevention support unit 586 executes various processes (sometimes referred to as support processes) for preventing information leakage. Examples of the support processes include (a) a process for encouraging the user to take a specific action for preventing information leakage, (b) a process for causing the control device 170 to execute a specific information process for preventing information leakage, and (c) a process for outputting a sound indicating the status of the concealment process by the control device 170.

[0105] The specific action is exemplified by changing the physical position and / or attitude of the user terminal 120. For example, the user can change the physical attitude of the user terminal 120 by rotating the user terminal 120 clockwise or counterclockwise. The specific information processing is exemplified by (i) a process for changing the position, shape, and / or size of the viewing area 360 in the display area 142, (ii) a process for changing the target and / or mode of anonymization when the length of a period during which no input from the user is detected exceeds a predetermined value, and (iii) a process for changing the target and / or mode of anonymization between one display area 142 and another display area 142 when the user terminal 120 has multiple display areas 142.

[0106] In one embodiment, the leakage prevention support unit 586 analyzes the image captured by the camera 154 to determine whether or not two or more people are present around the display area 142. For example, even if another person is present behind the user, the user may rotate the user terminal 120, making it difficult for the other person to view the display area 142. Therefore, when it is determined that two or more people are present around the display area 142, the leakage prevention support unit 586 executes a process for prompting the user to change the orientation of the user terminal 120 (for example, the orientation of the normal vector of the display area 142). For example, the leakage prevention support unit 586 controls the output image generation unit 588 to generate and output an image for suggesting the rotation direction of the user terminal 120.

[0107] In another embodiment, the leakage prevention support unit 586 automatically adjusts the range of the viewing area 360. Examples of the range of the viewing area 360 include the position, shape, and / or size of the viewing area 360 in the display area 142. For example, even if another person is present behind the user, the line of sight of the other person to the vicinity of the center of the display area 142 is blocked by the body of the user. Therefore, the other person cannot view the presented information arranged in the vicinity of the center of the display area 142. Therefore, for example, when the viewing area 360 is arranged at the end of the display area 142, the leakage prevention support unit 586 controls the output image generation unit 588 to move the information arranged inside the viewing area 360 to the vicinity of the center of the display area 142. This can guide the user's line of sight.

[0108] In still another embodiment, when the length of the period during which the input control unit 540 does not detect an input from the user exceeds a predetermined value, the leakage prevention support unit 586 decides to cancel the setting of the viewing area 360. This changes the target of concealment. Furthermore, the leakage prevention support unit 586 controls the output image generation unit 588 to update the screen displayed in the display area 142. Since the viewing area 360 does not exist on the updated screen, all of the presented information arranged in the display area 142 can be automatically concealed. Note that at least a part of the presented information (for example, highly valuable presented information described later) may be automatically concealed.

[0109] In still another embodiment, when the user terminal 120 has a plurality of display areas 142, the leakage prevention support unit 586 determines not to set the viewing area 360 for displays (sometimes referred to as sub-displays) other than the main display. This allows at least a part of the presented information (e.g., highly valuable presented information described later) displayed on the sub-display to be automatically concealed.

[0110] For example, when control device 170 outputs an image to a display built into housing 130 of user terminal 120 and to a projector connected to user terminal 120, viewing area 360 is set in the image output to the display, and viewing area 360 is not set in the image output to the projector. As a result, for example, in the image displayed on the display, the presentation information arranged inside viewing area 360 is not concealed. On the other hand, for example, in the image projected onto the screen by the projector, all the presentation information is concealed.

[0111] In still another embodiment, when the user terminal 120 has a plurality of display areas 142, the leakage prevention support unit 586 monitors whether or not an input from the user is detected for each of the plurality of display areas 142. When the length of a period during which no input from the user is detected for at least one display area 142 exceeds a predetermined value, the leakage prevention support unit 586 decides to cancel the setting of the viewing area 360 in the above-mentioned display area 142. In addition, the leakage prevention support unit 586 updates the screen displayed in the above-mentioned display area 142, and displays a screen on which the concealment process has been performed in the display area 142. As a result, for example, at least a part of the presented information (for example, highly valuable presented information described later) displayed on a display on which no input from the user is detected for a relatively long period of time can be automatically concealed.

[0112] In still another embodiment, the leakage prevention support unit 586 may transmit the content of the concealed presentation information by voice. The leakage prevention support unit 586 may transmit the reason why the presentation information is concealed by voice. The leakage prevention support unit 586 may output the voice information via a directional speaker, earphones, or headphones arranged in the user terminal 120.

[0113] In this embodiment, the output image generation unit 588 generates an image in which at least a part of the original image 200 generated by the original image generation unit 560 has been subjected to concealment processing by the concealment processing unit 584. The output image generation unit 588 may generate an image in which at least a part of the original image 200 generated by the original image generation unit 560 has been subjected to support processing by the leakage prevention support unit 586. The output image generation unit 588 may generate an image in which at least a part of the original image 200 generated by the original image generation unit 560 has been subjected to concealment processing by the concealment processing unit 584 and support processing by the leakage prevention support unit 586.

[0114] As a result, output image 300 is generated. Output image generation unit 588 controls the operation of display device 140 to display the generated output image 300 in display area 142. Note that user terminal 120 may output images to display device 140, which presents information to the user of user terminal 120, and to a device (sometimes referred to as "other device") different from display device 140. In this case, it may be the case that the concealment of information is not required in the other device.

[0115] Therefore, in one embodiment, when the user terminal 120 outputs an image to the other device in response to an explicit instruction from the user, the output image generating unit 588 may output the original image 200 instead of the output image 300. The user terminal 120 may include a first memory (sometimes referred to as VRAM) for storing the output image 300, and a second memory (sometimes referred to as VRAM) that is different from the first memory and for storing the original image 200.

[0116] In another embodiment, when user terminal 120 outputs an image to the other device in response to an explicit instruction from the user, output image generating unit 588 may output an image with a lower degree of concealment to the other device as compared with output image 300 output to display device 140. User terminal 120 may include a first memory (sometimes referred to as VRAM) for storing the image to be output to display device 140, and a second memory (sometimes referred to as VRAM) that is different from the first memory and for storing the image to be output to the other device.

[0117] For example, when a screen capture process is executed in response to an instruction from a user, the output image generation unit 588 may control the operation of the display device 140 to display the original image 200. Similarly, when a screen sharing process or a desktop sharing process is executed in response to an instruction from a user, the output image generation unit 588 may control the operation of the display device 140 to display the original image 200.

[0118] The input control unit 540 may be an example of a work position identification unit. The output control unit 550 may be an example of an image generating device or an information processing device. The original image generating unit 560 may be an example of an image generating device. The image processing unit 580 may be an example of an information processing device.

[0119] 6 shows an example of an internal structure of the value map generating unit 582. In this embodiment, the value map generating unit 582 includes a high value area determining unit 622 and a value determining unit 624.

[0120] In this embodiment, the high value area determination unit 622 analyzes the original image 200 and determines the range of an area (sometimes referred to as a high value area) that includes the presentation information in the original image 200. The high value area determination unit 622 may determine the range of the high value area in the original image 200 by using a known pattern recognition technique, an image recognition technique, and / or a natural language processing technique.

[0121] Examples of the range of the high value area include the position, shape, and size of the high value area in the original image 200. The range of one or more high value areas included in the original image 200 is determined, thereby dividing the original image 200 into a plurality of sections. Even if the number of high value areas included in the original image 200 is one, the image may be divided into two sections: the high value area and an area other than the high value area.

[0122] The presented information is exemplified by at least one selected from the group consisting of a character string, a picture, a diagram, a table, a photograph, a video, and parts thereof. Examples of parts of a character string include proper nouns, verbs, subjects of the verbs, and objects of the verbs contained in the character string. Examples of parts of a picture, a photograph, or a video include a human face.

[0123] In this embodiment, the value determination unit 624 determines the value of the presentation information included in each high value region for at least one of the one or more high value regions. For example, for at least one high value region included in the original image 200, the value determination unit 624 derives the value of the presentation information included in each high value region based on at least one of (a) the type of presentation information included in each high value region, (b) the operation history of the pointing device by the user in each high value region, (c) the tracking history of the user's gaze in each high value region, (d) the flag assigned to the window to which each high value region belongs, (e) the type of application that displays information in the window to which each high value region belongs, and (f) the URI of the information displayed in the window to which each high value region belongs.

[0124] The value determination unit 624 may determine the value of each piece of presentation information based on the type of each piece of presentation information. The value determination unit 624 determines the value of the presentation information included in each high value area based on, for example, a score predetermined for each type of presentation information. Examples of the type of presentation information include a character string, a picture, a diagram, a table, a photo, and a video. The type of presentation information may be a proper noun, a verb, a subject of the verb, an object of the verb, a human face, and the like.

[0125] The value determination unit 624 may determine the value of each piece of presentation information based on the type of operation of the pointing device performed on each piece of presentation information. The value determination unit 624 determines the value of the presentation information included in each high value area based on a score that is predetermined for each operation of the pointing device by the user, for example.

[0126] For example, the presented information included in an area where the frequency of the user's click operation is greater than a predetermined value is presumed to be information of high value to the user. Similarly, the presented information included in an area selected by the user's drag operation is presumed to be information of high value to the user. By assigning a score to each operation of the pointing device by the user, information of high value to the user can be extracted.

[0127] The value determination unit 624 determines the value of the presented information included in each high value area based on, for example, the length of time the user's gaze stays on the area. For example, the presented information included in an area where the user's gaze stays for a long time is estimated to be highly valuable to the user.

[0128] The value determination unit 624 may determine the value of the presented information included in a window based on the type of flag assigned to the window. The value determination unit 624 determines the value of the presented information included in each window based on, for example, a score predetermined for each of the above flags. For example, information displayed in a window to which a flag such as "no copying" or "no screenshots" is assigned is presumed to be information of high value to the user.

[0129] The value determining unit 624 may determine the value of the presented information included in a window based on the type of application that displays information in the window. The value determining unit 624 determines the value of the presented information included in each window based on a score that is predetermined for each of the above application types, for example.

[0130] For example, information displayed by a calculator application program is presumed to be of low value to the user, whereas information displayed by a spreadsheet, presentation, or document creation application program is presumed to be of high value to the user.

[0131] The value determining unit 624 may determine the value of the presented information included in a window based on the URI of the information displayed in the window. The value determining unit 624 determines the value of the presented information included in each window based on a score previously determined for each of the URIs. For example, it is estimated that information posted on a website published on the Internet is less valuable than information on an intranet.

[0132] In this embodiment, the value determination unit 624 may generate the value map described above. The value map stores, for example, information indicating the range occupied by each of one or more high value areas included in the original image 200 and information indicating the value of the presented information included in each of the one or more high value areas in association with each other. The value map will be described in detail later.

[0133] The high value area determination unit 622 may be an example of a division unit. The value determination unit 624 may be an example of a value derivation unit. At least one of the one or more high value areas may be an example of at least a part of a plurality of sections. The presented information included in each high value area may be an example of information included in each section.

[0134] 7 is a schematic diagram of an example of a data structure of a data table 700. The data table 700 may be an example of the value map described above. The data table 700 is generated by the value map generating unit 582 and stored in the setting information storage unit 520, for example.

[0135] In this embodiment, the data table 700 includes one or more records corresponding to one or more high value areas. Each of the one or more records stores an area ID 722, which is identification information of a specific high value area, information indicating an area 724 occupied by the specific high value area in the original image 200, and information indicating a value 726 of presented information included in the specific high value area, in association with each other. In this embodiment, the area 724 occupied by the specific high value area is represented by, for example, the position of a representative point of the high value area in the original image 200, and the shape and size of the high value area.

[0136] 8 illustrates an example of an internal configuration of the anonymization processing unit 584. In this embodiment, the anonymization processing unit 584 includes a mode determination unit 820, a viewing area determination unit 832, a viewing level determination unit 834, a concealment area determination unit 842, and a concealment mode determination unit 844.

[0137] In this embodiment, the mode determination unit 820 determines the operation mode for the object of anonymization described above. As described above, examples of the operation mode for the object of anonymization include (a) a mode in which the anonymization process is executed as a rule, and the anonymization process is not executed exceptionally in an area estimated to be necessary for the user's work, and (b) a mode in which the anonymization process is not executed as a rule, and the anonymization process is executed exceptionally in an area estimated to be viewed by a person other than the user who exists near the display area 142.

[0138] In one embodiment, the mode determination unit 820 determines the operation mode based on the setting information stored in the setting information storage unit 520. In another embodiment, the mode determination unit 820 determines the operation mode based on an instruction from an administrator or a user of the user terminal 120.

[0139] In this embodiment, the viewing area determination unit 832 determines one or more viewing areas 360. For example, the viewing area determination unit 832 first identifies a specific position of the original image 200 as the above-described viewing position 362. Specifically, the viewing area determination unit 832 identifies the viewing position 362 based on (i) the position or range of an input by the user and / or (ii) the position or range of the user's line of sight.

[0140] In one embodiment, the viewing area determination unit 832 acquires information indicating a position or range of an input by a user from the operation information acquisition unit 576. Examples of the position or range of an input by a user include a position of a pointer or cursor in the original image 200, and a dragged range in the original image 200. The viewing area determination unit 832 specifies the position or range of the input as the viewing position 362. As described above, the position or range of an input by a user may be an example of a position or range designated by a user.

[0141] In another embodiment, the viewing area determination unit 832 acquires information indicating the position or range of a window used in association with an input by a user, for example, from the window control unit 534. Examples of the window used in association with an input include various windows corresponding to an input assistance program or an input method editing program (sometimes referred to as an IME). The viewing area determination unit 832 specifies the position or range of the above-mentioned window as the viewing position 362. The position or range of the window used in association with an input may be an example of a position or range designated by the user.

[0142] In still another embodiment, the viewing area determination unit 832 acquires information indicating the position or range of the user's gaze in the original image 200 from the gaze information acquisition unit 574. The viewing area determination unit 832 identifies the above-mentioned gaze position or range as the viewing position 362. As described above, the user's gaze position or range may be an example of a position or range referenced by the user.

[0143] Next, the viewing area determination unit 832 determines a specific range including the viewing position 362 as the viewing area 360. The viewing area determination unit 832 may determine the range of the viewing area 360 based on the value of the presentation information arranged in the vicinity of the viewing position 362. For example, the viewing area determination unit 832 determines the range of the viewing area 360 such that the size of the viewing area 360 becomes smaller as the value of the presentation information increases.

[0144] For example, if the viewing position 362 is the position of a pointer or cursor, the viewing position 362 indicates a specific position on the original image 200. In this case, the viewing area determination unit 832 may determine the range of the viewing area 360 based on the value of the presented information included in the high value area including the viewing position 362. For example, if the viewing position 362 is a dragged range, the viewing position 362 indicates a specific range on the original image 200. In this case, the viewing area determination unit 832 may determine the range of the viewing area 360 based on the value of the information included in the viewing position 362.

[0145] The viewing area determination unit 832 may determine the range of the viewing area 360 based on the operation history of the pointing device by the user and / or the tracking history of the user's gaze. Examples of the range of the viewing area 360 include the shape and size.

[0146] For example, the viewing area determination unit 832 determines whether the viewing position 362 is part of a horizontally written document or part of a vertically written document based on the user's operation history of the pointing device and / or the user's gaze tracking history. If the viewing position 362 is determined to be part of a horizontally written document, the viewing area determination unit 832 may determine the range of the viewing area 360 so that the shape of the viewing area 360 is horizontally long. If the viewing position 362 is determined to be part of a vertically written document, the viewing area determination unit 832 may determine the range of the viewing area 360 so that the shape of the viewing area 360 is vertically long.

[0147] For example, the viewing area determination unit 832 determines the user's input or line of sight movement speed based on the user's pointing device operation history and / or the user's line of sight tracking history. The viewing area determination unit 832 may adjust the range of the viewing area 360 based on at least one of the user's input or line of sight movement direction and movement speed.

[0148] For example, the viewing area determination unit 832 adjusts the range of the viewing area 360 so that the larger the size of the viewing area 360 is, the faster the user's input or the movement speed of the line of sight is. The viewing area determination unit 832 may adjust the range of the viewing area 360 so that the length from the viewing position 362 to the end on the movement direction side is longer than the length from the viewing position 362 to the end on the opposite side to the movement direction.

[0149] The viewing area determination unit 832 may adjust the range of the viewing area 360 so that the viewing area 360 does not interfere with the user's operation of the pointing device. For example, the viewing area determination unit 832 adjusts the range of the viewing area 360 so that at least one of the one or more viewing areas 360 is located at the position of the pointer or cursor described above. This prevents the pointer or cursor from being covered by an object for concealing the presented information. As a result, the above-mentioned object is prevented from interfering with the user's input operation.

[0150] In this embodiment, the viewing level determination unit 834 determines, for each of one or more viewing areas 360, the degree to which it is estimated that the user needs to view the area in order to continue the work (sometimes referred to as a viewing level). In one embodiment, the viewing level determination unit 834 may determine that all viewing areas 360 extracted by the viewing area determination unit 832 have the same viewing level. The viewing level determination unit 834 may determine that an area not extracted as a viewing area 360 by the viewing area determination unit 832 has a lower degree than the viewing area 360.

[0151] In another embodiment, the viewing level determination unit 834 may determine the viewing level of each of the one or more viewing areas 360 based on the operation history of the pointing device by the user and / or the tracking history of the user's gaze. For example, the viewing level determination unit 834 determines the viewing level of each of the one or more viewing areas 360 such that the longer the stay time of the pointer or cursor or the user's gaze, the higher the viewing level.

[0152] In this embodiment, the concealment area determination unit 842 determines an area to be concealed (sometimes referred to as a concealment area) in the original image 200. The concealment area determination unit 842 determines the range of the concealment area based on, for example, the value derived by the value determination unit 624 and the viewing position 362 or the viewing area 360 identified by the viewing area determination unit 832.

[0153] When the purpose is to prevent information leakage, it is desirable to conceal an area having a large value derived by the value determination unit 624 (for example, a high-value area). Also, it is desirable that the greater the value derived by the value determination unit 624, the stronger the concealment. On the other hand, the smaller the degree of concealment within the viewing area 360, the greater the convenience for the user. The concealment area determination unit 842 determines the concealment area by taking into account the balance between the two.

[0154] In one embodiment, the concealment area determination unit 842 determines that at least high value areas located outside the range of the viewing area 360 are to be concealed. In another embodiment, the concealment area determination unit 842 determines that at least high value areas located outside the range of the viewing area 360, the high value areas having a value greater than a predetermined first degree are to be concealed.

[0155] In yet another embodiment, when a high-value region is included within the viewing area 360, the anonymization region determination unit 842 determines that at least the high-value region is to be anonymized. The anonymization region determination unit 842 may determine that other regions within the viewing area 360 are not to be anonymized.

[0156] In yet another embodiment, when the viewing area 360 includes a high-value area whose value is greater than a second predetermined degree, the anonymization area determination unit 842 determines that at least the high-value area is to be anonymized. The anonymization area determination unit 842 may determine that other areas within the viewing area 360 are not to be anonymized.

[0157] In yet another embodiment, if the viewing area 360 does not include a high-value area whose value is greater than a predetermined second degree, the concealment area determination unit 842 determines that the viewing area 360 is not concealed. The second degree may be greater than the first degree described above.

[0158] In this embodiment, the concealment mode determination unit 844 determines the mode of concealment to be applied to each of one or more concealment regions. As described above, examples of the concealment mode include the type or method of concealment processing, the strength of concealment processing, and the like.

[0159] In one embodiment, the anonymization mode determination unit 844 determines the anonymization mode in each anonymization area based on the value of the presentation information included in each anonymization area. The anonymization mode determination unit 844 may acquire the value of the presentation information included in each anonymization area by referring to the value map generated by the value map generation unit 582.

[0160] The anonymization mode determination unit 844 determines the anonymization mode in each anonymization area so that, for example, the higher the value of the presented information, the lower the visibility of the anonymization method is adopted. The anonymization mode determination unit 844 determines the anonymization mode in each anonymization area so that, for example, the higher the value of the presented information, the stronger the anonymization process is.

[0161] In another embodiment, the concealment mode determination unit 844 may adjust the display mode of the presentation information displayed within the viewing area 360. For example, when the user tries to view the display area 142 while hiding the display area 142 with his / her body, the distance between the user and the display area 142 becomes closer. Therefore, even if the presentation information displayed in the display area 142 is made smaller, the user can recognize the presentation information. On the other hand, it becomes difficult for people other than the user who are present around the display area 142 to recognize the presentation information.

[0162] More specifically, the anonymization mode determination unit 844 adjusts the display mode of the presentation information displayed in the viewing area 360 based on the distance between the user and the display area 142. For example, the anonymization mode determination unit 844 acquires data output by the distance sensor 152. In this way, the anonymization mode determination unit 844 can acquire information indicating the distance between the user and the display area 142. When the distance between the user and the display area 142 becomes smaller than a predetermined value, the anonymization mode determination unit 844 detects the approach of the user to the display area 142. When the approach of the user to the display area 142 is detected, the anonymization mode determination unit 844 determines to reduce the size of at least one selected from the group consisting of character strings, pictures, figures, tables, photos, and videos, and parts of these, included in the viewing area 360.

[0163] In this case, the anonymization mode determination unit 844 may determine the size of the presentation information presented inside the viewing area 360 based on the distance between the user and the display area 142. The anonymization mode determination unit 844 may determine the size of the presentation information presented inside the viewing area 360 using a continuous function inversely proportional to the above distance. Note that the calculation of the above distance is not limited to the method using the distance sensor 152. In another embodiment, the anonymization mode determination unit 844 may estimate the above distance using the size of a bounding box of the user's face detected by face detection technology using a monocular camera and the size of a standard human face.

[0164] When a user attempts to view the display area 142 while hiding the display area 142 with his / her body, the distance between the user and the display area 142 becomes closer. Therefore, it becomes difficult for people other than the user who are present around the display area 142 to peek at the information presented in the display area 142. Therefore, when the approach of the user to the display area 142 is detected, the concealment mode determination unit 844 may determine to (i) increase the size of at least one selected from the group consisting of character strings, pictures, diagrams, tables, photos, and videos, and parts of these, contained within the viewing area 360, and / or (ii) increase the range of the viewing area 360.

[0165] In another specific example of adjusting the display mode of the presentation information displayed within the viewing area 360, the anonymization mode determination unit 844 adjusts the display mode of the presentation information displayed within the viewing area 360 based on the number of people present around the display area 142. For example, the anonymization mode determination unit 844 acquires information acquired by the environmental sensor 150 (e.g., image data of an image captured by the camera 154). The anonymization mode determination unit 844 analyzes the information using a known face detection technique to detect a human face. This allows the anonymization mode determination unit 844 to determine the number of people present around the display area 142.

[0166] The anonymization mode determination unit 844 determines the size of the presentation information to be presented inside the viewing area 360 based on, for example, the number of people present around the display area 142 or the number of detected human faces. The anonymization mode determination unit 844 may determine the size of the presentation information to be presented inside the viewing area 360 using a continuous function proportional to the number of people or faces.

[0167] In yet another specific example of adjusting the display mode of the presentation information displayed inside the viewing area 360, the anonymization mode determination unit 844 adjusts the display mode of the presentation information displayed inside the viewing area 360 based on the distance between the user and the display area 142 and the number of people existing around the display area 142. The anonymization mode determination unit 844 determines the size of the presentation information presented inside the viewing area 360 based on, for example, the distance between the user and the display area 142 and the number of people existing around the display area 142. The anonymization mode determination unit 844 may determine the size of the presentation information presented inside the viewing area 360 using a continuous function that is inversely proportional to the distance and proportional to the number of people or faces.

[0168] The viewing area determination unit 832 may be an example of a work position identification unit or a work area determination unit. The concealment area determination unit 842 may be an example of a target area determination unit or a proximity detection unit. The high value area may be an example of a section whose value is greater than a predetermined first degree. The high value area included within the viewing area 360 may be an example of a section whose value is greater than a predetermined second degree.

[0169] (An example of another embodiment) In this embodiment, the details of the information leakage prevention system 100 are described by taking as an example a case where the anonymization processing unit 584 refers to the value map generated by the value map generating unit 582 and determines the anonymization area and / or the anonymization mode. However, the method of using the value map is not limited to this embodiment.

[0170] In another embodiment, the value map is used to emphasize and present information that is highly valuable to the user. For example, the control device 170 has an operation mode for emphasizing information that is highly valuable to the user. The control device 170 uses the value map to extract presentation information that has a value exceeding a predetermined standard. The control device 170 generates a display image in which the extracted presentation information is emphasized more than other information. The control device 170 generates the display image by, for example, adjusting the color, pattern, size, font, brightness, contrast, and / or animation or movement of the extracted presentation information. The control device 170 controls the display device 140 to display the generated image in the display area 142.

[0171] 9 illustrates an example of the data structure of a data table 900. The data table 900 stores various information related to each of one or more viewing areas 360. The data table 900 is generated by the anonymization processing unit 584 and stored in the setting information storage unit 520, for example.

[0172] In this embodiment, the data table 900 includes one or more records corresponding to each of the one or more viewing areas 360. Each of the one or more records stores, in association with each other, an area ID 922 that is identification information of a specific viewing area 360, information indicating an area 924 that the specific viewing area 360 occupies in the original image 200, and information indicating a viewing level 926 of the specific viewing area 360. In this embodiment, the area 924 that the specific viewing area 360 occupies is represented by, for example, the position of a representative point of the viewing area 360 in the original image 200 and the shape and size of the viewing area 360.

[0173] 10 illustrates an example of a data structure of a data table 1000. The data table 1000 stores various settings related to the anonymization process. The data table 1000 is stored in, for example, the setting information storage unit 520. The data table 1000 is used, for example, to determine the anonymization area in the anonymization area determination unit 842. The data table 1000 is used, for example, to determine the anonymization mode in the anonymization mode determination unit 844.

[0174] As described above, it is preferable that anonymization is performed in an area where the value of the presented information is high (e.g., a high-value area). On the other hand, it is preferable that anonymization is not performed or the strength of anonymization is weak in the viewing area.

[0175] Thus, the data table 1000 stores information for defining whether or not anonymization is required 1026, depending on a combination of the level 1022 of the value of the presented information and the browsing level 1024 at the position where the presented information is arranged. Similarly, the data table 1000 stores information for defining the manner of anonymization 1028, depending on a combination of the level 1022 of the value of the presented information and the browsing level 1024 at the position where the presented information is arranged.

[0176] For example, when the value level of the specific presentation information is maximum, the specific presentation information is anonymized regardless of the browsing level at the position where the specific presentation information is located. In addition, in order to reliably prevent leakage of the specific presentation information, the anonymization mode is determined so that the specific presentation information is not disclosed at all.

[0177] For example, when the value level of the specific presentation information is the minimum, the specific presentation information is not anonymized regardless of the browsing level at the position where the specific presentation information is placed. For example, when the browsing level at the position where the specific presentation information is placed is the maximum, the specific presentation information is not anonymized regardless of the value of the specific presentation information.

[0178] 11 is a schematic diagram showing an example of information processing in the leakage prevention support unit 586. According to this embodiment, the outline of the processing for encouraging the user to take a specific action to prevent information leakage will be described using an example in which a person 24 other than the user 22 of the user terminal 120 is present behind the user 22.

[0179] In this embodiment, the person 24 is located to the left and behind the user 22. Therefore, when the user 22 rotates the user terminal 120 horizontally in a clockwise direction, the person 24 can easily view the display area 142. On the other hand, when the user 22 rotates the user terminal 120 horizontally in a counterclockwise direction, it becomes difficult for the person 24 to view the display area 142.

[0180] Therefore, according to the present embodiment, the leakage prevention support unit 586 controls the output image generation unit 588 to display the guidance image 1118 in a part of the display area 142, thereby controlling the user's behavior. Specifically, the leakage prevention support unit 586 adjusts the display position of the guidance image 1118 to prompt the user to rotate the user terminal 120 counterclockwise horizontally. In this way, the leakage prevention support unit 586 can prompt the user to change the horizontal orientation of the user terminal 120 by using the guidance image 1118.

[0181] The leakage prevention support unit 586 first acquires data of an image captured by the camera 154. The leakage prevention support unit 586 analyzes the image captured by the camera 154 to determine whether or not two or more people are present around the display area 142. If two or more people are present around the display area 142, the leakage prevention support unit 586 identifies the relative positional relationship between the people. The leakage prevention support unit 586 determines the rotation direction of the user terminal 120 in which information leakage is further suppressed based on the relative positional relationship between the objects. As described above, in this embodiment, information leakage is further suppressed by rotating horizontally counterclockwise.

[0182] The leakage prevention support unit 586 controls the output image generation unit 588 to output an image 1102 to the display area 142. In the image 1102, a part of the right side of the image output area 214 is covered with a guidance image 1118. This enables the leakage prevention support unit 586 to prompt the user to rotate the user terminal 120 counterclockwise.

[0183] When the user rotates the user terminal 120 counterclockwise, the leakage prevention support unit 586 controls the output image generation unit 588 to output the image 1104 in the display area 142. The guidance image 1118 is not displayed in the image 1104, and the user can continue working as usual.

[0184] On the other hand, when the user rotates the user terminal 120 clockwise, the leakage prevention support unit 586 controls the output image generation unit 588 to output the image 1106 to the display area 142. A larger portion of the image 1106 is covered by the guidance image 1118 compared to the image 1102. This allows the leakage prevention support unit 586 to prompt the user to rotate the user terminal 120 counterclockwise.

[0185] 12 shows an outline of another example of information processing in the leakage prevention support unit 586. According to this embodiment, an overview of processing for automatically adjusting the range of the viewing area 360 will be described.

[0186] According to this embodiment, at time ta, viewing area 360 is located at the lower right edge of image output area 214. Therefore, leakage prevention support unit 586 determines to gradually move the position of viewing area 360 closer to the center of display area 142. As viewing area 360 moves, leakage prevention support unit 586 also moves the position of window 240 corresponding to viewing area 360.

[0187] According to this embodiment, the leakage prevention support unit 586 controls the output image generation unit 588 so that the image output area 214 of the window 240 and the viewing area 360 moves from the lower right edge to the lower center from time ta to time tb. Similarly, the leakage prevention support unit 586 controls the output image generation unit 588 so that the window 240 and the viewing area 360 moves from the lower center to the center from time tb to time tc.

[0188] (An example of another embodiment) In the present embodiment, an overview of the process for automatically adjusting the range of viewing area 360 has been described by taking as an example a case in which the range of viewing area 360 is automatically adjusted by automatically moving the position of viewing area 360. However, the process for automatically adjusting the range of viewing area 360 is not limited to the present embodiment.

[0189] In another embodiment, the anonymization processing unit 584 or the leakage prevention support unit 586 may adjust the range of the viewing area 360 in consideration of a delay in display caused by the anonymization process. As described above, according to the user terminal 120 according to the present embodiment, the range of the viewing area 360 also changes with the movement of the position of the presentation information itself to be anonymized. For example, when a part of a video being played is anonymized, or when a part of a document being edited is anonymized, the position of the presentation information to be anonymized changes.

[0190] Therefore, the anonymization processing unit 584 or the leakage prevention support unit 586, for example, first estimates a movement vector of the presentation information to be anonymized. In addition, the anonymization processing unit 584 or the leakage prevention support unit 586 estimates a display delay time. Next, the anonymization processing unit 584 or the leakage prevention support unit 586 estimates a position of the presentation information to be anonymized at the time when the delay time has elapsed based on the movement vector and the delay time. The anonymization processing unit 584 or the leakage prevention support unit 586 determines the range of the viewing area 360 or the range in which the anonymization object is to be superimposed based on the estimated position.

[0191] The above-mentioned movement vector is determined, for example, by identifying an instance of an object by image recognition and estimating the movement vector at two times. The above-mentioned movement vector is derived, for example, by estimating the corresponding coordinate transformation matrix RT or the coordinate transformation matrix RT with the smallest deviation based on the gradient state of the gradation in a BOX range of a certain image RECT unit (quadrilateral) at two times.

[0192] 13 shows an outline of another example of a method for dividing the original image 200. In this embodiment, the image output area 214 is divided into a plurality of unit areas 1310. The plurality of unit areas 1310 have, for example, the same shape and size.

[0193] In this embodiment, the high value area determining unit 622 may determine whether each of the plurality of unit areas 1310 corresponds to a high value area. The value determining unit 624 may determine the value of the presented information included in each of the plurality of unit areas 1310.

[0194] According to another embodiment, the value determining unit 624 first determines the value of the presented information included in each of the plurality of unit regions 1310. Next, the high value region determining unit 622 determines whether each of the plurality of unit regions 1310 is a high value region based on the value of each of the plurality of unit regions 1310.

[0195] In this embodiment, the viewing area determination unit 832 may determine whether or not each of the multiple unit areas 1310 corresponds to a viewing area. The viewing level determination unit 834 may determine a viewing level for each of the multiple unit areas 1310. The viewing level determination unit 834 may determine a viewing level for an area of ​​the multiple unit areas 1310 that is determined to correspond to a viewing area.

[0196] In this embodiment, the concealment region determination unit 842 may determine whether or not each of the multiple unit regions 1310 corresponds to a concealment region. The concealment mode determination unit 844 may determine the concealment mode for each of the multiple unit regions 1310. The concealment mode determination unit 844 may determine the concealment mode for an area determined to correspond to a concealment region among the multiple unit regions 1310.

[0197] The unit area 1310 may be an example of a partition.

[0198] 14 shows an example of a computer 3000 in which multiple aspects of the present invention may be embodied in whole or in part. At least a part of the information leakage prevention system 100 may be realized by the computer 3000. For example, at least a part of the user terminal 120 is realized by the computer 3000 or a part thereof. For example, at least a part of the user terminal 120, the control device 170 is realized by the computer 3000 or a part thereof.

[0199] A program installed on the computer 3000 may cause the computer 3000 to function as or perform operations associated with an apparatus according to an embodiment of the present invention or one or more "parts" of the apparatus, and / or to perform a process or steps of the process according to an embodiment of the present invention. Such a program may be executed by the CPU 3012 to cause the computer 3000 to perform certain operations associated with some or all of the blocks of the flowcharts and block diagrams described herein.

[0200] The computer 3000 according to this embodiment includes a CPU 3012, a RAM 3014, a GPU 3016, and a display device 3018, which are connected to each other by a host controller 3010. The computer 3000 also includes input / output units such as a communication interface 3022, a hard disk drive 3024, a DVD-ROM drive 3026, and an IC card drive, which are connected to the host controller 3010 via an input / output controller 3020. The computer also includes legacy input / output units such as a ROM 3030 and a keyboard 3042, which are connected to the input / output controller 3020 via an input / output chip 3040.

[0201] The CPU 3012 operates according to a program stored in the ROM 3030 and the RAM 3014, thereby controlling each unit. The GPU 3016 acquires image data generated by the CPU 3012 into a frame buffer or the like provided in the RAM 3014 or into the GPU 3016 itself, and causes the image data to be displayed on the display device 3018.

[0202] The communications interface 3022 communicates with other electronic devices via a network. The hard disk drive 3024 stores programs and data used by the CPU 3012 in the computer 3000. The DVD-ROM drive 3026 reads programs or data from the DVD-ROM 3001 and provides the programs or data to the hard disk drive 3024 via the RAM 3014. The IC card drive reads programs and data from an IC card and / or writes programs and data to an IC card.

[0203] The ROM 3030 stores therein a boot program or the like executed by the computer 3000 upon activation, and / or a program that depends on the hardware of the computer 3000. The input / output chip 3040 may also connect various input / output units to the input / output controller 3020 via a parallel port, a serial port, a keyboard port, a mouse port, etc.

[0204] The programs are provided by a computer-readable storage medium such as a DVD-ROM 3001 or an IC card. The programs are read from the computer-readable storage medium, installed in the hard disk drive 3024, the RAM 3014, or the ROM 3030, which are also examples of computer-readable storage media, and executed by the CPU 3012. Information processing described in these programs is read by the computer 3000, and brings about cooperation between the programs and the various types of hardware resources described above. An apparatus or method may be constructed by realizing an operation or processing of information according to the use of the computer 3000.

[0205] For example, when communication is performed between computer 3000 and an external device, CPU 3012 may execute a communication program loaded in RAM 3014 and instruct communication interface 3022 to perform communication processing based on the processing described in the communication program. Under the control of CPU 3012, communication interface 3022 reads transmission data stored in a transmission buffer area provided in RAM 3014, hard disk drive 3024, DVD-ROM 3001, or a recording medium such as an IC card, and transmits the read transmission data to the network, or writes reception data received from the network to a reception buffer area or the like provided on the recording medium.

[0206] Furthermore, CPU 3012 may cause all or a necessary portion of a file or database stored in an external recording medium such as hard disk drive 3024, DVD-ROM drive 3026 (DVD-ROM 3001), an IC card, etc. to be read into RAM 3014, and perform various types of processing on the data on RAM 3014. CPU 3012 may then write back the processed data to the external recording medium.

[0207] Various types of information, such as various types of programs, data, tables, and databases, may be stored in the recording medium and undergo information processing. The CPU 3012 may perform various types of processing on the data read from the RAM 3014, including various types of operations, information processing, conditional judgment, conditional branching, unconditional branching, information search / replacement, etc., as described throughout this disclosure and specified by the instruction sequence of the program, and writes back the results to the RAM 3014. The CPU 3012 may also search for information in a file, database, etc. in the recording medium. For example, when a plurality of entries each having an attribute value of a first attribute associated with an attribute value of a second attribute are stored in the recording medium, the CPU 3012 may search for an entry whose attribute value of the first attribute matches a specified condition from among the plurality of entries, read the attribute value of the second attribute stored in the entry, and thereby obtain the attribute value of the second attribute associated with the first attribute that satisfies a predetermined condition.

[0208] The above-described programs or software modules may be stored in a computer-readable storage medium on the computer 3000 or in the vicinity of the computer 3000. In addition, a recording medium such as a hard disk or a RAM provided in a server system connected to a dedicated communication network or the Internet can be used as a computer-readable storage medium, thereby providing the above-described programs to the computer 3000 via the network.

[0209] Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments. It is clear to those skilled in the art that various modifications or improvements can be made to the above embodiments. In addition, the matters described for a specific embodiment can be applied to other embodiments to the extent that they are not technically inconsistent. It is clear from the claims that such modified or improved forms can also be included in the technical scope of the present invention.

[0210] It should be noted that the order of execution of each process, such as operations, procedures, steps, and stages, in the devices, systems, programs, and methods shown in the claims, specifications, and drawings is not specifically stated as "before," "prior to," etc., and may be realized in any order unless the output of a previous process is used in a later process. Even if the operational flow in the claims, specifications, and drawings is explained using "first," "next," etc. for convenience, it does not mean that it is essential to perform the process in this order.

[0211] For example, the present specification discloses the following: (Item A) An information processing device that conceals a part of a generated image generated by an image generating device and generates a display image to be displayed on an image display device, a value derivation unit that derives a value of information included in each of at least a portion of the multiple sections set in the generated image; a work position identification unit that identifies a work position, which is one or more positions or ranges arranged in a part of the generated image, and which is (i) a position or range of an input by a user of the image display device and / or (ii) a position or range of the user's line of sight; a target area determination unit that determines a target area, which is an area to be concealed, based on the value derived by the value derivation unit and the work position identified by the work position identification unit; An information processing device comprising: (Item B) 1. A method for generating a display image to be displayed on an image display device by concealing a part of a generated image generated by an image generating device, comprising: A value derivation step of deriving a value of information contained in each of at least a portion of the multiple sections set in the generated image; a work position identification step of identifying one or more positions or ranges arranged in a part of the generated image, the work position being (i) a position or range of an input by a user of the image display device and / or (ii) a position or range of the user's line of sight; a target area determination step of determining a target area, which is an area to be concealed, based on the value derived by the value derivation unit and the work position identified in the work position identification step; The method comprising:

[0212] For example, the present specification discloses the following: (Item B-1) An information processing device that conceals a part of a generated image generated by an image generating device and generates a display image to be displayed on an image display device, A division unit that divides the generated image into a plurality of partitions; a value derivation unit that derives a value of information included in each of the plurality of sections for at least a portion of the sections; a work position identification unit that identifies a work position, which is one or more positions or ranges arranged in a part of the generated image, and which is (i) a position or range of an input by a user of the image display device and / or (ii) a position or range of the user's line of sight; a target area determination unit that determines a target area, which is an area to be concealed, based on the value derived by the value derivation unit and the work position identified by the work position identification unit; An information processing device comprising: (Item B-2) A working area determination unit is further provided that is disposed in a part of the generated image and determines a working area that is an area including the working position, The target region determination unit is (a) determining that at least one of the plurality of partitions is to be concealed, the partition being located outside the range of the working area and having a value greater than a predetermined first degree; (b) determining that the working area is not to be concealed if the working area does not include any of the plurality of areas whose value is greater than a second predetermined degree; (c) when the working area includes a partition having the value greater than the second degree among the plurality of partitions, determining that at least the partition having the value greater than the second degree is to be concealed; The second degree is greater than the first degree. The information processing device according to item B-1. (Item B-3) The work area determination unit determines the range of the work area based on the value derived by the value derivation unit, which is (i) a value of information included in a section including the work position among the plurality of sections, or (ii) a value of information included in the work position. The information processing device according to item B-2. (Item B-4) and a mode determination unit that determines a mode of concealment of the target region based on the value derived by the value derivation unit, the value being a value of the information included in the target region. The information processing device according to item B-1. (Item B-5) a proximity detection unit that detects the proximity of the user to the image display device when a distance between the user and the image display device becomes smaller than a predetermined value, the mode determination unit determines, when the approach of the user to the image display device is detected, to reduce a size of at least one selected from the group consisting of a character string, a picture, a diagram, a table, a photograph, a video, and a part thereof included within the working area. An information processing device according to item B-4. (Item B-6) The value derivation unit, Deriving a value of the information contained in each of the plurality of partitions based on at least one of: (a) the type of information contained in each partition; (b) the operation history of the pointing device by the user in each partition; (c) the tracking history of the user's gaze in each partition; (d) a flag assigned to the window to which each partition belongs; (e) the type of application that displays information in the window to which each partition belongs; and (f) the URI of the information displayed in the window to which each partition belongs. The information processing device according to item B-1. (Item B-7) A program for causing a computer to function as the information processing device according to any one of items B-1 to B-6. (Item B-8) 1. A method for generating a display image to be displayed on an image display device by concealing a part of a generated image generated by an image generating device, comprising: A segmentation step in which a computer divides the generated image into a plurality of partitions; A value derivation step in which the computer derives a value of information included in each of the plurality of sections for at least a portion of the plurality of sections; A work position identification step in which the computer identifies a work position, which is one or more positions or ranges arranged in a part of the generated image, and which is (i) a position or range of an input by a user of the image display device and / or (ii) a position or range of the user's line of sight; a target area determination step in which the computer determines a target area, which is an area to be concealed, based on the value derived by the value derivation unit and the work position identified in the work position identification step; The method comprising: [Explanation of symbols]

[0213] 22 users 24 People 100 Information Leakage Prevention System 120 User terminals 130 Case 140 Display device 142 Display area 150 Environmental Sensors 152 Distance Sensor 154 Cameras 156 Radio Detector 160 Input Devices 170 Control device 200 original images 210 Window 212 Control Area 214 Image Output Area 216 Presentation information 222 Objects 224 Objects 230 Window 232 Control Area 234 Image Output Area 236 Presentation information 240 Window 242 Control Area 244 Image Output Area 246 Presentation information 300 output images 318 Objects 326 Objects 328 Objects 338 Objects 348 Objects 360 Viewing Area 362 Viewing position 520 Setting information storage section 532 Program Control Unit 534 Window control section 540 Input control section 550 Output control section 560 Original Image Generation Unit 572 Window Information Acquisition Unit 574 Gaze information acquisition unit 576 Operation information acquisition section 580 Image Processing Unit 582 Value Map Generation Unit 584 Concealment Processing Unit 586 Leak Prevention Support Department 588 Output Image Generation Unit 622 High value area determination department 624 Value Determination Department 700 Data Table 722 Area ID 724 Range 726 Value 820 Mode determination unit 832 Viewing area determination unit 834 Viewing Level Determination Unit 842 Concealment area determination unit 844 Concealment mode determination unit 900 Data Table 922 Area ID 924 Range 926 View Level 1000 Data Table 1022 Level 1024 View Level 1026 Necessity 1028 Aspects 1102 images 1104 images 1106 images 1118 Guidance Image 1310 Unit Area 3000 Computers 3001 DVD-ROM 3010 Host Controller 3012 CPU 3014 RAM 3016 GPU 3018 Display Device 3020 I / O Controller 3022 Communication Interface 3024 Hard Disk Drive 3026 DVD-ROM drive 3030 ROM 3040 I / O chip 3042 Keyboard

Claims

1. An information processing device that generates a display image to be displayed on an image display device by concealing a part of a generated image generated by an image generating device, a work position specification unit that specifies a work position, which is one or more positions or ranges arranged in a part of the generated image and is a position or range designated or referenced by a user of the image display device; A division unit that divides the generated image into a plurality of partitions; a value derivation unit that derives a value of information included in each of the plurality of sections for at least a portion of the sections; a target area determination unit that determines a target area, which is an area to be concealed, based on the value derived by the value derivation unit and the work position identified by the work position identification unit; a work area determination unit that is disposed in a portion of the generated image and that determines a work area that is an area including the work position; Equipped with The target region determination unit is (a) determining that at least one of the plurality of sections is to be concealed, the section being located outside the range of the working area and having a value greater than a predetermined first degree; (b) determining that the work area is not to be concealed if the work area does not include any of the plurality of areas whose value is greater than a second predetermined degree; (c) when the working area includes a section among the plurality of sections whose value is greater than the second degree, determining that at least the section whose value is greater than the second degree is to be concealed; The second degree is greater than the first degree. Information processing device.

2. The work area determination unit determines a range of the work area based on the value derived by the value derivation unit, which is (i) a value of information included in a section including the work position among the plurality of sections, or (ii) a value of information included in the work position. The information processing device according to claim 1 .

3. and a mode determining unit that determines a mode of concealment of the target region based on the value derived by the value derivation unit, the value being a value of the information included in the target region. The information processing device according to claim 1 .

4. a proximity detection unit that detects the proximity of the user to the image display device when a distance between the user and the image display device becomes smaller than a predetermined value, the mode determination unit determines, when the approach of the user to the image display device is detected, to reduce a size of at least one selected from the group consisting of a character string, a picture, a diagram, a table, a photograph, a video, and a part thereof included in the working area. The information processing device according to claim 3 .

5. A program for causing a computer to function as the information processing device according to any one of claims 1 to 4.

6. 1. A method for generating a display image to be displayed on an image display device by concealing a part of a generated image generated by an image generating device, comprising: a work position identification step in which a computer identifies a work position, which is one or more positions or ranges located in a portion of the generated image and which is a position or range designated or referenced by a user of the image display device; A segmentation step of dividing the generated image into a plurality of partitions; A value derivation step of deriving a value of information contained in each of the plurality of sections for at least a portion of the plurality of sections; a target area determination step in which the computer determines a target area, which is an area to be concealed, based on the value derived in the value derivation step and the work position identified in the work position identification step; A working area determination step in which the computer determines a working area that is a region that is arranged in a part of the generated image and includes the working position; having The target region determination step includes: (a) determining that at least one of the plurality of sections is to be concealed, the section being located outside the range of the working area and having a value greater than a predetermined first degree; (b) determining that the work area is not to be concealed if the work area does not include any of the plurality of areas whose value is greater than a second predetermined degree; (c) determining, when the work area includes a partition having the value greater than the second degree among the plurality of partitions, that the partition having the value greater than the second degree is to be concealed; having The second degree is greater than the first degree. method.

Images